00002000:00010000:3.0:1762166971.085845:0:28434:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7f:0x0] updating lvb mtime from disk: 1762166971 -> 1762166971 00002000:00010000:3.0:1762166971.085851:0:28434:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7f:0x0] updating lvb atime from disk: 1762166969 -> 1762166969 00002000:00010000:3.0:1762166971.085854:0:28434:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7f:0x0] updating lvb ctime from disk: 1762166971 -> 1762166971 00002000:00010000:3.0:1762166971.085861:0:28434:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7f:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166971.085919:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+19:3635:x1847765449578624:12345-0@lo:2:osp-syn-0-1.0 Request processed in 186us (353us total) trans 21474842858 rc 0/0 00000100:00100000:3.0:1762166971.085944:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18089 00000100:00100000:3.0:1762166971.085966:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18092 00000100:00100000:3.0:1762166971.085976:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+16:3634:x1847765449579008:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166971.086071:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+18:3634:x1847765449579008:12345-0@lo:2:osp-syn-0-1.0 Request processed in 94us (358us total) trans 21474842861 rc 0/0 00000100:00100000:3.0:1762166971.086085:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18092 00000100:00100000:3.0:1762166971.086108:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449578368 00000100:00100000:3.0:1762166971.086112:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449578368 00000100:00100000:3.0:1762166971.086141:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18093 00000100:00100000:3.0:1762166971.086153:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5804700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+13:3633:x1847765449578368:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:3.0:1762166971.086208:0:28434:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa7d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166971.086215:0:28434:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa7d:0x0] updating lvb mtime from disk: 1762166971 -> 1762166971 00002000:00010000:3.0:1762166971.086223:0:28434:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa7d:0x0] updating lvb atime from disk: 1762166968 -> 1762166968 00002000:00010000:3.0:1762166971.086227:0:28434:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa7d:0x0] updating lvb ctime from disk: 1762166971 -> 1762166971 00002000:00010000:3.0:1762166971.086230:0:28434:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa7d:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166971.086280:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5804700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+16:3633:x1847765449578368:12345-0@lo:2:osp-syn-1-1.0 Request processed in 130us (255us total) trans 17179875739 rc 0/0 00000100:00100000:3.0:1762166971.086294:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18093 00000100:00100000:3.0:1762166971.086313:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18096 00000100:00100000:3.0:1762166971.086324:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5806a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+15:3636:x1847765449577856:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166971.086403:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5806a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+18:3636:x1847765449577856:12345-0@lo:2:osp-syn-1-1.0 Request processed in 80us (216us total) trans 17179875741 rc 0/0 00000100:00100000:3.0:1762166971.086411:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18096 00000004:00080000:3.0:1762166971.086460:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc47b6a00/2, rc 0, transno 17179875741 00000100:00100000:3.0:1762166971.086465:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc47b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449577856:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1762166971.086501:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc47b7480/2, rc 0, transno 17179875742 00000100:00100000:3.0:1762166971.086506:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc47b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449578240:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1762166971.086569:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc47b4380/2, rc 0, transno 17179875743 00000100:00100000:3.0:1762166971.086579:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc47b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449578752:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166971.114346:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450041216 00000100:00100000:3.0:1762166971.114356:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450041216 00000100:00100000:3.0:1762166971.114404:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11652 00000100:00100000:3.0:1762166971.114415:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945d011eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+526:61766:x1847765450041216:12345-192.168.204.38@tcp:35:fsx.0 00000100:00100000:3.0:1762166971.114691:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945d011eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+527:61766:x1847765450041216:12345-192.168.204.38@tcp:35:fsx.0 Request processed in 278us (489us total) trans 4294991279 rc 0/0 00000100:00100000:3.0:1762166971.114699:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11652 00000100:00100000:3.0:1762166971.125210:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450041600 00000100:00100000:3.0:1762166971.125219:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450041600 00000100:00100000:3.0:1762166971.125265:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 822 00000100:00100000:3.0:1762166971.125272:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+529:2419:x1847765450041600:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166971.125283:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166971.125302:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7ba00/0x2f180c4effba746d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8892 expref: 529 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.125316:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc718dd00) 00010000:00010000:3.0:1762166971.125320:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166971.125370:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+528:2419:x1847765450041600:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 97us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166971.125378:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 822 00000100:00100000:3.0:1762166971.129338:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450042240 00000100:00100000:3.0:1762166971.129345:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450042240 00010000:00010000:3.0:1762166971.129373:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63000/0x2f180c4effba7482 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5f9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8899 expref: 532 pid: 6494 timeout: 690 lvb_type: 0 00000100:00100000:3.0:1762166971.129408:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9189 00000100:00100000:3.0:1762166971.129418:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b22680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+532:2418:x1847765450042240:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166971.129432:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166971.129439:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63000/0x2f180c4effba7482 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5f9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8899 expref: 532 pid: 6494 timeout: 690 lvb_type: 0 00010000:00010000:3.0:1762166971.129452:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63000/0x2f180c4effba7482 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5f9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8899 expref: 532 pid: 6494 timeout: 690 lvb_type: 0 00010000:00010000:3.0:1762166971.129473:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63000/0x2f180c4effba7482 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5f9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8899 expref: 532 pid: 6494 timeout: 690 lvb_type: 0 00010000:00010000:3.0:1762166971.129528:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5f9:0x0].0x0 (ffff945bc809b900) 00010000:00010000:3.0:1762166971.129533:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63a00/0x2f180c4effba7497 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5f9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166971.129542:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63a00/0x2f180c4effba7497 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5f9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166971.129548:0:6479:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63a00/0x2f180c4effba7497 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x5f9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166971.129580:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166971.129625:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b22680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+531:2418:x1847765450042240:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 208us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166971.129632:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9189 00000100:00100000:3.0:1762166971.131085:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450042496 00000100:00100000:3.0:1762166971.131093:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450042496 00000100:00100000:3.0:1762166971.131138:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11653 00000100:00100000:3.0:1762166971.131147:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+530:61799:x1847765450042496:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:3.0:1762166971.131373:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+531:61799:x1847765450042496:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 229us (343us total) trans 4294991283 rc 0/0 00000100:00100000:3.0:1762166971.131379:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11653 00000100:00100000:3.0:1762166971.134233:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.135546:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.137631:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450043520 00000100:00100000:3.0:1762166971.137647:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450043520 00000100:00100000:3.0:1762166971.137731:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18105 00000100:00100000:3.0:1762166971.137763:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450043520:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:3.0:1762166971.137824:0:8380:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8472400/0x2f180c4effba74e4 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.137883:0:8380:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8800/0x2f180c4effba7386 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e883e expref: 21 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.137894:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166971.137898:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166971.137903:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472400/0x2f180c4effba74e4 lrc: 4/1,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.137945:0:8380:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8800/0x2f180c4effba7386 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e883e expref: 21 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.137962:0:8380:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8800/0x2f180c4effba7386 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e883e expref: 21 pid: 9168 timeout: 690 lvb_type: 0 00000100:00100000:3.0:1762166971.137979:0:8380:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc48aa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8380:1847765449579648:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166971.138067:0:8380:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a19c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166971.139036:0:8380:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc48aa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8380:1847765449579648:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166971.139059:0:8380:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc8472400/0x2f180c4effba74e4 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.139527:0:8380:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc8472400/0x2f180c4effba74e4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.139542:0:8380:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8472400/0x2f180c4effba74e4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.139573:0:8380:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8472400/0x2f180c4effba74e4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.139586:0:8380:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472400/0x2f180c4effba74e4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.139616:0:8380:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc8472400/0x2f180c4effba74e4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.139695:0:8380:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8472400 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166971.139702:0:8380:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8472400/0x2f180c4effba74e4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.139713:0:8380:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8472400/0x2f180c4effba74e4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.139732:0:8380:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc8472400/0x2f180c4effba74e4 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.139760:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8472400/0x2f180c4effba74e4 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166971.139838:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450043520:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 2087us (2261us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166971.139852:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18105 00000100:00100000:3.0:1762166971.141533:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450044160 00000100:00100000:3.0:1762166971.141539:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450044160 00000100:00100000:3.0:1762166971.141580:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450044288 00000100:00100000:3.0:1762166971.141585:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450044288 00000100:00100000:3.0:1762166971.169982:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.174118:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.177281:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.179033:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.179066:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.184173:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.187400:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.189040:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.195806:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.198049:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.201282:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.207966:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.209607:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.212917:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.219041:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.220330:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.222676:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450047872 00000100:00100000:3.0:1762166971.222685:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450047872 00000100:00100000:3.0:1762166971.222741:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1441 00000100:00100000:3.0:1762166971.222753:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+16:2418:x1847765450047872:12345-192.168.204.38@tcp:4:lfs.0 00002000:00010000:3.0:1762166971.222801:0:23942:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa82:0x0] initial LVB size: 188416, mtime: 0x690888bb, atime: 0x0, ctime: 0x690888bb, blocks: 0x108 00010000:00010000:3.0:1762166971.222809:0:23942:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc8472c00/0x2f180c4effba755b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa82:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.222820:0:23942:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166971.222822:0:23942:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166971.222828:0:23942:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8472c00/0x2f180c4effba755b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa82:0x0].0x0 rrc: 2 type: EXT [229376->245759] (req 229376->245759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.222840:0:23942:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc8472c00/0x2f180c4effba755b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa82:0x0].0x0 rrc: 2 type: EXT [229376->245759] (req 229376->245759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166971.224263:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa82:0x0] updating lvb size from disk: 188416 -> 244463 00002000:00010000:3.0:1762166971.224268:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa82:0x0] updating lvb blocks from disk: 264 -> 296 00010000:00010000:3.0:1762166971.224278:0:23942:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc8472c00/0x2f180c4effba755b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa82:0x0].0x0 rrc: 2 type: EXT [229376->245759] (req 229376->245759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.224288:0:23942:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8472c00/0x2f180c4effba755b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa82:0x0].0x0 rrc: 2 type: EXT [229376->245759] (req 229376->245759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.224296:0:23942:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc8472c00/0x2f180c4effba755b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa82:0x0].0x0 rrc: 2 type: EXT [229376->245759] (req 229376->245759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.224303:0:23942:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8472c00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166971.224307:0:23942:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc8472c00/0x2f180c4effba755b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa82:0x0].0x0 rrc: 2 type: EXT [229376->245759] (req 229376->245759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.224316:0:23942:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc8472c00/0x2f180c4effba755b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa82:0x0].0x0 rrc: 2 type: EXT [229376->245759] (req 229376->245759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.224332:0:23942:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc8472c00/0x2f180c4effba755b lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa82:0x0].0x0 rrc: 2 type: EXT [229376->245759] (req 229376->245759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.224340:0:23942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc8472c00/0x2f180c4effba755b lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa82:0x0].0x0 rrc: 2 type: EXT [229376->245759] (req 229376->245759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166971.224428:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+16:2418:x1847765450047872:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 1675us (1805us total) trans 21474842867 rc 0/0 00000100:00100000:3.0:1762166971.224437:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1441 00000100:00100000:3.0:1762166971.225874:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000001:00080000:3.0:1762166971.227038:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294991286 is committed 00000100:00100000:3.0:1762166971.237600:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18122 00000100:00100000:3.0:1762166971.237620:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf7838e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+21:2416:x1847765450048384:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:3.0:1762166971.237692:0:35248:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8472400/0x2f180c4effba7562 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.237713:0:35248:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166971.237720:0:35248:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166971.237730:0:35248:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472400/0x2f180c4effba7562 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.237762:0:35248:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8472400/0x2f180c4effba7562 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.237819:0:35248:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8472400/0x2f180c4effba7562 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.237850:0:35248:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472400/0x2f180c4effba7562 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.237860:0:35248:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc8472400/0x2f180c4effba7562 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.237869:0:35248:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8472400 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166971.237879:0:35248:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8472400/0x2f180c4effba7562 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.237920:0:35248:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8472400/0x2f180c4effba7562 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.237980:0:35248:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc8472400/0x2f180c4effba7562 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.238014:0:35248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8472400/0x2f180c4effba7562 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166971.238152:0:35248:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf7838e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+21:2416:x1847765450048384:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 531us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166971.238164:0:35248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18122 00000100:00100000:3.0:1762166971.242735:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.242806:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.251890:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.253868:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.257647:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.261288:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.263152:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450050944 00000100:00100000:3.0:1762166971.263164:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450050944 00000100:00100000:3.0:1762166971.263230:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18131 00000100:00100000:3.0:1762166971.263238:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450050944:12345-192.168.204.38@tcp:2:lfs.0 00000100:00100000:3.0:1762166971.263374:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450051072 00000100:00100000:3.0:1762166971.263381:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450051072 00000100:00100000:3.0:1762166971.263420:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18132 00000100:00100000:3.0:1762166971.263430:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450051072:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:3.0:1762166971.263604:0:8382:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166971.263610:0:8382:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166970 -> 1762166971 00002000:00010000:3.0:1762166971.263613:0:8382:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166970 -> 1762166970 00002000:00010000:3.0:1762166971.263616:0:8382:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166971 -> 1762166971 00002000:00010000:3.0:1762166971.263619:0:8382:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00000100:00100000:3.0:1762166971.263679:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450051072:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 248us (338us total) trans 21474842869 rc 0/0 00000100:00100000:3.0:1762166971.263913:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18132 00000100:00100000:3.0:1762166971.265423:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450051456 00000100:00100000:3.0:1762166971.265433:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450051456 00000100:00100000:3.0:1762166971.265516:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11654 00000100:00100000:3.0:1762166971.265528:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff2fd450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+531:61799:x1847765450051456:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:3.0:1762166971.265616:0:19593:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x240000404:0x5eb:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62000/0x2f180c4effba74c8 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e88bc expref: 531 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.265664:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effba75af lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166971.265680:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effba700d lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e86d2 expref: 531 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.265689:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7aa00/0x2f180c4effba7593 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e88fb expref: 531 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.265697:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effba75af lrc: 5/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166971.265736:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7aa00/0x2f180c4effba7593 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e88fb expref: 531 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.265752:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7aa00/0x2f180c4effba7593 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e88fb expref: 531 pid: 6494 timeout: 690 lvb_type: 0 00000100:00100000:3.0:1762166971.265768:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bbb480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449581312:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166971.265859:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effba700d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e86d2 expref: 531 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.265869:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effba700d lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e86d2 expref: 531 pid: 6494 timeout: 690 lvb_type: 0 00000100:00100000:3.0:1762166971.265879:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bb9880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449581440:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166971.265903:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a19c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166971.267044:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bbb480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449581312:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166971.268216:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bb9880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449581440:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166971.268239:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effba75af lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166971.268496:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effba75af lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166971.268505:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effba75af lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166971.268603:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472c00/0x2f180c4effba75b6 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5f9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166971.268617:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7b000/0x2f180c4effba7515 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x5f9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e88df expref: 529 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.268626:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472c00/0x2f180c4effba75b6 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x5f9:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166971.268653:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7b000/0x2f180c4effba7515 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5f9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e88df expref: 529 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.268670:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7b000/0x2f180c4effba7515 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5f9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e88df expref: 529 pid: 6494 timeout: 690 lvb_type: 0 00000100:00100000:3.0:1762166971.268723:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bb9880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449581568:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166971.268786:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a19c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166971.269713:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bb9880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449581568:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166971.269725:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472c00/0x2f180c4effba75b6 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5f9:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166971.270298:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472c00/0x2f180c4effba75b6 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5f9:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166971.270308:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472c00/0x2f180c4effba75b6 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5f9:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:3.0:1762166971.270704:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bb9880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449581696:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166971.270741:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166971.270770:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccac7a240 going to sleep for 11 seconds 00000100:00100000:3.0:1762166971.271255:0:19593:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 17179875743 gen 2 00000004:00080000:3.0:1762166971.271261:0:19593:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945ceda2f100, transno 17179875732 00000004:00080000:3.0:1762166971.271275:0:19593:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945ceda2d180, transno 17179875733 00000004:00080000:3.0:1762166971.271278:0:19593:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945ceda2c380, transno 17179875734 00000004:00080000:3.0:1762166971.271281:0:19593:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945ceda2ed80, transno 17179875735 00000004:00080000:3.0:1762166971.271284:0:19593:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945ceda2ca80, transno 17179875736 00000004:00080000:3.0:1762166971.271287:0:19593:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945ceda2f480, transno 17179875737 00000004:00080000:3.0:1762166971.271290:0:19593:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc47b7800, transno 17179875738 00000004:00080000:3.0:1762166971.271292:0:19593:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc47b6300, transno 17179875739 00000004:00080000:3.0:1762166971.271296:0:19593:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc47b5180, transno 17179875740 00000004:00080000:3.0:1762166971.271300:0:19593:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc47b6a00, transno 17179875741 00000004:00080000:3.0:1762166971.271304:0:19593:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc47b7480, transno 17179875742 00000004:00080000:3.0:1762166971.271308:0:19593:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc47b4380, transno 17179875743 00000100:00100000:3.0:1762166971.271316:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bb9880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449581696:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166971.271552:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bb9880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449581824:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166971.271580:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166971.271602:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7a77540 going to sleep for 11 seconds 00000100:00100000:3.0:1762166971.271838:0:19593:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 21474842862 gen 2 00000004:00080000:3.0:1762166971.271843:0:19593:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945d011e9180, transno 21474842851 00000004:00080000:3.0:1762166971.271860:0:19593:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945d011ea300, transno 21474842852 00000004:00080000:3.0:1762166971.271863:0:19593:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945d011eb800, transno 21474842853 00000004:00080000:3.0:1762166971.271866:0:19593:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945d011e8000, transno 21474842854 00000004:00080000:3.0:1762166971.271869:0:19593:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945d011e9f80, transno 21474842855 00000004:00080000:3.0:1762166971.271872:0:19593:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945d011e9880, transno 21474842856 00000004:00080000:3.0:1762166971.271875:0:19593:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc5806300, transno 21474842857 00000004:00080000:3.0:1762166971.271877:0:19593:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc5805c00, transno 21474842858 00000004:00080000:3.0:1762166971.271879:0:19593:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc5805180, transno 21474842859 00000004:00080000:3.0:1762166971.271882:0:19593:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc5807100, transno 21474842860 00000004:00080000:3.0:1762166971.271885:0:19593:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc5804a80, transno 21474842861 00000004:00080000:3.0:1762166971.271887:0:19593:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc5805500, transno 21474842862 00000100:00100000:3.0:1762166971.271891:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bb9880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449581824:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166971.271937:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bb9880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449581952:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166971.271961:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166971.271985:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccac7a240 going to sleep for 11 seconds 00000100:00100000:3.0:1762166971.272152:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bb9880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449581952:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166971.272183:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bc1500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449582080:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166971.272200:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166971.272215:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a19c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166971.272301:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bc1500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449582080:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166971.272353:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bc1500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449582208:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166971.272374:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166971.272390:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc9a5e000 going to sleep for 11 seconds 00000100:00100000:3.0:1762166971.272530:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bc1500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449582208:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166971.272565:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bc1500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449582336:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166971.272586:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166971.272606:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc9a5e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166971.272736:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bc1500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449582336:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166971.272775:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bc1500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449582464:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166971.272797:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166971.272821:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc9a5e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166971.272954:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bc1500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449582464:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166971.272984:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bc1500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449582592:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166971.273020:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166971.273040:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc9a5e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166971.273158:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bc1500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449582592:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166971.273184:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bc1500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449582720:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166971.273199:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166971.273217:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc9a5e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166971.273354:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bc1500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449582720:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166971.273385:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bc1500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449582848:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166971.273404:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166971.273421:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc9a5e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166971.273587:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bc1500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449582848:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166971.273623:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bc1500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449582976:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166971.273660:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166971.273679:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc9a5e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166971.273794:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bc1500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449582976:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166971.273817:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bc1500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449583104:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166971.273837:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166971.273855:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc9a5e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166971.273969:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bc1500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449583104:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166971.274016:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7ce4a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449583232:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166971.274038:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166971.274056:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc9a5e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166971.274169:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7ce4a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449583232:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166971.274202:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7ce4a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449583360:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166971.274225:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166971.274246:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc9a5e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166971.274352:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7ce4a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449583360:0@lo:1000:mdt_rdpg00_003.0 00000040:00080000:3.0:1762166971.274527:0:19593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x2:0x0].27, 816 off53352 00000001:00080000:3.0:1762166971.274539:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294991289 00000100:00100000:3.0:1762166971.274585:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7ce4a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449583488:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166971.274611:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166971.274628:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc9a5e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166971.274855:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7ce4a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449583488:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166971.274877:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7ce6a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449583616:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166971.274904:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166971.274925:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc9a5e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166971.275322:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7ce6a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449583616:0@lo:1000:mdt_rdpg00_003.0 00000001:00080000:3.0:1762166971.275378:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294991290 00010000:00010000:3.0:1762166971.275402:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472c00/0x2f180c4effba75b6 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5f9:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166971.275412:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472c00/0x2f180c4effba75b6 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x5f9:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166971.275419:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472c00/0x2f180c4effba75b6 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5f9:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166971.275425:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8472c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166971.275429:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472c00/0x2f180c4effba75b6 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5f9:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166971.275436:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472c00/0x2f180c4effba75b6 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x5f9:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166971.275454:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5f9:0x0].0x0 (ffff945bc809b700) 00010000:00010000:3.0:1762166971.275457:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166971.275461:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472c00/0x2f180c4effba75b6 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x5f9:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166971.275470:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472c00/0x2f180c4effba75b6 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x5f9:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166971.275513:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effba75af lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166971.275520:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effba75af lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166971.275526:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effba75af lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166971.275531:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8472400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166971.275534:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effba75af lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166971.275540:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effba75af lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166971.275548:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc718dd00) 00010000:00010000:3.0:1762166971.275550:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166971.275553:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effba75af lrc: 2/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166971.275559:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effba75af lrc: 0/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166971.275569:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc718dd00) 00010000:00010000:3.0:1762166971.275573:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166971.275581:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62000/0x2f180c4effba74c8 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e88bc expref: 531 pid: 6494 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166971.291527:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.322356:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.324259:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.329410:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18134 00000100:00100000:3.0:1762166971.329426:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450053504:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166971.329451:0:8382:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166971.329507:0:8382:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc8472400/0x2f180c4effba7618 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e8933 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166971.330716:0:8382:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5805c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8382:1847765449584000:192.168.204.38@tcp:106: 00010000:00010000:3.0:1762166971.330757:0:8382:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc8472400/0x2f180c4effba7618 lrc: 1/0,0 mode: --/PR res: [0x280000400:0xa82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8933 expref: 20 pid: 8382 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166971.330782:0:8382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc8472400/0x2f180c4effba7618 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8933 expref: 20 pid: 8382 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166971.330799:0:8382:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8472400, rc 0) 00000100:00100000:3.0:1762166971.330846:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450053504:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1421us (1607us total) trans 0 rc 301/301 00000100:00100000:3.0:1762166971.330872:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18134 00000100:00100000:3.0:1762166971.332420:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.334191:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.348579:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.350296:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.351942:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.353356:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.355032:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.355065:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.357819:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.361745:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000001:00080000:3.0:1762166971.363806:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294991299 is committed 00000004:00080000:3.0:1762166971.363813:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3106 committed 00000004:00080000:3.0:1762166971.363824:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3109 committed 00000004:00080000:3.0:1762166971.363831:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3108 committed 00000004:00080000:3.0:1762166971.363833:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3105 committed 00000004:00080000:3.0:1762166971.363839:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3104 committed 00000004:00080000:3.0:1762166971.363842:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3107 committed 00000004:00080000:3.0:1762166971.363844:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3106 committed 00000004:00080000:3.0:1762166971.363847:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3103 committed 00000004:00080000:3.0:1762166971.363851:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3102 committed 00000004:00080000:3.0:1762166971.363856:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3105 committed 00000004:00080000:3.0:1762166971.363860:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3101 committed 00000004:00080000:3.0:1762166971.363865:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3104 committed 00000004:00080000:3.0:1762166971.363869:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3103 committed 00000004:00080000:3.0:1762166971.363875:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3100 committed 00000020:00080000:3.0:1762166971.363904:0:7412:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff945cc7a77540 refcount 2 committed 0 result 0 batchid 29 00000020:00080000:3.0:1762166971.363912:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cf3bd1200 obd lustre-OST0001-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff945ccac7a240 00000020:00080000:3.0:1762166971.363918:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cf3bd1600 obd lustre-OST0000-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff945cc7a77a80 00000020:00080000:3.0:1762166971.363921:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cc3ef0300 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff945bc4b91800 00000020:00080000:3.0:1762166971.363925:0:7412:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000400:0x2:0x0].27 00000100:00100000:3.0:1762166971.363973:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5804a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449584768:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166971.364049:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166971.364083:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5805f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449585280:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166971.364145:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166971.364174:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5806a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449585792:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166971.364203:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166971.364230:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5804000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449586304:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166971.364268:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449585152 00000100:00100000:3.0:1762166971.364274:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449585152 00000100:00100000:3.0:1762166971.364307:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18140 00000100:00100000:3.0:1762166971.364321:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5806680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+10:3634:x1847765449585024:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:3.0:1762166971.364445:0:9165:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166971.364449:0:9165:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166971 -> 1762166971 00002000:00010000:3.0:1762166971.364454:0:9165:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166970 -> 1762166970 00002000:00010000:3.0:1762166971.364458:0:9165:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166971 -> 1762166971 00002000:00010000:3.0:1762166971.364462:0:9165:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00000100:00100000:3.0:1762166971.364526:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5806680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+12:3634:x1847765449585024:12345-0@lo:2:osp-syn-0-1.0 Request processed in 211us (432us total) trans 21474842871 rc 0/0 00000100:00100000:3.0:1762166971.364537:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18140 00000100:00100000:3.0:1762166971.364565:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18142 00000100:00100000:3.0:1762166971.364578:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5805880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+11:3634:x1847765449585536:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:3.0:1762166971.364645:0:9165:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166971.364652:0:9165:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7f:0x0] updating lvb mtime from disk: 1762166971 -> 1762166971 00002000:00010000:3.0:1762166971.364658:0:9165:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7f:0x0] updating lvb atime from disk: 1762166969 -> 1762166969 00002000:00010000:3.0:1762166971.364662:0:9165:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7f:0x0] updating lvb ctime from disk: 1762166971 -> 1762166971 00002000:00010000:3.0:1762166971.364664:0:9165:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7f:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166971.364701:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5805880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+12:3634:x1847765449585536:12345-0@lo:2:osp-syn-0-1.0 Request processed in 125us (532us total) trans 21474842873 rc 0/0 00000100:00100000:3.0:1762166971.364710:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18142 00000100:00100000:3.0:1762166971.364733:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18146 00000100:00100000:3.0:1762166971.364742:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+13:3635:x1847765449586176:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:3.0:1762166971.364814:0:9165:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa80:0x0] updating lvb size from disk: 244463 -> 244463 00002000:00010000:3.0:1762166971.364818:0:9165:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa80:0x0] updating lvb mtime from disk: 1762166971 -> 1762166971 00002000:00010000:3.0:1762166971.364821:0:9165:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa80:0x0] updating lvb atime from disk: 1762166970 -> 1762166970 00002000:00010000:3.0:1762166971.364824:0:9165:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa80:0x0] updating lvb ctime from disk: 1762166971 -> 1762166971 00002000:00010000:3.0:1762166971.364826:0:9165:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa80:0x0] updating lvb blocks from disk: 304 -> 304 00000100:00100000:3.0:1762166971.364857:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+15:3635:x1847765449586176:12345-0@lo:2:osp-syn-1-1.0 Request processed in 116us (497us total) trans 17179875752 rc 0/0 00000100:00100000:3.0:1762166971.364865:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18146 00000100:00100000:3.0:1762166971.364886:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18150 00000100:00100000:3.0:1762166971.364901:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+14:3633:x1847765449586432:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:3.0:1762166971.364967:0:9165:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa81:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166971.364970:0:9165:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa81:0x0] updating lvb mtime from disk: 1762166971 -> 1762166971 00002000:00010000:3.0:1762166971.364978:0:9165:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa81:0x0] updating lvb atime from disk: 1762166970 -> 1762166970 00002000:00010000:3.0:1762166971.364985:0:9165:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa81:0x0] updating lvb ctime from disk: 1762166971 -> 1762166971 00002000:00010000:3.0:1762166971.365002:0:9165:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa81:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166971.365059:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+14:3633:x1847765449586432:12345-0@lo:2:osp-syn-1-1.0 Request processed in 162us (455us total) trans 17179875756 rc 0/0 00000100:00100000:3.0:1762166971.365074:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18150 00000100:00100000:3.0:1762166971.365217:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449586304 00000100:00100000:3.0:1762166971.365223:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449586304 00000100:00100000:3.0:1762166971.365252:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18152 00000100:00100000:3.0:1762166971.365261:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3e6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+13:3636:x1847765449586304:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:3.0:1762166971.365318:0:9168:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa82:0x0] updating lvb size from disk: 244463 -> 244463 00002000:00010000:3.0:1762166971.365322:0:9168:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa82:0x0] updating lvb mtime from disk: 1762166971 -> 1762166971 00002000:00010000:3.0:1762166971.365324:0:9168:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa82:0x0] updating lvb atime from disk: 1762166970 -> 1762166970 00002000:00010000:3.0:1762166971.365327:0:9168:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa82:0x0] updating lvb ctime from disk: 1762166971 -> 1762166971 00002000:00010000:3.0:1762166971.365329:0:9168:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa82:0x0] updating lvb blocks from disk: 296 -> 296 00000100:00100000:3.0:1762166971.365368:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3e6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+13:3636:x1847765449586304:12345-0@lo:2:osp-syn-0-1.0 Request processed in 109us (191us total) trans 21474842877 rc 0/0 00000100:00100000:3.0:1762166971.365375:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18152 00000100:00100000:3.0:1762166971.367028:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.368458:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450056064 00000100:00100000:3.0:1762166971.368471:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450056064 00000100:00100000:3.0:1762166971.368571:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1444 00000100:00100000:3.0:1762166971.368586:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4012d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765450056064:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:3.0:1762166971.368819:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 244463 -> 249934 00002000:00010000:3.0:1762166971.368824:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166971 -> 1762166971 00002000:00010000:3.0:1762166971.368826:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166970 -> 1762166970 00002000:00010000:3.0:1762166971.368828:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166971 -> 1762166971 00002000:00010000:3.0:1762166971.368830:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 360 -> 456 00000100:00100000:3.0:1762166971.368901:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4012d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+24:2418:x1847765450056064:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 319us (553us total) trans 17179875757 rc 0/0 00000100:00100000:3.0:1762166971.368910:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1444 00000100:00100000:3.0:1762166971.370412:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.373743:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450056320 00000100:00100000:3.0:1762166971.373752:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450056320 00002000:00100000:3.0:1762166971.373805:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (167936->172031) req@ffff945bc4013800 x1847765450056320/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:2/0 lens 488/0 e 0 to 0 dl 1762166982 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166971.373817:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4013800 with x1847765450056320 ext(167936->172031) 00002000:00010000:3.0:1762166971.373823:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4013800 00000100:00100000:3.0:1762166971.373851:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1445 00000100:00100000:3.0:1762166971.373859:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4013800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765450056320:12345-192.168.204.38@tcp:3:lfs.0 00000100:00100000:3.0:1762166971.374049:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4013800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765450056320:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 191us (412us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1762166971.374055:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1445 00002000:00100000:3.0:1762166971.374061:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (167936->172031) req@ffff945bc4013800 x1847765450056320/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:2/0 lens 488/4536 e 0 to 0 dl 1762166982 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166971.374068:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4013800 with x1847765450056320 ext(167936->172031) 00002000:00010000:3.0:1762166971.374070:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4013800 00000100:00100000:3.0:1762166971.375623:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450056448 00000100:00100000:3.0:1762166971.375630:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450056448 00002000:00100000:3.0:1762166971.375659:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (172032->176127) req@ffff945bc7b23800 x1847765450056448/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:2/0 lens 488/0 e 0 to 0 dl 1762166982 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166971.375668:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc7b23800 with x1847765450056448 ext(172032->176127) 00002000:00010000:3.0:1762166971.375672:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc7b23800 00000100:00100000:3.0:1762166971.375700:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1446 00000100:00100000:3.0:1762166971.375710:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765450056448:12345-192.168.204.38@tcp:3:lfs.0 00000100:00100000:3.0:1762166971.375828:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765450056448:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 119us (289us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1762166971.375835:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1446 00002000:00100000:3.0:1762166971.375843:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (172032->176127) req@ffff945bc7b23800 x1847765450056448/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:2/0 lens 488/4536 e 0 to 0 dl 1762166982 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166971.375852:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc7b23800 with x1847765450056448 ext(172032->176127) 00002000:00010000:3.0:1762166971.375855:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc7b23800 00000100:00100000:3.0:1762166971.377529:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450056576 00000100:00100000:3.0:1762166971.377537:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450056576 00002000:00100000:3.0:1762166971.377577:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (167936->176127) req@ffff945cf1e6e680 x1847765450056576/t0(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:2/0 lens 8680/0 e 0 to 0 dl 1762166982 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166971.377587:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1e6e680 with x1847765450056576 ext(167936->176127) 00002000:00010000:3.0:1762166971.377602:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1e6e680 00000100:00100000:3.0:1762166971.377626:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1447 00000100:00100000:3.0:1762166971.377633:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+24:2418:x1847765450056576:12345-192.168.204.38@tcp:4:lfs.0 00000100:00100000:3.0:1762166971.378194:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+26:2418:x1847765450056576:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 558us (800us total) trans 17179875758 rc 0/0 00000100:00100000:3.0:1762166971.378203:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1447 00002000:00100000:3.0:1762166971.378210:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (167936->176127) req@ffff945cf1e6e680 x1847765450056576/t17179875758(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:2/0 lens 8680/448 e 0 to 0 dl 1762166982 ref 1 fl Complete:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166971.378217:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1e6e680 with x1847765450056576 ext(167936->176127) 00002000:00010000:3.0:1762166971.378220:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1e6e680 00000100:00100000:3.0:1762166971.392020:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.394262:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.394734:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.406037:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450058240 00000100:00100000:3.0:1762166971.406044:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450058240 00000100:00100000:3.0:1762166971.406151:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450058368 00000100:00100000:3.0:1762166971.406166:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450058368 00000100:00100000:3.0:1762166971.406592:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450058496 00000100:00100000:3.0:1762166971.406601:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450058496 00000100:00100000:3.0:1762166971.406647:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18157 00000100:00100000:3.0:1762166971.406657:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450058496:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:3.0:1762166971.406774:0:9168:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc8472400/0x2f180c4effba76ea lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.406786:0:9168:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf200/0x2f180c4effba75a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8910 expref: 21 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.406793:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166971.406795:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166971.406797:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472400/0x2f180c4effba76ea lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.406855:0:9168:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf200/0x2f180c4effba75a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8910 expref: 21 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.406866:0:9168:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf200/0x2f180c4effba75a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8910 expref: 21 pid: 28874 timeout: 690 lvb_type: 0 00000100:00100000:3.0:1762166971.406878:0:9168:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bc3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9168:1847765449587072:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166971.406913:0:9168:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc9a5e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166971.407853:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450058624 00000100:00100000:3.0:1762166971.407861:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450058624 00010000:00010000:3.0:1762166971.407887:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde800/0x2f180c4effba75a1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8909 expref: 20 pid: 28874 timeout: 690 lvb_type: 0 00000100:00100000:3.0:1762166971.407923:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9209 00000100:00100000:3.0:1762166971.407934:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff1ab050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450058624:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166971.407948:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166971.407974:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde800/0x2f180c4effba75a1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8909 expref: 20 pid: 28874 timeout: 690 lvb_type: 0 00010000:00010000:3.0:1762166971.408043:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde800/0x2f180c4effba75a1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8909 expref: 20 pid: 28874 timeout: 690 lvb_type: 0 00010000:00010000:3.0:1762166971.408067:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde800/0x2f180c4effba75a1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8909 expref: 20 pid: 28874 timeout: 690 lvb_type: 0 00010000:00010000:3.0:1762166971.408084:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166971.408086:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166971.408091:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4b63000/0x2f180c4effba76e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.408100:0:7421:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4b63000/0x2f180c4effba76e3 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.408133:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166971.408215:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff1ab050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450058624:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 281us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166971.408238:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9209 00000100:00100000:3.0:1762166971.408563:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450058880 00000100:00100000:3.0:1762166971.408573:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450058880 00010000:00010000:3.0:1762166971.408593:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf200/0x2f180c4effba75a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8910 expref: 22 pid: 28874 timeout: 690 lvb_type: 0 00000100:00100000:3.0:1762166971.408648:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9211 00000100:00100000:3.0:1762166971.408660:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450058880:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166971.408681:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166971.408698:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf200/0x2f180c4effba75a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8910 expref: 22 pid: 28874 timeout: 690 lvb_type: 0 00010000:00010000:3.0:1762166971.408716:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf200/0x2f180c4effba75a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8910 expref: 22 pid: 28874 timeout: 690 lvb_type: 0 00010000:00010000:3.0:1762166971.408760:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf200/0x2f180c4effba75a8 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8910 expref: 22 pid: 28874 timeout: 690 lvb_type: 0 00010000:00010000:3.0:1762166971.408779:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166971.408783:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166971.408787:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc8472400/0x2f180c4effba76ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.408796:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472400/0x2f180c4effba76ea lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.408827:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166971.408872:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450058880:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 212us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166971.408885:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9211 00000001:00080000:3.0:1762166971.412609:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294991303 is committed 00000004:00080000:3.0:1762166971.412617:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3113 committed 00000004:00080000:3.0:1762166971.412638:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3116 committed 00000004:00080000:3.0:1762166971.412653:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3115 committed 00000004:00080000:3.0:1762166971.412656:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3112 committed 00000004:00080000:3.0:1762166971.412659:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3111 committed 00000004:00080000:3.0:1762166971.412661:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3114 committed 00000004:00080000:3.0:1762166971.412663:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3113 committed 00000004:00080000:3.0:1762166971.412665:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3110 committed 00000004:00080000:3.0:1762166971.412667:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3109 committed 00000004:00080000:3.0:1762166971.412669:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3112 committed 00000004:00080000:3.0:1762166971.412670:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3108 committed 00000004:00080000:3.0:1762166971.412672:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3111 committed 00000004:00080000:3.0:1762166971.412674:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3110 committed 00000004:00080000:3.0:1762166971.412676:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3107 committed 00000020:00080000:3.0:1762166971.412688:0:7412:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0001: 29 batchid updated 00000100:00100000:3.0:1762166971.412842:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7b20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449587328:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166971.412916:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166971.412964:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7b22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449587712:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166971.413041:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449587456 00000100:00100000:3.0:1762166971.413057:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449587456 00000100:00100000:3.0:1762166971.413104:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449587200 00000100:00100000:3.0:1762166971.413110:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449587200 00000100:00100000:3.0:1762166971.413144:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449587840 00000100:00100000:3.0:1762166971.413150:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449587840 00000100:00100000:3.0:1762166971.413184:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18158 00000100:00100000:3.0:1762166971.413200:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+16:3634:x1847765449587328:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:3.0:1762166971.413344:0:8382:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166971.413349:0:8382:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb mtime from disk: 1762166966 -> 1762166966 00002000:00010000:3.0:1762166971.413355:0:8382:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1762166971.413359:0:8382:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb ctime from disk: 1762166966 -> 1762166966 00002000:00010000:3.0:1762166971.413362:0:8382:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166971.413407:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+20:3634:x1847765449587328:12345-0@lo:2:osp-syn-0-1.0 Request processed in 209us (490us total) trans 21474842878 rc 0/0 00000100:00100000:3.0:1762166971.413421:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18158 00000100:00100000:3.0:1762166971.413455:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18162 00000100:00100000:3.0:1762166971.413468:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4490700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+19:3633:x1847765449588096:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:3.0:1762166971.413580:0:8382:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166971.413587:0:8382:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7f:0x0] updating lvb mtime from disk: 1762166971 -> 1762166971 00002000:00010000:3.0:1762166971.413595:0:8382:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7f:0x0] updating lvb atime from disk: 1762166969 -> 1762166969 00002000:00010000:3.0:1762166971.413602:0:8382:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7f:0x0] updating lvb ctime from disk: 1762166971 -> 1762166971 00002000:00010000:3.0:1762166971.413608:0:8382:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7f:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166971.413648:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4490700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+20:3633:x1847765449588096:12345-0@lo:2:osp-syn-0-1.0 Request processed in 182us (582us total) trans 21474842880 rc 0/0 00000100:00100000:3.0:1762166971.413663:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18162 00000100:00100000:3.0:1762166971.413683:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18166 00000100:00100000:3.0:1762166971.413693:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945d011eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+19:3635:x1847765449588864:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:3.0:1762166971.413762:0:8382:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa82:0x0] updating lvb size from disk: 244463 -> 244463 00002000:00010000:3.0:1762166971.413770:0:8382:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa82:0x0] updating lvb mtime from disk: 1762166971 -> 1762166971 00002000:00010000:3.0:1762166971.413776:0:8382:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa82:0x0] updating lvb atime from disk: 1762166970 -> 1762166970 00002000:00010000:3.0:1762166971.413782:0:8382:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa82:0x0] updating lvb ctime from disk: 1762166971 -> 1762166971 00002000:00010000:3.0:1762166971.413789:0:8382:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa82:0x0] updating lvb blocks from disk: 296 -> 296 00000100:00100000:3.0:1762166971.413829:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945d011eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+21:3635:x1847765449588864:12345-0@lo:2:osp-syn-0-1.0 Request processed in 137us (592us total) trans 21474842883 rc 0/0 00000100:00100000:3.0:1762166971.413844:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18166 00000100:00100000:3.0:1762166971.413868:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18170 00000100:00100000:3.0:1762166971.413884:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945d011ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+12:3634:x1847765449588736:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:3.0:1762166971.413955:0:8382:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa81:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166971.413960:0:8382:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa81:0x0] updating lvb mtime from disk: 1762166971 -> 1762166971 00002000:00010000:3.0:1762166971.413966:0:8382:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa81:0x0] updating lvb atime from disk: 1762166970 -> 1762166970 00002000:00010000:3.0:1762166971.413969:0:8382:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa81:0x0] updating lvb ctime from disk: 1762166971 -> 1762166971 00002000:00010000:3.0:1762166971.413972:0:8382:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa81:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166971.414025:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945d011ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+14:3634:x1847765449588736:12345-0@lo:2:osp-syn-1-1.0 Request processed in 145us (577us total) trans 17179875764 rc 0/0 00000100:00100000:3.0:1762166971.414036:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18170 00000004:00080000:3.0:1762166971.414136:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc47b6300/2, rc 0, transno 17179875759 00000100:00100000:3.0:1762166971.414144:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc47b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449587584:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1762166971.414258:0:9994:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0001: 0 changes, 7 in progress, 0 in flight, 7 done 00010000:00010000:3.0:1762166971.414343:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effba76f1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166971.414355:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effba76f1 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166971.414363:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effba76f1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166971.414369:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdec00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166971.414374:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effba76f1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166971.414382:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effba76f1 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166971.414395:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc718dd00) 00010000:00010000:3.0:1762166971.414399:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166971.414403:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effba76f1 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166971.414410:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effba76f1 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00000100:00100000:3.0:1762166971.419855:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450059520 00000100:00100000:3.0:1762166971.419871:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450059520 00000100:00100000:3.0:1762166971.419955:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18172 00000100:00100000:3.0:1762166971.419976:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945d011e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+19:2417:x1847765450059520:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166971.420013:0:35247:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166971.420041:0:35247:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effba770d lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e89a3 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166971.420071:0:35247:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa77:0x0] initial LVB size: 249934, mtime: 0x690888bb, atime: 0x690888ba, ctime: 0x690888bb, blocks: 0x1c8 00010000:00010000:3.0:1762166971.420095:0:35247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166971.420099:0:35247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166971.420112:0:35247:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effba770d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e89a3 expref: 21 pid: 35247 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166971.420145:0:35247:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effba770d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e89a3 expref: 21 pid: 35247 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166971.420173:0:35247:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8472c00, rc 0) 00000100:00100000:3.0:1762166971.420272:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945d011e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+21:2417:x1847765450059520:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 284us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166971.420325:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18172 00000100:00100000:3.0:1762166971.449926:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450060160 00000100:00100000:3.0:1762166971.449940:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450060160 00000100:00100000:3.0:1762166971.450036:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1448 00000100:00100000:3.0:1762166971.450049:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945d011ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+20:2417:x1847765450060160:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:3.0:1762166971.450088:0:23942:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effba7722 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.450105:0:23942:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166971.450108:0:23942:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166971.450114:0:23942:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effba7722 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->49151] (req 0->49151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.450128:0:23942:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effba7722 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->49151] (req 0->49151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.451317:0:23942:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effba7722 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->49151] (req 0->49151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.451333:0:23942:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effba7722 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->49151] (req 0->49151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.451342:0:23942:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effba7722 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->49151] (req 0->49151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.451349:0:23942:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8473600 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166971.451353:0:23942:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effba7722 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->49151] (req 0->49151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.451361:0:23942:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effba7722 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->49151] (req 0->49151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.451378:0:23942:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effba7722 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->49151] (req 0->49151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.451386:0:23942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effba7722 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->49151] (req 0->49151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166971.451449:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945d011ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+20:2417:x1847765450060160:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 1401us (1633us total) trans 0 rc 49152/49152 00000100:00100000:3.0:1762166971.451459:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1448 00000100:00100000:3.0:1762166971.455509:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450060416 00000100:00100000:3.0:1762166971.455517:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450060416 00000100:00100000:3.0:1762166971.455573:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1449 00000100:00100000:3.0:1762166971.455584:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450060416:12345-192.168.204.38@tcp:4:lfs.0 00002000:00010000:3.0:1762166971.455627:0:23942:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa7e:0x0] initial LVB size: 244463, mtime: 0x690888bb, atime: 0x690888b8, ctime: 0x690888bb, blocks: 0x130 00010000:00010000:3.0:1762166971.455636:0:23942:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc8472800/0x2f180c4effba7737 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa7e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.455648:0:23942:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166971.455651:0:23942:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166971.455656:0:23942:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8472800/0x2f180c4effba7737 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa7e:0x0].0x0 rrc: 2 type: EXT [0->49151] (req 0->49151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.455668:0:23942:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc8472800/0x2f180c4effba7737 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa7e:0x0].0x0 rrc: 2 type: EXT [0->49151] (req 0->49151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166971.466886:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.473799:0:23942:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda2e680 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_009:lustre-OST0001_UUID:23942:1847765449588992:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166971.473824:0:23942:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9400/0x2f180c4effba774c lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa80:0x0].0x0 rrc: 3 type: EXT [0->49151] (req 0->49151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166971.474008:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450060928 00000100:00100000:3.0:1762166971.474015:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450060928 00010000:00010000:3.0:1762166971.474051:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8600/0x2f180c4effba742e lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa80:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->12287) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8876 expref: 21 pid: 9168 timeout: 690 lvb_type: 0 00000100:00100000:3.0:1762166971.474086:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9212 00000100:00100000:3.0:1762166971.474096:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450060928:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166971.474110:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166971.474131:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8600/0x2f180c4effba742e lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa80:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 8192->12287) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8876 expref: 21 pid: 9168 timeout: 690 lvb_type: 0 00010000:00010000:3.0:1762166971.474144:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8600/0x2f180c4effba742e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa80:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 8192->12287) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8876 expref: 21 pid: 9168 timeout: 690 lvb_type: 0 00010000:00010000:3.0:1762166971.474174:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8600/0x2f180c4effba742e lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa80:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 8192->12287) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8876 expref: 21 pid: 9168 timeout: 690 lvb_type: 0 00010000:00010000:3.0:1762166971.474192:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166971.474194:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166971.474199:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9400/0x2f180c4effba774c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa80:0x0].0x0 rrc: 3 type: EXT [0->49151] (req 0->49151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.474209:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9400/0x2f180c4effba774c lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xa80:0x0].0x0 rrc: 3 type: EXT [0->49151] (req 0->49151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.474236:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166971.474291:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450060928:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 195us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166971.474301:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9212 00010000:00010000:3.0:1762166971.476713:0:23942:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9400/0x2f180c4effba774c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa80:0x0].0x0 rrc: 2 type: EXT [0->49151] (req 0->49151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.476723:0:23942:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9400/0x2f180c4effba774c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa80:0x0].0x0 rrc: 2 type: EXT [0->49151] (req 0->49151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.476729:0:23942:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9400/0x2f180c4effba774c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa80:0x0].0x0 rrc: 2 type: EXT [0->49151] (req 0->49151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.476733:0:23942:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa9400 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166971.476736:0:23942:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9400/0x2f180c4effba774c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa80:0x0].0x0 rrc: 2 type: EXT [0->49151] (req 0->49151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.476742:0:23942:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9400/0x2f180c4effba774c lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa80:0x0].0x0 rrc: 2 type: EXT [0->49151] (req 0->49151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.476751:0:23942:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9400/0x2f180c4effba774c lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa80:0x0].0x0 rrc: 2 type: EXT [0->49151] (req 0->49151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.476755:0:23942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9400/0x2f180c4effba774c lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa80:0x0].0x0 rrc: 2 type: EXT [0->49151] (req 0->49151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166971.476813:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450060800:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 4591us (4778us total) trans 17179875767 rc 0/0 00000100:00100000:3.0:1762166971.476821:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1452 00000100:00100000:3.0:1762166971.479800:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450061056 00000100:00100000:3.0:1762166971.479819:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450061056 00000100:00100000:3.0:1762166971.479906:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1453 00000100:00100000:3.0:1762166971.479918:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+17:2416:x1847765450061056:12345-192.168.204.38@tcp:4:lfs.0 00010000:00010000:3.0:1762166971.479965:0:23942:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effba7753 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.480001:0:23942:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4b62600/0x2f180c4effba7650 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e894f expref: 17 pid: 8382 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166971.480011:0:23942:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166971.480014:0:23942:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166971.480019:0:23942:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effba7753 lrc: 4/0,1 mode: --/PW res: [0x280000400:0xa82:0x0].0x0 rrc: 3 type: EXT [0->49151] (req 0->49151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.480062:0:23942:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc4b62600/0x2f180c4effba7650 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e894f expref: 17 pid: 8382 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166971.480080:0:23942:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc4b62600/0x2f180c4effba7650 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e894f expref: 17 pid: 8382 timeout: 690 lvb_type: 1 00000100:00100000:3.0:1762166971.480099:0:23942:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bc1500 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_009:lustre-OST0000_UUID:23942:1847765449589120:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166971.480195:0:23942:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc9a5e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166971.481362:0:23942:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bc1500 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_009:lustre-OST0000_UUID:23942:1847765449589120:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166971.481392:0:23942:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effba7753 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa82:0x0].0x0 rrc: 3 type: EXT [0->49151] (req 0->49151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166971.481822:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450061184 00000100:00100000:3.0:1762166971.481836:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450061184 00010000:00010000:3.0:1762166971.481877:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4b62600/0x2f180c4effba7650 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e894f expref: 18 pid: 8382 timeout: 690 lvb_type: 1 00000100:00100000:3.0:1762166971.481996:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9213 00000100:00100000:3.0:1762166971.482008:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450061184:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166971.482023:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166971.482043:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc4b62600/0x2f180c4effba7650 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e894f expref: 18 pid: 8382 timeout: 690 lvb_type: 1 00010000:00010000:3.0:1762166971.482057:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc4b62600/0x2f180c4effba7650 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e894f expref: 18 pid: 8382 timeout: 690 lvb_type: 1 00010000:00010000:3.0:1762166971.482076:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4b62600/0x2f180c4effba7650 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e894f expref: 18 pid: 8382 timeout: 690 lvb_type: 1 00010000:00010000:3.0:1762166971.482091:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166971.482093:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166971.482097:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effba7753 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa82:0x0].0x0 rrc: 3 type: EXT [0->49151] (req 0->49151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.482106:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effba7753 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa82:0x0].0x0 rrc: 3 type: EXT [0->49151] (req 0->49151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.482143:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166971.482253:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450061184:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 246us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166971.482262:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9213 00000100:00100000:3.0:1762166971.488629:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450061312 00000100:00100000:3.0:1762166971.488640:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450061312 00000100:00100000:3.0:1762166971.488689:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18177 00000100:00100000:3.0:1762166971.488698:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450061312:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:3.0:1762166971.488825:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450061312:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 128us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166971.488834:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18177 00000100:00100000:3.0:1762166971.490309:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450061440 00000100:00100000:3.0:1762166971.490318:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450061440 00000100:00100000:3.0:1762166971.490373:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18178 00000100:00100000:3.0:1762166971.490382:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450061440:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:3.0:1762166971.490562:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450061440:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 175us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166971.490571:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18178 00000100:00100000:3.0:1762166971.493601:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.495168:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450062080 00000100:00100000:3.0:1762166971.495175:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450062080 00002000:00010000:3.0:1762166971.495194:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2685 (0->18446744073709551615) 00002000:00100000:3.0:1762166971.495199:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf783aa00 with x1847765450062080 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166971.495208:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf783aa00. 00000100:00100000:3.0:1762166971.495242:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1455 00000100:00100000:3.0:1762166971.495254:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450062080:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:3.0:1762166971.495409:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa7d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166971.495413:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa7d:0x0] updating lvb mtime from disk: 1762166971 -> 1762166971 00002000:00010000:3.0:1762166971.495416:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa7d:0x0] updating lvb atime from disk: 1762166968 -> 1762166968 00002000:00010000:3.0:1762166971.495418:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa7d:0x0] updating lvb ctime from disk: 1762166971 -> 1762166971 00002000:00010000:3.0:1762166971.495421:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa7d:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166971.495474:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450062080:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 223us (416us total) trans 17179875768 rc 0/0 00000100:00100000:3.0:1762166971.495515:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1455 00002000:00010000:3.0:1762166971.495520:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2685 (0->18446744073709551615) 00002000:00100000:3.0:1762166971.495524:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf783aa00 with x1847765450062080 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166971.495529:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf783aa00. 00000100:00100000:3.0:1762166971.501027:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.502598:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450062848 00000100:00100000:3.0:1762166971.502609:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450062848 00002000:00010000:3.0:1762166971.502657:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2687 (0->18446744073709551615) 00002000:00100000:3.0:1762166971.502665:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf783ad80 with x1847765450062848 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166971.502677:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945cf783ad80. 00000100:00100000:3.0:1762166971.502731:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1456 00000100:00100000:3.0:1762166971.502745:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450062720:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:3.0:1762166971.503191:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa7e:0x0] updating lvb size from disk: 244463 -> 49152 00002000:00010000:3.0:1762166971.503195:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa7e:0x0] updating lvb mtime from disk: 1762166971 -> 1762166971 00002000:00010000:3.0:1762166971.503198:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa7e:0x0] updating lvb atime from disk: 1762166969 -> 1762166969 00002000:00010000:3.0:1762166971.503200:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa7e:0x0] updating lvb ctime from disk: 1762166971 -> 1762166971 00002000:00010000:3.0:1762166971.503202:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa7e:0x0] updating lvb blocks from disk: 304 -> 104 00000100:00100000:3.0:1762166971.503239:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765450062720:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 499us (681us total) trans 17179875769 rc 0/0 00000100:00100000:3.0:1762166971.503247:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1456 00002000:00010000:3.0:1762166971.503250:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2686 (49152->18446744073709551615) 00002000:00100000:3.0:1762166971.503253:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf783b800 with x1847765450062720 ext(49152->18446744073709551615) 00002000:00010000:3.0:1762166971.503258:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf783b800. 00000100:00100000:3.0:1762166971.508898:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.511721:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450063488 00000100:00100000:3.0:1762166971.511732:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450063488 00002000:00010000:3.0:1762166971.511777:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2688 (49152->18446744073709551615) 00002000:00100000:3.0:1762166971.511783:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf7839f80 with x1847765450063488 ext(49152->18446744073709551615) 00002000:00010000:3.0:1762166971.511795:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945cf7839f80. 00000100:00100000:3.0:1762166971.511869:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1458 00000100:00100000:3.0:1762166971.511885:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf7839f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450063488:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:3.0:1762166971.512320:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa80:0x0] updating lvb size from disk: 244463 -> 49152 00002000:00010000:3.0:1762166971.512324:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa80:0x0] updating lvb mtime from disk: 1762166971 -> 1762166971 00002000:00010000:3.0:1762166971.512326:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa80:0x0] updating lvb atime from disk: 1762166969 -> 1762166969 00002000:00010000:3.0:1762166971.512328:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa80:0x0] updating lvb ctime from disk: 1762166971 -> 1762166971 00002000:00010000:3.0:1762166971.512330:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa80:0x0] updating lvb blocks from disk: 304 -> 104 00000100:00100000:3.0:1762166971.512354:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf7839f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450063488:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 476us (710us total) trans 21474842890 rc 0/0 00000100:00100000:3.0:1762166971.512362:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1458 00002000:00010000:3.0:1762166971.512365:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2688 (49152->18446744073709551615) 00002000:00100000:3.0:1762166971.512368:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf7839f80 with x1847765450063488 ext(49152->18446744073709551615) 00002000:00010000:3.0:1762166971.512372:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945cf7839f80. 00000100:00100000:3.0:1762166971.520940:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450064256 00000100:00100000:3.0:1762166971.520951:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450064256 00002000:00010000:3.0:1762166971.521003:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2688 (49152->18446744073709551615) 00002000:00100000:3.0:1762166971.521010:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf783f100 with x1847765450064256 ext(49152->18446744073709551615) 00002000:00010000:3.0:1762166971.521025:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf783f100. 00000100:00100000:3.0:1762166971.521071:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1461 00000100:00100000:3.0:1762166971.521084:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+24:2417:x1847765450064256:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:3.0:1762166971.521602:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa80:0x0] updating lvb size from disk: 244463 -> 49152 00002000:00010000:3.0:1762166971.521606:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa80:0x0] updating lvb mtime from disk: 1762166971 -> 1762166971 00002000:00010000:3.0:1762166971.521609:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa80:0x0] updating lvb atime from disk: 1762166970 -> 1762166970 00002000:00010000:3.0:1762166971.521611:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa80:0x0] updating lvb ctime from disk: 1762166971 -> 1762166971 00002000:00010000:3.0:1762166971.521614:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa80:0x0] updating lvb blocks from disk: 304 -> 104 00000100:00100000:3.0:1762166971.521654:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+25:2417:x1847765450064256:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 574us (799us total) trans 17179875771 rc 0/0 00000100:00100000:3.0:1762166971.521661:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1461 00002000:00010000:3.0:1762166971.521665:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2688 (49152->18446744073709551615) 00002000:00100000:3.0:1762166971.521667:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf783f100 with x1847765450064256 ext(49152->18446744073709551615) 00002000:00010000:3.0:1762166971.521671:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf783f100. 00000100:00100000:3.0:1762166971.528748:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450064896 00000100:00100000:3.0:1762166971.528755:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450064896 00000100:00100000:3.0:1762166971.528808:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18183 00000100:00100000:3.0:1762166971.528818:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+22:61801:x1847765450064896:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166971.528837:0:8383:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166971.528857:0:8383:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc8473c00/0x2f180c4effba77d1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa82:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e89f7 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166971.528881:0:8383:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa82:0x0] initial LVB size: 244463, mtime: 0x690888bb, atime: 0x690888ba, ctime: 0x690888bb, blocks: 0x128 00010000:00010000:3.0:1762166971.528909:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166971.528912:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166971.528920:0:8383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8473c00/0x2f180c4effba77d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e89f7 expref: 23 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.528947:0:8383:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc8473c00/0x2f180c4effba77d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e89f7 expref: 23 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.528958:0:8383:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8473c00, rc 0) 00000100:00100000:3.0:1762166971.529010:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+23:61801:x1847765450064896:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 194us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166971.529021:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18183 00000100:00100000:3.0:1762166971.530512:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450065024 00000100:00100000:3.0:1762166971.530522:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450065024 00000100:00100000:3.0:1762166971.530573:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18184 00000100:00100000:3.0:1762166971.530593:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+25:61801:x1847765450065024:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166971.530609:0:8383:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166971.530623:0:8383:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effba77d8 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa81:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e89fe expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.530650:0:8383:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc8c7ac00/0x2f180c4effba7523 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e88ed expref: 26 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.530659:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166971.530662:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166971.530666:0:8383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effba77d8 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xa81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e89fe expref: 26 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.530707:0:8383:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc8c7ac00/0x2f180c4effba7523 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e88ed expref: 26 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.530723:0:8383:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc8c7ac00/0x2f180c4effba7523 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e88ed expref: 26 pid: 8383 timeout: 690 lvb_type: 0 00000100:00100000:3.0:1762166971.530738:0:8383:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4013480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8383:1847765449589248:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166971.530835:0:8383:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc9a5e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166971.535044:0:8383:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4013480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8383:1847765449589248:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166971.535100:0:8383:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effba77d8 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xa81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e89fe expref: 26 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.535121:0:8383:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8473000, rc 0) 00000100:00100000:3.0:1762166971.535240:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+27:61801:x1847765450065024:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 4650us (4919us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166971.535260:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18184 00000100:00100000:3.0:1762166971.537706:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1462 00000100:00100000:3.0:1762166971.537726:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765450065280:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:3.0:1762166971.538269:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa82:0x0] updating lvb size from disk: 244463 -> 49152 00002000:00010000:3.0:1762166971.538275:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa82:0x0] updating lvb mtime from disk: 1762166971 -> 1762166971 00002000:00010000:3.0:1762166971.538277:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa82:0x0] updating lvb atime from disk: 1762166970 -> 1762166970 00002000:00010000:3.0:1762166971.538279:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa82:0x0] updating lvb ctime from disk: 1762166971 -> 1762166971 00002000:00010000:3.0:1762166971.538281:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa82:0x0] updating lvb blocks from disk: 296 -> 96 00000100:00100000:3.0:1762166971.538327:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+24:2418:x1847765450065280:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 610us (904us total) trans 21474842892 rc 0/0 00000100:00100000:3.0:1762166971.538335:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1462 00002000:00010000:3.0:1762166971.538340:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2690 (49152->18446744073709551615) 00002000:00100000:3.0:1762166971.538344:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf783f800 with x1847765450065280 ext(49152->18446744073709551615) 00002000:00010000:3.0:1762166971.538351:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945cf783f800. 00000100:00100000:3.0:1762166971.542232:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450065664 00000100:00100000:3.0:1762166971.542242:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450065664 00000100:00100000:3.0:1762166971.542307:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1464 00000100:00100000:3.0:1762166971.542325:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+26:2418:x1847765450065664:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:3.0:1762166971.542364:0:23940:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effba77ed lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.542380:0:23940:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166971.542383:0:23940:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166971.542388:0:23940:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effba77ed lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [61440->81919] (req 61440->81919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.542401:0:23940:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effba77ed lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [61440->81919] (req 61440->81919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.543458:0:23940:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effba77ed lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [61440->81919] (req 61440->81919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.543470:0:23940:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effba77ed lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [61440->81919] (req 61440->81919) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.543520:0:23940:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effba77ed lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [61440->81919] (req 61440->81919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.543528:0:23940:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8473600 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166971.543532:0:23940:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effba77ed lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [61440->81919] (req 61440->81919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.543541:0:23940:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effba77ed lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [61440->81919] (req 61440->81919) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.543556:0:23940:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effba77ed lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [61440->81919] (req 61440->81919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.543563:0:23940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effba77ed lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [61440->81919] (req 61440->81919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166971.543619:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+26:2418:x1847765450065664:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 1296us (1498us total) trans 0 rc 20480/20480 00000100:00100000:3.0:1762166971.543628:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1464 00000100:00100000:3.0:1762166971.545843:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450065792 00000100:00100000:3.0:1762166971.545851:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450065792 00000100:00100000:3.0:1762166971.545922:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1465 00000100:00100000:3.0:1762166971.545933:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+24:2418:x1847765450065792:12345-192.168.204.38@tcp:4:lfs.0 00010000:00010000:3.0:1762166971.545966:0:23940:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc8472800/0x2f180c4effba77f4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa7e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.545980:0:23940:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4b62600/0x2f180c4effba7761 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa7e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e89bf expref: 24 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.545985:0:23940:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166971.545998:0:23940:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166971.546002:0:23940:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8472800/0x2f180c4effba77f4 lrc: 4/0,1 mode: --/PW res: [0x280000400:0xa7e:0x0].0x0 rrc: 3 type: EXT [61440->81919] (req 61440->81919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.546035:0:23940:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc4b62600/0x2f180c4effba7761 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e89bf expref: 24 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.546050:0:23940:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc4b62600/0x2f180c4effba7761 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa7e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e89bf expref: 24 pid: 8383 timeout: 690 lvb_type: 0 00000100:00100000:3.0:1762166971.546066:0:23940:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4013480 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_007:lustre-OST0000_UUID:23940:1847765449589504:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166971.546151:0:23940:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc9a5e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166971.547824:0:23940:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4013480 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_007:lustre-OST0000_UUID:23940:1847765449589504:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166971.547847:0:23940:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bc8472800/0x2f180c4effba77f4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa7e:0x0].0x0 rrc: 3 type: EXT [61440->81919] (req 61440->81919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.548586:0:23940:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bc8472800/0x2f180c4effba77f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa7e:0x0].0x0 rrc: 2 type: EXT [61440->81919] (req 61440->81919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.548599:0:23940:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc8472800/0x2f180c4effba77f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa7e:0x0].0x0 rrc: 2 type: EXT [61440->81919] (req 61440->81919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166971.552413:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7e:0x0] updating lvb size from disk: 49152 -> 81920 00002000:00010000:3.0:1762166971.552419:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7e:0x0] updating lvb blocks from disk: 104 -> 136 00010000:00010000:3.0:1762166971.552436:0:23940:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc8472800/0x2f180c4effba77f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa7e:0x0].0x0 rrc: 2 type: EXT [61440->81919] (req 61440->81919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.552448:0:23940:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8472800/0x2f180c4effba77f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa7e:0x0].0x0 rrc: 2 type: EXT [61440->81919] (req 61440->81919) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.552457:0:23940:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc8472800/0x2f180c4effba77f4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7e:0x0].0x0 rrc: 2 type: EXT [61440->81919] (req 61440->81919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.552464:0:23940:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8472800 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166971.552469:0:23940:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc8472800/0x2f180c4effba77f4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7e:0x0].0x0 rrc: 2 type: EXT [61440->81919] (req 61440->81919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.552509:0:23940:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc8472800/0x2f180c4effba77f4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa7e:0x0].0x0 rrc: 2 type: EXT [61440->81919] (req 61440->81919) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.552530:0:23940:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc8472800/0x2f180c4effba77f4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa7e:0x0].0x0 rrc: 2 type: EXT [61440->81919] (req 61440->81919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.552539:0:23940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc8472800/0x2f180c4effba77f4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa7e:0x0].0x0 rrc: 2 type: EXT [61440->81919] (req 61440->81919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166971.552668:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450065792:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 6732us (6902us total) trans 21474842893 rc 0/0 00000100:00100000:3.0:1762166971.552679:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1465 00000100:00100000:3.0:1762166971.554967:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450066048 00000100:00100000:3.0:1762166971.554977:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450066048 00000100:00100000:3.0:1762166971.555067:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1466 00000100:00100000:3.0:1762166971.555077:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+26:2416:x1847765450066048:12345-192.168.204.38@tcp:4:lfs.0 00010000:00010000:3.0:1762166971.555118:0:23940:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effba77fb lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa7e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.555138:0:23940:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4b63e00/0x2f180c4effba777d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa7e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e89cd expref: 26 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.555146:0:23940:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166971.555149:0:23940:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166971.555152:0:23940:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effba77fb lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0xa7e:0x0].0x0 rrc: 3 type: EXT [61440->81919] (req 61440->81919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.555186:0:23940:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4b63e00/0x2f180c4effba777d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa7e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e89cd expref: 26 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.555200:0:23940:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc4b63e00/0x2f180c4effba777d lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa7e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e89cd expref: 26 pid: 8383 timeout: 690 lvb_type: 0 00000100:00100000:3.0:1762166971.555221:0:23940:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4013480 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_007:lustre-OST0001_UUID:23940:1847765449589632:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166971.555300:0:23940:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc9a5e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166971.556682:0:23940:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4013480 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_007:lustre-OST0001_UUID:23940:1847765449589632:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166971.556764:0:23940:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effba77fb lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa7e:0x0].0x0 rrc: 3 type: EXT [61440->81919] (req 61440->81919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.557191:0:23940:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effba77fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa7e:0x0].0x0 rrc: 2 type: EXT [61440->81919] (req 61440->81919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.557205:0:23940:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effba77fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa7e:0x0].0x0 rrc: 2 type: EXT [61440->81919] (req 61440->81919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166971.560455:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa7e:0x0] updating lvb size from disk: 49152 -> 81920 00002000:00010000:3.0:1762166971.560460:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa7e:0x0] updating lvb blocks from disk: 104 -> 136 00010000:00010000:3.0:1762166971.560472:0:23940:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effba77fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa7e:0x0].0x0 rrc: 2 type: EXT [61440->81919] (req 61440->81919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.560529:0:23940:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effba77fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa7e:0x0].0x0 rrc: 2 type: EXT [61440->81919] (req 61440->81919) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.560538:0:23940:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effba77fb lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa7e:0x0].0x0 rrc: 2 type: EXT [61440->81919] (req 61440->81919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.560546:0:23940:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8473600 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166971.560550:0:23940:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effba77fb lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa7e:0x0].0x0 rrc: 2 type: EXT [61440->81919] (req 61440->81919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.560560:0:23940:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effba77fb lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa7e:0x0].0x0 rrc: 2 type: EXT [61440->81919] (req 61440->81919) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.560577:0:23940:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effba77fb lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa7e:0x0].0x0 rrc: 2 type: EXT [61440->81919] (req 61440->81919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.560583:0:23940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effba77fb lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa7e:0x0].0x0 rrc: 2 type: EXT [61440->81919] (req 61440->81919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166971.560660:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+20:2416:x1847765450066048:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 5580us (5823us total) trans 17179875773 rc 0/0 00000100:00100000:3.0:1762166971.560670:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1466 00000100:00100000:3.0:1762166971.564418:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450066304 00000100:00100000:3.0:1762166971.564430:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450066304 00000100:00100000:3.0:1762166971.564529:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1467 00000100:00100000:3.0:1762166971.564542:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450066304:12345-192.168.204.38@tcp:4:lfs.0 00000100:00100000:3.0:1762166971.587202:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450067072 00000100:00100000:3.0:1762166971.587212:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450067072 00000100:00100000:3.0:1762166971.587265:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18185 00000100:00100000:3.0:1762166971.587276:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3e6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450067072:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:3.0:1762166971.587385:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3e6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450067072:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 111us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166971.587392:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18185 00000100:00100000:3.0:1762166971.588758:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450067200 00000100:00100000:3.0:1762166971.588763:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450067200 00000100:00100000:3.0:1762166971.588794:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18186 00000100:00100000:3.0:1762166971.588803:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450067200:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:3.0:1762166971.588875:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450067200:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 74us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166971.588882:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18186 00000100:00100000:3.0:1762166971.591824:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450067584 00000100:00100000:3.0:1762166971.591831:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450067584 00000100:00100000:3.0:1762166971.591873:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18187 00000100:00100000:3.0:1762166971.591880:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+16:61801:x1847765450067584:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166971.591890:0:8383:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166971.591905:0:8383:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effba781e lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa7e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e8a0c expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166971.591929:0:8383:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa7e:0x0] initial LVB size: 81920, mtime: 0x690888bb, atime: 0x690888b8, ctime: 0x690888bb, blocks: 0x88 00010000:00010000:3.0:1762166971.591946:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166971.591949:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166971.591956:0:8383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effba781e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8a0c expref: 17 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.591970:0:8383:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effba781e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8a0c expref: 17 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.591980:0:8383:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8473600, rc 0) 00000100:00100000:3.0:1762166971.592041:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+17:61801:x1847765450067584:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 161us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166971.592047:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18187 00000100:00100000:3.0:1762166971.596943:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.598411:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450068352 00000100:00100000:3.0:1762166971.598417:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450068352 00000100:00100000:3.0:1762166971.598460:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18188 00000100:00100000:3.0:1762166971.598468:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:61801:x1847765450068352:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166971.598499:0:8383:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166971.598515:0:8383:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8472800/0x2f180c4effba783a lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa7e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e8a1a expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166971.598534:0:8383:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa7e:0x0] initial LVB size: 81920, mtime: 0x690888bb, atime: 0x690888b9, ctime: 0x690888bb, blocks: 0x88 00010000:00010000:3.0:1762166971.598548:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166971.598551:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166971.598557:0:8383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472800/0x2f180c4effba783a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8a1a expref: 21 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.598570:0:8383:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc8472800/0x2f180c4effba783a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8a1a expref: 21 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.598580:0:8383:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8472800, rc 0) 00000100:00100000:3.0:1762166971.598616:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:61801:x1847765450068352:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 149us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166971.598623:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18188 00000100:00100000:3.0:1762166971.605671:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450069120 00000100:00100000:3.0:1762166971.605686:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450069120 00000100:00100000:3.0:1762166971.605740:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18189 00000100:00100000:3.0:1762166971.605752:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:61801:x1847765450069120:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166971.605771:0:8383:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166971.605789:0:8383:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc8472400/0x2f180c4effba7856 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa80:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e8a28 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166971.605807:0:8383:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa80:0x0] initial LVB size: 81920, mtime: 0x690888bb, atime: 0x690888b9, ctime: 0x690888bb, blocks: 0x88 00010000:00010000:3.0:1762166971.605825:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166971.605826:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166971.605832:0:8383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8472400/0x2f180c4effba7856 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8a28 expref: 20 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.605844:0:8383:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc8472400/0x2f180c4effba7856 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8a28 expref: 20 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.605858:0:8383:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8472400, rc 0) 00000100:00100000:3.0:1762166971.605901:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:61801:x1847765450069120:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 154us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166971.605907:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18189 00000100:00100000:3.0:1762166971.607155:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1474 00000100:00100000:3.0:1762166971.607170:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450069248:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:3.0:1762166971.607313:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa80:0x0] updating lvb size from disk: 81920 -> 81920 00002000:00010000:3.0:1762166971.607320:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa80:0x0] updating lvb mtime from disk: 1762166971 -> 1762166971 00002000:00010000:3.0:1762166971.607327:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa80:0x0] updating lvb atime from disk: 1762166969 -> 1762166969 00002000:00010000:3.0:1762166971.607335:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa80:0x0] updating lvb ctime from disk: 1762166971 -> 1762166971 00002000:00010000:3.0:1762166971.607343:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa80:0x0] updating lvb blocks from disk: 136 -> 136 00000100:00100000:3.0:1762166971.607389:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450069248:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 222us (438us total) trans 21474842898 rc 0/0 00000100:00100000:3.0:1762166971.607414:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1474 00002000:00010000:3.0:1762166971.607420:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2688 (81920->18446744073709551615) 00002000:00100000:3.0:1762166971.607426:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf79e8e00 with x1847765450069248 ext(81920->18446744073709551615) 00002000:00010000:3.0:1762166971.607432:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945cf79e8e00. 00000100:00100000:3.0:1762166971.612761:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450069888 00000100:00100000:3.0:1762166971.612771:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450069888 00000100:00100000:3.0:1762166971.612955:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18190 00000100:00100000:3.0:1762166971.612965:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc582df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+23:61801:x1847765450069888:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166971.612984:0:8383:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166971.613023:0:8383:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8472600/0x2f180c4effba7872 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa80:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e8a36 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166971.613048:0:8383:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa80:0x0] initial LVB size: 81920, mtime: 0x690888bb, atime: 0x690888ba, ctime: 0x690888bb, blocks: 0x88 00010000:00010000:3.0:1762166971.613069:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166971.613071:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166971.613079:0:8383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472600/0x2f180c4effba7872 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8a36 expref: 24 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.613093:0:8383:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc8472600/0x2f180c4effba7872 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8a36 expref: 24 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.613105:0:8383:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8472600, rc 0) 00000100:00100000:3.0:1762166971.613163:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc582df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+24:61801:x1847765450069888:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 200us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166971.613170:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18190 00000100:00100000:3.0:1762166971.614363:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450070016 00000100:00100000:3.0:1762166971.614371:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450070016 00002000:00010000:3.0:1762166971.614401:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2688 (81920->18446744073709551615) 00002000:00100000:3.0:1762166971.614405:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc582c700 with x1847765450070016 ext(81920->18446744073709551615) 00002000:00010000:3.0:1762166971.614412:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc582c700. 00000100:00100000:3.0:1762166971.614439:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1476 00000100:00100000:3.0:1762166971.614447:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc582c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+24:2417:x1847765450070016:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:3.0:1762166971.614710:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa80:0x0] updating lvb size from disk: 81920 -> 81920 00002000:00010000:3.0:1762166971.614716:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa80:0x0] updating lvb mtime from disk: 1762166971 -> 1762166971 00002000:00010000:3.0:1762166971.614719:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa80:0x0] updating lvb atime from disk: 1762166970 -> 1762166970 00002000:00010000:3.0:1762166971.614721:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa80:0x0] updating lvb ctime from disk: 1762166971 -> 1762166971 00002000:00010000:3.0:1762166971.614724:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa80:0x0] updating lvb blocks from disk: 136 -> 136 00000100:00100000:3.0:1762166971.614777:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc582c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+25:2417:x1847765450070016:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 330us (559us total) trans 17179875778 rc 0/0 00000100:00100000:3.0:1762166971.614789:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1476 00002000:00010000:3.0:1762166971.614794:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2688 (81920->18446744073709551615) 00002000:00100000:3.0:1762166971.614799:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc582c700 with x1847765450070016 ext(81920->18446744073709551615) 00002000:00010000:3.0:1762166971.614808:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc582c700. 00000100:00100000:3.0:1762166971.619911:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450070656 00000100:00100000:3.0:1762166971.619924:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450070656 00000100:00100000:3.0:1762166971.619984:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18191 00000100:00100000:3.0:1762166971.620007:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc582dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+22:61801:x1847765450070656:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166971.620026:0:8383:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166971.620050:0:8383:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc8472a00/0x2f180c4effba788e lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa82:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e8a44 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166971.620075:0:8383:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa82:0x0] initial LVB size: 81920, mtime: 0x690888bb, atime: 0x690888ba, ctime: 0x690888bb, blocks: 0x88 00010000:00010000:3.0:1762166971.620097:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166971.620101:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166971.620109:0:8383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8472a00/0x2f180c4effba788e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8a44 expref: 23 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.620125:0:8383:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc8472a00/0x2f180c4effba788e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8a44 expref: 23 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.620139:0:8383:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8472a00, rc 0) 00000100:00100000:3.0:1762166971.620213:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc582dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+23:61801:x1847765450070656:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 208us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166971.620222:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18191 00000100:00100000:3.0:1762166971.621652:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450070912 00000100:00100000:3.0:1762166971.621662:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450070912 00002000:00010000:3.0:1762166971.621702:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2689 (0->18446744073709551615) 00002000:00100000:3.0:1762166971.621708:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc582e680 with x1847765450070912 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166971.621720:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc582e680. 00000100:00100000:3.0:1762166971.621783:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1479 00000100:00100000:3.0:1762166971.621802:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc582e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+25:2419:x1847765450070912:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:3.0:1762166971.621970:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa81:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166971.621977:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa81:0x0] updating lvb mtime from disk: 1762166971 -> 1762166971 00002000:00010000:3.0:1762166971.621980:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa81:0x0] updating lvb atime from disk: 1762166970 -> 1762166970 00002000:00010000:3.0:1762166971.621983:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa81:0x0] updating lvb ctime from disk: 1762166971 -> 1762166971 00002000:00010000:3.0:1762166971.621999:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa81:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166971.622043:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc582e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765450070912:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 244us (446us total) trans 17179875779 rc 0/0 00000100:00100000:3.0:1762166971.622082:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1479 00002000:00010000:3.0:1762166971.622091:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2689 (0->18446744073709551615) 00002000:00100000:3.0:1762166971.622099:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc582e680 with x1847765450070912 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166971.622112:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc582e680. 00000100:00100000:3.0:1762166971.626664:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450071168 00000100:00100000:3.0:1762166971.626678:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450071168 00000100:00100000:3.0:1762166971.626758:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1480 00000100:00100000:3.0:1762166971.626772:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc582c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+26:2417:x1847765450071168:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:3.0:1762166971.626810:0:23942:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8472000/0x2f180c4effba78a3 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.626826:0:23942:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166971.626829:0:23942:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166971.626833:0:23942:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472000/0x2f180c4effba78a3 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [122880->188415] (req 122880->188415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.626848:0:23942:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8472000/0x2f180c4effba78a3 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [122880->188415] (req 122880->188415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.628055:0:23942:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8472000/0x2f180c4effba78a3 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [122880->188415] (req 122880->188415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.628070:0:23942:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472000/0x2f180c4effba78a3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [122880->188415] (req 122880->188415) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.628079:0:23942:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc8472000/0x2f180c4effba78a3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [122880->188415] (req 122880->188415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.628086:0:23942:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8472000 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166971.628091:0:23942:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8472000/0x2f180c4effba78a3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [122880->188415] (req 122880->188415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.628100:0:23942:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8472000/0x2f180c4effba78a3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [122880->188415] (req 122880->188415) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.628118:0:23942:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc8472000/0x2f180c4effba78a3 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [122880->188415] (req 122880->188415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.628125:0:23942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8472000/0x2f180c4effba78a3 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [122880->188415] (req 122880->188415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166971.628196:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc582c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+26:2417:x1847765450071168:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 1425us (1723us total) trans 0 rc 65536/65536 00000100:00100000:3.0:1762166971.628207:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1480 00000100:00100000:3.0:1762166971.630238:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450071296 00000100:00100000:3.0:1762166971.630248:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450071296 00000100:00100000:3.0:1762166971.630317:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1481 00000100:00100000:3.0:1762166971.630327:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765450071296:12345-192.168.204.38@tcp:4:lfs.0 00010000:00010000:3.0:1762166971.630361:0:23942:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc8473c00/0x2f180c4effba78aa lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa7e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.630379:0:23942:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effba781e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa7e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8a0c expref: 24 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.630386:0:23942:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166971.630388:0:23942:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166971.630390:0:23942:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8473c00/0x2f180c4effba78aa lrc: 4/0,1 mode: --/PW res: [0x280000400:0xa7e:0x0].0x0 rrc: 3 type: EXT [122880->188415] (req 122880->188415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.630427:0:23942:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effba781e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8a0c expref: 24 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.630439:0:23942:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effba781e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa7e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8a0c expref: 24 pid: 8383 timeout: 690 lvb_type: 0 00000100:00100000:3.0:1762166971.630454:0:23942:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4010e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_009:lustre-OST0000_UUID:23942:1847765449590144:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166971.646909:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.648316:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.655564:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450072192 00000100:00100000:3.0:1762166971.655573:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450072192 00010000:00010000:3.0:1762166971.655616:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472600/0x2f180c4effba7872 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa80:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8a36 expref: 21 pid: 8383 timeout: 690 lvb_type: 0 00000100:00100000:3.0:1762166971.655649:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9223 00000100:00100000:3.0:1762166971.655660:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff1ab850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450072192:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166971.655676:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166971.655700:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc8472600/0x2f180c4effba7872 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa80:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8a36 expref: 21 pid: 8383 timeout: 690 lvb_type: 0 00010000:00010000:3.0:1762166971.655714:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc8472600/0x2f180c4effba7872 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa80:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8a36 expref: 21 pid: 8383 timeout: 690 lvb_type: 0 00010000:00010000:3.0:1762166971.655739:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8472600/0x2f180c4effba7872 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa80:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8a36 expref: 21 pid: 8383 timeout: 690 lvb_type: 0 00010000:00010000:3.0:1762166971.655761:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166971.655763:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166971.655769:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc5ae4800/0x2f180c4effba78bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa80:0x0].0x0 rrc: 3 type: EXT [122880->188415] (req 122880->188415) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.655779:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc5ae4800/0x2f180c4effba78bf lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xa80:0x0].0x0 rrc: 3 type: EXT [122880->188415] (req 122880->188415) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.655814:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166971.655886:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff1ab850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450072192:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 227us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166971.655897:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9223 00000100:00100000:3.0:1762166971.661402:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.663068:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.668844:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450072576 00000100:00100000:3.0:1762166971.668858:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450072576 00000100:00100000:3.0:1762166971.668919:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18192 00000100:00100000:3.0:1762166971.668929:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:2416:x1847765450072576:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:3.0:1762166971.669102:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:2416:x1847765450072576:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 173us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166971.669111:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18192 00010000:00010000:3.0:1762166971.669174:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bca743200/0x2f180c4effba4ded lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166971.669192:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bca743200/0x2f180c4effba4ded lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166971.669205:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bca743200/0x2f180c4effba4ded lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166971.669212:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bca743200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166971.669218:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bca743200/0x2f180c4effba4ded lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166971.669226:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bca743200/0x2f180c4effba4ded lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166971.669245:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x85409d3b (ffff945bc1090a00) 00010000:00010000:3.0:1762166971.669249:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166971.669254:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bca743200/0x2f180c4effba4ded lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166971.669263:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bca743200/0x2f180c4effba4ded lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166971.669285:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effba4df4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166971.669291:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effba4df4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166971.669297:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effba4df4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166971.669302:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945d00f14000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166971.669304:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effba4df4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166971.669310:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effba4df4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166971.669318:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x53:0x0].0x0 (ffff945cceafb300) 00010000:00010000:3.0:1762166971.669321:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166971.669323:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effba4df4 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166971.669328:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d00f14000/0x2f180c4effba4df4 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x53:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166971.669337:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc42d1200/0x2f180c4effba4dfb lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166971.669343:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc42d1200/0x2f180c4effba4dfb lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166971.669390:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc42d1200/0x2f180c4effba4dfb lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166971.669395:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc42d1200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166971.669398:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc42d1200/0x2f180c4effba4dfb lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166971.669403:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc42d1200/0x2f180c4effba4dfb lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166971.669411:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd0:0x6:0x0].0x0 (ffff945cceafbd00) 00010000:00010000:3.0:1762166971.669414:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166971.669416:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc42d1200/0x2f180c4effba4dfb lrc: 2/0,0 mode: --/TXN res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166971.669422:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc42d1200/0x2f180c4effba4dfb lrc: 0/0,0 mode: --/TXN res: [0x200000bd0:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 00000100:00100000:3.0:1762166971.670583:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450072704 00000100:00100000:3.0:1762166971.670592:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450072704 00000100:00100000:3.0:1762166971.670638:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18193 00000100:00100000:3.0:1762166971.670654:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+19:2416:x1847765450072704:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:3.0:1762166971.670744:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+19:2416:x1847765450072704:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 96us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166971.670752:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18193 00000100:00100000:3.0:1762166971.673661:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450073088 00000100:00100000:3.0:1762166971.673666:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450073088 00000100:00100000:3.0:1762166971.673697:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18194 00000100:00100000:3.0:1762166971.673702:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+16:61801:x1847765450073088:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166971.673714:0:35247:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166971.673730:0:35247:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc8472600/0x2f180c4effba78d4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa7e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e8a52 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166971.673751:0:35247:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa7e:0x0] initial LVB size: 188416, mtime: 0x690888bb, atime: 0x690888b8, ctime: 0x690888bb, blocks: 0x108 00010000:00010000:3.0:1762166971.673765:0:35247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166971.673767:0:35247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166971.673772:0:35247:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8472600/0x2f180c4effba78d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8a52 expref: 17 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.673790:0:35247:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc8472600/0x2f180c4effba78d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8a52 expref: 17 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.673803:0:35247:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8472600, rc 0) 00000100:00100000:3.0:1762166971.673847:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+17:61801:x1847765450073088:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 144us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166971.673854:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18194 00000100:00100000:3.0:1762166971.674984:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450073344 00000100:00100000:3.0:1762166971.674999:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450073344 00002000:00010000:3.0:1762166971.675023:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2685 (0->18446744073709551615) 00002000:00100000:3.0:1762166971.675028:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945ceda2c380 with x1847765450073344 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166971.675037:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945ceda2c380. 00000100:00100000:3.0:1762166971.675059:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1486 00000100:00100000:3.0:1762166971.675070:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450073344:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:3.0:1762166971.675200:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa7d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166971.675203:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa7d:0x0] updating lvb mtime from disk: 1762166971 -> 1762166971 00002000:00010000:3.0:1762166971.675206:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa7d:0x0] updating lvb atime from disk: 1762166968 -> 1762166968 00002000:00010000:3.0:1762166971.675207:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa7d:0x0] updating lvb ctime from disk: 1762166971 -> 1762166971 00002000:00010000:3.0:1762166971.675209:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa7d:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166971.675252:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450073344:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 183us (312us total) trans 17179875782 rc 0/0 00000100:00100000:3.0:1762166971.675262:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1486 00002000:00010000:3.0:1762166971.675267:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2685 (0->18446744073709551615) 00002000:00100000:3.0:1762166971.675269:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945ceda2c380 with x1847765450073344 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166971.675274:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945ceda2c380. 00000100:00100000:3.0:1762166971.679147:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.680387:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450074112 00000100:00100000:3.0:1762166971.680393:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450074112 00002000:00010000:3.0:1762166971.680417:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2687 (0->18446744073709551615) 00002000:00100000:3.0:1762166971.680422:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945ceda2f800 with x1847765450074112 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166971.680430:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945ceda2f800. 00000100:00100000:3.0:1762166971.680454:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1489 00000100:00100000:3.0:1762166971.680465:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+18:2416:x1847765450074112:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:3.0:1762166971.680589:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166971.680594:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7f:0x0] updating lvb mtime from disk: 1762166971 -> 1762166971 00002000:00010000:3.0:1762166971.680596:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7f:0x0] updating lvb atime from disk: 1762166969 -> 1762166969 00002000:00010000:3.0:1762166971.680599:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7f:0x0] updating lvb ctime from disk: 1762166971 -> 1762166971 00002000:00010000:3.0:1762166971.680601:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7f:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166971.680632:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:2416:x1847765450074112:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 167us (319us total) trans 21474842905 rc 0/0 00000100:00100000:3.0:1762166971.680649:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1489 00002000:00010000:3.0:1762166971.680654:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2687 (0->18446744073709551615) 00002000:00100000:3.0:1762166971.680659:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945ceda2f800 with x1847765450074112 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166971.680667:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945ceda2f800. 00000100:00100000:3.0:1762166971.686246:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.686296:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.692252:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.697662:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.701676:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.708726:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450076928 00000100:00100000:3.0:1762166971.708775:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450076928 00010000:00010000:3.0:1762166971.708807:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8472600/0x2f180c4effba78d4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa7e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8a52 expref: 25 pid: 35247 timeout: 690 lvb_type: 0 00000100:00100000:3.0:1762166971.708848:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9225 00000100:00100000:3.0:1762166971.708857:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+25:2419:x1847765450076928:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166971.708870:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166971.708891:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc8472600/0x2f180c4effba78d4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa7e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8a52 expref: 25 pid: 35247 timeout: 690 lvb_type: 0 00010000:00010000:3.0:1762166971.708910:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc8472600/0x2f180c4effba78d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8a52 expref: 25 pid: 35247 timeout: 690 lvb_type: 0 00010000:00010000:3.0:1762166971.708932:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc8472600/0x2f180c4effba78d4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa7e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8a52 expref: 25 pid: 35247 timeout: 690 lvb_type: 0 00010000:00010000:3.0:1762166971.708947:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166971.708949:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166971.708953:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc56eaa00/0x2f180c4effba7960 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa7e:0x0].0x0 rrc: 3 type: EXT [229376->245759] (req 229376->245759) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.708963:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc56eaa00/0x2f180c4effba7960 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa7e:0x0].0x0 rrc: 3 type: EXT [229376->245759] (req 229376->245759) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.708998:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166971.709045:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765450076928:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 188us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166971.709054:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9225 00000100:00100000:3.0:1762166971.714340:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:3.0:1762166971.714690:0:8388:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc56eb000/0x2f180c4effba7967 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa7e:0x0].0x0 rrc: 2 type: EXT [229376->245759] (req 229376->245759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.714702:0:8388:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc56eb000/0x2f180c4effba7967 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa7e:0x0].0x0 rrc: 2 type: EXT [229376->245759] (req 229376->245759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166971.716389:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa7e:0x0] updating lvb size from disk: 188416 -> 245760 00002000:00010000:3.0:1762166971.716398:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa7e:0x0] updating lvb blocks from disk: 264 -> 304 00010000:00010000:3.0:1762166971.716411:0:8388:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc56eb000/0x2f180c4effba7967 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa7e:0x0].0x0 rrc: 2 type: EXT [229376->245759] (req 229376->245759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.716422:0:8388:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc56eb000/0x2f180c4effba7967 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa7e:0x0].0x0 rrc: 2 type: EXT [229376->245759] (req 229376->245759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.716430:0:8388:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc56eb000/0x2f180c4effba7967 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa7e:0x0].0x0 rrc: 2 type: EXT [229376->245759] (req 229376->245759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.716437:0:8388:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc56eb000 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166971.716441:0:8388:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc56eb000/0x2f180c4effba7967 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa7e:0x0].0x0 rrc: 2 type: EXT [229376->245759] (req 229376->245759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.716452:0:8388:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc56eb000/0x2f180c4effba7967 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa7e:0x0].0x0 rrc: 2 type: EXT [229376->245759] (req 229376->245759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.716470:0:8388:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc56eb000/0x2f180c4effba7967 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa7e:0x0].0x0 rrc: 2 type: EXT [229376->245759] (req 229376->245759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.716519:0:8388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc56eb000/0x2f180c4effba7967 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa7e:0x0].0x0 rrc: 2 type: EXT [229376->245759] (req 229376->245759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166971.716621:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5588700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450077056:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 3634us (3820us total) trans 17179875787 rc 0/0 00000100:00100000:3.0:1762166971.716631:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1498 00000100:00100000:3.0:1762166971.718753:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.720641:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.725281:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.727251:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.732411:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.734622:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00002000:00010000:3.0:1762166971.736900:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa82:0x0] updating lvb size from disk: 188416 -> 245760 00002000:00010000:3.0:1762166971.736906:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa82:0x0] updating lvb blocks from disk: 264 -> 296 00010000:00010000:3.0:1762166971.736918:0:8388:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc56eb000/0x2f180c4effba797c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa82:0x0].0x0 rrc: 2 type: EXT [229376->245759] (req 229376->245759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.736928:0:8388:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc56eb000/0x2f180c4effba797c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa82:0x0].0x0 rrc: 2 type: EXT [229376->245759] (req 229376->245759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.736936:0:8388:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc56eb000/0x2f180c4effba797c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa82:0x0].0x0 rrc: 2 type: EXT [229376->245759] (req 229376->245759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.736944:0:8388:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc56eb000 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166971.736948:0:8388:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc56eb000/0x2f180c4effba797c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa82:0x0].0x0 rrc: 2 type: EXT [229376->245759] (req 229376->245759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.736958:0:8388:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc56eb000/0x2f180c4effba797c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa82:0x0].0x0 rrc: 2 type: EXT [229376->245759] (req 229376->245759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.736975:0:8388:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc56eb000/0x2f180c4effba797c lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa82:0x0].0x0 rrc: 2 type: EXT [229376->245759] (req 229376->245759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.736996:0:8388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc56eb000/0x2f180c4effba797c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa82:0x0].0x0 rrc: 2 type: EXT [229376->245759] (req 229376->245759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166971.737140:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4013480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+16:2419:x1847765450077824:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 4468us (4740us total) trans 21474842911 rc 0/0 00000100:00100000:3.0:1762166971.737151:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1501 00000100:00100000:3.0:1762166971.739721:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.746388:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.746435:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.751275:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.753232:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.753270:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.760100:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.762258:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450080128 00000100:00100000:3.0:1762166971.762271:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450080128 00002000:00010000:3.0:1762166971.762312:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2687 (0->18446744073709551615) 00002000:00100000:3.0:1762166971.762319:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945ceda2d180 with x1847765450080128 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166971.762330:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945ceda2d180. 00000100:00100000:3.0:1762166971.762362:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1507 00000100:00100000:3.0:1762166971.762373:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450080128:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:3.0:1762166971.762597:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166971.762606:0:23939:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7f:0x0] updating lvb mtime from disk: 1762166971 -> 1762166971 00002000:00010000:3.0:1762166971.762612:0:23939:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7f:0x0] updating lvb atime from disk: 1762166969 -> 1762166969 00002000:00010000:3.0:1762166971.762618:0:23939:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7f:0x0] updating lvb ctime from disk: 1762166971 -> 1762166971 00002000:00010000:3.0:1762166971.762629:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7f:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166971.762708:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450080128:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 333us (532us total) trans 21474842914 rc 0/0 00000100:00100000:3.0:1762166971.762736:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1507 00002000:00010000:3.0:1762166971.762744:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2687 (0->18446744073709551615) 00002000:00100000:3.0:1762166971.762754:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945ceda2d180 with x1847765450080128 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166971.762763:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945ceda2d180. 00000100:00100000:3.0:1762166971.780442:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.782830:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450082048 00000100:00100000:3.0:1762166971.782836:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450082048 00002000:00010000:3.0:1762166971.782854:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2688 (249934->18446744073709551615) 00002000:00100000:3.0:1762166971.782862:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf7839f80 with x1847765450082048 ext(249934->18446744073709551615) 00002000:00010000:3.0:1762166971.782869:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945cf7839f80. 00000100:00100000:3.0:1762166971.782902:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1513 00000100:00100000:3.0:1762166971.782909:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf7839f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765450082048:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:3.0:1762166971.783101:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa80:0x0] updating lvb size from disk: 245760 -> 249934 00002000:00010000:3.0:1762166971.783104:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa80:0x0] updating lvb mtime from disk: 1762166971 -> 1762166972 00002000:00010000:3.0:1762166971.783106:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa80:0x0] updating lvb atime from disk: 1762166969 -> 1762166969 00002000:00010000:3.0:1762166971.783107:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa80:0x0] updating lvb ctime from disk: 1762166971 -> 1762166972 00002000:00010000:3.0:1762166971.783109:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa80:0x0] updating lvb blocks from disk: 304 -> 304 00000100:00100000:3.0:1762166971.783192:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf7839f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+24:2418:x1847765450082048:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 282us (491us total) trans 21474842917 rc 0/0 00000100:00100000:3.0:1762166971.783199:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1513 00002000:00010000:3.0:1762166971.783202:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2688 (249934->18446744073709551615) 00002000:00100000:3.0:1762166971.783204:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf7839f80 with x1847765450082048 ext(249934->18446744073709551615) 00002000:00010000:3.0:1762166971.783209:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945cf7839f80. 00000100:00100000:3.0:1762166971.792262:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.792301:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.793796:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.795622:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.797248:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.797291:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.800202:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.801818:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.804840:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.807132:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.809234:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.819242:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.821083:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.821140:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.824420:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.825946:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.825995:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.828634:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.830180:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.830213:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.833683:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.835140:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.835161:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.838029:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.839174:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.839194:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.841163:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.844030:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.846710:0:6481:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc558aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6481:1847765449591808:192.168.204.38@tcp:105: 00010000:00010000:3.0:1762166971.846730:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166971.846781:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc582ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+34:2418:x1847765450088960:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1187us (1366us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166971.846792:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9231 00000100:00100000:3.0:1762166971.848188:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450089216 00000100:00100000:3.0:1762166971.848199:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450089216 00010000:00010000:3.0:1762166971.848235:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8800/0x2f180c4effba7714 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e89b1 expref: 37 pid: 28874 timeout: 690 lvb_type: 1 00000100:00100000:3.0:1762166971.848272:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9232 00000100:00100000:3.0:1762166971.848281:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+37:2418:x1847765450089216:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166971.848294:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166971.848312:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8800/0x2f180c4effba7714 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e89b1 expref: 37 pid: 28874 timeout: 690 lvb_type: 1 00010000:00010000:3.0:1762166971.848325:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8800/0x2f180c4effba7714 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e89b1 expref: 37 pid: 28874 timeout: 690 lvb_type: 1 00010000:00010000:3.0:1762166971.848347:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8800/0x2f180c4effba7714 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e89b1 expref: 37 pid: 28874 timeout: 690 lvb_type: 1 00010000:00010000:3.0:1762166971.848361:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166971.848364:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166971.848369:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945cf3cada00/0x2f180c4effba7ae8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8b2b expref: 36 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.848379:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cf3cada00/0x2f180c4effba7ae8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8b2b expref: 36 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.848417:0:6481:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff945cf3cada00/0x2f180c4effba7ae8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8b2b expref: 36 pid: 35247 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166971.848429:0:6481:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4492a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6481:1847765449592064:192.168.204.38@tcp:105: 00000100:00100000:3.0:1762166971.848559:0:6481:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc9a5e000 going to sleep for 11 seconds 00000100:00100000:3.0:1762166971.849461:0:6481:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4492a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6481:1847765449592064:192.168.204.38@tcp:105: 00010000:00010000:3.0:1762166971.849475:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166971.849543:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+36:2418:x1847765450089216:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1261us (1523us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166971.849554:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9232 00000100:00100000:3.0:1762166971.853820:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450089984 00000100:00100000:3.0:1762166971.853827:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450089984 00010000:00010000:3.0:1762166971.853883:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effba76f8 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 36 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8995 expref: 619 pid: 6494 timeout: 691 lvb_type: 0 00000100:00100000:3.0:1762166971.853909:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9233 00000100:00100000:3.0:1762166971.853915:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc582c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+619:2419:x1847765450089984:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166971.853927:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166971.853934:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effba76f8 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 37 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8995 expref: 619 pid: 6494 timeout: 691 lvb_type: 0 00010000:00010000:3.0:1762166971.853946:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effba76f8 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 37 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8995 expref: 619 pid: 6494 timeout: 691 lvb_type: 0 00010000:00010000:3.0:1762166971.853971:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effba76f8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 37 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8995 expref: 619 pid: 6494 timeout: 691 lvb_type: 0 00010000:00010000:3.0:1762166971.854000:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc718dd00) 00010000:00010000:3.0:1762166971.854005:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb800/0x2f180c4effba7aef lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 36 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166971.854022:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb800/0x2f180c4effba7aef lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 36 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166971.854029:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb800/0x2f180c4effba7aef lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 36 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166971.854053:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166971.854092:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc582c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+618:2419:x1847765450089984:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 174us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166971.854103:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9233 00000001:00080000:3.0:1762166971.855663:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294991365 is committed 00000004:00080000:3.0:1762166971.855671:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3120 committed 00000004:00080000:3.0:1762166971.855685:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3123 committed 00000004:00080000:3.0:1762166971.855696:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3122 committed 00000004:00080000:3.0:1762166971.855700:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3119 committed 00000004:00080000:3.0:1762166971.855703:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3118 committed 00000004:00080000:3.0:1762166971.855708:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3121 committed 00000004:00080000:3.0:1762166971.855714:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3120 committed 00000004:00080000:3.0:1762166971.855720:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3117 committed 00000004:00080000:3.0:1762166971.855727:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3116 committed 00000004:00080000:3.0:1762166971.855733:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3119 committed 00000004:00080000:3.0:1762166971.855738:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3115 committed 00000004:00080000:3.0:1762166971.855742:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3118 committed 00000004:00080000:3.0:1762166971.855749:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3117 committed 00000004:00080000:3.0:1762166971.855755:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3114 committed 00000004:00010000:3.0:1762166971.855951:0:19593:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000aba923e6 reply state 00000000c6efdb0a transno 4294991365 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb800/0x2f180c4effba7aef lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 33 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166971.855968:0:19593:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb800/0x2f180c4effba7aef lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 33 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166971.856001:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc718dd00) 00010000:00010000:3.0:1762166971.856006:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1762166971.856010:0:19593:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1762166971.856018:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc718dd00) 00010000:00010000:3.0:1762166971.856025:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166971.856034:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effba76ce lrc: 0/0,0 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 33 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e898e expref: 553 pid: 6494 timeout: 0 lvb_type: 0 00010000:00080000:3.0:1762166971.856156:0:19593:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1762166971.856181:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff2fc850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+552:61801:x1847765450089856:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 3801us (3948us total) trans 4294991365 rc 0/0 00000100:00100000:3.0:1762166971.856198:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11660 00000100:00100000:3.0:1762166971.856746:0:3633:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 17179875765 gen 2 00000004:00080000:3.0:1762166971.856756:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc47b6300, transno 17179875759 00000004:00080000:3.0:1762166971.856770:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc47b7800, transno 17179875760 00000004:00080000:3.0:1762166971.856779:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc47b5180, transno 17179875761 00000004:00080000:3.0:1762166971.856788:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc47b4380, transno 17179875762 00000004:00080000:3.0:1762166971.856793:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc47b7480, transno 17179875763 00000004:00080000:3.0:1762166971.856800:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945d011eaa00, transno 17179875764 00000004:00080000:3.0:1762166971.856805:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc47b6a00, transno 17179875765 00000100:00100000:3.0:1762166971.856816:0:3633:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff945bc558bb80 x1847765449592320/t17179875807(17179875807) o2->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 440/432 e 0 to 0 dl 1762166987 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1762166971.856832:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc558bb80/2, rc 0, transno 17179875807 00000100:00100000:3.0:1762166971.856844:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc558bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449592320:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1762166971.856868:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc558aa00/2, rc 0, transno 17179875806 00000100:00100000:3.0:1762166971.856878:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc558aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449592960:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1762166971.856900:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc4011f80/2, rc 0, transno 17179875808 00000100:00100000:3.0:1762166971.856910:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4011f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449593472:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166971.856942:0:3633:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 21474842884 gen 2 00000004:00080000:3.0:1762166971.856952:0:3633:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 21474842870 committed transno 21474842884 00000004:00080000:3.0:1762166971.856978:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc5805500, transno 21474842871 00000004:00080000:3.0:1762166971.857005:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc5804a80, transno 21474842872 00000004:00080000:3.0:1762166971.857012:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc5804700, transno 21474842873 00000004:00080000:3.0:1762166971.857019:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc5805f80, transno 21474842874 00000004:00080000:3.0:1762166971.857026:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc5806a00, transno 21474842875 00000004:00080000:3.0:1762166971.857033:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc5804380, transno 21474842876 00000004:00080000:3.0:1762166971.857040:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc5804000, transno 21474842877 00000004:00080000:3.0:1762166971.857044:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc7b20700, transno 21474842878 00000004:00080000:3.0:1762166971.857051:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc7b22680, transno 21474842879 00000004:00080000:3.0:1762166971.857058:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc4493480, transno 21474842880 00000004:00080000:3.0:1762166971.857064:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc4491180, transno 21474842881 00000004:00080000:3.0:1762166971.857070:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc4491f80, transno 21474842882 00000004:00080000:3.0:1762166971.857075:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc4493b80, transno 21474842883 00000004:00080000:3.0:1762166971.857083:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc7b22a00, transno 21474842884 00000100:00100000:3.0:1762166971.857094:0:3633:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff945cf3db6300 x1847765449593984/t21474842929(21474842929) o2->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 440/432 e 0 to 0 dl 1762166987 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1762166971.857117:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf3db6300/2, rc 0, transno 21474842929 00000100:00100000:3.0:1762166971.857128:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3db6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449593984:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166971.857392:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18219 00000100:00100000:3.0:1762166971.857406:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+7:3636:x1847765449592448:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:3.0:1762166971.857514:0:35247:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166971.857520:0:35247:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb mtime from disk: 1762166966 -> 1762166966 00002000:00010000:3.0:1762166971.857527:0:35247:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1762166971.857533:0:35247:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb ctime from disk: 1762166966 -> 1762166966 00002000:00010000:3.0:1762166971.857538:0:35247:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166971.857583:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+8:3636:x1847765449592448:12345-0@lo:2:osp-syn-0-1.0 Request processed in 179us (261us total) trans 21474842930 rc 0/0 00000100:00100000:3.0:1762166971.857606:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18219 00000100:00100000:3.0:1762166971.857629:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449593344 00000100:00100000:3.0:1762166971.857634:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449593344 00000100:00100000:3.0:1762166971.857662:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449593856 00000100:00100000:3.0:1762166971.857666:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449593856 00000100:00100000:3.0:1762166971.857689:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18222 00000100:00100000:3.0:1762166971.857700:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+9:3636:x1847765449593856:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:3.0:1762166971.857790:0:35247:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa81:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166971.857798:0:35247:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa81:0x0] updating lvb mtime from disk: 1762166972 -> 1762166972 00002000:00010000:3.0:1762166971.857806:0:35247:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa81:0x0] updating lvb atime from disk: 1762166970 -> 1762166970 00002000:00010000:3.0:1762166971.857814:0:35247:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa81:0x0] updating lvb ctime from disk: 1762166972 -> 1762166972 00002000:00010000:3.0:1762166971.857820:0:35247:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa81:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166971.857863:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+11:3636:x1847765449593856:12345-0@lo:2:osp-syn-0-1.0 Request processed in 164us (308us total) trans 21474842932 rc 0/0 00000100:00100000:3.0:1762166971.857880:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18222 00000004:00080000:3.0:1762166971.858191:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf3db4000/2, rc 0, transno 21474842933 00000100:00100000:3.0:1762166971.858203:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3db4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449593088:0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1762166971.858230:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf3db4e00/2, rc 0, transno 21474842934 00000100:00100000:3.0:1762166971.858241:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3db4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449593600:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166971.860412:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.876408:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166971.905380:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450091264 00000100:00100000:3.0:1762166971.905389:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450091264 00010000:00010000:3.0:1762166971.905430:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4b63400/0x2f180c4effba7ada lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8b1d expref: 39 pid: 35247 timeout: 691 lvb_type: 0 00000100:00100000:3.0:1762166971.905519:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9234 00000100:00100000:3.0:1762166971.905530:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+39:2418:x1847765450091264:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166971.905548:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166971.905575:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc4b63400/0x2f180c4effba7ada lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8b1d expref: 39 pid: 35247 timeout: 691 lvb_type: 0 00010000:00010000:3.0:1762166971.905589:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc4b63400/0x2f180c4effba7ada lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8b1d expref: 39 pid: 35247 timeout: 691 lvb_type: 0 00010000:00010000:3.0:1762166971.905617:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4b63400/0x2f180c4effba7ada lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8b1d expref: 39 pid: 35247 timeout: 691 lvb_type: 0 00010000:00010000:3.0:1762166971.905635:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166971.905638:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166971.905643:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62c00/0x2f180c4effba7b43 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.905655:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62c00/0x2f180c4effba7b43 lrc: 4/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.905687:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166971.905759:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+38:2418:x1847765450091264:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 227us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166971.905770:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9234 00000100:00100000:3.0:1762166971.915110:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450091520 00000100:00100000:3.0:1762166971.915121:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450091520 00010000:00010000:3.0:1762166971.915166:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf600/0x2f180c4effba798a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa7e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8a98 expref: 36 pid: 35247 timeout: 691 lvb_type: 0 00000100:00100000:3.0:1762166971.915211:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9235 00000100:00100000:3.0:1762166971.915222:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+36:2418:x1847765450091520:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166971.915242:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166971.915269:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf600/0x2f180c4effba798a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa7e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8a98 expref: 36 pid: 35247 timeout: 691 lvb_type: 0 00010000:00010000:3.0:1762166971.915284:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf600/0x2f180c4effba798a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8a98 expref: 36 pid: 35247 timeout: 691 lvb_type: 0 00010000:00010000:3.0:1762166971.915314:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf600/0x2f180c4effba798a lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa7e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8a98 expref: 36 pid: 35247 timeout: 691 lvb_type: 0 00010000:00010000:3.0:1762166971.915333:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166971.915335:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166971.915340:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4b62e00/0x2f180c4effba7b4a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa7e:0x0].0x0 rrc: 3 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.915350:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4b62e00/0x2f180c4effba7b4a lrc: 4/1,0 mode: PR/PR res: [0x280000400:0xa7e:0x0].0x0 rrc: 3 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.915384:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166971.915454:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+35:2418:x1847765450091520:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 230us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166971.915519:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9235 00000100:00100000:3.0:1762166971.924001:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450091776 00000100:00100000:3.0:1762166971.924019:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450091776 00010000:00010000:3.0:1762166971.924080:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdee00/0x2f180c4effba79bb lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa7e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8aad expref: 38 pid: 35247 timeout: 691 lvb_type: 0 00000100:00100000:3.0:1762166971.924126:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9236 00000100:00100000:3.0:1762166971.924138:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+38:2419:x1847765450091776:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166971.924203:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166971.924232:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdee00/0x2f180c4effba79bb lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa7e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8aad expref: 38 pid: 35247 timeout: 691 lvb_type: 0 00010000:00010000:3.0:1762166971.924248:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdee00/0x2f180c4effba79bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa7e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8aad expref: 38 pid: 35247 timeout: 691 lvb_type: 0 00010000:00010000:3.0:1762166971.924276:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdee00/0x2f180c4effba79bb lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa7e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8aad expref: 38 pid: 35247 timeout: 691 lvb_type: 0 00010000:00010000:3.0:1762166971.924297:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166971.924300:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166971.924306:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62c00/0x2f180c4effba7b51 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa7e:0x0].0x0 rrc: 3 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.924316:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62c00/0x2f180c4effba7b51 lrc: 4/1,0 mode: PR/PR res: [0x2c0000400:0xa7e:0x0].0x0 rrc: 3 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.924356:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166971.924443:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+37:2419:x1847765450091776:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 306us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166971.924452:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9236 00000100:00100000:3.0:1762166971.932844:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450092032 00000100:00100000:3.0:1762166971.932851:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450092032 00010000:00010000:3.0:1762166971.932880:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf800/0x2f180c4effba79ec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa80:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8ac2 expref: 35 pid: 35247 timeout: 691 lvb_type: 0 00000100:00100000:3.0:1762166971.932967:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9237 00000100:00100000:3.0:1762166971.932976:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff1a9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+35:2419:x1847765450092032:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166971.933001:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166971.933022:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf800/0x2f180c4effba79ec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa80:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8ac2 expref: 35 pid: 35247 timeout: 691 lvb_type: 0 00010000:00010000:3.0:1762166971.933034:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf800/0x2f180c4effba79ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa80:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8ac2 expref: 35 pid: 35247 timeout: 691 lvb_type: 0 00010000:00010000:3.0:1762166971.933054:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf800/0x2f180c4effba79ec lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa80:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8ac2 expref: 35 pid: 35247 timeout: 691 lvb_type: 0 00010000:00010000:3.0:1762166971.933067:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166971.933069:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166971.933073:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4b62e00/0x2f180c4effba7b58 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa80:0x0].0x0 rrc: 3 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.933081:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4b62e00/0x2f180c4effba7b58 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0xa80:0x0].0x0 rrc: 3 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.933109:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166971.933163:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff1a9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+34:2419:x1847765450092032:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 183us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166971.933176:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9237 00000100:00100000:3.0:1762166971.970129:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450093568 00000100:00100000:3.0:1762166971.970139:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450093568 00010000:00010000:3.0:1762166971.970181:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63000/0x2f180c4effba7b74 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8b4e expref: 534 pid: 6494 timeout: 691 lvb_type: 0 00000100:00100000:3.0:1762166971.970225:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9241 00000100:00100000:3.0:1762166971.970236:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d23480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+534:2418:x1847765450093568:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166971.970255:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166971.970267:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63000/0x2f180c4effba7b74 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8b4e expref: 534 pid: 6494 timeout: 691 lvb_type: 0 00010000:00010000:3.0:1762166971.970279:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63000/0x2f180c4effba7b74 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8b4e expref: 534 pid: 6494 timeout: 691 lvb_type: 0 00010000:00010000:3.0:1762166971.970305:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63000/0x2f180c4effba7b74 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8b4e expref: 534 pid: 6494 timeout: 691 lvb_type: 0 00010000:00010000:3.0:1762166971.970324:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc718dd00) 00010000:00010000:3.0:1762166971.970328:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62000/0x2f180c4effba7b89 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166971.970338:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62000/0x2f180c4effba7b89 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166971.970344:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62000/0x2f180c4effba7b89 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166971.970380:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166971.970459:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d23480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+533:2418:x1847765450093568:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 223us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166971.970468:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9241 00000001:00080000:3.0:1762166971.992089:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294991372 is committed 00000004:00080000:3.0:1762166971.992100:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3127 committed 00000004:00080000:3.0:1762166971.992118:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3130 committed 00000004:00080000:3.0:1762166971.992130:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3129 committed 00000004:00080000:3.0:1762166971.992132:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3126 committed 00000004:00080000:3.0:1762166971.992134:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3125 committed 00000004:00080000:3.0:1762166971.992136:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3128 committed 00000004:00080000:3.0:1762166971.992138:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3127 committed 00000004:00080000:3.0:1762166971.992140:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3124 committed 00000004:00080000:3.0:1762166971.992142:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3123 committed 00000004:00080000:3.0:1762166971.992144:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3126 committed 00000004:00080000:3.0:1762166971.992146:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3122 committed 00000004:00080000:3.0:1762166971.992148:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3125 committed 00000004:00080000:3.0:1762166971.992149:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3124 committed 00000004:00080000:3.0:1762166971.992151:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3121 committed 00000100:00100000:3.0:1762166971.992525:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7d20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449595136:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166971.992645:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166971.992680:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7d22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449595776:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166971.992926:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18226 00000100:00100000:3.0:1762166971.992944:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+16:3636:x1847765449595392:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166971.993300:0:35248:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+17:3636:x1847765449595392:12345-0@lo:2:osp-syn-0-1.0 Request processed in 359us (755us total) trans 21474842937 rc 0/0 00000100:00100000:3.0:1762166971.993314:0:35248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18226 00000100:00100000:3.0:1762166971.993354:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18230 00000100:00100000:3.0:1762166971.993371:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+15:3636:x1847765449596416:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166971.993554:0:35248:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+17:3636:x1847765449596416:12345-0@lo:2:osp-syn-1-1.0 Request processed in 185us (774us total) trans 17179875813 rc 0/0 00000100:00100000:3.0:1762166971.993571:0:35248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18230 00000100:00100000:3.0:1762166971.993597:0:35248:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449596800 00000100:00100000:3.0:1762166971.993603:0:35248:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449596800 00000100:00100000:3.0:1762166971.993665:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18235 00000100:00100000:3.0:1762166971.993677:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+16:3635:x1847765449596288:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:3.0:1762166971.993766:0:35248:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa7d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166971.993780:0:35248:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa7d:0x0] updating lvb mtime from disk: 1762166972 -> 1762166972 00002000:00010000:3.0:1762166971.993786:0:35248:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa7d:0x0] updating lvb atime from disk: 1762166968 -> 1762166968 00002000:00010000:3.0:1762166971.993795:0:35248:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa7d:0x0] updating lvb ctime from disk: 1762166972 -> 1762166972 00002000:00010000:3.0:1762166971.993804:0:35248:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa7d:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166971.993857:0:35248:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+17:3635:x1847765449596288:12345-0@lo:2:osp-syn-1-1.0 Request processed in 180us (531us total) trans 17179875816 rc 0/0 00000100:00100000:3.0:1762166971.993876:0:35248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18235 00000100:00100000:3.0:1762166971.998032:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450094464 00000100:00100000:3.0:1762166971.998042:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450094464 00000100:00100000:3.0:1762166971.998100:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18240 00000100:00100000:3.0:1762166971.998110:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1dddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+35:61766:x1847765450094464:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:3.0:1762166971.998127:0:35247:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166971.998148:0:35247:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8472600/0x2f180c4effba7ba5 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e8b6a expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166971.998175:0:35247:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa77:0x0] initial LVB size: 249934, mtime: 0x690888bb, atime: 0x690888bb, ctime: 0x690888bc, blocks: 0x1c8 00010000:00010000:3.0:1762166971.998197:0:35247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166971.998200:0:35247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166971.998209:0:35247:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472600/0x2f180c4effba7ba5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 106496->131071) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8b6a expref: 36 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.998224:0:35247:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc8472600/0x2f180c4effba7ba5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 106496->131071) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8b6a expref: 36 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166971.998236:0:35247:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8472600, rc 0) 00000100:00100000:3.0:1762166971.998300:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1dddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+36:61766:x1847765450094464:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 192us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166971.998308:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18240 00000100:00100000:3.0:1762166972.005046:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.012703:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.015456:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.020587:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.027921:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.034728:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.036506:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.038133:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450096512 00000100:00100000:3.0:1762166972.038141:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450096512 00000100:00100000:3.0:1762166972.038223:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1548 00000100:00100000:3.0:1762166972.038251:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450096256:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:3.0:1762166972.042899:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.048672:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.056847:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.058922:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450097536 00000100:00100000:3.0:1762166972.058931:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450097536 00000100:00100000:3.0:1762166972.059000:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 826 00000100:00100000:3.0:1762166972.059010:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4012680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+532:2419:x1847765450097536:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166972.059038:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166972.059064:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7ba00/0x2f180c4effba7beb lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8b86 expref: 532 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.059079:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc718dd00) 00010000:00010000:3.0:1762166972.059082:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166972.059197:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4012680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+531:2419:x1847765450097536:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 187us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166972.059207:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 826 00000100:00100000:3.0:1762166972.062233:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450098176 00000100:00100000:3.0:1762166972.062238:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450098176 00010000:00010000:3.0:1762166972.062285:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62800/0x2f180c4effba7c00 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5fa:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8b8d expref: 535 pid: 6495 timeout: 691 lvb_type: 0 00000100:00100000:3.0:1762166972.062306:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9242 00000100:00100000:3.0:1762166972.062311:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff1a8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+535:2418:x1847765450098176:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166972.062319:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166972.062324:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62800/0x2f180c4effba7c00 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5fa:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8b8d expref: 535 pid: 6495 timeout: 691 lvb_type: 0 00010000:00010000:3.0:1762166972.062333:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62800/0x2f180c4effba7c00 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5fa:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8b8d expref: 535 pid: 6495 timeout: 691 lvb_type: 0 00010000:00010000:3.0:1762166972.062355:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62800/0x2f180c4effba7c00 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5fa:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8b8d expref: 535 pid: 6495 timeout: 691 lvb_type: 0 00010000:00010000:3.0:1762166972.062364:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5fa:0x0].0x0 (ffff945cf1ef6c00) 00010000:00010000:3.0:1762166972.062368:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62000/0x2f180c4effba7c15 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5fa:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166972.062373:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62000/0x2f180c4effba7c15 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5fa:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166972.062377:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62000/0x2f180c4effba7c15 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x5fa:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166972.062393:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166972.062419:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff1a8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+534:2418:x1847765450098176:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 106us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166972.062432:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9242 00000100:00100000:3.0:1762166972.063795:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450098432 00000100:00100000:3.0:1762166972.063802:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450098432 00000100:00100000:3.0:1762166972.063840:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11665 00000100:00100000:3.0:1762166972.063850:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+533:61803:x1847765450098432:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:3.0:1762166972.064035:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+534:61803:x1847765450098432:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 187us (281us total) trans 4294991379 rc 0/0 00000100:00100000:3.0:1762166972.064043:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11665 00000100:00100000:3.0:1762166972.064976:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.066231:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450098816 00000100:00100000:3.0:1762166972.066239:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450098816 00000100:00100000:3.0:1762166972.069439:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.069466:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.069531:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.069583:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18244 00000100:00100000:3.0:1762166972.069636:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc582df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+25:2419:x1847765450099200:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:3.0:1762166972.069670:0:9168:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effba7c54 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.069700:0:9168:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc8472600/0x2f180c4effba7ba5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 106496->131071) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8b6a expref: 25 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.069722:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166972.069727:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166972.069733:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effba7c54 lrc: 4/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.069773:0:9168:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc8472600/0x2f180c4effba7ba5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 106496->131071) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8b6a expref: 25 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.069804:0:9168:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc8472600/0x2f180c4effba7ba5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 106496->131071) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8b6a expref: 25 pid: 35247 timeout: 691 lvb_type: 0 00000100:00100000:3.0:1762166972.069834:0:9168:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc582ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9168:1847765449597184:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166972.069890:0:9168:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a16c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166972.070776:0:9168:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc582ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9168:1847765449597184:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166972.070874:0:9168:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effba7c54 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166972.070940:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450099584 00000100:00100000:3.0:1762166972.070946:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450099584 00010000:00010000:3.0:1762166972.070967:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc936b200/0x2f180c4effba7ae1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8b24 expref: 36 pid: 35247 timeout: 691 lvb_type: 0 00000100:00100000:3.0:1762166972.071011:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450099840 00000100:00100000:3.0:1762166972.071015:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450099840 00010000:00010000:3.0:1762166972.071029:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472600/0x2f180c4effba7ba5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 106496->131071) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8b6a expref: 26 pid: 35247 timeout: 691 lvb_type: 0 00000100:00100000:3.0:1762166972.071091:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9245 00000100:00100000:3.0:1762166972.071103:0:6480:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1dde300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+27:2418:x1847765450099712:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166972.071117:0:6480:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166972.071131:0:6480:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945cf3cada00/0x2f180c4effba7ae8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8b2b expref: 27 pid: 35247 timeout: 691 lvb_type: 0 00010000:00010000:3.0:1762166972.071163:0:6480:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945cf3cada00/0x2f180c4effba7ae8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8b2b expref: 27 pid: 35247 timeout: 691 lvb_type: 0 00010000:00010000:3.0:1762166972.071182:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cf3cada00/0x2f180c4effba7ae8 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8b2b expref: 27 pid: 35247 timeout: 691 lvb_type: 0 00010000:00010000:3.0:1762166972.071214:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166972.071216:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166972.071222:0:6480:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc56eaa00/0x2f180c4effba7c62 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.071232:0:6480:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc56eaa00/0x2f180c4effba7c62 lrc: 4/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.071266:0:6480:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166972.071296:0:6480:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1dde300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+25:2418:x1847765450099712:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 197us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166972.071311:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9245 00010000:00010000:3.0:1762166972.071334:0:9168:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effba7c54 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.071342:0:9168:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effba7c54 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.071369:0:9168:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effba7c54 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.071391:0:9168:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effba7c54 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.071410:0:9168:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effba7c54 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.071432:0:9168:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8473600 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166972.071440:0:9168:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effba7c54 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.071465:0:9168:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effba7c54 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.071555:0:9168:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effba7c54 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.071565:0:9168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effba7c54 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166972.071618:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc582df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765450099200:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 1985us (2178us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166972.071633:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18244 00000100:00100000:3.0:1762166972.072719:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450099968 00000100:00100000:3.0:1762166972.072727:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450099968 00000100:00100000:3.0:1762166972.072768:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18247 00000100:00100000:3.0:1762166972.072780:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765450099968:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166972.072802:0:9168:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166972.072819:0:9168:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8472000/0x2f180c4effba7c69 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e8bb7 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166972.072835:0:9168:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa77:0x0] initial LVB size: 39212, mtime: 0x690888bc, atime: 0x690888bb, ctime: 0x690888bc, blocks: 0x30 00010000:00010000:3.0:1762166972.072849:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166972.072852:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166972.072857:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472000/0x2f180c4effba7c69 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8bb7 expref: 25 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166972.072874:0:9168:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc8472000/0x2f180c4effba7c69 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8bb7 expref: 25 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166972.072936:0:9168:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8472000, rc 0) 00000100:00100000:3.0:1762166972.072967:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+24:2418:x1847765450099968:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 188us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166972.072993:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18247 00000100:00100000:3.0:1762166972.105364:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450101120 00000100:00100000:3.0:1762166972.105371:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450101120 00010000:00010000:3.0:1762166972.105394:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc5ae4a00/0x2f180c4effba7c31 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8ba2 expref: 25 pid: 35247 timeout: 691 lvb_type: 1 00000100:00100000:3.0:1762166972.105425:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9246 00000100:00100000:3.0:1762166972.105438:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4531880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+25:2419:x1847765450101120:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166972.105451:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166972.105456:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc5ae4a00/0x2f180c4effba7c31 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8ba2 expref: 25 pid: 35247 timeout: 691 lvb_type: 1 00010000:00010000:3.0:1762166972.105468:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc5ae4a00/0x2f180c4effba7c31 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8ba2 expref: 25 pid: 35247 timeout: 691 lvb_type: 1 00010000:00010000:3.0:1762166972.105524:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc5ae4a00/0x2f180c4effba7c31 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8ba2 expref: 25 pid: 35247 timeout: 691 lvb_type: 1 00010000:00010000:3.0:1762166972.105539:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166972.105542:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166972.105547:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc56eb000/0x2f180c4effba7c9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8bda expref: 24 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.105557:0:9458:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc56eb000/0x2f180c4effba7c9a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8bda expref: 24 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.105584:0:9458:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff945bc56eb000/0x2f180c4effba7c9a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8bda expref: 24 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166972.105602:0:9458:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc582ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:9458:1847765449597568:192.168.204.38@tcp:105: 00000100:00100000:3.0:1762166972.105646:0:9458:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a16c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166972.106658:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.107837:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.109230:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.112450:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.113896:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.123152:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.124778:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.128888:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000001:00080000:3.0:1762166972.129936:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294991382 is committed 00000100:00100000:3.0:1762166972.131067:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.131103:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.138724:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.138797:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.138825:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.138914:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18260 00000100:00100000:3.0:1762166972.138941:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945d011ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+18:2416:x1847765450103424:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:3.0:1762166972.139002:0:35247:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc8472600/0x2f180c4effba7cd2 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.139028:0:35247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166972.139039:0:35247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166972.139052:0:35247:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8472600/0x2f180c4effba7cd2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.139114:0:35247:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc8472600/0x2f180c4effba7cd2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.139184:0:35247:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc8472600/0x2f180c4effba7cd2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.139202:0:35247:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8472600/0x2f180c4effba7cd2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.139258:0:35247:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc8472600/0x2f180c4effba7cd2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.139268:0:35247:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8472600 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166972.139281:0:35247:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc8472600/0x2f180c4effba7cd2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.139314:0:35247:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc8472600/0x2f180c4effba7cd2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.139367:0:35247:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc8472600/0x2f180c4effba7cd2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.139372:0:35247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc8472600/0x2f180c4effba7cd2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166972.139452:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945d011ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+18:2416:x1847765450103424:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 514us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166972.139532:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18260 00000100:00100000:3.0:1762166972.141892:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450104064 00000100:00100000:3.0:1762166972.141898:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450104064 00000100:00100000:3.0:1762166972.141931:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450103936 00000100:00100000:3.0:1762166972.141933:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450103936 00000100:00100000:3.0:1762166972.142921:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.144136:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.145471:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.146953:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18265 00000100:00100000:3.0:1762166972.146965:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+21:2417:x1847765450105088:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:3.0:1762166972.147054:0:35248:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166972.147059:0:35248:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166972 -> 1762166972 00002000:00010000:3.0:1762166972.147062:0:35248:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166971 -> 1762166972 00002000:00010000:3.0:1762166972.147064:0:35248:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166972 -> 1762166972 00002000:00010000:3.0:1762166972.147067:0:35248:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166972.147102:0:35248:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+22:2417:x1847765450105088:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 136us (236us total) trans 17179875832 rc 0/0 00000100:00100000:3.0:1762166972.147116:0:35248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18265 00000100:00100000:3.0:1762166972.147999:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.149223:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.149246:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:3.0:1762166972.149530:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc936ac00/0x2f180c4effba7cee lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166972.149538:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc936ac00/0x2f180c4effba7cee lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166972.149552:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472600/0x2f180c4effba7cf5 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5fa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166972.149561:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb800/0x2f180c4effba7c93 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x5fa:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8bd3 expref: 529 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.149567:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472600/0x2f180c4effba7cf5 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x5fa:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166972.149635:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb800/0x2f180c4effba7c93 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5fa:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8bd3 expref: 529 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.149646:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb800/0x2f180c4effba7c93 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5fa:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8bd3 expref: 529 pid: 6495 timeout: 691 lvb_type: 0 00000100:00100000:3.0:1762166972.149656:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945d011eb480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449598464:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166972.149717:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a19c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166972.151072:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449598592 00000100:00100000:3.0:1762166972.151076:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449598592 00000100:00100000:3.0:1762166972.151105:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1094 00000100:00100000:3.0:1762166972.151110:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449598592:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166972.151173:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449598592:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 62us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166972.151178:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1094 00000004:00080000:3.0:1762166972.151354:0:9994:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0001: 0 changes, 5 in progress, 0 in flight, 9 done 00000004:00080000:3.0:1762166972.151400:0:9994:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0001: 0 changes, 0 in progress, 0 in flight, 5 done 00000100:00100000:3.0:1762166972.157122:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.167551:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.196060:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.204054:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.205407:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.215390:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.217567:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.217607:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.222330:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000001:00080000:3.0:1762166972.224399:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294991395 is committed 00000004:00080000:3.0:1762166972.224405:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3138 committed 00000004:00080000:3.0:1762166972.224420:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3135 committed 00000004:00080000:3.0:1762166972.224431:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3134 committed 00000004:00080000:3.0:1762166972.224434:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3137 committed 00000004:00080000:3.0:1762166972.224439:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3136 committed 00000004:00080000:3.0:1762166972.224443:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3133 committed 00000004:00080000:3.0:1762166972.224447:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3132 committed 00000004:00080000:3.0:1762166972.224452:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3135 committed 00000004:00080000:3.0:1762166972.224458:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3134 committed 00000004:00080000:3.0:1762166972.224463:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3131 committed 00000004:00080000:3.0:1762166972.224469:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3130 committed 00000004:00080000:3.0:1762166972.224473:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3133 committed 00000004:00080000:3.0:1762166972.224515:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3129 committed 00000004:00080000:3.0:1762166972.224522:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3132 committed 00000004:00080000:3.0:1762166972.224528:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3131 committed 00000004:00080000:3.0:1762166972.224535:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3128 committed 00000020:00080000:3.0:1762166972.224572:0:7412:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff945cf3cf4780 refcount 2 committed 0 result 0 batchid 30 00000020:00080000:3.0:1762166972.224581:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cf1d0e400 obd lustre-OST0001-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff945cd1ae6540 00000020:00080000:3.0:1762166972.224587:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cc6772300 obd lustre-OST0000-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff945cf3cf4240 00000020:00080000:3.0:1762166972.224594:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cc7dee100 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff945bc7cea800 00000020:00080000:3.0:1762166972.224599:0:7412:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000400:0x2:0x0].28 00000020:00080000:3.0:1762166972.224680:0:7435:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 30 committed batchid 29 00000020:00080000:3.0:1762166972.224726:0:7435:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 29 00000100:00100000:3.0:1762166972.224788:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449601408 00000100:00100000:3.0:1762166972.224795:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449601408 00000100:00100000:3.0:1762166972.224851:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18269 00000100:00100000:3.0:1762166972.224864:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+6:3633:x1847765449601408:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:3.0:1762166972.224971:0:28434:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 39212 -> 39212 00002000:00010000:3.0:1762166972.224993:0:28434:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166972 -> 1762166972 00002000:00010000:3.0:1762166972.225000:0:28434:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166972 -> 1762166972 00002000:00010000:3.0:1762166972.225006:0:28434:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166972 -> 1762166972 00002000:00010000:3.0:1762166972.225009:0:28434:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 48 -> 48 00000100:00100000:3.0:1762166972.225086:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+7:3633:x1847765449601408:12345-0@lo:2:osp-syn-1-1.0 Request processed in 221us (338us total) trans 17179875834 rc 0/0 00000100:00100000:3.0:1762166972.225110:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18269 00000100:00100000:3.0:1762166972.225135:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449601664 00000100:00100000:3.0:1762166972.225141:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449601664 00000100:00100000:3.0:1762166972.225185:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449601792 00000100:00100000:3.0:1762166972.225191:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449601792 00000100:00100000:3.0:1762166972.225229:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449602304 00000100:00100000:3.0:1762166972.225234:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449602304 00000100:00100000:3.0:1762166972.225321:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18271 00000100:00100000:3.0:1762166972.225331:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+10:3636:x1847765449601792:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166972.225436:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+13:3636:x1847765449601792:12345-0@lo:2:osp-syn-1-1.0 Request processed in 105us (471us total) trans 17179875836 rc 0/0 00000100:00100000:3.0:1762166972.225447:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18271 00000100:00100000:3.0:1762166972.225469:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18274 00000100:00100000:3.0:1762166972.225506:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+7:3635:x1847765449602688:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166972.225688:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+9:3635:x1847765449602688:12345-0@lo:2:osp-syn-0-1.0 Request processed in 134us (472us total) trans 21474842947 rc 0/0 00000100:00100000:3.0:1762166972.225705:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18274 00000100:00100000:3.0:1762166972.225731:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449602048 00000100:00100000:3.0:1762166972.225737:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449602048 00000100:00100000:3.0:1762166972.225772:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18277 00000100:00100000:3.0:1762166972.225794:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+13:3634:x1847765449602048:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166972.225937:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+14:3634:x1847765449602048:12345-0@lo:2:osp-syn-1-1.0 Request processed in 145us (260us total) trans 17179875840 rc 0/0 00000100:00100000:3.0:1762166972.225963:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18277 00000100:00100000:3.0:1762166972.226009:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18279 00000100:00100000:3.0:1762166972.226022:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+11:3634:x1847765449603072:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:3.0:1762166972.226115:0:28434:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa81:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166972.226123:0:28434:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa81:0x0] updating lvb mtime from disk: 1762166972 -> 1762166972 00002000:00010000:3.0:1762166972.226134:0:28434:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa81:0x0] updating lvb atime from disk: 1762166970 -> 1762166970 00002000:00010000:3.0:1762166972.226141:0:28434:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa81:0x0] updating lvb ctime from disk: 1762166972 -> 1762166972 00002000:00010000:3.0:1762166972.226149:0:28434:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa81:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166972.226217:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+15:3634:x1847765449603072:12345-0@lo:2:osp-syn-0-1.0 Request processed in 196us (374us total) trans 21474842950 rc 0/0 00000100:00100000:3.0:1762166972.226237:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18279 00000100:00100000:3.0:1762166972.226406:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449601920 00000100:00100000:3.0:1762166972.226413:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449601920 00000100:00100000:3.0:1762166972.226455:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18283 00000100:00100000:3.0:1762166972.226473:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+13:3633:x1847765449601920:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:3.0:1762166972.226558:0:8380:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa7f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166972.226570:0:8380:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa7f:0x0] updating lvb mtime from disk: 1762166972 -> 1762166972 00002000:00010000:3.0:1762166972.226577:0:8380:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa7f:0x0] updating lvb atime from disk: 1762166969 -> 1762166969 00002000:00010000:3.0:1762166972.226584:0:8380:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa7f:0x0] updating lvb ctime from disk: 1762166972 -> 1762166972 00002000:00010000:3.0:1762166972.226589:0:8380:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa7f:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166972.226648:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+14:3633:x1847765449601920:12345-0@lo:2:osp-syn-1-1.0 Request processed in 177us (286us total) trans 17179875841 rc 0/0 00000100:00100000:3.0:1762166972.226666:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18283 00000100:00100000:3.0:1762166972.226837:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449603328 00000100:00100000:3.0:1762166972.226844:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449603328 00000100:00100000:3.0:1762166972.226875:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18284 00000100:00100000:3.0:1762166972.226883:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+13:3636:x1847765449603328:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:3.0:1762166972.226941:0:8380:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa83:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166972.226946:0:8380:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa83:0x0] updating lvb mtime from disk: 1762166972 -> 1762166972 00002000:00010000:3.0:1762166972.226949:0:8380:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa83:0x0] updating lvb atime from disk: 1762166972 -> 1762166972 00002000:00010000:3.0:1762166972.226952:0:8380:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa83:0x0] updating lvb ctime from disk: 1762166972 -> 1762166972 00002000:00010000:3.0:1762166972.226954:0:8380:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa83:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166972.227057:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+14:3636:x1847765449603328:12345-0@lo:2:osp-syn-0-1.0 Request processed in 173us (341us total) trans 21474842954 rc 0/0 00000100:00100000:3.0:1762166972.227069:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18284 00000100:00100000:3.0:1762166972.228244:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4530380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765449603456:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166972.228277:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4b99800/0x2f180c4effba7d9d lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [45056->98303] (req 45056->98303) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8c27 expref: 24 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.228295:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4b99800, rc 0) 00000100:00100000:3.0:1762166972.228351:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+24:61766:x1847765450109184:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 1316us (1425us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166972.228360:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18285 00000100:00100000:3.0:1762166972.228681:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.230262:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.242862:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.247870:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450110464 00000100:00100000:3.0:1762166972.247878:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450110464 00000100:00100000:3.0:1762166972.247922:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11671 00000100:00100000:3.0:1762166972.247932:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+526:61766:x1847765450110464:12345-192.168.204.38@tcp:35:fsx.0 00000100:00100000:3.0:1762166972.248277:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+527:61766:x1847765450110464:12345-192.168.204.38@tcp:35:fsx.0 Request processed in 345us (469us total) trans 4294991396 rc 0/0 00000100:00100000:3.0:1762166972.248290:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11671 00000100:00100000:3.0:1762166972.256543:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.259266:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.264266:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450111744 00000100:00100000:3.0:1762166972.264272:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450111744 00000100:00100000:3.0:1762166972.264308:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11672 00000100:00100000:3.0:1762166972.264317:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff2fcc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+530:61805:x1847765450111744:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:3.0:1762166972.264497:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff2fcc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+531:61805:x1847765450111744:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 180us (277us total) trans 4294991400 rc 0/0 00000100:00100000:3.0:1762166972.264505:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11672 00000100:00100000:3.0:1762166972.265573:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.267024:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450112000 00000100:00100000:3.0:1762166972.267030:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450112000 00000100:00100000:3.0:1762166972.267070:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18286 00000100:00100000:3.0:1762166972.267078:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4532d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450112000:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166972.267089:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166972.267101:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc8472c00/0x2f180c4effba7e1b lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa84:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e8c58 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166972.267126:0:28434:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa84:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1762166972.267138:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166972.267140:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166972.267148:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8472c00/0x2f180c4effba7e1b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8c58 expref: 21 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166972.267162:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc8472c00/0x2f180c4effba7e1b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8c58 expref: 21 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166972.267172:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8472c00, rc 0) 00000100:00100000:3.0:1762166972.267209:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4532d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450112000:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 131us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166972.267220:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18286 00000100:00100000:3.0:1762166972.270391:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450112512 00000100:00100000:3.0:1762166972.270397:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450112512 00000100:00100000:3.0:1762166972.270443:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450112640 00000100:00100000:3.0:1762166972.270448:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450112640 00000100:00100000:3.0:1762166972.270506:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18290 00000100:00100000:3.0:1762166972.270521:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+29:2419:x1847765450112768:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:3.0:1762166972.270546:0:28434:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effba7e45 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.270570:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166972.270574:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166972.270583:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effba7e45 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.270635:0:28434:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effba7e45 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.270660:0:28434:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effba7e45 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.270682:0:28434:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effba7e45 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.270692:0:28434:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effba7e45 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.270710:0:28434:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8473600 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166972.270719:0:28434:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effba7e45 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.270743:0:28434:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effba7e45 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.270769:0:28434:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effba7e45 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.270788:0:28434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effba7e45 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166972.270855:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+29:2419:x1847765450112768:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 336us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166972.270871:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18290 00000100:00100000:3.0:1762166972.315860:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.323891:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.337174:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.337433:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.344634:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.360250:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.364746:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.379624:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.383679:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.392534:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.399520:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.401862:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.404066:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.406381:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.410546:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.412250:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.413740:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.416564:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.428047:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.429678:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.431027:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.431069:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.433426:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.436940:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.438925:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.442027:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000001:00080000:3.0:1762166972.443511:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294991405 is committed 00000020:00080000:3.0:1762166972.443541:0:7412:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0001: 30 batchid updated 00000100:00100000:3.0:1762166972.445213:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.445405:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.455182:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450119040 00000100:00100000:3.0:1762166972.455197:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450119040 00000100:00100000:3.0:1762166972.455252:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18311 00000100:00100000:3.0:1762166972.455261:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450119040:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:3.0:1762166972.455289:0:8383:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effba7ef4 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.455303:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166972.455307:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166972.455319:0:8383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effba7ef4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.455356:0:8383:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effba7ef4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.455396:0:8383:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effba7ef4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.455408:0:8383:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effba7ef4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.455435:0:8383:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effba7ef4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.455461:0:8383:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8473600 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166972.455469:0:8383:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effba7ef4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.455520:0:8383:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effba7ef4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.455534:0:8383:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effba7ef4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.455560:0:8383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effba7ef4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166972.455649:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450119040:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 389us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166972.455663:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18311 00000100:00100000:3.0:1762166972.457155:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.460594:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.460679:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.463932:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.465620:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.466864:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.468462:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.468580:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.468619:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.470320:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.472464:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.472604:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.475417:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000004:00080000:3.0:1762166972.476829:0:9994:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0001: 0 changes, 0 in progress, 0 in flight, 8 done 00000100:00100000:3.0:1762166972.477256:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4492a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449605504:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166972.477296:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7ce4a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449605632:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166972.477338:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166972.477360:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf3cf4780 going to sleep for 11 seconds 00000100:00100000:3.0:1762166972.477593:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7ce4a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449605632:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166972.477633:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7ce4a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449605760:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166972.477656:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166972.477681:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccac36b40 going to sleep for 11 seconds 00000100:00100000:3.0:1762166972.477877:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7ce4a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449605760:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166972.477904:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7ce4a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449605888:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166972.477933:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166972.477953:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf3cf4780 going to sleep for 11 seconds 00000100:00100000:3.0:1762166972.478126:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7ce4a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449605888:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166972.478161:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7ce4a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449606016:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166972.478186:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166972.478214:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc2c72900 going to sleep for 11 seconds 00000100:00100000:3.0:1762166972.478460:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7ce4a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449606016:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166972.478518:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7ce4a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449606144:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166972.478543:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166972.478563:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccac36b40 going to sleep for 11 seconds 00000100:00100000:3.0:1762166972.478701:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7ce4a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449606144:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166972.478740:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7ce4a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449606272:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166972.478763:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166972.478786:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf3cf4780 going to sleep for 11 seconds 00000100:00100000:3.0:1762166972.478945:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7ce4a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449606272:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166972.478990:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7ce4a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449606400:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166972.479013:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166972.479031:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc2c72900 going to sleep for 11 seconds 00000100:00100000:3.0:1762166972.479161:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7ce4a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449606400:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166972.479193:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7d20700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449606528:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166972.479215:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166972.479233:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccac36b40 going to sleep for 11 seconds 00000100:00100000:3.0:1762166972.479349:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7d20700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449606528:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166972.479378:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7d20700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449606656:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166972.479397:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166972.479415:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf3cf4780 going to sleep for 11 seconds 00000100:00100000:3.0:1762166972.479565:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7d20700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449606656:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166972.479597:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7d20700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449606784:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166972.479617:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166972.479641:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc2c72900 going to sleep for 11 seconds 00000100:00100000:3.0:1762166972.479948:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7d20700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449606784:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166972.479989:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7d20700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449606912:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166972.480012:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166972.480031:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccac36b40 going to sleep for 11 seconds 00000100:00100000:3.0:1762166972.480263:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7d20700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449606912:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166972.480299:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7d20700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449607040:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166972.480319:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166972.480341:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf3cf4780 going to sleep for 11 seconds 00000100:00100000:3.0:1762166972.480530:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7d20700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449607040:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166972.480566:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7d20700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449607168:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166972.480604:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166972.480628:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc2c72900 going to sleep for 11 seconds 00000100:00100000:3.0:1762166972.480872:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7d20700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449607168:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166972.480903:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7d20700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449607296:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166972.480926:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166972.480944:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccac36b40 going to sleep for 11 seconds 00000100:00100000:3.0:1762166972.481103:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7d20700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449607296:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166972.481138:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5804a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449607424:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166972.481162:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166972.481182:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf3cf4780 going to sleep for 11 seconds 00000100:00100000:3.0:1762166972.481322:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5804a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449607424:0@lo:1000:mdt_rdpg00_003.0 00000040:00080000:3.0:1762166972.481555:0:19593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x2:0x0].29, 1000 off55264 00000001:00080000:3.0:1762166972.481565:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294991408 00000100:00100000:3.0:1762166972.481638:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5804a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449607552:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166972.481664:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166972.481682:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc2c72900 going to sleep for 11 seconds 00000100:00100000:3.0:1762166972.482115:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5804a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449607552:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166972.482139:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5806a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449607680:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166972.482163:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166972.482182:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf3cf4000 going to sleep for 11 seconds 00000100:00100000:3.0:1762166972.482914:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5806a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449607680:0@lo:1000:mdt_rdpg00_003.0 00000001:00080000:3.0:1762166972.482982:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294991409 00010000:00010000:3.0:1762166972.483013:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc936a800/0x2f180c4effba7f1e lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5fb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166972.483021:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc936a800/0x2f180c4effba7f1e lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x5fb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166972.483026:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc936a800/0x2f180c4effba7f1e lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5fb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166972.483030:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc936a800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166972.483036:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc936a800/0x2f180c4effba7f1e lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5fb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166972.483041:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc936a800/0x2f180c4effba7f1e lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x5fb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166972.483053:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5fb:0x0].0x0 (ffff945cd1d8c700) 00010000:00010000:3.0:1762166972.483055:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166972.483058:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc936a800/0x2f180c4effba7f1e lrc: 2/0,0 mode: --/EX res: [0x240000404:0x5fb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166972.483061:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc936a800/0x2f180c4effba7f1e lrc: 0/0,0 mode: --/EX res: [0x240000404:0x5fb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166972.483071:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc936ac00/0x2f180c4effba7f17 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166972.483074:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc936ac00/0x2f180c4effba7f17 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166972.483081:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc936ac00/0x2f180c4effba7f17 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166972.483084:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc936ac00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166972.483086:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc936ac00/0x2f180c4effba7f17 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166972.483088:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc936ac00/0x2f180c4effba7f17 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166972.483092:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc718dd00) 00010000:00010000:3.0:1762166972.483093:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166972.483095:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc936ac00/0x2f180c4effba7f17 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166972.483098:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc936ac00/0x2f180c4effba7f17 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166972.483104:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc718dd00) 00010000:00010000:3.0:1762166972.483105:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166972.483110:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effba7e30 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8c66 expref: 531 pid: 6495 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166972.483192:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7ce4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+530:61805:x1847765450121088:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 12721us (12876us total) trans 4294991410 rc 0/0 00000100:00100000:3.0:1762166972.483198:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11673 00000020:00080000:3.0:1762166972.483200:0:19593:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1762166972.484851:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.487074:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450121856 00000100:00100000:3.0:1762166972.487084:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450121856 00000100:00100000:3.0:1762166972.487193:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11674 00000100:00100000:3.0:1762166972.487205:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+531:61805:x1847765450121856:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:3.0:1762166972.487474:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+532:61805:x1847765450121856:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 271us (471us total) trans 4294991411 rc 0/0 00000100:00100000:3.0:1762166972.487526:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11674 00000100:00100000:3.0:1762166972.488362:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.502423:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.527133:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450122880 00000100:00100000:3.0:1762166972.527157:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450122880 00000100:00100000:3.0:1762166972.527258:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1581 00000100:00100000:3.0:1762166972.527270:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+24:2418:x1847765450122880:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:3.0:1762166972.527315:0:8388:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8472400/0x2f180c4effba7f79 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.527334:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166972.527336:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166972.527343:0:8388:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472400/0x2f180c4effba7f79 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.527359:0:8388:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8472400/0x2f180c4effba7f79 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.529505:0:8388:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8472400/0x2f180c4effba7f79 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.529522:0:8388:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472400/0x2f180c4effba7f79 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.529532:0:8388:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc8472400/0x2f180c4effba7f79 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.529537:0:8388:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8472400 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166972.529540:0:8388:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8472400/0x2f180c4effba7f79 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.529545:0:8388:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8472400/0x2f180c4effba7f79 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.529560:0:8388:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc8472400/0x2f180c4effba7f79 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.529564:0:8388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8472400/0x2f180c4effba7f79 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166972.529652:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+24:2418:x1847765450122880:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 2380us (2692us total) trans 0 rc 252494/252494 00000100:00100000:3.0:1762166972.529664:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1581 00000100:00100000:3.0:1762166972.532159:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450123008 00000100:00100000:3.0:1762166972.532174:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450123008 00000100:00100000:3.0:1762166972.532249:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1582 00000100:00100000:3.0:1762166972.532257:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450123008:12345-192.168.204.38@tcp:3:lfs.0 00002000:00010000:3.0:1762166972.532310:0:8388:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa84:0x0] initial LVB size: 252494, mtime: 0x690888bc, atime: 0x690888bc, ctime: 0x690888bc, blocks: 0xd8 00010000:00010000:3.0:1762166972.532319:0:8388:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc8472a00/0x2f180c4effba7f80 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa84:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.532334:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166972.532335:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166972.532340:0:8388:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8472a00/0x2f180c4effba7f80 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa84:0x0].0x0 rrc: 2 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.532350:0:8388:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc8472a00/0x2f180c4effba7f80 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa84:0x0].0x0 rrc: 2 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.534655:0:8388:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc8472a00/0x2f180c4effba7f80 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa84:0x0].0x0 rrc: 2 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.534670:0:8388:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8472a00/0x2f180c4effba7f80 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa84:0x0].0x0 rrc: 2 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.534677:0:8388:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc8472a00/0x2f180c4effba7f80 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa84:0x0].0x0 rrc: 2 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.534683:0:8388:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8472a00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166972.534687:0:8388:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc8472a00/0x2f180c4effba7f80 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa84:0x0].0x0 rrc: 2 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.534694:0:8388:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc8472a00/0x2f180c4effba7f80 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa84:0x0].0x0 rrc: 2 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.534715:0:8388:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc8472a00/0x2f180c4effba7f80 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa84:0x0].0x0 rrc: 2 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.534722:0:8388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc8472a00/0x2f180c4effba7f80 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa84:0x0].0x0 rrc: 2 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166972.534817:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450123008:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 2556us (2726us total) trans 0 rc 252494/252494 00000100:00100000:3.0:1762166972.534827:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1582 00000100:00100000:3.0:1762166972.554297:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450124288 00000100:00100000:3.0:1762166972.554303:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450124288 00000100:00100000:3.0:1762166972.554398:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18318 00000100:00100000:3.0:1762166972.554409:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765450124288:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:3.0:1762166972.554425:0:8380:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166972.554440:0:8380:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8472a00/0x2f180c4effba7fb1 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa83:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e8ccf expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166972.554543:0:8380:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5807100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8380:1847765449608064:192.168.204.38@tcp:106: 00000100:00100000:3.0:1762166972.554630:0:8380:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf3cf4780 going to sleep for 11 seconds 00000100:00100000:3.0:1762166972.559736:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.561528:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000001:00080000:3.0:1762166972.568372:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294991420 is committed 00000004:00080000:3.0:1762166972.568386:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3144 committed 00000004:00080000:3.0:1762166972.568411:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3147 committed 00000004:00080000:3.0:1762166972.568431:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3146 committed 00000004:00080000:3.0:1762166972.568437:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3143 committed 00000004:00080000:3.0:1762166972.568441:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3142 committed 00000004:00080000:3.0:1762166972.568445:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3145 committed 00000004:00080000:3.0:1762166972.568450:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3144 committed 00000004:00080000:3.0:1762166972.568454:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3141 committed 00000004:00080000:3.0:1762166972.568458:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3140 committed 00000004:00080000:3.0:1762166972.568463:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3143 committed 00000004:00080000:3.0:1762166972.568469:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3142 committed 00000004:00080000:3.0:1762166972.568474:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3139 committed 00000004:00080000:3.0:1762166972.568501:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3138 committed 00000004:00080000:3.0:1762166972.568503:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3141 committed 00000004:00080000:3.0:1762166972.568506:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3137 committed 00000004:00080000:3.0:1762166972.568508:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3140 committed 00000004:00080000:3.0:1762166972.568511:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3139 committed 00000004:00080000:3.0:1762166972.568515:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3136 committed 00000020:00080000:3.0:1762166972.568543:0:7412:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff945cf3cf4240 refcount 2 committed 0 result 0 batchid 31 00000020:00080000:3.0:1762166972.568549:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cf3bd1600 obd lustre-OST0001-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff945ccafbdd80 00000020:00080000:3.0:1762166972.568553:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cf1d0ef00 obd lustre-OST0000-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff945cf3cf4840 00000020:00080000:3.0:1762166972.568556:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cf1d0ec00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff945bc7cea000 00000020:00080000:3.0:1762166972.568559:0:7412:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000400:0x2:0x0].29 00000100:00100000:3.0:1762166972.568626:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1762166972.568651:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1ddc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449608320:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166972.568732:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166972.569205:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1ddfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449608192:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166972.570784:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1762166972.572088:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf1ddc700/2, rc 0, transno 17179875852 00000100:00100000:3.0:1762166972.572125:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1ddc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449608320:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1762166972.572157:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf1ddfb80/2, rc 0, transno 17179875858 00000100:00100000:3.0:1762166972.572274:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1ddfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449608192:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166972.572411:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1762166972.572430:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5805880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449609216:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166972.572523:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166972.572807:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1e6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449609344:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166972.572853:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166972.572897:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1e6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449609856:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166972.572946:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1762166972.573011:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc5805880/2, rc 0, transno 17179875860 00000100:00100000:3.0:1762166972.573030:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5805880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449609216:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166972.573048:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1762166972.573064:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1e6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449609728:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166972.573099:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166972.573134:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1e6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449610240:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166972.573194:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1762166972.573261:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf1e6ce00/2, rc 0, transno 21474842966 00000100:00100000:3.0:1762166972.573289:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1e6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449609344:0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1762166972.573327:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf1e6c700/2, rc 0, transno 21474842967 00000100:00100000:3.0:1762166972.573340:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1e6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449609856:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166972.573475:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18331 00000100:00100000:3.0:1762166972.573514:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+10:3634:x1847765449610240:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:3.0:1762166972.573610:0:28874:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa83:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166972.573615:0:28874:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa83:0x0] updating lvb mtime from disk: 1762166972 -> 1762166972 00002000:00010000:3.0:1762166972.573618:0:28874:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa83:0x0] updating lvb atime from disk: 1762166972 -> 1762166972 00002000:00010000:3.0:1762166972.573621:0:28874:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa83:0x0] updating lvb ctime from disk: 1762166972 -> 1762166972 00002000:00010000:3.0:1762166972.573624:0:28874:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa83:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166972.573667:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+10:3634:x1847765449610240:12345-0@lo:2:osp-syn-0-1.0 Request processed in 157us (483us total) trans 21474842969 rc 0/0 00000100:00100000:3.0:1762166972.573682:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18331 00000004:00080000:3.0:1762166972.573728:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf1e6c000/2, rc 0, transno 21474842968 00000100:00100000:3.0:1762166972.573738:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1e6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449609728:0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1762166972.573765:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf1e6d880/2, rc 0, transno 21474842969 00000100:00100000:3.0:1762166972.573771:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1e6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449610240:0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1762166972.574105:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf1e6d500/2, rc 0, transno 21474842970 00000100:00100000:3.0:1762166972.574117:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1e6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449610368:0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1762166972.574943:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf1e6f480/2, rc 0, transno 21474842973 00000100:00100000:3.0:1762166972.574953:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1e6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449609600:0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1762166972.574967:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf1e6fb80/2, rc 0, transno 21474842974 00000100:00100000:3.0:1762166972.574980:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1e6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449610112:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166972.575837:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.577431:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.578822:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.580340:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.581956:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.583596:0:8383:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5ef6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8383:1847765449611008:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166972.583623:0:8383:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4b98a00/0x2f180c4effba7fe9 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8cf2 expref: 25 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.583641:0:8383:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4b98a00, rc 0) 00000100:00100000:3.0:1762166972.583714:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+26:61766:x1847765450125824:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 1618us (1759us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166972.583724:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18339 00000100:00100000:3.0:1762166972.585282:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450126080 00000100:00100000:3.0:1762166972.585289:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450126080 00002000:00010000:3.0:1762166972.585372:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (129015->18446744073709551615) 00002000:00100000:3.0:1762166972.585378:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf783e680 with x1847765450126080 ext(129015->18446744073709551615) 00002000:00010000:3.0:1762166972.585389:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf783e680. 00000100:00100000:3.0:1762166972.585412:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450126208 00000100:00100000:3.0:1762166972.585416:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450126208 00002000:00010000:3.0:1762166972.585432:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:3.0:1762166972.585437:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc48a8a80 with x1847765450126208 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166972.585444:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc48a8a80. 00000100:00100000:3.0:1762166972.585458:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450126336 00000100:00100000:3.0:1762166972.585460:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450126336 00002000:00010000:3.0:1762166972.585531:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:3.0:1762166972.585537:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc48a8000 with x1847765450126336 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166972.585543:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc48a8000. 00000100:00100000:3.0:1762166972.585712:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1585 00000100:00100000:3.0:1762166972.585740:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+25:2419:x1847765450126336:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:3.0:1762166972.586011:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166972.586017:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166972 -> 1762166972 00002000:00010000:3.0:1762166972.586020:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166972 -> 1762166972 00002000:00010000:3.0:1762166972.586023:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166972 -> 1762166972 00002000:00010000:3.0:1762166972.586025:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166972.586132:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765450126336:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 406us (702us total) trans 17179875862 rc 0/0 00000100:00100000:3.0:1762166972.586141:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1585 00002000:00010000:3.0:1762166972.586146:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:3.0:1762166972.586150:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc48a8000 with x1847765450126336 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166972.586157:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc48a8000. 00000100:00100000:3.0:1762166972.589891:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450126592 00000100:00100000:3.0:1762166972.589901:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450126592 00000100:00100000:3.0:1762166972.589944:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1586 00000100:00100000:3.0:1762166972.589954:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+26:2418:x1847765450126592:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:3.0:1762166972.590149:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 129015 -> 129015 00002000:00010000:3.0:1762166972.590153:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166972 -> 1762166972 00002000:00010000:3.0:1762166972.590155:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166972 -> 1762166972 00002000:00010000:3.0:1762166972.590158:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166972 -> 1762166972 00002000:00010000:3.0:1762166972.590159:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 152 -> 168 00000100:00100000:3.0:1762166972.590224:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+27:2418:x1847765450126592:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 272us (460us total) trans 17179875863 rc 0/0 00000100:00100000:3.0:1762166972.590232:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1586 00000100:00100000:3.0:1762166972.591955:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450126720 00000100:00100000:3.0:1762166972.591966:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450126720 00000100:00100000:3.0:1762166972.592031:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1587 00000100:00100000:3.0:1762166972.592040:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+27:2417:x1847765450126720:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:3.0:1762166972.592293:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 129015 -> 129015 00002000:00010000:3.0:1762166972.592297:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166972 -> 1762166972 00002000:00010000:3.0:1762166972.592299:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166972 -> 1762166972 00002000:00010000:3.0:1762166972.592301:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166972 -> 1762166972 00002000:00010000:3.0:1762166972.592303:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 168 -> 216 00000100:00100000:3.0:1762166972.592365:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+28:2417:x1847765450126720:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 326us (502us total) trans 17179875864 rc 0/0 00000100:00100000:3.0:1762166972.592374:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1587 00000100:00100000:3.0:1762166972.594444:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450126848 00000100:00100000:3.0:1762166972.594463:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450126848 00000100:00100000:3.0:1762166972.594547:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1588 00000100:00100000:3.0:1762166972.594558:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+28:2419:x1847765450126848:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:3.0:1762166972.594715:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 129015 -> 194050 00002000:00010000:3.0:1762166972.594720:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166972 -> 1762166972 00002000:00010000:3.0:1762166972.594722:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166972 -> 1762166972 00002000:00010000:3.0:1762166972.594724:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166972 -> 1762166972 00002000:00010000:3.0:1762166972.594726:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 216 -> 320 00000100:00100000:3.0:1762166972.594778:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+29:2419:x1847765450126848:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 222us (383us total) trans 17179875865 rc 0/0 00000100:00100000:3.0:1762166972.594785:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1588 00000100:00100000:3.0:1762166972.598064:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450126976 00000100:00100000:3.0:1762166972.598074:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450126976 00002000:00100000:3.0:1762166972.598121:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (61440->65535) req@ffff945cf783f800 x1847765450126976/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:3/0 lens 488/0 e 0 to 0 dl 1762166983 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166972.598133:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf783f800 with x1847765450126976 ext(61440->65535) 00002000:00010000:3.0:1762166972.598141:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf783f800 00000100:00100000:3.0:1762166972.598170:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1589 00000100:00100000:3.0:1762166972.598180:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+29:2418:x1847765450126976:12345-192.168.204.38@tcp:3:lfs.0 00000100:00100000:3.0:1762166972.598369:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+29:2418:x1847765450126976:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 190us (375us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1762166972.598377:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1589 00002000:00100000:3.0:1762166972.598384:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (61440->65535) req@ffff945cf783f800 x1847765450126976/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:3/0 lens 488/4536 e 0 to 0 dl 1762166983 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166972.598391:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf783f800 with x1847765450126976 ext(61440->65535) 00002000:00010000:3.0:1762166972.598395:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf783f800 00000100:00100000:3.0:1762166972.599906:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450127104 00000100:00100000:3.0:1762166972.599914:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450127104 00002000:00100000:3.0:1762166972.599941:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (65536->69631) req@ffff945cf783dc00 x1847765450127104/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:3/0 lens 488/0 e 0 to 0 dl 1762166983 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166972.599951:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf783dc00 with x1847765450127104 ext(65536->69631) 00002000:00010000:3.0:1762166972.599955:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf783dc00 00000100:00100000:3.0:1762166972.599986:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1590 00000100:00100000:3.0:1762166972.599996:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+29:2417:x1847765450127104:12345-192.168.204.38@tcp:3:lfs.0 00000100:00100000:3.0:1762166972.600102:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+29:2417:x1847765450127104:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 108us (277us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1762166972.600109:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1590 00002000:00100000:3.0:1762166972.600116:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (65536->69631) req@ffff945cf783dc00 x1847765450127104/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:3/0 lens 488/4536 e 0 to 0 dl 1762166983 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166972.600124:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf783dc00 with x1847765450127104 ext(65536->69631) 00002000:00010000:3.0:1762166972.600128:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf783dc00 00000100:00100000:3.0:1762166972.601709:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450127232 00000100:00100000:3.0:1762166972.601719:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450127232 00002000:00100000:3.0:1762166972.601756:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (40960->106495) req@ffff945bc5ef6680 x1847765450127232/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:3/0 lens 504/0 e 0 to 0 dl 1762166983 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166972.601766:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5ef6680 with x1847765450127232 ext(40960->106495) 00002000:00010000:3.0:1762166972.601770:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5ef6680 00000100:00100000:3.0:1762166972.601802:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1591 00000100:00100000:3.0:1762166972.601811:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+29:2416:x1847765450127232:12345-192.168.204.38@tcp:3:lfs.0 00000100:00100000:3.0:1762166972.603449:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+29:2416:x1847765450127232:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 1635us (1835us total) trans 0 rc 57344/57344 00000100:00100000:3.0:1762166972.603459:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1591 00002000:00100000:3.0:1762166972.603467:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (40960->106495) req@ffff945bc5ef6680 x1847765450127232/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:3/0 lens 504/440 e 0 to 0 dl 1762166983 ref 1 fl Complete:/600/0 rc 57344/57344 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166972.603517:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5ef6680 with x1847765450127232 ext(40960->106495) 00002000:00010000:3.0:1762166972.603522:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5ef6680 00000100:00100000:3.0:1762166972.605706:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450127360 00000100:00100000:3.0:1762166972.605717:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450127360 00000100:00100000:3.0:1762166972.605793:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1592 00000100:00100000:3.0:1762166972.605803:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+29:2419:x1847765450127360:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:3.0:1762166972.606307:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 194050 -> 194050 00002000:00010000:3.0:1762166972.606312:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166972 -> 1762166972 00002000:00010000:3.0:1762166972.606315:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166972 -> 1762166972 00002000:00010000:3.0:1762166972.606317:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166972 -> 1762166972 00002000:00010000:3.0:1762166972.606320:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 320 -> 304 00000100:00100000:3.0:1762166972.606389:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+30:2419:x1847765450127360:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 587us (760us total) trans 17179875866 rc 0/0 00000100:00100000:3.0:1762166972.606397:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1592 00000100:00100000:3.0:1762166972.612613:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450127872 00000100:00100000:3.0:1762166972.612623:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450127872 00002000:00010000:3.0:1762166972.612664:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (234868->18446744073709551615) 00002000:00100000:3.0:1762166972.612671:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf783c380 with x1847765450127872 ext(234868->18446744073709551615) 00002000:00010000:3.0:1762166972.612685:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf783c380. 00000100:00100000:3.0:1762166972.612737:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1593 00000100:00100000:3.0:1762166972.612756:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+31:2419:x1847765450127872:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:3.0:1762166972.613032:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 194050 -> 234868 00002000:00010000:3.0:1762166972.613039:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166972 -> 1762166972 00002000:00010000:3.0:1762166972.613042:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166972 -> 1762166972 00002000:00010000:3.0:1762166972.613045:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166972 -> 1762166972 00002000:00010000:3.0:1762166972.613047:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 304 -> 304 00000100:00100000:3.0:1762166972.613163:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+33:2419:x1847765450127872:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 413us (691us total) trans 17179875868 rc 0/0 00000100:00100000:3.0:1762166972.613185:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1593 00002000:00010000:3.0:1762166972.613196:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (234868->18446744073709551615) 00002000:00100000:3.0:1762166972.613202:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf783c380 with x1847765450127872 ext(234868->18446744073709551615) 00002000:00010000:3.0:1762166972.613214:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf783c380. 00000100:00100000:3.0:1762166972.617365:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450128384 00000100:00100000:3.0:1762166972.617414:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450128384 00002000:00100000:3.0:1762166972.617451:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (163840->229375) req@ffff945cf783e300 x1847765450128384/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:3/0 lens 488/0 e 0 to 0 dl 1762166983 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166972.617462:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf783e300 with x1847765450128384 ext(163840->229375) 00002000:00010000:3.0:1762166972.617466:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf783e300 00000100:00100000:3.0:1762166972.617528:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1596 00000100:00100000:3.0:1762166972.617539:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+32:2419:x1847765450128384:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:3.0:1762166972.618771:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+32:2419:x1847765450128384:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 1232us (1448us total) trans 0 rc 65536/65536 00000100:00100000:3.0:1762166972.618782:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1596 00002000:00100000:3.0:1762166972.618791:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (163840->229375) req@ffff945cf783e300 x1847765450128384/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:3/0 lens 488/440 e 0 to 0 dl 1762166983 ref 1 fl Complete:/600/0 rc 65536/65536 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166972.618800:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf783e300 with x1847765450128384 ext(163840->229375) 00002000:00010000:3.0:1762166972.618803:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf783e300 00000100:00100000:3.0:1762166972.622633:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450128512 00000100:00100000:3.0:1762166972.622642:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450128512 00002000:00100000:3.0:1762166972.622681:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (106496->143359) req@ffff945bc5bc0000 x1847765450128512/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:3/0 lens 488/0 e 0 to 0 dl 1762166983 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166972.622692:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5bc0000 with x1847765450128512 ext(106496->143359) 00002000:00010000:3.0:1762166972.622696:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5bc0000 00000100:00100000:3.0:1762166972.622730:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1597 00000100:00100000:3.0:1762166972.622739:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+32:2419:x1847765450128512:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:3.0:1762166972.623996:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+32:2419:x1847765450128512:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 1256us (1422us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1762166972.624005:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1597 00002000:00100000:3.0:1762166972.624013:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (106496->143359) req@ffff945bc5bc0000 x1847765450128512/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:3/0 lens 488/440 e 0 to 0 dl 1762166983 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166972.624023:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5bc0000 with x1847765450128512 ext(106496->143359) 00002000:00010000:3.0:1762166972.624027:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5bc0000 00000100:00100000:3.0:1762166972.628819:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450129024 00000100:00100000:3.0:1762166972.628826:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450129024 00002000:00010000:3.0:1762166972.628850:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:3.0:1762166972.628857:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4a2b100 with x1847765450129024 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166972.628866:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc4a2b100. 00000100:00100000:3.0:1762166972.628957:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450129152 00000100:00100000:3.0:1762166972.629021:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450129152 00002000:00010000:3.0:1762166972.629038:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:3.0:1762166972.629042:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1cd1f80 with x1847765450129152 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166972.629049:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1cd1f80. 00000100:00100000:3.0:1762166972.629083:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1600 00000100:00100000:3.0:1762166972.629099:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+34:2418:x1847765450129152:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:3.0:1762166972.629188:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166972.629195:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166972 -> 1762166972 00002000:00010000:3.0:1762166972.629199:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166972 -> 1762166972 00002000:00010000:3.0:1762166972.629207:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166972 -> 1762166972 00002000:00010000:3.0:1762166972.629210:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166972.629243:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+34:2418:x1847765450129152:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 145us (325us total) trans 17179875870 rc 0/0 00000100:00100000:3.0:1762166972.629252:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1600 00002000:00010000:3.0:1762166972.629256:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:3.0:1762166972.629260:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1cd1f80 with x1847765450129152 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166972.629265:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1cd1f80. 00000100:00100000:3.0:1762166972.630909:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450129280 00000100:00100000:3.0:1762166972.630921:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450129280 00002000:00100000:3.0:1762166972.630980:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (229376->262143) req@ffff945bc4a29880 x1847765450129280/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:3/0 lens 488/0 e 0 to 0 dl 1762166983 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166972.630989:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4a29880 with x1847765450129280 ext(229376->262143) 00002000:00010000:3.0:1762166972.630995:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4a29880 00000100:00100000:3.0:1762166972.631020:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1601 00000100:00100000:3.0:1762166972.631030:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+34:2419:x1847765450129280:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:3.0:1762166972.632927:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+34:2419:x1847765450129280:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 1893us (2084us total) trans 0 rc 32768/32768 00000100:00100000:3.0:1762166972.632939:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1601 00002000:00100000:3.0:1762166972.632956:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (229376->262143) req@ffff945bc4a29880 x1847765450129280/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:3/0 lens 488/440 e 0 to 0 dl 1762166983 ref 1 fl Complete:/600/0 rc 32768/32768 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166972.632975:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4a29880 with x1847765450129280 ext(229376->262143) 00002000:00010000:3.0:1762166972.632982:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4a29880 00000100:00100000:3.0:1762166972.635070:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450129408 00000100:00100000:3.0:1762166972.635079:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450129408 00002000:00100000:3.0:1762166972.635110:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (172032->262143) req@ffff945cf1cd0700 x1847765450129408/t0(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:3/0 lens 504/0 e 0 to 0 dl 1762166983 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166972.635117:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1cd0700 with x1847765450129408 ext(172032->262143) 00002000:00010000:3.0:1762166972.635119:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1cd0700 00000100:00100000:3.0:1762166972.635141:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1602 00000100:00100000:3.0:1762166972.635149:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+34:2417:x1847765450129408:12345-192.168.204.38@tcp:4:fsx.0 00000100:00100000:3.0:1762166972.637607:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+36:2417:x1847765450129408:12345-192.168.204.38@tcp:4:fsx.0 Request processed in 2446us (2592us total) trans 17179875871 rc 0/0 00000100:00100000:3.0:1762166972.637624:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1602 00002000:00100000:3.0:1762166972.637638:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (172032->262143) req@ffff945cf1cd0700 x1847765450129408/t17179875871(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:3/0 lens 504/448 e 0 to 0 dl 1762166983 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166972.637648:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1cd0700 with x1847765450129408 ext(172032->262143) 00002000:00010000:3.0:1762166972.637655:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1cd0700 00000100:00100000:3.0:1762166972.638716:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450129536 00000100:00100000:3.0:1762166972.638724:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450129536 00000100:00100000:3.0:1762166972.638774:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18340 00000100:00100000:3.0:1762166972.638784:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+36:2416:x1847765450129536:12345-192.168.204.38@tcp:16:fsx.0 00000100:00100000:3.0:1762166972.640076:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:2416:x1847765450129536:12345-192.168.204.38@tcp:16:fsx.0 Request processed in 1291us (1414us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166972.640085:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18340 00000100:00100000:3.0:1762166972.645735:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450129792 00000100:00100000:3.0:1762166972.645796:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450129792 00002000:00100000:3.0:1762166972.645851:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (45056->114687) req@ffff945bc4a2ad80 x1847765450129792/t0(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:3/0 lens 488/0 e 0 to 0 dl 1762166983 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166972.645864:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4a2ad80 with x1847765450129792 ext(45056->114687) 00002000:00010000:3.0:1762166972.645870:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4a2ad80 00000100:00100000:3.0:1762166972.645897:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1603 00000100:00100000:3.0:1762166972.645905:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450129792:12345-192.168.204.38@tcp:4:fsx.0 00000100:00100000:3.0:1762166972.648160:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765450129792:12345-192.168.204.38@tcp:4:fsx.0 Request processed in 2246us (2506us total) trans 17179875872 rc 0/0 00000100:00100000:3.0:1762166972.648175:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1603 00002000:00100000:3.0:1762166972.648190:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (45056->114687) req@ffff945bc4a2ad80 x1847765450129792/t17179875872(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:3/0 lens 488/448 e 0 to 0 dl 1762166983 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166972.648202:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4a2ad80 with x1847765450129792 ext(45056->114687) 00002000:00010000:3.0:1762166972.648208:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4a2ad80 00000100:00100000:3.0:1762166972.649210:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450129920 00000100:00100000:3.0:1762166972.649219:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450129920 00000100:00100000:3.0:1762166972.649277:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1604 00000100:00100000:3.0:1762166972.649286:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765450129920:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:3.0:1762166972.649620:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:3.0:1762166972.649625:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166972 -> 1762166972 00002000:00010000:3.0:1762166972.649628:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166972 -> 1762166972 00002000:00010000:3.0:1762166972.649630:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166972 -> 1762166972 00002000:00010000:3.0:1762166972.649632:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 304 -> 360 00000100:00100000:3.0:1762166972.649672:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765450129920:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 387us (512us total) trans 17179875873 rc 0/0 00000100:00100000:3.0:1762166972.649678:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1604 00000100:00100000:3.0:1762166972.653300:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450130048 00000100:00100000:3.0:1762166972.653312:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450130048 00000100:00100000:3.0:1762166972.653403:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1605 00000100:00100000:3.0:1762166972.653415:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765450130048:12345-192.168.204.38@tcp:22:fsx.0 00000100:00100000:3.0:1762166972.677218:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450130816 00000100:00100000:3.0:1762166972.677235:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450130816 00000100:00100000:3.0:1762166972.677305:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18341 00000100:00100000:3.0:1762166972.677316:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+30:2416:x1847765450130816:12345-192.168.204.38@tcp:16:fsx.0 00000100:00100000:3.0:1762166972.678897:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:2416:x1847765450130816:12345-192.168.204.38@tcp:16:fsx.0 Request processed in 1579us (1808us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166972.678908:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18341 00000100:00100000:3.0:1762166972.705774:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.705861:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.712291:0:8383:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a28380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8383:1847765449611648:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166972.712309:0:8383:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc4b98400/0x2f180c4effba80bb lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166972.712739:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450133888 00000100:00100000:3.0:1762166972.712745:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450133888 00010000:00010000:3.0:1762166972.712777:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4b99a00/0x2f180c4effba7fdb lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8ce4 expref: 25 pid: 8383 timeout: 691 lvb_type: 0 00000100:00100000:3.0:1762166972.712819:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9274 00000100:00100000:3.0:1762166972.712837:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765450133888:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166972.712848:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166972.712862:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc4b99a00/0x2f180c4effba7fdb lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8ce4 expref: 24 pid: 8383 timeout: 691 lvb_type: 0 00010000:00010000:3.0:1762166972.712934:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc4b99a00/0x2f180c4effba7fdb lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8ce4 expref: 24 pid: 8383 timeout: 691 lvb_type: 0 00010000:00010000:3.0:1762166972.712985:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4b99a00/0x2f180c4effba7fdb lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8ce4 expref: 24 pid: 8383 timeout: 691 lvb_type: 0 00010000:00010000:3.0:1762166972.713012:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166972.713017:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166972.713022:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc936ac00/0x2f180c4effba80ad lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.713041:0:6479:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc936ac00/0x2f180c4effba80ad lrc: 4/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.713073:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166972.713105:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765450133888:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 274us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166972.713114:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9274 00000100:00100000:3.0:1762166972.714666:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18347 00000100:00100000:3.0:1762166972.714679:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+22:2416:x1847765450134016:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166972.714694:0:28874:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166972.714711:0:28874:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8472400/0x2f180c4effba80c2 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e8d46 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166972.714739:0:28874:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa77:0x0] initial LVB size: 262144, mtime: 0x690888bc, atime: 0x690888bc, ctime: 0x690888bc, blocks: 0x128 00010000:00010000:3.0:1762166972.714754:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166972.714758:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166972.714767:0:28874:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472400/0x2f180c4effba80c2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8d46 expref: 23 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166972.714788:0:28874:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc8472400/0x2f180c4effba80c2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8d46 expref: 23 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166972.714805:0:28874:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8472400, rc 0) 00000100:00100000:3.0:1762166972.714861:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+24:2416:x1847765450134016:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 183us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166972.714877:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18347 00000100:00100000:3.0:1762166972.738628:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450134400 00000100:00100000:3.0:1762166972.738642:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450134400 00000100:00100000:3.0:1762166972.738712:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18350 00000100:00100000:3.0:1762166972.738725:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+23:2417:x1847765450134400:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:3.0:1762166972.738878:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+23:2417:x1847765450134400:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 156us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166972.738887:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18350 00000100:00100000:3.0:1762166972.744385:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450135040 00000100:00100000:3.0:1762166972.744390:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450135040 00000100:00100000:3.0:1762166972.744428:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18351 00000100:00100000:3.0:1762166972.744438:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+23:61807:x1847765450135040:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166972.744450:0:8383:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166972.744463:0:8383:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effba80f3 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa84:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e8d69 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.744523:0:8383:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4b98600/0x2f180c4effba808a lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa84:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8d31 expref: 24 pid: 8383 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166972.744532:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166972.744535:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166972.744540:0:8383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effba80f3 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xa84:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8d69 expref: 24 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.744571:0:8383:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4b98600/0x2f180c4effba808a lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa84:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8d31 expref: 24 pid: 8383 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166972.744585:0:8383:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc4b98600/0x2f180c4effba808a lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa84:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8d31 expref: 24 pid: 8383 timeout: 691 lvb_type: 1 00000100:00100000:3.0:1762166972.744601:0:8383:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf8bf0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8383:1847765449611776:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166972.744688:0:8383:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf3cf4780 going to sleep for 11 seconds 00000100:00100000:3.0:1762166972.745643:0:8383:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf8bf0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8383:1847765449611776:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166972.745664:0:8383:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effba80f3 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xa84:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8d69 expref: 24 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.745675:0:8383:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8473600, rc 0) 00000100:00100000:3.0:1762166972.745709:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+24:61807:x1847765450135040:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1272us (1397us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166972.745717:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18351 00000100:00100000:3.0:1762166972.747146:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450135296 00000100:00100000:3.0:1762166972.747150:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450135296 00000100:00100000:3.0:1762166972.747181:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18352 00000100:00100000:3.0:1762166972.747188:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+25:61807:x1847765450135296:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166972.747200:0:8383:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166972.747213:0:8383:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc8472800/0x2f180c4effba80fa lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa85:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e8d70 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.747232:0:8383:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc936a800/0x2f180c4effba8091 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa85:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8d38 expref: 26 pid: 35248 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166972.747240:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166972.747242:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166972.747245:0:8383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8472800/0x2f180c4effba80fa lrc: 4/0,0 mode: --/PW res: [0x280000400:0xa85:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8d70 expref: 26 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.747264:0:8383:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc936a800/0x2f180c4effba8091 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa85:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8d38 expref: 26 pid: 35248 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166972.747276:0:8383:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc936a800/0x2f180c4effba8091 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa85:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8d38 expref: 26 pid: 35248 timeout: 691 lvb_type: 1 00000100:00100000:3.0:1762166972.747286:0:8383:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf8bf0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8383:1847765449612032:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166972.747326:0:8383:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf3cf4780 going to sleep for 11 seconds 00000100:00100000:3.0:1762166972.748613:0:8383:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf8bf0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8383:1847765449612032:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166972.748695:0:8383:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc8472800/0x2f180c4effba80fa lrc: 3/0,0 mode: --/PW res: [0x280000400:0xa85:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8d70 expref: 27 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.748714:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166972.748717:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166972.748724:0:8383:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc8472800/0x2f180c4effba80fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa85:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8d70 expref: 26 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.748734:0:8383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8472800/0x2f180c4effba80fa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa85:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8d70 expref: 26 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.748770:0:8383:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff945bc8472800/0x2f180c4effba80fa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8d70 expref: 26 pid: 8383 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166972.748782:0:8383:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf8bf0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8383:1847765449612160:192.168.204.38@tcp:105: 00000100:00100000:3.0:1762166972.748848:0:8383:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf3cf4780 going to sleep for 11 seconds 00000100:00100000:3.0:1762166972.750009:0:8383:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf8bf0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8383:1847765449612160:192.168.204.38@tcp:105: 00010000:00010000:3.0:1762166972.750027:0:8383:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8472800, rc 0) 00000100:00100000:3.0:1762166972.750075:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+25:61807:x1847765450135296:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2887us (2993us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166972.750082:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18352 00000100:00100000:3.0:1762166972.753373:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450135808 00000100:00100000:3.0:1762166972.753381:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450135808 00000100:00100000:3.0:1762166972.753426:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18353 00000100:00100000:3.0:1762166972.753435:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+24:2417:x1847765450135808:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:3.0:1762166972.753567:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+24:2417:x1847765450135808:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 132us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166972.753575:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18353 00000100:00100000:3.0:1762166972.754994:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450135936 00000100:00100000:3.0:1762166972.755003:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450135936 00000100:00100000:3.0:1762166972.755058:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18354 00000100:00100000:3.0:1762166972.755072:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+24:2417:x1847765450135936:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:3.0:1762166972.755178:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+24:2417:x1847765450135936:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 111us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166972.755186:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18354 00000100:00100000:3.0:1762166972.756608:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450136064 00000100:00100000:3.0:1762166972.756619:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450136064 00000100:00100000:3.0:1762166972.756682:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1614 00000100:00100000:3.0:1762166972.756691:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5806680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+24:2417:x1847765450136064:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:3.0:1762166972.756761:0:23943:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effba8101 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.756777:0:23943:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166972.756780:0:23943:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166972.756785:0:23943:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effba8101 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.756799:0:23943:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effba8101 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.756901:0:23943:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effba8101 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.756915:0:23943:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effba8101 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.756923:0:23943:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effba8101 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.756931:0:23943:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8473c00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166972.756936:0:23943:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effba8101 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.756945:0:23943:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effba8101 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.756959:0:23943:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effba8101 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.756978:0:23943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effba8101 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166972.757041:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5806680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+24:2417:x1847765450136064:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 350us (492us total) trans 0 rc 8192/8192 00000100:00100000:3.0:1762166972.757050:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1614 00000100:00100000:3.0:1762166972.758366:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450136192 00000100:00100000:3.0:1762166972.758371:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450136192 00000100:00100000:3.0:1762166972.758410:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1615 00000100:00100000:3.0:1762166972.758418:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+24:2417:x1847765450136192:12345-192.168.204.38@tcp:4:lfs.0 00010000:00010000:3.0:1762166972.758440:0:23943:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc8472a00/0x2f180c4effba8108 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa84:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.758453:0:23943:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effba80f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa84:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8d69 expref: 24 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.758460:0:23943:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166972.758462:0:23943:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166972.758465:0:23943:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472a00/0x2f180c4effba8108 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0xa84:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.758520:0:23943:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effba80f3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa84:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8d69 expref: 24 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.758535:0:23943:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effba80f3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa84:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8d69 expref: 24 pid: 8383 timeout: 691 lvb_type: 0 00000100:00100000:3.0:1762166972.758550:0:23943:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf8bf0000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_010:lustre-OST0001_UUID:23943:1847765449612288:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166972.758615:0:23943:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf3cf4000 going to sleep for 11 seconds 00000100:00100000:3.0:1762166972.760378:0:23943:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf8bf0000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_010:lustre-OST0001_UUID:23943:1847765449612288:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166972.760403:0:23943:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc8472a00/0x2f180c4effba8108 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa84:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.761251:0:23943:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc8472a00/0x2f180c4effba8108 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa84:0x0].0x0 rrc: 2 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.761260:0:23943:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8472a00/0x2f180c4effba8108 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa84:0x0].0x0 rrc: 2 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166972.763403:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa84:0x0] updating lvb size from disk: 0 -> 8192 00002000:00010000:3.0:1762166972.763409:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa84:0x0] updating lvb blocks from disk: 0 -> 16 00010000:00010000:3.0:1762166972.763418:0:23943:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc8472a00/0x2f180c4effba8108 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa84:0x0].0x0 rrc: 2 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.763427:0:23943:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472a00/0x2f180c4effba8108 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa84:0x0].0x0 rrc: 2 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.763435:0:23943:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc8472a00/0x2f180c4effba8108 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa84:0x0].0x0 rrc: 2 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.763441:0:23943:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8472a00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166972.763446:0:23943:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8472a00/0x2f180c4effba8108 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa84:0x0].0x0 rrc: 2 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.763455:0:23943:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8472a00/0x2f180c4effba8108 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa84:0x0].0x0 rrc: 2 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.763471:0:23943:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc8472a00/0x2f180c4effba8108 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa84:0x0].0x0 rrc: 2 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.763501:0:23943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8472a00/0x2f180c4effba8108 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa84:0x0].0x0 rrc: 2 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166972.763578:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+21:2417:x1847765450136192:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 5158us (5254us total) trans 17179875881 rc 0/0 00000100:00100000:3.0:1762166972.763587:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1615 00000100:00100000:3.0:1762166972.765818:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450136448 00000100:00100000:3.0:1762166972.765826:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450136448 00000100:00100000:3.0:1762166972.765877:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18355 00000100:00100000:3.0:1762166972.765886:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:2416:x1847765450136448:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:3.0:1762166972.765997:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:2416:x1847765450136448:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 111us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166972.766006:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18355 00000100:00100000:3.0:1762166972.770077:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450136704 00000100:00100000:3.0:1762166972.770085:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450136704 00000100:00100000:3.0:1762166972.770147:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1616 00000100:00100000:3.0:1762166972.770156:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+21:2417:x1847765450136704:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:3.0:1762166972.770211:0:23943:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effba810f lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.770230:0:23943:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166972.770232:0:23943:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166972.770238:0:23943:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effba810f lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [36864->40959] (req 36864->40959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.770252:0:23943:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effba810f lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [36864->40959] (req 36864->40959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.770371:0:23943:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effba810f lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [36864->40959] (req 36864->40959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.770382:0:23943:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effba810f lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [36864->40959] (req 36864->40959) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.770391:0:23943:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effba810f lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [36864->40959] (req 36864->40959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.770400:0:23943:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8473c00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166972.770405:0:23943:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effba810f lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [36864->40959] (req 36864->40959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.770415:0:23943:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effba810f lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [36864->40959] (req 36864->40959) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.770434:0:23943:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effba810f lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [36864->40959] (req 36864->40959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.770442:0:23943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effba810f lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [36864->40959] (req 36864->40959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166972.770539:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+21:2417:x1847765450136704:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 383us (588us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1762166972.770547:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1616 00000100:00100000:3.0:1762166972.772446:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450136832 00000100:00100000:3.0:1762166972.772461:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450136832 00000100:00100000:3.0:1762166972.772595:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1617 00000100:00100000:3.0:1762166972.772606:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+21:2416:x1847765450136832:12345-192.168.204.38@tcp:4:lfs.0 00002000:00010000:3.0:1762166972.772658:0:23943:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa84:0x0] initial LVB size: 8192, mtime: 0x690888bc, atime: 0x0, ctime: 0x690888bc, blocks: 0x10 00010000:00010000:3.0:1762166972.772668:0:23943:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effba8116 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa84:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.772685:0:23943:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166972.772687:0:23943:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166972.772693:0:23943:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effba8116 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa84:0x0].0x0 rrc: 2 type: EXT [36864->40959] (req 36864->40959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.772707:0:23943:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effba8116 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa84:0x0].0x0 rrc: 2 type: EXT [36864->40959] (req 36864->40959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166972.776342:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa84:0x0] updating lvb size from disk: 8192 -> 40960 00002000:00010000:3.0:1762166972.776348:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa84:0x0] updating lvb blocks from disk: 16 -> 24 00010000:00010000:3.0:1762166972.776360:0:23943:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effba8116 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa84:0x0].0x0 rrc: 2 type: EXT [36864->40959] (req 36864->40959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.776371:0:23943:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effba8116 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa84:0x0].0x0 rrc: 2 type: EXT [36864->40959] (req 36864->40959) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.776380:0:23943:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effba8116 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa84:0x0].0x0 rrc: 2 type: EXT [36864->40959] (req 36864->40959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.776387:0:23943:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8472c00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166972.776391:0:23943:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effba8116 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa84:0x0].0x0 rrc: 2 type: EXT [36864->40959] (req 36864->40959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.776400:0:23943:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effba8116 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa84:0x0].0x0 rrc: 2 type: EXT [36864->40959] (req 36864->40959) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.776417:0:23943:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effba8116 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa84:0x0].0x0 rrc: 2 type: EXT [36864->40959] (req 36864->40959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.776424:0:23943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effba8116 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa84:0x0].0x0 rrc: 2 type: EXT [36864->40959] (req 36864->40959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166972.776595:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+21:2416:x1847765450136832:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 3987us (4335us total) trans 17179875882 rc 0/0 00000100:00100000:3.0:1762166972.776606:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1617 00000100:00100000:3.0:1762166972.782582:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450137216 00000100:00100000:3.0:1762166972.782589:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450137216 00000100:00100000:3.0:1762166972.782641:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1618 00000100:00100000:3.0:1762166972.782651:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+21:2417:x1847765450137216:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:3.0:1762166972.782686:0:23943:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effba811d lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.782701:0:23943:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166972.782703:0:23943:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166972.782709:0:23943:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effba811d lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [45056->49151] (req 45056->49151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.782723:0:23943:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effba811d lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [45056->49151] (req 45056->49151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.782813:0:23943:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effba811d lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [45056->49151] (req 45056->49151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.782822:0:23943:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effba811d lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [45056->49151] (req 45056->49151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.782829:0:23943:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effba811d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [45056->49151] (req 45056->49151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.782841:0:23943:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8473c00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166972.782845:0:23943:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effba811d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [45056->49151] (req 45056->49151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.782854:0:23943:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effba811d lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [45056->49151] (req 45056->49151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.782868:0:23943:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effba811d lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [45056->49151] (req 45056->49151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.782876:0:23943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effba811d lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [45056->49151] (req 45056->49151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166972.782937:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+21:2417:x1847765450137216:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 287us (403us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1762166972.782944:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1618 00000100:00100000:3.0:1762166972.785395:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450137344 00000100:00100000:3.0:1762166972.785405:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450137344 00000100:00100000:3.0:1762166972.785520:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1619 00000100:00100000:3.0:1762166972.785531:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5805c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+21:2416:x1847765450137344:12345-192.168.204.38@tcp:4:lfs.0 00002000:00010000:3.0:1762166972.785593:0:23943:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa84:0x0] initial LVB size: 40960, mtime: 0x690888bc, atime: 0x0, ctime: 0x690888bc, blocks: 0x18 00010000:00010000:3.0:1762166972.785604:0:23943:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc8472a00/0x2f180c4effba8124 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa84:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.785619:0:23943:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166972.785621:0:23943:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166972.785629:0:23943:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472a00/0x2f180c4effba8124 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa84:0x0].0x0 rrc: 2 type: EXT [45056->49151] (req 45056->49151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.785649:0:23943:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8472a00/0x2f180c4effba8124 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa84:0x0].0x0 rrc: 2 type: EXT [45056->49151] (req 45056->49151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166972.787441:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa84:0x0] updating lvb size from disk: 40960 -> 49152 00002000:00010000:3.0:1762166972.787447:0:23943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa84:0x0] updating lvb mtime from disk: 1762166972 -> 1762166973 00002000:00010000:3.0:1762166972.787450:0:23943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa84:0x0] updating lvb ctime from disk: 1762166972 -> 1762166973 00002000:00010000:3.0:1762166972.787452:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa84:0x0] updating lvb blocks from disk: 24 -> 32 00010000:00010000:3.0:1762166972.787463:0:23943:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc8472a00/0x2f180c4effba8124 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa84:0x0].0x0 rrc: 2 type: EXT [45056->49151] (req 45056->49151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.787473:0:23943:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472a00/0x2f180c4effba8124 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa84:0x0].0x0 rrc: 2 type: EXT [45056->49151] (req 45056->49151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.787552:0:23943:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc8472a00/0x2f180c4effba8124 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa84:0x0].0x0 rrc: 2 type: EXT [45056->49151] (req 45056->49151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.787559:0:23943:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8472a00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166972.787563:0:23943:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8472a00/0x2f180c4effba8124 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa84:0x0].0x0 rrc: 2 type: EXT [45056->49151] (req 45056->49151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.787571:0:23943:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8472a00/0x2f180c4effba8124 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa84:0x0].0x0 rrc: 2 type: EXT [45056->49151] (req 45056->49151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.787587:0:23943:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc8472a00/0x2f180c4effba8124 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa84:0x0].0x0 rrc: 2 type: EXT [45056->49151] (req 45056->49151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.787598:0:23943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8472a00/0x2f180c4effba8124 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa84:0x0].0x0 rrc: 2 type: EXT [45056->49151] (req 45056->49151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166972.787717:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5805c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+21:2416:x1847765450137344:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 2184us (2400us total) trans 17179875883 rc 0/0 00000100:00100000:3.0:1762166972.787726:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1619 00000100:00100000:3.0:1762166972.790186:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450137472 00000100:00100000:3.0:1762166972.790203:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450137472 00000100:00100000:3.0:1762166972.790252:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18359 00000100:00100000:3.0:1762166972.790261:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450137472:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:3.0:1762166972.790365:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450137472:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 105us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166972.790372:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18359 00000100:00100000:3.0:1762166972.792191:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450137600 00000100:00100000:3.0:1762166972.792198:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450137600 00000100:00100000:3.0:1762166972.792235:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18360 00000100:00100000:3.0:1762166972.792243:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450137600:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:3.0:1762166972.792320:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450137600:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 77us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166972.792328:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18360 00000100:00100000:3.0:1762166972.795133:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450137728 00000100:00100000:3.0:1762166972.795146:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450137728 00000100:00100000:3.0:1762166972.795217:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1620 00000100:00100000:3.0:1762166972.795228:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5807800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450137728:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:3.0:1762166972.795268:0:23943:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8472a00/0x2f180c4effba812b lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.795288:0:23943:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166972.795294:0:23943:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166972.795301:0:23943:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472a00/0x2f180c4effba812b lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [110592->131071] (req 110592->131071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.795329:0:23943:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8472a00/0x2f180c4effba812b lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [110592->131071] (req 110592->131071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.797269:0:23943:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8472a00/0x2f180c4effba812b lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [110592->131071] (req 110592->131071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.797284:0:23943:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472a00/0x2f180c4effba812b lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [110592->131071] (req 110592->131071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.797292:0:23943:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc8472a00/0x2f180c4effba812b lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [110592->131071] (req 110592->131071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.797297:0:23943:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8472a00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166972.797301:0:23943:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8472a00/0x2f180c4effba812b lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [110592->131071] (req 110592->131071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.797306:0:23943:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8472a00/0x2f180c4effba812b lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [110592->131071] (req 110592->131071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.797328:0:23943:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc8472a00/0x2f180c4effba812b lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [110592->131071] (req 110592->131071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.797340:0:23943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8472a00/0x2f180c4effba812b lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [110592->131071] (req 110592->131071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166972.797414:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5807800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450137728:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 2186us (2714us total) trans 0 rc 20480/20480 00000100:00100000:3.0:1762166972.797423:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1620 00000100:00100000:3.0:1762166972.799288:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450137856 00000100:00100000:3.0:1762166972.799305:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450137856 00000100:00100000:3.0:1762166972.799406:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1621 00000100:00100000:3.0:1762166972.799417:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450137856:12345-192.168.204.38@tcp:4:lfs.0 00002000:00010000:3.0:1762166972.799563:0:23943:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa84:0x0] initial LVB size: 49152, mtime: 0x690888bd, atime: 0x0, ctime: 0x690888bd, blocks: 0x20 00010000:00010000:3.0:1762166972.799575:0:23943:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effba8132 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa84:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.799592:0:23943:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166972.799594:0:23943:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166972.799601:0:23943:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effba8132 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa84:0x0].0x0 rrc: 2 type: EXT [110592->131071] (req 110592->131071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.799617:0:23943:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effba8132 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa84:0x0].0x0 rrc: 2 type: EXT [110592->131071] (req 110592->131071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166972.803359:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa84:0x0] updating lvb size from disk: 49152 -> 131072 00002000:00010000:3.0:1762166972.803366:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa84:0x0] updating lvb blocks from disk: 32 -> 72 00010000:00010000:3.0:1762166972.803382:0:23943:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effba8132 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa84:0x0].0x0 rrc: 2 type: EXT [110592->131071] (req 110592->131071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.803399:0:23943:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effba8132 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa84:0x0].0x0 rrc: 2 type: EXT [110592->131071] (req 110592->131071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.803409:0:23943:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effba8132 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa84:0x0].0x0 rrc: 2 type: EXT [110592->131071] (req 110592->131071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.803423:0:23943:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8473c00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166972.803428:0:23943:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effba8132 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa84:0x0].0x0 rrc: 2 type: EXT [110592->131071] (req 110592->131071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.803439:0:23943:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effba8132 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa84:0x0].0x0 rrc: 2 type: EXT [110592->131071] (req 110592->131071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.803464:0:23943:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effba8132 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa84:0x0].0x0 rrc: 2 type: EXT [110592->131071] (req 110592->131071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.803472:0:23943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effba8132 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa84:0x0].0x0 rrc: 2 type: EXT [110592->131071] (req 110592->131071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166972.803645:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450137856:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 4220us (4486us total) trans 17179875884 rc 0/0 00000100:00100000:3.0:1762166972.803660:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1621 00000100:00100000:3.0:1762166972.805080:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450137984 00000100:00100000:3.0:1762166972.805092:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450137984 00000100:00100000:3.0:1762166972.805153:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18361 00000100:00100000:3.0:1762166972.805161:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450137984:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:3.0:1762166972.805299:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450137984:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 139us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166972.805305:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18361 00000100:00100000:3.0:1762166972.806886:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450138112 00000100:00100000:3.0:1762166972.806899:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450138112 00000100:00100000:3.0:1762166972.806950:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18362 00000100:00100000:3.0:1762166972.806961:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450138112:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:3.0:1762166972.807111:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450138112:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 151us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166972.807119:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18362 00000100:00100000:3.0:1762166972.814399:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450138496 00000100:00100000:3.0:1762166972.814407:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450138496 00000100:00100000:3.0:1762166972.814452:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18363 00000100:00100000:3.0:1762166972.814461:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450138496:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:3.0:1762166972.814604:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450138496:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 143us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166972.814611:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18363 00000100:00100000:3.0:1762166972.815994:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450138624 00000100:00100000:3.0:1762166972.816002:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450138624 00000100:00100000:3.0:1762166972.816045:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18364 00000100:00100000:3.0:1762166972.816054:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450138624:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:3.0:1762166972.816128:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450138624:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 76us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166972.816133:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18364 00000100:00100000:3.0:1762166972.822858:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450139008 00000100:00100000:3.0:1762166972.822868:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450139008 00000100:00100000:3.0:1762166972.822916:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18365 00000100:00100000:3.0:1762166972.822926:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450139008:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:3.0:1762166972.823033:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450139008:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 109us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166972.823041:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18365 00000100:00100000:3.0:1762166972.824304:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450139136 00000100:00100000:3.0:1762166972.824310:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450139136 00000100:00100000:3.0:1762166972.824357:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18366 00000100:00100000:3.0:1762166972.824364:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450139136:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:3.0:1762166972.824422:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450139136:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 58us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166972.824429:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18366 00000100:00100000:3.0:1762166972.835009:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450139776 00000100:00100000:3.0:1762166972.835016:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450139776 00000100:00100000:3.0:1762166972.835056:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18367 00000100:00100000:3.0:1762166972.835065:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:61807:x1847765450139776:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166972.835078:0:8383:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166972.835094:0:8383:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effba816a lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa84:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e8d77 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166972.835114:0:8383:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa84:0x0] initial LVB size: 262144, mtime: 0x690888bd, atime: 0x0, ctime: 0x690888bd, blocks: 0xa0 00010000:00010000:3.0:1762166972.835141:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166972.835147:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166972.835154:0:8383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effba816a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8d77 expref: 22 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.835174:0:8383:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effba816a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8d77 expref: 22 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166972.835187:0:8383:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8473c00, rc 0) 00000100:00100000:3.0:1762166972.835228:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+22:61807:x1847765450139776:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 165us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166972.835235:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18367 00000100:00100000:3.0:1762166972.836598:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450140032 00000100:00100000:3.0:1762166972.836605:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450140032 00002000:00010000:3.0:1762166972.836630:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2693 (0->18446744073709551615) 00002000:00100000:3.0:1762166972.836636:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4a2a300 with x1847765450140032 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166972.836646:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc4a2a300. 00000100:00100000:3.0:1762166972.836676:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1629 00000100:00100000:3.0:1762166972.836689:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765450140032:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:3.0:1762166972.836808:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa85:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166972.836812:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa85:0x0] updating lvb mtime from disk: 1762166972 -> 1762166973 00002000:00010000:3.0:1762166972.836818:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa85:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1762166972.836820:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa85:0x0] updating lvb ctime from disk: 1762166972 -> 1762166973 00002000:00010000:3.0:1762166972.836824:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa85:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166972.836864:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+27:2419:x1847765450140032:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 179us (323us total) trans 21474842979 rc 0/0 00000100:00100000:3.0:1762166972.836873:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1629 00002000:00010000:3.0:1762166972.836877:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2693 (0->18446744073709551615) 00002000:00100000:3.0:1762166972.836881:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4a2a300 with x1847765450140032 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166972.836887:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc4a2a300. 00000001:00080000:3.0:1762166972.839487:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294991434 is committed 00000020:00080000:3.0:1762166972.839556:0:7412:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0001: 31 batchid updated 00000100:00100000:3.0:1762166972.841020:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450140288 00000100:00100000:3.0:1762166972.841030:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450140288 00000100:00100000:3.0:1762166972.841135:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450140416 00000100:00100000:3.0:1762166972.841141:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450140416 00000100:00100000:3.0:1762166972.841232:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18369 00000100:00100000:3.0:1762166972.841245:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7ce5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+27:2419:x1847765450140416:12345-192.168.204.38@tcp:16:lfs.0 00000100:00100000:3.0:1762166972.850678:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450140800 00000100:00100000:3.0:1762166972.850685:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450140800 00000100:00100000:3.0:1762166972.854880:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.854915:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.863433:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.865033:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.867043:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.868976:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.871309:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.871350:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.871384:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.871528:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18379 00000100:00100000:3.0:1762166972.871545:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf8bf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450142592:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:3.0:1762166972.871774:0:28874:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166972.871791:0:28874:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166972 -> 1762166972 00002000:00010000:3.0:1762166972.871805:0:28874:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166972 -> 1762166972 00002000:00010000:3.0:1762166972.871820:0:28874:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166972 -> 1762166973 00002000:00010000:3.0:1762166972.871843:0:28874:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00000100:00100000:3.0:1762166972.871906:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf8bf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765450142592:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 358us (545us total) trans 21474842981 rc 0/0 00000100:00100000:3.0:1762166972.871941:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18379 00000100:00100000:3.0:1762166972.878007:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.878073:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:3.0:1762166972.878471:0:6497:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effba81b0 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5fc:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00010000:00010000:3.0:1762166972.878516:0:6497:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effba81b0 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5fc:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00000100:00100000:3.0:1762166972.879025:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf8bf3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449613696:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166972.879068:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166972.879100:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf3cf4000 going to sleep for 11 seconds 00000100:00100000:3.0:1762166972.879294:0:6497:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 17179875860 gen 2 00000004:00080000:3.0:1762166972.879299:0:6497:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 17179875851 committed transno 17179875860 00000004:00080000:3.0:1762166972.879317:0:6497:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf1ddc700, transno 17179875852 00000004:00080000:3.0:1762166972.879331:0:6497:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf1ddd180, transno 17179875853 00000004:00080000:3.0:1762166972.879334:0:6497:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf1ddca80, transno 17179875854 00000004:00080000:3.0:1762166972.879336:0:6497:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf1ddce00, transno 17179875855 00000004:00080000:3.0:1762166972.879339:0:6497:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf1ddf480, transno 17179875856 00000004:00080000:3.0:1762166972.879342:0:6497:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf1dddc00, transno 17179875857 00000004:00080000:3.0:1762166972.879345:0:6497:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf1ddfb80, transno 17179875858 00000004:00080000:3.0:1762166972.879348:0:6497:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf1e6c380, transno 17179875859 00000004:00080000:3.0:1762166972.879352:0:6497:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc5805880, transno 17179875860 00000100:00100000:3.0:1762166972.879359:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf8bf3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449613696:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166972.879404:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf8bf3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449613824:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166972.879429:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166972.879448:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf3cf4780 going to sleep for 11 seconds 00000100:00100000:3.0:1762166972.879672:0:6497:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 21474842974 gen 2 00000004:00080000:3.0:1762166972.879677:0:6497:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 21474842965 committed transno 21474842974 00000004:00080000:3.0:1762166972.879687:0:6497:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf1e6ce00, transno 21474842966 00000004:00080000:3.0:1762166972.879700:0:6497:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf1e6c700, transno 21474842967 00000004:00080000:3.0:1762166972.879703:0:6497:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf1e6c000, transno 21474842968 00000004:00080000:3.0:1762166972.879705:0:6497:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf1e6d880, transno 21474842969 00000004:00080000:3.0:1762166972.879707:0:6497:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf1e6d500, transno 21474842970 00000004:00080000:3.0:1762166972.879710:0:6497:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf1e6ea00, transno 21474842971 00000004:00080000:3.0:1762166972.879712:0:6497:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf1e6ed80, transno 21474842972 00000004:00080000:3.0:1762166972.879715:0:6497:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf1e6f480, transno 21474842973 00000004:00080000:3.0:1762166972.879717:0:6497:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf1e6fb80, transno 21474842974 00000100:00100000:3.0:1762166972.879722:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf8bf3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449613824:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166972.879768:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf8bf3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449613952:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166972.879791:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166972.879812:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccac36b40 going to sleep for 11 seconds 00000100:00100000:3.0:1762166972.879933:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf8bf3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449613952:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166972.879972:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf8bf3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449614080:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166972.879993:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166972.880015:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf3cf4000 going to sleep for 11 seconds 00000100:00100000:3.0:1762166972.880156:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf8bf3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449614080:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166972.880189:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf8bf3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449614208:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166972.880208:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166972.880225:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a16c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166972.880362:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf8bf3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449614208:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166972.880395:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf8bf3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449614336:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166972.880413:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166972.880431:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf3cf4000 going to sleep for 11 seconds 00000100:00100000:3.0:1762166972.880574:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf8bf3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449614336:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166972.880605:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf8bf3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449614464:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166972.880623:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166972.880639:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc2c72900 going to sleep for 11 seconds 00000100:00100000:3.0:1762166972.880758:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf8bf3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449614464:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166972.880792:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf8bf3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449614592:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166972.880809:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166972.880826:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a16c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166972.880912:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf8bf3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449614592:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166972.880940:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf8bf3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449614720:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166972.880959:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166972.880987:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf3cf4000 going to sleep for 11 seconds 00000100:00100000:3.0:1762166972.881184:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf8bf3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449614720:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166972.881211:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf8bf3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449614848:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166972.881228:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166972.881245:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc2c72900 going to sleep for 11 seconds 00000100:00100000:3.0:1762166972.881431:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf8bf3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449614848:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166972.881462:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf8bf3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449614976:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166972.881509:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166972.881525:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a16c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166972.881632:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf8bf3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449614976:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166972.881660:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf8bf3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449615104:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166972.881679:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166972.881696:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf3cf4000 going to sleep for 11 seconds 00000100:00100000:3.0:1762166972.881788:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf8bf3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449615104:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166972.881822:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcce76680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449615232:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166972.881840:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166972.881864:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc2c72900 going to sleep for 11 seconds 00000100:00100000:3.0:1762166972.882078:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcce76680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449615232:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166972.882105:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcce76680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449615360:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166972.882123:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166972.882145:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a16c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166972.882279:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcce76680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449615360:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166972.882316:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcce76680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449615488:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166972.882336:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166972.882353:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf3cf4000 going to sleep for 11 seconds 00000100:00100000:3.0:1762166972.882509:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcce76680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449615488:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166972.882538:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcce76680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449615616:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166972.882556:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166972.882572:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc2c72900 going to sleep for 11 seconds 00000100:00100000:3.0:1762166972.882709:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcce76680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449615616:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166972.882743:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcce76680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449615744:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166972.882762:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166972.882779:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a16c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166972.882894:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcce76680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449615744:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166972.882922:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcce76680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449615872:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166972.882940:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166972.882957:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf3cf4000 going to sleep for 11 seconds 00000100:00100000:3.0:1762166972.883070:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcce76680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449615872:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166972.883107:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcce76680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449616000:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166972.883125:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166972.883141:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc2c72900 going to sleep for 11 seconds 00000100:00100000:3.0:1762166972.883253:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcce76680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449616000:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166972.883283:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcce76680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449616128:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166972.883301:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166972.883318:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a16c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166972.883429:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcce76680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449616128:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166972.886396:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.892185:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:3.0:1762166972.892892:0:6482:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1762166972.892906:0:6482:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b98a00/0x2f180c4effba81be lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x5fc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6497 initiator: MDT1 00010000:00010000:3.0:1762166972.892917:0:6482:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4b98a00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166972.892921:0:6482:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b98a00/0x2f180c4effba81be lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x5fc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6497 initiator: MDT1 00010000:00010000:3.0:1762166972.892929:0:6482:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b98a00/0x2f180c4effba81be lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5fc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6497 initiator: MDT1 00010000:00010000:3.0:1762166972.892951:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5fc:0x0].0x0 (ffff945bc4180000) 00010000:00010000:3.0:1762166972.892955:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1762166972.892959:0:6482:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b98a00/0x2f180c4effba81be lrc: 1/0,0 mode: --/PW res: [0x240000404:0x5fc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6497 initiator: MDT1 00010000:00010000:3.0:1762166972.892977:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b98a00/0x2f180c4effba81be lrc: 0/0,0 mode: --/PW res: [0x240000404:0x5fc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6497 initiator: MDT1 00010000:00010000:3.0:1762166972.893000:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166972.893002:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166972.893004:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166972.903183:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.906709:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.910045:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.936527:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.938286:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.943120:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.943162:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.963900:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.965449:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.972188:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.975028:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.977189:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.981165:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.983082:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.985058:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.987056:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166972.989131:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000001:00080000:3.0:1762166972.992746:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294991449 is committed 00000004:00080000:3.0:1762166972.992761:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3157 committed 00000004:00080000:3.0:1762166972.992779:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3154 committed 00000004:00080000:3.0:1762166972.992795:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3153 committed 00000004:00080000:3.0:1762166972.992800:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3156 committed 00000004:00080000:3.0:1762166972.992809:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3155 committed 00000004:00080000:3.0:1762166972.992815:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3152 committed 00000004:00080000:3.0:1762166972.992821:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3151 committed 00000004:00080000:3.0:1762166972.992826:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3154 committed 00000004:00080000:3.0:1762166972.992833:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3153 committed 00000004:00080000:3.0:1762166972.992837:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3150 committed 00000004:00080000:3.0:1762166972.992844:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3149 committed 00000004:00080000:3.0:1762166972.992849:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3152 committed 00000004:00080000:3.0:1762166972.992854:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3151 committed 00000004:00080000:3.0:1762166972.992862:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3148 committed 00000004:00080000:3.0:1762166972.992869:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3147 committed 00000004:00080000:3.0:1762166972.992883:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3150 committed 00000004:00080000:3.0:1762166972.992892:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3146 committed 00000004:00080000:3.0:1762166972.992899:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3149 committed 00000004:00080000:3.0:1762166972.992904:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3148 committed 00000004:00080000:3.0:1762166972.992916:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3145 committed 00000020:00080000:3.0:1762166972.992981:0:7412:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff945cf3cf4840 refcount 2 committed 0 result 0 batchid 32 00000020:00080000:3.0:1762166972.992988:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cf3bd1100 obd lustre-OST0001-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff945ccac36b40 00000020:00080000:3.0:1762166972.992997:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cf3bd1600 obd lustre-OST0000-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff945cf3cf4780 00000020:00080000:3.0:1762166972.993005:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cf3bd1500 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff945bca718800 00000020:00080000:3.0:1762166972.993014:0:7412:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000400:0x2:0x0].30 00000100:00100000:3.0:1762166972.993113:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf3db5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449617536:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166972.993219:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166972.993318:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449618048:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166972.993370:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166972.993427:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449618560:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166972.993569:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449617536 00000100:00100000:3.0:1762166972.993583:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449617536 00000100:00100000:3.0:1762166972.993641:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449617408 00000100:00100000:3.0:1762166972.993646:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449617408 00000100:00100000:3.0:1762166972.993674:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449618048 00000100:00100000:3.0:1762166972.993683:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449618048 00000100:00100000:3.0:1762166972.993723:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449618176 00000100:00100000:3.0:1762166972.993730:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449618176 00000100:00100000:3.0:1762166972.993802:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449618560 00000100:00100000:3.0:1762166972.993807:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449618560 00000100:00100000:3.0:1762166972.993868:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449619072 00000100:00100000:3.0:1762166972.993874:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449619072 00000100:00100000:3.0:1762166972.993907:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18387 00000100:00100000:3.0:1762166972.993919:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+11:3633:x1847765449618048:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:3.0:1762166972.994038:0:28874:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa7d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166972.994043:0:28874:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa7d:0x0] updating lvb mtime from disk: 1762166972 -> 1762166972 00002000:00010000:3.0:1762166972.994052:0:28874:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa7d:0x0] updating lvb atime from disk: 1762166968 -> 1762166968 00002000:00010000:3.0:1762166972.994060:0:28874:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa7d:0x0] updating lvb ctime from disk: 1762166972 -> 1762166972 00002000:00010000:3.0:1762166972.994068:0:28874:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa7d:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166972.994143:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+14:3633:x1847765449618048:12345-0@lo:2:osp-syn-1-1.0 Request processed in 224us (775us total) trans 17179875895 rc 0/0 00000100:00100000:3.0:1762166972.994157:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18387 00000100:00100000:3.0:1762166972.994206:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18389 00000100:00100000:3.0:1762166972.994217:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+9:3634:x1847765449618176:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:3.0:1762166972.994294:0:28874:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa80:0x0] updating lvb size from disk: 249934 -> 249934 00002000:00010000:3.0:1762166972.994298:0:28874:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa80:0x0] updating lvb mtime from disk: 1762166972 -> 1762166972 00002000:00010000:3.0:1762166972.994307:0:28874:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa80:0x0] updating lvb atime from disk: 1762166969 -> 1762166969 00002000:00010000:3.0:1762166972.994321:0:28874:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa80:0x0] updating lvb ctime from disk: 1762166972 -> 1762166972 00002000:00010000:3.0:1762166972.994326:0:28874:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa80:0x0] updating lvb blocks from disk: 304 -> 304 00000100:00100000:3.0:1762166972.994393:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+12:3634:x1847765449618176:12345-0@lo:2:osp-syn-0-1.0 Request processed in 175us (936us total) trans 21474842985 rc 0/0 00000100:00100000:3.0:1762166972.994405:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18389 00000100:00100000:3.0:1762166972.994440:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18393 00000100:00100000:3.0:1762166972.994459:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+12:3633:x1847765449619072:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:3.0:1762166972.994613:0:28874:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa82:0x0] updating lvb size from disk: 39212 -> 39212 00002000:00010000:3.0:1762166972.994621:0:28874:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa82:0x0] updating lvb mtime from disk: 1762166972 -> 1762166972 00002000:00010000:3.0:1762166972.994627:0:28874:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa82:0x0] updating lvb atime from disk: 1762166972 -> 1762166972 00002000:00010000:3.0:1762166972.994632:0:28874:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa82:0x0] updating lvb ctime from disk: 1762166972 -> 1762166972 00002000:00010000:3.0:1762166972.994634:0:28874:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa82:0x0] updating lvb blocks from disk: 40 -> 40 00000100:00100000:3.0:1762166972.994675:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+13:3633:x1847765449619072:12345-0@lo:2:osp-syn-1-1.0 Request processed in 221us (853us total) trans 17179875898 rc 0/0 00000100:00100000:3.0:1762166972.994698:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18393 00000100:00100000:3.0:1762166972.994791:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1762166972.994944:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc406ea00/2, rc 0, transno 17179875893 00000100:00100000:3.0:1762166972.994978:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449617408:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1762166972.995017:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf3db7480/2, rc 0, transno 21474842984 00000100:00100000:3.0:1762166972.995031:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3db7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449617920:0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1762166972.995050:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc406ce00/2, rc 0, transno 17179875896 00000100:00100000:3.0:1762166972.995060:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449618432:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166972.995154:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449618816 00000100:00100000:3.0:1762166972.995162:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449618816 00000100:00100000:3.0:1762166972.995211:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18398 00000100:00100000:3.0:1762166972.995231:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+13:3635:x1847765449618816:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:3.0:1762166972.995322:0:28874:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa81:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166972.995328:0:28874:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa81:0x0] updating lvb mtime from disk: 1762166972 -> 1762166972 00002000:00010000:3.0:1762166972.995337:0:28874:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa81:0x0] updating lvb atime from disk: 1762166970 -> 1762166970 00002000:00010000:3.0:1762166972.995346:0:28874:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa81:0x0] updating lvb ctime from disk: 1762166972 -> 1762166972 00002000:00010000:3.0:1762166972.995349:0:28874:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa81:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166972.995398:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+16:3635:x1847765449618816:12345-0@lo:2:osp-syn-1-1.0 Request processed in 173us (274us total) trans 17179875900 rc 0/0 00000100:00100000:3.0:1762166972.995414:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18398 00000100:00100000:3.0:1762166972.995455:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1762166972.995568:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc406e300/2, rc 0, transno 17179875894 00000100:00100000:3.0:1762166972.995574:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449617664:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1762166972.995605:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf3db4700/2, rc 0, transno 21474842985 00000100:00100000:3.0:1762166972.995620:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3db4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449618176:0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1762166972.995663:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf1dde300/2, rc 0, transno 21474842986 00000100:00100000:3.0:1762166972.995677:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1dde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449618688:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166972.995763:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18402 00000100:00100000:3.0:1762166972.995784:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+14:3633:x1847765449619584:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:3.0:1762166972.995872:0:28874:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa84:0x0] updating lvb size from disk: 252494 -> 252494 00002000:00010000:3.0:1762166972.995883:0:28874:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa84:0x0] updating lvb mtime from disk: 1762166972 -> 1762166972 00002000:00010000:3.0:1762166972.995899:0:28874:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa84:0x0] updating lvb atime from disk: 1762166972 -> 1762166972 00002000:00010000:3.0:1762166972.995917:0:28874:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa84:0x0] updating lvb ctime from disk: 1762166972 -> 1762166972 00002000:00010000:3.0:1762166972.995922:0:28874:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa84:0x0] updating lvb blocks from disk: 216 -> 216 00000100:00100000:3.0:1762166972.996018:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+17:3633:x1847765449619584:12345-0@lo:2:osp-syn-0-1.0 Request processed in 235us (484us total) trans 21474842991 rc 0/0 00000100:00100000:3.0:1762166972.996056:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18402 00000100:00100000:3.0:1762166972.996700:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.003115:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450148224 00000100:00100000:3.0:1762166973.003122:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450148224 00002000:00010000:3.0:1762166973.003142:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:3.0:1762166973.003148:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf79ea300 with x1847765450148224 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166973.003156:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf79ea300. 00000100:00100000:3.0:1762166973.003261:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1632 00000100:00100000:3.0:1762166973.003275:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+25:2419:x1847765450147968:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:3.0:1762166973.003808:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 262144 -> 242313 00002000:00010000:3.0:1762166973.003813:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166972 -> 1762166973 00002000:00010000:3.0:1762166973.003816:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166972 -> 1762166972 00002000:00010000:3.0:1762166973.003818:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166973 -> 1762166973 00002000:00010000:3.0:1762166973.003820:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 296 -> 264 00000100:00100000:3.0:1762166973.003855:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765450147968:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 583us (907us total) trans 17179875904 rc 0/0 00000100:00100000:3.0:1762166973.003862:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1632 00002000:00010000:3.0:1762166973.003865:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (242313->18446744073709551615) 00002000:00100000:3.0:1762166973.003868:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf79e8380 with x1847765450147968 ext(242313->18446744073709551615) 00002000:00010000:3.0:1762166973.003873:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf79e8380. 00000100:00100000:3.0:1762166973.024702:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.027577:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.028248:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.029851:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.032202:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.034668:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.037436:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.038957:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.040760:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.042575:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.043956:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.044136:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.045714:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.047113:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.049238:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.050630:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.051773:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.053333:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00080000:3.0:1762166973.054568:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1762166973.059518:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.061129:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.062909:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.071686:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.074366:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.076083:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.078036:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.079005:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.080980:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.082466:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.084599:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.086016:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.088155:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.089853:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.091751:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.093994:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.096859:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.105625:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.107781:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.107808:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.110156:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.111819:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.113849:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.114898:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.115861:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.117072:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.119039:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.119080:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.121130:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.123260:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.125725:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.127458:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.129028:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.130532:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.136845:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.138283:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.141948:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.143464:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.152935:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.156116:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.158017:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.159884:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.161085:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.163682:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.165170:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.166880:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.168303:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.170989:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.172568:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.174576:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.177326:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.186886:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.189123:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.189166:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.192823:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.194535:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.196466:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.197764:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.199166:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.200907:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.202561:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.202653:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:3.0:1762166973.203061:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa400/0x2f180c4effba851b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166973.203070:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa400/0x2f180c4effba851b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166973.203364:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa400/0x2f180c4effba851b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166973.203372:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa400/0x2f180c4effba851b lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166973.203379:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa400/0x2f180c4effba851b lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166973.203385:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcc8fa400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166973.203388:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa400/0x2f180c4effba851b lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166973.203395:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa400/0x2f180c4effba851b lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166973.203405:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc6ab7200) 00010000:00010000:3.0:1762166973.203408:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166973.203411:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa400/0x2f180c4effba851b lrc: 2/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166973.203417:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa400/0x2f180c4effba851b lrc: 0/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166973.203427:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc6ab7200) 00010000:00010000:3.0:1762166973.203430:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166973.203435:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fb800/0x2f180c4effba850d lrc: 0/0,0 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8eb9 expref: 569 pid: 6495 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166973.203579:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc84e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+569:61813:x1847765450163584:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 2565us (2677us total) trans 4294991495 rc -22/-22 00000100:00100000:3.0:1762166973.203588:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11707 00000100:00100000:3.0:1762166973.204596:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.210655:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.212318:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:3.0:1762166973.212649:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4a400/0x2f180c4effba8553 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166973.212663:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4a400/0x2f180c4effba8553 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166973.212694:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472a00/0x2f180c4effba855a lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5ff:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166973.212708:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa200/0x2f180c4effba8530 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5ff:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8ec7 expref: 573 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166973.212715:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472a00/0x2f180c4effba855a lrc: 4/0,1 mode: --/EX res: [0x240000404:0x5ff:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166973.212748:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa200/0x2f180c4effba8530 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5ff:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8ec7 expref: 573 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166973.212758:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa200/0x2f180c4effba8530 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5ff:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8ec7 expref: 573 pid: 6495 timeout: 692 lvb_type: 0 00000100:00100000:3.0:1762166973.212769:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc84eaa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449627264:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166973.212881:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc2c72900 going to sleep for 11 seconds 00010000:00010000:3.0:1762166973.214364:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472a00/0x2f180c4effba855a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5ff:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166973.214372:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472a00/0x2f180c4effba855a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5ff:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:3.0:1762166973.214882:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc84e9180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449627392:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166973.214915:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166973.214941:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a16c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166973.215137:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc84e9180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449627392:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166973.215186:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc84e9180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449627520:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166973.215211:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166973.215229:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc2c72900 going to sleep for 11 seconds 00000100:00100000:3.0:1762166973.215374:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc84e9180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449627520:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166973.215416:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc84e9180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449627648:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166973.215438:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166973.215461:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166973.215680:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc84e9180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449627648:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166973.215707:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc84e9180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449627776:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166973.215729:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166973.215753:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166973.215928:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc84e9180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449627776:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166973.215980:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc84e9180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449627904:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166973.216005:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166973.216026:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402f780 going to sleep for 11 seconds 00000100:00100000:3.0:1762166973.216144:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc84e9180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449627904:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166973.216177:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc84e9180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449628032:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166973.216204:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166973.216227:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402f780 going to sleep for 11 seconds 00000100:00100000:3.0:1762166973.216319:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc84e9180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449628032:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166973.216354:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf7839c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449628160:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166973.216377:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166973.216397:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402f780 going to sleep for 11 seconds 00000100:00100000:3.0:1762166973.216569:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf7839c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449628160:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166973.216624:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf7839c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449628288:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166973.216648:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166973.216671:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402f780 going to sleep for 11 seconds 00000100:00100000:3.0:1762166973.216985:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf7839c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449628288:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166973.217018:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf7839c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449628416:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166973.217042:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166973.217064:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402f780 going to sleep for 11 seconds 00000100:00100000:3.0:1762166973.217285:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf7839c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449628416:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166973.217312:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf7839c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449628544:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166973.217334:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166973.217355:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402f780 going to sleep for 11 seconds 00000100:00100000:3.0:1762166973.217518:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf7839c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449628544:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166973.217550:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf7839c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449628672:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166973.217574:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166973.217600:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402f780 going to sleep for 11 seconds 00000100:00100000:3.0:1762166973.217907:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf7839c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449628672:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166973.217934:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf7839c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449628800:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166973.217970:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166973.217991:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402f780 going to sleep for 11 seconds 00000100:00100000:3.0:1762166973.218183:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf7839c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449628800:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166973.218212:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf7839c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449628928:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166973.218228:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166973.218245:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402f780 going to sleep for 11 seconds 00000100:00100000:3.0:1762166973.218378:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf7839c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449628928:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166973.218405:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf7839c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449629056:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166973.218423:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166973.218440:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402f780 going to sleep for 11 seconds 00000100:00100000:3.0:1762166973.218624:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf7839c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449629056:0@lo:1000:mdt_rdpg00_003.0 00000040:00080000:3.0:1762166973.218774:0:19593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x2:0x0].33, 728 off58808 00000001:00080000:3.0:1762166973.218780:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294991498 00000100:00100000:3.0:1762166973.218820:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf7839c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449629184:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166973.218838:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166973.218855:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402f780 going to sleep for 11 seconds 00000100:00100000:3.0:1762166973.219053:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf7839c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449629184:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166973.219075:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1dded80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449629312:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166973.219092:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166973.219109:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402f780 going to sleep for 11 seconds 00000100:00100000:3.0:1762166973.219261:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1dded80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449629312:0@lo:1000:mdt_rdpg00_003.0 00000001:00080000:3.0:1762166973.219304:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294991499 00010000:00010000:3.0:1762166973.219321:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472a00/0x2f180c4effba855a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5ff:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166973.219329:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472a00/0x2f180c4effba855a lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x5ff:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166973.219334:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472a00/0x2f180c4effba855a lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5ff:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166973.219341:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8472a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166973.219345:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472a00/0x2f180c4effba855a lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5ff:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166973.219350:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472a00/0x2f180c4effba855a lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x5ff:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166973.219361:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5ff:0x0].0x0 (ffff945bc812e000) 00010000:00010000:3.0:1762166973.219363:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166973.219366:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472a00/0x2f180c4effba855a lrc: 2/0,0 mode: --/EX res: [0x240000404:0x5ff:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166973.219370:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472a00/0x2f180c4effba855a lrc: 0/0,0 mode: --/EX res: [0x240000404:0x5ff:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166973.219384:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4a400/0x2f180c4effba8553 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166973.219390:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4a400/0x2f180c4effba8553 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166973.219395:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4a400/0x2f180c4effba8553 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166973.219400:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc3d4a400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166973.219402:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4a400/0x2f180c4effba8553 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166973.219408:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4a400/0x2f180c4effba8553 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166973.219415:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e800) 00010000:00010000:3.0:1762166973.219418:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166973.219421:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4a400/0x2f180c4effba8553 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166973.219426:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4a400/0x2f180c4effba8553 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166973.219437:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e800) 00010000:00010000:3.0:1762166973.219440:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166973.219446:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4a14000/0x2f180c4effba8545 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8ece expref: 575 pid: 6495 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166973.219548:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff2ffc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+574:61813:x1847765450164736:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 8795us (8901us total) trans 4294991500 rc 0/0 00000100:00100000:3.0:1762166973.219557:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11708 00000020:00080000:3.0:1762166973.219562:0:19593:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1762166973.226515:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450165504 00000100:00100000:3.0:1762166973.226524:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450165504 00000100:00100000:3.0:1762166973.226573:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11709 00000100:00100000:3.0:1762166973.226582:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+575:61813:x1847765450165504:12345-192.168.204.38@tcp:35:lfs.0 00000004:00080000:3.0:1762166973.226853:0:19593:0:(mdd_object.c:3965:mdd_close()) Object [0x240000404:0x5ff:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1762166973.226897:0:19593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5785, 64 off452248 00000040:00080000:3.0:1762166973.226917:0:19593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5786, 64 off452248 00000001:00080000:3.0:1762166973.226924:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294991501 00010000:00010000:3.0:1762166973.226978:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effba8568 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5ff:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166973.226993:0:19593:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effba8568 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5ff:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166973.227003:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effba8568 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5ff:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166973.227014:0:19593:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effba8568 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x5ff:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166973.227020:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effba8568 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x5ff:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166973.227025:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effba8568 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5ff:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166973.227047:0:19593:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1762166973.227219:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+577:61813:x1847765450165504:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 637us (758us total) trans 4294991502 rc 0/0 00000100:00100000:3.0:1762166973.227228:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11709 00000020:00080000:3.0:1762166973.227232:0:19593:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1762166973.228283:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450165760 00000100:00100000:3.0:1762166973.228288:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450165760 00000100:00100000:3.0:1762166973.228313:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11710 00000100:00100000:3.0:1762166973.228318:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+577:61813:x1847765450165760:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:3.0:1762166973.228454:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+578:61813:x1847765450165760:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 135us (199us total) trans 4294991503 rc 0/0 00000100:00100000:3.0:1762166973.228459:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11710 00000100:00100000:3.0:1762166973.244816:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450166784 00000100:00100000:3.0:1762166973.244821:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450166784 00000100:00100000:3.0:1762166973.244849:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11711 00000100:00100000:3.0:1762166973.244855:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+582:61814:x1847765450166784:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:3.0:1762166973.245060:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+583:61814:x1847765450166784:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 205us (299us total) trans 4294991506 rc 0/0 00000100:00100000:3.0:1762166973.245068:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11711 00000100:00100000:3.0:1762166973.258250:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.259818:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.263424:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.267233:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.278939:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.279364:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.286180:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.287406:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.290714:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450170880 00000100:00100000:3.0:1762166973.290722:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450170880 00010000:00010000:3.0:1762166973.290745:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4ac00/0x2f180c4effba8561 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8ed5 expref: 594 pid: 6495 timeout: 692 lvb_type: 0 00000100:00100000:3.0:1762166973.290773:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450171008 00000100:00100000:3.0:1762166973.290775:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450171008 00010000:00010000:3.0:1762166973.290790:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9800/0x2f180c4effba85df lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8eff expref: 595 pid: 6495 timeout: 692 lvb_type: 0 00000100:00100000:3.0:1762166973.294065:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.296300:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.297608:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.299210:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.300633:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.304346:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449632000 00000100:00100000:3.0:1762166973.304352:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449632000 00000100:00100000:3.0:1762166973.304387:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1221 00000100:00100000:3.0:1762166973.304395:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+19:19593:x1847765449632000:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166973.304530:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+20:19593:x1847765449632000:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 134us (203us total) trans 21474842998 rc 0/0 00000100:00100000:3.0:1762166973.304537:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1221 00000100:00100000:3.0:1762166973.305884:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.307555:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:3.0:1762166973.308236:0:6482:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1762166973.308243:0:6482:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc98f5200/0x2f180c4effba8695 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x600:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166973.308249:0:6482:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc98f5200 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166973.308253:0:6482:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc98f5200/0x2f180c4effba8695 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x600:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166973.308259:0:6482:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc98f5200/0x2f180c4effba8695 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x600:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166973.308271:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x600:0x0].0x0 (ffff945bc812e800) 00010000:00010000:3.0:1762166973.308274:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1762166973.308277:0:6482:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc98f5200/0x2f180c4effba8695 lrc: 1/0,0 mode: --/PW res: [0x240000404:0x600:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166973.308281:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc98f5200/0x2f180c4effba8695 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x600:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166973.308298:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166973.308300:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166973.308301:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166973.309142:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.316750:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.319008:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.320563:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.322351:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.323546:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.334249:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.335825:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.337886:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.339587:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.342881:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.345862:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.349474:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.358741:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.361151:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.361439:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.370082:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.371922:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.371984:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.377030:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.377073:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.377113:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.379628:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.379693:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.379750:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.383227:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.383264:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.383331:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.408121:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.410067:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.411744:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.414221:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.415571:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.418006:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.421318:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.422971:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.426633:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.428184:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.431811:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.436261:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.438381:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.443615:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.445265:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.451809:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.454774:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.456633:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.459584:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.466927:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.469609:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.471860:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.475770:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000001:00080000:3.0:1762166973.487782:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294991536 is committed 00000020:00080000:3.0:1762166973.487822:0:7412:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff945cc9a5e0c0 refcount 2 committed 0 result 0 batchid 36 00000020:00080000:3.0:1762166973.487827:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cf399c000 obd lustre-OST0001-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff945cd1ae6540 00000020:00080000:3.0:1762166973.487832:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cf39b2600 obd lustre-OST0000-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff945bc4446b40 00000020:00080000:3.0:1762166973.487839:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cf3a53300 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff945cf1c41400 00000020:00080000:3.0:1762166973.487845:0:7412:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000400:0x2:0x0].34 00000020:00080000:3.0:1762166973.487907:0:7412:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff945cd05170c0 refcount 2 committed 0 result 0 batchid 35 00000020:00080000:3.0:1762166973.487914:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cc7ab5600 obd lustre-OST0001-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff945bc402f840 00000020:00080000:3.0:1762166973.487918:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cc7ab5700 obd lustre-OST0000-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff945d011a16c0 00000020:00080000:3.0:1762166973.487920:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945bccf54300 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff945bca719e00 00000020:00080000:3.0:1762166973.487922:0:7412:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000400:0x2:0x0].33 00000020:00080000:3.0:1762166973.487976:0:7412:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff945bc56bf600 refcount 2 committed 0 result 0 batchid 34 00000020:00080000:3.0:1762166973.487981:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cf3a53600 obd lustre-OST0001-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff945cc7c77000 00000020:00080000:3.0:1762166973.487986:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cf3a53500 obd lustre-OST0000-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff945bc37313c0 00000020:00080000:3.0:1762166973.487993:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cf1d0e400 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff945bc5c23a00 00000020:00080000:3.0:1762166973.488001:0:7412:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000400:0x2:0x0].32 00000004:00080000:3.0:1762166973.488039:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3158 committed 00000004:00080000:3.0:1762166973.488053:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3155 committed 00000020:00080000:3.0:1762166973.488068:0:7412:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff945ccac3ce40 refcount 2 committed 0 result 0 batchid 33 00000020:00080000:3.0:1762166973.488071:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cf1d0e500 obd lustre-OST0001-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff945cc63990c0 00000020:00080000:3.0:1762166973.488075:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cf1d0ec00 obd lustre-OST0000-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff945cce6910c0 00000020:00080000:3.0:1762166973.488077:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cf1d0ef00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff945bc49f3800 00000020:00080000:3.0:1762166973.488081:0:7412:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000400:0x2:0x0].31 00000020:00080000:3.0:1762166973.488111:0:7412:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0001: 32 batchid updated 00000100:00100000:3.0:1762166973.488298:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449633664 00000100:00100000:3.0:1762166973.488305:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449633664 00000100:00100000:3.0:1762166973.488355:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18426 00000100:00100000:3.0:1762166973.488369:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+20:3636:x1847765449633664:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1762166973.488393:0:8380:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:2692 count 1 00002000:00010000:3.0:1762166973.488425:0:8380:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa84:0x0] initial LVB size: 262144, mtime: 0x690888bc, atime: 0x690888bc, ctime: 0x690888bd, blocks: 0xa0 00010000:00010000:3.0:1762166973.488433:0:8380:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc8472a00/0x2f180c4effba882b lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa84:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166973.488454:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166973.488456:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166973.488461:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472a00/0x2f180c4effba882b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166973.488472:0:8380:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8472a00/0x2f180c4effba882b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166973.488507:0:8380:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc8472a00/0x2f180c4effba882b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166973.488514:0:8380:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472a00/0x2f180c4effba882b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166973.488863:0:7420:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1762166973.488871:0:7420:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc8472a00/0x2f180c4effba882b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166973.488880:0:7420:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8472a00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166973.488884:0:7420:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8472a00/0x2f180c4effba882b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166973.488891:0:7420:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8472a00/0x2f180c4effba882b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166973.488905:0:7420:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc8472a00/0x2f180c4effba882b lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xa84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166973.488917:0:7420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8472a00/0x2f180c4effba882b lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166973.488933:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166973.488935:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166973.488938:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166973.492650:0:3636:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 21474842998 gen 2 00000004:00080000:3.0:1762166973.492664:0:3636:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 21474842982 committed transno 21474842998 00000004:00080000:3.0:1762166973.492702:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf3db5180, transno 21474842983 00000004:00080000:3.0:1762166973.492721:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf3db7480, transno 21474842984 00000004:00080000:3.0:1762166973.492726:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf3db4700, transno 21474842985 00000004:00080000:3.0:1762166973.492733:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf1dde300, transno 21474842986 00000004:00080000:3.0:1762166973.492737:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf3db7100, transno 21474842987 00000004:00080000:3.0:1762166973.492740:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf3db4380, transno 21474842988 00000004:00080000:3.0:1762166973.492743:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf1ddc700, transno 21474842989 00000004:00080000:3.0:1762166973.492746:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf1ddd180, transno 21474842990 00000004:00080000:3.0:1762166973.492749:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf1dddc00, transno 21474842991 00000004:00080000:3.0:1762166973.492752:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf1cd0e00, transno 21474842992 00000004:00080000:3.0:1762166973.492756:0:3636:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 21474842994 committed transno 21474842998 00000004:00080000:3.0:1762166973.492770:0:3636:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 21474842995 committed transno 21474842998 00000004:00080000:3.0:1762166973.492785:0:3636:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 21474842996 committed transno 21474842998 00000004:00080000:3.0:1762166973.492795:0:3636:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 21474842998 committed transno 21474842998 00000100:00100000:3.0:1762166973.492814:0:3636:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff945cf79eb100 x1847765449633536/t21474843005(21474843005) o6->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 544/432 e 0 to 0 dl 1762166989 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1762166973.492827:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf79eb100/2, rc 0, transno 21474843005 00000100:00100000:3.0:1762166973.492837:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449633536:0@lo:6:osp-syn-0-1.0 00000004:00080000:3.0:1762166973.493001:0:9158:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0001: 3 changes, 1 in progress, 0 in flight, 10 done 00000100:00100000:3.0:1762166973.504714:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450183552 00000100:00100000:3.0:1762166973.504726:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450183552 00000100:00100000:3.0:1762166973.505139:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.506362:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.513050:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.515431:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.515519:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.515561:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.515683:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18436 00000100:00100000:3.0:1762166973.515695:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+24:2418:x1847765450185216:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:3.0:1762166973.515867:0:28434:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166973.515873:0:28434:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166973 -> 1762166973 00002000:00010000:3.0:1762166973.515878:0:28434:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166972 -> 1762166973 00002000:00010000:3.0:1762166973.515881:0:28434:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166973 -> 1762166973 00002000:00010000:3.0:1762166973.515888:0:28434:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166973.515949:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+25:2418:x1847765450185216:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 258us (472us total) trans 17179875926 rc 0/0 00000100:00100000:3.0:1762166973.515973:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18436 00000100:00100000:3.0:1762166973.517217:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.519091:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.519127:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.519169:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.519243:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450185600 00000100:00100000:3.0:1762166973.519248:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450185600 00010000:00010000:3.0:1762166973.519271:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945d02174e00/0x2f180c4effba870c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8f61 expref: 534 pid: 6495 timeout: 692 lvb_type: 0 00000100:00100000:3.0:1762166973.519304:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450185984 00000100:00100000:3.0:1762166973.519308:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450185984 00010000:00010000:3.0:1762166973.519322:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945d02174400/0x2f180c4effba868e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8f37 expref: 536 pid: 6495 timeout: 692 lvb_type: 0 00000100:00100000:3.0:1762166973.519342:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9327 00000100:00100000:3.0:1762166973.519350:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+536:2418:x1847765450185600:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166973.519361:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166973.519371:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945d02174e00/0x2f180c4effba870c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8f61 expref: 536 pid: 6495 timeout: 692 lvb_type: 0 00010000:00010000:3.0:1762166973.519392:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945d02174e00/0x2f180c4effba870c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8f61 expref: 536 pid: 6495 timeout: 692 lvb_type: 0 00010000:00010000:3.0:1762166973.519417:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945d02174e00/0x2f180c4effba870c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8f61 expref: 536 pid: 6495 timeout: 692 lvb_type: 0 00010000:00010000:3.0:1762166973.519440:0:7421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166973.519582:0:7421:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eef600/0x2f180c4effba8863 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166973.519592:0:7421:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eef600/0x2f180c4effba8863 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166973.519647:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166973.520737:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eef600/0x2f180c4effba8863 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166973.520750:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eef600/0x2f180c4effba8863 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166973.520770:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472a00/0x2f180c4effba886a lrc: 3/0,1 mode: --/EX res: [0x240000404:0x601:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166973.520782:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4a400/0x2f180c4effba87d0 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x601:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8fb5 expref: 530 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166973.520790:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472a00/0x2f180c4effba886a lrc: 4/0,1 mode: --/EX res: [0x240000404:0x601:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166973.520822:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4a400/0x2f180c4effba87d0 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x601:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8fb5 expref: 530 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166973.520834:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4a400/0x2f180c4effba87d0 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x601:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8fb5 expref: 530 pid: 6495 timeout: 692 lvb_type: 0 00000100:00100000:3.0:1762166973.520846:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf3db5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449634432:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166973.520935:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166973.521790:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3db5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449634432:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166973.521804:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472a00/0x2f180c4effba886a lrc: 3/0,1 mode: --/EX res: [0x240000404:0x601:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166973.522330:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472a00/0x2f180c4effba886a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x601:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166973.522337:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472a00/0x2f180c4effba886a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x601:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:3.0:1762166973.522818:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf3db5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449634560:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166973.522858:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166973.522892:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402fd80 going to sleep for 11 seconds 00000100:00100000:3.0:1762166973.523124:0:19593:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 17179875924 gen 2 00000004:00080000:3.0:1762166973.523130:0:19593:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 17179875892 committed transno 17179875924 00000004:00080000:3.0:1762166973.523145:0:19593:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc406ea00, transno 17179875893 00000004:00080000:3.0:1762166973.523162:0:19593:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc406e300, transno 17179875894 00000004:00080000:3.0:1762166973.523165:0:19593:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc406fb80, transno 17179875895 00000004:00080000:3.0:1762166973.523168:0:19593:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc406ce00, transno 17179875896 00000004:00080000:3.0:1762166973.523170:0:19593:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc406d500, transno 17179875897 00000004:00080000:3.0:1762166973.523173:0:19593:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc406dc00, transno 17179875898 00000004:00080000:3.0:1762166973.523176:0:19593:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc406ed80, transno 17179875899 00000004:00080000:3.0:1762166973.523179:0:19593:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc406e680, transno 17179875900 00000004:00080000:3.0:1762166973.523181:0:19593:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc406f800, transno 17179875901 00000004:00080000:3.0:1762166973.523185:0:19593:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc406f100, transno 17179875902 00000004:00080000:3.0:1762166973.523188:0:19593:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 17179875905 committed transno 17179875924 00000004:00080000:3.0:1762166973.523229:0:19593:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 17179875906 committed transno 17179875924 00000004:00080000:3.0:1762166973.523243:0:19593:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 17179875910 committed transno 17179875924 00000004:00080000:3.0:1762166973.523253:0:19593:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 17179875916 committed transno 17179875924 00000004:00080000:3.0:1762166973.523267:0:19593:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc4493b80, transno 17179875924 00000100:00100000:3.0:1762166973.523277:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3db5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449634560:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166973.523313:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf3db5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449634688:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166973.523337:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166973.523362:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402fd80 going to sleep for 11 seconds 00000100:00100000:3.0:1762166973.523507:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3db5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449634688:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166973.523556:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf3db5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449634816:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166973.523594:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166973.523616:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402f300 going to sleep for 11 seconds 00000100:00100000:3.0:1762166973.523760:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3db5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449634816:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166973.523792:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf3db5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449634944:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166973.523816:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166973.523832:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402f300 going to sleep for 11 seconds 00000100:00100000:3.0:1762166973.523924:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3db5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449634944:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166973.523982:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf3db5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449635072:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166973.524002:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166973.524016:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1762166973.524153:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3db5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449635072:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166973.524184:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf3db5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449635200:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166973.524205:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166973.524223:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1762166973.524344:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3db5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449635200:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166973.524378:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf3db5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449635328:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166973.524400:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166973.524424:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1762166973.524616:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3db5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449635328:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166973.524645:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf3db5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449635456:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166973.524661:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166973.524675:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1762166973.524758:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3db5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449635456:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166973.524783:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf3db5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449635584:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166973.524797:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166973.524811:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1762166973.524886:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3db5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449635584:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166973.524910:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf3db5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449635712:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166973.524924:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166973.524938:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1762166973.525054:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3db5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449635712:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166973.525080:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf3db5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449635840:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166973.525095:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166973.525108:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1762166973.525187:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3db5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449635840:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166973.525220:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf3db5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449635968:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166973.525242:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166973.525257:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1762166973.525358:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3db5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449635968:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166973.525391:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcce75180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449636096:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166973.525413:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166973.525431:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1762166973.525565:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcce75180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449636096:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166973.532995:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450186880 00000100:00100000:3.0:1762166973.533007:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450186880 00000100:00100000:3.0:1762166973.533064:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11726 00000100:00100000:3.0:1762166973.533075:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4490a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+533:61817:x1847765450186880:12345-192.168.204.38@tcp:35:lfs.0 00000004:00080000:3.0:1762166973.533297:0:6497:0:(mdd_object.c:3965:mdd_close()) Object [0x240000404:0x601:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:3.0:1762166973.533404:0:6497:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472600/0x2f180c4effba8878 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x601:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 00010000:00010000:3.0:1762166973.533440:0:6497:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472600/0x2f180c4effba8878 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x601:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6497 initiator: MDT1 00010000:00010000:3.0:1762166973.533453:0:6497:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472600/0x2f180c4effba8878 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x601:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6497 initiator: MDT1 00010000:00010000:3.0:1762166973.533463:0:6497:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472600/0x2f180c4effba8878 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x601:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6497 initiator: MDT1 00010000:00010000:3.0:1762166973.533470:0:6497:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472600/0x2f180c4effba8878 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x601:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6497 initiator: MDT1 00010000:00010000:3.0:1762166973.533513:0:6497:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472600/0x2f180c4effba8878 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x601:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6497 initiator: MDT1 00010000:00010000:3.0:1762166973.533543:0:6497:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1762166973.592646:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.601520:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.604150:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.614750:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.620457:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.628869:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.632587:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.634794:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:3.0:1762166973.638179:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99400/0x2f180c4effba8919 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9010 expref: 525 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166973.638200:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166973.638211:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1762166973.638257:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99800/0x2f180c4effba8912 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9010 expref: 525 pid: 6495 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1762166973.638456:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99400/0x2f180c4effba8919 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9010 expref: 524 pid: 6495 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166973.638638:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18445 00000100:00100000:3.0:1762166973.638661:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+10:3636:x1847765449637632:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1762166973.638693:0:28434:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:2692 count 1 00010000:00010000:3.0:1762166973.638727:0:28434:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc8472600/0x2f180c4effba8935 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa84:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166973.638859:0:28434:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc6eeaa00/0x2f180c4effba7faa lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa84:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8cc8 expref: 21 pid: 35247 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166973.638888:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166973.638899:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166973.638910:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8472600/0x2f180c4effba8935 lrc: 4/0,1 mode: --/PW res: [0x280000400:0xa84:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166973.638981:0:28434:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc6eeaa00/0x2f180c4effba7faa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa84:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8cc8 expref: 21 pid: 35247 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166973.639031:0:28434:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc6eeaa00/0x2f180c4effba7faa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa84:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8cc8 expref: 21 pid: 35247 timeout: 692 lvb_type: 1 00000100:00100000:3.0:1762166973.639063:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcce75180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765449639552:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166973.639138:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402f780 going to sleep for 11 seconds 00000100:00100000:3.0:1762166973.639656:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18451 00000100:00100000:3.0:1762166973.639688:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4492a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+12:3633:x1847765449638144:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:3.0:1762166973.639853:0:35248:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166973.639860:0:35248:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb mtime from disk: 1762166966 -> 1762166966 00002000:00010000:3.0:1762166973.639866:0:35248:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1762166973.639991:0:35248:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb ctime from disk: 1762166966 -> 1762166966 00002000:00010000:3.0:1762166973.639996:0:35248:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166973.640091:0:35248:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4492a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+14:3633:x1847765449638144:12345-0@lo:2:osp-syn-0-1.0 Request processed in 404us (654us total) trans 21474843012 rc 0/0 00000100:00100000:3.0:1762166973.640105:0:35248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18451 00000100:00100000:3.0:1762166973.640146:0:35248:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449639040 00000100:00100000:3.0:1762166973.640155:0:35248:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449639040 00000100:00100000:3.0:1762166973.640212:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18454 00000100:00100000:3.0:1762166973.640230:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+14:3635:x1847765449638528:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:3.0:1762166973.640378:0:35248:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166973.640385:0:35248:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166973 -> 1762166973 00002000:00010000:3.0:1762166973.640392:0:35248:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166973 -> 1762166973 00002000:00010000:3.0:1762166973.640403:0:35248:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166973 -> 1762166973 00002000:00010000:3.0:1762166973.640417:0:35248:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00000100:00100000:3.0:1762166973.640538:0:35248:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+15:3635:x1847765449638528:12345-0@lo:2:osp-syn-0-1.0 Request processed in 314us (632us total) trans 21474843014 rc 0/0 00000100:00100000:3.0:1762166973.640552:0:35248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18454 00010000:00010000:3.0:1762166973.640780:0:6482:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1762166973.640793:0:6482:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc4b98e00/0x2f180c4effba893c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166973.640808:0:6482:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4b98e00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166973.640819:0:6482:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4b98e00/0x2f180c4effba893c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166973.640838:0:6482:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4b98e00/0x2f180c4effba893c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166973.640881:0:6482:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc4b98e00/0x2f180c4effba893c lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xa80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166973.640916:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4b98e00/0x2f180c4effba893c lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166973.640975:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166973.640982:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166973.640991:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166973.641018:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18460 00000100:00100000:3.0:1762166973.641048:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6224380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+15:3636:x1847765449640192:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:3.0:1762166973.641153:0:35248:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb size from disk: 188408 -> 188408 00002000:00010000:3.0:1762166973.641159:0:35248:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb mtime from disk: 1762166973 -> 1762166973 00002000:00010000:3.0:1762166973.641167:0:35248:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb atime from disk: 1762166973 -> 1762166973 00002000:00010000:3.0:1762166973.641174:0:35248:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb ctime from disk: 1762166973 -> 1762166973 00002000:00010000:3.0:1762166973.641177:0:35248:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb blocks from disk: 216 -> 216 00000100:00100000:3.0:1762166973.641524:0:35248:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6224380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+18:3636:x1847765449640192:12345-0@lo:2:osp-syn-0-1.0 Request processed in 438us (581us total) trans 21474843015 rc 0/0 00000100:00100000:3.0:1762166973.641557:0:35248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18460 00000100:00100000:3.0:1762166973.641734:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9335 00000100:00100000:3.0:1762166973.641813:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6225880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450190464:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166973.641849:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166973.641864:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc6eeaa00/0x2f180c4effba7faa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa84:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8cc8 expref: 22 pid: 35247 timeout: 692 lvb_type: 1 00010000:00010000:3.0:1762166973.641886:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc6eeaa00/0x2f180c4effba7faa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa84:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8cc8 expref: 22 pid: 35247 timeout: 692 lvb_type: 1 00010000:00010000:3.0:1762166973.641913:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc6eeaa00/0x2f180c4effba7faa lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa84:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8cc8 expref: 22 pid: 35247 timeout: 692 lvb_type: 1 00010000:00010000:3.0:1762166973.641978:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166973.641983:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166973.641990:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc8472600/0x2f180c4effba8935 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa84:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166973.642002:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8472600/0x2f180c4effba8935 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa84:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166973.642087:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166973.642140:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6225880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450190464:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 382us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166973.642180:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9335 00000100:00100000:3.0:1762166973.642447:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9336 00000100:00100000:3.0:1762166973.642470:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6224700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765450190848:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166973.642561:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166973.642580:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effba6142 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa7d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8137 expref: 26 pid: 35247 timeout: 692 lvb_type: 0 00010000:00010000:3.0:1762166973.642667:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effba6142 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa7d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8137 expref: 26 pid: 35247 timeout: 692 lvb_type: 0 00010000:00010000:3.0:1762166973.642730:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effba6142 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa7d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8137 expref: 26 pid: 35247 timeout: 692 lvb_type: 0 00010000:00010000:3.0:1762166973.642761:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166973.642765:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166973.642772:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc6eef800/0x2f180c4effba8943 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa7d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166973.642833:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc6eef800/0x2f180c4effba8943 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xa7d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166973.642871:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166973.642917:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6224700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+25:2419:x1847765450190848:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 451us (865us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166973.642934:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9336 00010000:00010000:3.0:1762166973.643290:0:10256:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1762166973.643299:0:10256:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc6eef800/0x2f180c4effba8943 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166973.643307:0:10256:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc6eef800 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166973.643311:0:10256:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc6eef800/0x2f180c4effba8943 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166973.643323:0:10256:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc6eef800/0x2f180c4effba8943 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166973.643450:0:10256:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc6eef800/0x2f180c4effba8943 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xa7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166973.643459:0:10256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc6eef800/0x2f180c4effba8943 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166973.645197:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450190976 00000100:00100000:3.0:1762166973.645204:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450190976 00010000:00010000:3.0:1762166973.645232:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf200/0x2f180c4effba87a6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8f99 expref: 24 pid: 9165 timeout: 692 lvb_type: 1 00000100:00100000:3.0:1762166973.645263:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9337 00000100:00100000:3.0:1762166973.645271:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765450190976:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166973.645326:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166973.645344:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf200/0x2f180c4effba87a6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8f99 expref: 24 pid: 9165 timeout: 692 lvb_type: 1 00010000:00010000:3.0:1762166973.645355:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf200/0x2f180c4effba87a6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8f99 expref: 24 pid: 9165 timeout: 692 lvb_type: 1 00010000:00010000:3.0:1762166973.645370:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf200/0x2f180c4effba87a6 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8f99 expref: 24 pid: 9165 timeout: 692 lvb_type: 1 00010000:00010000:3.0:1762166973.645387:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166973.645389:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166973.645394:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf800/0x2f180c4effba894a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 131072->176127) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9017 expref: 23 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166973.645402:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf800/0x2f180c4effba894a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 131072->176127) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9017 expref: 23 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166973.645429:0:6481:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf800/0x2f180c4effba894a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 131072->176127) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9017 expref: 23 pid: 35472 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166973.645442:0:6481:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcce76d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6481:1847765449640448:192.168.204.38@tcp:105: 00000100:00100000:3.0:1762166973.645530:0:6481:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402f000 going to sleep for 11 seconds 00000100:00100000:3.0:1762166973.646996:0:6481:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcce76d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6481:1847765449640448:192.168.204.38@tcp:105: 00010000:00010000:3.0:1762166973.647014:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166973.647112:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765450190976:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1790us (2186us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166973.647124:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9337 00000100:00100000:3.0:1762166973.652423:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450191360 00000100:00100000:3.0:1762166973.652432:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450191360 00000100:00100000:3.0:1762166973.652504:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 29985 00000100:00100000:3.0:1762166973.652514:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6225c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+525:61766:x1847765450191360:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:3.0:1762166973.652527:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166973.652540:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473600/0x2f180c4effba895f lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9025 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166973.652572:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472c00/0x2f180c4effba8966 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166973.652584:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472c00/0x2f180c4effba8966 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166973.652593:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472c00/0x2f180c4effba8966 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166973.652691:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473600/0x2f180c4effba895f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9025 expref: 527 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166973.652705:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472c00/0x2f180c4effba8966 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9025 expref: 526 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166973.652712:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166973.652715:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1762166973.652718:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8472c00, rc 0) 00000100:00100000:3.0:1762166973.652757:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6225c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+526:61766:x1847765450191360:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 245us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166973.652764:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 29985 00000100:00100000:3.0:1762166973.654735:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450191616 00000100:00100000:3.0:1762166973.654742:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450191616 00000100:00100000:3.0:1762166973.654786:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 29986 00000100:00100000:3.0:1762166973.654795:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+526:61766:x1847765450191616:12345-192.168.204.38@tcp:36:fsx.0 00010000:00010000:3.0:1762166973.654832:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1762166973.654850:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b98600/0x2f180c4effba8958 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e901e expref: 526 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166973.654872:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99400/0x2f180c4effba8919 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9010 expref: 525 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166973.654882:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166973.654886:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166973.655068:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effba896d lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166973.655078:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effba896d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166973.655085:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effba896d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000001:00080000:3.0:1762166973.655129:0:6495:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294991551 00000004:00010000:3.0:1762166973.655150:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000a4afe069 reply state 0000000013cbcbef transno 4294991552 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effba896d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166973.655161:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effba896d lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166973.655180:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166973.655183:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1762166973.655185:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166973.655265:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+527:61766:x1847765450191616:12345-192.168.204.38@tcp:36:fsx.0 Request processed in 470us (590us total) trans 4294991552 rc 0/0 00000100:00100000:3.0:1762166973.655272:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 29986 00000020:00080000:3.0:1762166973.655277:0:6495:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1762166973.656807:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450191744 00000100:00100000:3.0:1762166973.656818:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450191744 00000100:00100000:3.0:1762166973.656877:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 29987 00000100:00100000:3.0:1762166973.656887:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6224000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+527:61766:x1847765450191744:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:3.0:1762166973.656913:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166973.656933:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472a00/0x2f180c4effba8974 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e902c expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166973.657002:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472a00/0x2f180c4effba8974 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e902c expref: 528 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166973.657017:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472a00/0x2f180c4effba8974 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e902c expref: 528 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166973.657036:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166973.657040:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166973.657043:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8472a00, rc 0) 00000100:00100000:3.0:1762166973.657104:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6224000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+528:61766:x1847765450191744:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 219us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166973.657112:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 29987 00000100:00100000:3.0:1762166973.661332:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.664409:0:6481:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6481:1847765449640704:192.168.204.38@tcp:105: 00010000:00010000:3.0:1762166973.664438:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166973.664512:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce76d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450192000:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 2987us (3186us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166973.664525:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9338 00000100:00100000:3.0:1762166973.666652:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450192256 00000100:00100000:3.0:1762166973.666660:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450192256 00010000:00010000:3.0:1762166973.666691:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc6eee000/0x2f180c4effba87b4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8fa7 expref: 25 pid: 28434 timeout: 692 lvb_type: 1 00000100:00100000:3.0:1762166973.666731:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9339 00000100:00100000:3.0:1762166973.666741:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7c30450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+25:2419:x1847765450192256:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166973.666756:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166973.666779:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc6eee000/0x2f180c4effba87b4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8fa7 expref: 25 pid: 28434 timeout: 692 lvb_type: 1 00010000:00010000:3.0:1762166973.666793:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc6eee000/0x2f180c4effba87b4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8fa7 expref: 25 pid: 28434 timeout: 692 lvb_type: 1 00010000:00010000:3.0:1762166973.666819:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc6eee000/0x2f180c4effba87b4 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e8fa7 expref: 25 pid: 28434 timeout: 692 lvb_type: 1 00010000:00010000:3.0:1762166973.666833:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166973.666835:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166973.666841:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effba8982 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e903a expref: 24 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166973.666852:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effba8982 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e903a expref: 24 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166973.666888:0:6481:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effba8982 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e903a expref: 24 pid: 35472 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166973.666902:0:6481:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcce75f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6481:1847765449640960:192.168.204.38@tcp:105: 00000100:00100000:3.0:1762166973.666983:0:6481:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402f000 going to sleep for 11 seconds 00000100:00100000:3.0:1762166973.668368:0:6481:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcce75f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6481:1847765449640960:192.168.204.38@tcp:105: 00010000:00010000:3.0:1762166973.668393:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166973.668782:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7c30450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765450192256:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1717us (1858us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166973.668796:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9339 00000100:00100000:3.0:1762166973.671047:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450192768 00000100:00100000:3.0:1762166973.671056:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450192768 00000100:00100000:3.0:1762166973.671122:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 29988 00000100:00100000:3.0:1762166973.671131:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6225180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+528:61766:x1847765450192768:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:3.0:1762166973.671148:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166973.671167:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473600/0x2f180c4effba8989 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9041 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166973.671260:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472800/0x2f180c4effba8990 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166973.671275:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472800/0x2f180c4effba8990 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166973.671287:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472800/0x2f180c4effba8990 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:3.0:1762166973.671316:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 140435 00000004:00200000:3.0:1762166973.671320:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166973.671336:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472800/0x2f180c4effba8990 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166973.671359:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473600/0x2f180c4effba8989 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9041 expref: 530 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166973.671381:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472800/0x2f180c4effba8990 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9041 expref: 529 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166973.671389:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166973.671392:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166973.671396:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8472800, rc 0) 00000100:00100000:3.0:1762166973.671451:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6225180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+529:61766:x1847765450192768:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 321us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166973.671458:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 29988 00000100:00100000:3.0:1762166973.708933:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.708985:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.724407:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.724804:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.728118:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.731736:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.734100:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.736907:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.738874:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.738919:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.739772:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.741624:0:28874:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28874:1847765449641600:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166973.741638:0:28874:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bc6eee000/0x2f180c4effba89f9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166973.741694:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:3.0:1762166973.741834:0:28434:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc4b99600/0x2f180c4effba89eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166973.741844:0:28434:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4b99600/0x2f180c4effba89eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166973.741861:0:28434:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc4b99600/0x2f180c4effba89eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166973.741904:0:28434:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4b99600/0x2f180c4effba89eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166973.741911:0:28434:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc4b99600/0x2f180c4effba89eb lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166973.741917:0:28434:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4b99600 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166973.741920:0:28434:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4b99600/0x2f180c4effba89eb lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166973.741926:0:28434:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4b99600/0x2f180c4effba89eb lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166973.741936:0:28434:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc4b99600/0x2f180c4effba89eb lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166973.741941:0:28434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4b99600/0x2f180c4effba89eb lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166973.741992:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+32:2419:x1847765450195456:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 2927us (3122us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166973.741998:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18465 00000100:00100000:3.0:1762166973.744457:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:3.0:1762166973.747712:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effba896d lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166973.747732:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effba896d lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166973.747744:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effba896d lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166973.747755:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8472400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166973.747762:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effba896d lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166973.747771:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effba896d lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166973.747794:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166973.747800:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166973.747808:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effba896d lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166973.747815:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effba896d lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000100:00100000:3.0:1762166973.747892:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4010e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449641728:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166973.748004:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166973.748070:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc6224700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449642240:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166973.748143:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166973.748194:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4010a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449642752:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166973.748243:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166973.748299:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5589880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449643264:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166973.748344:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166973.748663:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18472 00000100:00100000:3.0:1762166973.748682:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+20:3633:x1847765449642752:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:3.0:1762166973.748793:0:9165:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa80:0x0] updating lvb size from disk: 249934 -> 249934 00002000:00010000:3.0:1762166973.748799:0:9165:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa80:0x0] updating lvb mtime from disk: 1762166972 -> 1762166972 00002000:00010000:3.0:1762166973.748804:0:9165:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa80:0x0] updating lvb atime from disk: 1762166969 -> 1762166969 00002000:00010000:3.0:1762166973.748812:0:9165:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa80:0x0] updating lvb ctime from disk: 1762166972 -> 1762166972 00002000:00010000:3.0:1762166973.748817:0:9165:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa80:0x0] updating lvb blocks from disk: 304 -> 304 00000100:00100000:3.0:1762166973.748869:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+22:3633:x1847765449642752:12345-0@lo:2:osp-syn-0-1.0 Request processed in 192us (634us total) trans 21474843023 rc 0/0 00000100:00100000:3.0:1762166973.748882:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18472 00000100:00100000:3.0:1762166973.748921:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166973.748971:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449642624:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166973.749016:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166973.749042:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449643136:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166973.749078:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166973.749126:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166973.749155:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449642880:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166973.749214:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166973.749241:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5589500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449643392:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166973.749280:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1762166973.749321:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc6224a80/2, rc 0, transno 17179875948 00000100:00100000:3.0:1762166973.749330:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc6224a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449641856:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166973.749359:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449643392 00000100:00100000:3.0:1762166973.749363:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449643392 00000100:00100000:3.0:1762166973.749396:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18479 00000100:00100000:3.0:1762166973.749411:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+24:3634:x1847765449642368:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:3.0:1762166973.749509:0:9165:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa7f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166973.749512:0:9165:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa7f:0x0] updating lvb mtime from disk: 1762166972 -> 1762166972 00002000:00010000:3.0:1762166973.749514:0:9165:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa7f:0x0] updating lvb atime from disk: 1762166969 -> 1762166969 00002000:00010000:3.0:1762166973.749516:0:9165:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa7f:0x0] updating lvb ctime from disk: 1762166972 -> 1762166972 00002000:00010000:3.0:1762166973.749519:0:9165:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa7f:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166973.749579:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+24:3634:x1847765449642368:12345-0@lo:2:osp-syn-1-1.0 Request processed in 172us (452us total) trans 17179875952 rc 0/0 00000100:00100000:3.0:1762166973.749609:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18479 00000004:00080000:3.0:1762166973.749650:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf783ed80/2, rc 0, transno 17179875952 00000100:00100000:3.0:1762166973.749657:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449642368:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166973.751259:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.753748:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.755904:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.781383:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.787096:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.815689:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.817647:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450198912 00000100:00100000:3.0:1762166973.817656:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450198912 00000100:00100000:3.0:1762166973.817706:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 29996 00000100:00100000:3.0:1762166973.817716:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945d011ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+527:61819:x1847765450198912:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:3.0:1762166973.817774:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166973.817800:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effba8a15 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e906b expref: 527 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166973.817817:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166973.817823:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166973.818004:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effba8a5b lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166973.818016:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effba8a5b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166973.818022:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effba8a5b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000001:00080000:3.0:1762166973.818055:0:6495:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294991557 00000004:00010000:3.0:1762166973.818070:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000004872a626 reply state 00000000087083a0 transno 4294991558 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effba8a5b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166973.818078:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effba8a5b lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166973.818082:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166973.818083:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1762166973.818085:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166973.818154:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945d011ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+529:61819:x1847765450198912:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 439us (597us total) trans 4294991558 rc 0/0 00000100:00100000:3.0:1762166973.818162:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 29996 00000020:00080000:3.0:1762166973.818167:0:6495:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1762166973.824224:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450199424 00000100:00100000:3.0:1762166973.824235:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450199424 00000100:00100000:3.0:1762166973.824281:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 29997 00000100:00100000:3.0:1762166973.824291:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945d011e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+529:61819:x1847765450199424:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166973.824309:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166973.824325:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472800/0x2f180c4effba8a69 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e908e expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166973.824534:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473c00/0x2f180c4effba8a70 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166973.824550:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473c00/0x2f180c4effba8a70 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166973.824568:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473c00/0x2f180c4effba8a70 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:3.0:1762166973.824598:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 8192 00000004:00200000:3.0:1762166973.824603:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166973.824619:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473c00/0x2f180c4effba8a70 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166973.824644:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472800/0x2f180c4effba8a69 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e908e expref: 531 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166973.824660:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473c00/0x2f180c4effba8a70 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e908e expref: 530 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166973.824669:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166973.824672:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166973.824675:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8473c00, rc 0) 00000100:00100000:3.0:1762166973.824741:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945d011e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+530:61819:x1847765450199424:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 452us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166973.824748:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 29997 00000100:00100000:3.0:1762166973.826772:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450199680 00000100:00100000:3.0:1762166973.826782:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450199680 00000100:00100000:3.0:1762166973.826825:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 29998 00000100:00100000:3.0:1762166973.826835:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945d011eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+530:61819:x1847765450199680:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:3.0:1762166973.826874:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166973.826893:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473c00/0x2f180c4effba8a70 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e908e expref: 530 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166973.826908:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166973.826912:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166973.827082:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effba8a77 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166973.827094:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effba8a77 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166973.827103:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effba8a77 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000001:00080000:3.0:1762166973.827147:0:6495:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294991559 00000004:00010000:3.0:1762166973.827170:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000179b190f reply state 0000000066ac9988 transno 4294991560 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effba8a77 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166973.827181:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effba8a77 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166973.827187:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166973.827190:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1762166973.827192:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166973.827276:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945d011eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+532:61819:x1847765450199680:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 442us (703us total) trans 4294991560 rc 0/0 00000100:00100000:3.0:1762166973.827283:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 29998 00000020:00080000:3.0:1762166973.827288:0:6495:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1762166973.830498:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450200064 00000100:00100000:3.0:1762166973.830505:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450200064 00002000:00010000:3.0:1762166973.830538:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2687 (0->18446744073709551615) 00002000:00100000:3.0:1762166973.830548:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945d011e9500 with x1847765450200064 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166973.830561:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945d011e9500. 00000100:00100000:3.0:1762166973.833011:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450200192 00000100:00100000:3.0:1762166973.833022:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450200192 00000100:00100000:3.0:1762166973.833078:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 29999 00000100:00100000:3.0:1762166973.833089:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945d011e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+532:61819:x1847765450200192:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166973.833123:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166973.833148:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473600/0x2f180c4effba8a85 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e909c expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166973.833257:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472600/0x2f180c4effba8a8c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166973.833274:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472600/0x2f180c4effba8a8c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166973.833285:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472600/0x2f180c4effba8a8c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:3.0:1762166973.833315:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 8192 00000004:00200000:3.0:1762166973.833320:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166973.833340:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472600/0x2f180c4effba8a8c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166973.833366:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473600/0x2f180c4effba8a85 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e909c expref: 534 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166973.833392:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472600/0x2f180c4effba8a8c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e909c expref: 533 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166973.833402:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166973.833405:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166973.833409:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8472600, rc 0) 00000100:00100000:3.0:1762166973.833473:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945d011e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+533:61819:x1847765450200192:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 386us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166973.833525:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 29999 00000100:00100000:3.0:1762166973.835305:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450200448 00000100:00100000:3.0:1762166973.835315:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450200448 00000100:00100000:3.0:1762166973.835378:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30000 00000100:00100000:3.0:1762166973.835388:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945d011e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+533:61819:x1847765450200448:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:3.0:1762166973.835443:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166973.835470:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472600/0x2f180c4effba8a8c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e909c expref: 533 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166973.835531:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166973.835535:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166973.835703:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472800/0x2f180c4effba8a93 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166973.835721:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472800/0x2f180c4effba8a93 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166973.835731:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472800/0x2f180c4effba8a93 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000001:00080000:3.0:1762166973.835783:0:6495:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294991561 00000004:00010000:3.0:1762166973.835804:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000004f5fb672 reply state 00000000339b713a transno 4294991562 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472800/0x2f180c4effba8a93 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166973.835816:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472800/0x2f180c4effba8a93 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166973.835822:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166973.835825:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1762166973.835827:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166973.835911:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945d011e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+535:61819:x1847765450200448:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 524us (855us total) trans 4294991562 rc 0/0 00000100:00100000:3.0:1762166973.835918:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30000 00000020:00080000:3.0:1762166973.835923:0:6495:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1762166973.842131:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450200960 00000100:00100000:3.0:1762166973.842137:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450200960 00000100:00100000:3.0:1762166973.842187:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30001 00000100:00100000:3.0:1762166973.842196:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc582d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+535:61819:x1847765450200960:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166973.842216:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166973.842235:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473c00/0x2f180c4effba8aa1 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e90aa expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166973.842326:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472a00/0x2f180c4effba8aa8 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166973.842340:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472a00/0x2f180c4effba8aa8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166973.842350:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472a00/0x2f180c4effba8aa8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:3.0:1762166973.842384:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 8192 00000004:00200000:3.0:1762166973.842388:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166973.842411:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472a00/0x2f180c4effba8aa8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166973.842437:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473c00/0x2f180c4effba8aa1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e90aa expref: 537 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166973.842455:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472a00/0x2f180c4effba8aa8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e90aa expref: 536 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166973.842463:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166973.842466:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166973.842470:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8472a00, rc 0) 00000100:00100000:3.0:1762166973.842545:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc582d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+536:61819:x1847765450200960:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 350us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166973.842554:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30001 00000100:00100000:3.0:1762166973.844373:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450201216 00000100:00100000:3.0:1762166973.844380:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450201216 00000100:00100000:3.0:1762166973.844422:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30002 00000100:00100000:3.0:1762166973.844460:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc582fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+536:61819:x1847765450201216:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:3.0:1762166973.844537:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166973.844565:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472a00/0x2f180c4effba8aa8 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e90aa expref: 536 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166973.844579:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166973.844583:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166973.864581:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450202752 00000100:00100000:3.0:1762166973.864589:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450202752 00002000:00010000:3.0:1762166973.864622:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2694 (8192->18446744073709551615) 00002000:00100000:3.0:1762166973.864627:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1ddc380 with x1847765450202752 ext(8192->18446744073709551615) 00002000:00010000:3.0:1762166973.864638:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945cf1ddc380. 00000100:00100000:3.0:1762166973.864669:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1695 00000100:00100000:3.0:1762166973.864682:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765450202752:12345-192.168.204.38@tcp:10:lfs.0 00000100:00100000:3.0:1762166973.880603:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.882342:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.899224:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.907939:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.910385:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.918606:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.926726:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.926772:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.930954:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.933396:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.935526:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450206080 00000100:00100000:3.0:1762166973.935532:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450206080 00002000:00010000:3.0:1762166973.935555:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2687 (0->18446744073709551615) 00002000:00100000:3.0:1762166973.935564:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc47b7100 with x1847765450206080 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166973.935578:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc47b7100. 00000100:00100000:3.0:1762166973.937529:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.939797:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.943031:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.943068:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.944914:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.948908:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.950592:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.950633:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.954585:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.956205:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.957805:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450208384 00000100:00100000:3.0:1762166973.957814:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450208384 00002000:00010000:3.0:1762166973.957844:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2693 (0->18446744073709551615) 00002000:00100000:3.0:1762166973.957851:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5589f80 with x1847765450208384 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166973.957862:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5589f80. 00000100:00100000:3.0:1762166973.957913:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1712 00000100:00100000:3.0:1762166973.957930:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5589f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+25:2418:x1847765450208384:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:3.0:1762166973.958131:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166973.958135:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb mtime from disk: 1762166974 -> 1762166974 00002000:00010000:3.0:1762166973.958139:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb atime from disk: 1762166973 -> 1762166973 00002000:00010000:3.0:1762166973.958142:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb ctime from disk: 1762166974 -> 1762166974 00002000:00010000:3.0:1762166973.958157:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166973.958243:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5589f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+26:2418:x1847765450208384:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 313us (492us total) trans 17179875967 rc 0/0 00000100:00100000:3.0:1762166973.958304:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1712 00002000:00010000:3.0:1762166973.958312:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2693 (0->18446744073709551615) 00002000:00100000:3.0:1762166973.958317:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5589f80 with x1847765450208384 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166973.958325:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5589f80. 00000100:00100000:3.0:1762166973.959425:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166973.961549:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450208640 00000100:00100000:3.0:1762166973.961560:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450208640 00000100:00100000:3.0:1762166973.961629:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1713 00000100:00100000:3.0:1762166973.961642:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5588380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+26:2418:x1847765450208640:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:3.0:1762166973.961678:0:23940:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effba8bab lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166973.961695:0:23940:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166973.961697:0:23940:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166973.961703:0:23940:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effba8bab lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [212992->217087] (req 212992->217087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166973.961716:0:23940:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effba8bab lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [212992->217087] (req 212992->217087) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166973.961835:0:23940:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effba8bab lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [212992->217087] (req 212992->217087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166973.961844:0:23940:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effba8bab lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [212992->217087] (req 212992->217087) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166973.961852:0:23940:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effba8bab lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [212992->217087] (req 212992->217087) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166973.961859:0:23940:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8473c00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166973.961864:0:23940:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effba8bab lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [212992->217087] (req 212992->217087) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166973.961874:0:23940:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effba8bab lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [212992->217087] (req 212992->217087) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166973.961901:0:23940:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effba8bab lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [212992->217087] (req 212992->217087) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166973.961908:0:23940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effba8bab lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [212992->217087] (req 212992->217087) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166973.961988:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5588380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+26:2418:x1847765450208640:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 351us (535us total) trans 0 rc 222/222 00000100:00100000:3.0:1762166973.961997:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1713 00000100:00100000:3.0:1762166973.963745:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450208768 00000100:00100000:3.0:1762166973.963753:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450208768 00000100:00100000:3.0:1762166973.963800:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1714 00000100:00100000:3.0:1762166973.963806:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765450208768:12345-192.168.204.38@tcp:4:lfs.0 00010000:00010000:3.0:1762166973.963834:0:23940:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc8472a00/0x2f180c4effba8bb2 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa7e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166973.963852:0:23940:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc5db8400/0x2f180c4effba8b26 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa7e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e90db expref: 26 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166973.963860:0:23940:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166973.963862:0:23940:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166973.963866:0:23940:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472a00/0x2f180c4effba8bb2 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0xa7e:0x0].0x0 rrc: 3 type: EXT [212992->217087] (req 212992->217087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166973.963901:0:23940:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc5db8400/0x2f180c4effba8b26 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa7e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e90db expref: 26 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166973.963919:0:23940:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc5db8400/0x2f180c4effba8b26 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa7e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e90db expref: 26 pid: 28874 timeout: 693 lvb_type: 0 00000100:00100000:3.0:1762166973.963933:0:23940:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7b20000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_007:lustre-OST0001_UUID:23940:1847765449645056:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166973.964046:0:23940:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1762166973.965086:0:23940:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7b20000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_007:lustre-OST0001_UUID:23940:1847765449645056:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166973.965186:0:23940:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc8472a00/0x2f180c4effba8bb2 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa7e:0x0].0x0 rrc: 3 type: EXT [212992->217087] (req 212992->217087) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166973.965656:0:23940:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc8472a00/0x2f180c4effba8bb2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa7e:0x0].0x0 rrc: 2 type: EXT [212992->217087] (req 212992->217087) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166973.965665:0:23940:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8472a00/0x2f180c4effba8bb2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa7e:0x0].0x0 rrc: 2 type: EXT [212992->217087] (req 212992->217087) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166973.967595:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa7e:0x0] updating lvb size from disk: 118784 -> 217088 00002000:00010000:3.0:1762166973.967603:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa7e:0x0] updating lvb blocks from disk: 80 -> 88 00010000:00010000:3.0:1762166973.967612:0:23940:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc8472a00/0x2f180c4effba8bb2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa7e:0x0].0x0 rrc: 2 type: EXT [212992->217087] (req 212992->217087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166973.967621:0:23940:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472a00/0x2f180c4effba8bb2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa7e:0x0].0x0 rrc: 2 type: EXT [212992->217087] (req 212992->217087) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166973.967630:0:23940:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc8472a00/0x2f180c4effba8bb2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa7e:0x0].0x0 rrc: 2 type: EXT [212992->217087] (req 212992->217087) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166973.967642:0:23940:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8472a00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166973.967646:0:23940:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8472a00/0x2f180c4effba8bb2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa7e:0x0].0x0 rrc: 2 type: EXT [212992->217087] (req 212992->217087) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166973.967655:0:23940:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8472a00/0x2f180c4effba8bb2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa7e:0x0].0x0 rrc: 2 type: EXT [212992->217087] (req 212992->217087) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166973.967674:0:23940:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc8472a00/0x2f180c4effba8bb2 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa7e:0x0].0x0 rrc: 2 type: EXT [212992->217087] (req 212992->217087) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166973.967681:0:23940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8472a00/0x2f180c4effba8bb2 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa7e:0x0].0x0 rrc: 2 type: EXT [212992->217087] (req 212992->217087) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166973.967748:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450208768:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 3940us (4086us total) trans 17179875968 rc 0/0 00000100:00100000:3.0:1762166973.967756:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1714 00000100:00100000:3.0:1762166973.969919:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450209024 00000100:00100000:3.0:1762166973.969927:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450209024 00000100:00100000:3.0:1762166973.970000:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1715 00000100:00100000:3.0:1762166973.970011:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5589c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+24:2418:x1847765450209024:12345-192.168.204.38@tcp:4:lfs.0 00010000:00010000:3.0:1762166973.970049:0:23940:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc8472600/0x2f180c4effba8bb9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa80:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166973.970067:0:23940:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945d02174400/0x2f180c4effba8b42 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa80:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e90e9 expref: 24 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166973.970081:0:23940:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166973.970083:0:23940:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166973.970087:0:23940:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8472600/0x2f180c4effba8bb9 lrc: 4/0,1 mode: --/PW res: [0x280000400:0xa80:0x0].0x0 rrc: 3 type: EXT [212992->217087] (req 212992->217087) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166973.970124:0:23940:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945d02174400/0x2f180c4effba8b42 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa80:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e90e9 expref: 24 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166973.970138:0:23940:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945d02174400/0x2f180c4effba8b42 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa80:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e90e9 expref: 24 pid: 35247 timeout: 693 lvb_type: 0 00000100:00100000:3.0:1762166973.970154:0:23940:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7b20000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_007:lustre-OST0000_UUID:23940:1847765449645184:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166973.970232:0:23940:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1762166973.971638:0:23940:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7b20000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_007:lustre-OST0000_UUID:23940:1847765449645184:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166973.971673:0:23940:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bc8472600/0x2f180c4effba8bb9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa80:0x0].0x0 rrc: 3 type: EXT [212992->217087] (req 212992->217087) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166974.004877:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00080000:3.0:1762166974.005011:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1762166974.006101:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.006138:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00080000:3.0:1762166974.006239:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1762166974.007811:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.010889:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.012147:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.012174:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.013773:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.016606:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.018032:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.018077:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.022654:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.028683:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.030653:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.033560:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.033600:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.036310:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.036538:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30025 00000100:00100000:3.0:1762166974.036555:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5807800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+571:61819:x1847765450213888:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:3.0:1762166974.036683:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473c00/0x2f180c4effba8c53 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 20 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166974.036707:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473c00/0x2f180c4effba8c53 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166974.036720:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473c00/0x2f180c4effba8c53 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00010000:3.0:1762166974.036836:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000006e67dbc0 reply state 00000000e5643929 transno 4294991587 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473c00/0x2f180c4effba8c53 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166974.036849:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473c00/0x2f180c4effba8c53 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166974.036857:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166974.036860:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1762166974.036864:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166974.036979:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5807800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+573:61819:x1847765450213888:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 430us (678us total) trans 4294991587 rc 0/0 00000100:00100000:3.0:1762166974.036988:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30025 00000100:00100000:3.0:1762166974.039918:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.041662:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.043173:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.046260:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.048552:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450214912 00000100:00100000:3.0:1762166974.048559:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450214912 00000100:00100000:3.0:1762166974.048606:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18511 00000100:00100000:3.0:1762166974.048619:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+28:2419:x1847765450214784:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:3.0:1762166974.048789:0:35247:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 213214 -> 213214 00002000:00010000:3.0:1762166974.048793:0:35247:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166973 -> 1762166973 00002000:00010000:3.0:1762166974.048796:0:35247:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166973 -> 1762166973 00002000:00010000:3.0:1762166974.048798:0:35247:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166973 -> 1762166974 00002000:00010000:3.0:1762166974.048801:0:35247:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 224 -> 224 00000100:00100000:3.0:1762166974.048850:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+29:2419:x1847765450214784:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 234us (435us total) trans 17179875975 rc 0/0 00000100:00100000:3.0:1762166974.049028:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18511 00000100:00100000:3.0:1762166974.054441:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5806d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449646592:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166974.054521:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5805f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449646976:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166974.054565:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166974.054598:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4491880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449647488:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166974.054669:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166974.054692:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5804380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449647104:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166974.054746:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449646720 00000100:00100000:3.0:1762166974.054757:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449646720 00000100:00100000:3.0:1762166974.054813:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449646976 00000100:00100000:3.0:1762166974.054819:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449646976 00000100:00100000:3.0:1762166974.054844:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449647232 00000100:00100000:3.0:1762166974.054849:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449647232 00000100:00100000:3.0:1762166974.054879:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449646592 00000100:00100000:3.0:1762166974.054885:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449646592 00000100:00100000:3.0:1762166974.054906:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449647744 00000100:00100000:3.0:1762166974.054911:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449647744 00000100:00100000:3.0:1762166974.054932:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449648256 00000100:00100000:3.0:1762166974.054936:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449648256 00000100:00100000:3.0:1762166974.054970:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449647616 00000100:00100000:3.0:1762166974.054975:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449647616 00000100:00100000:3.0:1762166974.055002:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18514 00000100:00100000:3.0:1762166974.055017:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+8:3636:x1847765449646720:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:3.0:1762166974.055195:0:9165:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166974.055204:0:9165:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166973 -> 1762166973 00002000:00010000:3.0:1762166974.055213:0:9165:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166973 -> 1762166973 00002000:00010000:3.0:1762166974.055221:0:9165:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166974 -> 1762166974 00002000:00010000:3.0:1762166974.055228:0:9165:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00000100:00100000:3.0:1762166974.055271:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+11:3636:x1847765449646720:12345-0@lo:2:osp-syn-0-1.0 Request processed in 258us (759us total) trans 21474843053 rc 0/0 00000100:00100000:3.0:1762166974.055288:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18514 00000100:00100000:3.0:1762166974.055315:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18517 00000100:00100000:3.0:1762166974.055329:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5807480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+9:3635:x1847765449646592:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:3.0:1762166974.055395:0:9165:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166974.055400:0:9165:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb mtime from disk: 1762166966 -> 1762166966 00002000:00010000:3.0:1762166974.055407:0:9165:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1762166974.055411:0:9165:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb ctime from disk: 1762166966 -> 1762166966 00002000:00010000:3.0:1762166974.055417:0:9165:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166974.055458:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5807480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+9:3635:x1847765449646592:12345-0@lo:2:osp-syn-0-1.0 Request processed in 131us (790us total) trans 21474843055 rc 0/0 00000100:00100000:3.0:1762166974.055502:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18517 00000100:00100000:3.0:1762166974.055525:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18520 00000100:00100000:3.0:1762166974.055538:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+10:3636:x1847765449647616:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:3.0:1762166974.055596:0:9165:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166974.055603:0:9165:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166973 -> 1762166973 00002000:00010000:3.0:1762166974.055611:0:9165:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166973 -> 1762166973 00002000:00010000:3.0:1762166974.055620:0:9165:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166974 -> 1762166974 00002000:00010000:3.0:1762166974.055627:0:9165:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166974.055659:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+10:3636:x1847765449647616:12345-0@lo:2:osp-syn-1-1.0 Request processed in 123us (811us total) trans 17179875979 rc 0/0 00000100:00100000:3.0:1762166974.055673:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18520 00000100:00100000:3.0:1762166974.055719:0:3636:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 17179875953 gen 2 00000004:00080000:3.0:1762166974.055728:0:3636:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 17179875928 committed transno 17179875953 00000004:00080000:3.0:1762166974.055754:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf1ddd180, transno 17179875929 00000004:00080000:3.0:1762166974.055776:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf1dde300, transno 17179875930 00000004:00080000:3.0:1762166974.055783:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf7838000, transno 17179875931 00000004:00080000:3.0:1762166974.055791:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf783b800, transno 17179875932 00000004:00080000:3.0:1762166974.055798:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf1ddc700, transno 17179875933 00000004:00080000:3.0:1762166974.055804:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf1dddc00, transno 17179875934 00000004:00080000:3.0:1762166974.055811:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf1dddf80, transno 17179875935 00000004:00080000:3.0:1762166974.055816:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc6227800, transno 17179875936 00000004:00080000:3.0:1762166974.055821:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf783a680, transno 17179875937 00000004:00080000:3.0:1762166974.055827:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf783a300, transno 17179875938 00000004:00080000:3.0:1762166974.055833:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc6224700, transno 17179875947 00000004:00080000:3.0:1762166974.055839:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc6224a80, transno 17179875948 00000004:00080000:3.0:1762166974.055845:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc6225880, transno 17179875949 00000004:00080000:3.0:1762166974.055851:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf783c700, transno 17179875950 00000004:00080000:3.0:1762166974.055858:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf79e9500, transno 17179875951 00000004:00080000:3.0:1762166974.055864:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf783ed80, transno 17179875952 00000004:00080000:3.0:1762166974.055869:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf783ce00, transno 17179875953 00000100:00100000:3.0:1762166974.055880:0:3636:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff945bc4492300 x1847765449647616/t17179875979(17179875979) o2->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 440/432 e 0 to 0 dl 1762166990 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1762166974.055904:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc4492300/2, rc 0, transno 17179875979 00000100:00100000:3.0:1762166974.055912:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4492300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449647616:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1762166974.055931:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc4490000/2, rc 0, transno 17179875980 00000100:00100000:3.0:1762166974.055935:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4490000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449648128:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1762166974.055955:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc4490380/2, rc 0, transno 17179875978 00000100:00100000:3.0:1762166974.055964:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4490380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449647744:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1762166974.055980:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc4490700/2, rc 0, transno 17179875977 00000100:00100000:3.0:1762166974.055985:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4490700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449648256:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166974.055999:0:3636:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 21474843026 gen 2 00000004:00080000:3.0:1762166974.056004:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf79eb100, transno 21474843005 00000004:00080000:3.0:1762166974.056016:0:3636:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 21474843008 committed transno 21474843026 00000004:00080000:3.0:1762166974.056034:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bcce74000, transno 21474843009 00000004:00080000:3.0:1762166974.056039:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bcce74380, transno 21474843010 00000004:00080000:3.0:1762166974.056043:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bcce74700, transno 21474843011 00000004:00080000:3.0:1762166974.056048:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bcce75500, transno 21474843012 00000004:00080000:3.0:1762166974.056054:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bcce76a00, transno 21474843013 00000004:00080000:3.0:1762166974.056058:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bcce77b80, transno 21474843014 00000004:00080000:3.0:1762166974.056061:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc6226680, transno 21474843015 00000004:00080000:3.0:1762166974.056066:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc6227b80, transno 21474843016 00000004:00080000:3.0:1762166974.056071:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bcce76300, transno 21474843017 00000004:00080000:3.0:1762166974.056074:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bcce74a80, transno 21474843018 00000004:00080000:3.0:1762166974.056078:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc4010e00, transno 21474843020 00000004:00080000:3.0:1762166974.056082:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc4011f80, transno 21474843021 00000004:00080000:3.0:1762166974.056086:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc5589880, transno 21474843022 00000004:00080000:3.0:1762166974.056091:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc4010a80, transno 21474843023 00000004:00080000:3.0:1762166974.056096:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc4011180, transno 21474843024 00000004:00080000:3.0:1762166974.056099:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc4012300, transno 21474843025 00000004:00080000:3.0:1762166974.056105:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc5589500, transno 21474843026 00000100:00100000:3.0:1762166974.056112:0:3636:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff945bc5806a00 x1847765449647232/t21474843054(21474843054) o2->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 440/432 e 0 to 0 dl 1762166990 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1762166974.056126:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc5806a00/2, rc 0, transno 21474843054 00000100:00100000:3.0:1762166974.056136:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5806a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449647232:0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1762166974.056155:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc5805500/2, rc 0, transno 21474843053 00000100:00100000:3.0:1762166974.056162:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5805500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449646720:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166974.056188:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1762166974.056223:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc5806d80/2, rc 0, transno 21474843055 00000100:00100000:3.0:1762166974.056232:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5806d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449646592:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166974.056267:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1762166974.056302:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc5805f80/2, rc 0, transno 21474843052 00000100:00100000:3.0:1762166974.056313:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5805f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449646976:0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1762166974.056506:0:9158:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0001: 0 changes, 7 in progress, 2 in flight, 18 done 00000004:00080000:3.0:1762166974.056562:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc5804380/2, rc 0, transno 21474843058 00000100:00100000:3.0:1762166974.056574:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5804380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449647104:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166974.059017:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450215552 00000100:00100000:3.0:1762166974.059028:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450215552 00000100:00100000:3.0:1762166974.059077:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30026 00000100:00100000:3.0:1762166974.059087:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4493800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+524:61819:x1847765450215552:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166974.059113:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166974.059134:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472600/0x2f180c4effba8c76 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9175 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.059207:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472600/0x2f180c4effba8c76 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9175 expref: 525 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.059224:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472600/0x2f180c4effba8c76 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9175 expref: 525 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.059246:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166974.059250:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166974.059254:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8472600, rc 0) 00000100:00100000:3.0:1762166974.059328:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4493800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+525:61819:x1847765450215552:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 242us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166974.059337:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30026 00000100:00100000:3.0:1762166974.071536:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450215936 00000100:00100000:3.0:1762166974.071551:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450215936 00000100:00100000:3.0:1762166974.071631:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30027 00000100:00100000:3.0:1762166974.071642:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+526:61820:x1847765450215936:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166974.071668:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166974.071694:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473600/0x2f180c4effba8c7d lrc: 2/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e917c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.071777:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472a00/0x2f180c4effba8c84 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166974.071791:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472a00/0x2f180c4effba8c84 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166974.071803:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472a00/0x2f180c4effba8c84 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166974.071815:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473c00/0x2f180c4effba8c8b lrc: 3/1,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166974.071822:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473c00/0x2f180c4effba8c8b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166974.071828:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473c00/0x2f180c4effba8c8b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166974.071927:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472800/0x2f180c4effba8c92 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166974.071935:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472800/0x2f180c4effba8c92 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166974.071956:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472800/0x2f180c4effba8c92 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:3.0:1762166974.072000:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 213214 00000004:00200000:3.0:1762166974.072004:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166974.072022:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472800/0x2f180c4effba8c92 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166974.072033:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472800/0x2f180c4effba8c92 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166974.072041:0:6494:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472a00/0x2f180c4effba8c84 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166974.072052:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472a00/0x2f180c4effba8c84 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166974.072067:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472a00/0x2f180c4effba8c84 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166974.072077:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472a00/0x2f180c4effba8c84 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166974.072083:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8472a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166974.072086:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472a00/0x2f180c4effba8c84 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166974.072093:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472a00/0x2f180c4effba8c84 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166974.072103:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0x0 (ffff945bc5841300) 00010000:00010000:3.0:1762166974.072107:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166974.072111:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472a00/0x2f180c4effba8c84 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166974.072117:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472a00/0x2f180c4effba8c84 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166974.072131:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473c00/0x2f180c4effba8c8b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166974.072136:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473c00/0x2f180c4effba8c8b lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166974.072142:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473c00/0x2f180c4effba8c8b lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166974.072146:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8473c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166974.072149:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473c00/0x2f180c4effba8c8b lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166974.072154:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473c00/0x2f180c4effba8c8b lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166974.072161:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0xdd396665 (ffff945bc5841a00) 00010000:00010000:3.0:1762166974.072163:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166974.072166:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473c00/0x2f180c4effba8c8b lrc: 2/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166974.072171:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473c00/0x2f180c4effba8c8b lrc: 0/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166974.072202:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473600/0x2f180c4effba8c7d lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e917c expref: 528 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.072216:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472800/0x2f180c4effba8c92 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e917c expref: 527 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.072223:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166974.072226:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166974.072228:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8472800, rc 0) 00000100:00100000:3.0:1762166974.072299:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+527:61820:x1847765450215936:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 658us (914us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166974.072307:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30027 00000100:00100000:3.0:1762166974.074044:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.075953:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450216448 00000100:00100000:3.0:1762166974.075963:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450216448 00000100:00100000:3.0:1762166974.076016:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30029 00000100:00100000:3.0:1762166974.076024:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+529:61820:x1847765450216448:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166974.076049:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166974.076069:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effba8cae lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e918a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.076155:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effba8cb5 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166974.076166:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effba8cb5 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166974.076173:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effba8cb5 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:3.0:1762166974.076182:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 213214 00010000:00010000:3.0:1762166974.076262:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effba8cae lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e918a expref: 532 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.076275:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effba8cb5 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e918a expref: 531 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.076281:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166974.076283:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166974.076285:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8472400, rc 0) 00000100:00100000:3.0:1762166974.076339:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+531:61820:x1847765450216448:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 316us (444us total) trans 4294991591 rc 0/0 00000100:00100000:3.0:1762166974.076345:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30029 00000100:00100000:3.0:1762166974.114524:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.116020:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.120596:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.127048:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.128970:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.133410:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.144510:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.148738:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450218624 00000100:00100000:3.0:1762166974.148747:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450218624 00000100:00100000:3.0:1762166974.148797:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30030 00000100:00100000:3.0:1762166974.148810:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4492680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+531:61766:x1847765450218624:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:3.0:1762166974.148833:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166974.148858:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945d02174e00/0x2f180c4effba8ced lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9191 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.148984:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effba8cf4 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166974.149002:0:6494:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472800/0x2f180c4effba8c92 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e917c expref: 532 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.149012:0:6494:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effba8cf4 lrc: 4/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166974.149053:0:6494:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472800/0x2f180c4effba8c92 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e917c expref: 532 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.149068:0:6494:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472800/0x2f180c4effba8c92 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e917c expref: 532 pid: 6494 timeout: 693 lvb_type: 0 00000100:00100000:3.0:1762166974.149086:0:6494:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5588700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765449649152:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166974.149179:0:6494:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402fe40 going to sleep for 11 seconds 00010000:00010000:3.0:1762166974.150812:0:6494:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effba8cf4 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166974.150820:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effba8cf4 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:3.0:1762166974.150839:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 213214 00010000:00010000:3.0:1762166974.151019:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945d02174e00/0x2f180c4effba8ced lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9191 expref: 533 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.151035:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effba8cf4 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9191 expref: 532 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.151044:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166974.151047:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1762166974.151049:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8472000, rc 0) 00000100:00100000:3.0:1762166974.151083:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4492680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+532:61766:x1847765450218624:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 2277us (2404us total) trans 4294991593 rc 0/0 00000100:00100000:3.0:1762166974.151092:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30030 00000100:00100000:3.0:1762166974.151921:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450218880 00000100:00100000:3.0:1762166974.151927:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450218880 00000100:00100000:3.0:1762166974.151967:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30031 00000100:00100000:3.0:1762166974.151976:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+532:61766:x1847765450218880:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:3.0:1762166974.151994:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166974.152006:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472a00/0x2f180c4effba8d02 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9198 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.152077:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473c00/0x2f180c4effba8d09 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166974.152088:0:6494:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effba8cf4 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9191 expref: 533 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.152097:0:6494:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473c00/0x2f180c4effba8d09 lrc: 4/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166974.152122:0:6494:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effba8cf4 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9191 expref: 533 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.152134:0:6494:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effba8cf4 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9191 expref: 533 pid: 6494 timeout: 693 lvb_type: 0 00000100:00100000:3.0:1762166974.152146:0:6494:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc558a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765449649280:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166974.152205:0:6494:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402f840 going to sleep for 11 seconds 00000100:00100000:3.0:1762166974.152864:0:6494:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc558a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765449649280:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166974.152877:0:6494:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473c00/0x2f180c4effba8d09 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166974.153273:0:6494:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473c00/0x2f180c4effba8d09 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166974.153279:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473c00/0x2f180c4effba8d09 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:3.0:1762166974.153306:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 213214 00000004:00200000:3.0:1762166974.153311:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166974.153324:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473c00/0x2f180c4effba8d09 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166974.153341:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472a00/0x2f180c4effba8d02 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9198 expref: 533 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.153357:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473c00/0x2f180c4effba8d09 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9198 expref: 532 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.153364:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166974.153368:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166974.153371:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8473c00, rc 0) 00000100:00100000:3.0:1762166974.153405:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+532:61766:x1847765450218880:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 1431us (1516us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166974.153412:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30031 00000100:00100000:3.0:1762166974.156710:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450219648 00000100:00100000:3.0:1762166974.156714:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450219648 00000100:00100000:3.0:1762166974.156743:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30032 00000100:00100000:3.0:1762166974.156751:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+533:61766:x1847765450219648:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:3.0:1762166974.156764:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166974.156767:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 1 00010000:00010000:3.0:1762166974.156791:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eefe00/0x2f180c4effba8ca0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9183 expref: 533 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.156810:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472600/0x2f180c4effba8c76 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9175 expref: 532 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.156823:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473c00/0x2f180c4effba8d09 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9198 expref: 531 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.156833:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166974.156837:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166974.156854:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473600/0x2f180c4effba8d17 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e91a6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.156891:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effba8d1e lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166974.156903:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effba8d1e lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166974.156912:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effba8d1e lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000040:00080000:3.0:1762166974.157193:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5809, 88 off454248 00000004:00080000:3.0:1762166974.157203:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 593305724655ns, next at 593210027671ns, rc = 0 00000040:00080000:3.0:1762166974.157241:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5808, 88 off454248 00000004:00080000:3.0:1762166974.157246:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 593305768642ns, next at 593210059859ns, rc = 0 00000040:00080000:3.0:1762166974.157277:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5809, 88 off454336 00000004:00080000:3.0:1762166974.157287:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 593305808915ns, next at 593210059859ns, rc = 0 00000040:00080000:3.0:1762166974.157299:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5810, 88 off454336 00000004:00080000:3.0:1762166974.157304:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 593305826342ns, next at 593210027671ns, rc = 0 00000040:00080000:3.0:1762166974.157323:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5811, 88 off454424 00000004:00080000:3.0:1762166974.157328:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 593305850100ns, next at 593210027671ns, rc = 0 00000040:00080000:3.0:1762166974.157341:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5810, 88 off454424 00000004:00080000:3.0:1762166974.157346:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 593305868100ns, next at 593210059859ns, rc = 0 00000040:00080000:3.0:1762166974.157357:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5811, 88 off454512 00000004:00080000:3.0:1762166974.157361:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 593305883505ns, next at 593210059859ns, rc = 0 00000040:00080000:3.0:1762166974.157374:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5812, 88 off454512 00000004:00080000:3.0:1762166974.157378:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 593305900008ns, next at 593210027671ns, rc = 0 00000040:00080000:3.0:1762166974.157396:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5812, 88 off454600 00000004:00080000:3.0:1762166974.157400:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 593305922441ns, next at 593210059859ns, rc = 0 00000040:00080000:3.0:1762166974.157419:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5813, 88 off454600 00000004:00080000:3.0:1762166974.157423:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 593305945441ns, next at 593210027671ns, rc = 0 00000040:00080000:3.0:1762166974.157438:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5814, 88 off454688 00000004:00080000:3.0:1762166974.157443:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 593305964981ns, next at 593210027671ns, rc = 0 00000040:00080000:3.0:1762166974.157455:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5813, 88 off454688 00000004:00080000:3.0:1762166974.157459:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 593305981208ns, next at 593210059859ns, rc = 0 00000040:00080000:3.0:1762166974.157505:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5814, 88 off454776 00000004:00080000:3.0:1762166974.157511:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 593306033228ns, next at 593210059859ns, rc = 0 00000040:00080000:3.0:1762166974.157529:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5815, 88 off454776 00000004:00080000:3.0:1762166974.157534:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 593306056581ns, next at 593210027671ns, rc = 0 00010000:00010000:3.0:1762166974.159017:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effba8d1e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e91a6 expref: 526 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.159042:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166974.159050:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1762166974.159073:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473600/0x2f180c4effba8d17 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e91a6 expref: 526 pid: 6494 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1762166974.159105:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effba8d1e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e91a6 expref: 525 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.159145:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166974.159151:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1762166974.159158:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8472400, rc 0) 00000100:00100000:3.0:1762166974.159231:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+525:61766:x1847765450219648:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 2478us (2551us total) trans 4294991595 rc 0/0 00000100:00100000:3.0:1762166974.159253:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30032 00000100:00100000:3.0:1762166974.159312:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc47b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449649664:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166974.159372:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166974.159452:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf7838000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449650176:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166974.159568:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166974.159665:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc6226680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449650688:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166974.159718:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166974.159804:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166974.159834:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7d21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449650304:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166974.159885:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166974.159903:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc6227b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449650944:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166974.160054:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166974.160113:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166974.160150:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7d20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449651072:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166974.160207:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1762166974.160272:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf783bb80/2, rc 0, transno 17179875985 00000100:00100000:3.0:1762166974.160292:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449649536:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1762166974.160330:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc47b5c00/2, rc 0, transno 21474843061 00000100:00100000:3.0:1762166974.160342:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc47b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449649920:0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1762166974.160392:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc47b4a80/2, rc 0, transno 21474843060 00000100:00100000:3.0:1762166974.160399:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc47b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449649664:0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1762166974.160426:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf7838000/2, rc 0, transno 17179875987 00000100:00100000:3.0:1762166974.160433:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf7838000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449650176:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1762166974.160457:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc6226680/2, rc 0, transno 17179875988 00000100:00100000:3.0:1762166974.160513:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc6226680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449650688:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1762166974.160567:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf783a680/2, rc 0, transno 17179875989 00000100:00100000:3.0:1762166974.160586:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449649792:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1762166974.160623:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc7d21500/2, rc 0, transno 21474843062 00000100:00100000:3.0:1762166974.160633:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7d21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449650304:0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1762166974.160651:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc6227b80/2, rc 0, transno 17179875990 00000100:00100000:3.0:1762166974.160658:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc6227b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449650944:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166974.160691:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1762166974.160758:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf783a300/2, rc 0, transno 17179875984 00000100:00100000:3.0:1762166974.160772:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449650048:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1762166974.160806:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf783b800/2, rc 0, transno 17179875986 00000100:00100000:3.0:1762166974.160814:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449650432:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1762166974.160837:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc47b7800/2, rc 0, transno 21474843059 00000100:00100000:3.0:1762166974.160843:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc47b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449649408:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166974.162781:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450219904 00000100:00100000:3.0:1762166974.162791:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450219904 00000100:00100000:3.0:1762166974.162848:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30033 00000100:00100000:3.0:1762166974.162858:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6225880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+525:61766:x1847765450219904:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:3.0:1762166974.162884:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166974.162902:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472a00/0x2f180c4effba8d2c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e91b4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.163028:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945d02174e00/0x2f180c4effba8d33 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166974.163052:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945d02174e00/0x2f180c4effba8d33 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166974.163064:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945d02174e00/0x2f180c4effba8d33 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:3.0:1762166974.163099:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 262145 00000004:00200000:3.0:1762166974.163104:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166974.163126:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945d02174e00/0x2f180c4effba8d33 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166974.163153:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472a00/0x2f180c4effba8d2c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e91b4 expref: 527 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.163170:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945d02174e00/0x2f180c4effba8d33 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e91b4 expref: 526 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.163179:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166974.163182:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166974.163185:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945d02174e00, rc 0) 00000100:00100000:3.0:1762166974.163247:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6225880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+526:61766:x1847765450219904:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 391us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166974.163254:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30033 00000100:00100000:3.0:1762166974.167505:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450220288 00000100:00100000:3.0:1762166974.167515:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450220288 00000100:00100000:3.0:1762166974.167579:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30034 00000100:00100000:3.0:1762166974.167591:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6225f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+526:61766:x1847765450220288:12345-192.168.204.38@tcp:36:fsx.0 00010000:00010000:3.0:1762166974.167648:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1762166974.167679:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effba8d1e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e91a6 expref: 526 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.167702:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945d02174e00/0x2f180c4effba8d33 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e91b4 expref: 525 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.167721:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166974.167726:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166974.167929:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945d02174400/0x2f180c4effba8d3a lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166974.167960:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945d02174400/0x2f180c4effba8d3a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166974.167972:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945d02174400/0x2f180c4effba8d3a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000001:00080000:3.0:1762166974.168020:0:6494:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294991596 00000004:00010000:3.0:1762166974.168043:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000e9794e7c reply state 000000000c4f30fe transno 4294991597 ns: mdt-lustre-MDT0001_UUID lock: ffff945d02174400/0x2f180c4effba8d3a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166974.168056:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945d02174400/0x2f180c4effba8d3a lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166974.168063:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166974.168066:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1762166974.168069:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166974.168160:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6225f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+527:61766:x1847765450220288:12345-192.168.204.38@tcp:36:fsx.0 Request processed in 572us (764us total) trans 4294991597 rc 0/0 00000100:00100000:3.0:1762166974.168169:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30034 00000020:00080000:3.0:1762166974.168175:0:6494:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1762166974.169170:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450220416 00000100:00100000:3.0:1762166974.169178:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450220416 00000100:00100000:3.0:1762166974.169216:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30035 00000100:00100000:3.0:1762166974.169226:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6226d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+527:61766:x1847765450220416:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:3.0:1762166974.169245:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166974.169257:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473600/0x2f180c4effba8d41 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e91bb expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.169292:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473600/0x2f180c4effba8d41 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e91bb expref: 528 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.169304:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473600/0x2f180c4effba8d41 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e91bb expref: 528 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.169323:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166974.169326:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166974.169329:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8473600, rc 0) 00000100:00100000:3.0:1762166974.169362:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6226d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+528:61766:x1847765450220416:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 139us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166974.169367:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30035 00000100:00100000:3.0:1762166974.171035:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450220800 00000100:00100000:3.0:1762166974.171042:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450220800 00002000:00010000:3.0:1762166974.171065:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:3.0:1762166974.171073:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc6224380 with x1847765450220800 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166974.171084:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc6224380. 00000100:00100000:3.0:1762166974.172728:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450220928 00000100:00100000:3.0:1762166974.172734:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450220928 00000100:00100000:3.0:1762166974.172772:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30036 00000100:00100000:3.0:1762166974.172780:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6224e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+528:61766:x1847765450220928:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:3.0:1762166974.172795:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166974.172811:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effba8d48 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e91c2 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.172890:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472a00/0x2f180c4effba8d4f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166974.172904:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472a00/0x2f180c4effba8d4f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166974.172914:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472a00/0x2f180c4effba8d4f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:3.0:1762166974.172952:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 204726 00000004:00200000:3.0:1762166974.172956:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166974.172973:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472a00/0x2f180c4effba8d4f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166974.172995:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effba8d48 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e91c2 expref: 530 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.173009:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472a00/0x2f180c4effba8d4f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e91c2 expref: 529 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.173018:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166974.173020:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166974.173023:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8472a00, rc 0) 00000100:00100000:3.0:1762166974.173058:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6224e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+529:61766:x1847765450220928:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 279us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166974.173065:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30036 00000100:00100000:3.0:1762166974.175546:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.182042:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.187343:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.192528:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.193993:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450222336 00000100:00100000:3.0:1762166974.193997:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450222336 00000100:00100000:3.0:1762166974.194020:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1746 00000100:00100000:3.0:1762166974.194028:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+35:2419:x1847765450222208:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:3.0:1762166974.194465:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 204726 -> 92846 00002000:00010000:3.0:1762166974.194470:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166974 -> 1762166974 00002000:00010000:3.0:1762166974.194473:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166973 -> 1762166973 00002000:00010000:3.0:1762166974.194505:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166974 -> 1762166974 00002000:00010000:3.0:1762166974.194508:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 336 -> 176 00000100:00100000:3.0:1762166974.194536:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+36:2419:x1847765450222208:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 509us (661us total) trans 17179875999 rc 0/0 00000100:00100000:3.0:1762166974.194546:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1746 00002000:00010000:3.0:1762166974.194550:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (92846->18446744073709551615) 00002000:00100000:3.0:1762166974.194553:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4a28e00 with x1847765450222208 ext(92846->18446744073709551615) 00002000:00010000:3.0:1762166974.194569:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4a28e00. 00000100:00100000:3.0:1762166974.199642:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+36:2418:x1847765450222720:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 924us (1092us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1762166974.199651:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1749 00002000:00100000:3.0:1762166974.199660:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (53248->90111) req@ffff945bc7d23480 x1847765450222720/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:5/0 lens 488/440 e 0 to 0 dl 1762166985 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166974.199670:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc7d23480 with x1847765450222720 ext(53248->90111) 00002000:00010000:3.0:1762166974.199674:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc7d23480 00000100:00100000:3.0:1762166974.203587:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450222848 00000100:00100000:3.0:1762166974.203594:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450222848 00002000:00100000:3.0:1762166974.203626:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (118784->166768) req@ffff945bc7d21180 x1847765450222848/t0(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:5/0 lens 488/0 e 0 to 0 dl 1762166985 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166974.203633:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc7d21180 with x1847765450222848 ext(118784->166768) 00002000:00010000:3.0:1762166974.203637:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc7d21180 00000100:00100000:3.0:1762166974.203662:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1750 00000100:00100000:3.0:1762166974.203672:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+36:2419:x1847765450222848:12345-192.168.204.38@tcp:4:fsx.0 00000100:00100000:3.0:1762166974.205092:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+38:2419:x1847765450222848:12345-192.168.204.38@tcp:4:fsx.0 Request processed in 1419us (1552us total) trans 17179876000 rc 0/0 00000100:00100000:3.0:1762166974.205102:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1750 00002000:00100000:3.0:1762166974.205110:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (118784->166768) req@ffff945bc7d21180 x1847765450222848/t17179876000(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:5/0 lens 488/448 e 0 to 0 dl 1762166985 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166974.205119:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc7d21180 with x1847765450222848 ext(118784->166768) 00002000:00010000:3.0:1762166974.205123:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc7d21180 00000100:00100000:3.0:1762166974.206042:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450222976 00000100:00100000:3.0:1762166974.206048:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450222976 00000100:00100000:3.0:1762166974.206090:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1751 00000100:00100000:3.0:1762166974.206100:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+38:2418:x1847765450222976:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:3.0:1762166974.206308:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 92846 -> 166769 00002000:00010000:3.0:1762166974.206312:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166974 -> 1762166974 00002000:00010000:3.0:1762166974.206314:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166973 -> 1762166974 00002000:00010000:3.0:1762166974.206316:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166974 -> 1762166974 00002000:00010000:3.0:1762166974.206319:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 176 -> 272 00000100:00100000:3.0:1762166974.206353:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+39:2418:x1847765450222976:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 254us (364us total) trans 17179876001 rc 0/0 00000100:00100000:3.0:1762166974.206364:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1751 00000100:00100000:3.0:1762166974.209453:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450223360 00000100:00100000:3.0:1762166974.209459:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450223360 00002000:00010000:3.0:1762166974.209507:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (170081->18446744073709551615) 00002000:00100000:3.0:1762166974.209512:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc7d21c00 with x1847765450223360 ext(170081->18446744073709551615) 00002000:00010000:3.0:1762166974.209521:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc7d21c00. 00000100:00100000:3.0:1762166974.209545:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1752 00000100:00100000:3.0:1762166974.209558:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+39:2419:x1847765450223360:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:3.0:1762166974.209737:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 166769 -> 170081 00002000:00010000:3.0:1762166974.209742:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166974 -> 1762166974 00002000:00010000:3.0:1762166974.209745:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166974 -> 1762166974 00002000:00010000:3.0:1762166974.209753:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166974 -> 1762166974 00002000:00010000:3.0:1762166974.209758:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 272 -> 272 00000100:00100000:3.0:1762166974.209794:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+42:2419:x1847765450223360:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 235us (363us total) trans 17179876002 rc 0/0 00000100:00100000:3.0:1762166974.209806:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1752 00002000:00010000:3.0:1762166974.209809:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (170081->18446744073709551615) 00002000:00100000:3.0:1762166974.209815:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc7d21c00 with x1847765450223360 ext(170081->18446744073709551615) 00002000:00010000:3.0:1762166974.209821:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc7d21c00. 00000100:00100000:3.0:1762166974.220598:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450224128 00000100:00100000:3.0:1762166974.220604:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450224128 00000100:00100000:3.0:1762166974.220648:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30040 00000100:00100000:3.0:1762166974.220656:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+534:61766:x1847765450224128:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:3.0:1762166974.220677:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166974.220693:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effba8d72 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e91d0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.220774:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effba8d79 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166974.220791:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effba8d79 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166974.220803:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effba8d79 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:3.0:1762166974.220831:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 170081 00000004:00200000:3.0:1762166974.220836:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166974.220851:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effba8d79 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166974.220873:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effba8d72 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e91d0 expref: 536 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.220883:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effba8d79 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e91d0 expref: 535 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.220888:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166974.220890:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166974.220892:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8472400, rc 0) 00000100:00100000:3.0:1762166974.220924:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+535:61766:x1847765450224128:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 269us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166974.220928:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30040 00000100:00100000:3.0:1762166974.226562:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450224640 00000100:00100000:3.0:1762166974.226568:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450224640 00000100:00100000:3.0:1762166974.226609:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30041 00000100:00100000:3.0:1762166974.226616:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+535:61766:x1847765450224640:12345-192.168.204.38@tcp:36:fsx.0 00010000:00010000:3.0:1762166974.226659:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166974.226688:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effba8d79 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e91d0 expref: 535 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.226703:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166974.226707:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166974.226845:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effba8d80 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166974.226860:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effba8d80 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166974.226869:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effba8d80 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000001:00080000:3.0:1762166974.226905:0:6494:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294991602 00000004:00010000:3.0:1762166974.226921:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000e3f3d709 reply state 000000001aaa9334 transno 4294991603 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effba8d80 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166974.226929:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effba8d80 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166974.226933:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166974.226935:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1762166974.226936:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166974.227003:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+537:61766:x1847765450224640:12345-192.168.204.38@tcp:36:fsx.0 Request processed in 389us (485us total) trans 4294991603 rc 0/0 00000100:00100000:3.0:1762166974.227008:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30041 00000020:00080000:3.0:1762166974.227011:0:6494:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1762166974.227988:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450224768 00000100:00100000:3.0:1762166974.227996:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450224768 00002000:00010000:3.0:1762166974.228016:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (262144->18446744073709551615) 00002000:00100000:3.0:1762166974.228022:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4a29180 with x1847765450224768 ext(262144->18446744073709551615) 00002000:00010000:3.0:1762166974.228031:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4a29180. 00000100:00100000:3.0:1762166974.228068:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1760 00000100:00100000:3.0:1762166974.228083:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450224768:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:3.0:1762166974.228206:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 170081 -> 262144 00002000:00010000:3.0:1762166974.228213:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166974 -> 1762166974 00002000:00010000:3.0:1762166974.228220:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166974 -> 1762166974 00002000:00010000:3.0:1762166974.228225:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166974 -> 1762166974 00002000:00010000:3.0:1762166974.228229:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 264 -> 264 00000100:00100000:3.0:1762166974.228267:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765450224768:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 187us (346us total) trans 17179876010 rc 0/0 00000100:00100000:3.0:1762166974.228278:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1760 00002000:00010000:3.0:1762166974.228282:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (262144->18446744073709551615) 00002000:00100000:3.0:1762166974.228285:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4a29180 with x1847765450224768 ext(262144->18446744073709551615) 00002000:00010000:3.0:1762166974.228291:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4a29180. 00000100:00100000:3.0:1762166974.229828:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450225152 00000100:00100000:3.0:1762166974.229834:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450225152 00002000:00100000:3.0:1762166974.229865:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (0->262143) req@ffff945bc7d20700 x1847765450225152/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:5/0 lens 536/0 e 0 to 0 dl 1762166985 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166974.229875:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc7d20700 with x1847765450225152 ext(0->262143) 00002000:00010000:3.0:1762166974.229879:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc7d20700 00000100:00100000:3.0:1762166974.229899:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1762 00000100:00100000:3.0:1762166974.229905:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+23:2417:x1847765450225152:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:3.0:1762166974.231390:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+23:2417:x1847765450225152:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 1473us (1589us total) trans 0 rc 147456/147456 00000100:00100000:3.0:1762166974.231404:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1762 00002000:00100000:3.0:1762166974.231419:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (0->262143) req@ffff945bc7d20700 x1847765450225152/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:5/0 lens 536/440 e 0 to 0 dl 1762166985 ref 1 fl Complete:/600/0 rc 147456/147456 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166974.231429:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc7d20700 with x1847765450225152 ext(0->262143) 00002000:00010000:3.0:1762166974.231436:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc7d20700 00000100:00100000:3.0:1762166974.233676:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450225280 00000100:00100000:3.0:1762166974.233687:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450225280 00002000:00100000:3.0:1762166974.233734:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (53248->262143) req@ffff945bc4a29500 x1847765450225280/t0(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:5/0 lens 504/0 e 0 to 0 dl 1762166985 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166974.233745:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4a29500 with x1847765450225280 ext(53248->262143) 00002000:00010000:3.0:1762166974.233750:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4a29500 00000100:00100000:3.0:1762166974.233781:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1763 00000100:00100000:3.0:1762166974.233793:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765450225280:12345-192.168.204.38@tcp:4:fsx.0 00000100:00100000:3.0:1762166974.235639:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+25:2419:x1847765450225280:12345-192.168.204.38@tcp:4:fsx.0 Request processed in 1841us (2008us total) trans 17179876011 rc 0/0 00000100:00100000:3.0:1762166974.235654:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1763 00002000:00100000:3.0:1762166974.235666:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (53248->262143) req@ffff945bc4a29500 x1847765450225280/t17179876011(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:5/0 lens 504/448 e 0 to 0 dl 1762166985 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166974.235677:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4a29500 with x1847765450225280 ext(53248->262143) 00002000:00010000:3.0:1762166974.235682:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4a29500 00000100:00100000:3.0:1762166974.239019:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450225536 00000100:00100000:3.0:1762166974.239027:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450225536 00000100:00100000:3.0:1762166974.239076:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30042 00000100:00100000:3.0:1762166974.239086:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+537:61766:x1847765450225536:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:3.0:1762166974.239110:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166974.239138:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effba8d87 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e91d7 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.239258:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472800/0x2f180c4effba8d8e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166974.239275:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472800/0x2f180c4effba8d8e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166974.239289:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472800/0x2f180c4effba8d8e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:3.0:1762166974.239321:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 262144 00000004:00200000:3.0:1762166974.239326:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166974.239344:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472800/0x2f180c4effba8d8e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166974.239374:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effba8d87 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e91d7 expref: 539 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.239389:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472800/0x2f180c4effba8d8e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e91d7 expref: 538 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.239396:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166974.239399:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166974.239401:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8472800, rc 0) 00000100:00100000:3.0:1762166974.239434:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+538:61766:x1847765450225536:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 350us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166974.239438:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30042 00000100:00100000:3.0:1762166974.241357:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450225792 00000100:00100000:3.0:1762166974.241364:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450225792 00000100:00100000:3.0:1762166974.243354:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450225920 00000100:00100000:3.0:1762166974.243364:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450225920 00002000:00010000:3.0:1762166974.243399:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (48219->18446744073709551615) 00002000:00100000:3.0:1762166974.243406:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc2d5ed80 with x1847765450225920 ext(48219->18446744073709551615) 00002000:00010000:3.0:1762166974.243418:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc2d5ed80. 00000100:00100000:3.0:1762166974.243515:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1765 00000100:00100000:3.0:1762166974.243528:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450226176:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:3.0:1762166974.243686:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166974.243692:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166974 -> 1762166974 00002000:00010000:3.0:1762166974.243700:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166973 -> 1762166973 00002000:00010000:3.0:1762166974.243706:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166974 -> 1762166974 00002000:00010000:3.0:1762166974.243712:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166974.243761:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450226176:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 233us (429us total) trans 17179876012 rc 0/0 00000100:00100000:3.0:1762166974.243787:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1765 00002000:00010000:3.0:1762166974.243793:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:3.0:1762166974.243798:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc2d5f480 with x1847765450226176 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166974.243804:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc2d5f480. 00000100:00100000:3.0:1762166974.247214:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.250662:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450226944 00000100:00100000:3.0:1762166974.250667:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450226944 00002000:00010000:3.0:1762166974.250687:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:3.0:1762166974.250692:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc2d5ce00 with x1847765450226944 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166974.250698:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc2d5ce00. 00000100:00100000:3.0:1762166974.250727:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1769 00000100:00100000:3.0:1762166974.250741:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+28:2419:x1847765450226944:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:3.0:1762166974.250877:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166974.250883:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166974 -> 1762166974 00002000:00010000:3.0:1762166974.250889:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166973 -> 1762166973 00002000:00010000:3.0:1762166974.250897:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166974 -> 1762166974 00002000:00010000:3.0:1762166974.250900:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00000100:00100000:3.0:1762166974.250954:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+29:2419:x1847765450226944:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 205us (329us total) trans 21474843071 rc 0/0 00000100:00100000:3.0:1762166974.250974:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1769 00002000:00010000:3.0:1762166974.250982:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:3.0:1762166974.250988:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc2d5ce00 with x1847765450226944 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166974.250995:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc2d5ce00. 00000100:00100000:3.0:1762166974.255950:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450227584 00000100:00100000:3.0:1762166974.255957:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450227584 00002000:00010000:3.0:1762166974.255979:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (10304->18446744073709551615) 00002000:00100000:3.0:1762166974.255985:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf79e8380 with x1847765450227584 ext(10304->18446744073709551615) 00002000:00010000:3.0:1762166974.255994:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf79e8380. 00000100:00100000:3.0:1762166974.256032:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1771 00000100:00100000:3.0:1762166974.256046:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+29:2418:x1847765450227712:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:3.0:1762166974.256177:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166974.256180:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166974 -> 1762166974 00002000:00010000:3.0:1762166974.256182:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166973 -> 1762166973 00002000:00010000:3.0:1762166974.256185:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166974 -> 1762166974 00002000:00010000:3.0:1762166974.256187:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00000100:00100000:3.0:1762166974.256229:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+30:2418:x1847765450227712:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 187us (388us total) trans 21474843072 rc 0/0 00000100:00100000:3.0:1762166974.256237:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1771 00002000:00010000:3.0:1762166974.256242:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:3.0:1762166974.256247:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf79ea300 with x1847765450227712 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166974.256253:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945cf79ea300. 00000100:00100000:3.0:1762166974.265599:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450228480 00000100:00100000:3.0:1762166974.265607:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450228480 00002000:00100000:3.0:1762166974.265650:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (4096->8191) req@ffff945bc2d5ea00 x1847765450228480/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:5/0 lens 488/0 e 0 to 0 dl 1762166985 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166974.265662:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc2d5ea00 with x1847765450228480 ext(4096->8191) 00002000:00010000:3.0:1762166974.265669:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc2d5ea00 00000100:00100000:3.0:1762166974.265696:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1777 00000100:00100000:3.0:1762166974.265706:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+29:2418:x1847765450228480:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:3.0:1762166974.265876:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+29:2418:x1847765450228480:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 171us (349us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1762166974.265885:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1777 00002000:00100000:3.0:1762166974.265893:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (4096->8191) req@ffff945bc2d5ea00 x1847765450228480/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:5/0 lens 488/4536 e 0 to 0 dl 1762166985 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166974.265902:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc2d5ea00 with x1847765450228480 ext(4096->8191) 00002000:00010000:3.0:1762166974.265906:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc2d5ea00 00000100:00100000:3.0:1762166974.270233:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450228992 00000100:00100000:3.0:1762166974.270240:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450228992 00002000:00010000:3.0:1762166974.270263:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:3.0:1762166974.270269:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1e6e680 with x1847765450228992 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166974.270278:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945cf1e6e680. 00000100:00100000:3.0:1762166974.270309:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1779 00000100:00100000:3.0:1762166974.270324:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+30:2418:x1847765450228992:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:3.0:1762166974.270450:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166974.270463:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166974 -> 1762166974 00002000:00010000:3.0:1762166974.270470:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166973 -> 1762166973 00002000:00010000:3.0:1762166974.270501:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166974 -> 1762166974 00002000:00010000:3.0:1762166974.270506:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00000100:00100000:3.0:1762166974.270554:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+31:2418:x1847765450228992:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 232us (411us total) trans 21474843073 rc 0/0 00000100:00100000:3.0:1762166974.270590:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1779 00002000:00010000:3.0:1762166974.270595:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:3.0:1762166974.270601:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1e6e680 with x1847765450228992 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166974.270611:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945cf1e6e680. 00000100:00100000:3.0:1762166974.289048:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.289096:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.289166:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1785 00000100:00100000:3.0:1762166974.289182:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+31:2417:x1847765450230272:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:3.0:1762166974.289284:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166974.289288:0:23939:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166974 -> 1762166974 00002000:00010000:3.0:1762166974.289292:0:23939:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166973 -> 1762166973 00002000:00010000:3.0:1762166974.289296:0:23939:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166974 -> 1762166974 00002000:00010000:3.0:1762166974.289298:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00000100:00100000:3.0:1762166974.289343:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+32:2417:x1847765450230272:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 167us (296us total) trans 21474843074 rc 0/0 00000100:00100000:3.0:1762166974.289359:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1785 00002000:00010000:3.0:1762166974.289361:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:3.0:1762166974.289364:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc55dc000 with x1847765450230272 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166974.289368:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc55dc000. 00000100:00100000:3.0:1762166974.290723:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:3.0:1762166974.291582:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166974.294151:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450231040 00000100:00100000:3.0:1762166974.294158:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450231040 00002000:00010000:3.0:1762166974.294180:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:3.0:1762166974.294189:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc406d180 with x1847765450231040 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166974.294201:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc406d180. 00000100:00100000:3.0:1762166974.294236:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1789 00000100:00100000:3.0:1762166974.294247:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+32:2419:x1847765450231040:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:3.0:1762166974.294335:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166974.294340:0:23939:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166974 -> 1762166974 00002000:00010000:3.0:1762166974.294343:0:23939:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166973 -> 1762166973 00002000:00010000:3.0:1762166974.294346:0:23939:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166974 -> 1762166974 00002000:00010000:3.0:1762166974.294353:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00000100:00100000:3.0:1762166974.294387:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+33:2419:x1847765450231040:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 139us (296us total) trans 21474843075 rc 0/0 00000100:00100000:3.0:1762166974.294401:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1789 00002000:00010000:3.0:1762166974.294407:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:3.0:1762166974.294413:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc406d180 with x1847765450231040 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166974.294420:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc406d180. 00000100:00100000:3.0:1762166974.298086:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.302469:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.308898:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.310502:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450232320 00000100:00100000:3.0:1762166974.310509:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450232320 00002000:00010000:3.0:1762166974.310532:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:3.0:1762166974.310538:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1ddd500 with x1847765450232320 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166974.310546:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945cf1ddd500. 00000100:00100000:3.0:1762166974.310590:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1795 00000100:00100000:3.0:1762166974.310605:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450232448:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:3.0:1762166974.310701:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166974.310705:0:23939:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166974 -> 1762166974 00002000:00010000:3.0:1762166974.310707:0:23939:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166973 -> 1762166973 00002000:00010000:3.0:1762166974.310710:0:23939:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166974 -> 1762166974 00002000:00010000:3.0:1762166974.310713:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166974.310747:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765450232448:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 143us (288us total) trans 17179876032 rc 0/0 00000100:00100000:3.0:1762166974.310759:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1795 00002000:00010000:3.0:1762166974.310766:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:3.0:1762166974.310773:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1ddd880 with x1847765450232448 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166974.310780:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1ddd880. 00000100:00100000:3.0:1762166974.324586:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.325979:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450233600 00000100:00100000:3.0:1762166974.325990:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450233600 00002000:00010000:3.0:1762166974.326029:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:3.0:1762166974.326036:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1ddd180 with x1847765450233600 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166974.326049:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945cf1ddd180. 00000100:00100000:3.0:1762166974.328685:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.330747:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.333653:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.342681:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.344758:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450234752 00000100:00100000:3.0:1762166974.344765:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450234752 00000100:00100000:3.0:1762166974.344813:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 844 00000100:00100000:3.0:1762166974.344822:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945d0207ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+565:2418:x1847765450234752:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166974.344834:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166974.344848:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b98a00/0x2f180c4effba8e52 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 18 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9216 expref: 565 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.344858:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166974.344861:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166974.344890:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945d0207ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+564:2418:x1847765450234752:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 71us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166974.344895:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 844 00000100:00100000:3.0:1762166974.345118:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.349750:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450235648 00000100:00100000:3.0:1762166974.349796:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450235648 00010000:00010000:3.0:1762166974.349836:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b98e00/0x2f180c4effba8e36 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 19 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e920f expref: 569 pid: 6495 timeout: 693 lvb_type: 0 00000100:00100000:3.0:1762166974.349869:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9372 00000100:00100000:3.0:1762166974.349878:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc70b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+569:2419:x1847765450235648:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166974.349891:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166974.349896:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b98e00/0x2f180c4effba8e36 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 20 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e920f expref: 569 pid: 6495 timeout: 693 lvb_type: 0 00010000:00010000:3.0:1762166974.349909:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b98e00/0x2f180c4effba8e36 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 20 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e920f expref: 569 pid: 6495 timeout: 693 lvb_type: 0 00010000:00010000:3.0:1762166974.349950:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b98e00/0x2f180c4effba8e36 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 20 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e920f expref: 569 pid: 6495 timeout: 693 lvb_type: 0 00010000:00010000:3.0:1762166974.349967:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166974.349972:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9a00/0x2f180c4effba8e7c lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 19 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166974.349983:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9a00/0x2f180c4effba8e7c lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 19 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166974.349990:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9a00/0x2f180c4effba8e7c lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 19 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166974.350017:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166974.350062:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc70b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+568:2419:x1847765450235648:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 184us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166974.350071:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9372 00000100:00100000:3.0:1762166974.352051:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.352983:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.355694:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.355753:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.357040:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.360840:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.362550:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.364142:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.365625:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.366372:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449651840 00000100:00100000:3.0:1762166974.366381:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449651840 00000100:00100000:3.0:1762166974.366428:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1238 00000100:00100000:3.0:1762166974.366439:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449651840:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166974.366580:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449651840:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 137us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166974.366591:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1238 00000100:00100000:3.0:1762166974.366822:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449651968 00000100:00100000:3.0:1762166974.366829:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449651968 00000100:00100000:3.0:1762166974.366865:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1239 00000100:00100000:3.0:1762166974.366879:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+19:19593:x1847765449651968:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166974.366968:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+19:19593:x1847765449651968:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 94us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166974.366978:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1239 00000100:00100000:3.0:1762166974.367119:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449652096 00000100:00100000:3.0:1762166974.367125:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449652096 00000100:00100000:3.0:1762166974.367158:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1240 00000100:00100000:3.0:1762166974.367165:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+19:19593:x1847765449652096:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166974.367238:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+19:19593:x1847765449652096:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 73us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166974.367245:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1240 00000100:00100000:3.0:1762166974.367427:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449652224 00000100:00100000:3.0:1762166974.367433:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449652224 00000100:00100000:3.0:1762166974.367473:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1241 00000100:00100000:3.0:1762166974.367522:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449652224:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166974.367602:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449652224:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 83us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166974.367609:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1241 00000100:00100000:3.0:1762166974.367690:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449652352 00000100:00100000:3.0:1762166974.367695:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449652352 00000100:00100000:3.0:1762166974.367723:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1242 00000100:00100000:3.0:1762166974.367731:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449652352:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166974.367789:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449652352:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 58us (121us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166974.367796:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1242 00000100:00100000:3.0:1762166974.367875:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449652480 00000100:00100000:3.0:1762166974.367880:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449652480 00000100:00100000:3.0:1762166974.367910:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1243 00000100:00100000:3.0:1762166974.367917:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+19:19593:x1847765449652480:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166974.367989:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+19:19593:x1847765449652480:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 73us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166974.367998:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1243 00000100:00100000:3.0:1762166974.368074:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449652608 00000100:00100000:3.0:1762166974.368080:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449652608 00000100:00100000:3.0:1762166974.368104:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1244 00000100:00100000:3.0:1762166974.368111:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+19:19593:x1847765449652608:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166974.368163:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+19:19593:x1847765449652608:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 52us (112us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166974.368170:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1244 00000100:00100000:3.0:1762166974.368260:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449652736 00000100:00100000:3.0:1762166974.368266:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449652736 00000100:00100000:3.0:1762166974.368290:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1245 00000100:00100000:3.0:1762166974.368296:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449652736:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166974.368359:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449652736:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 62us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166974.368367:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1245 00000100:00100000:3.0:1762166974.368504:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449652864 00000100:00100000:3.0:1762166974.368508:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449652864 00000100:00100000:3.0:1762166974.368535:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1246 00000100:00100000:3.0:1762166974.368543:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449652864:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166974.368598:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449652864:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 56us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166974.368605:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1246 00000100:00100000:3.0:1762166974.368694:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449652992 00000100:00100000:3.0:1762166974.368698:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449652992 00000100:00100000:3.0:1762166974.368722:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1247 00000100:00100000:3.0:1762166974.368728:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+19:19593:x1847765449652992:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166974.368796:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+19:19593:x1847765449652992:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 68us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166974.368803:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1247 00000100:00100000:3.0:1762166974.368886:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449653120 00000100:00100000:3.0:1762166974.368891:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449653120 00000100:00100000:3.0:1762166974.368916:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1248 00000100:00100000:3.0:1762166974.368923:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+19:19593:x1847765449653120:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166974.368984:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+19:19593:x1847765449653120:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 61us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166974.368992:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1248 00000100:00100000:3.0:1762166974.369064:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449653248 00000100:00100000:3.0:1762166974.369067:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449653248 00000100:00100000:3.0:1762166974.369090:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1249 00000100:00100000:3.0:1762166974.369094:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449653248:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166974.369128:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449653248:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 33us (86us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166974.369133:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1249 00000100:00100000:3.0:1762166974.371133:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.375246:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.385591:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.389468:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450238976 00000100:00100000:3.0:1762166974.389507:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450238976 00000100:00100000:3.0:1762166974.389561:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30068 00000100:00100000:3.0:1762166974.389571:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc70b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+577:61822:x1847765450238976:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166974.389591:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166974.389615:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effba8f0f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9255 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.389722:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472600/0x2f180c4effba8f16 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 17 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166974.389736:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472600/0x2f180c4effba8f16 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 17 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166974.389746:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472600/0x2f180c4effba8f16 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 17 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:3.0:1762166974.389757:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 108144 00010000:00010000:3.0:1762166974.389867:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effba8f0f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 17 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9255 expref: 580 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.389888:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472600/0x2f180c4effba8f16 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 16 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9255 expref: 579 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.389897:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166974.389900:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1762166974.389904:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8472600, rc 0) 00000100:00100000:3.0:1762166974.389985:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc70b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+579:61822:x1847765450238976:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 415us (614us total) trans 4294991636 rc 0/0 00000100:00100000:3.0:1762166974.389992:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30068 00000100:00100000:3.0:1762166974.392051:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450239232 00000100:00100000:3.0:1762166974.392058:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450239232 00000100:00100000:3.0:1762166974.392109:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30069 00000100:00100000:3.0:1762166974.392118:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc70b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+579:61822:x1847765450239232:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166974.392138:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166974.392221:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473c00/0x2f180c4effba8f24 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 17 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e925c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.392356:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473600/0x2f180c4effba8f2b lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 18 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166974.392374:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473600/0x2f180c4effba8f2b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 18 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166974.392384:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473600/0x2f180c4effba8f2b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 18 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:3.0:1762166974.392395:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 108144 00010000:00010000:3.0:1762166974.392511:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473c00/0x2f180c4effba8f24 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 18 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e925c expref: 582 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.392531:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473600/0x2f180c4effba8f2b lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 17 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e925c expref: 581 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.392539:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166974.392542:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166974.392545:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8473600, rc 0) 00000100:00100000:3.0:1762166974.392605:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc70b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+581:61822:x1847765450239232:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 488us (611us total) trans 4294991637 rc 0/0 00000100:00100000:3.0:1762166974.392612:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30069 00000100:00100000:3.0:1762166974.395069:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450239360 00000100:00100000:3.0:1762166974.395079:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450239360 00000100:00100000:3.0:1762166974.395247:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 845 00000100:00100000:3.0:1762166974.395258:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+581:61822:x1847765450239360:12345-192.168.204.38@tcp:103:lfs.0 00010000:00010000:3.0:1762166974.395273:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166974.395293:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473600/0x2f180c4effba8f2b lrc: 0/0,0 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 18 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e925c expref: 581 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.395311:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166974.395315:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166974.395366:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+580:61822:x1847765450239360:12345-192.168.204.38@tcp:103:lfs.0 Request processed in 110us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166974.395375:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 845 00000100:00100000:3.0:1762166974.400141:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450239872 00000100:00100000:3.0:1762166974.400150:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450239872 00000100:00100000:3.0:1762166974.400207:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30070 00000100:00100000:3.0:1762166974.400217:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+581:61766:x1847765450239872:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:3.0:1762166974.400241:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166974.400259:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effba8f39 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 17 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9263 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.400377:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472c00/0x2f180c4effba8f40 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 18 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166974.400395:0:6494:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effba8f08 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 18 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e924e expref: 582 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.400406:0:6494:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472c00/0x2f180c4effba8f40 lrc: 4/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 18 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166974.400447:0:6494:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effba8f08 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 18 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e924e expref: 582 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.400469:0:6494:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effba8f08 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 18 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e924e expref: 582 pid: 6495 timeout: 693 lvb_type: 0 00000100:00100000:3.0:1762166974.400509:0:6494:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc48abb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765449653632:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166974.400601:0:6494:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402f240 going to sleep for 11 seconds 00000100:00100000:3.0:1762166974.401859:0:6494:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc48abb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765449653632:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166974.401964:0:6494:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472c00/0x2f180c4effba8f40 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 18 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000100:00100000:3.0:1762166974.402168:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450240000 00000100:00100000:3.0:1762166974.402176:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450240000 00010000:00010000:3.0:1762166974.402209:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effba8f08 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 18 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e924e expref: 583 pid: 6495 timeout: 693 lvb_type: 0 00000100:00100000:3.0:1762166974.402252:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9377 00000100:00100000:3.0:1762166974.402262:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945d0207f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+583:2418:x1847765450240000:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166974.402277:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166974.402285:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effba8f08 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 19 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e924e expref: 583 pid: 6495 timeout: 693 lvb_type: 0 00010000:00010000:3.0:1762166974.402299:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effba8f08 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 19 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e924e expref: 583 pid: 6495 timeout: 693 lvb_type: 0 00010000:00010000:3.0:1762166974.402324:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effba8f08 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 19 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e924e expref: 583 pid: 6495 timeout: 693 lvb_type: 0 00010000:00010000:3.0:1762166974.402342:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166974.402346:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472c00/0x2f180c4effba8f40 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 18 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166974.402358:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472c00/0x2f180c4effba8f40 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 18 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166974.402365:0:6479:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472c00/0x2f180c4effba8f40 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 18 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166974.402393:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166974.402450:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945d0207f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+582:2418:x1847765450240000:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 188us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166974.402469:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9377 00000100:00100000:3.0:1762166974.406178:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450240256 00000100:00100000:3.0:1762166974.406187:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450240256 00010000:00010000:3.0:1762166974.406267:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472c00/0x2f180c4effba8f40 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 18 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9263 expref: 584 pid: 6494 timeout: 693 lvb_type: 0 00000100:00100000:3.0:1762166974.406306:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9378 00000100:00100000:3.0:1762166974.406313:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+584:2418:x1847765450240256:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166974.406325:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166974.406332:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472c00/0x2f180c4effba8f40 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 19 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9263 expref: 584 pid: 6494 timeout: 693 lvb_type: 0 00010000:00010000:3.0:1762166974.406350:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472c00/0x2f180c4effba8f40 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 19 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9263 expref: 584 pid: 6494 timeout: 693 lvb_type: 0 00010000:00010000:3.0:1762166974.406373:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472c00/0x2f180c4effba8f40 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 19 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9263 expref: 584 pid: 6494 timeout: 693 lvb_type: 0 00010000:00010000:3.0:1762166974.406389:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166974.406394:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eee000/0x2f180c4effba8f55 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 18 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166974.406403:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eee000/0x2f180c4effba8f55 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 18 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166974.406411:0:6479:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eee000/0x2f180c4effba8f55 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 18 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166974.406444:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166974.406538:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+583:2418:x1847765450240256:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 220us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166974.406549:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9378 00000100:00100000:3.0:1762166974.422966:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.423048:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.423084:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.432987:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.438659:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.441904:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.448638:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.452401:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.463788:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.463827:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.466206:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.468261:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.470140:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.471308:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.472642:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.474205:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.475929:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.476245:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450244608 00000100:00100000:3.0:1762166974.476254:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450244608 00010000:00010000:3.0:1762166974.476298:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8200/0x2f180c4effba8ee5 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 17 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9247 expref: 591 pid: 6495 timeout: 693 lvb_type: 0 00000100:00100000:3.0:1762166974.477959:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450244736 00000100:00100000:3.0:1762166974.477965:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450244736 00000100:00100000:3.0:1762166974.478015:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30078 00000100:00100000:3.0:1762166974.478023:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945d011e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+589:61823:x1847765450244736:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166974.478041:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166974.478057:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473c00/0x2f180c4effba8fd3 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 15 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9294 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.478109:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473c00/0x2f180c4effba8fd3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 15 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9294 expref: 590 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.478123:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473c00/0x2f180c4effba8fd3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 15 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9294 expref: 590 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.478141:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166974.478144:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166974.478147:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8473c00, rc 0) 00000100:00100000:3.0:1762166974.478193:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945d011e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+590:61823:x1847765450244736:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 171us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166974.478200:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30078 00000100:00100000:3.0:1762166974.479673:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.483627:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.485087:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.486383:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.490403:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449655936 00000100:00100000:3.0:1762166974.490410:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449655936 00000100:00100000:3.0:1762166974.490446:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1263 00000100:00100000:3.0:1762166974.490454:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6dbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+20:19593:x1847765449655936:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166974.490608:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6dbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+21:19593:x1847765449655936:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 154us (303us total) trans 21474843080 rc 0/0 00000100:00100000:3.0:1762166974.490616:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1263 00000100:00100000:3.0:1762166974.492570:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.494460:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:3.0:1762166974.495201:0:7420:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1762166974.495211:0:7420:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8400/0x2f180c4effba9019 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x603:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166974.495221:0:7420:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc5db8400 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166974.495227:0:7420:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8400/0x2f180c4effba9019 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x603:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166974.495236:0:7420:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8400/0x2f180c4effba9019 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x603:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166974.495252:0:7420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x603:0x0].0x0 (ffff945bc809b100) 00010000:00010000:3.0:1762166974.495256:0:7420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1762166974.495261:0:7420:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8400/0x2f180c4effba9019 lrc: 1/0,0 mode: --/PW res: [0x240000404:0x603:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166974.495266:0:7420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8400/0x2f180c4effba9019 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x603:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166974.495288:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166974.495290:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166974.495293:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166974.496470:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.506269:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.509833:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.512554:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.515086:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.516210:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.518996:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.520774:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.522674:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.523912:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.526446:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.528613:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.531209:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.534314:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.538117:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.541719:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.551622:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.559302:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.569197:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.572146:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.572454:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.575371:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.577063:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.579053:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.581016:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.583068:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.583101:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.585114:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.588408:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.588442:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.589610:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.591334:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.591369:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.592364:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.595349:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18556 00000100:00100000:3.0:1762166974.595364:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6db8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+19:2417:x1847765450252288:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166974.595381:0:9168:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166974.595400:0:9168:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8472800/0x2f180c4effba912a lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e930b expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166974.595424:0:9168:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa77:0x0] initial LVB size: 193897, mtime: 0x690888be, atime: 0x690888be, ctime: 0x690888be, blocks: 0x140 00010000:00010000:3.0:1762166974.595449:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166974.595453:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166974.595465:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472800/0x2f180c4effba912a lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e930b expref: 21 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166974.595512:0:9168:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc8472800/0x2f180c4effba912a lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e930b expref: 21 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166974.595545:0:9168:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8472800, rc 0) 00000100:00100000:3.0:1762166974.595601:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6db8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+21:2417:x1847765450252288:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 238us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166974.595620:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18556 00000100:00100000:3.0:1762166974.620878:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.625716:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.630462:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.633889:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.634024:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.637611:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450254208 00000100:00100000:3.0:1762166974.637617:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450254208 00000100:00100000:3.0:1762166974.637651:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18563 00000100:00100000:3.0:1762166974.637659:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450254208:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:3.0:1762166974.637728:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450254208:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 69us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166974.637735:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18563 00000100:00100000:3.0:1762166974.639036:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.648876:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.650647:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450254848 00000100:00100000:3.0:1762166974.650653:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450254848 00000100:00100000:3.0:1762166974.661030:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450255232 00000100:00100000:3.0:1762166974.661037:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450255232 00000100:00100000:3.0:1762166974.661078:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18566 00000100:00100000:3.0:1762166974.661085:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6db8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+19:2417:x1847765450255232:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:3.0:1762166974.661171:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6db8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+19:2417:x1847765450255232:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 86us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166974.661180:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18566 00000100:00100000:3.0:1762166974.662645:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450255360 00000100:00100000:3.0:1762166974.662654:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450255360 00000100:00100000:3.0:1762166974.662702:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18567 00000100:00100000:3.0:1762166974.662710:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6224700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+19:2417:x1847765450255360:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:3.0:1762166974.662826:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6224700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+19:2417:x1847765450255360:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 116us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166974.662834:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18567 00000100:00100000:3.0:1762166974.668611:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450255744 00000100:00100000:3.0:1762166974.668627:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450255744 00000100:00100000:3.0:1762166974.668684:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18568 00000100:00100000:3.0:1762166974.668693:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4493480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+19:2416:x1847765450255744:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:3.0:1762166974.668827:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4493480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+19:2416:x1847765450255744:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 136us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166974.668833:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18568 00000100:00100000:3.0:1762166974.669920:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450255872 00000100:00100000:3.0:1762166974.669925:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450255872 00000100:00100000:3.0:1762166974.669969:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18569 00000100:00100000:3.0:1762166974.669978:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4492a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+19:2417:x1847765450255872:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:3.0:1762166974.670039:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4492a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+19:2417:x1847765450255872:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 64us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166974.670044:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18569 00000020:00080000:3.0:1762166974.679812:0:7435:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 37 00000100:00100000:3.0:1762166974.679974:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bccb7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449657600:0@lo:6:osp-syn-0-1.0 00000020:00080000:3.0:1762166974.680054:0:7435:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 39 committed batchid 37 00000020:00080000:3.0:1762166974.680106:0:7435:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 37 00000100:00100000:3.0:1762166974.680127:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166974.680176:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449657600 00000100:00100000:3.0:1762166974.680183:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449657600 00000100:00100000:3.0:1762166974.680231:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18571 00000100:00100000:3.0:1762166974.680247:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+21:3635:x1847765449657600:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1762166974.680322:0:8380:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:2688 count 1 00002000:00010000:3.0:1762166974.680348:0:8380:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa80:0x0] initial LVB size: 213214, mtime: 0x690888be, atime: 0x690888b9, ctime: 0x690888be, blocks: 0x58 00010000:00010000:3.0:1762166974.680358:0:8380:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effba91a8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa80:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.680380:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166974.680384:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166974.680391:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effba91a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.680409:0:8380:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effba91a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.680442:0:8380:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effba91a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.680458:0:8380:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effba91a8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.680497:0:8380:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1762166974.681050:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+22:3635:x1847765449657600:12345-0@lo:6:osp-syn-0-1.0 Request processed in 808us (925us total) trans 21474843082 rc 0/0 00000100:00100000:3.0:1762166974.681058:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18571 00000100:00100000:3.0:1762166974.681359:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450256512 00000100:00100000:3.0:1762166974.681365:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450256512 00000100:00100000:3.0:1762166974.681402:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18573 00000100:00100000:3.0:1762166974.681417:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4493100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+38:2418:x1847765450256512:12345-192.168.204.38@tcp:16:lfs.0 00010000:00010000:3.0:1762166974.681960:0:10256:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1762166974.681967:0:10256:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc42f6200/0x2f180c4effba91a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.681977:0:10256:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc42f6200 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166974.681981:0:10256:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc42f6200/0x2f180c4effba91a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.681989:0:10256:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc42f6200/0x2f180c4effba91a1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.682001:0:10256:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc42f6200/0x2f180c4effba91a1 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xa7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.682008:0:10256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc42f6200/0x2f180c4effba91a1 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.682024:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166974.682027:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166974.682030:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166974.691864:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.691893:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.698138:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.699825:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.699871:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.700761:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000004:00080000:3.0:1762166974.703213:0:9158:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0001: 1 changes, 3 in progress, 0 in flight, 12 done 00000004:00080000:3.0:1762166974.703248:0:9158:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0001: 1 changes, 0 in progress, 0 in flight, 3 done 00000100:00100000:3.0:1762166974.708349:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.709386:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:3.0:1762166974.709764:0:6482:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1762166974.709772:0:6482:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9a00/0x2f180c4effba91ee lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x604:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166974.709780:0:6482:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc5db9a00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166974.709785:0:6482:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9a00/0x2f180c4effba91ee lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x604:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166974.709791:0:6482:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9a00/0x2f180c4effba91ee lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x604:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166974.709800:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x604:0x0].0x0 (ffff945bc812e000) 00010000:00010000:3.0:1762166974.709802:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1762166974.709805:0:6482:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9a00/0x2f180c4effba91ee lrc: 1/0,0 mode: --/PW res: [0x240000404:0x604:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166974.709809:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9a00/0x2f180c4effba91ee lrc: 0/0,0 mode: --/PW res: [0x240000404:0x604:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166974.709819:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166974.709821:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166974.709823:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166974.720843:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.722811:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.762806:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.785888:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.790581:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.798043:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.801467:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bccb7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449661312:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1762166974.801580:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166974.801628:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc558b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449661824:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166974.801695:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166974.801733:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc6db9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449662336:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166974.801793:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18588 00000100:00100000:3.0:1762166974.801805:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5804700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3635:x1847765449661312:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1762166974.801827:0:8380:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:2687 count 1 00010000:00010000:3.0:1762166974.801854:0:8380:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc8472c00/0x2f180c4effba929d lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa7f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.801889:0:8380:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc8473a00/0x2f180c4effba6af0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e84e1 expref: 19 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.801919:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166974.801939:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166974.801945:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8472c00/0x2f180c4effba929d lrc: 4/0,1 mode: --/PW res: [0x280000400:0xa7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.801994:0:8380:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc8473a00/0x2f180c4effba6af0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e84e1 expref: 19 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.802052:0:8380:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc8473a00/0x2f180c4effba6af0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e84e1 expref: 19 pid: 8380 timeout: 693 lvb_type: 0 00000100:00100000:3.0:1762166974.802103:0:8380:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc47b7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8380:1847765449662976:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166974.802184:0:8380:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402f600 going to sleep for 11 seconds 00000100:00100000:3.0:1762166974.802213:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449662720 00000100:00100000:3.0:1762166974.802221:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449662720 00000100:00100000:3.0:1762166974.802266:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18591 00000100:00100000:3.0:1762166974.802281:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6db8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+12:3633:x1847765449662080:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:3.0:1762166974.802375:0:9165:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa81:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166974.802380:0:9165:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa81:0x0] updating lvb mtime from disk: 1762166974 -> 1762166974 00002000:00010000:3.0:1762166974.802384:0:9165:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa81:0x0] updating lvb atime from disk: 1762166970 -> 1762166970 00002000:00010000:3.0:1762166974.802387:0:9165:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa81:0x0] updating lvb ctime from disk: 1762166974 -> 1762166974 00002000:00010000:3.0:1762166974.802390:0:9165:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa81:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166974.802453:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6db8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+14:3633:x1847765449662080:12345-0@lo:2:osp-syn-1-1.0 Request processed in 176us (703us total) trans 17179876062 rc 0/0 00000100:00100000:3.0:1762166974.802466:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18591 00000100:00100000:3.0:1762166974.802567:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166974.802611:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc6dbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449662848:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166974.802663:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1762166974.802706:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc558b100/2, rc 0, transno 17179876061 00000100:00100000:3.0:1762166974.802715:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc558b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449661824:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166974.802733:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1762166974.802746:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5805180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449661440:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166974.802835:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166974.802865:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5805500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449661952:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166974.802906:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166974.802945:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5806d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449662464:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166974.802985:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1762166974.803024:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc6db9180/2, rc 0, transno 17179876063 00000100:00100000:3.0:1762166974.803035:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc6db9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449662336:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1762166974.803071:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc6dbb800/2, rc 0, transno 17179876064 00000100:00100000:3.0:1762166974.803082:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc6dbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449662848:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1762166974.803109:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc5805180/2, rc 0, transno 21474843088 00000100:00100000:3.0:1762166974.803117:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5805180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449661440:0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1762166974.803227:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc5806a00/2, rc 0, transno 21474843086 00000100:00100000:3.0:1762166974.803240:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5806a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449662208:0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1762166974.803263:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc5805880/2, rc 0, transno 21474843087 00000100:00100000:3.0:1762166974.803274:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5805880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449662720:0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1762166974.803307:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc5589180/2, rc 0, transno 17179876062 00000100:00100000:3.0:1762166974.803313:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5589180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449662080:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1762166974.803592:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc6dba680/2, rc 0, transno 17179876065 00000100:00100000:3.0:1762166974.803609:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc6dba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449662592:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166974.804538:0:8380:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc47b7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8380:1847765449662976:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166974.804565:0:8380:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bc8472c00/0x2f180c4effba929d lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa7f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.804886:0:8380:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bc8472c00/0x2f180c4effba929d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.804902:0:8380:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc8472c00/0x2f180c4effba929d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.804911:0:8380:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc8472c00/0x2f180c4effba929d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.804919:0:8380:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8472c00/0x2f180c4effba929d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.804957:0:8380:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1762166974.805280:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5804700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+13:3635:x1847765449661312:12345-0@lo:6:osp-syn-0-1.0 Request processed in 3477us (3701us total) trans 21474843092 rc 0/0 00000100:00100000:3.0:1762166974.805289:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18588 00000100:00100000:3.0:1762166974.806343:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450263936 00000100:00100000:3.0:1762166974.806350:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450263936 00010000:00010000:3.0:1762166974.806371:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472800/0x2f180c4effba912a lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e930b expref: 23 pid: 9168 timeout: 693 lvb_type: 1 00000100:00100000:3.0:1762166974.806404:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9402 00000100:00100000:3.0:1762166974.806412:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765450263936:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166974.806423:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166974.806439:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc8472800/0x2f180c4effba912a lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e930b expref: 23 pid: 9168 timeout: 693 lvb_type: 1 00010000:00010000:3.0:1762166974.806451:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc8472800/0x2f180c4effba912a lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e930b expref: 23 pid: 9168 timeout: 693 lvb_type: 1 00010000:00010000:3.0:1762166974.806468:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8472800/0x2f180c4effba912a lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e930b expref: 23 pid: 9168 timeout: 693 lvb_type: 1 00010000:00010000:3.0:1762166974.806500:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166974.806502:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166974.806507:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1a00/0x2f180c4effba92ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 172032->233471) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9390 expref: 22 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.806513:0:6479:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1a00/0x2f180c4effba92ab lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 172032->233471) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9390 expref: 22 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.806531:0:6479:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff945bc95c1a00/0x2f180c4effba92ab lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 172032->233471) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9390 expref: 22 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166974.806537:0:6479:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcceb5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6479:1847765449663232:192.168.204.38@tcp:105: 00000100:00100000:3.0:1762166974.806573:0:6479:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402f600 going to sleep for 11 seconds 00000100:00100000:3.0:1762166974.807424:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.810619:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.813176:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.817450:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.822722:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.825907:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.829043:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.830120:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.831635:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.832889:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.835835:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1841 00000100:00100000:3.0:1762166974.835852:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+27:2418:x1847765450265984:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:3.0:1762166974.836169:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 231804 -> 247907 00002000:00010000:3.0:1762166974.836176:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166974.836182:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166974.836189:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166974.836193:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 440 -> 440 00000100:00100000:3.0:1762166974.836251:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+30:2418:x1847765450265984:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 397us (655us total) trans 17179876070 rc 0/0 00000100:00100000:3.0:1762166974.836279:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1841 00002000:00010000:3.0:1762166974.836285:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (247907->18446744073709551615) 00002000:00100000:3.0:1762166974.836292:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5bb9880 with x1847765450265984 ext(247907->18446744073709551615) 00002000:00010000:3.0:1762166974.836304:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5bb9880. 00000100:00100000:3.0:1762166974.837304:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.843663:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166974.854124:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6dbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+532:61828:x1847765450267008:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 846us (1077us total) trans 4294991686 rc 0/0 00000100:00100000:0.0:1762166974.854131:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30112 00000100:00100000:0.0:1762166974.855453:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166974.855975:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450267392 00000100:00100000:0.0:1762166974.855982:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450267392 00000100:00100000:0.0:1762166974.856026:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11761 00000100:00100000:0.0:1762166974.856035:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6db9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+531:61828:x1847765450267392:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166974.856223:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6db9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+532:61828:x1847765450267392:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 188us (311us total) trans 4294991687 rc 0/0 00000100:00100000:0.0:1762166974.856231:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11761 00000100:00100000:0.0:1762166974.857255:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450267648 00000100:00100000:0.0:1762166974.857260:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450267648 00000100:00100000:0.0:1762166974.857293:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30113 00000100:00100000:0.0:1762166974.857300:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6dbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+532:61828:x1847765450267648:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166974.857312:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166974.857331:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effba931b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e93c8 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166974.857416:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effba9322 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166974.857431:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effba9322 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166974.857442:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effba9322 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:0.0:1762166974.857454:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 247907 00010000:00010000:0.0:1762166974.857548:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effba931b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e93c8 expref: 535 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166974.857566:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effba9322 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e93c8 expref: 534 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166974.857576:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166974.857579:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1762166974.857582:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdec00, rc 0) 00000100:00100000:0.0:1762166974.857621:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6dbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+534:61828:x1847765450267648:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 321us (414us total) trans 4294991688 rc 0/0 00000100:00100000:0.0:1762166974.857629:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30113 00000100:00100000:3.0:1762166974.859265:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166974.859318:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450267904 00000100:00100000:0.0:1762166974.859325:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450267904 00000100:00100000:0.0:1762166974.859365:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30114 00000100:00100000:0.0:1762166974.859374:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcceb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+534:61828:x1847765450267904:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166974.859397:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166974.859414:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effba9330 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e93cf expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166974.859543:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effba9337 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166974.859558:0:6495:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99400/0x2f180c4effba92f1 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e93ba expref: 535 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166974.859567:0:6495:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effba9337 lrc: 4/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166974.859603:0:6495:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99400/0x2f180c4effba92f1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e93ba expref: 535 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166974.859616:0:6495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99400/0x2f180c4effba92f1 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e93ba expref: 535 pid: 6495 timeout: 694 lvb_type: 0 00000100:00100000:0.0:1762166974.859628:0:6495:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc6224700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6495:1847765449663872:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166974.859705:0:6495:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1c8da80 going to sleep for 11 seconds 00000100:00100000:0.0:1762166974.860847:0:6495:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc6224700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6495:1847765449663872:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166974.860877:0:6495:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effba9337 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000100:00100000:3.0:1762166974.861107:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.863625:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166974.863721:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450268160 00000100:00100000:0.0:1762166974.863732:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450268160 00000100:00100000:0.0:1762166974.863785:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11762 00000100:00100000:0.0:1762166974.863799:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcceb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+535:61828:x1847765450268160:12345-192.168.204.38@tcp:33:lfs.0 00000100:00100000:0.0:1762166974.863991:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcceb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+535:61828:x1847765450268160:12345-192.168.204.38@tcp:33:lfs.0 Request processed in 196us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166974.864003:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11762 00000100:00100000:0.0:1762166974.865181:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.865688:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff2f9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+536:61828:x1847765450268416:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 308us (516us total) trans 4294991690 rc 0/0 00000100:00100000:3.0:1762166974.865694:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11763 00000100:00100000:3.0:1762166974.867071:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166974.869061:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.869141:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450268928 00000100:00100000:3.0:1762166974.869153:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450268928 00000100:00100000:3.0:1762166974.869206:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11764 00000100:00100000:3.0:1762166974.869215:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6224700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+536:61828:x1847765450268928:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:3.0:1762166974.869272:0:19593:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x240000404:0x5eb:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b98400/0x2f180c4effba934c lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e93d6 expref: 536 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.869305:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473600/0x2f180c4effba935a lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166974.869316:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9a00/0x2f180c4effba92b9 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9397 expref: 536 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.869325:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effba92d5 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e93a5 expref: 536 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.869333:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473600/0x2f180c4effba935a lrc: 5/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166974.869371:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effba92d5 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e93a5 expref: 536 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.869386:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effba92d5 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e93a5 expref: 536 pid: 6495 timeout: 694 lvb_type: 0 00000100:00100000:3.0:1762166974.869402:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcceb5c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449664000:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166974.869541:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9a00/0x2f180c4effba92b9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9397 expref: 536 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.869550:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9a00/0x2f180c4effba92b9 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9397 expref: 536 pid: 6495 timeout: 694 lvb_type: 0 00000100:00100000:3.0:1762166974.869561:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcceb4e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449664128:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166974.869591:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166974.870624:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcceb5c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449664000:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166974.870648:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcceb4e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449664128:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166974.870727:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450269056 00000100:00100000:0.0:1762166974.870736:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450269056 00010000:00010000:3.0:1762166974.870746:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473600/0x2f180c4effba935a lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166974.870778:0:6480:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effba92d5 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e93a5 expref: 537 pid: 6495 timeout: 694 lvb_type: 0 00000100:00100000:0.0:1762166974.870857:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450269184 00000100:00100000:0.0:1762166974.870863:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450269184 00010000:00010000:0.0:1762166974.870885:0:6480:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9a00/0x2f180c4effba92b9 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9397 expref: 538 pid: 6495 timeout: 694 lvb_type: 0 00000100:00100000:3.0:1762166974.870943:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9407 00000100:00100000:3.0:1762166974.870972:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cceb4b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+538:2416:x1847765450269184:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166974.870994:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166974.871008:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9a00/0x2f180c4effba92b9 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9397 expref: 538 pid: 6495 timeout: 694 lvb_type: 0 00010000:00010000:3.0:1762166974.871056:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9a00/0x2f180c4effba92b9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9397 expref: 538 pid: 6495 timeout: 694 lvb_type: 0 00010000:00010000:3.0:1762166974.871096:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9a00/0x2f180c4effba92b9 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9397 expref: 538 pid: 6495 timeout: 694 lvb_type: 0 00010000:00010000:3.0:1762166974.871145:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166974.871151:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166974.871220:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473600/0x2f180c4effba935a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:3.0:1762166974.871224:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cceb4b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+536:2416:x1847765450269184:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 252us (390us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166974.871255:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473600/0x2f180c4effba935a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:3.0:1762166974.871281:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9407 00010000:00010000:0.0:1762166974.871565:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473600/0x2f180c4effba935a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166974.871574:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473600/0x2f180c4effba935a lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166974.871581:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473600/0x2f180c4effba935a lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166974.871586:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8473600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166974.871590:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473600/0x2f180c4effba935a lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166974.871597:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473600/0x2f180c4effba935a lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166974.871607:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166974.871610:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166974.871614:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473600/0x2f180c4effba935a lrc: 2/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166974.871619:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473600/0x2f180c4effba935a lrc: 0/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166974.871630:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166974.871632:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166974.871637:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b98400/0x2f180c4effba934c lrc: 0/0,0 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e93d6 expref: 534 pid: 6495 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166974.871773:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6224700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+534:61828:x1847765450268928:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 2559us (2724us total) trans 4294991692 rc -22/-22 00000100:00100000:0.0:1762166974.871782:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11764 00000100:00100000:0.0:1762166974.874698:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450269568 00000100:00100000:0.0:1762166974.874706:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450269568 00000100:00100000:0.0:1762166974.874750:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30117 00000100:00100000:0.0:1762166974.874759:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6db8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+535:61828:x1847765450269568:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166974.874774:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166974.874794:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effba9368 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e93e4 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166974.875340:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effba936f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x605:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166974.875353:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effba936f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x605:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166974.875364:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effba936f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x605:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:0.0:1762166974.875376:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x605:0x0]: returning size 0 00010000:00010000:0.0:1762166974.875423:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effba9368 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e93e4 expref: 538 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166974.875446:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effba936f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x605:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e93e4 expref: 537 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166974.875455:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x605:0x0].0x0 (ffff945bc4afe600) 00010000:00010000:0.0:1762166974.875459:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166974.875463:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bde400, rc 0) 00000100:00100000:0.0:1762166974.875554:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6db8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+537:61828:x1847765450269568:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 795us (912us total) trans 4294991693 rc 0/0 00000100:00100000:0.0:1762166974.875562:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30117 00000100:00100000:0.0:1762166974.877312:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450269824 00000100:00100000:0.0:1762166974.877319:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450269824 00000100:00100000:0.0:1762166974.877356:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30118 00000100:00100000:0.0:1762166974.877362:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6cd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+537:61828:x1847765450269824:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166974.877380:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166974.877394:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effba937d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e93eb expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166974.877505:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effba9384 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166974.877519:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effba9384 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166974.877530:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effba9384 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:0.0:1762166974.877540:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 247907 00010000:00010000:0.0:1762166974.877634:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effba937d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e93eb expref: 540 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166974.877649:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effba9384 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e93eb expref: 539 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166974.877658:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166974.877661:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166974.877665:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bde600, rc 0) 00000100:00100000:0.0:1762166974.877722:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6cd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+539:61828:x1847765450269824:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 358us (462us total) trans 4294991694 rc 0/0 00000100:00100000:0.0:1762166974.877729:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30118 00000100:00100000:0.0:1762166974.879305:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450270080 00000100:00100000:0.0:1762166974.879313:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450270080 00000100:00100000:0.0:1762166974.879360:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11765 00000100:00100000:0.0:1762166974.879369:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6cd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+539:61828:x1847765450270080:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:0.0:1762166974.879430:0:19593:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x240000404:0x5eb:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effba9384 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e93eb expref: 539 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166974.879464:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effba9392 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166974.879499:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b98a00/0x2f180c4effba9361 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e93dd expref: 539 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166974.879509:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effba9392 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166974.879544:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b98a00/0x2f180c4effba9361 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e93dd expref: 539 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166974.879559:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b98a00/0x2f180c4effba9361 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e93dd expref: 539 pid: 6495 timeout: 694 lvb_type: 0 00000100:00100000:0.0:1762166974.879576:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc6226680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449664256:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166974.879666:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1c8df00 going to sleep for 11 seconds 00000100:00100000:0.0:1762166974.880921:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc6226680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449664256:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166974.880953:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effba9392 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:3.0:1762166974.881346:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450270208 00000100:00100000:3.0:1762166974.881353:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450270208 00010000:00010000:3.0:1762166974.881424:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b98a00/0x2f180c4effba9361 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e93dd expref: 540 pid: 6495 timeout: 694 lvb_type: 0 00000100:00100000:3.0:1762166974.881506:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9408 00000100:00100000:3.0:1762166974.881517:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6cd2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+540:2418:x1847765450270208:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166974.881530:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166974.881537:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b98a00/0x2f180c4effba9361 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e93dd expref: 540 pid: 6495 timeout: 694 lvb_type: 0 00010000:00010000:3.0:1762166974.881550:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b98a00/0x2f180c4effba9361 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e93dd expref: 540 pid: 6495 timeout: 694 lvb_type: 0 00010000:00010000:3.0:1762166974.881568:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b98a00/0x2f180c4effba9361 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e93dd expref: 540 pid: 6495 timeout: 694 lvb_type: 0 00010000:00010000:3.0:1762166974.881583:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166974.881587:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effba9392 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166974.881596:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effba9392 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166974.881603:0:6479:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effba9392 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166974.881627:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166974.881638:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effba9392 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166974.881648:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effba9392 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166974.881667:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effba9399 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x605:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00000100:00100000:3.0:1762166974.881679:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6cd2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+539:2418:x1847765450270208:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 162us (383us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166974.881688:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effba936f lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x605:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e93e4 expref: 539 pid: 6495 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166974.881690:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9408 00010000:00010000:0.0:1762166974.881700:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effba9399 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x605:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166974.881726:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effba936f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x605:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e93e4 expref: 538 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166974.881738:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effba936f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x605:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e93e4 expref: 538 pid: 6495 timeout: 694 lvb_type: 0 00000100:00100000:0.0:1762166974.881749:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc6226680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449664384:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166974.881803:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1c8df00 going to sleep for 11 seconds 00000100:00100000:0.0:1762166974.882807:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc6226680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449664384:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166974.882829:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effba9399 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x605:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:3.0:1762166974.882843:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450270336 00000100:00100000:3.0:1762166974.882850:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450270336 00010000:00010000:3.0:1762166974.882870:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effba936f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x605:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e93e4 expref: 539 pid: 6495 timeout: 694 lvb_type: 0 00000100:00100000:3.0:1762166974.882899:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9409 00000100:00100000:3.0:1762166974.882905:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6cd0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+539:2419:x1847765450270336:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166974.882962:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166974.882968:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effba936f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x605:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e93e4 expref: 539 pid: 6495 timeout: 694 lvb_type: 0 00010000:00010000:3.0:1762166974.882980:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effba936f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x605:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e93e4 expref: 539 pid: 6495 timeout: 694 lvb_type: 0 00010000:00010000:3.0:1762166974.882994:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effba936f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x605:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e93e4 expref: 539 pid: 6495 timeout: 694 lvb_type: 0 00010000:00010000:3.0:1762166974.883007:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x605:0x0].0x0 (ffff945bc4afe600) 00010000:00010000:3.0:1762166974.883011:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effba9399 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x605:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166974.883018:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effba9399 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x605:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166974.883025:0:6479:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effba9399 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x605:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166974.883059:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166974.883095:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6cd0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+538:2419:x1847765450270336:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 189us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166974.883105:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9409 00010000:00010000:0.0:1762166974.883126:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effba9399 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x605:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166974.883136:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effba9399 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x605:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:0.0:1762166974.883618:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc6226680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449664512:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166974.883688:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166974.883716:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cee171900 going to sleep for 11 seconds 00000100:00100000:3.0:1762166974.883730:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449664512 00000100:00100000:3.0:1762166974.883735:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449664512 00000100:00100000:3.0:1762166974.883772:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1278 00000100:00100000:3.0:1762166974.883779:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+14:19593:x1847765449664512:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166974.883865:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+14:19593:x1847765449664512:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 87us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166974.883873:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1278 00000100:00100000:0.0:1762166974.883902:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc6226680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449664512:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166974.883960:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf7838000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449664640:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166974.883986:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166974.884008:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449664640 00000100:00100000:0.0:1762166974.884010:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cd123ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1762166974.884012:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449664640 00000100:00100000:3.0:1762166974.884046:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1279 00000100:00100000:3.0:1762166974.884052:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+13:19593:x1847765449664640:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166974.884118:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+13:19593:x1847765449664640:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 66us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166974.884124:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1279 00000100:00100000:0.0:1762166974.884158:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf7838000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449664640:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166974.884207:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf7838000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449664768:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166974.884232:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166974.884251:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc12ed240 going to sleep for 11 seconds 00000100:00100000:3.0:1762166974.884253:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449664768 00000100:00100000:3.0:1762166974.884259:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449664768 00000100:00100000:3.0:1762166974.884285:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1280 00000100:00100000:3.0:1762166974.884292:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6226680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+13:19593:x1847765449664768:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166974.884350:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6226680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+13:19593:x1847765449664768:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 58us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166974.884357:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1280 00000100:00100000:0.0:1762166974.884394:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf7838000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449664768:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166974.884426:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf7838000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449664896:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166974.884448:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166974.884468:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc12ed300 going to sleep for 11 seconds 00000100:00100000:3.0:1762166974.884471:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449664896 00000100:00100000:3.0:1762166974.884500:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449664896 00000100:00100000:3.0:1762166974.884526:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1281 00000100:00100000:3.0:1762166974.884533:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+14:19593:x1847765449664896:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166974.884583:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+14:19593:x1847765449664896:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 51us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166974.884592:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1281 00000100:00100000:0.0:1762166974.884607:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf7838000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449664896:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166974.884647:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55ddc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449665024:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166974.884667:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166974.884682:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bca7930c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166974.884690:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449665024 00000100:00100000:3.0:1762166974.884695:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449665024 00000100:00100000:3.0:1762166974.884724:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1282 00000100:00100000:3.0:1762166974.884731:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+14:19593:x1847765449665024:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166974.884777:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+14:19593:x1847765449665024:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 48us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166974.884782:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1282 00000100:00100000:0.0:1762166974.884801:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55ddc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449665024:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166974.884838:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55ddc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449665152:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166974.884863:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166974.884880:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449665152 00000100:00100000:3.0:1762166974.884884:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449665152 00000100:00100000:0.0:1762166974.884884:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bca7936c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166974.884905:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1283 00000100:00100000:3.0:1762166974.884909:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf7838000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+13:19593:x1847765449665152:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166974.884963:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf7838000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+13:19593:x1847765449665152:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 53us (100us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166974.884968:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1283 00000100:00100000:0.0:1762166974.884986:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55ddc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449665152:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166974.885017:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55ddc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449665280:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166974.885039:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166974.885059:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bca7936c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166974.885060:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449665280 00000100:00100000:3.0:1762166974.885065:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449665280 00000100:00100000:3.0:1762166974.885095:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1284 00000100:00100000:3.0:1762166974.885101:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5804380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+13:19593:x1847765449665280:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166974.885152:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5804380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+13:19593:x1847765449665280:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 50us (111us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166974.885160:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1284 00000100:00100000:0.0:1762166974.885169:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55ddc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449665280:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166974.885200:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5804700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449665408:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166974.885224:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166974.885245:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bca7936c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166974.885393:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5804700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449665408:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166974.885430:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5804700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449665536:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166974.885449:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166974.885467:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bca7936c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166974.885616:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5804700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449665536:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166974.885646:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bccb7ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449665664:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166974.885668:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166974.885689:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bca7936c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166974.885844:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bccb7ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449665664:0@lo:1000:mdt_rdpg00_003.0 00000040:00080000:0.0:1762166974.885998:0:19593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x2:0x0].39, 552 off62736 00000001:00080000:0.0:1762166974.886007:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294991695 00000100:00100000:0.0:1762166974.886055:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bccb7ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449665792:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166974.886078:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166974.886103:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bca7936c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166974.886373:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bccb7ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449665792:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166974.886395:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bccb7fb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449665920:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166974.886417:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166974.886438:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bca7936c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166974.886682:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bccb7fb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449665920:0@lo:1000:mdt_rdpg00_003.0 00000001:00080000:0.0:1762166974.886735:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294991696 00010000:00010000:0.0:1762166974.886760:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effba9399 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x605:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166974.886770:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effba9399 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x605:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166974.886776:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effba9399 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x605:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166974.886782:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdfc00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166974.886787:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effba9399 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x605:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166974.886794:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effba9399 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x605:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166974.886808:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x605:0x0].0x0 (ffff945bc4afe600) 00010000:00010000:0.0:1762166974.886811:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166974.886815:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effba9399 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x605:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166974.886825:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effba9399 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x605:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166974.886845:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effba9392 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166974.886851:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effba9392 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166974.886855:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effba9392 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166974.886860:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdfa00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166974.886863:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effba9392 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166974.886875:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effba9392 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166974.886883:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166974.886885:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166974.886888:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effba9392 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166974.886894:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effba9392 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166974.886905:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166974.886907:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166974.886913:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effba9384 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e93eb expref: 540 pid: 6495 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166974.887012:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6cd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+539:61828:x1847765450270080:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 7644us (7802us total) trans 4294991697 rc 0/0 00000100:00100000:0.0:1762166974.887022:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11765 00000020:00080000:0.0:1762166974.887026:0:19593:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1762166974.888268:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450270464 00000100:00100000:0.0:1762166974.888274:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450270464 00000100:00100000:0.0:1762166974.888322:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30119 00000100:00100000:0.0:1762166974.888335:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6cd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+539:61828:x1847765450270464:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166974.888354:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166974.888371:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effba93a0 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e93f2 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166974.888419:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effba93a0 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e93f2 expref: 540 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166974.888433:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effba93a0 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e93f2 expref: 540 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166974.888448:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166974.888452:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166974.888456:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdf000, rc 0) 00000100:00100000:0.0:1762166974.888525:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6cd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+540:61828:x1847765450270464:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 189us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166974.888532:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30119 00000100:00100000:0.0:1762166974.890413:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450270720 00000100:00100000:0.0:1762166974.890423:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450270720 00000100:00100000:0.0:1762166974.890505:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11766 00000100:00100000:0.0:1762166974.890517:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6dbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+540:61828:x1847765450270720:12345-192.168.204.38@tcp:35:lfs.0 00000004:00080000:0.0:1762166974.890797:0:19593:0:(mdd_object.c:3965:mdd_close()) Object [0x240000404:0x605:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1762166974.890869:0:19593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5823, 64 off455496 00000040:00080000:0.0:1762166974.890892:0:19593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5824, 64 off455496 00000001:00080000:0.0:1762166974.890899:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294991698 00010000:00010000:0.0:1762166974.890946:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effba93a7 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x605:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166974.890959:0:19593:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effba93a7 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x605:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166974.890970:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effba93a7 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x605:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166974.890977:0:19593:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effba93a7 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x605:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166974.890983:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effba93a7 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x605:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166974.890989:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effba93a7 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x605:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166974.891008:0:19593:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1762166974.891191:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6dbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+542:61828:x1847765450270720:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 675us (900us total) trans 4294991699 rc 0/0 00000100:00100000:0.0:1762166974.891200:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11766 00000020:00080000:0.0:1762166974.891205:0:19593:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1762166974.892143:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450270976 00000100:00100000:0.0:1762166974.892152:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450270976 00000100:00100000:0.0:1762166974.892192:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11767 00000100:00100000:0.0:1762166974.892199:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6db8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+542:61828:x1847765450270976:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166974.892442:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6db8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+543:61828:x1847765450270976:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 244us (370us total) trans 4294991700 rc 0/0 00000100:00100000:0.0:1762166974.892451:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11767 00000100:00100000:0.0:1762166974.902168:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450271104 00000100:00100000:0.0:1762166974.902179:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450271104 00000100:00100000:0.0:1762166974.902257:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30120 00000100:00100000:0.0:1762166974.902267:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4493480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+543:61829:x1847765450271104:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166974.902294:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166974.902327:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effba93ae lrc: 2/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e93f9 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166974.902403:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effba93b5 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166974.902418:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effba93b5 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166974.902429:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effba93b5 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166974.902438:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effba93bc lrc: 3/1,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166974.902442:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effba93bc lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166974.902446:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effba93bc lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166974.902542:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effba93c3 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166974.902549:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effba93c3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166974.902553:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effba93c3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:0.0:1762166974.902595:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 247907 00000004:00200000:0.0:1762166974.902600:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166974.902617:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effba93c3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166974.902629:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effba93c3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166974.902637:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effba93b5 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166974.902643:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effba93b5 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166974.902648:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effba93b5 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166974.902654:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effba93b5 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166974.902659:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdfa00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166974.902663:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effba93b5 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166974.902670:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effba93b5 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166974.902680:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0x0 (ffff945bc4afe600) 00010000:00010000:0.0:1762166974.902683:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166974.902687:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effba93b5 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166974.902693:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effba93b5 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166974.902705:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effba93bc lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166974.902710:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effba93bc lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166974.902715:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effba93bc lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166974.902719:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdfc00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166974.902722:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effba93bc lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166974.902727:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effba93bc lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166974.902732:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0xdd396665 (ffff945bc4afe500) 00010000:00010000:0.0:1762166974.902735:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166974.902738:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effba93bc lrc: 2/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166974.902743:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effba93bc lrc: 0/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166974.902771:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effba93ae lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e93f9 expref: 545 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166974.902786:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effba93c3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e93f9 expref: 544 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166974.902799:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166974.902802:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166974.902804:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bde200, rc 0) 00000100:00100000:0.0:1762166974.902868:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4493480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+544:61829:x1847765450271104:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 602us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166974.902876:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30120 00000100:00100000:0.0:1762166974.904626:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450271360 00000100:00100000:0.0:1762166974.904640:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450271360 00000100:00100000:0.0:1762166974.904696:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30121 00000100:00100000:0.0:1762166974.904707:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6db8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+544:61829:x1847765450271360:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166974.904726:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166974.904745:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effba93ca lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9400 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166974.904849:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effba93d1 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166974.904862:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effba93d1 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166974.904873:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effba93d1 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:0.0:1762166974.904882:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 247907 00010000:00010000:0.0:1762166974.905020:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effba93ca lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9400 expref: 547 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166974.905037:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effba93d1 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9400 expref: 546 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166974.905046:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166974.905049:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1762166974.905053:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdec00, rc 0) 00000100:00100000:0.0:1762166974.905122:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6db8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+546:61829:x1847765450271360:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 417us (553us total) trans 4294991701 rc 0/0 00000100:00100000:0.0:1762166974.905131:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30121 00000100:00100000:0.0:1762166974.906573:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450271616 00000100:00100000:0.0:1762166974.906582:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450271616 00000100:00100000:0.0:1762166974.906623:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30122 00000100:00100000:0.0:1762166974.906631:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6dbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+546:61829:x1847765450271616:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166974.906650:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166974.906662:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effba93df lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9407 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166974.906728:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effba93e6 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166974.906738:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effba93e6 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166974.906745:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effba93e6 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:0.0:1762166974.906753:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 247907 00010000:00010000:0.0:1762166974.906819:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effba93df lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9407 expref: 549 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166974.906834:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effba93e6 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9407 expref: 548 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166974.906842:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166974.906845:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166974.906847:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdf200, rc 0) 00000100:00100000:0.0:1762166974.906897:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6dbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+548:61829:x1847765450271616:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 267us (373us total) trans 4294991702 rc 0/0 00000100:00100000:0.0:1762166974.906904:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30122 00000100:00100000:3.0:1762166974.908711:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450271744 00000100:00100000:3.0:1762166974.908719:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450271744 00000100:00100000:3.0:1762166974.908773:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 851 00000100:00100000:3.0:1762166974.908785:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4492a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+548:61829:x1847765450271744:12345-192.168.204.38@tcp:103:lfs.0 00010000:00010000:3.0:1762166974.908802:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166974.908825:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effba93e6 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9407 expref: 548 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.908842:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166974.908846:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166974.908896:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4492a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+547:61829:x1847765450271744:12345-192.168.204.38@tcp:103:lfs.0 Request processed in 115us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166974.908906:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 851 00000100:00100000:0.0:1762166974.909834:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450272000 00000100:00100000:0.0:1762166974.909846:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450272000 00000100:00100000:0.0:1762166974.909909:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11768 00000100:00100000:0.0:1762166974.909920:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff2f8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+547:61829:x1847765450272000:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166974.910155:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff2f8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+548:61829:x1847765450272000:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 236us (395us total) trans 4294991703 rc 0/0 00000100:00100000:0.0:1762166974.910164:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11768 00000100:00100000:0.0:1762166974.912691:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450272256 00000100:00100000:0.0:1762166974.912698:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450272256 00000100:00100000:0.0:1762166974.912746:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30123 00000100:00100000:0.0:1762166974.912756:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6db8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+548:61766:x1847765450272256:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:0.0:1762166974.912779:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166974.912800:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effba93f4 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e940e expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166974.912903:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effba93fb lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166974.912918:0:6495:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effba93c3 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e93f9 expref: 549 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166974.912944:0:6495:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effba93fb lrc: 4/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166974.912995:0:6495:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effba93c3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e93f9 expref: 549 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166974.913008:0:6495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effba93c3 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e93f9 expref: 549 pid: 6495 timeout: 694 lvb_type: 0 00000100:00100000:0.0:1762166974.913021:0:6495:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bccb7c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6495:1847765449666048:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166974.913118:0:6495:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bca7936c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166974.914200:0:6495:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bccb7c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6495:1847765449666048:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166974.914224:0:6495:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effba93fb lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000100:00100000:3.0:1762166974.914380:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450272384 00000100:00100000:3.0:1762166974.914393:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450272384 00010000:00010000:3.0:1762166974.914444:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effba93c3 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e93f9 expref: 550 pid: 6495 timeout: 694 lvb_type: 0 00000100:00100000:3.0:1762166974.914528:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9410 00000100:00100000:3.0:1762166974.914537:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6dbb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+550:2419:x1847765450272384:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166974.914550:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166974.914555:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effba93c3 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e93f9 expref: 550 pid: 6495 timeout: 694 lvb_type: 0 00010000:00010000:3.0:1762166974.914566:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effba93c3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e93f9 expref: 550 pid: 6495 timeout: 694 lvb_type: 0 00010000:00010000:3.0:1762166974.914584:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effba93c3 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e93f9 expref: 550 pid: 6495 timeout: 694 lvb_type: 0 00010000:00010000:3.0:1762166974.914598:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166974.914602:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effba93fb lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166974.914609:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effba93fb lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166974.914616:0:6479:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effba93fb lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166974.914638:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166974.914665:0:6495:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effba93fb lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166974.914675:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effba93fb lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000100:00100000:3.0:1762166974.914684:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6dbb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+549:2419:x1847765450272384:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 147us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166974.914691:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9410 00000004:00200000:0.0:1762166974.914694:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 247907 00010000:00010000:0.0:1762166974.914812:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effba93f4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e940e expref: 550 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166974.914831:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effba93fb lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e940e expref: 549 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166974.914840:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166974.914843:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1762166974.914845:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdee00, rc 0) 00000100:00100000:0.0:1762166974.914889:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6db8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+549:61766:x1847765450272256:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 2134us (2245us total) trans 4294991704 rc 0/0 00000100:00100000:0.0:1762166974.914897:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30123 00000100:00100000:0.0:1762166974.915880:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450272512 00000100:00100000:0.0:1762166974.915887:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450272512 00000100:00100000:0.0:1762166974.915937:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30124 00000100:00100000:0.0:1762166974.915947:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6dbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+549:61766:x1847765450272512:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:0.0:1762166974.915963:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166974.915975:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effba9409 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9415 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166974.916043:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effba9410 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166974.916054:0:6495:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effba93fb lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e940e expref: 550 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166974.916061:0:6495:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effba9410 lrc: 4/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166974.916086:0:6495:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effba93fb lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e940e expref: 550 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166974.916096:0:6495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effba93fb lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e940e expref: 550 pid: 6495 timeout: 694 lvb_type: 0 00000100:00100000:0.0:1762166974.916109:0:6495:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bccb7c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6495:1847765449666176:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166974.916158:0:6495:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bca793c00 going to sleep for 11 seconds 00000100:00100000:0.0:1762166974.916935:0:6495:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bccb7c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6495:1847765449666176:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166974.916948:0:6495:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effba9410 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000100:00100000:3.0:1762166974.917071:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450272640 00000100:00100000:3.0:1762166974.917076:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450272640 00010000:00010000:3.0:1762166974.917094:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effba93fb lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e940e expref: 551 pid: 6495 timeout: 694 lvb_type: 0 00000100:00100000:3.0:1762166974.917163:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9411 00000100:00100000:3.0:1762166974.917172:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6db8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+551:2419:x1847765450272640:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166974.917182:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166974.917187:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effba93fb lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e940e expref: 551 pid: 6495 timeout: 694 lvb_type: 0 00010000:00010000:3.0:1762166974.917199:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effba93fb lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e940e expref: 551 pid: 6495 timeout: 694 lvb_type: 0 00010000:00010000:3.0:1762166974.917214:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effba93fb lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e940e expref: 551 pid: 6495 timeout: 694 lvb_type: 0 00010000:00010000:3.0:1762166974.917227:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166974.917231:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effba9410 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166974.917242:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effba9410 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166974.917249:0:6479:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effba9410 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166974.917270:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166974.917290:0:6495:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effba9410 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166974.917298:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effba9410 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000100:00100000:3.0:1762166974.917306:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6db8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+550:2419:x1847765450272640:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 135us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166974.917316:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9411 00000004:00200000:0.0:1762166974.917339:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 247907 00000004:00200000:0.0:1762166974.917344:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166974.917363:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effba9410 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166974.917385:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effba9409 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9415 expref: 550 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166974.917397:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effba9410 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9415 expref: 549 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166974.917404:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166974.917406:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166974.917409:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdfc00, rc 0) 00000100:00100000:0.0:1762166974.917440:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6dbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+549:61766:x1847765450272512:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 1496us (1599us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166974.917448:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30124 00000100:00100000:0.0:1762166974.919099:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450272896 00000100:00100000:0.0:1762166974.919107:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450272896 00000100:00100000:0.0:1762166974.919157:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11769 00000100:00100000:0.0:1762166974.919165:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6db9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+549:61766:x1847765450272896:12345-192.168.204.38@tcp:35:fsx.0 00000100:00100000:0.0:1762166974.919341:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6db9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+550:61766:x1847765450272896:12345-192.168.204.38@tcp:35:fsx.0 Request processed in 177us (291us total) trans 4294991705 rc 0/0 00000100:00100000:0.0:1762166974.919349:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11769 00000100:00100000:0.0:1762166974.928523:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450273024 00000100:00100000:0.0:1762166974.928543:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450273024 00000100:00100000:0.0:1762166974.928664:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30125 00000100:00100000:0.0:1762166974.928678:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4491500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+550:61830:x1847765450273024:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166974.928704:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166974.928727:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effba9417 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e941c expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166974.928805:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effba941e lrc: 3/1,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166974.928821:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effba941e lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166974.928832:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effba941e lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166974.928844:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effba9425 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166974.928851:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effba9425 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166974.928857:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effba9425 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166974.928945:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effba942c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166974.928955:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effba942c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166974.928962:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effba942c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:0.0:1762166974.929006:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 247907 00000004:00200000:0.0:1762166974.929011:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166974.929029:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effba942c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166974.929039:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effba942c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166974.929048:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effba941e lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166974.929055:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effba941e lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166974.929077:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effba941e lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166974.929084:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effba941e lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166974.929090:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bde000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166974.929100:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effba941e lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166974.929108:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effba941e lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166974.929120:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0x0 (ffff945bc4afe600) 00010000:00010000:0.0:1762166974.929123:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166974.929128:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effba941e lrc: 3/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166974.929134:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effba941e lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166974.929149:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effba9425 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166974.929155:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effba9425 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166974.929160:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effba9425 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166974.929166:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdea00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166974.929168:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effba9425 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166974.929174:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effba9425 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166974.929181:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0xdd396665 (ffff945bc4afe500) 00010000:00010000:0.0:1762166974.929184:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166974.929187:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effba9425 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166974.929193:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effba9425 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166974.929223:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effba9417 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e941c expref: 552 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166974.929238:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effba942c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e941c expref: 551 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166974.929245:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166974.929247:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166974.929250:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bde400, rc 0) 00000100:00100000:0.0:1762166974.929316:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4491500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+551:61830:x1847765450273024:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 641us (988us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166974.929324:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30125 00000100:00100000:3.0:1762166974.931413:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450273152 00000100:00100000:3.0:1762166974.931420:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450273152 00000100:00100000:3.0:1762166974.931461:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 852 00000100:00100000:3.0:1762166974.931467:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d20e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+551:2416:x1847765450273152:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166974.931511:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166974.931532:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effba942c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e941c expref: 551 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.931547:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166974.931551:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166974.931598:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d20e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+550:2416:x1847765450273152:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 131us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166974.931675:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 852 00000100:00100000:0.0:1762166974.931762:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450273408 00000100:00100000:0.0:1762166974.931768:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450273408 00000100:00100000:0.0:1762166974.931806:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30126 00000100:00100000:0.0:1762166974.931815:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4490000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+550:61830:x1847765450273408:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166974.931828:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166974.931841:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effba9433 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9423 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166974.931939:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effba943a lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166974.931953:0:6495:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effba9410 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9415 expref: 551 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166974.931962:0:6495:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effba943a lrc: 4/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166974.931993:0:6495:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effba9410 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9415 expref: 551 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166974.932010:0:6495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effba9410 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9415 expref: 551 pid: 6495 timeout: 694 lvb_type: 0 00000100:00100000:0.0:1762166974.932023:0:6495:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bccb7c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6495:1847765449666304:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166974.932095:0:6495:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bca7936c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166974.932910:0:6495:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bccb7c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6495:1847765449666304:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166974.932941:0:6495:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effba943a lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000100:00100000:3.0:1762166974.933546:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450273536 00000100:00100000:3.0:1762166974.933561:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450273536 00010000:00010000:3.0:1762166974.933599:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effba9410 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9415 expref: 552 pid: 6495 timeout: 694 lvb_type: 0 00000100:00100000:3.0:1762166974.933640:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9412 00000100:00100000:3.0:1762166974.933647:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cceb4a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+552:2418:x1847765450273536:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166974.933661:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166974.933667:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effba9410 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9415 expref: 552 pid: 6495 timeout: 694 lvb_type: 0 00010000:00010000:3.0:1762166974.933678:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effba9410 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9415 expref: 552 pid: 6495 timeout: 694 lvb_type: 0 00010000:00010000:3.0:1762166974.933696:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effba9410 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9415 expref: 552 pid: 6495 timeout: 694 lvb_type: 0 00010000:00010000:3.0:1762166974.933709:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166974.933712:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effba943a lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166974.933720:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effba943a lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166974.933728:0:6479:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effba943a lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166974.933769:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166974.933797:0:6495:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effba943a lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166974.933807:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effba943a lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:0.0:1762166974.933822:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 247907 00000100:00100000:3.0:1762166974.933829:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cceb4a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+551:2418:x1847765450273536:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 179us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166974.933840:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9412 00010000:00010000:0.0:1762166974.933968:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effba9433 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9423 expref: 552 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166974.933992:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effba943a lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9423 expref: 551 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166974.934001:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166974.934003:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1762166974.934006:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdf600, rc 0) 00000100:00100000:0.0:1762166974.934059:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4490000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+551:61830:x1847765450273408:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2243us (2347us total) trans 4294991706 rc 0/0 00000100:00100000:0.0:1762166974.934070:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30126 00000100:00100000:0.0:1762166974.935569:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450273664 00000100:00100000:0.0:1762166974.935585:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450273664 00000100:00100000:0.0:1762166974.935628:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30127 00000100:00100000:0.0:1762166974.935639:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4493100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+551:61830:x1847765450273664:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166974.935659:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166974.935674:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effba9448 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e942a expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166974.935755:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effba944f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166974.935771:0:6495:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effba943a lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9423 expref: 552 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166974.935778:0:6495:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effba944f lrc: 4/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166974.935808:0:6495:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effba943a lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9423 expref: 552 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166974.935819:0:6495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effba943a lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9423 expref: 552 pid: 6495 timeout: 694 lvb_type: 0 00000100:00100000:0.0:1762166974.935831:0:6495:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bccb7c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6495:1847765449666432:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166974.935895:0:6495:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bca793c00 going to sleep for 11 seconds 00000100:00100000:0.0:1762166974.936798:0:6495:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bccb7c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6495:1847765449666432:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166974.936827:0:6495:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effba944f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000100:00100000:3.0:1762166974.937027:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450273792 00000100:00100000:3.0:1762166974.937073:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450273792 00010000:00010000:3.0:1762166974.937108:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effba943a lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9423 expref: 553 pid: 6495 timeout: 694 lvb_type: 0 00000100:00100000:3.0:1762166974.937143:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9413 00000100:00100000:3.0:1762166974.937158:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4492a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+553:2418:x1847765450273792:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166974.937175:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166974.937182:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effba943a lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9423 expref: 553 pid: 6495 timeout: 694 lvb_type: 0 00010000:00010000:3.0:1762166974.937195:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effba943a lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9423 expref: 553 pid: 6495 timeout: 694 lvb_type: 0 00010000:00010000:3.0:1762166974.937215:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effba943a lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9423 expref: 553 pid: 6495 timeout: 694 lvb_type: 0 00010000:00010000:3.0:1762166974.937230:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166974.937233:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effba944f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166974.937241:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effba944f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166974.937246:0:6479:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effba944f lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166974.937269:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166974.937301:0:6495:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effba944f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166974.937308:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effba944f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000100:00100000:3.0:1762166974.937313:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4492a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+552:2418:x1847765450273792:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 157us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166974.937321:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9413 00000004:00200000:0.0:1762166974.937365:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 247907 00000004:00200000:0.0:1762166974.937371:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166974.937392:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effba944f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166974.937419:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effba9448 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e942a expref: 552 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166974.937430:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effba944f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e942a expref: 551 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166974.937437:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166974.937440:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166974.937443:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdea00, rc 0) 00000100:00100000:0.0:1762166974.937519:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4493100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+551:61830:x1847765450273664:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1882us (1990us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166974.937526:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30127 00000100:00100000:0.0:1762166974.939011:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450274048 00000100:00100000:0.0:1762166974.939018:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450274048 00000100:00100000:0.0:1762166974.939074:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11770 00000100:00100000:0.0:1762166974.939084:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+551:61830:x1847765450274048:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166974.939312:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+552:61830:x1847765450274048:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 230us (358us total) trans 4294991707 rc 0/0 00000100:00100000:0.0:1762166974.939321:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11770 00000100:00100000:0.0:1762166974.940333:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450274304 00000100:00100000:0.0:1762166974.940339:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450274304 00000100:00100000:0.0:1762166974.940379:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30128 00000100:00100000:0.0:1762166974.940386:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+552:61830:x1847765450274304:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166974.940407:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166974.940410:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1762166974.940436:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effba93d1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9400 expref: 552 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166974.940453:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166974.940457:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166974.940471:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effba9456 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9431 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166974.940602:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effba945d lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166974.940613:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effba945d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166974.940620:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effba945d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:0.0:1762166974.940629:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 247907 00010000:00010000:0.0:1762166974.940694:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effba9456 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9431 expref: 554 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166974.940704:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effba945d lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9431 expref: 553 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166974.940712:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166974.940715:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166974.940717:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bde800, rc 0) 00000100:00100000:0.0:1762166974.940764:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+553:61830:x1847765450274304:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 378us (480us total) trans 4294991708 rc 0/0 00000100:00100000:0.0:1762166974.940779:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30128 00000100:00100000:0.0:1762166974.942097:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450274560 00000100:00100000:3.0:1762166974.942098:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450274688 00000100:00100000:0.0:1762166974.942103:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450274560 00000100:00100000:3.0:1762166974.942106:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450274688 00000100:00100000:0.0:1762166974.942150:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18605 00000100:00100000:3.0:1762166974.942159:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18606 00000100:00100000:0.0:1762166974.942161:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+20:2417:x1847765450274560:12345-192.168.204.38@tcp:1:lfs.0 00000100:00100000:3.0:1762166974.942175:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+30:2416:x1847765450274688:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:0.0:1762166974.942184:0:28874:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effba9472 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166974.942196:0:28874:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc95c0800/0x2f180c4effba92dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e93ac expref: 20 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.942203:0:8380:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc8472000/0x2f180c4effba9479 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166974.942219:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166974.942223:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166974.942228:0:8380:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc5db8200/0x2f180c4effba92e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e93b3 expref: 30 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166974.942228:0:28874:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effba9472 lrc: 4/0,1 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.942254:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166974.942257:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166974.942260:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472000/0x2f180c4effba9479 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166974.942279:0:28874:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc95c0800/0x2f180c4effba92dc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e93ac expref: 20 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.942290:0:8380:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc5db8200/0x2f180c4effba92e3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e93b3 expref: 30 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166974.942302:0:28874:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc95c0800/0x2f180c4effba92dc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e93ac expref: 20 pid: 9168 timeout: 694 lvb_type: 0 00010000:00010000:3.0:1762166974.942310:0:8380:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc5db8200/0x2f180c4effba92e3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e93b3 expref: 30 pid: 9168 timeout: 694 lvb_type: 0 00000100:00100000:0.0:1762166974.942350:0:28874:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bccb7c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28874:1847765449666688:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166974.942351:0:8380:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcceb7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8380:1847765449666816:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166974.942440:0:8380:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402f840 going to sleep for 11 seconds 00000100:00100000:0.0:1762166974.942441:0:28874:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bca7930c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166974.943803:0:28874:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bccb7c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28874:1847765449666688:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166974.943833:0:8380:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcceb7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8380:1847765449666816:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166974.943840:0:28874:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effba9472 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.943880:0:8380:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc8472000/0x2f180c4effba9479 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166974.943967:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166974.944040:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9415 00000100:00100000:0.0:1762166974.944057:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc582ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+32:2418:x1847765450274944:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166974.944075:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166974.944094:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc5db8200/0x2f180c4effba92e3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e93b3 expref: 32 pid: 9168 timeout: 694 lvb_type: 0 00010000:00010000:0.0:1762166974.944119:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc5db8200/0x2f180c4effba92e3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e93b3 expref: 31 pid: 9168 timeout: 694 lvb_type: 0 00010000:00010000:3.0:1762166974.944227:0:9168:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc847f600/0x2f180c4effba946b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166974.944243:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc5db8200/0x2f180c4effba92e3 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e93b3 expref: 31 pid: 9168 timeout: 694 lvb_type: 0 00010000:00010000:3.0:1762166974.944301:0:9168:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc847f600/0x2f180c4effba946b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166974.944324:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166974.944333:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166974.944339:0:9168:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc847f600/0x2f180c4effba946b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166974.944349:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc8472000/0x2f180c4effba9479 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.944390:0:9168:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc847f600/0x2f180c4effba946b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.944421:0:9168:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc847f600/0x2f180c4effba946b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166974.944435:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472000/0x2f180c4effba9479 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166974.944523:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166974.944547:0:9168:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc847f600 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166974.944559:0:9168:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc847f600/0x2f180c4effba946b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166974.944600:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc582ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+29:2418:x1847765450274944:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 540us (772us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166974.944605:0:9168:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc847f600/0x2f180c4effba946b lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166974.944648:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9415 00010000:00010000:3.0:1762166974.944681:0:9168:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc847f600/0x2f180c4effba946b lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.944723:0:9168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc847f600/0x2f180c4effba946b lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166974.944861:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+28:2416:x1847765450274432:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 2731us (2933us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166974.944875:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18604 00000100:00100000:0.0:1762166974.946042:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450275328 00000100:00100000:0.0:1762166974.946051:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450275328 00000100:00100000:0.0:1762166974.946098:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30129 00000100:00100000:0.0:1762166974.946106:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc582df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+553:61830:x1847765450275328:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:0.0:1762166974.946158:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1762166974.946178:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effba944f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e942a expref: 553 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166974.946196:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effba93a0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e93f2 expref: 552 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166974.946205:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166974.946209:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166974.946234:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effba9480 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166974.946245:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effba9480 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166974.946253:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effba9480 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000040:00080000:0.0:1762166974.946544:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5825, 88 off455584 00000004:00080000:0.0:1762166974.946552:0:6495:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 594095074025ns, next at 594522415006ns, rc = 0 00000040:00080000:0.0:1762166974.946586:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5824, 88 off455584 00000004:00080000:0.0:1762166974.946592:0:6495:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 594095113939ns, next at 594522388989ns, rc = 0 00000040:00080000:0.0:1762166974.946622:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5825, 88 off455672 00000004:00080000:0.0:1762166974.946626:0:6495:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 594095148251ns, next at 594522388989ns, rc = 0 00000040:00080000:0.0:1762166974.946636:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5826, 88 off455672 00000004:00080000:0.0:1762166974.946640:0:6495:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 594095162175ns, next at 594522415006ns, rc = 0 00000040:00080000:0.0:1762166974.946657:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5827, 88 off455760 00000004:00080000:0.0:1762166974.946661:0:6495:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 594095183075ns, next at 594522415006ns, rc = 0 00000040:00080000:0.0:1762166974.946671:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5826, 88 off455760 00000004:00080000:0.0:1762166974.946697:0:6495:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 594095219405ns, next at 594522388989ns, rc = 0 00000040:00080000:0.0:1762166974.946716:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5827, 88 off455848 00000004:00080000:0.0:1762166974.946720:0:6495:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 594095242514ns, next at 594522388989ns, rc = 0 00000040:00080000:0.0:1762166974.946729:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5828, 88 off455848 00000004:00080000:0.0:1762166974.946733:0:6495:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 594095255425ns, next at 594522415006ns, rc = 0 00000040:00080000:0.0:1762166974.946752:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5829, 88 off455936 00000004:00080000:0.0:1762166974.946756:0:6495:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 594095278621ns, next at 594522415006ns, rc = 0 00000040:00080000:0.0:1762166974.946765:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5828, 88 off455936 00000004:00080000:0.0:1762166974.946768:0:6495:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 594095290685ns, next at 594522388989ns, rc = 0 00000001:00080000:3.0:1762166974.948553:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294991709 is committed 00000004:00080000:3.0:1762166974.948565:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3198 committed 00000004:00080000:3.0:1762166974.948593:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3195 committed 00000004:00080000:3.0:1762166974.948611:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3194 committed 00000004:00080000:3.0:1762166974.948618:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3197 committed 00000004:00080000:3.0:1762166974.948626:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3196 committed 00000004:00080000:3.0:1762166974.948632:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3193 committed 00000004:00080000:3.0:1762166974.948641:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3192 committed 00000004:00080000:3.0:1762166974.948647:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3195 committed 00000004:00080000:3.0:1762166974.948654:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3194 committed 00000004:00080000:3.0:1762166974.948662:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3191 committed 00000020:00080000:3.0:1762166974.948712:0:7412:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff945cd123b480 refcount 2 committed 0 result 0 batchid 41 00000020:00080000:3.0:1762166974.948724:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cc3e9fa00 obd lustre-OST0001-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff945cee171900 00000020:00080000:3.0:1762166974.948732:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cc3e9f500 obd lustre-OST0000-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff945cf1c8df00 00000020:00080000:3.0:1762166974.948736:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cc3e9f100 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff945bc9579e00 00000020:00080000:3.0:1762166974.948738:0:7412:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000400:0x2:0x0].39 00000020:00080000:3.0:1762166974.948810:0:7412:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0001: 40 batchid updated 00000100:00100000:3.0:1762166974.948856:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc582d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449667072:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166974.948948:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166974.949011:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc582c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449667584:0@lo:2:osp-syn-1-1.0 00000004:00010000:0.0:1762166974.949011:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000002a6cf6fb reply state 00000000e7765c84 transno 4294991709 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effba9480 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166974.949044:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effba9480 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166974.949054:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166974.949057:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:0.0:1762166974.949061:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166974.949077:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166974.949145:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc6cd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449668096:0@lo:2:osp-syn-0-1.0 00010000:00080000:0.0:1762166974.949185:0:6495:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1762166974.949203:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc582df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+525:61830:x1847765450275328:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 3093us (3226us total) trans 4294991709 rc 0/0 00000100:00100000:3.0:1762166974.949204:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166974.949223:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30129 00000100:00100000:0.0:1762166974.949255:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449667072 00000100:00100000:0.0:1762166974.949257:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449667072 00000100:00100000:0.0:1762166974.949281:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449667840 00000100:00100000:0.0:1762166974.949283:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449667840 00000100:00100000:0.0:1762166974.949299:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449668352 00000100:00100000:0.0:1762166974.949301:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449668352 00000100:00100000:0.0:1762166974.949309:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449668096 00000100:00100000:0.0:1762166974.949311:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449668096 00000100:00100000:0.0:1762166974.949323:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18607 00000100:00100000:0.0:1762166974.949330:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+18:3635:x1847765449667328:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166974.949536:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1762166974.949554:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc6cd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449668224:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1762166974.949556:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+20:3635:x1847765449667328:12345-0@lo:2:osp-syn-1-1.0 Request processed in 222us (662us total) trans 17179876074 rc 0/0 00000100:00100000:0.0:1762166974.949574:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18607 00000100:00100000:0.0:1762166974.949591:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449667712 00000100:00100000:0.0:1762166974.949594:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449667712 00000100:00100000:0.0:1762166974.949621:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18609 00000100:00100000:0.0:1762166974.949635:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+17:3635:x1847765449667840:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166974.949642:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1762166974.949718:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc582d180/2, rc 0, transno 17179876073 00002000:00010000:0.0:1762166974.949729:0:35247:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:3.0:1762166974.949732:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc582d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449667072:0@lo:2:osp-syn-1-1.0 00002000:00010000:0.0:1762166974.949733:0:35247:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb mtime from disk: 1762166966 -> 1762166966 00002000:00010000:0.0:1762166974.949746:0:35247:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1762166974.949752:0:35247:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb ctime from disk: 1762166966 -> 1762166966 00002000:00010000:0.0:1762166974.949758:0:35247:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166974.949792:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449667456 00000100:00100000:0.0:1762166974.949802:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+19:3635:x1847765449667840:12345-0@lo:2:osp-syn-0-1.0 Request processed in 171us (783us total) trans 21474843095 rc 0/0 00000100:00100000:3.0:1762166974.949804:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449667456 00000100:00100000:0.0:1762166974.949818:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18609 00000100:00100000:0.0:1762166974.949845:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18612 00000100:00100000:0.0:1762166974.949857:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcceb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+18:3633:x1847765449668096:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166974.949864:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18613 00000100:00100000:3.0:1762166974.949892:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc582f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+21:3634:x1847765449667200:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:0.0:1762166974.949936:0:35247:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa83:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166974.949939:0:35247:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa83:0x0] updating lvb mtime from disk: 1762166974 -> 1762166974 00002000:00010000:0.0:1762166974.949941:0:35247:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa83:0x0] updating lvb atime from disk: 1762166972 -> 1762166972 00002000:00010000:0.0:1762166974.949944:0:35247:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa83:0x0] updating lvb ctime from disk: 1762166974 -> 1762166974 00002000:00010000:0.0:1762166974.949946:0:35247:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa83:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1762166974.949978:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcceb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+19:3633:x1847765449668096:12345-0@lo:2:osp-syn-0-1.0 Request processed in 126us (781us total) trans 21474843096 rc 0/0 00000100:00100000:0.0:1762166974.949985:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18612 00000100:00100000:0.0:1762166974.949998:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18615 00000100:00100000:0.0:1762166974.950007:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+20:3636:x1847765449666944:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1762166974.950020:0:35247:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:2689 count 1 00010000:00010000:0.0:1762166974.950037:0:35247:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effba948e lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa81:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166974.950053:0:35247:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effba77d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e89fe expref: 26 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166974.950060:0:35247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166974.950063:0:35247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166974.950066:0:35247:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effba948e lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0xa81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166974.950095:0:35247:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effba77d8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e89fe expref: 26 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166974.950107:0:35247:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effba77d8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e89fe expref: 26 pid: 8383 timeout: 694 lvb_type: 0 00000100:00100000:0.0:1762166974.950121:0:35247:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:35247:1847765449668608:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166974.950144:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc582f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+21:3634:x1847765449667200:12345-0@lo:2:osp-syn-1-1.0 Request processed in 251us (981us total) trans 17179876076 rc 0/0 00000100:00100000:0.0:1762166974.950148:0:35247:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bca7930c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166974.950162:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18613 00010000:00010000:0.0:1762166974.950171:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effba9480 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166974.950181:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effba9480 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166974.950190:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effba9480 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166974.950196:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdf200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166974.950201:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effba9480 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166974.950208:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effba9480 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166974.950218:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166974.950222:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166974.950226:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effba9480 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166974.950232:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effba9480 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000100:00100000:3.0:1762166974.950260:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1762166974.950338:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc6224700/2, rc 0, transno 21474843095 00000100:00100000:3.0:1762166974.950353:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc6224700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449667840:0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1762166974.950397:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc5804700/2, rc 0, transno 21474843097 00000100:00100000:3.0:1762166974.950407:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5804700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449668352:0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1762166974.950429:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc582dc00/2, rc 0, transno 17179876074 00000100:00100000:3.0:1762166974.950436:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc582dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449667328:0@lo:2:osp-syn-1-1.0 00000004:00080000:0.0:1762166974.950582:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc6cd2300/2, rc 0, transno 21474843099 00000100:00100000:0.0:1762166974.950586:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc6cd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449667968:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1762166974.951949:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166974.951987:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166974.952022:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166974.952080:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9417 00000100:00100000:0.0:1762166974.952096:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+27:2419:x1847765450275712:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166974.952111:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166974.952121:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effba77d8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e89fe expref: 27 pid: 8383 timeout: 694 lvb_type: 0 00010000:00010000:0.0:1762166974.952147:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effba77d8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e89fe expref: 27 pid: 8383 timeout: 694 lvb_type: 0 00010000:00010000:0.0:1762166974.952175:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effba77d8 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa81:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e89fe expref: 27 pid: 8383 timeout: 694 lvb_type: 0 00010000:00010000:0.0:1762166974.952191:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166974.952195:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166974.952200:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effba948e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166974.952225:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effba948e lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xa81:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166974.952270:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166974.952311:0:35247:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effba948e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.952336:0:35247:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effba948e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166974.952338:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765450275712:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 242us (384us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166974.952386:0:35247:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effba948e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166974.952389:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9417 00010000:00010000:3.0:1762166974.952441:0:35247:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effba948e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166974.952518:0:10256:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1762166974.952527:0:10256:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc4b99400/0x2f180c4effba9487 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166974.952536:0:10256:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4b99400 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166974.952541:0:10256:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4b99400/0x2f180c4effba9487 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166974.952549:0:10256:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4b99400/0x2f180c4effba9487 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166974.952561:0:10256:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc4b99400/0x2f180c4effba9487 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166974.952569:0:10256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4b99400/0x2f180c4effba9487 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166974.952587:0:10256:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1762166974.952591:0:10256:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effba948e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166974.952598:0:10256:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdec00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166974.952601:0:10256:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effba948e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166974.952611:0:10256:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effba948e lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166974.952622:0:10256:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effba948e lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166974.952631:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166974.952633:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166974.952635:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166974.952641:0:35247:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1762166974.952650:0:35247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effba948e lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166974.953052:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+21:3636:x1847765449666944:12345-0@lo:6:osp-syn-1-1.0 Request processed in 3044us (3454us total) trans 17179876078 rc 0/0 00000100:00100000:3.0:1762166974.953064:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18615 00010000:00010000:3.0:1762166974.953106:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1762166974.953400:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bccb7df80/2, rc 0, transno 21474843100 00000100:00100000:0.0:1762166974.953407:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bccb7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449667712:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1762166974.954036:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.957053:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450276096 00000100:00100000:3.0:1762166974.957064:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450276096 00000100:00100000:0.0:1762166974.957157:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18619 00000100:00100000:0.0:1762166974.957176:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+27:2418:x1847765450275968:12345-192.168.204.38@tcp:101:lfs.0 00000100:00100000:3.0:1762166974.957192:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18621 00010000:00010000:0.0:1762166974.957200:0:8380:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1762166974.957207:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+27:2418:x1847765450276224:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166974.957222:0:35247:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166974.957225:0:8380:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde000/0x2f180c4effba94aa lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9446 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166974.957244:0:35247:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8472800/0x2f180c4effba94b1 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9454 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166974.957258:0:8380:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa77:0x0] initial LVB size: 247907, mtime: 0x690888bf, atime: 0x690888bf, ctime: 0x690888bf, blocks: 0x1b8 00010000:00010000:0.0:1762166974.957282:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166974.957287:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166974.957300:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde000/0x2f180c4effba94aa lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9446 expref: 28 pid: 8380 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166974.957329:0:8380:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde000/0x2f180c4effba94aa lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9446 expref: 29 pid: 8380 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166974.957369:0:8380:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bde000, rc 0) 00000100:00100000:0.0:1762166974.957455:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+29:2418:x1847765450275968:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 272us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166974.957570:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18619 00000100:00100000:0.0:1762166974.982603:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.984062:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166974.985744:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.991836:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166974.993941:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166974.999091:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.004261:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166975.005680:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.011180:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166975.012302:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00080000:3.0:1762166975.012422:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1762166975.014970:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.015007:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166975.015059:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450278016 00000100:00100000:3.0:1762166975.015065:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450278016 00002000:00010000:3.0:1762166975.015085:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2690 (73728->18446744073709551615) 00002000:00100000:3.0:1762166975.015091:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf783c380 with x1847765450278016 ext(73728->18446744073709551615) 00002000:00010000:3.0:1762166975.015097:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf783c380. 00000100:00100000:3.0:1762166975.015121:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1850 00000100:00100000:3.0:1762166975.015130:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450278016:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:3.0:1762166975.015510:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa82:0x0] updating lvb size from disk: 213214 -> 73728 00002000:00010000:3.0:1762166975.015514:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa82:0x0] updating lvb mtime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166975.015517:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa82:0x0] updating lvb atime from disk: 1762166972 -> 1762166972 00002000:00010000:3.0:1762166975.015520:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa82:0x0] updating lvb ctime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166975.015522:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa82:0x0] updating lvb blocks from disk: 216 -> 144 00000100:00100000:3.0:1762166975.015553:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450278016:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 426us (547us total) trans 17179876081 rc 0/0 00000100:00100000:3.0:1762166975.015560:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1850 00002000:00010000:3.0:1762166975.015564:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2690 (73728->18446744073709551615) 00002000:00100000:3.0:1762166975.015567:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf783c380 with x1847765450278016 ext(73728->18446744073709551615) 00002000:00010000:3.0:1762166975.015572:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf783c380. 00000100:00100000:0.0:1762166975.016282:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.017627:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.019604:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.019637:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166975.019657:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450278912 00000100:00100000:3.0:1762166975.019664:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450278912 00002000:00010000:3.0:1762166975.019687:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2693 (0->18446744073709551615) 00002000:00100000:3.0:1762166975.019691:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf783f480 with x1847765450278912 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166975.019699:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf783f480. 00000100:00100000:3.0:1762166975.019730:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1852 00000100:00100000:3.0:1762166975.019738:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450278912:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:3.0:1762166975.019818:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166975.019822:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb mtime from disk: 1762166974 -> 1762166975 00002000:00010000:3.0:1762166975.019824:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb atime from disk: 1762166973 -> 1762166973 00002000:00010000:3.0:1762166975.019827:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb ctime from disk: 1762166974 -> 1762166975 00002000:00010000:3.0:1762166975.019828:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166975.019861:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450278912:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 124us (258us total) trans 17179876082 rc 0/0 00000100:00100000:3.0:1762166975.019869:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1852 00002000:00010000:3.0:1762166975.019873:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2693 (0->18446744073709551615) 00002000:00100000:3.0:1762166975.019876:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf783f480 with x1847765450278912 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166975.019881:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf783f480. 00000100:00100000:0.0:1762166975.020865:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.022570:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.025005:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.026206:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166975.027329:0:6479:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bccb7c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6479:1847765449668992:192.168.204.38@tcp:105: 00010000:00010000:3.0:1762166975.027342:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166975.027429:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce77100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450279680:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1118us (1223us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166975.027438:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9420 00000100:00100000:0.0:1762166975.027568:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.027607:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166975.027638:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450279936 00000100:00100000:3.0:1762166975.027644:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450279936 00002000:00010000:3.0:1762166975.027662:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2695 (0->18446744073709551615) 00002000:00100000:3.0:1762166975.027667:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bcce74000 with x1847765450279936 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166975.027673:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bcce74000. 00000100:00100000:3.0:1762166975.027701:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1854 00000100:00100000:3.0:1762166975.027710:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450279936:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:3.0:1762166975.027819:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa87:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166975.027822:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa87:0x0] updating lvb mtime from disk: 1762166974 -> 1762166975 00002000:00010000:3.0:1762166975.027824:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa87:0x0] updating lvb atime from disk: 1762166974 -> 1762166974 00002000:00010000:3.0:1762166975.027826:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa87:0x0] updating lvb ctime from disk: 1762166974 -> 1762166975 00002000:00010000:3.0:1762166975.027828:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa87:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166975.027855:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450279936:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 147us (249us total) trans 21474843104 rc 0/0 00000100:00100000:3.0:1762166975.027860:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1854 00002000:00010000:3.0:1762166975.027863:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2695 (0->18446744073709551615) 00002000:00100000:3.0:1762166975.027865:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bcce74000 with x1847765450279936 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166975.027869:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bcce74000. 00000100:00100000:0.0:1762166975.028913:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.030702:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166975.033454:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450280448 00000100:00100000:3.0:1762166975.033460:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450280448 00010000:00010000:3.0:1762166975.033494:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29000/0x2f180c4effba94f0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9462 expref: 23 pid: 8380 timeout: 694 lvb_type: 0 00000100:00100000:3.0:1762166975.033520:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9421 00000100:00100000:3.0:1762166975.033526:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945d011eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765450280448:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166975.033534:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166975.033546:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29000/0x2f180c4effba94f0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9462 expref: 23 pid: 8380 timeout: 694 lvb_type: 0 00010000:00010000:3.0:1762166975.033555:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29000/0x2f180c4effba94f0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9462 expref: 23 pid: 8380 timeout: 694 lvb_type: 0 00010000:00010000:3.0:1762166975.033568:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bcaa29000/0x2f180c4effba94f0 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9462 expref: 23 pid: 8380 timeout: 694 lvb_type: 0 00010000:00010000:3.0:1762166975.033576:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166975.033577:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166975.033580:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945cc7d16400/0x2f180c4effba954b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 3 type: EXT [131072->139263] (req 131072->139263) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.033586:0:6479:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc7d16400/0x2f180c4effba954b lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 3 type: EXT [131072->139263] (req 131072->139263) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.033603:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166975.033626:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945d011eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450280448:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 101us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166975.033632:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9421 00000100:00100000:3.0:1762166975.037780:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450280704 00000100:00100000:3.0:1762166975.037785:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450280704 00010000:00010000:3.0:1762166975.037807:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bcc8fa200/0x2f180c4effba950c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9470 expref: 21 pid: 8380 timeout: 694 lvb_type: 0 00000100:00100000:3.0:1762166975.037839:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9422 00000100:00100000:3.0:1762166975.037847:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945d011ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450280704:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166975.037859:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166975.037874:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bcc8fa200/0x2f180c4effba950c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9470 expref: 21 pid: 8380 timeout: 694 lvb_type: 0 00010000:00010000:3.0:1762166975.037886:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bcc8fa200/0x2f180c4effba950c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9470 expref: 21 pid: 8380 timeout: 694 lvb_type: 0 00010000:00010000:3.0:1762166975.037905:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bcc8fa200/0x2f180c4effba950c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9470 expref: 21 pid: 8380 timeout: 694 lvb_type: 0 00010000:00010000:3.0:1762166975.037918:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166975.037920:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166975.037939:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc42d1200/0x2f180c4effba9552 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [131072->139263] (req 131072->139263) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.037947:0:6479:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc42d1200/0x2f180c4effba9552 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [131072->139263] (req 131072->139263) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.037971:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166975.038009:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945d011ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450280704:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 160us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166975.038019:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9422 00000100:00100000:3.0:1762166975.041819:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450280960 00000100:00100000:3.0:1762166975.041826:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450280960 00010000:00010000:3.0:1762166975.041853:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bcc8fa000/0x2f180c4effba9528 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e947e expref: 19 pid: 8380 timeout: 694 lvb_type: 0 00000100:00100000:3.0:1762166975.041883:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9423 00000100:00100000:3.0:1762166975.041892:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450280960:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166975.041908:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166975.041940:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bcc8fa000/0x2f180c4effba9528 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e947e expref: 19 pid: 8380 timeout: 694 lvb_type: 0 00010000:00010000:3.0:1762166975.041951:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bcc8fa000/0x2f180c4effba9528 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e947e expref: 19 pid: 8380 timeout: 694 lvb_type: 0 00010000:00010000:3.0:1762166975.041970:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bcc8fa000/0x2f180c4effba9528 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e947e expref: 19 pid: 8380 timeout: 694 lvb_type: 0 00010000:00010000:3.0:1762166975.041987:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166975.041988:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166975.041992:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bcc8fac00/0x2f180c4effba9559 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 3 type: EXT [131072->139263] (req 131072->139263) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.042001:0:6479:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bcc8fac00/0x2f180c4effba9559 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 3 type: EXT [131072->139263] (req 131072->139263) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.042021:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166975.042066:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450280960:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 168us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166975.042075:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9423 00000100:00100000:0.0:1762166975.046125:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.047568:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.050176:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.050211:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166975.050248:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450281856 00000100:00100000:3.0:1762166975.050254:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450281856 00002000:00010000:3.0:1762166975.050277:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2691 (0->18446744073709551615) 00002000:00100000:3.0:1762166975.050286:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bcce76300 with x1847765450281856 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166975.050297:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bcce76300. 00000100:00100000:3.0:1762166975.050323:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1859 00000100:00100000:3.0:1762166975.050331:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+16:2419:x1847765450281856:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:3.0:1762166975.050458:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa83:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166975.050461:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa83:0x0] updating lvb mtime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166975.050463:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa83:0x0] updating lvb atime from disk: 1762166972 -> 1762166972 00002000:00010000:3.0:1762166975.050465:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa83:0x0] updating lvb ctime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166975.050467:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa83:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166975.050535:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450281856:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 203us (323us total) trans 21474843106 rc 0/0 00000100:00100000:3.0:1762166975.050546:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1859 00002000:00010000:3.0:1762166975.050550:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2691 (0->18446744073709551615) 00002000:00100000:3.0:1762166975.050553:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bcce76300 with x1847765450281856 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166975.050557:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bcce76300. 00000100:00100000:0.0:1762166975.051580:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.054671:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.055962:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.056285:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.057695:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.059579:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.062047:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.062080:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166975.062144:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450283392 00000100:00100000:3.0:1762166975.062160:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450283392 00002000:00010000:3.0:1762166975.062204:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2695 (0->18446744073709551615) 00002000:00100000:3.0:1762166975.062210:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bcce74e00 with x1847765450283392 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166975.062232:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bcce74e00. 00000100:00100000:3.0:1762166975.062286:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1864 00000100:00100000:3.0:1762166975.062305:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+19:2416:x1847765450283392:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:3.0:1762166975.062523:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa87:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166975.062526:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa87:0x0] updating lvb mtime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166975.062528:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa87:0x0] updating lvb atime from disk: 1762166974 -> 1762166974 00002000:00010000:3.0:1762166975.062530:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa87:0x0] updating lvb ctime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166975.062532:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa87:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166975.062584:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+20:2416:x1847765450283392:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 289us (505us total) trans 21474843108 rc 0/0 00000100:00100000:3.0:1762166975.062590:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1864 00002000:00010000:3.0:1762166975.062593:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2695 (0->18446744073709551615) 00002000:00100000:3.0:1762166975.062595:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bcce74e00 with x1847765450283392 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166975.062599:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bcce74e00. 00000100:00100000:0.0:1762166975.063578:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.065531:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166975.065629:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450283648 00000100:00100000:3.0:1762166975.065635:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450283648 00000100:00100000:3.0:1762166975.065688:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1865 00000100:00100000:3.0:1762166975.065699:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765450283648:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:3.0:1762166975.065729:0:23942:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8472a00/0x2f180c4effba95b4 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.065742:0:23942:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166975.065745:0:23942:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166975.065750:0:23942:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472a00/0x2f180c4effba95b4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [172032->233471] (req 172032->233471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.065761:0:23942:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8472a00/0x2f180c4effba95b4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [172032->233471] (req 172032->233471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.066937:0:23942:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8472a00/0x2f180c4effba95b4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [172032->233471] (req 172032->233471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.066951:0:23942:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472a00/0x2f180c4effba95b4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [172032->233471] (req 172032->233471) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.066957:0:23942:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc8472a00/0x2f180c4effba95b4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [172032->233471] (req 172032->233471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.066961:0:23942:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8472a00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166975.066964:0:23942:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8472a00/0x2f180c4effba95b4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [172032->233471] (req 172032->233471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.066970:0:23942:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8472a00/0x2f180c4effba95b4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [172032->233471] (req 172032->233471) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.066982:0:23942:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc8472a00/0x2f180c4effba95b4 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [172032->233471] (req 172032->233471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.066987:0:23942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8472a00/0x2f180c4effba95b4 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [172032->233471] (req 172032->233471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166975.067053:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765450283648:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 1354us (1523us total) trans 0 rc 61440/61440 00000100:00100000:3.0:1762166975.067064:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1865 00000100:00100000:0.0:1762166975.068621:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166975.068671:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450283776 00000100:00100000:3.0:1762166975.068677:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450283776 00000100:00100000:3.0:1762166975.068722:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1866 00000100:00100000:3.0:1762166975.068731:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450283776:12345-192.168.204.38@tcp:4:lfs.0 00010000:00010000:3.0:1762166975.068759:0:23942:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effba95bb lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.068777:0:23942:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bcc8fa400/0x2f180c4effba9567 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9493 expref: 22 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.068785:0:23942:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166975.068787:0:23942:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166975.068790:0:23942:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effba95bb lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 3 type: EXT [172032->233471] (req 172032->233471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.068829:0:23942:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bcc8fa400/0x2f180c4effba9567 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9493 expref: 22 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.068845:0:23942:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bcc8fa400/0x2f180c4effba9567 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9493 expref: 22 pid: 8380 timeout: 694 lvb_type: 0 00000100:00100000:3.0:1762166975.068867:0:23942:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bb9500 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_009:lustre-OST0001_UUID:23942:1847765449669504:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166975.068963:0:23942:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166975.069698:0:23942:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bb9500 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_009:lustre-OST0001_UUID:23942:1847765449669504:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166975.069722:0:23942:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effba95bb lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 3 type: EXT [172032->233471] (req 172032->233471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166975.069836:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166975.069867:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450283904 00000100:00100000:3.0:1762166975.069897:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450283904 00010000:00010000:3.0:1762166975.069913:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bcc8fa400/0x2f180c4effba9567 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9493 expref: 23 pid: 8380 timeout: 694 lvb_type: 0 00000100:00100000:3.0:1762166975.069949:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9424 00000100:00100000:3.0:1762166975.069959:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce76a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765450283904:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166975.069972:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166975.069993:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bcc8fa400/0x2f180c4effba9567 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9493 expref: 23 pid: 8380 timeout: 694 lvb_type: 0 00010000:00010000:3.0:1762166975.070005:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bcc8fa400/0x2f180c4effba9567 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9493 expref: 23 pid: 8380 timeout: 694 lvb_type: 0 00010000:00010000:3.0:1762166975.070024:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bcc8fa400/0x2f180c4effba9567 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9493 expref: 23 pid: 8380 timeout: 694 lvb_type: 0 00010000:00010000:3.0:1762166975.070034:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166975.070036:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166975.070039:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effba95bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 3 type: EXT [172032->233471] (req 172032->233471) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.070046:0:6479:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effba95bb lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 3 type: EXT [172032->233471] (req 172032->233471) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.070072:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166975.070097:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce76a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450283904:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 141us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166975.070103:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9424 00000100:00100000:0.0:1762166975.074230:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.075698:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166975.075818:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450284160 00000100:00100000:3.0:1762166975.075824:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450284160 00010000:00010000:3.0:1762166975.075852:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc42d1200/0x2f180c4effba9583 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e94a1 expref: 21 pid: 8380 timeout: 694 lvb_type: 0 00000100:00100000:3.0:1762166975.075887:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9425 00000100:00100000:3.0:1762166975.075896:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4010e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450284160:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166975.075912:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166975.075943:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc42d1200/0x2f180c4effba9583 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e94a1 expref: 21 pid: 8380 timeout: 694 lvb_type: 0 00010000:00010000:3.0:1762166975.075956:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc42d1200/0x2f180c4effba9583 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e94a1 expref: 21 pid: 8380 timeout: 694 lvb_type: 0 00010000:00010000:3.0:1762166975.075976:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc42d1200/0x2f180c4effba9583 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e94a1 expref: 21 pid: 8380 timeout: 694 lvb_type: 0 00010000:00010000:3.0:1762166975.075993:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166975.075994:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166975.075998:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945cf3cac200/0x2f180c4effba95c2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [172032->233471] (req 172032->233471) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.076005:0:6479:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cf3cac200/0x2f180c4effba95c2 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [172032->233471] (req 172032->233471) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.076030:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166975.076071:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4010e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450284160:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 175us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166975.076083:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9425 00000100:00100000:0.0:1762166975.080578:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.082014:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166975.082081:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450284416 00000100:00100000:3.0:1762166975.082087:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450284416 00010000:00010000:3.0:1762166975.082109:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945ceda5f600/0x2f180c4effba959f lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e94af expref: 19 pid: 8380 timeout: 694 lvb_type: 0 00000100:00100000:3.0:1762166975.082140:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9426 00000100:00100000:3.0:1762166975.082149:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cceb4a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450284416:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166975.082160:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166975.082178:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945ceda5f600/0x2f180c4effba959f lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e94af expref: 19 pid: 8380 timeout: 694 lvb_type: 0 00010000:00010000:3.0:1762166975.082190:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945ceda5f600/0x2f180c4effba959f lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e94af expref: 19 pid: 8380 timeout: 694 lvb_type: 0 00010000:00010000:3.0:1762166975.082216:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945ceda5f600/0x2f180c4effba959f lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e94af expref: 19 pid: 8380 timeout: 694 lvb_type: 0 00010000:00010000:3.0:1762166975.082228:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166975.082230:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166975.082234:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945cc7d16400/0x2f180c4effba95c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 3 type: EXT [172032->233471] (req 172032->233471) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.082243:0:6479:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc7d16400/0x2f180c4effba95c9 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 3 type: EXT [172032->233471] (req 172032->233471) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.082265:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166975.082301:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cceb4a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450284416:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 151us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166975.082313:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9426 00000100:00100000:0.0:1762166975.086024:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.087434:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.088700:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.089775:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.089881:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166975.089936:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450285184 00000100:00100000:3.0:1762166975.089942:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450285184 00002000:00010000:3.0:1762166975.089960:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2691 (0->18446744073709551615) 00002000:00100000:3.0:1762166975.089963:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4012a00 with x1847765450285184 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166975.089970:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc4012a00. 00000100:00100000:3.0:1762166975.089994:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1870 00000100:00100000:3.0:1762166975.090003:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4012a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+16:2418:x1847765450285184:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:3.0:1762166975.090084:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa83:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166975.090087:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa83:0x0] updating lvb mtime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166975.090089:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa83:0x0] updating lvb atime from disk: 1762166972 -> 1762166972 00002000:00010000:3.0:1762166975.090091:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa83:0x0] updating lvb ctime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166975.090094:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa83:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166975.090117:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4012a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450285184:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 116us (242us total) trans 21474843110 rc 0/0 00000100:00100000:3.0:1762166975.090126:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1870 00002000:00010000:3.0:1762166975.090129:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2691 (0->18446744073709551615) 00002000:00100000:3.0:1762166975.090133:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4012a00 with x1847765450285184 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166975.090138:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc4012a00. 00000100:00100000:0.0:1762166975.090982:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.092705:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.094013:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.094044:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166975.094077:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450285696 00000100:00100000:3.0:1762166975.094091:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450285696 00002000:00010000:3.0:1762166975.094127:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2690 (247907->18446744073709551615) 00002000:00100000:3.0:1762166975.094132:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4013480 with x1847765450285696 ext(247907->18446744073709551615) 00002000:00010000:3.0:1762166975.094143:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4013480. 00000100:00100000:3.0:1762166975.094177:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1871 00000100:00100000:3.0:1762166975.094187:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4013480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450285696:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:3.0:1762166975.094397:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa82:0x0] updating lvb size from disk: 233472 -> 247907 00002000:00010000:3.0:1762166975.094402:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa82:0x0] updating lvb mtime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166975.094405:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa82:0x0] updating lvb atime from disk: 1762166972 -> 1762166972 00002000:00010000:3.0:1762166975.094406:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa82:0x0] updating lvb ctime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166975.094408:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa82:0x0] updating lvb blocks from disk: 280 -> 280 00000100:00100000:3.0:1762166975.094521:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4013480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450285696:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 335us (509us total) trans 17179876092 rc 0/0 00000100:00100000:3.0:1762166975.094528:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1871 00002000:00010000:3.0:1762166975.094532:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2690 (247907->18446744073709551615) 00002000:00100000:3.0:1762166975.094534:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4013480 with x1847765450285696 ext(247907->18446744073709551615) 00002000:00010000:3.0:1762166975.094539:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4013480. 00000100:00100000:0.0:1762166975.095343:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.096844:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.098069:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.099098:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166975.099189:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450286464 00000100:00100000:3.0:1762166975.099194:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450286464 00002000:00010000:3.0:1762166975.099214:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2694 (233472->18446744073709551615) 00002000:00100000:3.0:1762166975.099219:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4012680 with x1847765450286464 ext(233472->18446744073709551615) 00002000:00010000:3.0:1762166975.099225:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc4012680. 00000100:00100000:0.0:1762166975.099230:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166975.099298:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450286592 00000100:00100000:3.0:1762166975.099303:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450286592 00002000:00010000:3.0:1762166975.099322:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2693 (0->18446744073709551615) 00002000:00100000:3.0:1762166975.099328:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4010000 with x1847765450286592 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166975.099339:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4010000. 00000100:00100000:3.0:1762166975.099367:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1874 00000100:00100000:3.0:1762166975.099379:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4010000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:2417:x1847765450286592:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:3.0:1762166975.099466:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166975.099474:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb mtime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166975.099509:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb atime from disk: 1762166973 -> 1762166973 00002000:00010000:3.0:1762166975.099512:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb ctime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166975.099515:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166975.099547:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4010000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:2417:x1847765450286592:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 168us (316us total) trans 17179876093 rc 0/0 00000100:00100000:3.0:1762166975.099560:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1874 00002000:00010000:3.0:1762166975.099566:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2693 (0->18446744073709551615) 00002000:00100000:3.0:1762166975.099569:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4010000 with x1847765450286592 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166975.099575:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4010000. 00000100:00100000:0.0:1762166975.100467:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.102087:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.103423:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166975.103508:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450287104 00000100:00100000:3.0:1762166975.103514:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450287104 00002000:00010000:3.0:1762166975.103536:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2694 (247907->18446744073709551615) 00002000:00100000:3.0:1762166975.103541:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945ceda2f100 with x1847765450287104 ext(247907->18446744073709551615) 00000100:00100000:0.0:1762166975.103549:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00002000:00010000:3.0:1762166975.103550:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945ceda2f100. 00000100:00100000:3.0:1762166975.103584:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450287232 00000100:00100000:3.0:1762166975.103588:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450287232 00002000:00010000:3.0:1762166975.103646:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2693 (0->18446744073709551615) 00002000:00100000:3.0:1762166975.103651:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945ceda2fb80 with x1847765450287232 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166975.103657:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945ceda2fb80. 00000100:00100000:3.0:1762166975.103682:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1876 00000100:00100000:3.0:1762166975.103692:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450287232:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:3.0:1762166975.103776:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166975.103780:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb mtime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166975.103783:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb atime from disk: 1762166973 -> 1762166973 00002000:00010000:3.0:1762166975.103786:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb ctime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166975.103789:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166975.103832:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765450287232:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 139us (281us total) trans 17179876094 rc 0/0 00000100:00100000:3.0:1762166975.103846:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1876 00002000:00010000:3.0:1762166975.103853:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2693 (0->18446744073709551615) 00002000:00100000:3.0:1762166975.103859:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945ceda2fb80 with x1847765450287232 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166975.103867:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945ceda2fb80. 00000100:00100000:0.0:1762166975.104644:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.105829:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.106807:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.107703:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.107741:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166975.107819:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450288000 00000100:00100000:3.0:1762166975.107824:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450288000 00002000:00010000:3.0:1762166975.107846:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2695 (0->18446744073709551615) 00002000:00100000:3.0:1762166975.107853:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945ceda2d180 with x1847765450288000 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166975.107861:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945ceda2d180. 00000100:00100000:3.0:1762166975.107886:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1878 00000100:00100000:3.0:1762166975.107896:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:2417:x1847765450288000:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:3.0:1762166975.107992:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa87:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166975.107996:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa87:0x0] updating lvb mtime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166975.107999:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa87:0x0] updating lvb atime from disk: 1762166974 -> 1762166974 00002000:00010000:3.0:1762166975.108002:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa87:0x0] updating lvb ctime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166975.108004:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa87:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166975.108034:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+22:2417:x1847765450288000:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 139us (290us total) trans 21474843114 rc 0/0 00000100:00100000:3.0:1762166975.108046:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1878 00002000:00010000:3.0:1762166975.108050:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2695 (0->18446744073709551615) 00002000:00100000:3.0:1762166975.108054:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945ceda2d180 with x1847765450288000 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166975.108060:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945ceda2d180. 00000100:00100000:0.0:1762166975.108932:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.110468:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.111685:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.111705:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166975.111730:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450288640 00000100:00100000:3.0:1762166975.111738:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450288640 00002000:00010000:3.0:1762166975.111762:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2695 (0->18446744073709551615) 00002000:00100000:3.0:1762166975.111771:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945ceda2df80 with x1847765450288640 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166975.111779:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945ceda2df80. 00000100:00100000:3.0:1762166975.111828:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1880 00000100:00100000:3.0:1762166975.111841:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450288640:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:3.0:1762166975.111945:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa87:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166975.111949:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa87:0x0] updating lvb mtime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166975.111952:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa87:0x0] updating lvb atime from disk: 1762166974 -> 1762166974 00002000:00010000:3.0:1762166975.111956:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa87:0x0] updating lvb ctime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166975.111961:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa87:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166975.112012:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765450288640:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 169us (326us total) trans 21474843115 rc 0/0 00000100:00100000:3.0:1762166975.112036:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1880 00002000:00010000:3.0:1762166975.112043:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2695 (0->18446744073709551615) 00002000:00100000:3.0:1762166975.112047:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945ceda2df80 with x1847765450288640 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166975.112054:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945ceda2df80. 00000100:00100000:0.0:1762166975.117115:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.118616:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.119792:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166975.119883:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450289152 00000100:00100000:3.0:1762166975.119889:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450289152 00002000:00010000:3.0:1762166975.119918:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2690 (247907->18446744073709551615) 00000100:00100000:0.0:1762166975.119936:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00002000:00100000:3.0:1762166975.119939:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945ceda2e680 with x1847765450289152 ext(247907->18446744073709551615) 00002000:00010000:3.0:1762166975.119950:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945ceda2e680. 00000100:00100000:3.0:1762166975.120015:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1881 00000100:00100000:3.0:1762166975.120027:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+25:2416:x1847765450289152:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:3.0:1762166975.120149:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa82:0x0] updating lvb size from disk: 247907 -> 247907 00002000:00010000:3.0:1762166975.120154:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa82:0x0] updating lvb mtime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166975.120158:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa82:0x0] updating lvb atime from disk: 1762166972 -> 1762166972 00002000:00010000:3.0:1762166975.120164:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa82:0x0] updating lvb ctime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166975.120171:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa82:0x0] updating lvb blocks from disk: 280 -> 280 00000100:00100000:3.0:1762166975.120215:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+26:2416:x1847765450289152:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 188us (419us total) trans 17179876097 rc 0/0 00000100:00100000:3.0:1762166975.120232:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1881 00002000:00010000:3.0:1762166975.120238:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2690 (247907->18446744073709551615) 00002000:00100000:3.0:1762166975.120243:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945ceda2e680 with x1847765450289152 ext(247907->18446744073709551615) 00002000:00010000:3.0:1762166975.120249:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945ceda2e680. 00000100:00100000:0.0:1762166975.121032:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.122280:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.123584:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.123617:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166975.123630:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450289792 00000100:00100000:3.0:1762166975.123637:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450289792 00002000:00010000:3.0:1762166975.123660:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2694 (247907->18446744073709551615) 00002000:00100000:3.0:1762166975.123666:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4533480 with x1847765450289792 ext(247907->18446744073709551615) 00002000:00010000:3.0:1762166975.123675:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc4533480. 00000100:00100000:3.0:1762166975.123703:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1883 00000100:00100000:3.0:1762166975.123716:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4533480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+24:2418:x1847765450289792:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:3.0:1762166975.123804:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb size from disk: 247907 -> 247907 00002000:00010000:3.0:1762166975.123806:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb mtime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166975.123808:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb atime from disk: 1762166973 -> 1762166973 00002000:00010000:3.0:1762166975.123810:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb ctime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166975.123811:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb blocks from disk: 280 -> 280 00000100:00100000:3.0:1762166975.123842:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4533480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+25:2418:x1847765450289792:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 132us (260us total) trans 21474843117 rc 0/0 00000100:00100000:3.0:1762166975.123848:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1883 00002000:00010000:3.0:1762166975.123852:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2694 (247907->18446744073709551615) 00002000:00100000:3.0:1762166975.123856:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4533480 with x1847765450289792 ext(247907->18446744073709551615) 00002000:00010000:3.0:1762166975.123862:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc4533480. 00000100:00100000:0.0:1762166975.124709:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.126040:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.127123:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.127148:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166975.127189:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450290560 00000100:00100000:3.0:1762166975.127193:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450290560 00002000:00010000:3.0:1762166975.127205:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2695 (0->18446744073709551615) 00002000:00100000:3.0:1762166975.127208:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4530700 with x1847765450290560 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166975.127217:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc4530700. 00000100:00100000:3.0:1762166975.127238:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1885 00000100:00100000:3.0:1762166975.127245:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4530700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+25:2419:x1847765450290560:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:3.0:1762166975.127338:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa87:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166975.127342:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa87:0x0] updating lvb mtime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166975.127345:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa87:0x0] updating lvb atime from disk: 1762166974 -> 1762166974 00002000:00010000:3.0:1762166975.127348:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa87:0x0] updating lvb ctime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166975.127351:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa87:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166975.127383:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4530700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765450290560:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 137us (233us total) trans 21474843118 rc 0/0 00000100:00100000:3.0:1762166975.127391:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1885 00002000:00010000:3.0:1762166975.127394:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2695 (0->18446744073709551615) 00002000:00100000:3.0:1762166975.127397:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4530700 with x1847765450290560 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166975.127403:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc4530700. 00000100:00100000:0.0:1762166975.128204:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.129146:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.129172:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.129195:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.129247:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18639 00000100:00100000:0.0:1762166975.129256:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4531180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+29:2416:x1847765450290944:12345-192.168.204.38@tcp:2:lfs.0 00000100:00100000:3.0:1762166975.129267:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18640 00000100:00100000:3.0:1762166975.129280:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3e6a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+26:2417:x1847765450291072:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:0.0:1762166975.129345:0:28874:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 247907 -> 247907 00002000:00010000:0.0:1762166975.129350:0:28874:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166975 -> 1762166975 00002000:00010000:0.0:1762166975.129353:0:28874:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00002000:00010000:0.0:1762166975.129356:0:28874:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166975 -> 1762166975 00002000:00010000:0.0:1762166975.129358:0:28874:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 440 -> 440 00002000:00010000:3.0:1762166975.129368:0:8382:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166975.129371:0:8382:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166975.129373:0:8382:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166974 -> 1762166975 00002000:00010000:3.0:1762166975.129375:0:8382:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166975.129377:0:8382:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00000100:00100000:0.0:1762166975.129398:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4531180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+31:2416:x1847765450290944:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 141us (248us total) trans 17179876100 rc 0/0 00000100:00100000:3.0:1762166975.129407:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3e6a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+27:2417:x1847765450291072:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 129us (231us total) trans 21474843119 rc 0/0 00000100:00100000:0.0:1762166975.129415:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18639 00000100:00100000:3.0:1762166975.129436:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18640 00000100:00100000:0.0:1762166975.130135:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166975.130178:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450291456 00000100:00100000:3.0:1762166975.130184:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450291456 00000100:00100000:3.0:1762166975.130218:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11771 00000100:00100000:3.0:1762166975.130227:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4532a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+573:61830:x1847765450291456:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:3.0:1762166975.130260:0:19593:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x240000404:0x5eb:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effba945d lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 20 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9431 expref: 573 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.130297:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472a00/0x2f180c4effba969b lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 21 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166975.130309:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847f600/0x2f180c4effba9495 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 21 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9438 expref: 573 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.130319:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472a00/0x2f180c4effba969b lrc: 4/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 21 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166975.130354:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847f600/0x2f180c4effba9495 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 21 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9438 expref: 573 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.130365:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847f600/0x2f180c4effba9495 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 21 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9438 expref: 573 pid: 6494 timeout: 694 lvb_type: 0 00000100:00100000:3.0:1762166975.130377:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bb9500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449669888:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166975.130437:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1762166975.131062:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bb9500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449669888:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166975.131141:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472a00/0x2f180c4effba969b lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 21 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:0.0:1762166975.131202:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166975.131277:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450291584 00000100:00100000:3.0:1762166975.131281:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450291584 00010000:00010000:3.0:1762166975.131301:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847f600/0x2f180c4effba9495 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 21 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9438 expref: 574 pid: 6494 timeout: 694 lvb_type: 0 00000100:00100000:3.0:1762166975.131330:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9427 00000100:00100000:3.0:1762166975.131337:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4530380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+574:2418:x1847765450291584:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166975.131349:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166975.131355:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847f600/0x2f180c4effba9495 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 22 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9438 expref: 574 pid: 6494 timeout: 694 lvb_type: 0 00010000:00010000:3.0:1762166975.131367:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847f600/0x2f180c4effba9495 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 22 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9438 expref: 574 pid: 6494 timeout: 694 lvb_type: 0 00010000:00010000:3.0:1762166975.131381:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847f600/0x2f180c4effba9495 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 22 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9438 expref: 574 pid: 6494 timeout: 694 lvb_type: 0 00010000:00010000:3.0:1762166975.131394:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166975.131398:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472a00/0x2f180c4effba969b lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 21 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166975.131406:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472a00/0x2f180c4effba969b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 21 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166975.131412:0:6479:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472a00/0x2f180c4effba969b lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 21 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166975.131432:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166975.131460:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472a00/0x2f180c4effba969b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 20 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:3.0:1762166975.131465:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4530380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+573:2418:x1847765450291584:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 126us (261us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166975.131474:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472a00/0x2f180c4effba969b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 20 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:3.0:1762166975.131511:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9427 00000040:00080000:0.0:1762166975.131731:0:19593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5830, 88 off456024 00000004:00080000:0.0:1762166975.131743:0:19593:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 594280264691ns, next at 594522415006ns, rc = 0 00000040:00080000:0.0:1762166975.131787:0:19593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5829, 88 off456024 00000004:00080000:0.0:1762166975.131796:0:19593:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 594280318206ns, next at 594522388989ns, rc = 0 00000040:00080000:0.0:1762166975.131825:0:19593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5830, 88 off456112 00000004:00080000:0.0:1762166975.131832:0:19593:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 594280354003ns, next at 594522388989ns, rc = 0 00000040:00080000:0.0:1762166975.131849:0:19593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5831, 88 off456112 00000004:00080000:0.0:1762166975.131855:0:19593:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 594280377024ns, next at 594522415006ns, rc = 0 00000040:00080000:0.0:1762166975.131877:0:19593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5832, 88 off456200 00000004:00080000:0.0:1762166975.131883:0:19593:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 594280405248ns, next at 594522415006ns, rc = 0 00000040:00080000:0.0:1762166975.131902:0:19593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5831, 88 off456200 00000004:00080000:0.0:1762166975.131905:0:19593:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 594280427821ns, next at 594522388989ns, rc = 0 00000040:00080000:0.0:1762166975.131919:0:19593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5832, 88 off456288 00000004:00080000:0.0:1762166975.131934:0:19593:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 594280456706ns, next at 594522388989ns, rc = 0 00000040:00080000:0.0:1762166975.131944:0:19593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5833, 88 off456288 00000004:00080000:0.0:1762166975.131947:0:19593:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 594280469501ns, next at 594522415006ns, rc = 0 00000040:00080000:0.0:1762166975.131958:0:19593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5834, 88 off456376 00000004:00080000:0.0:1762166975.131960:0:19593:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 594280482728ns, next at 594522415006ns, rc = 0 00000040:00080000:0.0:1762166975.131966:0:19593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5833, 88 off456376 00000004:00080000:0.0:1762166975.131969:0:19593:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 594280491157ns, next at 594522388989ns, rc = 0 00000001:00080000:3.0:1762166975.132745:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294991741 is committed 00000004:00080000:3.0:1762166975.132752:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3203 committed 00000004:00080000:3.0:1762166975.132765:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3200 committed 00000004:00080000:3.0:1762166975.132778:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3199 committed 00010000:00010000:0.0:1762166975.132779:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa28a00/0x2f180c4effba94e9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00000004:00080000:3.0:1762166975.132784:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3202 committed 00000004:00080000:3.0:1762166975.132790:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3201 committed 00010000:00010000:0.0:1762166975.132793:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa28a00/0x2f180c4effba94e9 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00000004:00080000:3.0:1762166975.132798:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3198 committed 00000004:00080000:3.0:1762166975.132804:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3197 committed 00010000:00010000:0.0:1762166975.132804:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa28a00/0x2f180c4effba94e9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00000004:00080000:3.0:1762166975.132809:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3200 committed 00000004:00080000:3.0:1762166975.132816:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3199 committed 00010000:00010000:0.0:1762166975.132818:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa28a00 already unused, calling callback (ffffffffc18e2310) 00000004:00080000:3.0:1762166975.132821:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3196 committed 00010000:00010000:0.0:1762166975.132825:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa28a00/0x2f180c4effba94e9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.132834:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa28a00/0x2f180c4effba94e9 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.132848:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166975.132852:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166975.132856:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa28a00/0x2f180c4effba94e9 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.132869:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa28a00/0x2f180c4effba94e9 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.132892:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847e000/0x2f180c4effba9505 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.132900:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847e000/0x2f180c4effba9505 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.132908:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847e000/0x2f180c4effba9505 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00000020:00080000:3.0:1762166975.132915:0:7412:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0001: 41 batchid updated 00010000:00010000:0.0:1762166975.132931:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc847e000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166975.132936:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847e000/0x2f180c4effba9505 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.132943:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847e000/0x2f180c4effba9505 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.132955:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166975.132959:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166975.132963:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847e000/0x2f180c4effba9505 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.132975:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847e000/0x2f180c4effba9505 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.132991:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fba00/0x2f180c4effba9521 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.133000:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fba00/0x2f180c4effba9521 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00000100:00100000:3.0:1762166975.133001:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449670144 00000100:00100000:3.0:1762166975.133009:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449670144 00010000:00010000:0.0:1762166975.133010:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fba00/0x2f180c4effba9521 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.133018:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcc8fba00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166975.133022:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fba00/0x2f180c4effba9521 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.133029:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fba00/0x2f180c4effba9521 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.133043:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166975.133047:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166975.133050:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fba00/0x2f180c4effba9521 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000100:00100000:3.0:1762166975.133061:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449670656 00010000:00010000:0.0:1762166975.133061:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fba00/0x2f180c4effba9521 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000100:00100000:3.0:1762166975.133067:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449670656 00010000:00010000:0.0:1762166975.133080:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fb600/0x2f180c4effba9560 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.133088:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fb600/0x2f180c4effba9560 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.133096:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fb600/0x2f180c4effba9560 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00000100:00100000:3.0:1762166975.133099:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449671168 00010000:00010000:0.0:1762166975.133102:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcc8fb600 already unused, calling callback (ffffffffc18e2310) 00000100:00100000:3.0:1762166975.133104:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449671168 00010000:00010000:0.0:1762166975.133108:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fb600/0x2f180c4effba9560 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.133119:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fb600/0x2f180c4effba9560 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.133129:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166975.133137:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1762166975.133141:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18643 00010000:00010000:0.0:1762166975.133143:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fb600/0x2f180c4effba9560 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.133151:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fb600/0x2f180c4effba9560 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000100:00100000:3.0:1762166975.133157:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3633:x1847765449670656:12345-0@lo:2:osp-syn-1-1.0 00010000:00010000:0.0:1762166975.133167:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc3618200/0x2f180c4effba957c lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.133180:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc3618200/0x2f180c4effba957c lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.133188:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc3618200/0x2f180c4effba957c lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.133193:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc3618200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166975.133197:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc3618200/0x2f180c4effba957c lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.133204:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc3618200/0x2f180c4effba957c lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.133214:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166975.133217:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166975.133220:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc3618200/0x2f180c4effba957c lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.133226:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc3618200/0x2f180c4effba957c lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00002000:00010000:3.0:1762166975.133242:0:8382:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166975.133250:0:8382:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb mtime from disk: 1762166975 -> 1762166975 00010000:00010000:0.0:1762166975.133253:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cada00/0x2f180c4effba9598 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00002000:00010000:3.0:1762166975.133256:0:8382:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb atime from disk: 1762166973 -> 1762166973 00002000:00010000:3.0:1762166975.133265:0:8382:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb ctime from disk: 1762166975 -> 1762166975 00010000:00010000:0.0:1762166975.133268:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cada00/0x2f180c4effba9598 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00002000:00010000:3.0:1762166975.133271:0:8382:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00010000:0.0:1762166975.133281:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cada00/0x2f180c4effba9598 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.133286:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cada00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166975.133289:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cada00/0x2f180c4effba9598 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.133299:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cada00/0x2f180c4effba9598 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.133309:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166975.133312:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166975.133317:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cada00/0x2f180c4effba9598 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000100:00100000:3.0:1762166975.133329:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+8:3633:x1847765449670656:12345-0@lo:2:osp-syn-1-1.0 Request processed in 173us (294us total) trans 17179876103 rc 0/0 00010000:00010000:0.0:1762166975.133338:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cada00/0x2f180c4effba9598 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000100:00100000:3.0:1762166975.133349:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18643 00010000:00010000:0.0:1762166975.133355:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b98a00/0x2f180c4effba95d0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.133362:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b98a00/0x2f180c4effba95d0 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.133375:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b98a00/0x2f180c4effba95d0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00000100:00100000:3.0:1762166975.133378:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18646 00010000:00010000:0.0:1762166975.133387:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4b98a00 already unused, calling callback (ffffffffc18e2310) 00000100:00100000:3.0:1762166975.133393:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+8:3633:x1847765449670784:12345-0@lo:2:osp-syn-0-1.0 00010000:00010000:0.0:1762166975.133393:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b98a00/0x2f180c4effba95d0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.133412:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b98a00/0x2f180c4effba95d0 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.133428:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166975.133432:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166975.133435:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b98a00/0x2f180c4effba95d0 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.133441:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b98a00/0x2f180c4effba95d0 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.133456:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99000/0x2f180c4effba95ec lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.133468:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99000/0x2f180c4effba95ec lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.133504:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99000/0x2f180c4effba95ec lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00002000:00010000:3.0:1762166975.133511:0:8382:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa83:0x0] updating lvb size from disk: 0 -> 0 00010000:00010000:0.0:1762166975.133520:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4b99000 already unused, calling callback (ffffffffc18e2310) 00002000:00010000:3.0:1762166975.133521:0:8382:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa83:0x0] updating lvb mtime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166975.133526:0:8382:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa83:0x0] updating lvb atime from disk: 1762166972 -> 1762166972 00010000:00010000:0.0:1762166975.133527:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99000/0x2f180c4effba95ec lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00002000:00010000:3.0:1762166975.133533:0:8382:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa83:0x0] updating lvb ctime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166975.133541:0:8382:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa83:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00010000:0.0:1762166975.133542:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99000/0x2f180c4effba95ec lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.133554:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166975.133557:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166975.133561:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99000/0x2f180c4effba95ec lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.133577:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99000/0x2f180c4effba95ec lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000100:00100000:3.0:1762166975.133581:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+9:3633:x1847765449670784:12345-0@lo:2:osp-syn-0-1.0 Request processed in 190us (349us total) trans 21474843122 rc 0/0 00000100:00100000:3.0:1762166975.133598:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18646 00010000:00010000:0.0:1762166975.133604:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99200/0x2f180c4effba9601 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.133612:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99200/0x2f180c4effba9601 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.133619:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99200/0x2f180c4effba9601 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00000100:00100000:3.0:1762166975.133623:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449670400 00010000:00010000:0.0:1762166975.133626:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4b99200 already unused, calling callback (ffffffffc18e2310) 00000100:00100000:3.0:1762166975.133629:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449670400 00010000:00010000:0.0:1762166975.133632:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99200/0x2f180c4effba9601 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.133648:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99200/0x2f180c4effba9601 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00000100:00100000:3.0:1762166975.133662:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18647 00010000:00010000:0.0:1762166975.133662:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166975.133667:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166975.133670:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99200/0x2f180c4effba9601 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000100:00100000:3.0:1762166975.133677:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+7:3635:x1847765449670400:12345-0@lo:2:osp-syn-1-1.0 00010000:00010000:0.0:1762166975.133684:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99200/0x2f180c4effba9601 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.133699:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b98600/0x2f180c4effba961d lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.133710:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b98600/0x2f180c4effba961d lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.133718:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b98600/0x2f180c4effba961d lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.133732:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4b98600 already unused, calling callback (ffffffffc18e2310) 00002000:00010000:3.0:1762166975.133738:0:8382:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00010000:00010000:0.0:1762166975.133739:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b98600/0x2f180c4effba961d lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00002000:00010000:3.0:1762166975.133745:0:8382:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166975.133752:0:8382:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166975.133759:0:8382:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166975 -> 1762166975 00010000:00010000:0.0:1762166975.133760:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b98600/0x2f180c4effba961d lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00002000:00010000:3.0:1762166975.133762:0:8382:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00010000:0.0:1762166975.133777:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166975.133782:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166975.133786:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b98600/0x2f180c4effba961d lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.133798:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b98600/0x2f180c4effba961d lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000100:00100000:3.0:1762166975.133807:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+10:3635:x1847765449670400:12345-0@lo:2:osp-syn-1-1.0 Request processed in 133us (204us total) trans 17179876104 rc 0/0 00010000:00010000:0.0:1762166975.133819:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99400/0x2f180c4effba9632 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00000100:00100000:3.0:1762166975.133826:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18647 00010000:00010000:0.0:1762166975.133838:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99400/0x2f180c4effba9632 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.133849:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99400/0x2f180c4effba9632 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.133861:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4b99400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166975.133866:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99400/0x2f180c4effba9632 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00000100:00100000:3.0:1762166975.133872:0:3635:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 17179876078 gen 2 00010000:00010000:0.0:1762166975.133873:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99400/0x2f180c4effba9632 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00000004:00080000:3.0:1762166975.133879:0:3635:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc4492300, transno 17179876054 00010000:00010000:0.0:1762166975.133886:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166975.133892:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000004:00080000:3.0:1762166975.133893:0:3635:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 17179876058 committed transno 17179876078 00010000:00010000:0.0:1762166975.133898:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99400/0x2f180c4effba9632 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.133909:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99400/0x2f180c4effba9632 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000004:00080000:3.0:1762166975.133913:0:3635:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc558bb80, transno 17179876059 00000004:00080000:3.0:1762166975.133934:0:3635:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc558a300, transno 17179876060 00000004:00080000:3.0:1762166975.133942:0:3635:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc558b100, transno 17179876061 00010000:00010000:0.0:1762166975.133945:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b98e00/0x2f180c4effba964e lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00000004:00080000:3.0:1762166975.133948:0:3635:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc5589180, transno 17179876062 00000004:00080000:3.0:1762166975.133956:0:3635:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc6db9180, transno 17179876063 00010000:00010000:0.0:1762166975.133956:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b98e00/0x2f180c4effba964e lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00000004:00080000:3.0:1762166975.133962:0:3635:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc6dbb800, transno 17179876064 00010000:00010000:0.0:1762166975.133966:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b98e00/0x2f180c4effba964e lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00000004:00080000:3.0:1762166975.133968:0:3635:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc6dba680, transno 17179876065 00000004:00080000:3.0:1762166975.133977:0:3635:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 17179876072 committed transno 17179876078 00010000:00010000:0.0:1762166975.133981:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4b98e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166975.133987:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b98e00/0x2f180c4effba964e lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.133999:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b98e00/0x2f180c4effba964e lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00000004:00080000:3.0:1762166975.134006:0:3635:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc582d180, transno 17179876073 00000004:00080000:3.0:1762166975.134014:0:3635:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc582dc00, transno 17179876074 00010000:00010000:0.0:1762166975.134014:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00000004:00080000:3.0:1762166975.134021:0:3635:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc582c000, transno 17179876075 00000004:00080000:3.0:1762166975.134025:0:3635:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc582f800, transno 17179876076 00000004:00080000:3.0:1762166975.134028:0:3635:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc582c700, transno 17179876077 00010000:00010000:0.0:1762166975.134031:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000004:00080000:3.0:1762166975.134033:0:3635:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc582ce00, transno 17179876078 00010000:00010000:0.0:1762166975.134037:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b98e00/0x2f180c4effba964e lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000100:00100000:3.0:1762166975.134042:0:3635:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff945bc48ab100 x1847765449670400/t17179876104(17179876104) o2->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 440/432 e 0 to 0 dl 1762166991 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-1.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1762166975.134056:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b98e00/0x2f180c4effba964e lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000004:00080000:3.0:1762166975.134060:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc48ab100/2, rc 0, transno 17179876104 00000100:00100000:3.0:1762166975.134071:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc48ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449670400:0@lo:2:osp-syn-1-1.0 00010000:00010000:0.0:1762166975.134075:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99e00/0x2f180c4effba9663 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.134087:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99e00/0x2f180c4effba9663 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.134094:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99e00/0x2f180c4effba9663 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00000004:00080000:3.0:1762166975.134098:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc48a8000/2, rc 0, transno 17179876105 00010000:00010000:0.0:1762166975.134105:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4b99e00 already unused, calling callback (ffffffffc18e2310) 00000100:00100000:3.0:1762166975.134110:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc48a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449670912:0@lo:2:osp-syn-1-1.0 00010000:00010000:0.0:1762166975.134111:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99e00/0x2f180c4effba9663 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.134131:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99e00/0x2f180c4effba9663 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.134148:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166975.134153:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166975.134156:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99e00/0x2f180c4effba9663 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.134162:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99e00/0x2f180c4effba9663 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.134193:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c0800/0x2f180c4effba9678 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.134210:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c0800/0x2f180c4effba9678 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.134219:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c0800/0x2f180c4effba9678 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.134225:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c0800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166975.134232:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c0800/0x2f180c4effba9678 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00000004:00080000:3.0:1762166975.134242:0:9994:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0001: 0 changes, 5 in progress, 1 in flight, 14 done 00010000:00010000:0.0:1762166975.134253:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c0800/0x2f180c4effba9678 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.134289:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00000100:00100000:3.0:1762166975.134296:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449670016 00010000:00010000:0.0:1762166975.134296:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166975.134301:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c0800/0x2f180c4effba9678 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000100:00100000:3.0:1762166975.134302:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449670016 00010000:00010000:0.0:1762166975.134318:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c0800/0x2f180c4effba9678 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.134333:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bca743600/0x2f180c4effba968d lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00000100:00100000:3.0:1762166975.134336:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449671040 00010000:00010000:0.0:1762166975.134342:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bca743600/0x2f180c4effba968d lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00000100:00100000:3.0:1762166975.134343:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449671040 00010000:00010000:0.0:1762166975.134352:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bca743600/0x2f180c4effba968d lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.134364:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bca743600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166975.134369:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bca743600/0x2f180c4effba968d lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.134381:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bca743600/0x2f180c4effba968d lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00000100:00100000:3.0:1762166975.134385:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18650 00010000:00010000:0.0:1762166975.134398:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00000100:00100000:3.0:1762166975.134400:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+9:3636:x1847765449670528:12345-0@lo:2:osp-syn-1-1.0 00010000:00010000:0.0:1762166975.134404:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166975.134409:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bca743600/0x2f180c4effba968d lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.134416:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bca743600/0x2f180c4effba968d lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.134429:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c1a00/0x2f180c4effba9694 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.134435:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c1a00/0x2f180c4effba9694 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.134442:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c1a00/0x2f180c4effba9694 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.134457:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc95c1a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166975.134462:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c1a00/0x2f180c4effba9694 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00002000:00010000:3.0:1762166975.134471:0:9168:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa82:0x0] updating lvb size from disk: 247907 -> 247907 00010000:00010000:0.0:1762166975.134497:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c1a00/0x2f180c4effba9694 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00002000:00010000:3.0:1762166975.134504:0:9168:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa82:0x0] updating lvb mtime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166975.134509:0:9168:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa82:0x0] updating lvb atime from disk: 1762166972 -> 1762166972 00010000:00010000:0.0:1762166975.134511:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00002000:00010000:3.0:1762166975.134513:0:9168:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa82:0x0] updating lvb ctime from disk: 1762166975 -> 1762166975 00010000:00010000:0.0:1762166975.134517:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00002000:00010000:3.0:1762166975.134521:0:9168:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa82:0x0] updating lvb blocks from disk: 280 -> 280 00010000:00010000:0.0:1762166975.134523:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c1a00/0x2f180c4effba9694 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.134537:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc95c1a00/0x2f180c4effba9694 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000100:00100000:3.0:1762166975.134569:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+10:3636:x1847765449670528:12345-0@lo:2:osp-syn-1-1.0 Request processed in 172us (361us total) trans 17179876106 rc 0/0 00000100:00100000:3.0:1762166975.134578:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18650 00000100:00100000:0.0:1762166975.135548:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.136786:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450291968 00000100:00100000:0.0:1762166975.136791:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450291968 00000100:00100000:0.0:1762166975.136831:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11772 00000100:00100000:0.0:1762166975.136839:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+525:61830:x1847765450291968:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166975.136987:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+526:61830:x1847765450291968:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 149us (239us total) trans 4294991742 rc 0/0 00000100:00100000:0.0:1762166975.136991:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11772 00000100:00100000:0.0:1762166975.145237:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.170932:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:3.0:1762166975.172648:0:23942:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945cd1af1200/0x2f180c4effba96ef lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->249855] (req 0->249855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.172665:0:23942:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945cd1af1200/0x2f180c4effba96ef lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->249855] (req 0->249855) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.172674:0:23942:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945cd1af1200/0x2f180c4effba96ef lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->249855] (req 0->249855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.172681:0:23942:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cd1af1200 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166975.172685:0:23942:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945cd1af1200/0x2f180c4effba96ef lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->249855] (req 0->249855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.172693:0:23942:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945cd1af1200/0x2f180c4effba96ef lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->249855] (req 0->249855) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.172712:0:23942:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945cd1af1200/0x2f180c4effba96ef lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->249855] (req 0->249855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.172719:0:23942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cd1af1200/0x2f180c4effba96ef lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->249855] (req 0->249855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166975.172797:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4531f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+30:2418:x1847765450292736:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 1697us (1879us total) trans 0 rc 247907/247907 00000100:00100000:3.0:1762166975.172808:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1887 00000100:00100000:3.0:1762166975.175186:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450292864 00000100:00100000:3.0:1762166975.175200:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450292864 00000100:00100000:3.0:1762166975.175275:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1888 00000100:00100000:3.0:1762166975.175287:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+30:2419:x1847765450292864:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:3.0:1762166975.175327:0:23942:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8472600/0x2f180c4effba96f6 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.175346:0:23942:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc3618400/0x2f180c4effba95d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e94bd expref: 30 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.175354:0:23942:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166975.175356:0:23942:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166975.175360:0:23942:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472600/0x2f180c4effba96f6 lrc: 4/1,0 mode: --/PR res: [0x2c0000400:0xa82:0x0].0x0 rrc: 3 type: EXT [0->249855] (req 0->249855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.175400:0:23942:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc3618400/0x2f180c4effba95d7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e94bd expref: 30 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.175417:0:23942:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc3618400/0x2f180c4effba95d7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e94bd expref: 30 pid: 8380 timeout: 694 lvb_type: 0 00000100:00100000:3.0:1762166975.175433:0:23942:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bb9500 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_009:lustre-OST0001_UUID:23942:1847765449671296:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166975.175568:0:23942:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1762166975.176829:0:23942:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bb9500 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_009:lustre-OST0001_UUID:23942:1847765449671296:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166975.176856:0:23942:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc8472600/0x2f180c4effba96f6 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa82:0x0].0x0 rrc: 3 type: EXT [0->249855] (req 0->249855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166975.177008:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450292992 00000100:00100000:3.0:1762166975.177015:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450292992 00010000:00010000:3.0:1762166975.177090:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc3618400/0x2f180c4effba95d7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e94bd expref: 31 pid: 8380 timeout: 694 lvb_type: 0 00000100:00100000:3.0:1762166975.177123:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9428 00000100:00100000:3.0:1762166975.177133:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+31:2419:x1847765450292992:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166975.177148:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166975.177169:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc3618400/0x2f180c4effba95d7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e94bd expref: 31 pid: 8380 timeout: 694 lvb_type: 0 00010000:00010000:3.0:1762166975.177182:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc3618400/0x2f180c4effba95d7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e94bd expref: 31 pid: 8380 timeout: 694 lvb_type: 0 00010000:00010000:3.0:1762166975.177205:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc3618400/0x2f180c4effba95d7 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e94bd expref: 31 pid: 8380 timeout: 694 lvb_type: 0 00010000:00010000:3.0:1762166975.177226:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166975.177228:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166975.177232:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc8472600/0x2f180c4effba96f6 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa82:0x0].0x0 rrc: 3 type: EXT [0->249855] (req 0->249855) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.177242:0:6479:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472600/0x2f180c4effba96f6 lrc: 4/1,0 mode: PR/PR res: [0x2c0000400:0xa82:0x0].0x0 rrc: 3 type: EXT [0->249855] (req 0->249855) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.177268:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166975.177316:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+30:2419:x1847765450292992:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 183us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166975.177341:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9428 00000100:00100000:0.0:1762166975.181374:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.183005:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166975.183086:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450293248 00000100:00100000:3.0:1762166975.183093:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450293248 00010000:00010000:3.0:1762166975.183119:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc3619200/0x2f180c4effba9608 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e94d2 expref: 28 pid: 8380 timeout: 694 lvb_type: 0 00000100:00100000:3.0:1762166975.183167:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9429 00000100:00100000:3.0:1762166975.183175:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4533800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+28:2418:x1847765450293248:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166975.183188:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166975.183206:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc3619200/0x2f180c4effba9608 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e94d2 expref: 28 pid: 8380 timeout: 694 lvb_type: 0 00010000:00010000:3.0:1762166975.183218:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc3619200/0x2f180c4effba9608 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e94d2 expref: 28 pid: 8380 timeout: 694 lvb_type: 0 00010000:00010000:3.0:1762166975.183242:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc3619200/0x2f180c4effba9608 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e94d2 expref: 28 pid: 8380 timeout: 694 lvb_type: 0 00010000:00010000:3.0:1762166975.183257:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166975.183259:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166975.183264:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc8c7ba00/0x2f180c4effba96fd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->249855] (req 0->249855) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.183273:0:6479:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8c7ba00/0x2f180c4effba96fd lrc: 4/1,0 mode: PR/PR res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->249855] (req 0->249855) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.183296:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166975.183334:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4533800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+27:2418:x1847765450293248:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 158us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166975.183350:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9429 00000100:00100000:0.0:1762166975.187176:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.188630:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166975.188793:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450293504 00000100:00100000:3.0:1762166975.188798:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450293504 00010000:00010000:3.0:1762166975.188821:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945cc7d16400/0x2f180c4effba9639 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e94e7 expref: 30 pid: 8380 timeout: 694 lvb_type: 0 00000100:00100000:3.0:1762166975.188855:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9430 00000100:00100000:3.0:1762166975.188863:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4531180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+30:2418:x1847765450293504:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166975.188874:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166975.188891:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945cc7d16400/0x2f180c4effba9639 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e94e7 expref: 30 pid: 8380 timeout: 694 lvb_type: 0 00010000:00010000:3.0:1762166975.188902:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945cc7d16400/0x2f180c4effba9639 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e94e7 expref: 30 pid: 8380 timeout: 694 lvb_type: 0 00010000:00010000:3.0:1762166975.188933:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cc7d16400/0x2f180c4effba9639 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e94e7 expref: 30 pid: 8380 timeout: 694 lvb_type: 0 00010000:00010000:3.0:1762166975.188946:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166975.188948:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166975.188952:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc8c7ac00/0x2f180c4effba9704 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->249855] (req 0->249855) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.188960:0:6479:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8c7ac00/0x2f180c4effba9704 lrc: 4/1,0 mode: PR/PR res: [0x2c0000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->249855] (req 0->249855) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.188995:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166975.189030:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4531180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+29:2418:x1847765450293504:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 167us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166975.189038:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9430 00000100:00100000:3.0:1762166975.197680:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450293632 00000100:00100000:3.0:1762166975.197694:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450293632 00000100:00100000:3.0:1762166975.197772:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 853 00000100:00100000:3.0:1762166975.197784:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+531:61831:x1847765450293632:12345-192.168.204.38@tcp:103:lfs.0 00010000:00010000:3.0:1762166975.197805:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166975.197834:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb000/0x2f180c4effba96e1 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e951f expref: 531 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.197855:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166975.197861:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166975.197935:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+530:61831:x1847765450293632:12345-192.168.204.38@tcp:103:lfs.0 Request processed in 140us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166975.197944:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 853 00000100:00100000:0.0:1762166975.198773:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.200881:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166975.202233:0:6495:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bc3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6495:1847765449671680:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166975.202257:0:6495:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effba9712 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000100:00100000:0.0:1762166975.202561:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166975.202683:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450294272 00000100:00100000:3.0:1762166975.202689:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450294272 00010000:00010000:3.0:1762166975.202711:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99a00/0x2f180c4effba96be lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9511 expref: 533 pid: 6495 timeout: 694 lvb_type: 0 00000100:00100000:3.0:1762166975.202744:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9431 00000100:00100000:3.0:1762166975.202752:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+533:2418:x1847765450294272:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166975.202763:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166975.202769:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99a00/0x2f180c4effba96be lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9511 expref: 533 pid: 6495 timeout: 694 lvb_type: 0 00010000:00010000:3.0:1762166975.202782:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99a00/0x2f180c4effba96be lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9511 expref: 533 pid: 6495 timeout: 694 lvb_type: 0 00010000:00010000:3.0:1762166975.202801:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99a00/0x2f180c4effba96be lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9511 expref: 533 pid: 6495 timeout: 694 lvb_type: 0 00010000:00010000:3.0:1762166975.202815:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166975.202819:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effba9712 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166975.202827:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effba9712 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166975.202834:0:6479:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effba9712 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166975.202858:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166975.202893:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+532:2418:x1847765450294272:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 140us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166975.202905:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9431 00000100:00100000:0.0:1762166975.204028:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.205246:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166975.205280:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450294528 00000100:00100000:3.0:1762166975.205286:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450294528 00010000:00010000:3.0:1762166975.205339:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effba9712 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9526 expref: 534 pid: 6495 timeout: 694 lvb_type: 0 00000100:00100000:3.0:1762166975.205366:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9432 00000100:00100000:3.0:1762166975.205373:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ccec70c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+534:2419:x1847765450294528:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166975.205381:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166975.205386:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effba9712 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9526 expref: 534 pid: 6495 timeout: 694 lvb_type: 0 00010000:00010000:3.0:1762166975.205403:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effba9712 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9526 expref: 534 pid: 6495 timeout: 694 lvb_type: 0 00010000:00010000:3.0:1762166975.205418:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effba9712 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9526 expref: 534 pid: 6495 timeout: 694 lvb_type: 0 00010000:00010000:3.0:1762166975.205431:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166975.205435:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8600/0x2f180c4effba9727 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166975.205442:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8600/0x2f180c4effba9727 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166975.205448:0:6479:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8600/0x2f180c4effba9727 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166975.205468:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166975.205529:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ccec70c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+533:2419:x1847765450294528:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 153us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166975.205539:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9432 00000100:00100000:0.0:1762166975.206663:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.209633:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.210855:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000001:00080000:3.0:1762166975.212442:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294991750 is committed 00000004:00080000:3.0:1762166975.212448:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3208 committed 00000004:00080000:3.0:1762166975.212456:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3205 committed 00000004:00080000:3.0:1762166975.212466:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3204 committed 00000004:00080000:3.0:1762166975.212469:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3207 committed 00000004:00080000:3.0:1762166975.212470:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3206 committed 00000004:00080000:3.0:1762166975.212472:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3203 committed 00000004:00080000:3.0:1762166975.212473:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3202 committed 00000004:00080000:3.0:1762166975.212493:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3205 committed 00000004:00080000:3.0:1762166975.212496:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3204 committed 00000004:00080000:3.0:1762166975.212500:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3201 committed 00000100:00100000:3.0:1762166975.212565:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf3db4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449672192:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166975.212634:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166975.212640:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449672064:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166975.212679:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf3db4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449672704:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166975.212716:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166975.212719:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449672320:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166975.212761:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449671936 00000100:00100000:3.0:1762166975.212765:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449671936 00000100:00100000:3.0:1762166975.212795:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449672448 00000100:00100000:3.0:1762166975.212799:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449672448 00000100:00100000:0.0:1762166975.212812:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18653 00000100:00100000:0.0:1762166975.212827:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+13:3636:x1847765449672192:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166975.212833:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18655 00000100:00100000:3.0:1762166975.212846:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+13:3636:x1847765449672704:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:0.0:1762166975.212975:0:9165:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166975.212981:0:9165:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166975 -> 1762166975 00002000:00010000:0.0:1762166975.212989:0:9165:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00000100:00100000:3.0:1762166975.212990:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+17:3636:x1847765449672704:12345-0@lo:2:osp-syn-0-1.0 Request processed in 146us (275us total) trans 21474843125 rc 0/0 00002000:00010000:0.0:1762166975.212996:0:9165:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166975 -> 1762166975 00000100:00100000:3.0:1762166975.213000:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18655 00002000:00010000:0.0:1762166975.213002:0:9165:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00000100:00100000:3.0:1762166975.213020:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18657 00000100:00100000:3.0:1762166975.213031:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+17:3634:x1847765449672960:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1762166975.213045:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+17:3636:x1847765449672192:12345-0@lo:2:osp-syn-0-1.0 Request processed in 223us (412us total) trans 21474843127 rc 0/0 00000100:00100000:0.0:1762166975.213061:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18653 00002000:00010000:3.0:1762166975.213087:0:8383:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa87:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166975.213092:0:8383:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa87:0x0] updating lvb mtime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166975.213098:0:8383:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa87:0x0] updating lvb atime from disk: 1762166974 -> 1762166974 00002000:00010000:3.0:1762166975.213103:0:8383:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa87:0x0] updating lvb ctime from disk: 1762166975 -> 1762166975 00000100:00100000:0.0:1762166975.213105:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:3.0:1762166975.213108:0:8383:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa87:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1762166975.213144:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449672832:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166975.213152:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+15:3634:x1847765449672960:12345-0@lo:2:osp-syn-0-1.0 Request processed in 122us (315us total) trans 21474843129 rc 0/0 00000100:00100000:3.0:1762166975.213160:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18657 00000100:00100000:0.0:1762166975.213177:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1762166975.213211:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf3db4380/2, rc 0, transno 21474843125 00000100:00100000:3.0:1762166975.213217:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3db4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449672704:0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1762166975.213232:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf3db4700/2, rc 0, transno 21474843127 00000100:00100000:3.0:1762166975.213239:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3db4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449672192:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1762166975.213262:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166975.213287:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449672064 00000100:00100000:3.0:1762166975.213290:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449672064 00000100:00100000:0.0:1762166975.213295:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449672576:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166975.213314:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18660 00000100:00100000:3.0:1762166975.213323:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+13:3635:x1847765449672064:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1762166975.213347:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166975.213379:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449673088:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1762166975.213408:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1762166975.213453:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf1cd1180/2, rc 0, transno 17179876107 00000100:00100000:0.0:1762166975.213459:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449672320:0@lo:2:osp-syn-1-1.0 00000004:00080000:0.0:1762166975.213469:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf1cd0a80/2, rc 0, transno 17179876108 00000100:00100000:0.0:1762166975.213474:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449672832:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1762166975.213580:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf1cd2d80/2, rc 0, transno 17179876109 00000100:00100000:3.0:1762166975.213588:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449672576:0@lo:2:osp-syn-1-1.0 00000004:00080000:0.0:1762166975.213617:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf3db6a00/2, rc 0, transno 21474843126 00000100:00100000:0.0:1762166975.213623:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3db6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449671936:0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1762166975.213640:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf1cd3b80/2, rc 0, transno 17179876110 00000004:00080000:0.0:1762166975.213642:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf3db7480/2, rc 0, transno 21474843128 00000100:00100000:3.0:1762166975.213649:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449673088:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1762166975.213651:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3db7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449672448:0@lo:2:osp-syn-0-1.0 00000004:00080000:0.0:1762166975.213664:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf3db5c00/2, rc 0, transno 21474843129 00000100:00100000:0.0:1762166975.213668:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3db5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449672960:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1762166975.214791:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450295552 00000100:00100000:0.0:1762166975.214794:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450295552 00000100:00100000:0.0:1762166975.214821:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18663 00000100:00100000:0.0:1762166975.214826:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+29:61766:x1847765450295552:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:0.0:1762166975.214835:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166975.214844:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effba974a lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9542 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.214861:0:28434:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde000/0x2f180c4effba94aa lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9446 expref: 30 pid: 8380 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166975.214867:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166975.214869:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166975.214872:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effba974a lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9542 expref: 30 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.214892:0:28434:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde000/0x2f180c4effba94aa lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9446 expref: 30 pid: 8380 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166975.214901:0:28434:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde000/0x2f180c4effba94aa lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9446 expref: 30 pid: 8380 timeout: 694 lvb_type: 1 00000100:00100000:0.0:1762166975.214909:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765449673216:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166975.214971:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bca7930c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166975.215916:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450295680 00000100:00100000:3.0:1762166975.215929:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450295680 00010000:00010000:3.0:1762166975.215950:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde000/0x2f180c4effba94aa lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9446 expref: 30 pid: 8380 timeout: 694 lvb_type: 1 00000100:00100000:3.0:1762166975.215980:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9433 00000100:00100000:3.0:1762166975.215988:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5589180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+30:2418:x1847765450295680:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166975.215998:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166975.216008:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde000/0x2f180c4effba94aa lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9446 expref: 30 pid: 8380 timeout: 694 lvb_type: 1 00010000:00010000:3.0:1762166975.216020:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde000/0x2f180c4effba94aa lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9446 expref: 30 pid: 8380 timeout: 694 lvb_type: 1 00010000:00010000:3.0:1762166975.216038:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde000/0x2f180c4effba94aa lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9446 expref: 30 pid: 8380 timeout: 694 lvb_type: 1 00010000:00010000:3.0:1762166975.216050:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166975.216052:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166975.216059:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effba974a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9542 expref: 29 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.216069:0:6479:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effba974a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9542 expref: 29 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.216088:0:6479:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effba974a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9542 expref: 29 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166975.216096:0:6479:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bb9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6479:1847765449673344:192.168.204.38@tcp:105: 00000100:00100000:3.0:1762166975.216127:0:6479:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402fd80 going to sleep for 11 seconds 00000100:00100000:3.0:1762166975.216873:0:6479:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bb9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6479:1847765449673344:192.168.204.38@tcp:105: 00010000:00010000:3.0:1762166975.216886:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166975.216915:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5589180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+29:2418:x1847765450295680:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 927us (1020us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166975.216935:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9433 00000100:00100000:3.0:1762166975.218041:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450295936 00000100:00100000:3.0:1762166975.218047:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450295936 00010000:00010000:3.0:1762166975.218064:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945cc7d17000/0x2f180c4effba94b8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e944d expref: 27 pid: 8382 timeout: 694 lvb_type: 1 00000100:00100000:3.0:1762166975.218090:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9434 00000100:00100000:3.0:1762166975.218097:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5589880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+27:2419:x1847765450295936:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166975.218107:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166975.218119:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945cc7d17000/0x2f180c4effba94b8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e944d expref: 27 pid: 8382 timeout: 694 lvb_type: 1 00010000:00010000:3.0:1762166975.218131:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945cc7d17000/0x2f180c4effba94b8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e944d expref: 27 pid: 8382 timeout: 694 lvb_type: 1 00010000:00010000:3.0:1762166975.218146:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cc7d17000/0x2f180c4effba94b8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e944d expref: 27 pid: 8382 timeout: 694 lvb_type: 1 00010000:00010000:3.0:1762166975.218156:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166975.218158:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166975.218163:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8800/0x2f180c4effba9751 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9549 expref: 26 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.218173:0:6479:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8800/0x2f180c4effba9751 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9549 expref: 26 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.218192:0:6479:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8800/0x2f180c4effba9751 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9549 expref: 26 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166975.218202:0:6479:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bb9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6479:1847765449673600:192.168.204.38@tcp:105: 00000100:00100000:3.0:1762166975.218238:0:6479:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402fd80 going to sleep for 11 seconds 00000100:00100000:3.0:1762166975.218968:0:6479:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bb9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6479:1847765449673600:192.168.204.38@tcp:105: 00010000:00010000:3.0:1762166975.218976:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166975.218994:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166975.219003:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5589880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765450295936:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 906us (1021us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166975.219009:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9434 00000100:00100000:0.0:1762166975.220007:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166975.220053:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450296192 00000100:00100000:3.0:1762166975.220057:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450296192 00010000:00010000:3.0:1762166975.220070:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472800/0x2f180c4effba94b1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9454 expref: 30 pid: 35247 timeout: 694 lvb_type: 1 00000100:00100000:3.0:1762166975.220089:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9435 00000100:00100000:3.0:1762166975.220098:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+30:2418:x1847765450296192:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166975.220108:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166975.220122:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc8472800/0x2f180c4effba94b1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9454 expref: 30 pid: 35247 timeout: 694 lvb_type: 1 00010000:00010000:3.0:1762166975.220133:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc8472800/0x2f180c4effba94b1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9454 expref: 30 pid: 35247 timeout: 694 lvb_type: 1 00010000:00010000:3.0:1762166975.220147:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8472800/0x2f180c4effba94b1 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9454 expref: 30 pid: 35247 timeout: 694 lvb_type: 1 00010000:00010000:3.0:1762166975.220157:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166975.220159:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166975.220163:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8600/0x2f180c4effba9758 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9550 expref: 29 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.220171:0:6479:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8600/0x2f180c4effba9758 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9550 expref: 29 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.220196:0:6479:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8600/0x2f180c4effba9758 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9550 expref: 29 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166975.220207:0:6479:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bb9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6479:1847765449673856:192.168.204.38@tcp:105: 00000100:00100000:3.0:1762166975.220245:0:6479:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402fd80 going to sleep for 11 seconds 00000100:00100000:3.0:1762166975.220895:0:6479:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bb9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6479:1847765449673856:192.168.204.38@tcp:105: 00010000:00010000:3.0:1762166975.220903:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166975.220935:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+29:2418:x1847765450296192:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 839us (930us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166975.220940:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9435 00000100:00100000:0.0:1762166975.221064:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.221097:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166975.221123:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450296448 00000100:00100000:3.0:1762166975.221129:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450296448 00000100:00100000:0.0:1762166975.221143:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00002000:00010000:3.0:1762166975.221158:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:3.0:1762166975.221164:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1cd2680 with x1847765450296448 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166975.221172:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945cf1cd2680. 00000100:00100000:0.0:1762166975.221221:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1891 00000100:00100000:0.0:1762166975.221238:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+26:2418:x1847765450296448:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:0.0:1762166975.221399:0:14623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166975.221407:0:14623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166975 -> 1762166975 00002000:00010000:0.0:1762166975.221414:0:14623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00002000:00010000:0.0:1762166975.221420:0:14623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166975 -> 1762166975 00002000:00010000:0.0:1762166975.221428:0:14623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00000100:00100000:0.0:1762166975.221461:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+27:2418:x1847765450296448:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 231us (398us total) trans 21474843130 rc 0/0 00000100:00100000:0.0:1762166975.221471:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1891 00002000:00010000:0.0:1762166975.221504:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:0.0:1762166975.221510:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1cd2680 with x1847765450296448 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166975.221519:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945cf1cd2680. 00000100:00100000:0.0:1762166975.222329:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166975.224116:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.227259:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.228607:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166975.230044:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.232703:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166975.235744:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450297472 00000100:00100000:3.0:1762166975.235760:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450297472 00002000:00100000:3.0:1762166975.235809:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (77824->262143) req@ffff945bc5589500 x1847765450297472/t0(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:6/0 lens 504/0 e 0 to 0 dl 1762166986 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166975.235820:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5589500 with x1847765450297472 ext(77824->262143) 00002000:00010000:3.0:1762166975.235825:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5589500 00000100:00100000:3.0:1762166975.235860:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1899 00000100:00100000:3.0:1762166975.235871:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5589500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+32:2418:x1847765450297472:12345-192.168.204.38@tcp:4:fsx.0 00000100:00100000:3.0:1762166975.237615:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5589500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+34:2418:x1847765450297472:12345-192.168.204.38@tcp:4:fsx.0 Request processed in 1742us (1925us total) trans 17179876115 rc 0/0 00000100:00100000:3.0:1762166975.237624:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1899 00002000:00100000:3.0:1762166975.237631:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (77824->262143) req@ffff945bc5589500 x1847765450297472/t17179876115(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:6/0 lens 504/448 e 0 to 0 dl 1762166986 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166975.237641:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5589500 with x1847765450297472 ext(77824->262143) 00002000:00010000:3.0:1762166975.237644:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5589500 00000100:00100000:0.0:1762166975.238592:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166975.238637:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450297600 00000100:00100000:3.0:1762166975.238644:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450297600 00000100:00100000:3.0:1762166975.238690:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1900 00000100:00100000:3.0:1762166975.238696:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+34:2419:x1847765450297600:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:3.0:1762166975.239122:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 242830 -> 262144 00002000:00010000:3.0:1762166975.239126:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166975.239128:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166975.239130:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166975.239131:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 440 -> 504 00000100:00100000:3.0:1762166975.239180:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+35:2419:x1847765450297600:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 482us (592us total) trans 17179876116 rc 0/0 00000100:00100000:3.0:1762166975.239220:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1900 00000100:00100000:0.0:1762166975.241672:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.243046:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.243073:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.243100:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166975.243135:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450298112 00000100:00100000:3.0:1762166975.243143:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450298112 00002000:00010000:3.0:1762166975.243174:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (141873->18446744073709551615) 00002000:00100000:3.0:1762166975.243190:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc70b3b80 with x1847765450298112 ext(141873->18446744073709551615) 00002000:00010000:3.0:1762166975.243205:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc70b3b80. 00000100:00100000:3.0:1762166975.243238:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1901 00000100:00100000:3.0:1762166975.243257:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc70b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+36:2418:x1847765450298112:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:0.0:1762166975.243308:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1903 00000100:00100000:0.0:1762166975.243326:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc70b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+36:2419:x1847765450298368:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:0.0:1762166975.243422:0:14623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166975.243428:0:14623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166975 -> 1762166975 00002000:00010000:0.0:1762166975.243434:0:14623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00002000:00010000:0.0:1762166975.243439:0:14623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166975 -> 1762166975 00002000:00010000:0.0:1762166975.243443:0:14623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1762166975.243521:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc70b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+38:2419:x1847765450298368:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 200us (417us total) trans 17179876117 rc 0/0 00000100:00100000:0.0:1762166975.243537:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1903 00002000:00010000:0.0:1762166975.243543:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:0.0:1762166975.243547:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc70b0380 with x1847765450298368 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166975.243555:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc70b0380. 00002000:00010000:3.0:1762166975.243705:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 262144 -> 141873 00002000:00010000:3.0:1762166975.243709:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166975.243712:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166975.243716:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166975.243719:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 504 -> 280 00000100:00100000:3.0:1762166975.243754:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc70b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+37:2418:x1847765450298112:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 505us (711us total) trans 17179876118 rc 0/0 00000100:00100000:3.0:1762166975.243760:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1901 00002000:00010000:3.0:1762166975.243763:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (141873->18446744073709551615) 00002000:00100000:3.0:1762166975.243767:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc70b3b80 with x1847765450298112 ext(141873->18446744073709551615) 00002000:00010000:3.0:1762166975.243771:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc70b3b80. 00000100:00100000:0.0:1762166975.244884:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166975.247836:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450298624 00000100:00100000:3.0:1762166975.247845:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450298624 00002000:00100000:3.0:1762166975.247884:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (0->147455) req@ffff945bc558b800 x1847765450298624/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:6/0 lens 504/0 e 0 to 0 dl 1762166986 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166975.247892:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc558b800 with x1847765450298624 ext(0->147455) 00002000:00010000:3.0:1762166975.247897:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc558b800 00000100:00100000:3.0:1762166975.247930:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1904 00000100:00100000:3.0:1762166975.247938:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+37:2416:x1847765450298624:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:3.0:1762166975.249169:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+37:2416:x1847765450298624:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 1229us (1420us total) trans 0 rc 106496/106496 00000100:00100000:3.0:1762166975.249177:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1904 00002000:00100000:3.0:1762166975.249185:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (0->147455) req@ffff945bc558b800 x1847765450298624/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:6/0 lens 504/440 e 0 to 0 dl 1762166986 ref 1 fl Complete:/600/0 rc 106496/106496 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166975.249198:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc558b800 with x1847765450298624 ext(0->147455) 00002000:00010000:3.0:1762166975.249201:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc558b800 00000100:00100000:0.0:1762166975.251383:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166975.251460:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450298752 00000100:00100000:3.0:1762166975.251472:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450298752 00002000:00100000:3.0:1762166975.251541:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (106496->150804) req@ffff945bc70b1c00 x1847765450298752/t0(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:6/0 lens 504/0 e 0 to 0 dl 1762166986 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166975.251549:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc70b1c00 with x1847765450298752 ext(106496->150804) 00002000:00010000:3.0:1762166975.251552:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc70b1c00 00000100:00100000:3.0:1762166975.251575:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1905 00000100:00100000:3.0:1762166975.251583:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc70b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+37:2418:x1847765450298752:12345-192.168.204.38@tcp:4:fsx.0 00000100:00100000:3.0:1762166975.253126:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc70b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+41:2418:x1847765450298752:12345-192.168.204.38@tcp:4:fsx.0 Request processed in 1542us (1749us total) trans 17179876121 rc 0/0 00000100:00100000:3.0:1762166975.253134:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1905 00002000:00100000:3.0:1762166975.253141:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (106496->150804) req@ffff945bc70b1c00 x1847765450298752/t17179876121(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:6/0 lens 504/448 e 0 to 0 dl 1762166986 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166975.253148:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc70b1c00 with x1847765450298752 ext(106496->150804) 00002000:00010000:3.0:1762166975.253151:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc70b1c00 00000100:00100000:0.0:1762166975.258732:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166975.258800:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450299008 00000100:00100000:3.0:1762166975.258816:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450299008 00000100:00100000:3.0:1762166975.258890:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1906 00000100:00100000:3.0:1762166975.258901:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc70b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450299008:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:3.0:1762166975.259291:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 141873 -> 150805 00002000:00010000:3.0:1762166975.259295:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166975.259298:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166975.259300:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166975.259302:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 280 -> 288 00000100:00100000:3.0:1762166975.259363:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc70b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450299008:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 464us (639us total) trans 17179876122 rc 0/0 00000100:00100000:3.0:1762166975.259371:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1906 00000100:00100000:0.0:1762166975.263291:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450299520 00000100:00100000:0.0:1762166975.263300:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450299520 00000100:00100000:3.0:1762166975.263304:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450299392 00000100:00100000:3.0:1762166975.263311:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450299392 00002000:00010000:3.0:1762166975.263349:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (262144->18446744073709551615) 00002000:00010000:0.0:1762166975.263349:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:3.0:1762166975.263359:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc6224000 with x1847765450299392 ext(262144->18446744073709551615) 00002000:00100000:0.0:1762166975.263360:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc6225c00 with x1847765450299520 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166975.263373:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc6225c00. 00002000:00010000:3.0:1762166975.263374:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc6224000. 00000100:00100000:0.0:1762166975.263405:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1907 00000100:00100000:0.0:1762166975.263416:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6225c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+28:2418:x1847765450299520:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:0.0:1762166975.263588:0:14623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166975.263595:0:14623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166975 -> 1762166975 00002000:00010000:0.0:1762166975.263602:0:14623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00002000:00010000:0.0:1762166975.263609:0:14623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166975 -> 1762166975 00002000:00010000:0.0:1762166975.263615:0:14623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00000100:00100000:0.0:1762166975.263673:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6225c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+29:2418:x1847765450299520:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 255us (466us total) trans 21474843132 rc 0/0 00000100:00100000:0.0:1762166975.263694:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1907 00002000:00010000:0.0:1762166975.263700:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:0.0:1762166975.263711:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc6225c00 with x1847765450299520 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166975.263721:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc6225c00. 00000100:00100000:0.0:1762166975.265776:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.271071:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166975.273197:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.288352:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166975.290562:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:0.0:1762166975.292807:0:6495:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effba97c1 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.292814:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effba97c1 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:0.0:1762166975.292827:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 262144 00010000:00010000:0.0:1762166975.292938:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effba97ba lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e957a expref: 535 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.292953:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effba97c1 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e957a expref: 534 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.292961:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166975.292963:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1762166975.292966:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa8200, rc 0) 00000100:00100000:0.0:1762166975.293001:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6226d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+534:61832:x1847765450300928:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1716us (1828us total) trans 4294991756 rc 0/0 00000100:00100000:0.0:1762166975.293007:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30178 00000100:00100000:0.0:1762166975.294306:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450301184 00000100:00100000:0.0:1762166975.294313:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450301184 00000100:00100000:0.0:1762166975.294348:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30179 00000100:00100000:0.0:1762166975.294358:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+534:61832:x1847765450301184:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166975.294374:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166975.294387:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effba97cf lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9581 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.294450:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effba97d6 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166975.294461:0:6495:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effba97c1 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e957a expref: 535 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.294468:0:6495:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effba97d6 lrc: 4/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.294525:0:6495:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effba97c1 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e957a expref: 535 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.294537:0:6495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effba97c1 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e957a expref: 535 pid: 6495 timeout: 694 lvb_type: 0 00000100:00100000:0.0:1762166975.294549:0:6495:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc70b1500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6495:1847765449674112:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166975.294606:0:6495:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bca793c00 going to sleep for 11 seconds 00000100:00100000:0.0:1762166975.295409:0:6495:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc70b1500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6495:1847765449674112:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166975.295424:0:6495:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effba97d6 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.296058:0:6495:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effba97d6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.296067:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effba97d6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:0.0:1762166975.296106:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 262144 00000004:00200000:0.0:1762166975.296111:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166975.296135:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effba97d6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.296166:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effba97cf lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9581 expref: 535 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.296179:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effba97d6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9581 expref: 534 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.296201:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166975.296204:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166975.296207:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdf200, rc 0) 00000100:00100000:0.0:1762166975.296248:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+534:61832:x1847765450301184:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1891us (1987us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166975.296256:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30179 00000100:00100000:0.0:1762166975.297723:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450301568 00000100:00100000:0.0:1762166975.297730:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450301568 00000100:00100000:0.0:1762166975.297768:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30180 00000100:00100000:0.0:1762166975.297777:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+534:61832:x1847765450301568:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166975.297794:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166975.297808:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effba97dd lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9588 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.297876:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effba97e4 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166975.297885:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effba97e4 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.297891:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effba97e4 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:0.0:1762166975.297899:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 262144 00010000:00010000:0.0:1762166975.297991:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effba97dd lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9588 expref: 537 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.298002:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effba97e4 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9588 expref: 536 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.298008:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166975.298010:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166975.298011:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdfa00, rc 0) 00000100:00100000:0.0:1762166975.298043:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+536:61832:x1847765450301568:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 267us (367us total) trans 4294991757 rc 0/0 00000100:00100000:0.0:1762166975.298051:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30180 00000100:00100000:0.0:1762166975.299147:0:35248:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450301824 00000100:00100000:0.0:1762166975.299153:0:35248:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450301824 00000100:00100000:3.0:1762166975.299155:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18668 00000100:00100000:3.0:1762166975.299169:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450301696:12345-192.168.204.38@tcp:1:lfs.0 00000100:00100000:0.0:1762166975.299193:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18670 00010000:00010000:3.0:1762166975.299202:0:35247:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc8472800/0x2f180c4effba97f2 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166975.299207:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+29:2418:x1847765450301824:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:3.0:1762166975.299226:0:35247:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effba974a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9542 expref: 19 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.299231:0:35248:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde400/0x2f180c4effba9800 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.299251:0:35247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166975.299256:0:35247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166975.299257:0:35248:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8800/0x2f180c4effba9751 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9549 expref: 29 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.299262:0:35247:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472800/0x2f180c4effba97f2 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.299267:0:35248:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166975.299270:0:35248:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166975.299275:0:35248:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde400/0x2f180c4effba9800 lrc: 4/0,1 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.299318:0:35247:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effba974a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9542 expref: 19 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.299318:0:35248:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8800/0x2f180c4effba9751 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9549 expref: 29 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.299345:0:35247:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effba974a lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9542 expref: 19 pid: 28434 timeout: 694 lvb_type: 0 00010000:00010000:0.0:1762166975.299345:0:35248:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8800/0x2f180c4effba9751 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9549 expref: 29 pid: 28434 timeout: 694 lvb_type: 0 00000100:00100000:3.0:1762166975.299375:0:35247:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bba300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:35247:1847765449674240:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166975.299389:0:35248:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc70b1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:35248:1847765449674368:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166975.299434:0:35247:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1762166975.299435:0:35248:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bca7930c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166975.300337:0:35247:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bba300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:35247:1847765449674240:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166975.300357:0:35247:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc8472800/0x2f180c4effba97f2 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166975.300913:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450302208 00000100:00100000:0.0:1762166975.300927:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450302208 00000100:00100000:3.0:1762166975.300935:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450302080 00000100:00100000:3.0:1762166975.300942:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450302080 00002000:00100000:0.0:1762166975.300959:0:14623:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xa77:0x0] (196608->217087) req@ffff945cf79ead80 x1847765450302208/t0(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:6/0 lens 488/0 e 0 to 0 dl 1762166986 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1762166975.300966:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8800/0x2f180c4effba9751 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9549 expref: 30 pid: 28434 timeout: 694 lvb_type: 0 00002000:00100000:0.0:1762166975.300977:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf79ead80 with x1847765450302208 ext(196608->217087) 00010000:00010000:0.0:1762166975.300987:0:14623:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effba974a lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9542 expref: 20 pid: 28434 timeout: 694 lvb_type: 0 00010000:00010000:0.0:1762166975.300999:0:14623:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effba974a lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9542 expref: 20 pid: 28434 timeout: 694 lvb_type: 0 00002000:00010000:0.0:1762166975.301006:0:14623:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff945cf79ead80 00000100:00100000:3.0:1762166975.301007:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9438 00000100:00100000:3.0:1762166975.301019:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ccec70050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+30:2419:x1847765450302080:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166975.301030:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1762166975.301040:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 26 00010000:00010000:3.0:1762166975.301049:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8800/0x2f180c4effba9751 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9549 expref: 30 pid: 28434 timeout: 694 lvb_type: 0 00000100:00100000:0.0:1762166975.301054:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450302208:12345-192.168.204.38@tcp:4:fsx.0 00010000:00010000:3.0:1762166975.301071:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8800/0x2f180c4effba9751 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9549 expref: 30 pid: 28434 timeout: 694 lvb_type: 0 00010000:00010000:3.0:1762166975.301098:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8800/0x2f180c4effba9751 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9549 expref: 30 pid: 28434 timeout: 694 lvb_type: 0 00010000:00010000:3.0:1762166975.301122:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166975.301125:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166975.301130:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde400/0x2f180c4effba9800 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.301143:0:6479:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde400/0x2f180c4effba9800 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.301166:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166975.301197:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ccec70050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+29:2419:x1847765450302080:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 176us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166975.301217:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9438 00010000:00010000:3.0:1762166975.301365:0:28434:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc7194800/0x2f180c4effba97f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.301373:0:28434:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc7194800/0x2f180c4effba97f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.301384:0:28434:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc7194800/0x2f180c4effba97f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.301400:0:28434:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc7194800/0x2f180c4effba97f9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.301412:0:28434:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc7194800/0x2f180c4effba97f9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.301499:0:28434:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc7194800 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166975.301502:0:28434:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc7194800/0x2f180c4effba97f9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.301507:0:28434:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc7194800/0x2f180c4effba97f9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.301515:0:28434:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc7194800/0x2f180c4effba97f9 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.301520:0:28434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc7194800/0x2f180c4effba97f9 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166975.301558:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450301952:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 2366us (2495us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166975.301562:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18669 00000100:00100000:0.0:1762166975.303624:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:0.0:1762166975.303836:0:35247:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc8472800/0x2f180c4effba97f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.303868:0:35247:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8472800/0x2f180c4effba97f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.303884:0:35247:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc8472800/0x2f180c4effba97f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.303889:0:35247:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472800/0x2f180c4effba97f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.303894:0:35247:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc8472800/0x2f180c4effba97f2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.303897:0:35247:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8472800 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166975.303900:0:35247:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8472800/0x2f180c4effba97f2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.303904:0:35247:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8472800/0x2f180c4effba97f2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.303913:0:35247:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc8472800/0x2f180c4effba97f2 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.303927:0:35247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8472800/0x2f180c4effba97f2 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166975.303973:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450301696:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 4808us (4940us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166975.303979:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18668 00000100:00100000:0.0:1762166975.304848:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000001:00080000:3.0:1762166975.306308:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294991758 is committed 00000004:00080000:3.0:1762166975.306315:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3213 committed 00000004:00080000:3.0:1762166975.306323:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3210 committed 00000004:00080000:3.0:1762166975.306334:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3209 committed 00010000:00010000:0.0:1762166975.306336:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effba976d lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00000004:00080000:3.0:1762166975.306337:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3212 committed 00000004:00080000:3.0:1762166975.306342:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3211 committed 00000004:00080000:3.0:1762166975.306348:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3208 committed 00010000:00010000:0.0:1762166975.306350:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effba976d lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00000004:00080000:3.0:1762166975.306352:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3207 committed 00000004:00080000:3.0:1762166975.306357:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3210 committed 00010000:00010000:0.0:1762166975.306362:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effba976d lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00000004:00080000:3.0:1762166975.306363:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3209 committed 00000004:00080000:3.0:1762166975.306368:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3206 committed 00010000:00010000:0.0:1762166975.306376:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa9800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166975.306380:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effba976d lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.306386:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effba976d lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.306397:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166975.306401:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166975.306404:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effba976d lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.306408:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effba976d lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.306419:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effba9789 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.306426:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effba9789 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.306430:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effba9789 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.306435:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa9a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166975.306438:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effba9789 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.306443:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effba9789 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.306448:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166975.306450:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166975.306452:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effba9789 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.306457:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effba9789 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000100:00100000:0.0:1762166975.306475:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449674752:0@lo:2:osp-syn-1-1.0 00000004:00010000:3.0:1762166975.306543:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000bd806be1 reply state 00000000f52c4a91 transno 4294991758 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194200/0x2f180c4effba9807 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000100:00100000:0.0:1762166975.306558:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1762166975.306559:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194200/0x2f180c4effba9807 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166975.306568:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166975.306571:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1762166975.306574:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166975.306594:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449675264:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1762166975.306623:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1762166975.306639:0:6495:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1762166975.306650:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449675776:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166975.306658:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc70b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+526:61832:x1847765450302720:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 1718us (1806us total) trans 4294991758 rc 0/0 00000100:00100000:3.0:1762166975.306667:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30181 00000100:00100000:0.0:1762166975.306684:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449674880:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1762166975.306709:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166975.306729:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449674880 00000100:00100000:0.0:1762166975.306732:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449675392:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166975.306736:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449674880 00000100:00100000:0.0:1762166975.306758:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166975.306771:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449675392 00000100:00100000:3.0:1762166975.306776:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449675392 00000100:00100000:0.0:1762166975.306789:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18672 00000100:00100000:0.0:1762166975.306802:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+9:3635:x1847765449675008:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166975.306811:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18673 00000100:00100000:3.0:1762166975.306826:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945d011eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+9:3633:x1847765449675264:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1762166975.306900:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+11:3635:x1847765449675008:12345-0@lo:2:osp-syn-1-1.0 Request processed in 101us (316us total) trans 17179876128 rc 0/0 00002000:00010000:3.0:1762166975.306906:0:8382:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa82:0x0] updating lvb size from disk: 247907 -> 247907 00000100:00100000:0.0:1762166975.306911:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18672 00002000:00010000:3.0:1762166975.306913:0:8382:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa82:0x0] updating lvb mtime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166975.306928:0:8382:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa82:0x0] updating lvb atime from disk: 1762166972 -> 1762166972 00002000:00010000:3.0:1762166975.306932:0:8382:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa82:0x0] updating lvb ctime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166975.306939:0:8382:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa82:0x0] updating lvb blocks from disk: 280 -> 280 00000100:00100000:0.0:1762166975.306951:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18676 00000100:00100000:0.0:1762166975.306964:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945d011ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+17:3634:x1847765449675392:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166975.306990:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945d011eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+10:3633:x1847765449675264:12345-0@lo:2:osp-syn-1-1.0 Request processed in 168us (366us total) trans 17179876129 rc 0/0 00000100:00100000:3.0:1762166975.307002:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18673 00000100:00100000:0.0:1762166975.307057:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945d011ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+17:3634:x1847765449675392:12345-0@lo:2:osp-syn-0-1.0 Request processed in 94us (295us total) trans 21474843134 rc 0/0 00000100:00100000:0.0:1762166975.307064:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18676 00000004:00080000:0.0:1762166975.307108:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf79ebb80/2, rc 0, transno 21474843133 00000100:00100000:0.0:1762166975.307116:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449674880:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166975.307119:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449674624 00000100:00100000:3.0:1762166975.307125:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449674624 00000004:00080000:0.0:1762166975.307133:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf79eaa00/2, rc 0, transno 21474843134 00000100:00100000:0.0:1762166975.307139:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449675392:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166975.307160:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449675136 00000100:00100000:3.0:1762166975.307165:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449675136 00000100:00100000:0.0:1762166975.307179:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166975.307221:0:3633:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 17179876111 gen 2 00000004:00080000:0.0:1762166975.307227:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc48ab480, transno 17179876102 00000004:00080000:0.0:1762166975.307239:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc48a9c00, transno 17179876103 00000004:00080000:0.0:1762166975.307244:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc48ab100, transno 17179876104 00000004:00080000:0.0:1762166975.307248:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc48a8000, transno 17179876105 00000004:00080000:0.0:1762166975.307252:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc48ab800, transno 17179876106 00000004:00080000:0.0:1762166975.307257:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf1cd1180, transno 17179876107 00000004:00080000:0.0:1762166975.307259:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf1cd0a80, transno 17179876108 00000004:00080000:0.0:1762166975.307263:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf1cd2d80, transno 17179876109 00000100:00100000:3.0:1762166975.307266:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18678 00000004:00080000:0.0:1762166975.307269:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf1cd3b80, transno 17179876110 00000004:00080000:0.0:1762166975.307275:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf1cd0000, transno 17179876111 00000100:00100000:3.0:1762166975.307281:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+19:3636:x1847765449675136:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1762166975.307282:0:3633:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff945bc5bc2a00 x1847765449674752/t17179876127(17179876127) o2->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 440/432 e 0 to 0 dl 1762166991 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1762166975.307297:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc5bc2a00/2, rc 0, transno 17179876127 00000100:00100000:0.0:1762166975.307304:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449674752:0@lo:2:osp-syn-1-1.0 00000004:00080000:0.0:1762166975.307321:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc5bc2d80/2, rc 0, transno 17179876129 00000100:00100000:0.0:1762166975.307325:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449675264:0@lo:2:osp-syn-1-1.0 00002000:00010000:3.0:1762166975.307368:0:9165:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa83:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166975.307373:0:9165:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa83:0x0] updating lvb mtime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166975.307376:0:9165:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa83:0x0] updating lvb atime from disk: 1762166972 -> 1762166972 00002000:00010000:3.0:1762166975.307378:0:9165:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa83:0x0] updating lvb ctime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166975.307381:0:9165:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa83:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166975.307423:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+20:3636:x1847765449675136:12345-0@lo:2:osp-syn-0-1.0 Request processed in 148us (274us total) trans 21474843136 rc 0/0 00000004:00080000:0.0:1762166975.307423:0:9994:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0001: 0 changes, 5 in progress, 3 in flight, 10 done 00000100:00100000:3.0:1762166975.307437:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18678 00000004:00080000:0.0:1762166975.307455:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc5bc1880/2, rc 0, transno 17179876131 00000100:00100000:0.0:1762166975.307461:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449675776:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166975.307898:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450302848 00000100:00100000:3.0:1762166975.307902:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450302848 00000100:00100000:3.0:1762166975.307936:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30182 00000100:00100000:3.0:1762166975.307945:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+525:61832:x1847765450302848:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166975.307958:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166975.307970:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472600/0x2f180c4effba980e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e958f expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.308001:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472600/0x2f180c4effba980e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e958f expref: 526 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.308009:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472600/0x2f180c4effba980e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e958f expref: 526 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.308018:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166975.308021:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166975.308023:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8472600, rc 0) 00000100:00100000:3.0:1762166975.308051:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+526:61832:x1847765450302848:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 107us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166975.308059:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30182 00000100:00100000:3.0:1762166975.309237:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450302976 00000100:00100000:3.0:1762166975.309277:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450302976 00000100:00100000:3.0:1762166975.309310:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30183 00000100:00100000:3.0:1762166975.309317:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+526:61832:x1847765450302976:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166975.309328:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166975.309337:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effba9815 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9596 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.309397:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472a00/0x2f180c4effba981c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166975.309408:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472a00/0x2f180c4effba981c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166975.309417:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472a00/0x2f180c4effba981c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:3.0:1762166975.309440:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 262144 00000004:00200000:3.0:1762166975.309443:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166975.309457:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472a00/0x2f180c4effba981c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166975.309527:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effba9815 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9596 expref: 528 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.309546:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472a00/0x2f180c4effba981c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9596 expref: 527 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.309558:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166975.309561:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166975.309563:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8472a00, rc 0) 00000100:00100000:3.0:1762166975.309597:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+527:61832:x1847765450302976:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 279us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166975.309605:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30183 00000100:00100000:0.0:1762166975.310616:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.310780:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450303232 00000100:00100000:0.0:1762166975.310787:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450303232 00000100:00100000:0.0:1762166975.310833:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18682 00000100:00100000:3.0:1762166975.310850:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450303360 00000100:00100000:0.0:1762166975.310850:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+28:2419:x1847765450303232:12345-192.168.204.38@tcp:101:lfs.0 00000100:00100000:3.0:1762166975.310857:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450303360 00010000:00010000:0.0:1762166975.310862:0:8383:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166975.310877:0:8383:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf800/0x2f180c4effba982a lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e95a4 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166975.310894:0:8383:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa7a:0x0] initial LVB size: 0, mtime: 0x690888bf, atime: 0x690888bf, ctime: 0x690888bf, blocks: 0x1800 00000100:00100000:3.0:1762166975.310897:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18683 00010000:00010000:0.0:1762166975.310909:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1762166975.310910:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450303360:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166975.310912:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166975.310933:0:8383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf800/0x2f180c4effba982a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e95a4 expref: 29 pid: 8383 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166975.310934:0:8380:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166975.310949:0:8383:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf800/0x2f180c4effba982a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e95a4 expref: 29 pid: 8383 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166975.310957:0:8383:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdf800, rc 0) 00010000:00010000:3.0:1762166975.310981:0:8380:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effba9831 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e95ab expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166975.310992:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+29:2419:x1847765450303232:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 146us (247us total) trans 0 rc 0/0 00002000:00010000:3.0:1762166975.310998:0:8380:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa79:0x0] initial LVB size: 0, mtime: 0x690888bf, atime: 0x690888bf, ctime: 0x690888bf, blocks: 0x0 00000100:00100000:0.0:1762166975.311007:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18682 00010000:00010000:3.0:1762166975.311165:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166975.311168:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166975.311174:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effba9831 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e95ab expref: 20 pid: 8380 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166975.311186:0:8380:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effba9831 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e95ab expref: 20 pid: 8380 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166975.311195:0:8380:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8473c00, rc 0) 00000100:00100000:3.0:1762166975.311229:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450303360:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 323us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166975.311236:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18683 00010000:00010000:0.0:1762166975.314585:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166975.342753:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166975.342798:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450303488 00000100:00100000:3.0:1762166975.342806:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450303488 00000100:00100000:3.0:1762166975.342855:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18684 00000100:00100000:3.0:1762166975.342863:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945d011eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450303488:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:3.0:1762166975.343004:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945d011eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450303488:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 141us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166975.343009:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18684 00000100:00100000:3.0:1762166975.344233:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450303616 00000100:00100000:3.0:1762166975.344239:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450303616 00000100:00100000:3.0:1762166975.344272:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18685 00000100:00100000:3.0:1762166975.344280:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450303616:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:3.0:1762166975.344355:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450303616:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 75us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166975.344362:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18685 00010000:00010000:0.0:1762166975.349647:0:14623:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc7194800/0x2f180c4effba983f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 2 type: EXT [0->24575] (req 0->24575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.349659:0:14623:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc7194800/0x2f180c4effba983f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 2 type: EXT [0->24575] (req 0->24575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.351416:0:14623:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc7194800/0x2f180c4effba983f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 2 type: EXT [0->24575] (req 0->24575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.351428:0:14623:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc7194800/0x2f180c4effba983f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 2 type: EXT [0->24575] (req 0->24575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.351436:0:14623:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc7194800/0x2f180c4effba983f lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 2 type: EXT [0->24575] (req 0->24575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.351452:0:14623:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc7194800 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166975.351456:0:14623:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc7194800/0x2f180c4effba983f lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 2 type: EXT [0->24575] (req 0->24575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.351464:0:14623:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc7194800/0x2f180c4effba983f lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 2 type: EXT [0->24575] (req 0->24575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.351501:0:14623:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc7194800/0x2f180c4effba983f lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 2 type: EXT [0->24575] (req 0->24575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.351509:0:14623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc7194800/0x2f180c4effba983f lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 2 type: EXT [0->24575] (req 0->24575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166975.351573:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+17:2417:x1847765450303872:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 3281us (3370us total) trans 17179876132 rc 0/0 00000100:00100000:0.0:1762166975.351582:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1913 00000100:00100000:0.0:1762166975.352963:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450304128 00000100:00100000:0.0:1762166975.352971:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450304128 00000100:00100000:0.0:1762166975.353022:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1914 00000100:00100000:0.0:1762166975.353030:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+29:2419:x1847765450304128:12345-192.168.204.38@tcp:4:lfs.0 00002000:00010000:0.0:1762166975.353063:0:14623:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa86:0x0] initial LVB size: 247907, mtime: 0x690888bf, atime: 0x690888bd, ctime: 0x690888bf, blocks: 0x118 00010000:00010000:0.0:1762166975.353070:0:14623:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdea00/0x2f180c4effba9846 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.353080:0:14623:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166975.353082:0:14623:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166975.353087:0:14623:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdea00/0x2f180c4effba9846 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->24575] (req 0->24575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.353097:0:14623:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdea00/0x2f180c4effba9846 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->24575] (req 0->24575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.355051:0:14623:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdea00/0x2f180c4effba9846 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->24575] (req 0->24575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.355061:0:14623:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdea00/0x2f180c4effba9846 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->24575] (req 0->24575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.355067:0:14623:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdea00/0x2f180c4effba9846 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->24575] (req 0->24575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.355076:0:14623:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdea00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166975.355079:0:14623:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdea00/0x2f180c4effba9846 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->24575] (req 0->24575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.355085:0:14623:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdea00/0x2f180c4effba9846 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->24575] (req 0->24575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.355096:0:14623:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdea00/0x2f180c4effba9846 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->24575] (req 0->24575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.355101:0:14623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdea00/0x2f180c4effba9846 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->24575] (req 0->24575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166975.355171:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+16:2419:x1847765450304128:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 2139us (2255us total) trans 21474843138 rc 0/0 00000100:00100000:0.0:1762166975.355178:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1914 00000100:00100000:0.0:1762166975.356708:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450304256 00000100:00100000:0.0:1762166975.356716:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450304256 00000100:00100000:0.0:1762166975.356763:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1915 00000100:00100000:0.0:1762166975.356771:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450304256:12345-192.168.204.38@tcp:4:lfs.0 00002000:00010000:0.0:1762166975.356805:0:14623:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa86:0x0] initial LVB size: 247907, mtime: 0x690888bf, atime: 0x690888be, ctime: 0x690888bf, blocks: 0x118 00010000:00010000:0.0:1762166975.356810:0:14623:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effba984d lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.356820:0:14623:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166975.356821:0:14623:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166975.356826:0:14623:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effba984d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->24575] (req 0->24575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.356836:0:14623:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effba984d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->24575] (req 0->24575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.358551:0:14623:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effba984d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->24575] (req 0->24575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.358563:0:14623:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effba984d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->24575] (req 0->24575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.358571:0:14623:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effba984d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->24575] (req 0->24575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.358578:0:14623:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdfe00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166975.358583:0:14623:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effba984d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->24575] (req 0->24575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.358591:0:14623:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effba984d lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->24575] (req 0->24575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.358605:0:14623:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effba984d lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->24575] (req 0->24575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.358612:0:14623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effba984d lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->24575] (req 0->24575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166975.358672:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450304256:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 1901us (1997us total) trans 17179876133 rc 0/0 00000100:00100000:0.0:1762166975.358687:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1915 00000100:00100000:3.0:1762166975.360225:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450304384 00000100:00100000:3.0:1762166975.360236:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450304384 00000100:00100000:3.0:1762166975.360282:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18686 00000100:00100000:3.0:1762166975.360293:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450304384:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:3.0:1762166975.360388:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450304384:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 98us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166975.360394:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18686 00000100:00100000:0.0:1762166975.361575:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450304512 00000100:00100000:0.0:1762166975.361580:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450304512 00000100:00100000:0.0:1762166975.361618:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18687 00000100:00100000:0.0:1762166975.361628:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc70b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450304512:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:0.0:1762166975.361691:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc70b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450304512:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 66us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166975.361696:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18687 00000100:00100000:3.0:1762166975.363098:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450304768 00000100:00100000:3.0:1762166975.363106:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450304768 00000100:00100000:3.0:1762166975.363152:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30184 00000100:00100000:3.0:1762166975.363159:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc70b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+527:61832:x1847765450304768:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:3.0:1762166975.363204:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166975.363225:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472a00/0x2f180c4effba981c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9596 expref: 527 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.363239:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166975.363242:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166975.363401:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effba9854 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166975.363411:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effba9854 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166975.363418:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effba9854 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000001:00080000:3.0:1762166975.363464:0:6495:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294991759 00000004:00010000:3.0:1762166975.363515:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000017f602d5 reply state 00000000fc9b6cca transno 4294991760 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effba9854 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166975.363528:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effba9854 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166975.363535:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166975.363538:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1762166975.363540:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166975.363611:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc70b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+529:61832:x1847765450304768:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 452us (574us total) trans 4294991760 rc 0/0 00000100:00100000:3.0:1762166975.363617:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30184 00000020:00080000:3.0:1762166975.363621:0:6495:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1762166975.364719:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450304896 00000100:00100000:0.0:1762166975.364729:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450304896 00000100:00100000:0.0:1762166975.364776:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18688 00000100:00100000:0.0:1762166975.364786:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+17:61832:x1847765450304896:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166975.364802:0:8380:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166975.364821:0:8380:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdea00/0x2f180c4effba985b lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e95b2 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166975.364845:0:8380:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa82:0x0] initial LVB size: 247907, mtime: 0x690888bf, atime: 0x690888bc, ctime: 0x690888bf, blocks: 0x118 00010000:00010000:0.0:1762166975.364865:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166975.364868:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166975.364875:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdea00/0x2f180c4effba985b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e95b2 expref: 18 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.364892:0:8380:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdea00/0x2f180c4effba985b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e95b2 expref: 18 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.364905:0:8380:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdea00, rc 0) 00000100:00100000:0.0:1762166975.364968:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+18:61832:x1847765450304896:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 184us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166975.364977:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18688 00000100:00100000:0.0:1762166975.365909:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450305024 00000100:00100000:0.0:1762166975.365927:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450305024 00002000:00010000:0.0:1762166975.365959:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2690 (24576->18446744073709551615) 00002000:00100000:0.0:1762166975.365964:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc55dea00 with x1847765450305024 ext(24576->18446744073709551615) 00002000:00010000:0.0:1762166975.365973:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc55dea00. 00000100:00100000:0.0:1762166975.366005:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1916 00000100:00100000:0.0:1762166975.366018:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450305024:12345-192.168.204.38@tcp:10:lfs.0 00000100:00100000:3.0:1762166975.366070:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450305152 00000100:00100000:3.0:1762166975.366076:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450305152 00002000:00010000:3.0:1762166975.366095:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2691 (0->18446744073709551615) 00002000:00100000:3.0:1762166975.366099:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc55dca80 with x1847765450305152 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166975.366107:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc55dca80. 00000100:00100000:3.0:1762166975.366177:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1917 00000100:00100000:3.0:1762166975.366187:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+16:2419:x1847765450305152:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:3.0:1762166975.366305:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa83:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166975.366309:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa83:0x0] updating lvb mtime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166975.366321:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa83:0x0] updating lvb atime from disk: 1762166972 -> 1762166972 00002000:00010000:3.0:1762166975.366324:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa83:0x0] updating lvb ctime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166975.366326:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa83:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166975.366378:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450305152:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 192us (364us total) trans 21474843139 rc 0/0 00000100:00100000:3.0:1762166975.366387:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1917 00002000:00010000:3.0:1762166975.366392:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2691 (0->18446744073709551615) 00002000:00100000:3.0:1762166975.366395:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc55dca80 with x1847765450305152 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166975.366401:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc55dca80. 00002000:00010000:0.0:1762166975.366435:0:14623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa82:0x0] updating lvb size from disk: 247907 -> 24576 00002000:00010000:0.0:1762166975.366440:0:14623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa82:0x0] updating lvb mtime from disk: 1762166975 -> 1762166975 00002000:00010000:0.0:1762166975.366443:0:14623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa82:0x0] updating lvb atime from disk: 1762166972 -> 1762166972 00002000:00010000:0.0:1762166975.366445:0:14623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa82:0x0] updating lvb ctime from disk: 1762166975 -> 1762166975 00002000:00010000:0.0:1762166975.366447:0:14623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa82:0x0] updating lvb blocks from disk: 280 -> 48 00000100:00100000:0.0:1762166975.366558:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450305024:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 543us (696us total) trans 17179876134 rc 0/0 00000100:00100000:0.0:1762166975.366565:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1916 00002000:00010000:0.0:1762166975.366569:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2690 (24576->18446744073709551615) 00002000:00100000:0.0:1762166975.366571:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc55dea00 with x1847765450305024 ext(24576->18446744073709551615) 00002000:00010000:0.0:1762166975.366576:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc55dea00. 00000100:00100000:3.0:1762166975.367852:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450305280 00000100:00100000:3.0:1762166975.367858:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450305280 00000100:00100000:3.0:1762166975.367897:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30185 00000100:00100000:3.0:1762166975.367906:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+529:61832:x1847765450305280:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166975.367933:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166975.367949:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473000/0x2f180c4effba9862 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e95b9 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.368023:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effba9869 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166975.368036:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effba9869 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166975.368046:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effba9869 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:3.0:1762166975.368071:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 24576 00000004:00200000:3.0:1762166975.368075:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166975.368090:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effba9869 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166975.368110:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473000/0x2f180c4effba9862 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e95b9 expref: 531 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.368124:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effba9869 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e95b9 expref: 530 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.368133:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166975.368136:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166975.368139:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8472000, rc 0) 00000100:00100000:3.0:1762166975.368174:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+530:61832:x1847765450305280:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 270us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166975.368181:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30185 00000100:00100000:3.0:1762166975.369456:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450305536 00000100:00100000:3.0:1762166975.369463:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450305536 00000100:00100000:3.0:1762166975.369532:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30186 00000100:00100000:3.0:1762166975.369543:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+530:61832:x1847765450305536:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:3.0:1762166975.369576:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166975.369593:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effba9869 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e95b9 expref: 530 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.369606:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166975.369609:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166975.369751:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473600/0x2f180c4effba9870 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166975.369762:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473600/0x2f180c4effba9870 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166975.369770:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473600/0x2f180c4effba9870 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000001:00080000:3.0:1762166975.369813:0:6495:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294991761 00000004:00010000:3.0:1762166975.369834:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000eb46c7f6 reply state 000000004be5b812 transno 4294991762 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473600/0x2f180c4effba9870 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166975.369846:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473600/0x2f180c4effba9870 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166975.369852:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166975.369854:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1762166975.369857:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166975.369928:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+532:61832:x1847765450305536:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 376us (534us total) trans 4294991762 rc 0/0 00000100:00100000:3.0:1762166975.369935:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30186 00000020:00080000:3.0:1762166975.369940:0:6495:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1762166975.371025:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450305664 00000100:00100000:0.0:1762166975.371030:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450305664 00000100:00100000:0.0:1762166975.371069:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18689 00000100:00100000:0.0:1762166975.371077:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1dde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+17:61832:x1847765450305664:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166975.371091:0:8380:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166975.371108:0:8380:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effba9877 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e95c0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166975.371128:0:8380:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa86:0x0] initial LVB size: 247907, mtime: 0x690888bf, atime: 0x690888bd, ctime: 0x690888bf, blocks: 0x118 00010000:00010000:0.0:1762166975.371144:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166975.371146:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166975.371153:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effba9877 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e95c0 expref: 18 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.371167:0:8380:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effba9877 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e95c0 expref: 18 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.371177:0:8380:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdfe00, rc 0) 00000100:00100000:0.0:1762166975.371218:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1dde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+18:61832:x1847765450305664:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 141us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166975.371224:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18689 00000100:00100000:0.0:1762166975.372213:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450305792 00000100:00100000:0.0:1762166975.372219:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450305792 00002000:00010000:0.0:1762166975.372243:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2694 (24576->18446744073709551615) 00002000:00100000:0.0:1762166975.372248:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1ddfb80 with x1847765450305792 ext(24576->18446744073709551615) 00002000:00010000:0.0:1762166975.372255:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945cf1ddfb80. 00000100:00100000:0.0:1762166975.372279:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450305920 00000100:00100000:0.0:1762166975.372283:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450305920 00002000:00010000:0.0:1762166975.372295:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2693 (0->18446744073709551615) 00002000:00100000:0.0:1762166975.372299:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1ddce00 with x1847765450305920 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166975.372305:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1ddce00. 00000100:00100000:3.0:1762166975.372329:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1919 00000100:00100000:3.0:1762166975.372343:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+19:2416:x1847765450305920:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:3.0:1762166975.372473:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166975.372500:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb mtime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166975.372503:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb atime from disk: 1762166973 -> 1762166973 00002000:00010000:3.0:1762166975.372505:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb ctime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166975.372507:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166975.372536:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+20:2416:x1847765450305920:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 199us (301us total) trans 17179876135 rc 0/0 00000100:00100000:3.0:1762166975.372543:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1919 00002000:00010000:3.0:1762166975.372546:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2693 (0->18446744073709551615) 00002000:00100000:3.0:1762166975.372549:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1ddce00 with x1847765450305920 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166975.372555:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1ddce00. 00000100:00100000:3.0:1762166975.374021:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450306048 00000100:00100000:3.0:1762166975.374034:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450306048 00000100:00100000:3.0:1762166975.374093:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30187 00000100:00100000:3.0:1762166975.374102:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1dddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+532:61832:x1847765450306048:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166975.374127:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166975.374148:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472c00/0x2f180c4effba987e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e95c7 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.374246:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473a00/0x2f180c4effba9885 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166975.374263:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473a00/0x2f180c4effba9885 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166975.374276:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473a00/0x2f180c4effba9885 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:3.0:1762166975.374307:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 24576 00000004:00200000:3.0:1762166975.374312:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166975.374329:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473a00/0x2f180c4effba9885 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166975.374357:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472c00/0x2f180c4effba987e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e95c7 expref: 534 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.374378:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473a00/0x2f180c4effba9885 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e95c7 expref: 533 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.374387:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166975.374390:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166975.374394:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8473a00, rc 0) 00000100:00100000:3.0:1762166975.374466:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1dddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+533:61832:x1847765450306048:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 352us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166975.374526:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30187 00000100:00100000:3.0:1762166975.376294:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450306304 00000100:00100000:3.0:1762166975.376303:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450306304 00000100:00100000:3.0:1762166975.376362:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30188 00000100:00100000:3.0:1762166975.376371:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1dde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+533:61832:x1847765450306304:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:3.0:1762166975.376417:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166975.376441:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473a00/0x2f180c4effba9885 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e95c7 expref: 533 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.376463:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166975.376467:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166975.378155:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450306432 00000100:00100000:0.0:1762166975.378163:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450306432 00000100:00100000:0.0:1762166975.378221:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18690 00000100:00100000:0.0:1762166975.378230:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+20:61832:x1847765450306432:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166975.378245:0:8380:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166975.378260:0:8380:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde600/0x2f180c4effba9893 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e95ce expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166975.378281:0:8380:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa86:0x0] initial LVB size: 247907, mtime: 0x690888bf, atime: 0x690888be, ctime: 0x690888bf, blocks: 0x118 00010000:00010000:0.0:1762166975.378298:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166975.378300:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166975.378306:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde600/0x2f180c4effba9893 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e95ce expref: 21 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.378320:0:8380:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde600/0x2f180c4effba9893 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e95ce expref: 21 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.378330:0:8380:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bde600, rc 0) 00000100:00100000:0.0:1762166975.378366:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+21:61832:x1847765450306432:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 137us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166975.378373:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18690 00000100:00100000:3.0:1762166975.379612:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450306688 00000100:00100000:3.0:1762166975.379623:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450306688 00002000:00010000:3.0:1762166975.379654:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2695 (0->18446744073709551615) 00002000:00100000:3.0:1762166975.379661:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5805880 with x1847765450306688 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166975.379674:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc5805880. 00000100:00100000:3.0:1762166975.379717:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1921 00000100:00100000:3.0:1762166975.379731:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5805880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450306688:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:3.0:1762166975.379889:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa87:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166975.379894:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa87:0x0] updating lvb mtime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166975.379897:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa87:0x0] updating lvb atime from disk: 1762166974 -> 1762166974 00002000:00010000:3.0:1762166975.379900:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa87:0x0] updating lvb ctime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166975.379903:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa87:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166975.379982:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5805880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450306688:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 255us (419us total) trans 21474843141 rc 0/0 00000100:00100000:3.0:1762166975.379991:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1921 00002000:00010000:3.0:1762166975.379996:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2695 (0->18446744073709551615) 00002000:00100000:3.0:1762166975.379999:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5805880 with x1847765450306688 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166975.380004:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc5805880. 00000100:00100000:3.0:1762166975.393139:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.394769:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450307456 00000100:00100000:0.0:1762166975.394777:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450307456 00010000:00010000:0.0:1762166975.394820:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effba9877 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e95c0 expref: 21 pid: 8380 timeout: 694 lvb_type: 0 00000100:00100000:0.0:1762166975.394857:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9443 00000100:00100000:0.0:1762166975.394869:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5804700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450307456:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166975.394885:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166975.394904:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effba9877 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e95c0 expref: 21 pid: 8380 timeout: 694 lvb_type: 0 00010000:00010000:0.0:1762166975.394924:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effba9877 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e95c0 expref: 21 pid: 8380 timeout: 694 lvb_type: 0 00010000:00010000:0.0:1762166975.394946:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effba9877 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e95c0 expref: 21 pid: 8380 timeout: 694 lvb_type: 0 00010000:00010000:0.0:1762166975.394961:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166975.394963:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166975.394968:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8600/0x2f180c4effba98b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [94208->139263] (req 94208->139263) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.394981:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8600/0x2f180c4effba98b6 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [94208->139263] (req 94208->139263) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.395010:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166975.395058:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5804700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450307456:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 192us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166975.395066:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9443 00000100:00100000:3.0:1762166975.399459:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166975.400856:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.400896:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450307712 00000100:00100000:0.0:1762166975.400901:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450307712 00010000:00010000:0.0:1762166975.400932:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde600/0x2f180c4effba9893 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e95ce expref: 19 pid: 8380 timeout: 694 lvb_type: 0 00000100:00100000:0.0:1762166975.400956:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9444 00000100:00100000:0.0:1762166975.400966:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450307712:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166975.400976:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166975.400988:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde600/0x2f180c4effba9893 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e95ce expref: 19 pid: 8380 timeout: 694 lvb_type: 0 00010000:00010000:0.0:1762166975.400997:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde600/0x2f180c4effba9893 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e95ce expref: 19 pid: 8380 timeout: 694 lvb_type: 0 00010000:00010000:0.0:1762166975.401011:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde600/0x2f180c4effba9893 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e95ce expref: 19 pid: 8380 timeout: 694 lvb_type: 0 00010000:00010000:0.0:1762166975.401021:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166975.401022:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166975.401025:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9400/0x2f180c4effba98bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 3 type: EXT [94208->139263] (req 94208->139263) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.401031:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9400/0x2f180c4effba98bd lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 3 type: EXT [94208->139263] (req 94208->139263) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.401049:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166975.401080:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450307712:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 116us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166975.401093:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9444 00000100:00100000:0.0:1762166975.405509:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450307840 00000100:00100000:0.0:1762166975.405518:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450307840 00000100:00100000:0.0:1762166975.405569:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18691 00000100:00100000:0.0:1762166975.405580:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5807800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+17:2416:x1847765450307840:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:0.0:1762166975.405686:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5807800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+17:2416:x1847765450307840:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 109us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166975.405691:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18691 00000100:00100000:0.0:1762166975.406799:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450307968 00000100:00100000:0.0:1762166975.406812:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450307968 00000100:00100000:0.0:1762166975.406849:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18692 00000100:00100000:0.0:1762166975.406857:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5806300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450307968:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:0.0:1762166975.406927:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5806300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450307968:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 60us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166975.406935:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18692 00000100:00100000:3.0:1762166975.408228:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.410005:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450308352 00000100:00100000:0.0:1762166975.410012:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450308352 00000100:00100000:0.0:1762166975.410047:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18693 00000100:00100000:0.0:1762166975.410056:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5807100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+17:61832:x1847765450308352:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166975.410069:0:8380:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166975.410086:0:8380:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effba98cb lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e95dc expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166975.410104:0:8380:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa82:0x0] initial LVB size: 139264, mtime: 0x690888bf, atime: 0x690888bc, ctime: 0x690888bf, blocks: 0x88 00010000:00010000:0.0:1762166975.410121:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166975.410123:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166975.410142:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effba98cb lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e95dc expref: 18 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.410159:0:8380:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effba98cb lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e95dc expref: 18 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.410174:0:8380:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdfe00, rc 0) 00000100:00100000:0.0:1762166975.410211:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5807100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+18:61832:x1847765450308352:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 156us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166975.410220:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18693 00000100:00100000:3.0:1762166975.411701:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1927 00000100:00100000:3.0:1762166975.411718:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+16:2416:x1847765450308608:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:3.0:1762166975.411851:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa83:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166975.411858:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa83:0x0] updating lvb mtime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166975.411863:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa83:0x0] updating lvb atime from disk: 1762166972 -> 1762166972 00002000:00010000:3.0:1762166975.411872:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa83:0x0] updating lvb ctime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166975.411878:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa83:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166975.411930:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+17:2416:x1847765450308608:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 205us (338us total) trans 21474843143 rc 0/0 00000100:00100000:3.0:1762166975.411955:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1927 00002000:00010000:3.0:1762166975.411965:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2691 (0->18446744073709551615) 00002000:00100000:3.0:1762166975.411969:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf783b100 with x1847765450308608 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166975.411976:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945cf783b100. 00000100:00100000:3.0:1762166975.414007:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.417250:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450309120 00000100:00100000:0.0:1762166975.417255:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450309120 00000100:00100000:0.0:1762166975.417282:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18694 00000100:00100000:0.0:1762166975.417287:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf7839180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+17:61832:x1847765450309120:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166975.417295:0:8380:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166975.417307:0:8380:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde600/0x2f180c4effba98e7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e95ea expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166975.417323:0:8380:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa86:0x0] initial LVB size: 139264, mtime: 0x690888bf, atime: 0x690888bd, ctime: 0x690888bf, blocks: 0x88 00010000:00010000:0.0:1762166975.417338:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166975.417341:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166975.417348:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde600/0x2f180c4effba98e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e95ea expref: 18 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.417361:0:8380:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde600/0x2f180c4effba98e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e95ea expref: 18 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.417370:0:8380:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bde600, rc 0) 00000100:00100000:0.0:1762166975.417405:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf7839180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+18:61832:x1847765450309120:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 116us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166975.417412:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18694 00000100:00100000:3.0:1762166975.418267:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166975.418300:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.421112:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166975.422538:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.422583:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450309888 00000100:00100000:0.0:1762166975.422589:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450309888 00000100:00100000:0.0:1762166975.422625:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18695 00000100:00100000:0.0:1762166975.422634:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+20:61832:x1847765450309888:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166975.422645:0:8380:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166975.422656:0:8380:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf200/0x2f180c4effba9903 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e95f8 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166975.422674:0:8380:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa86:0x0] initial LVB size: 139264, mtime: 0x690888bf, atime: 0x690888be, ctime: 0x690888bf, blocks: 0x88 00010000:00010000:0.0:1762166975.422689:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166975.422692:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166975.422712:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf200/0x2f180c4effba9903 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e95f8 expref: 21 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.422725:0:8380:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf200/0x2f180c4effba9903 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e95f8 expref: 21 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.422736:0:8380:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdf200, rc 0) 00000100:00100000:0.0:1762166975.422774:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+21:61832:x1847765450309888:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 141us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166975.422781:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18695 00000100:00100000:3.0:1762166975.424175:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1930 00000100:00100000:3.0:1762166975.424201:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+21:2416:x1847765450310016:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:3.0:1762166975.424380:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa86:0x0] updating lvb size from disk: 139264 -> 139264 00002000:00010000:3.0:1762166975.424386:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa86:0x0] updating lvb mtime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166975.424389:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa86:0x0] updating lvb atime from disk: 1762166974 -> 1762166974 00002000:00010000:3.0:1762166975.424392:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa86:0x0] updating lvb ctime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166975.424395:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa86:0x0] updating lvb blocks from disk: 136 -> 136 00000100:00100000:3.0:1762166975.424451:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+22:2416:x1847765450310016:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 261us (436us total) trans 17179876141 rc 0/0 00000100:00100000:3.0:1762166975.424463:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1930 00002000:00010000:3.0:1762166975.424469:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2694 (139264->18446744073709551615) 00002000:00100000:3.0:1762166975.424473:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf783a680 with x1847765450310016 ext(139264->18446744073709551615) 00002000:00010000:3.0:1762166975.424531:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf783a680. 00000100:00100000:0.0:1762166975.427256:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166975.427364:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450310400 00000100:00100000:3.0:1762166975.427374:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450310400 00000100:00100000:3.0:1762166975.427425:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1932 00000100:00100000:3.0:1762166975.427432:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945d011e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450310400:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:3.0:1762166975.427465:0:23940:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8472000/0x2f180c4effba9918 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.427513:0:23940:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166975.427515:0:23940:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166975.427521:0:23940:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472000/0x2f180c4effba9918 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.427532:0:23940:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8472000/0x2f180c4effba9918 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.427630:0:23940:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8472000/0x2f180c4effba9918 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.427636:0:23940:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472000/0x2f180c4effba9918 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.427641:0:23940:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc8472000/0x2f180c4effba9918 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.427646:0:23940:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8472000 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166975.427649:0:23940:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8472000/0x2f180c4effba9918 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.427654:0:23940:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8472000/0x2f180c4effba9918 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.427666:0:23940:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc8472000/0x2f180c4effba9918 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.427677:0:23940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8472000/0x2f180c4effba9918 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166975.427736:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945d011e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450310400:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 304us (481us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1762166975.427744:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1932 00000100:00100000:3.0:1762166975.429595:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450310528 00000100:00100000:3.0:1762166975.429650:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450310528 00000100:00100000:3.0:1762166975.429714:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1933 00000100:00100000:3.0:1762166975.429725:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450310528:12345-192.168.204.38@tcp:4:lfs.0 00010000:00010000:3.0:1762166975.429758:0:23940:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc8473a00/0x2f180c4effba991f lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.429778:0:23940:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effba98cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e95dc expref: 22 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.429788:0:23940:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166975.429790:0:23940:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166975.429793:0:23940:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8473a00/0x2f180c4effba991f lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 3 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.429832:0:23940:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effba98cb lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e95dc expref: 22 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.429850:0:23940:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effba98cb lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e95dc expref: 22 pid: 8380 timeout: 694 lvb_type: 0 00000100:00100000:3.0:1762166975.429876:0:23940:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc558aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_007:lustre-OST0001_UUID:23940:1847765449676416:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166975.430013:0:23940:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402f780 going to sleep for 11 seconds 00000100:00100000:3.0:1762166975.430984:0:23940:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc558aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_007:lustre-OST0001_UUID:23940:1847765449676416:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166975.431009:0:23940:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc8473a00/0x2f180c4effba991f lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 3 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166975.431280:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450310656 00000100:00100000:0.0:1762166975.431287:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450310656 00010000:00010000:0.0:1762166975.431313:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effba98cb lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e95dc expref: 23 pid: 8380 timeout: 694 lvb_type: 0 00000100:00100000:0.0:1762166975.431341:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9445 00000100:00100000:0.0:1762166975.431348:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cd425a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765450310656:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166975.431359:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166975.431382:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effba98cb lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e95dc expref: 23 pid: 8380 timeout: 694 lvb_type: 0 00010000:00010000:0.0:1762166975.431391:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effba98cb lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e95dc expref: 23 pid: 8380 timeout: 694 lvb_type: 0 00010000:00010000:0.0:1762166975.431408:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effba98cb lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e95dc expref: 23 pid: 8380 timeout: 694 lvb_type: 0 00010000:00010000:0.0:1762166975.431427:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166975.431429:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166975.431434:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc8473a00/0x2f180c4effba991f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 3 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.431443:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8473a00/0x2f180c4effba991f lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 3 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.431470:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166975.431509:0:23940:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc8473a00/0x2f180c4effba991f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 2 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.431519:0:23940:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8473a00/0x2f180c4effba991f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 2 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166975.431536:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cd425a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765450310656:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 187us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166975.431543:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9445 00002000:00010000:3.0:1762166975.432735:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa82:0x0] updating lvb size from disk: 139264 -> 151552 00002000:00010000:3.0:1762166975.432739:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa82:0x0] updating lvb blocks from disk: 136 -> 144 00010000:00010000:3.0:1762166975.432747:0:23940:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc8473a00/0x2f180c4effba991f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 2 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.432756:0:23940:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8473a00/0x2f180c4effba991f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 2 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.432763:0:23940:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc8473a00/0x2f180c4effba991f lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 2 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.432769:0:23940:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8473a00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166975.432772:0:23940:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8473a00/0x2f180c4effba991f lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 2 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.432779:0:23940:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8473a00/0x2f180c4effba991f lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 2 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.432788:0:23940:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc8473a00/0x2f180c4effba991f lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 2 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.432792:0:23940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8473a00/0x2f180c4effba991f lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 2 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166975.432835:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450310528:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 3113us (3293us total) trans 17179876142 rc 0/0 00000100:00100000:3.0:1762166975.432841:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1933 00000100:00100000:3.0:1762166975.434618:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450310784 00000100:00100000:3.0:1762166975.434624:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450310784 00000100:00100000:3.0:1762166975.434667:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1934 00000100:00100000:3.0:1762166975.434675:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+20:2416:x1847765450310784:12345-192.168.204.38@tcp:4:lfs.0 00010000:00010000:3.0:1762166975.434695:0:23940:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc8472c00/0x2f180c4effba9926 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.434707:0:23940:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde600/0x2f180c4effba98e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e95ea expref: 20 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.434713:0:23940:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166975.434715:0:23940:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166975.434718:0:23940:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8472c00/0x2f180c4effba9926 lrc: 4/0,1 mode: --/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.434751:0:23940:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde600/0x2f180c4effba98e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e95ea expref: 20 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.434764:0:23940:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde600/0x2f180c4effba98e7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e95ea expref: 20 pid: 8380 timeout: 694 lvb_type: 0 00000100:00100000:3.0:1762166975.434777:0:23940:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc558aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_007:lustre-OST0000_UUID:23940:1847765449676544:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166975.434834:0:23940:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402f780 going to sleep for 11 seconds 00000100:00100000:3.0:1762166975.435658:0:23940:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc558aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_007:lustre-OST0000_UUID:23940:1847765449676544:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166975.435673:0:23940:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bc8472c00/0x2f180c4effba9926 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166975.435967:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450310912 00000100:00100000:0.0:1762166975.435972:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450310912 00010000:00010000:0.0:1762166975.435995:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde600/0x2f180c4effba98e7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e95ea expref: 21 pid: 8380 timeout: 694 lvb_type: 0 00000100:00100000:0.0:1762166975.436024:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9446 00000100:00100000:0.0:1762166975.436033:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450310912:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166975.436043:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166975.436057:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde600/0x2f180c4effba98e7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e95ea expref: 21 pid: 8380 timeout: 694 lvb_type: 0 00010000:00010000:0.0:1762166975.436069:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde600/0x2f180c4effba98e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e95ea expref: 21 pid: 8380 timeout: 694 lvb_type: 0 00010000:00010000:0.0:1762166975.436086:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde600/0x2f180c4effba98e7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e95ea expref: 21 pid: 8380 timeout: 694 lvb_type: 0 00010000:00010000:0.0:1762166975.436098:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166975.436100:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166975.436104:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc8472c00/0x2f180c4effba9926 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.436113:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8472c00/0x2f180c4effba9926 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.436135:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166975.436154:0:23940:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bc8472c00/0x2f180c4effba9926 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.436166:0:23940:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc8472c00/0x2f180c4effba9926 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166975.436168:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450310912:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 136us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166975.436183:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9446 00002000:00010000:3.0:1762166975.437245:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb size from disk: 139264 -> 151552 00002000:00010000:3.0:1762166975.437249:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb blocks from disk: 136 -> 144 00010000:00010000:3.0:1762166975.437256:0:23940:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc8472c00/0x2f180c4effba9926 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.437266:0:23940:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8472c00/0x2f180c4effba9926 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.437278:0:23940:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc8472c00/0x2f180c4effba9926 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.437285:0:23940:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8472c00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166975.437289:0:23940:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc8472c00/0x2f180c4effba9926 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.437297:0:23940:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc8472c00/0x2f180c4effba9926 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.437310:0:23940:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc8472c00/0x2f180c4effba9926 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.437317:0:23940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc8472c00/0x2f180c4effba9926 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166975.437359:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+16:2416:x1847765450310784:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 2686us (2792us total) trans 21474843146 rc 0/0 00000100:00100000:3.0:1762166975.437364:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1934 00000100:00100000:3.0:1762166975.438983:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450311040 00000100:00100000:3.0:1762166975.438990:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450311040 00000100:00100000:3.0:1762166975.439041:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1935 00000100:00100000:3.0:1762166975.439051:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+18:2417:x1847765450311040:12345-192.168.204.38@tcp:4:lfs.0 00010000:00010000:3.0:1762166975.439078:0:23940:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effba992d lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.439097:0:23940:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf200/0x2f180c4effba9903 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e95f8 expref: 18 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.439105:0:23940:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166975.439107:0:23940:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166975.439110:0:23940:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effba992d lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 3 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.439136:0:23940:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf200/0x2f180c4effba9903 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e95f8 expref: 18 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.439149:0:23940:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf200/0x2f180c4effba9903 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e95f8 expref: 18 pid: 8380 timeout: 694 lvb_type: 0 00000100:00100000:3.0:1762166975.439163:0:23940:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc558aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_007:lustre-OST0001_UUID:23940:1847765449676672:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166975.439228:0:23940:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402f780 going to sleep for 11 seconds 00000100:00100000:3.0:1762166975.439943:0:23940:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc558aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_007:lustre-OST0001_UUID:23940:1847765449676672:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166975.439960:0:23940:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effba992d lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 3 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166975.440132:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450311168 00000100:00100000:0.0:1762166975.440138:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450311168 00010000:00010000:0.0:1762166975.440159:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf200/0x2f180c4effba9903 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e95f8 expref: 19 pid: 8380 timeout: 694 lvb_type: 0 00000100:00100000:0.0:1762166975.440190:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9447 00000100:00100000:0.0:1762166975.440200:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450311168:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166975.440210:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166975.440221:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf200/0x2f180c4effba9903 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e95f8 expref: 19 pid: 8380 timeout: 694 lvb_type: 0 00010000:00010000:0.0:1762166975.440229:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf200/0x2f180c4effba9903 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e95f8 expref: 19 pid: 8380 timeout: 694 lvb_type: 0 00010000:00010000:0.0:1762166975.440241:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf200/0x2f180c4effba9903 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e95f8 expref: 19 pid: 8380 timeout: 694 lvb_type: 0 00010000:00010000:0.0:1762166975.440249:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166975.440251:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166975.440253:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effba992d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 3 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.440259:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effba992d lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 3 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.440275:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166975.440296:0:23940:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effba992d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 2 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166975.440300:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450311168:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 103us (209us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166975.440318:0:23940:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effba992d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 2 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166975.440319:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9447 00002000:00010000:3.0:1762166975.441399:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa86:0x0] updating lvb size from disk: 139264 -> 151552 00002000:00010000:3.0:1762166975.441406:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa86:0x0] updating lvb blocks from disk: 136 -> 144 00010000:00010000:3.0:1762166975.441411:0:23940:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effba992d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 2 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.441417:0:23940:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effba992d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 2 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.441423:0:23940:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effba992d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 2 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.441428:0:23940:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8473000 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166975.441431:0:23940:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effba992d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 2 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.441436:0:23940:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effba992d lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 2 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.441443:0:23940:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effba992d lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 2 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.441447:0:23940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effba992d lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 2 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166975.441515:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+17:2417:x1847765450311040:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 2465us (2617us total) trans 17179876143 rc 0/0 00000100:00100000:3.0:1762166975.441523:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1935 00000100:00100000:0.0:1762166975.442975:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450311296 00000100:00100000:0.0:1762166975.442980:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450311296 00000100:00100000:0.0:1762166975.443010:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18696 00000100:00100000:0.0:1762166975.443015:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450311296:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:0.0:1762166975.443076:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450311296:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 61us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166975.443082:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18696 00000100:00100000:0.0:1762166975.443946:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450311424 00000100:00100000:0.0:1762166975.443950:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450311424 00000100:00100000:0.0:1762166975.443975:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18697 00000100:00100000:0.0:1762166975.443980:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450311424:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:0.0:1762166975.444019:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450311424:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 39us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166975.444023:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18697 00000100:00100000:0.0:1762166975.446648:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450311808 00000100:00100000:0.0:1762166975.446652:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450311808 00000100:00100000:0.0:1762166975.446677:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18698 00000100:00100000:0.0:1762166975.446682:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+17:61832:x1847765450311808:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166975.446690:0:8380:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166975.446701:0:8380:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effba993b lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9606 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166975.446714:0:8380:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa82:0x0] initial LVB size: 151552, mtime: 0x690888bf, atime: 0x690888bc, ctime: 0x690888bf, blocks: 0x90 00010000:00010000:0.0:1762166975.446725:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166975.446727:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166975.446731:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effba993b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9606 expref: 18 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.446740:0:8380:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effba993b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9606 expref: 18 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.446746:0:8380:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdfe00, rc 0) 00000100:00100000:0.0:1762166975.446772:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+18:61832:x1847765450311808:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 89us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166975.446779:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18698 00000100:00100000:3.0:1762166975.447821:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450312064 00000100:00100000:3.0:1762166975.447836:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450312064 00002000:00010000:3.0:1762166975.447880:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2691 (0->18446744073709551615) 00002000:00100000:3.0:1762166975.447886:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bccb7ca80 with x1847765450312064 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166975.447898:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bccb7ca80. 00000100:00100000:3.0:1762166975.447948:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1937 00000100:00100000:3.0:1762166975.447963:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+16:2418:x1847765450312064:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:3.0:1762166975.448121:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa83:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166975.448126:0:23943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa83:0x0] updating lvb mtime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166975.448129:0:23943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa83:0x0] updating lvb atime from disk: 1762166972 -> 1762166972 00002000:00010000:3.0:1762166975.448132:0:23943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa83:0x0] updating lvb ctime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166975.448134:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa83:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166975.448194:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450312064:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 235us (437us total) trans 21474843147 rc 0/0 00000100:00100000:3.0:1762166975.448203:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1937 00002000:00010000:3.0:1762166975.448208:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2691 (0->18446744073709551615) 00002000:00100000:3.0:1762166975.448211:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bccb7ca80 with x1847765450312064 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166975.448217:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bccb7ca80. 00000100:00100000:0.0:1762166975.452630:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450312576 00000100:00100000:0.0:1762166975.452636:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450312576 00000100:00100000:0.0:1762166975.452681:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18699 00000100:00100000:0.0:1762166975.452691:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+17:61832:x1847765450312576:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166975.452703:0:8380:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166975.452719:0:8380:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde600/0x2f180c4effba9957 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9614 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166975.452737:0:8380:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa86:0x0] initial LVB size: 151552, mtime: 0x690888bf, atime: 0x690888bd, ctime: 0x690888bf, blocks: 0x90 00010000:00010000:0.0:1762166975.452752:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166975.452754:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166975.452760:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde600/0x2f180c4effba9957 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9614 expref: 18 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.452779:0:8380:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde600/0x2f180c4effba9957 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9614 expref: 18 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.452796:0:8380:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bde600, rc 0) 00000100:00100000:0.0:1762166975.452835:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+18:61832:x1847765450312576:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 147us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166975.452842:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18699 00000100:00100000:0.0:1762166975.453758:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.453794:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166975.453817:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450312704 00000100:00100000:3.0:1762166975.453822:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450312704 00002000:00010000:3.0:1762166975.453844:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2694 (151552->18446744073709551615) 00002000:00100000:3.0:1762166975.453849:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945d011e8e00 with x1847765450312704 ext(151552->18446744073709551615) 00002000:00010000:3.0:1762166975.453855:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945d011e8e00. 00000100:00100000:3.0:1762166975.453874:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1938 00000100:00100000:3.0:1762166975.453884:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945d011e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+18:2416:x1847765450312704:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:3.0:1762166975.454017:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb size from disk: 151552 -> 151552 00002000:00010000:3.0:1762166975.454022:0:23943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb mtime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166975.454026:0:23943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb atime from disk: 1762166973 -> 1762166973 00002000:00010000:3.0:1762166975.454031:0:23943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb ctime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166975.454036:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb blocks from disk: 144 -> 144 00000100:00100000:3.0:1762166975.454080:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945d011e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+19:2416:x1847765450312704:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 195us (322us total) trans 21474843148 rc 0/0 00000100:00100000:3.0:1762166975.454099:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1938 00002000:00010000:3.0:1762166975.454106:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2694 (151552->18446744073709551615) 00002000:00100000:3.0:1762166975.454113:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945d011e8e00 with x1847765450312704 ext(151552->18446744073709551615) 00002000:00010000:3.0:1762166975.454120:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945d011e8e00. 00000100:00100000:0.0:1762166975.458567:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166975.459909:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450313472 00000100:00100000:3.0:1762166975.459925:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450313472 00002000:00010000:3.0:1762166975.459948:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2694 (151552->18446744073709551615) 00002000:00100000:3.0:1762166975.459953:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bccb7f480 with x1847765450313472 ext(151552->18446744073709551615) 00002000:00010000:3.0:1762166975.459961:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bccb7f480. 00000100:00100000:3.0:1762166975.459992:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1940 00000100:00100000:3.0:1762166975.460006:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450313472:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:3.0:1762166975.460118:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa86:0x0] updating lvb size from disk: 151552 -> 151552 00002000:00010000:3.0:1762166975.460122:0:23943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa86:0x0] updating lvb mtime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166975.460125:0:23943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa86:0x0] updating lvb atime from disk: 1762166974 -> 1762166974 00002000:00010000:3.0:1762166975.460127:0:23943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa86:0x0] updating lvb ctime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166975.460129:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa86:0x0] updating lvb blocks from disk: 144 -> 144 00000100:00100000:3.0:1762166975.460176:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450313472:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 172us (331us total) trans 17179876146 rc 0/0 00000100:00100000:3.0:1762166975.460184:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1940 00002000:00010000:3.0:1762166975.460188:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2694 (151552->18446744073709551615) 00002000:00100000:3.0:1762166975.460191:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bccb7f480 with x1847765450313472 ext(151552->18446744073709551615) 00002000:00010000:3.0:1762166975.460199:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bccb7f480. 00000100:00100000:0.0:1762166975.464225:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.466890:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.468216:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.473130:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.474981:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.479272:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.480724:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.485887:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.487340:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.488954:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.490760:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.491911:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.491954:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166975.492001:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450315520 00000100:00100000:3.0:1762166975.492008:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450315520 00002000:00010000:3.0:1762166975.492030:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2691 (0->18446744073709551615) 00002000:00100000:3.0:1762166975.492036:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc6cd3480 with x1847765450315520 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166975.492045:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc6cd3480. 00000100:00100000:3.0:1762166975.492085:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1947 00000100:00100000:3.0:1762166975.492097:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6cd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+16:2418:x1847765450315520:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:3.0:1762166975.492211:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa83:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166975.492217:0:23943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa83:0x0] updating lvb mtime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166975.492223:0:23943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa83:0x0] updating lvb atime from disk: 1762166972 -> 1762166972 00002000:00010000:3.0:1762166975.492227:0:23943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa83:0x0] updating lvb ctime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166975.492230:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa83:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166975.492263:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6cd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450315520:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 166us (305us total) trans 21474843151 rc 0/0 00000100:00100000:3.0:1762166975.492290:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1947 00002000:00010000:3.0:1762166975.492296:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2691 (0->18446744073709551615) 00002000:00100000:3.0:1762166975.492302:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc6cd3480 with x1847765450315520 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166975.492308:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc6cd3480. 00000100:00100000:0.0:1762166975.493206:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.495049:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.496599:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.497741:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.497772:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166975.497795:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450316160 00000100:00100000:3.0:1762166975.497802:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450316160 00002000:00010000:3.0:1762166975.497829:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2694 (217088->18446744073709551615) 00002000:00100000:3.0:1762166975.497835:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc6cd1500 with x1847765450316160 ext(217088->18446744073709551615) 00002000:00010000:3.0:1762166975.497846:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc6cd1500. 00000100:00100000:3.0:1762166975.497876:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1948 00000100:00100000:3.0:1762166975.497888:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6cd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450316160:12345-192.168.204.38@tcp:10:lfs.0 00000100:00100000:0.0:1762166975.497891:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1949 00000100:00100000:0.0:1762166975.497905:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6cd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450316288:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:0.0:1762166975.498037:0:14623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166975.498038:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb size from disk: 217088 -> 217088 00002000:00010000:0.0:1762166975.498042:0:14623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb mtime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166975.498044:0:23943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb mtime from disk: 1762166975 -> 1762166975 00002000:00010000:0.0:1762166975.498046:0:14623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb atime from disk: 1762166973 -> 1762166973 00002000:00010000:3.0:1762166975.498050:0:23943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb atime from disk: 1762166973 -> 1762166973 00002000:00010000:0.0:1762166975.498051:0:14623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb ctime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166975.498058:0:23943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb ctime from disk: 1762166975 -> 1762166975 00002000:00010000:0.0:1762166975.498058:0:14623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:3.0:1762166975.498063:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb blocks from disk: 192 -> 192 00000100:00100000:0.0:1762166975.498093:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6cd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450316288:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 192us (320us total) trans 17179876150 rc 0/0 00000100:00100000:0.0:1762166975.498098:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1949 00000100:00100000:3.0:1762166975.498104:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6cd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450316160:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 215us (361us total) trans 21474843152 rc 0/0 00002000:00010000:0.0:1762166975.498105:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2693 (0->18446744073709551615) 00002000:00100000:0.0:1762166975.498110:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc6cd0700 with x1847765450316288 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166975.498117:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc6cd0700. 00000100:00100000:3.0:1762166975.498120:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1948 00002000:00010000:3.0:1762166975.498126:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2694 (217088->18446744073709551615) 00002000:00100000:3.0:1762166975.498130:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc6cd1500 with x1847765450316160 ext(217088->18446744073709551615) 00002000:00010000:3.0:1762166975.498136:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc6cd1500. 00000100:00100000:0.0:1762166975.499049:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:2.0:1762166975.499180:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc3619200/0x2f180c4effba99ce lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9645 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.499272:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc3618400/0x2f180c4effba99d5 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 17 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166975.499286:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc3618400/0x2f180c4effba99d5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 17 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.499296:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc3618400/0x2f180c4effba99d5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 17 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:2.0:1762166975.499324:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 217088 00000004:00200000:2.0:1762166975.499329:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166975.499346:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc3618400/0x2f180c4effba99d5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 17 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.499369:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc3619200/0x2f180c4effba99ce lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9645 expref: 561 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.499388:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc3618400/0x2f180c4effba99d5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 16 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9645 expref: 560 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.499396:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166975.499399:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166975.499402:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc3618400, rc 0) 00000100:00100000:2.0:1762166975.499443:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4492300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+560:61832:x1847765450316416:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 300us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166975.499450:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30205 00000100:00100000:2.0:1762166975.501076:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450316672 00000100:00100000:2.0:1762166975.501089:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450316672 00000100:00100000:2.0:1762166975.501176:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30206 00000100:00100000:2.0:1762166975.501189:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+560:61832:x1847765450316672:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:2.0:1762166975.501242:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166975.501267:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc3618400/0x2f180c4effba99d5 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 17 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9645 expref: 560 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.501290:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166975.501296:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166975.501447:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc3618200/0x2f180c4effba99dc lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166975.501460:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc3618200/0x2f180c4effba99dc lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.501467:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc3618200/0x2f180c4effba99dc lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000001:00080000:2.0:1762166975.501526:0:6495:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294991781 00000004:00010000:2.0:1762166975.501542:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000008d2ab136 reply state 00000000a99e157f transno 4294991782 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc3618200/0x2f180c4effba99dc lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.501550:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc3618200/0x2f180c4effba99dc lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.501554:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166975.501556:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166975.501558:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166975.501630:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+562:61832:x1847765450316672:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 445us (679us total) trans 4294991782 rc 0/0 00000100:00100000:2.0:1762166975.501635:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30206 00000020:00080000:2.0:1762166975.501639:0:6495:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1762166975.502567:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166975.502602:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450316800 00000100:00100000:2.0:1762166975.502608:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450316800 00000100:00100000:2.0:1762166975.502643:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18705 00000100:00100000:2.0:1762166975.502653:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4492a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+20:61832:x1847765450316800:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166975.502665:0:8380:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166975.502679:0:8380:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effba99e3 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e964c expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166975.502695:0:8380:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa86:0x0] initial LVB size: 217088, mtime: 0x690888bf, atime: 0x690888be, ctime: 0x690888bf, blocks: 0xb8 00010000:00010000:2.0:1762166975.502710:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166975.502712:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166975.502718:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effba99e3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e964c expref: 21 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.502733:0:8380:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effba99e3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e964c expref: 21 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.502744:0:8380:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa9c00, rc 0) 00000100:00100000:2.0:1762166975.502781:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4492a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+21:61832:x1847765450316800:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 130us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166975.502788:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18705 00000100:00100000:0.0:1762166975.504035:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166975.504081:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450316928 00000100:00100000:3.0:1762166975.504087:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450316928 00002000:00010000:3.0:1762166975.504112:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2694 (217088->18446744073709551615) 00000100:00100000:0.0:1762166975.504113:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00002000:00100000:3.0:1762166975.504116:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4492d80 with x1847765450316928 ext(217088->18446744073709551615) 00002000:00010000:3.0:1762166975.504124:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4492d80. 00000100:00100000:3.0:1762166975.504149:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450317056 00000100:00100000:2.0:1762166975.504158:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1950 00000100:00100000:2.0:1762166975.504166:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4492d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+21:2417:x1847765450316928:12345-192.168.204.38@tcp:10:lfs.0 00000100:00100000:3.0:1762166975.504191:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450317056 00002000:00010000:3.0:1762166975.504205:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2695 (0->18446744073709551615) 00002000:00100000:3.0:1762166975.504207:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4491f80 with x1847765450317056 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166975.504212:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc4491f80. 00000100:00100000:3.0:1762166975.504228:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1951 00000100:00100000:3.0:1762166975.504235:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4491f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+19:2417:x1847765450317056:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:2.0:1762166975.504256:0:14623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa86:0x0] updating lvb size from disk: 217088 -> 217088 00002000:00010000:2.0:1762166975.504259:0:14623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa86:0x0] updating lvb mtime from disk: 1762166975 -> 1762166975 00002000:00010000:2.0:1762166975.504261:0:14623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa86:0x0] updating lvb atime from disk: 1762166974 -> 1762166974 00002000:00010000:2.0:1762166975.504263:0:14623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa86:0x0] updating lvb ctime from disk: 1762166975 -> 1762166975 00002000:00010000:2.0:1762166975.504264:0:14623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa86:0x0] updating lvb blocks from disk: 184 -> 184 00000100:00100000:2.0:1762166975.504294:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4492d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+22:2417:x1847765450316928:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 130us (263us total) trans 17179876151 rc 0/0 00000100:00100000:2.0:1762166975.504300:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1950 00002000:00010000:2.0:1762166975.504302:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2694 (217088->18446744073709551615) 00002000:00100000:2.0:1762166975.504304:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4492d80 with x1847765450316928 ext(217088->18446744073709551615) 00002000:00010000:2.0:1762166975.504308:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4492d80. 00002000:00010000:3.0:1762166975.504313:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa87:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166975.504317:0:23943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa87:0x0] updating lvb mtime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166975.504319:0:23943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa87:0x0] updating lvb atime from disk: 1762166974 -> 1762166974 00002000:00010000:3.0:1762166975.504321:0:23943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa87:0x0] updating lvb ctime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166975.504323:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa87:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166975.504344:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4491f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+20:2417:x1847765450317056:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 109us (231us total) trans 21474843153 rc 0/0 00000100:00100000:3.0:1762166975.504349:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1951 00002000:00010000:3.0:1762166975.504352:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2695 (0->18446744073709551615) 00002000:00100000:3.0:1762166975.504354:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4491f80 with x1847765450317056 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166975.504357:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc4491f80. 00000100:00100000:0.0:1762166975.505348:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166975.505389:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450317184 00000100:00100000:2.0:1762166975.505393:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450317184 00000100:00100000:2.0:1762166975.505426:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30207 00000100:00100000:2.0:1762166975.505436:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4490e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+562:61832:x1847765450317184:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166975.505449:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166975.505463:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effba99ea lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 17 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9653 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.505558:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba000/0x2f180c4effba99f1 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 18 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166975.505570:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba000/0x2f180c4effba99f1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 18 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.505580:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba000/0x2f180c4effba99f1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 18 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:2.0:1762166975.505604:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 217088 00000004:00200000:2.0:1762166975.505608:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166975.505622:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba000/0x2f180c4effba99f1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 18 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.505643:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effba99ea lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9653 expref: 564 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.505664:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba000/0x2f180c4effba99f1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 17 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9653 expref: 563 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.505672:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166975.505675:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166975.505677:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93ba000, rc 0) 00000100:00100000:2.0:1762166975.505725:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4490e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+563:61832:x1847765450317184:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 292us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166975.505731:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30207 00000100:00100000:3.0:1762166975.507277:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450317312 00000100:00100000:3.0:1762166975.507282:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450317312 00000100:00100000:3.0:1762166975.507317:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1952 00000100:00100000:3.0:1762166975.507324:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765450317312:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:3.0:1762166975.507365:0:23943:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effba99f8 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.507373:0:23943:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166975.507375:0:23943:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166975.507378:0:23943:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effba99f8 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [253952->262143] (req 253952->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.507386:0:23943:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effba99f8 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [253952->262143] (req 253952->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.507453:0:23943:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effba99f8 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [253952->262143] (req 253952->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.507459:0:23943:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effba99f8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [253952->262143] (req 253952->262143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.507463:0:23943:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effba99f8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [253952->262143] (req 253952->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.507467:0:23943:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8473000 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166975.507470:0:23943:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effba99f8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [253952->262143] (req 253952->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.507499:0:23943:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effba99f8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [253952->262143] (req 253952->262143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.507512:0:23943:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effba99f8 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [253952->262143] (req 253952->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.507520:0:23943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effba99f8 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [253952->262143] (req 253952->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166975.507557:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765450317312:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 235us (354us total) trans 0 rc 8192/8192 00000100:00100000:3.0:1762166975.507563:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1952 00000100:00100000:0.0:1762166975.509050:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166975.509138:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450317440 00000100:00100000:3.0:1762166975.509147:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450317440 00000100:00100000:3.0:1762166975.509210:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1953 00000100:00100000:3.0:1762166975.509220:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450317440:12345-192.168.204.38@tcp:4:lfs.0 00010000:00010000:3.0:1762166975.509253:0:23943:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effba99ff lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.509271:0:23943:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effba99ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9630 expref: 22 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.509280:0:23943:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166975.509282:0:23943:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166975.509286:0:23943:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effba99ff lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 3 type: EXT [253952->262143] (req 253952->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.509326:0:23943:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effba99ab lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9630 expref: 22 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.509340:0:23943:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effba99ab lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9630 expref: 22 pid: 8380 timeout: 694 lvb_type: 0 00000100:00100000:3.0:1762166975.509359:0:23943:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc558aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_010:lustre-OST0001_UUID:23943:1847765449677184:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166975.509464:0:23943:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402f780 going to sleep for 11 seconds 00000100:00100000:3.0:1762166975.510225:0:23943:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc558aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_010:lustre-OST0001_UUID:23943:1847765449677184:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166975.510242:0:23943:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effba99ff lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 3 type: EXT [253952->262143] (req 253952->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166975.510469:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166975.510542:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450317568 00000100:00100000:2.0:1762166975.510552:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450317568 00010000:00010000:2.0:1762166975.510586:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effba99ab lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9630 expref: 23 pid: 8380 timeout: 694 lvb_type: 0 00000100:00100000:2.0:1762166975.510629:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9451 00000100:00100000:2.0:1762166975.510648:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4493800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765450317568:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166975.510661:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166975.510677:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effba99ab lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9630 expref: 23 pid: 8380 timeout: 694 lvb_type: 0 00010000:00010000:2.0:1762166975.510691:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effba99ab lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9630 expref: 23 pid: 8380 timeout: 694 lvb_type: 0 00010000:00010000:2.0:1762166975.510722:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effba99ab lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9630 expref: 23 pid: 8380 timeout: 694 lvb_type: 0 00010000:00010000:2.0:1762166975.510742:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166975.510744:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166975.510756:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effba99ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 3 type: EXT [253952->262143] (req 253952->262143) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.510765:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effba99ff lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 3 type: EXT [253952->262143] (req 253952->262143) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.510799:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166975.510823:0:23943:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effba99ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 2 type: EXT [253952->262143] (req 253952->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.510832:0:23943:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effba99ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 2 type: EXT [253952->262143] (req 253952->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166975.510846:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4493800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450317568:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 208us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166975.510854:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9451 00000001:00080000:2.0:1762166975.512091:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876152 is committed 00002000:00010000:3.0:1762166975.512171:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa82:0x0] updating lvb size from disk: 217088 -> 262144 00002000:00010000:3.0:1762166975.512176:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa82:0x0] updating lvb blocks from disk: 192 -> 208 00010000:00010000:3.0:1762166975.512184:0:23943:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effba99ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 2 type: EXT [253952->262143] (req 253952->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.512194:0:23943:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effba99ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 2 type: EXT [253952->262143] (req 253952->262143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.512203:0:23943:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effba99ff lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 2 type: EXT [253952->262143] (req 253952->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.512211:0:23943:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8472c00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166975.512215:0:23943:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effba99ff lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 2 type: EXT [253952->262143] (req 253952->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.512224:0:23943:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effba99ff lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 2 type: EXT [253952->262143] (req 253952->262143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.512237:0:23943:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effba99ff lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 2 type: EXT [253952->262143] (req 253952->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.512245:0:23943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effba99ff lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 2 type: EXT [253952->262143] (req 253952->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166975.512306:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450317440:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 3087us (3263us total) trans 17179876152 rc 0/0 00000100:00100000:3.0:1762166975.512315:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1953 00000100:00100000:0.0:1762166975.514009:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166975.514057:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450317696 00000100:00100000:3.0:1762166975.514067:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450317696 00000100:00100000:3.0:1762166975.514122:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1954 00000100:00100000:3.0:1762166975.514132:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4492680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450317696:12345-192.168.204.38@tcp:4:lfs.0 00010000:00010000:3.0:1762166975.514167:0:23943:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc8473a00/0x2f180c4effba9a06 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.514191:0:23943:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc7194800/0x2f180c4effba99c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e963e expref: 20 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.514203:0:23943:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166975.514206:0:23943:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166975.514210:0:23943:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8473a00/0x2f180c4effba9a06 lrc: 4/0,1 mode: --/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [253952->262143] (req 253952->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.514248:0:23943:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc7194800/0x2f180c4effba99c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e963e expref: 20 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.514263:0:23943:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc7194800/0x2f180c4effba99c7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e963e expref: 20 pid: 8380 timeout: 694 lvb_type: 0 00000100:00100000:3.0:1762166975.514278:0:23943:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc558aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_010:lustre-OST0000_UUID:23943:1847765449677312:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166975.514349:0:23943:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402f780 going to sleep for 11 seconds 00000100:00100000:3.0:1762166975.515220:0:23943:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc558aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_010:lustre-OST0000_UUID:23943:1847765449677312:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166975.515242:0:23943:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bc8473a00/0x2f180c4effba9a06 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [253952->262143] (req 253952->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166975.515280:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166975.515325:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450317824 00000100:00100000:2.0:1762166975.515334:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450317824 00010000:00010000:2.0:1762166975.515367:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc7194800/0x2f180c4effba99c7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e963e expref: 21 pid: 8380 timeout: 694 lvb_type: 0 00000100:00100000:2.0:1762166975.515406:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9452 00000100:00100000:2.0:1762166975.515416:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf9d1e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450317824:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166975.515428:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166975.515445:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc7194800/0x2f180c4effba99c7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e963e expref: 21 pid: 8380 timeout: 694 lvb_type: 0 00010000:00010000:2.0:1762166975.515458:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc7194800/0x2f180c4effba99c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e963e expref: 21 pid: 8380 timeout: 694 lvb_type: 0 00010000:00010000:2.0:1762166975.515520:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc7194800/0x2f180c4effba99c7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e963e expref: 21 pid: 8380 timeout: 694 lvb_type: 0 00010000:00010000:2.0:1762166975.515533:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166975.515534:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166975.515537:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc8473a00/0x2f180c4effba9a06 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [253952->262143] (req 253952->262143) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.515544:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8473a00/0x2f180c4effba9a06 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [253952->262143] (req 253952->262143) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.515564:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166975.515588:0:23943:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bc8473a00/0x2f180c4effba9a06 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [253952->262143] (req 253952->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.515600:0:23943:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc8473a00/0x2f180c4effba9a06 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [253952->262143] (req 253952->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166975.515613:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf9d1e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450317824:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 197us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166975.515621:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9452 00000001:00080000:2.0:1762166975.517048:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843154 is committed 00002000:00010000:3.0:1762166975.517131:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb size from disk: 217088 -> 262144 00002000:00010000:3.0:1762166975.517137:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb blocks from disk: 192 -> 208 00010000:00010000:3.0:1762166975.517147:0:23943:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc8473a00/0x2f180c4effba9a06 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [253952->262143] (req 253952->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.517157:0:23943:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8473a00/0x2f180c4effba9a06 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [253952->262143] (req 253952->262143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.517167:0:23943:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc8473a00/0x2f180c4effba9a06 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [253952->262143] (req 253952->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.517174:0:23943:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8473a00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166975.517179:0:23943:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc8473a00/0x2f180c4effba9a06 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [253952->262143] (req 253952->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.517189:0:23943:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc8473a00/0x2f180c4effba9a06 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [253952->262143] (req 253952->262143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.517206:0:23943:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc8473a00/0x2f180c4effba9a06 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [253952->262143] (req 253952->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.517219:0:23943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc8473a00/0x2f180c4effba9a06 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [253952->262143] (req 253952->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166975.517290:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4492680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+16:2418:x1847765450317696:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 3157us (3282us total) trans 21474843154 rc 0/0 00000100:00100000:3.0:1762166975.517301:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1954 00000100:00100000:0.0:1762166975.519227:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166975.519288:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450317952 00000100:00100000:3.0:1762166975.519296:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450317952 00000100:00100000:3.0:1762166975.519345:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1955 00000100:00100000:3.0:1762166975.519353:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf41a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450317952:12345-192.168.204.38@tcp:4:lfs.0 00010000:00010000:3.0:1762166975.519380:0:23943:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effba9a0d lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.519394:0:23943:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effba99e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e964c expref: 18 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.519399:0:23943:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166975.519400:0:23943:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166975.519403:0:23943:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effba9a0d lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 3 type: EXT [253952->262143] (req 253952->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.519427:0:23943:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effba99e3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e964c expref: 18 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.519437:0:23943:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effba99e3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e964c expref: 18 pid: 8380 timeout: 694 lvb_type: 0 00000100:00100000:3.0:1762166975.519462:0:23943:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc558aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_010:lustre-OST0001_UUID:23943:1847765449677440:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166975.519561:0:23943:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402f780 going to sleep for 11 seconds 00000100:00100000:3.0:1762166975.520358:0:23943:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc558aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_010:lustre-OST0001_UUID:23943:1847765449677440:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166975.520375:0:23943:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effba9a0d lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 3 type: EXT [253952->262143] (req 253952->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166975.520614:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166975.520659:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450318080 00000100:00100000:2.0:1762166975.520664:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450318080 00010000:00010000:2.0:1762166975.520682:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effba99e3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e964c expref: 19 pid: 8380 timeout: 694 lvb_type: 0 00000100:00100000:2.0:1762166975.520710:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9453 00000100:00100000:2.0:1762166975.520720:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4491180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450318080:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166975.520731:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166975.520759:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effba99e3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e964c expref: 19 pid: 8380 timeout: 694 lvb_type: 0 00010000:00010000:2.0:1762166975.520776:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effba99e3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e964c expref: 19 pid: 8380 timeout: 694 lvb_type: 0 00010000:00010000:2.0:1762166975.520793:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effba99e3 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e964c expref: 19 pid: 8380 timeout: 694 lvb_type: 0 00010000:00010000:2.0:1762166975.520805:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166975.520807:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166975.520811:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effba9a0d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 3 type: EXT [253952->262143] (req 253952->262143) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.520820:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effba9a0d lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 3 type: EXT [253952->262143] (req 253952->262143) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.520839:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166975.520853:0:23943:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effba9a0d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 2 type: EXT [253952->262143] (req 253952->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.520860:0:23943:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effba9a0d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 2 type: EXT [253952->262143] (req 253952->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166975.520870:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4491180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450318080:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 152us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166975.520878:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9453 00000001:00080000:2.0:1762166975.522019:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876153 is committed 00002000:00010000:3.0:1762166975.522084:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa86:0x0] updating lvb size from disk: 217088 -> 262144 00002000:00010000:3.0:1762166975.522089:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa86:0x0] updating lvb blocks from disk: 184 -> 208 00010000:00010000:3.0:1762166975.522097:0:23943:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effba9a0d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 2 type: EXT [253952->262143] (req 253952->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.522107:0:23943:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effba9a0d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 2 type: EXT [253952->262143] (req 253952->262143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.522115:0:23943:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effba9a0d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 2 type: EXT [253952->262143] (req 253952->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.522123:0:23943:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8473000 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166975.522127:0:23943:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effba9a0d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 2 type: EXT [253952->262143] (req 253952->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.522136:0:23943:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effba9a0d lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 2 type: EXT [253952->262143] (req 253952->262143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.522148:0:23943:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effba9a0d lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 2 type: EXT [253952->262143] (req 253952->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.522156:0:23943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effba9a0d lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 2 type: EXT [253952->262143] (req 253952->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166975.522207:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf41a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450317952:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 2853us (2984us total) trans 17179876153 rc 0/0 00000100:00100000:3.0:1762166975.522215:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1955 00000100:00100000:0.0:1762166975.531037:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166975.531084:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450318336 00000100:00100000:2.0:1762166975.531095:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450318336 00000100:00100000:2.0:1762166975.531165:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30208 00000100:00100000:2.0:1762166975.531176:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4490a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+563:61832:x1847765450318336:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:2.0:1762166975.531229:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166975.531257:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba000/0x2f180c4effba99f1 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 18 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9653 expref: 563 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.531280:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166975.531284:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166975.531460:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb600/0x2f180c4effba9a14 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 17 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166975.531495:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb600/0x2f180c4effba9a14 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.531506:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb600/0x2f180c4effba9a14 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000001:00080000:2.0:1762166975.531549:0:6495:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294991783 00000004:00010000:2.0:1762166975.531569:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000066cd526a reply state 00000000a6ce4ee0 transno 4294991784 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb600/0x2f180c4effba9a14 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.531579:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb600/0x2f180c4effba9a14 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.531585:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166975.531587:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166975.531590:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166975.531673:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4490a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+565:61832:x1847765450318336:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 498us (644us total) trans 4294991784 rc 0/0 00000100:00100000:2.0:1762166975.531681:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30208 00000020:00080000:2.0:1762166975.531687:0:6495:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1762166975.533009:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166975.533075:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450318464 00000100:00100000:2.0:1762166975.533085:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450318464 00000100:00100000:2.0:1762166975.533152:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18706 00000100:00100000:2.0:1762166975.533165:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4490380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+17:61832:x1847765450318464:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166975.533188:0:8380:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166975.533213:0:8380:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc7194800/0x2f180c4effba9a1b lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e965a expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166975.533241:0:8380:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa82:0x0] initial LVB size: 262144, mtime: 0x690888bf, atime: 0x690888bc, ctime: 0x690888bf, blocks: 0xd0 00010000:00010000:2.0:1762166975.533268:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166975.533271:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166975.533280:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc7194800/0x2f180c4effba9a1b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e965a expref: 18 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.533298:0:8380:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc7194800/0x2f180c4effba9a1b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e965a expref: 18 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.533314:0:8380:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc7194800, rc 0) 00000100:00100000:2.0:1762166975.533370:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4490380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+18:61832:x1847765450318464:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 209us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166975.533375:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18706 00000100:00100000:3.0:1762166975.534684:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450318720 00000100:00100000:3.0:1762166975.534691:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450318720 00000100:00100000:2.0:1762166975.534713:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450318592 00000100:00100000:2.0:1762166975.534720:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450318592 00002000:00010000:3.0:1762166975.534730:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2691 (0->18446744073709551615) 00002000:00100000:3.0:1762166975.534735:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4a2b100 with x1847765450318720 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166975.534741:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2690 (262144->18446744073709551615) 00002000:00010000:3.0:1762166975.534744:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc4a2b100. 00002000:00100000:2.0:1762166975.534749:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4a29880 with x1847765450318592 ext(262144->18446744073709551615) 00002000:00010000:2.0:1762166975.534758:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4a29880. 00000100:00100000:3.0:1762166975.534774:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1956 00000100:00100000:3.0:1762166975.534785:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+16:2419:x1847765450318720:12345-192.168.204.38@tcp:10:lfs.0 00000100:00100000:2.0:1762166975.534797:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1957 00000100:00100000:2.0:1762166975.534809:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450318592:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:3.0:1762166975.534982:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa83:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166975.534982:0:14623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa82:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:3.0:1762166975.534990:0:23943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa83:0x0] updating lvb mtime from disk: 1762166975 -> 1762166975 00002000:00010000:2.0:1762166975.534990:0:14623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa82:0x0] updating lvb mtime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166975.534994:0:23943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa83:0x0] updating lvb atime from disk: 1762166972 -> 1762166972 00002000:00010000:2.0:1762166975.534996:0:14623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa82:0x0] updating lvb atime from disk: 1762166972 -> 1762166972 00002000:00010000:3.0:1762166975.535000:0:23943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa83:0x0] updating lvb ctime from disk: 1762166975 -> 1762166975 00002000:00010000:2.0:1762166975.535001:0:14623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa82:0x0] updating lvb ctime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166975.535006:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa83:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:2.0:1762166975.535008:0:14623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa82:0x0] updating lvb blocks from disk: 208 -> 208 00000100:00100000:3.0:1762166975.535054:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450318720:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 270us (460us total) trans 21474843155 rc 0/0 00000100:00100000:2.0:1762166975.535061:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450318592:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 252us (403us total) trans 17179876154 rc 0/0 00000100:00100000:3.0:1762166975.535068:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1956 00000100:00100000:2.0:1762166975.535077:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1957 00002000:00010000:3.0:1762166975.535078:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2691 (0->18446744073709551615) 00002000:00100000:3.0:1762166975.535083:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4a2b100 with x1847765450318720 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166975.535083:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2690 (262144->18446744073709551615) 00002000:00100000:2.0:1762166975.535089:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4a29880 with x1847765450318592 ext(262144->18446744073709551615) 00002000:00010000:3.0:1762166975.535090:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc4a2b100. 00002000:00010000:2.0:1762166975.535095:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4a29880. 00000100:00100000:0.0:1762166975.536634:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166975.536693:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450318848 00000100:00100000:2.0:1762166975.536701:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450318848 00000100:00100000:2.0:1762166975.536749:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30209 00000100:00100000:2.0:1762166975.536757:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4491880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+565:61832:x1847765450318848:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166975.536780:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166975.536802:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effba9a22 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 18 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9661 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.536906:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc3618400/0x2f180c4effba9a29 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 19 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166975.536931:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc3618400/0x2f180c4effba9a29 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 19 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.536944:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc3618400/0x2f180c4effba9a29 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 19 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:2.0:1762166975.536978:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 262144 00000004:00200000:2.0:1762166975.536982:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166975.537002:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc3618400/0x2f180c4effba9a29 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 19 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.537030:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effba9a22 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 19 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9661 expref: 567 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.537050:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc3618400/0x2f180c4effba9a29 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 18 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9661 expref: 566 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.537059:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166975.537062:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166975.537066:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc3618400, rc 0) 00000100:00100000:2.0:1762166975.537124:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4491880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+566:61832:x1847765450318848:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 367us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166975.537132:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30209 00000100:00100000:0.0:1762166975.538792:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166975.538831:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450319104 00000100:00100000:2.0:1762166975.538839:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450319104 00000100:00100000:2.0:1762166975.538886:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30210 00000100:00100000:2.0:1762166975.538895:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4493480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+566:61832:x1847765450319104:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:2.0:1762166975.538955:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166975.538980:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc3618400/0x2f180c4effba9a29 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 19 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9661 expref: 566 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.538998:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166975.539002:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166975.539183:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc3619200/0x2f180c4effba9a30 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 18 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166975.539198:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc3619200/0x2f180c4effba9a30 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.539206:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc3619200/0x2f180c4effba9a30 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000001:00080000:2.0:1762166975.539257:0:6495:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294991785 00000004:00010000:2.0:1762166975.539278:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000004433ca82 reply state 000000008a7906b8 transno 4294991786 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc3619200/0x2f180c4effba9a30 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.539290:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc3619200/0x2f180c4effba9a30 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.539296:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166975.539299:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166975.539301:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166975.539367:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4493480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+568:61832:x1847765450319104:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 473us (577us total) trans 4294991786 rc 0/0 00000100:00100000:2.0:1762166975.539374:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30210 00000020:00080000:2.0:1762166975.539379:0:6495:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1762166975.541040:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450319232 00000100:00100000:2.0:1762166975.541048:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450319232 00000100:00100000:2.0:1762166975.541102:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18707 00000100:00100000:2.0:1762166975.541111:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+17:61832:x1847765450319232:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166975.541128:0:8380:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166975.541149:0:8380:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba000/0x2f180c4effba9a37 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9668 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166975.541177:0:8380:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa86:0x0] initial LVB size: 262144, mtime: 0x690888bf, atime: 0x690888bd, ctime: 0x690888bf, blocks: 0xd0 00010000:00010000:2.0:1762166975.541196:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166975.541199:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166975.541206:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba000/0x2f180c4effba9a37 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9668 expref: 18 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.541223:0:8380:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba000/0x2f180c4effba9a37 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9668 expref: 18 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.541237:0:8380:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93ba000, rc 0) 00000100:00100000:2.0:1762166975.541288:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+18:61832:x1847765450319232:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 178us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166975.541295:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18707 00000100:00100000:0.0:1762166975.542771:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.542809:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166975.542832:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450319488 00000100:00100000:2.0:1762166975.542843:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450319488 00000100:00100000:3.0:1762166975.542861:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450319360 00000100:00100000:3.0:1762166975.542868:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450319360 00002000:00010000:2.0:1762166975.542884:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2693 (0->18446744073709551615) 00002000:00010000:3.0:1762166975.542890:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2694 (262144->18446744073709551615) 00002000:00100000:2.0:1762166975.542890:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4491500 with x1847765450319488 ext(0->18446744073709551615) 00002000:00100000:3.0:1762166975.542897:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4490000 with x1847765450319360 ext(262144->18446744073709551615) 00002000:00010000:2.0:1762166975.542906:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4491500. 00002000:00010000:3.0:1762166975.542908:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc4490000. 00000100:00100000:2.0:1762166975.542953:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1958 00000100:00100000:2.0:1762166975.542963:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4491500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450319488:12345-192.168.204.38@tcp:10:lfs.0 00000100:00100000:3.0:1762166975.542969:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1959 00000100:00100000:3.0:1762166975.542993:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4490000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450319360:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:2.0:1762166975.543089:0:14623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166975.543092:0:14623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb mtime from disk: 1762166975 -> 1762166975 00002000:00010000:2.0:1762166975.543094:0:14623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb atime from disk: 1762166973 -> 1762166973 00002000:00010000:3.0:1762166975.543097:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:2.0:1762166975.543097:0:14623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb ctime from disk: 1762166975 -> 1762166975 00002000:00010000:2.0:1762166975.543102:0:14623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:3.0:1762166975.543105:0:23943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb mtime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166975.543109:0:23943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb atime from disk: 1762166973 -> 1762166973 00002000:00010000:3.0:1762166975.543112:0:23943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb ctime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166975.543115:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb blocks from disk: 208 -> 208 00000100:00100000:3.0:1762166975.543165:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4490000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450319360:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 177us (354us total) trans 21474843156 rc 0/0 00000100:00100000:3.0:1762166975.543174:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1959 00002000:00010000:3.0:1762166975.543178:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2694 (262144->18446744073709551615) 00002000:00100000:3.0:1762166975.543182:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4490000 with x1847765450319360 ext(262144->18446744073709551615) 00002000:00010000:3.0:1762166975.543187:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc4490000. 00000100:00100000:2.0:1762166975.543277:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4491500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450319488:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 193us (388us total) trans 17179876155 rc 0/0 00000100:00100000:2.0:1762166975.543286:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1958 00002000:00010000:2.0:1762166975.543290:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2693 (0->18446744073709551615) 00002000:00100000:2.0:1762166975.543293:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4491500 with x1847765450319488 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166975.543298:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4491500. 00000100:00100000:0.0:1762166975.544802:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166975.544842:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450319616 00000100:00100000:2.0:1762166975.544849:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450319616 00000100:00100000:2.0:1762166975.544888:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30211 00000100:00100000:2.0:1762166975.544896:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4493100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+568:61832:x1847765450319616:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166975.544924:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166975.544946:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effba9a3e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 19 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e966f expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.545033:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effba9a45 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 20 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166975.545048:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effba9a45 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 20 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.545060:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effba9a45 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 20 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:2.0:1762166975.545086:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 262144 00000004:00200000:2.0:1762166975.545091:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166975.545106:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effba9a45 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 20 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.545136:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effba9a3e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 20 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e966f expref: 570 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.545158:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effba9a45 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 19 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e966f expref: 569 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.545166:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166975.545169:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166975.545172:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa9e00, rc 0) 00000100:00100000:2.0:1762166975.545210:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4493100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+569:61832:x1847765450319616:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 316us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166975.545224:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30211 00000100:00100000:2.0:1762166975.546725:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450319872 00000100:00100000:2.0:1762166975.546732:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450319872 00000100:00100000:2.0:1762166975.546769:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30212 00000100:00100000:2.0:1762166975.546779:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+569:61832:x1847765450319872:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:2.0:1762166975.546820:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166975.546839:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effba9a45 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 20 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e966f expref: 569 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.546854:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166975.546858:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166975.547020:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effba9a4c lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 19 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166975.547033:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effba9a4c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.547040:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effba9a4c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000001:00080000:2.0:1762166975.547087:0:6495:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294991787 00000004:00010000:2.0:1762166975.547108:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000000549eee reply state 000000003aa57607 transno 4294991788 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effba9a4c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.547118:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effba9a4c lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.547124:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166975.547126:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166975.547128:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166975.547195:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+571:61832:x1847765450319872:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 418us (517us total) trans 4294991788 rc 0/0 00000100:00100000:2.0:1762166975.547202:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30212 00000020:00080000:2.0:1762166975.547206:0:6495:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1762166975.548181:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166975.548248:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450320000 00000100:00100000:2.0:1762166975.548256:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450320000 00000100:00100000:2.0:1762166975.548299:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18708 00000100:00100000:2.0:1762166975.548307:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4491c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+20:61832:x1847765450320000:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166975.548330:0:8380:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166975.548349:0:8380:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effba9a53 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9676 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166975.548369:0:8380:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa86:0x0] initial LVB size: 262144, mtime: 0x690888bf, atime: 0x690888be, ctime: 0x690888bf, blocks: 0xd0 00010000:00010000:2.0:1762166975.548386:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166975.548388:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166975.548394:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effba9a53 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9676 expref: 21 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.548405:0:8380:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effba9a53 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9676 expref: 21 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.548415:0:8380:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa8e00, rc 0) 00000100:00100000:2.0:1762166975.548455:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4491c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+21:61832:x1847765450320000:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 149us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166975.548460:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18708 00000100:00100000:0.0:1762166975.549540:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166975.549564:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450320128 00000100:00100000:2.0:1762166975.549569:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450320128 00002000:00010000:2.0:1762166975.549593:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2694 (262144->18446744073709551615) 00002000:00100000:2.0:1762166975.549598:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4490700 with x1847765450320128 ext(262144->18446744073709551615) 00002000:00010000:2.0:1762166975.549608:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4490700. 00000100:00100000:0.0:1762166975.549618:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166975.549639:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450320256 00000100:00100000:2.0:1762166975.549644:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450320256 00002000:00010000:2.0:1762166975.549660:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2695 (0->18446744073709551615) 00002000:00100000:2.0:1762166975.549664:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4492d80 with x1847765450320256 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166975.549672:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc4492d80. 00000100:00100000:2.0:1762166975.549700:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1961 00000100:00100000:2.0:1762166975.549715:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4492d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450320256:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:2.0:1762166975.549870:0:14623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa87:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166975.549875:0:14623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa87:0x0] updating lvb mtime from disk: 1762166975 -> 1762166975 00002000:00010000:2.0:1762166975.549878:0:14623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa87:0x0] updating lvb atime from disk: 1762166974 -> 1762166974 00002000:00010000:2.0:1762166975.549884:0:14623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa87:0x0] updating lvb ctime from disk: 1762166975 -> 1762166975 00002000:00010000:2.0:1762166975.549891:0:14623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa87:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1762166975.549935:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4492d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450320256:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 224us (318us total) trans 21474843157 rc 0/0 00000100:00100000:2.0:1762166975.549946:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1961 00002000:00010000:2.0:1762166975.549952:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2695 (0->18446744073709551615) 00002000:00100000:2.0:1762166975.549957:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4492d80 with x1847765450320256 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166975.549965:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc4492d80. 00000100:00100000:2.0:1762166975.551071:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450320512 00000100:00100000:2.0:1762166975.551075:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450320512 00000100:00100000:2.0:1762166975.551113:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30213 00000100:00100000:2.0:1762166975.551121:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+571:61832:x1847765450320512:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:2.0:1762166975.551212:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effba9a5a lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 20 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166975.551233:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effba9a5a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.551251:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effba9a5a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00010000:2.0:1762166975.551351:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000051319fc8 reply state 0000000021dbc994 transno 4294991789 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effba9a5a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.551365:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effba9a5a lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.551372:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166975.551375:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166975.551379:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166975.551440:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+573:61832:x1847765450320512:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 319us (418us total) trans 4294991789 rc 0/0 00000100:00100000:2.0:1762166975.551447:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30213 00000100:00100000:0.0:1762166975.552398:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166975.552433:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450320640 00000100:00100000:2.0:1762166975.552438:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450320640 00000100:00100000:0.0:1762166975.552461:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166975.552502:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450320768 00000100:00100000:2.0:1762166975.552507:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450320768 00000100:00100000:0.0:1762166975.552527:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166975.552541:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450320896 00000100:00100000:2.0:1762166975.552544:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450320896 00000100:00100000:3.0:1762166975.552555:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18710 00000100:00100000:3.0:1762166975.552567:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+20:2416:x1847765450320768:12345-192.168.204.38@tcp:2:lfs.0 00000100:00100000:2.0:1762166975.552574:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18711 00000100:00100000:2.0:1762166975.552583:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4492680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+23:2416:x1847765450320896:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:2.0:1762166975.552661:0:8380:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166975.552667:0:28434:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166975.552669:0:8380:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166975.552673:0:28434:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166975 -> 1762166975 00002000:00010000:2.0:1762166975.552674:0:8380:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166975.552678:0:28434:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00002000:00010000:2.0:1762166975.552680:0:8380:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166975.552682:0:28434:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166975 -> 1762166975 00002000:00010000:2.0:1762166975.552685:0:8380:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:3.0:1762166975.552687:0:28434:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00000100:00100000:2.0:1762166975.552719:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4492680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+25:2416:x1847765450320896:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 135us (191us total) trans 17179876158 rc 0/0 00000100:00100000:3.0:1762166975.552732:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+21:2416:x1847765450320768:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 164us (267us total) trans 21474843158 rc 0/0 00000100:00100000:2.0:1762166975.552737:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18711 00000100:00100000:3.0:1762166975.552747:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18710 00000100:00100000:0.0:1762166975.553651:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166975.553699:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450321152 00000100:00100000:2.0:1762166975.553704:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450321152 00000100:00100000:2.0:1762166975.553742:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11776 00000100:00100000:2.0:1762166975.553755:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4493800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+573:61832:x1847765450321152:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:2.0:1762166975.553806:0:19593:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x240000404:0x5eb:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effba97e4 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 20 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9588 expref: 573 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.553848:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc13fde00/0x2f180c4effba9a61 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 21 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:2.0:1762166975.553860:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472600/0x2f180c4effba980e lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 21 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e958f expref: 573 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.553871:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc13fde00/0x2f180c4effba9a61 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 21 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166975.553907:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472600/0x2f180c4effba980e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 21 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e958f expref: 573 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.553937:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472600/0x2f180c4effba980e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 21 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e958f expref: 573 pid: 6495 timeout: 694 lvb_type: 0 00000100:00100000:2.0:1762166975.553954:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bc0700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449677568:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166975.554049:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf3a330c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166975.554801:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bc0700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449677568:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166975.554823:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945cc13fde00/0x2f180c4effba9a61 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 21 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:0.0:1762166975.554977:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166975.555015:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450321280 00000100:00100000:2.0:1762166975.555020:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450321280 00010000:00010000:2.0:1762166975.555040:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472600/0x2f180c4effba980e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 21 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e958f expref: 574 pid: 6495 timeout: 694 lvb_type: 0 00000100:00100000:2.0:1762166975.555062:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9454 00000100:00100000:2.0:1762166975.555068:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d23480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+574:2419:x1847765450321280:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166975.555076:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166975.555081:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472600/0x2f180c4effba980e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 22 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e958f expref: 574 pid: 6495 timeout: 694 lvb_type: 0 00010000:00010000:2.0:1762166975.555090:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472600/0x2f180c4effba980e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 22 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e958f expref: 574 pid: 6495 timeout: 694 lvb_type: 0 00010000:00010000:2.0:1762166975.555102:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472600/0x2f180c4effba980e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 22 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e958f expref: 574 pid: 6495 timeout: 694 lvb_type: 0 00010000:00010000:2.0:1762166975.555112:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166975.555115:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc13fde00/0x2f180c4effba9a61 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 21 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166975.555131:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc13fde00/0x2f180c4effba9a61 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 21 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166975.555136:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc13fde00/0x2f180c4effba9a61 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 21 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166975.555154:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166975.555182:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d23480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+573:2419:x1847765450321280:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 115us (207us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166975.555184:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945cc13fde00/0x2f180c4effba9a61 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 20 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:2.0:1762166975.555192:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9454 00010000:00010000:0.0:1762166975.555198:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc13fde00/0x2f180c4effba9a61 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 20 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000040:00080000:0.0:1762166975.555467:0:19593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5845, 88 off457344 00000004:00080000:0.0:1762166975.555511:0:19593:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 594703997061ns, next at 594522415006ns, rc = 0 00000040:00080000:0.0:1762166975.555555:0:19593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5844, 88 off457344 00000004:00080000:0.0:1762166975.555562:0:19593:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 594704084262ns, next at 594522388989ns, rc = 0 00000040:00080000:0.0:1762166975.555578:0:19593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5845, 88 off457432 00000004:00080000:0.0:1762166975.555583:0:19593:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 594704105450ns, next at 594522388989ns, rc = 0 00000040:00080000:0.0:1762166975.555595:0:19593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5846, 88 off457432 00000004:00080000:0.0:1762166975.555601:0:19593:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 594704122957ns, next at 594522415006ns, rc = 0 00000040:00080000:0.0:1762166975.555623:0:19593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5847, 88 off457520 00000004:00080000:0.0:1762166975.555629:0:19593:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 594704151070ns, next at 594522415006ns, rc = 0 00000040:00080000:0.0:1762166975.555692:0:19593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5846, 88 off457520 00000004:00080000:0.0:1762166975.555700:0:19593:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 594704221792ns, next at 594522388989ns, rc = 0 00000040:00080000:0.0:1762166975.555728:0:19593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5847, 88 off457608 00000004:00080000:0.0:1762166975.555735:0:19593:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 594704257152ns, next at 594522388989ns, rc = 0 00000040:00080000:0.0:1762166975.555761:0:19593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5848, 88 off457608 00000004:00080000:0.0:1762166975.555767:0:19593:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 594704289120ns, next at 594522415006ns, rc = 0 00000040:00080000:0.0:1762166975.555789:0:19593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5849, 88 off457696 00000004:00080000:0.0:1762166975.555795:0:19593:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 594704316807ns, next at 594522415006ns, rc = 0 00000040:00080000:0.0:1762166975.555815:0:19593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5848, 88 off457696 00000004:00080000:0.0:1762166975.555820:0:19593:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 594704342245ns, next at 594522388989ns, rc = 0 00000001:00080000:3.0:1762166975.557166:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294991790 is committed 00000004:00080000:3.0:1762166975.557179:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3218 committed 00010000:00010000:2.0:1762166975.557194:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effba9854 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00000004:00080000:3.0:1762166975.557198:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3215 committed 00010000:00010000:2.0:1762166975.557211:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effba9854 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.557217:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effba9854 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.557221:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8472400 already unused, calling callback (ffffffffc18e2310) 00000004:00080000:3.0:1762166975.557224:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3214 committed 00010000:00010000:2.0:1762166975.557226:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effba9854 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00000004:00080000:3.0:1762166975.557234:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3217 committed 00010000:00010000:2.0:1762166975.557236:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effba9854 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00000004:00080000:3.0:1762166975.557241:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3216 committed 00000004:00080000:3.0:1762166975.557249:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3213 committed 00010000:00010000:2.0:1762166975.557250:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00000004:00080000:3.0:1762166975.557253:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3212 committed 00010000:00010000:2.0:1762166975.557255:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166975.557262:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effba9854 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000004:00080000:3.0:1762166975.557264:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3215 committed 00010000:00010000:2.0:1762166975.557270:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effba9854 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000004:00080000:3.0:1762166975.557272:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3214 committed 00000004:00080000:3.0:1762166975.557281:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3211 committed 00010000:00010000:2.0:1762166975.557313:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473600/0x2f180c4effba9870 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.557325:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473600/0x2f180c4effba9870 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.557336:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473600/0x2f180c4effba9870 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.557346:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8473600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166975.557349:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473600/0x2f180c4effba9870 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.557356:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473600/0x2f180c4effba9870 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.557369:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166975.557371:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166975.557373:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473600/0x2f180c4effba9870 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.557380:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473600/0x2f180c4effba9870 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.557398:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194200/0x2f180c4effba988c lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.557405:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194200/0x2f180c4effba988c lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.557410:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194200/0x2f180c4effba988c lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.557416:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc7194200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166975.557419:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194200/0x2f180c4effba988c lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.557426:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194200/0x2f180c4effba988c lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00000100:00100000:0.0:1762166975.557427:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7d21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449677696:0@lo:2:osp-syn-1-1.0 00010000:00010000:2.0:1762166975.557442:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166975.557445:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166975.557447:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194200/0x2f180c4effba988c lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.557451:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194200/0x2f180c4effba988c lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.557465:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8600/0x2f180c4effba98c4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.557474:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8600/0x2f180c4effba98c4 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00000100:00100000:0.0:1762166975.557510:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1762166975.557520:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8600/0x2f180c4effba98c4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.557525:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa8600 already unused, calling callback (ffffffffc18e2310) 00000100:00100000:3.0:1762166975.557527:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449678080:0@lo:2:osp-syn-0-1.0 00010000:00010000:2.0:1762166975.557530:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8600/0x2f180c4effba98c4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00000100:00100000:0.0:1762166975.557544:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7d21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449678208:0@lo:2:osp-syn-1-1.0 00010000:00010000:2.0:1762166975.557556:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8600/0x2f180c4effba98c4 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.557562:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166975.557563:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166975.557565:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8600/0x2f180c4effba98c4 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.557569:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8600/0x2f180c4effba98c4 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.557577:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effba98e0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.557582:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effba98e0 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.557588:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effba98e0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.557592:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa9a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166975.557596:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effba98e0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.557603:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effba98e0 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00000100:00100000:0.0:1762166975.557604:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1762166975.557615:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166975.557618:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166975.557620:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effba98e0 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.557624:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effba98e0 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.557636:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9400/0x2f180c4effba98fc lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.557644:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9400/0x2f180c4effba98fc lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.557652:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9400/0x2f180c4effba98fc lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.557666:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa9400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166975.557669:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9400/0x2f180c4effba98fc lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00000100:00100000:0.0:1762166975.557673:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449678720:0@lo:2:osp-syn-0-1.0 00000004:00010000:3.0:1762166975.557681:0:19593:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000001cff3802 reply state 000000008f9cfbf1 transno 4294991790 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc13fde00/0x2f180c4effba9a61 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 16 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166975.557685:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9400/0x2f180c4effba98fc lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.557719:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166975.557726:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762166975.557731:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1762166975.557732:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9400/0x2f180c4effba98fc lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.557738:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9400/0x2f180c4effba98fc lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166975.557741:0:19593:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc13fde00/0x2f180c4effba9a61 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 16 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166975.557755:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effba9934 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.557762:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effba9934 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.557769:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effba9934 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166975.557771:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166975.557780:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166975.557785:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa8800 already unused, calling callback (ffffffffc18e2310) 00000100:00100000:3.0:1762166975.557786:0:19593:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1762166975.557796:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effba9934 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166975.557798:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00000100:00100000:0.0:1762166975.557807:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449677696 00010000:00010000:3.0:1762166975.557814:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00000100:00100000:0.0:1762166975.557817:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449677696 00010000:00010000:2.0:1762166975.557822:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effba9934 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166975.557828:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effba97e4 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9588 expref: 535 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.557853:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166975.557858:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166975.557864:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effba9934 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000100:00100000:0.0:1762166975.557865:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449678208 00000100:00100000:0.0:1762166975.557869:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449678208 00010000:00010000:2.0:1762166975.557876:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effba9934 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.557896:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effba9950 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.557902:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effba9950 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.557906:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effba9950 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00000100:00100000:0.0:1762166975.557909:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449677952 00010000:00010000:2.0:1762166975.557911:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa9800 already unused, calling callback (ffffffffc18e2310) 00000100:00100000:0.0:1762166975.557927:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449677952 00010000:00010000:2.0:1762166975.557929:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effba9950 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.557944:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effba9950 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.557960:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166975.557963:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762166975.557965:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449678464 00010000:00010000:2.0:1762166975.557966:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effba9950 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000100:00100000:0.0:1762166975.557972:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449678464 00010000:00010000:2.0:1762166975.557973:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effba9950 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00080000:3.0:1762166975.557987:0:19593:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00010000:00010000:2.0:1762166975.557994:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effba996c lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.558002:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effba996c lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.558009:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effba996c lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00000100:00100000:3.0:1762166975.558012:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4493800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+533:61832:x1847765450321152:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 4259us (4359us total) trans 4294991790 rc 0/0 00010000:00010000:2.0:1762166975.558036:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa8c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166975.558040:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effba996c lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00000100:00100000:3.0:1762166975.558050:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11776 00010000:00010000:2.0:1762166975.558051:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effba996c lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00000100:00100000:0.0:1762166975.558068:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18713 00010000:00010000:2.0:1762166975.558084:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166975.558091:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762166975.558091:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+8:3634:x1847765449678208:12345-0@lo:2:osp-syn-1-1.0 00010000:00010000:2.0:1762166975.558098:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effba996c lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.558105:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effba996c lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.558136:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effba99a4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.558143:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effba99a4 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.558150:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effba99a4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00000100:00100000:3.0:1762166975.558156:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18714 00010000:00010000:2.0:1762166975.558162:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa8200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166975.558169:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effba99a4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00000100:00100000:3.0:1762166975.558175:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+8:3636:x1847765449677952:12345-0@lo:2:osp-syn-1-1.0 00010000:00010000:2.0:1762166975.558186:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effba99a4 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.558199:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166975.558202:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166975.558206:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effba99a4 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.558219:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effba99a4 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00002000:00010000:0.0:1762166975.558226:0:35472:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa82:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:0.0:1762166975.558232:0:35472:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa82:0x0] updating lvb mtime from disk: 1762166975 -> 1762166975 00010000:00010000:2.0:1762166975.558234:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effba99c0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00002000:00010000:0.0:1762166975.558236:0:35472:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa82:0x0] updating lvb atime from disk: 1762166972 -> 1762166972 00002000:00010000:0.0:1762166975.558244:0:35472:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa82:0x0] updating lvb ctime from disk: 1762166975 -> 1762166975 00002000:00010000:0.0:1762166975.558256:0:35472:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa82:0x0] updating lvb blocks from disk: 208 -> 208 00010000:00010000:2.0:1762166975.558257:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effba99c0 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00002000:00010000:3.0:1762166975.558277:0:8380:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00010000:00010000:2.0:1762166975.558280:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effba99c0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00002000:00010000:3.0:1762166975.558288:0:8380:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166975.558303:0:8380:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00010000:00010000:2.0:1762166975.558307:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa8000 already unused, calling callback (ffffffffc18e2310) 00002000:00010000:3.0:1762166975.558309:0:8380:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166975 -> 1762166975 00010000:00010000:2.0:1762166975.558315:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effba99c0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00002000:00010000:3.0:1762166975.558316:0:8380:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1762166975.558322:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+11:3634:x1847765449678208:12345-0@lo:2:osp-syn-1-1.0 Request processed in 236us (716us total) trans 17179876159 rc 0/0 00010000:00010000:2.0:1762166975.558342:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effba99c0 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00000100:00100000:0.0:1762166975.558346:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18713 00010000:00010000:2.0:1762166975.558357:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166975.558367:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166975.558374:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effba99c0 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000100:00100000:0.0:1762166975.558378:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18715 00000100:00100000:3.0:1762166975.558388:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+10:3636:x1847765449677952:12345-0@lo:2:osp-syn-1-1.0 Request processed in 215us (677us total) trans 17179876161 rc 0/0 00010000:00010000:2.0:1762166975.558391:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effba99c0 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000100:00100000:0.0:1762166975.558399:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3634:x1847765449678720:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166975.558425:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18714 00010000:00010000:2.0:1762166975.558436:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc3618200/0x2f180c4effba99dc lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.558447:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc3618200/0x2f180c4effba99dc lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.558460:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc3618200/0x2f180c4effba99dc lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.558471:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc3618200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166975.558501:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc3618200/0x2f180c4effba99dc lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.558511:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc3618200/0x2f180c4effba99dc lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.558536:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166975.558540:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166975.558545:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc3618200/0x2f180c4effba99dc lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00002000:00010000:0.0:1762166975.558545:0:35472:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:0.0:1762166975.558552:0:35472:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb mtime from disk: 1762166975 -> 1762166975 00010000:00010000:2.0:1762166975.558554:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc3618200/0x2f180c4effba99dc lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00002000:00010000:0.0:1762166975.558555:0:35472:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb atime from disk: 1762166973 -> 1762166973 00002000:00010000:0.0:1762166975.558565:0:35472:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb ctime from disk: 1762166975 -> 1762166975 00000100:00100000:3.0:1762166975.558572:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:0.0:1762166975.558575:0:35472:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb blocks from disk: 208 -> 208 00010000:00010000:2.0:1762166975.558581:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb600/0x2f180c4effba9a14 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.558591:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb600/0x2f180c4effba9a14 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.558599:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb600/0x2f180c4effba9a14 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.558607:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bb600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166975.558615:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb600/0x2f180c4effba9a14 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00000100:00100000:3.0:1762166975.558618:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7d22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449678336:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1762166975.558632:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+6:3634:x1847765449678720:12345-0@lo:2:osp-syn-0-1.0 Request processed in 239us (905us total) trans 21474843159 rc 0/0 00010000:00010000:2.0:1762166975.558651:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb600/0x2f180c4effba9a14 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00000100:00100000:0.0:1762166975.558653:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18715 00000100:00100000:0.0:1762166975.558675:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449677824 00010000:00010000:2.0:1762166975.558679:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00000100:00100000:0.0:1762166975.558682:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449677824 00000100:00100000:3.0:1762166975.558683:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1762166975.558685:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166975.558692:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb600/0x2f180c4effba9a14 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.558701:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb600/0x2f180c4effba9a14 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.558725:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc3619200/0x2f180c4effba9a30 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00000100:00100000:0.0:1762166975.558726:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449678336 00000100:00100000:3.0:1762166975.558733:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449678848:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1762166975.558736:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449678336 00010000:00010000:2.0:1762166975.558764:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc3619200/0x2f180c4effba9a30 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00000100:00100000:0.0:1762166975.558777:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18717 00010000:00010000:2.0:1762166975.558778:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc3619200/0x2f180c4effba9a30 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00000100:00100000:3.0:1762166975.558787:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1762166975.558795:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc3619200 already unused, calling callback (ffffffffc18e2310) 00000100:00100000:0.0:1762166975.558802:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5588e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+6:3635:x1847765449677824:12345-0@lo:2:osp-syn-0-1.0 00010000:00010000:2.0:1762166975.558806:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc3619200/0x2f180c4effba9a30 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.558825:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc3619200/0x2f180c4effba9a30 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00000100:00100000:3.0:1762166975.558826:0:35248:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449678848 00000100:00100000:3.0:1762166975.558843:0:35248:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449678848 00010000:00010000:2.0:1762166975.558859:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166975.558862:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166975.558866:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc3619200/0x2f180c4effba9a30 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.558873:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc3619200/0x2f180c4effba9a30 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000100:00100000:3.0:1762166975.558889:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18719 00010000:00010000:2.0:1762166975.558894:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effba9a4c lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00002000:00010000:0.0:1762166975.558901:0:35472:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:3.0:1762166975.558905:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5588380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+8:3635:x1847765449678848:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:0.0:1762166975.558910:0:35472:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb mtime from disk: 1762166966 -> 1762166966 00010000:00010000:2.0:1762166975.558926:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effba9a4c lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00002000:00010000:0.0:1762166975.558931:0:35472:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1762166975.558939:0:35472:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb ctime from disk: 1762166966 -> 1762166966 00002000:00010000:0.0:1762166975.558950:0:35472:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00010000:2.0:1762166975.558972:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effba9a4c lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.558995:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa9000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166975.559001:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effba9a4c lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00000100:00100000:0.0:1762166975.559003:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5588e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+9:3635:x1847765449677824:12345-0@lo:2:osp-syn-0-1.0 Request processed in 210us (443us total) trans 21474843160 rc 0/0 00002000:00010000:3.0:1762166975.559012:0:35248:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa87:0x0] updating lvb size from disk: 0 -> 0 00010000:00010000:2.0:1762166975.559016:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effba9a4c lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00000100:00100000:0.0:1762166975.559016:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18717 00002000:00010000:3.0:1762166975.559024:0:35248:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa87:0x0] updating lvb mtime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166975.559031:0:35248:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa87:0x0] updating lvb atime from disk: 1762166974 -> 1762166974 00002000:00010000:3.0:1762166975.559036:0:35248:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa87:0x0] updating lvb ctime from disk: 1762166975 -> 1762166975 00010000:00010000:2.0:1762166975.559036:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166975.559048:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00002000:00010000:3.0:1762166975.559049:0:35248:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa87:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00010000:2.0:1762166975.559056:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effba9a4c lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.559056:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc13fde00/0x2f180c4effba9a61 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166975.559087:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc13fde00/0x2f180c4effba9a61 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166975.559089:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effba9a4c lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000100:00100000:3.0:1762166975.559090:0:35248:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5588380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+8:3635:x1847765449678848:12345-0@lo:2:osp-syn-0-1.0 Request processed in 188us (305us total) trans 21474843161 rc 0/0 00010000:00010000:0.0:1762166975.559121:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc13fde00/0x2f180c4effba9a61 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00000100:00100000:3.0:1762166975.559127:0:35248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18719 00010000:00010000:2.0:1762166975.559137:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effba9a5a lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.559146:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effba9a5a lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.559154:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effba9a5a lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.559154:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc13fde00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166975.559162:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc13fde00/0x2f180c4effba9a61 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166975.559176:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc60b1400 already unused, calling callback (ffffffffc18e2310) 00000100:00100000:3.0:1762166975.559181:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1762166975.559185:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effba9a5a lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.559192:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc13fde00/0x2f180c4effba9a61 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166975.559212:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effba9a5a lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.559219:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00000100:00100000:3.0:1762166975.559220:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449678592:0@lo:2:osp-syn-0-1.0 00010000:00010000:0.0:1762166975.559232:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166975.559239:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc13fde00/0x2f180c4effba9a61 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166975.559260:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc13fde00/0x2f180c4effba9a61 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166975.559265:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00000100:00100000:3.0:1762166975.559285:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1762166975.559286:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166975.559298:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effba9a5a lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.559310:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effba9a5a lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000100:00100000:0.0:1762166975.559322:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449678080 00000100:00100000:0.0:1762166975.559332:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449678080 00000100:00100000:3.0:1762166975.559379:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449678592 00000100:00100000:3.0:1762166975.559387:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449678592 00000100:00100000:0.0:1762166975.559390:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18720 00000100:00100000:0.0:1762166975.559405:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3e6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+9:3633:x1847765449678080:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166975.559533:0:3634:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 21474843137 gen 2 00002000:00010000:0.0:1762166975.559538:0:8382:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00000004:00080000:3.0:1762166975.559540:0:3634:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf3db4e00, transno 21474843120 00002000:00010000:0.0:1762166975.559549:0:8382:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166975 -> 1762166975 00002000:00010000:0.0:1762166975.559555:0:8382:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00002000:00010000:0.0:1762166975.559560:0:8382:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166975 -> 1762166975 00000004:00080000:3.0:1762166975.559561:0:3634:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf3db7b80, transno 21474843121 00002000:00010000:0.0:1762166975.559566:0:8382:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00000004:00080000:3.0:1762166975.559574:0:3634:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf3db6300, transno 21474843122 00000004:00080000:3.0:1762166975.559581:0:3634:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf3db5f80, transno 21474843123 00000004:00080000:3.0:1762166975.559591:0:3634:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf3db7800, transno 21474843124 00000100:00100000:0.0:1762166975.559623:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3e6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+11:3633:x1847765449678080:12345-0@lo:2:osp-syn-0-1.0 Request processed in 221us (456us total) trans 21474843162 rc 0/0 00000100:00100000:0.0:1762166975.559633:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18720 00000004:00080000:3.0:1762166975.559680:0:3634:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf3db4380, transno 21474843125 00000004:00080000:3.0:1762166975.559693:0:3634:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf3db6a00, transno 21474843126 00000004:00080000:3.0:1762166975.559702:0:3634:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf3db4700, transno 21474843127 00000004:00080000:3.0:1762166975.559712:0:3634:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf3db7480, transno 21474843128 00000004:00080000:3.0:1762166975.559723:0:3634:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf3db5c00, transno 21474843129 00000004:00080000:3.0:1762166975.559733:0:3634:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf79ebb80, transno 21474843133 00000004:00080000:3.0:1762166975.559743:0:3634:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf79eaa00, transno 21474843134 00000004:00080000:3.0:1762166975.559757:0:3634:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf79e9180, transno 21474843135 00000004:00080000:3.0:1762166975.559764:0:3634:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf79e8700, transno 21474843136 00000004:00080000:2.0:1762166975.559767:0:9994:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0001: 0 changes, 5 in progress, 3 in flight, 5 done 00000004:00080000:3.0:1762166975.559771:0:3634:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf79e8e00, transno 21474843137 00000100:00100000:3.0:1762166975.559787:0:3634:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff945bc4a2aa00 x1847765449678720/t21474843159(21474843159) o2->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 440/432 e 0 to 0 dl 1762166991 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1762166975.559799:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc4a2aa00/2, rc 0, transno 21474843159 00000100:00100000:3.0:1762166975.559812:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449678720:0@lo:2:osp-syn-0-1.0 00000004:00080000:2.0:1762166975.559814:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc4a28e00/2, rc 0, transno 21474843160 00000100:00100000:2.0:1762166975.559830:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449677824:0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1762166975.559868:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc7d21180/2, rc 0, transno 17179876160 00000004:00080000:2.0:1762166975.559871:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc7d22a00/2, rc 0, transno 17179876163 00000100:00100000:3.0:1762166975.559878:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7d21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449677696:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1762166975.559882:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7d22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449678336:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1762166975.559929:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc7d21c00/2, rc 0, transno 17179876159 00000004:00080000:2.0:1762166975.559936:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc4a28700/2, rc 0, transno 21474843161 00000100:00100000:2.0:1762166975.559943:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449678848:0@lo:2:osp-syn-0-1.0 00000004:00080000:0.0:1762166975.559948:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc4a28000/2, rc 0, transno 21474843162 00000100:00100000:0.0:1762166975.559956:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449678080:0@lo:2:osp-syn-0-1.0 00000004:00080000:0.0:1762166975.559973:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc4a28380/2, rc 0, transno 21474843163 00000100:00100000:0.0:1762166975.559977:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449678592:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166975.560038:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7d21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449678208:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1762166975.560601:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166975.560646:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450321408 00000100:00100000:2.0:1762166975.560653:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450321408 00000100:00100000:2.0:1762166975.560695:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30214 00000100:00100000:2.0:1762166975.560706:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+524:61832:x1847765450321408:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166975.560727:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166975.560744:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effba9a68 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e967d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.560799:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effba9a68 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e967d expref: 525 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.560814:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effba9a68 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e967d expref: 525 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.560833:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166975.560836:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166975.560839:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa9e00, rc 0) 00000100:00100000:2.0:1762166975.560888:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+525:61832:x1847765450321408:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 184us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166975.560896:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30214 00000100:00100000:2.0:1762166975.562616:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166975.562778:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450321664 00000100:00100000:3.0:1762166975.562787:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450321664 00000100:00100000:3.0:1762166975.562833:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11777 00000100:00100000:3.0:1762166975.562845:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+525:61832:x1847765450321664:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:3.0:1762166975.563125:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+526:61832:x1847765450321664:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 282us (514us total) trans 4294991791 rc 0/0 00000100:00100000:3.0:1762166975.563134:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11777 00000100:00100000:2.0:1762166975.571786:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450321792 00000100:00100000:2.0:1762166975.571797:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450321792 00000100:00100000:2.0:1762166975.571857:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30215 00000100:00100000:2.0:1762166975.571867:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+526:61833:x1847765450321792:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166975.571893:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166975.571932:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effba9a6f lrc: 2/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9684 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.571997:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effba9a76 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166975.572010:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effba9a76 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.572020:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effba9a76 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.572031:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effba9a7d lrc: 3/1,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166975.572037:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effba9a7d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.572046:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effba9a7d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.572117:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effba9a84 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166975.572125:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effba9a84 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.572130:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effba9a84 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:2.0:1762166975.572171:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 262144 00000004:00200000:2.0:1762166975.572176:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166975.572193:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effba9a84 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.572204:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effba9a84 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.572212:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effba9a76 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.572218:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effba9a76 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.572224:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effba9a76 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.572230:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effba9a76 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.572236:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa8000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166975.572239:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effba9a76 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.572246:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effba9a76 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.572262:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0x0 (ffff945bc809bb00) 00010000:00010000:2.0:1762166975.572265:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166975.572270:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effba9a76 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.572276:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effba9a76 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.572290:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effba9a7d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.572296:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effba9a7d lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.572302:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effba9a7d lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.572307:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa8200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166975.572310:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effba9a7d lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.572316:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effba9a7d lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.572323:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0xdd396665 (ffff945bc809bf00) 00010000:00010000:2.0:1762166975.572325:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166975.572328:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effba9a7d lrc: 2/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.572333:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effba9a7d lrc: 0/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.572360:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effba9a6f lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9684 expref: 528 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.572374:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effba9a84 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9684 expref: 527 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.572381:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166975.572383:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166975.572386:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa8c00, rc 0) 00000100:00100000:2.0:1762166975.572447:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+527:61833:x1847765450321792:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 581us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166975.572454:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30215 00000100:00100000:0.0:1762166975.574079:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166975.574118:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450322048 00000100:00100000:2.0:1762166975.574125:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450322048 00000100:00100000:2.0:1762166975.574163:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30216 00000100:00100000:2.0:1762166975.574171:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+527:61833:x1847765450322048:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166975.574184:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166975.574195:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effba9a8b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e968b expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.574282:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effba9a92 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166975.574294:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effba9a92 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.574302:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effba9a92 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:2.0:1762166975.574315:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 262144 00010000:00010000:2.0:1762166975.574402:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effba9a8b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e968b expref: 530 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.574416:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effba9a92 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e968b expref: 529 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.574424:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166975.574426:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1762166975.574428:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa8800, rc 0) 00000100:00100000:2.0:1762166975.574497:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+529:61833:x1847765450322048:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 305us (401us total) trans 4294991792 rc 0/0 00000100:00100000:2.0:1762166975.574505:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30216 00000100:00100000:0.0:1762166975.576433:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166975.576508:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450322304 00000100:00100000:2.0:1762166975.576515:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450322304 00000100:00100000:2.0:1762166975.576565:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30217 00000100:00100000:2.0:1762166975.576579:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+529:61833:x1847765450322304:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166975.576596:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166975.576612:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9400/0x2f180c4effba9aa0 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9692 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.576690:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effba9aa7 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166975.576703:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effba9aa7 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.576712:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effba9aa7 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:2.0:1762166975.576722:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 262144 00010000:00010000:2.0:1762166975.576798:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9400/0x2f180c4effba9aa0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9692 expref: 532 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.576816:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effba9aa7 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9692 expref: 531 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.576823:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166975.576826:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166975.576829:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa9a00, rc 0) 00000100:00100000:2.0:1762166975.576874:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+531:61833:x1847765450322304:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 300us (451us total) trans 4294991793 rc 0/0 00000100:00100000:2.0:1762166975.576881:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30217 00000100:00100000:2.0:1762166975.601665:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450322432 00000100:00100000:2.0:1762166975.601677:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450322432 00000100:00100000:2.0:1762166975.601765:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1962 00000100:00100000:2.0:1762166975.601776:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+24:2418:x1847765450322432:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:2.0:1762166975.601810:0:23940:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9400/0x2f180c4effba9ab5 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.601824:0:23940:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166975.601826:0:23940:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166975.601831:0:23940:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9400/0x2f180c4effba9ab5 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.601844:0:23940:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9400/0x2f180c4effba9ab5 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.605703:0:23940:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9400/0x2f180c4effba9ab5 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.605722:0:23940:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9400/0x2f180c4effba9ab5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.605732:0:23940:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9400/0x2f180c4effba9ab5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.605740:0:23940:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa9400 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166975.605744:0:23940:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9400/0x2f180c4effba9ab5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.605753:0:23940:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9400/0x2f180c4effba9ab5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.605772:0:23940:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9400/0x2f180c4effba9ab5 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.605780:0:23940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9400/0x2f180c4effba9ab5 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166975.605862:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+24:2418:x1847765450322432:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 4085us (4290us total) trans 0 rc 262144/262144 00000100:00100000:2.0:1762166975.605872:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1962 00000100:00100000:0.0:1762166975.608343:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166975.608412:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450322560 00000100:00100000:2.0:1762166975.608425:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450322560 00000100:00100000:2.0:1762166975.608543:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1963 00000100:00100000:2.0:1762166975.608555:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765450322560:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:2.0:1762166975.608597:0:23940:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9800/0x2f180c4effba9abc lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.608619:0:23940:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc7194800/0x2f180c4effba9a1b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e965a expref: 24 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.608629:0:23940:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166975.608631:0:23940:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166975.608634:0:23940:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9800/0x2f180c4effba9abc lrc: 4/1,0 mode: --/PR res: [0x2c0000400:0xa82:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.608675:0:23940:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc7194800/0x2f180c4effba9a1b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e965a expref: 24 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.608691:0:23940:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc7194800/0x2f180c4effba9a1b lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e965a expref: 24 pid: 8380 timeout: 694 lvb_type: 0 00000100:00100000:2.0:1762166975.608708:0:23940:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bc3480 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_007:lustre-OST0001_UUID:23940:1847765449678976:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166975.608814:0:23940:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf3a33180 going to sleep for 11 seconds 00000100:00100000:2.0:1762166975.609879:0:23940:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bc3480 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_007:lustre-OST0001_UUID:23940:1847765449678976:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166975.609906:0:23940:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9800/0x2f180c4effba9abc lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa82:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166975.609992:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166975.610055:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450322688 00000100:00100000:2.0:1762166975.610061:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450322688 00010000:00010000:2.0:1762166975.610086:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc7194800/0x2f180c4effba9a1b lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e965a expref: 25 pid: 8380 timeout: 694 lvb_type: 0 00000100:00100000:2.0:1762166975.610126:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9455 00000100:00100000:2.0:1762166975.610136:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d20e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+25:2418:x1847765450322688:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166975.610148:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166975.610168:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc7194800/0x2f180c4effba9a1b lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e965a expref: 25 pid: 8380 timeout: 694 lvb_type: 0 00010000:00010000:2.0:1762166975.610177:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc7194800/0x2f180c4effba9a1b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e965a expref: 25 pid: 8380 timeout: 694 lvb_type: 0 00010000:00010000:2.0:1762166975.610195:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc7194800/0x2f180c4effba9a1b lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e965a expref: 25 pid: 8380 timeout: 694 lvb_type: 0 00010000:00010000:2.0:1762166975.610209:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166975.610211:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166975.610214:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9800/0x2f180c4effba9abc lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa82:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.610221:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9800/0x2f180c4effba9abc lrc: 4/1,0 mode: PR/PR res: [0x2c0000400:0xa82:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.610243:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166975.610274:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d20e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+24:2418:x1847765450322688:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 140us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166975.610282:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9455 00000100:00100000:0.0:1762166975.614133:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.616203:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166975.616257:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450322944 00000100:00100000:2.0:1762166975.616266:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450322944 00010000:00010000:2.0:1762166975.616304:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba000/0x2f180c4effba9a37 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9668 expref: 22 pid: 8380 timeout: 694 lvb_type: 0 00000100:00100000:2.0:1762166975.616344:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9456 00000100:00100000:2.0:1762166975.616355:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d23b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450322944:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166975.616370:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166975.616392:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba000/0x2f180c4effba9a37 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9668 expref: 22 pid: 8380 timeout: 694 lvb_type: 0 00010000:00010000:2.0:1762166975.616406:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba000/0x2f180c4effba9a37 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9668 expref: 22 pid: 8380 timeout: 694 lvb_type: 0 00010000:00010000:2.0:1762166975.616427:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba000/0x2f180c4effba9a37 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9668 expref: 22 pid: 8380 timeout: 694 lvb_type: 0 00010000:00010000:2.0:1762166975.616439:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166975.616440:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166975.616444:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc8c7ba00/0x2f180c4effba9ac3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.616451:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8c7ba00/0x2f180c4effba9ac3 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.616506:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166975.616565:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d23b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450322944:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 209us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166975.616585:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9456 00000100:00100000:0.0:1762166975.621376:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.623130:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166975.623192:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450323200 00000100:00100000:2.0:1762166975.623198:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450323200 00010000:00010000:2.0:1762166975.623224:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effba9a53 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9676 expref: 24 pid: 8380 timeout: 694 lvb_type: 0 00000100:00100000:2.0:1762166975.623259:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9457 00000100:00100000:2.0:1762166975.623272:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d23800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+24:2418:x1847765450323200:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166975.623283:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166975.623303:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effba9a53 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9676 expref: 24 pid: 8380 timeout: 694 lvb_type: 0 00010000:00010000:2.0:1762166975.623315:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effba9a53 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9676 expref: 24 pid: 8380 timeout: 694 lvb_type: 0 00010000:00010000:2.0:1762166975.623340:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effba9a53 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9676 expref: 24 pid: 8380 timeout: 694 lvb_type: 0 00010000:00010000:2.0:1762166975.623354:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166975.623356:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166975.623359:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc8c7a600/0x2f180c4effba9aca lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.623369:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8c7a600/0x2f180c4effba9aca lrc: 4/1,0 mode: PR/PR res: [0x2c0000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.623393:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166975.623504:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d23800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765450323200:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 236us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166975.623517:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9457 00000100:00100000:0.0:1762166975.632329:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166975.632582:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450323328 00000100:00100000:2.0:1762166975.632599:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450323328 00000100:00100000:2.0:1762166975.632683:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 855 00000100:00100000:2.0:1762166975.632695:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4492a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+531:61833:x1847765450323328:12345-192.168.204.38@tcp:103:lfs.0 00010000:00010000:2.0:1762166975.632717:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166975.632748:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effba9aa7 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9692 expref: 531 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.632784:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166975.632790:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166975.632862:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4492a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+530:61833:x1847765450323328:12345-192.168.204.38@tcp:103:lfs.0 Request processed in 169us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166975.632871:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 855 00000100:00100000:0.0:1762166975.633832:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166975.633908:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450323584 00000100:00100000:3.0:1762166975.633936:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450323584 00000100:00100000:3.0:1762166975.633995:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11778 00000100:00100000:3.0:1762166975.634006:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff2f9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+530:61833:x1847765450323584:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:3.0:1762166975.634222:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff2f9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+531:61833:x1847765450323584:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 217us (393us total) trans 4294991794 rc 0/0 00000100:00100000:3.0:1762166975.634233:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11778 00000100:00100000:0.0:1762166975.636272:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166975.636357:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450323840 00000100:00100000:2.0:1762166975.636366:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450323840 00000100:00100000:2.0:1762166975.636423:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30218 00000100:00100000:2.0:1762166975.636433:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4490380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+531:61766:x1847765450323840:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:2.0:1762166975.636459:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166975.636505:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effba9ad1 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9699 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.636648:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effba9ad8 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166975.636666:0:6495:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effba9a84 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9684 expref: 532 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.636682:0:6495:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effba9ad8 lrc: 4/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.636717:0:6495:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effba9a84 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9684 expref: 532 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.636733:0:6495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effba9a84 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9684 expref: 532 pid: 6495 timeout: 694 lvb_type: 0 00000100:00100000:2.0:1762166975.636748:0:6495:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bc3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6495:1847765449679360:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166975.636846:0:6495:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf3a330c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166975.638002:0:6495:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bc3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6495:1847765449679360:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166975.638035:0:6495:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effba9ad8 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000100:00100000:0.0:1762166975.638121:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166975.638164:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450323968 00000100:00100000:2.0:1762166975.638172:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450323968 00010000:00010000:2.0:1762166975.638204:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effba9a84 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9684 expref: 533 pid: 6495 timeout: 694 lvb_type: 0 00000100:00100000:2.0:1762166975.638241:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9458 00000100:00100000:2.0:1762166975.638251:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf9d1f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+533:2418:x1847765450323968:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166975.638265:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166975.638272:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effba9a84 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9684 expref: 533 pid: 6495 timeout: 694 lvb_type: 0 00010000:00010000:2.0:1762166975.638284:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effba9a84 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9684 expref: 533 pid: 6495 timeout: 694 lvb_type: 0 00010000:00010000:2.0:1762166975.638308:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effba9a84 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9684 expref: 533 pid: 6495 timeout: 694 lvb_type: 0 00010000:00010000:2.0:1762166975.638322:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166975.638326:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effba9ad8 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.638335:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effba9ad8 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.638342:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effba9ad8 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.638370:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166975.638409:0:6495:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effba9ad8 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.638419:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effba9ad8 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000100:00100000:2.0:1762166975.638423:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf9d1f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+532:2418:x1847765450323968:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 172us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166975.638435:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9458 00000004:00200000:0.0:1762166975.638447:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 262144 00010000:00010000:0.0:1762166975.638611:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effba9ad1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9699 expref: 533 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.638627:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effba9ad8 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9699 expref: 532 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.638635:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166975.638637:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1762166975.638640:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa9000, rc 0) 00000100:00100000:0.0:1762166975.638684:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4490380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+532:61766:x1847765450323840:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 2253us (2418us total) trans 4294991795 rc 0/0 00000100:00100000:0.0:1762166975.638691:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30218 00000100:00100000:0.0:1762166975.639976:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166975.640036:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450324096 00000100:00100000:2.0:1762166975.640043:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450324096 00000100:00100000:2.0:1762166975.640083:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30219 00000100:00100000:2.0:1762166975.640089:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4491c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+532:61766:x1847765450324096:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:2.0:1762166975.640108:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166975.640122:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effba9ae6 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e96a0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.640199:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effba9aed lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166975.640213:0:6495:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effba9ad8 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9699 expref: 533 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.640220:0:6495:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effba9aed lrc: 4/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.640244:0:6495:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effba9ad8 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9699 expref: 533 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.640252:0:6495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effba9ad8 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9699 expref: 533 pid: 6495 timeout: 694 lvb_type: 0 00000100:00100000:2.0:1762166975.640262:0:6495:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bc3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6495:1847765449679488:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166975.640313:0:6495:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf3a33180 going to sleep for 11 seconds 00000100:00100000:2.0:1762166975.641794:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.641828:0:6495:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bc3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6495:1847765449679488:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166975.641855:0:6495:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effba9aed lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000100:00100000:3.0:1762166975.641858:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450324224 00000100:00100000:3.0:1762166975.641866:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450324224 00010000:00010000:3.0:1762166975.641899:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effba9ad8 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9699 expref: 534 pid: 6495 timeout: 694 lvb_type: 0 00000100:00100000:3.0:1762166975.641940:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9459 00000100:00100000:3.0:1762166975.641951:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+534:2419:x1847765450324224:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166975.641963:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166975.641969:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effba9ad8 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9699 expref: 534 pid: 6495 timeout: 694 lvb_type: 0 00010000:00010000:3.0:1762166975.641980:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effba9ad8 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9699 expref: 534 pid: 6495 timeout: 694 lvb_type: 0 00010000:00010000:3.0:1762166975.642000:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effba9ad8 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9699 expref: 534 pid: 6495 timeout: 694 lvb_type: 0 00010000:00010000:3.0:1762166975.642017:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166975.642021:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effba9aed lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166975.642030:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effba9aed lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166975.642037:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effba9aed lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166975.642060:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166975.642077:0:6495:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effba9aed lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.642087:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effba9aed lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000100:00100000:3.0:1762166975.642114:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+533:2419:x1847765450324224:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 162us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166975.642128:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9459 00000004:00200000:0.0:1762166975.642138:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 262144 00000004:00200000:0.0:1762166975.642148:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166975.642172:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effba9aed lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.642203:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effba9ae6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e96a0 expref: 533 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.642220:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effba9aed lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e96a0 expref: 532 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.642228:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166975.642231:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166975.642234:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa8000, rc 0) 00000100:00100000:0.0:1762166975.642271:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4491c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+532:61766:x1847765450324096:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 2181us (2300us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166975.642278:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30219 00000100:00100000:2.0:1762166975.643462:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.643535:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450324352 00000100:00100000:0.0:1762166975.643541:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450324352 00000100:00100000:0.0:1762166975.643585:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18722 00000100:00100000:0.0:1762166975.643592:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+22:2417:x1847765450324352:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:0.0:1762166975.643612:0:8382:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166975.643631:0:8382:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde800/0x2f180c4effba9af4 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa82:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e96a7 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166975.643656:0:8382:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa82:0x0] initial LVB size: 262144, mtime: 0x690888bf, atime: 0x690888bc, ctime: 0x690888bf, blocks: 0xd0 00010000:00010000:0.0:1762166975.643674:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166975.643677:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166975.643686:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde800/0x2f180c4effba9af4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e96a7 expref: 23 pid: 8382 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166975.643707:0:8382:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde800/0x2f180c4effba9af4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e96a7 expref: 23 pid: 8382 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166975.643718:0:8382:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bde800, rc 0) 00000100:00100000:0.0:1762166975.643755:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+23:2417:x1847765450324352:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 163us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166975.643762:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18722 00000100:00100000:2.0:1762166975.645615:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450324480 00000100:00100000:2.0:1762166975.645623:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450324480 00002000:00100000:2.0:1762166975.645666:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa82:0x0] (49152->53247) req@ffff945bc4a28a80 x1847765450324480/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:6/0 lens 488/0 e 0 to 0 dl 1762166986 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166975.645677:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4a28a80 with x1847765450324480 ext(49152->53247) 00002000:00010000:2.0:1762166975.645682:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4a28a80 00000100:00100000:2.0:1762166975.645706:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1966 00000100:00100000:2.0:1762166975.645715:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765450324480:12345-192.168.204.38@tcp:3:lfs.0 00000100:00100000:2.0:1762166975.645902:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765450324480:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 188us (343us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1762166975.645919:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1966 00002000:00100000:2.0:1762166975.645927:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa82:0x0] (49152->53247) req@ffff945bc4a28a80 x1847765450324480/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:6/0 lens 488/4536 e 0 to 0 dl 1762166986 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166975.645935:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4a28a80 with x1847765450324480 ext(49152->53247) 00002000:00010000:2.0:1762166975.645939:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4a28a80 00000100:00100000:2.0:1762166975.647310:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450324608 00000100:00100000:2.0:1762166975.647316:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450324608 00002000:00100000:2.0:1762166975.647341:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa82:0x0] (53248->57343) req@ffff945bc4a2ad80 x1847765450324608/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:6/0 lens 488/0 e 0 to 0 dl 1762166986 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166975.647351:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4a2ad80 with x1847765450324608 ext(53248->57343) 00002000:00010000:2.0:1762166975.647356:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4a2ad80 00000100:00100000:2.0:1762166975.647384:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1967 00000100:00100000:2.0:1762166975.647393:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765450324608:12345-192.168.204.38@tcp:3:lfs.0 00000100:00100000:2.0:1762166975.647539:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765450324608:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 145us (275us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1762166975.647553:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1967 00002000:00100000:2.0:1762166975.647562:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa82:0x0] (53248->57343) req@ffff945bc4a2ad80 x1847765450324608/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:6/0 lens 488/4536 e 0 to 0 dl 1762166986 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166975.647570:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4a2ad80 with x1847765450324608 ext(53248->57343) 00002000:00010000:2.0:1762166975.647574:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4a2ad80 00000100:00100000:0.0:1762166975.648727:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166975.648783:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450324736 00000100:00100000:2.0:1762166975.648789:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450324736 00002000:00100000:2.0:1762166975.648814:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa82:0x0] (28672->94207) req@ffff945bc4491f80 x1847765450324736/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:6/0 lens 504/0 e 0 to 0 dl 1762166986 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166975.648824:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4491f80 with x1847765450324736 ext(28672->94207) 00002000:00010000:2.0:1762166975.648828:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4491f80 00000100:00100000:2.0:1762166975.648851:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1968 00000100:00100000:2.0:1762166975.648860:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4491f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+23:2416:x1847765450324736:12345-192.168.204.38@tcp:3:lfs.0 00000100:00100000:2.0:1762166975.649959:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4491f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+23:2416:x1847765450324736:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 1097us (1232us total) trans 0 rc 57344/57344 00000100:00100000:2.0:1762166975.649969:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1968 00002000:00100000:2.0:1762166975.649982:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa82:0x0] (28672->94207) req@ffff945bc4491f80 x1847765450324736/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:6/0 lens 504/440 e 0 to 0 dl 1762166986 ref 1 fl Complete:/600/0 rc 57344/57344 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166975.649992:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4491f80 with x1847765450324736 ext(28672->94207) 00002000:00010000:2.0:1762166975.649997:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4491f80 00000100:00100000:0.0:1762166975.651383:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450324992 00000100:00100000:0.0:1762166975.651393:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450324992 00000100:00100000:0.0:1762166975.651455:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30220 00000100:00100000:0.0:1762166975.651464:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+532:61766:x1847765450324992:12345-192.168.204.38@tcp:36:fsx.0 00010000:00010000:0.0:1762166975.651548:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166975.651573:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effba9aed lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e96a0 expref: 532 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.651594:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166975.651599:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166975.651787:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effba9afb lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166975.651799:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effba9afb lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.651808:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effba9afb lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000001:00080000:0.0:1762166975.651859:0:6495:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294991796 00000004:00010000:0.0:1762166975.651885:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000e66a6699 reply state 000000002f5f9140 transno 4294991797 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effba9afb lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.651895:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effba9afb lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.651899:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166975.651902:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762166975.651903:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166975.651981:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+534:61766:x1847765450324992:12345-192.168.204.38@tcp:36:fsx.0 Request processed in 518us (648us total) trans 4294991797 rc 0/0 00000100:00100000:0.0:1762166975.651988:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30220 00000020:00080000:0.0:1762166975.651993:0:6495:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1762166975.652818:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166975.652859:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450325248 00000100:00100000:3.0:1762166975.652865:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450325248 00000100:00100000:3.0:1762166975.652904:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11779 00000100:00100000:3.0:1762166975.652922:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4492680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+534:61766:x1847765450325248:12345-192.168.204.38@tcp:35:fsx.0 00000100:00100000:3.0:1762166975.653082:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4492680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+535:61766:x1847765450325248:12345-192.168.204.38@tcp:35:fsx.0 Request processed in 169us (265us total) trans 4294991798 rc 0/0 00000100:00100000:3.0:1762166975.653090:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11779 00000100:00100000:0.0:1762166975.654068:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450325504 00000100:00100000:0.0:1762166975.654078:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450325504 00000100:00100000:0.0:1762166975.654134:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30221 00000100:00100000:0.0:1762166975.654147:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcceb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+535:61766:x1847765450325504:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:0.0:1762166975.654169:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166975.654173:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:0.0:1762166975.654198:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effba9a92 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e968b expref: 535 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.654219:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effba9a68 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e967d expref: 534 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.654230:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166975.654235:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166975.654249:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effba9b02 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e96ae expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.654294:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effba9b09 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166975.654304:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effba9b09 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.654311:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effba9b09 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000040:00080000:0.0:1762166975.654551:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5850, 88 off457784 00000004:00080000:0.0:1762166975.654557:0:6495:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 594803079282ns, next at 594522415006ns, rc = 0 00000040:00080000:0.0:1762166975.654589:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5849, 88 off457784 00000004:00080000:0.0:1762166975.654595:0:6495:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 594803116971ns, next at 594522388989ns, rc = 0 00000040:00080000:0.0:1762166975.654625:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5850, 88 off457872 00000004:00080000:0.0:1762166975.654630:0:6495:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 594803151882ns, next at 594522388989ns, rc = 0 00000040:00080000:0.0:1762166975.654638:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5851, 88 off457872 00000004:00080000:0.0:1762166975.654641:0:6495:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 594803163572ns, next at 594522415006ns, rc = 0 00000040:00080000:0.0:1762166975.654654:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5852, 88 off457960 00000004:00080000:0.0:1762166975.654657:0:6495:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 594803179539ns, next at 594522415006ns, rc = 0 00000040:00080000:0.0:1762166975.654674:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5851, 88 off457960 00000004:00080000:0.0:1762166975.654678:0:6495:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 594803199874ns, next at 594522388989ns, rc = 0 00000040:00080000:0.0:1762166975.654685:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5852, 88 off458048 00000004:00080000:0.0:1762166975.654688:0:6495:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 594803210282ns, next at 594522388989ns, rc = 0 00000040:00080000:0.0:1762166975.654694:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5853, 88 off458048 00000004:00080000:0.0:1762166975.654697:0:6495:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 594803219422ns, next at 594522415006ns, rc = 0 00000040:00080000:0.0:1762166975.654708:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5854, 88 off458136 00000004:00080000:0.0:1762166975.654711:0:6495:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 594803233714ns, next at 594522415006ns, rc = 0 00000040:00080000:0.0:1762166975.654718:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5853, 88 off458136 00000004:00080000:0.0:1762166975.654720:0:6495:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 594803242274ns, next at 594522388989ns, rc = 0 00000001:00080000:3.0:1762166975.655635:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294991799 is committed 00000004:00080000:3.0:1762166975.655642:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3223 committed 00000004:00080000:3.0:1762166975.655653:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3220 committed 00000004:00080000:3.0:1762166975.655663:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3219 committed 00000004:00080000:3.0:1762166975.655667:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3222 committed 00000004:00080000:3.0:1762166975.655672:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3221 committed 00000004:00080000:3.0:1762166975.655678:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3218 committed 00000004:00080000:3.0:1762166975.655683:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3217 committed 00000004:00080000:3.0:1762166975.655687:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3220 committed 00000004:00080000:3.0:1762166975.655702:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3219 committed 00000004:00080000:3.0:1762166975.655708:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3216 committed 00000100:00100000:0.0:1762166975.655800:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449679744:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1762166975.655803:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4492a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449680000:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1762166975.655849:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4491180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449679872:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1762166975.655858:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166975.655880:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449679616 00000100:00100000:0.0:1762166975.655884:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166975.655885:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449679616 00000100:00100000:2.0:1762166975.655893:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449680512:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1762166975.655922:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449680384:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166975.655926:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449680000 00000100:00100000:3.0:1762166975.655930:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449680000 00000100:00100000:2.0:1762166975.655942:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166975.655953:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449679872 00000100:00100000:3.0:1762166975.655958:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449679872 00000100:00100000:3.0:1762166975.655983:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18723 00000100:00100000:2.0:1762166975.655986:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1762166975.655986:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166975.655996:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcceb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+12:3636:x1847765449679616:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1762166975.655997:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449680640:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1762166975.656022:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1762166975.656042:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effba9b09 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e96ae expref: 526 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.656054:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00000100:00100000:2.0:1762166975.656059:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18724 00010000:00010000:0.0:1762166975.656060:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000100:00100000:2.0:1762166975.656071:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+13:3635:x1847765449680000:12345-0@lo:2:osp-syn-0-1.0 00010000:00010000:0.0:1762166975.656074:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effba9b02 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e96ae expref: 526 pid: 6495 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1762166975.656097:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effba9b09 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e96ae expref: 525 pid: 6495 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166975.656103:0:8382:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166975.656107:0:8382:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb mtime from disk: 1762166966 -> 1762166966 00002000:00010000:3.0:1762166975.656110:0:8382:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1762166975.656112:0:8382:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb ctime from disk: 1762166966 -> 1762166966 00002000:00010000:3.0:1762166975.656115:0:8382:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1762166975.656123:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18726 00000100:00100000:0.0:1762166975.656132:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+11:3635:x1847765449680512:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:2.0:1762166975.656137:0:8380:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa83:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166975.656141:0:8380:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa83:0x0] updating lvb mtime from disk: 1762166975 -> 1762166975 00002000:00010000:2.0:1762166975.656143:0:8380:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa83:0x0] updating lvb atime from disk: 1762166972 -> 1762166972 00002000:00010000:2.0:1762166975.656145:0:8380:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa83:0x0] updating lvb ctime from disk: 1762166975 -> 1762166975 00002000:00010000:2.0:1762166975.656147:0:8380:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa83:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166975.656153:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcceb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+16:3636:x1847765449679616:12345-0@lo:2:osp-syn-0-1.0 Request processed in 160us (333us total) trans 21474843164 rc 0/0 00000100:00100000:3.0:1762166975.656161:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18723 00000100:00100000:2.0:1762166975.656179:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+15:3635:x1847765449680000:12345-0@lo:2:osp-syn-0-1.0 Request processed in 112us (322us total) trans 21474843165 rc 0/0 00000100:00100000:3.0:1762166975.656185:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18727 00000100:00100000:2.0:1762166975.656195:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18724 00000100:00100000:3.0:1762166975.656200:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+12:3634:x1847765449680384:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:0.0:1762166975.656209:0:35472:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166975.656213:0:35472:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb mtime from disk: 1762166975 -> 1762166975 00000100:00100000:2.0:1762166975.656214:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18728 00002000:00010000:0.0:1762166975.656219:0:35472:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb atime from disk: 1762166973 -> 1762166973 00002000:00010000:0.0:1762166975.656223:0:35472:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb ctime from disk: 1762166975 -> 1762166975 00000100:00100000:2.0:1762166975.656226:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+14:3635:x1847765449680640:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:0.0:1762166975.656228:0:35472:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:3.0:1762166975.656253:0:8382:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa82:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:3.0:1762166975.656257:0:8382:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa82:0x0] updating lvb mtime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166975.656260:0:8382:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa82:0x0] updating lvb atime from disk: 1762166972 -> 1762166972 00002000:00010000:3.0:1762166975.656262:0:8382:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa82:0x0] updating lvb ctime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166975.656265:0:8382:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa82:0x0] updating lvb blocks from disk: 208 -> 208 00000100:00100000:0.0:1762166975.656266:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+13:3635:x1847765449680512:12345-0@lo:2:osp-syn-1-1.0 Request processed in 136us (325us total) trans 17179876164 rc 0/0 00000100:00100000:0.0:1762166975.656273:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18726 00002000:00010000:2.0:1762166975.656278:0:8380:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa87:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166975.656283:0:8380:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa87:0x0] updating lvb mtime from disk: 1762166975 -> 1762166975 00002000:00010000:2.0:1762166975.656287:0:8380:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa87:0x0] updating lvb atime from disk: 1762166974 -> 1762166974 00002000:00010000:2.0:1762166975.656289:0:8380:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa87:0x0] updating lvb ctime from disk: 1762166975 -> 1762166975 00000100:00100000:0.0:1762166975.656291:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449679744 00002000:00010000:2.0:1762166975.656292:0:8380:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa87:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1762166975.656297:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449679744 00000100:00100000:3.0:1762166975.656299:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+12:3634:x1847765449680384:12345-0@lo:2:osp-syn-1-1.0 Request processed in 96us (308us total) trans 17179876165 rc 0/0 00000100:00100000:3.0:1762166975.656307:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18727 00000100:00100000:3.0:1762166975.656334:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18729 00000100:00100000:2.0:1762166975.656334:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+14:3635:x1847765449680640:12345-0@lo:2:osp-syn-0-1.0 Request processed in 109us (310us total) trans 21474843167 rc 0/0 00000100:00100000:3.0:1762166975.656349:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcceb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+12:3633:x1847765449679744:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1762166975.656350:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18728 00010000:00010000:0.0:1762166975.656359:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166975.656363:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1762166975.656368:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdf200, rc 0) 00000100:00100000:2.0:1762166975.656371:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449680256 00000100:00100000:2.0:1762166975.656376:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449680256 00000100:00100000:2.0:1762166975.656402:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18730 00002000:00010000:3.0:1762166975.656409:0:8382:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:3.0:1762166975.656414:0:8382:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166975 -> 1762166975 00000100:00100000:2.0:1762166975.656416:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcceb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+14:3633:x1847765449680256:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:3.0:1762166975.656418:0:8382:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166975.656424:0:8382:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166975.656427:0:8382:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 344 -> 344 00000100:00100000:0.0:1762166975.656429:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcceb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+525:61766:x1847765450325504:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 2283us (2419us total) trans 4294991799 rc 0/0 00000100:00100000:0.0:1762166975.656442:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30221 00000100:00100000:3.0:1762166975.656464:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcceb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+14:3633:x1847765449679744:12345-0@lo:2:osp-syn-1-1.0 Request processed in 118us (184us total) trans 17179876166 rc 0/0 00000100:00100000:3.0:1762166975.656514:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18729 00000100:00100000:2.0:1762166975.656532:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcceb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+15:3633:x1847765449680256:12345-0@lo:2:osp-syn-0-1.0 Request processed in 121us (195us total) trans 21474843168 rc 0/0 00000100:00100000:2.0:1762166975.656538:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18730 00000004:00080000:2.0:1762166975.656580:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf783f800/2, rc 0, transno 21474843167 00000100:00100000:2.0:1762166975.656585:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449680640:0@lo:2:osp-syn-0-1.0 00000004:00080000:2.0:1762166975.656600:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc4492a00/2, rc 0, transno 21474843165 00000100:00100000:2.0:1762166975.656608:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4492a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449680000:0@lo:2:osp-syn-0-1.0 00000004:00080000:0.0:1762166975.656612:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc4491180/2, rc 0, transno 21474843166 00000100:00100000:0.0:1762166975.656620:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4491180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449679872:0@lo:2:osp-syn-0-1.0 00000004:00080000:2.0:1762166975.656628:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc5bc2a00/2, rc 0, transno 17179876164 00000100:00100000:2.0:1762166975.656634:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449680512:0@lo:2:osp-syn-1-1.0 00000004:00080000:0.0:1762166975.656638:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc5bc3480/2, rc 0, transno 17179876165 00000100:00100000:0.0:1762166975.656646:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449680384:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1762166975.656680:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166975.656705:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449680128 00000100:00100000:0.0:1762166975.656710:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449680128 00000004:00080000:2.0:1762166975.656734:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc4493b80/2, rc 0, transno 21474843164 00000100:00100000:2.0:1762166975.656741:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4493b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449679616:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1762166975.656746:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18732 00000100:00100000:0.0:1762166975.656755:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+14:3636:x1847765449680128:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:0.0:1762166975.656811:0:35472:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166975.656814:0:35472:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166975 -> 1762166975 00002000:00010000:0.0:1762166975.656816:0:35472:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00002000:00010000:0.0:1762166975.656818:0:35472:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166975 -> 1762166975 00002000:00010000:0.0:1762166975.656820:0:35472:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1762166975.656856:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+15:3636:x1847765449680128:12345-0@lo:2:osp-syn-1-1.0 Request processed in 104us (181us total) trans 17179876168 rc 0/0 00000100:00100000:0.0:1762166975.656866:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18732 00000004:00080000:2.0:1762166975.656887:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc5bc0700/2, rc 0, transno 17179876168 00000100:00100000:2.0:1762166975.656891:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449680128:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1762166975.658105:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450325632 00000100:00100000:0.0:1762166975.658110:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450325632 00000100:00100000:0.0:1762166975.658142:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18733 00000100:00100000:0.0:1762166975.658148:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcceb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+23:61766:x1847765450325632:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:0.0:1762166975.658157:0:35472:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166975.658168:0:35472:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde400/0x2f180c4effba9b10 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e96b5 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.658187:0:35472:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc7194e00/0x2f180c4effba9823 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e959d expref: 24 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166975.658194:0:35472:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166975.658195:0:35472:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166975.658198:0:35472:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde400/0x2f180c4effba9b10 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e96b5 expref: 24 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.658216:0:35472:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc7194e00/0x2f180c4effba9823 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e959d expref: 24 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166975.658225:0:35472:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc7194e00/0x2f180c4effba9823 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e959d expref: 24 pid: 28434 timeout: 694 lvb_type: 1 00000100:00100000:0.0:1762166975.658232:0:35472:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:35472:1847765449680896:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166975.658271:0:35472:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bca7930c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166975.659308:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166975.659343:0:35472:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:35472:1847765449680896:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166975.659367:0:35472:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde400/0x2f180c4effba9b10 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e96b5 expref: 24 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.659379:0:35472:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bde400, rc 0) 00000100:00100000:3.0:1762166975.659409:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450325760 00000100:00100000:2.0:1762166975.659420:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcceb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+24:61766:x1847765450325632:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 1268us (1358us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166975.659425:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450325760 00000100:00100000:2.0:1762166975.659432:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18733 00010000:00010000:3.0:1762166975.659474:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc7194e00/0x2f180c4effba9823 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e959d expref: 24 pid: 28434 timeout: 694 lvb_type: 1 00000100:00100000:3.0:1762166975.659595:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9460 00000100:00100000:3.0:1762166975.659606:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+24:2418:x1847765450325760:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166975.659620:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166975.659638:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc7194e00/0x2f180c4effba9823 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e959d expref: 24 pid: 28434 timeout: 694 lvb_type: 1 00010000:00010000:3.0:1762166975.659648:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc7194e00/0x2f180c4effba9823 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e959d expref: 24 pid: 28434 timeout: 694 lvb_type: 1 00010000:00010000:3.0:1762166975.659668:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc7194e00/0x2f180c4effba9823 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e959d expref: 24 pid: 28434 timeout: 694 lvb_type: 1 00010000:00010000:3.0:1762166975.659681:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166975.659683:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166975.659690:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde400/0x2f180c4effba9b10 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e96b5 expref: 23 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.659696:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde400/0x2f180c4effba9b10 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e96b5 expref: 23 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.659729:0:6481:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde400/0x2f180c4effba9b10 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e96b5 expref: 23 pid: 35472 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166975.659743:0:6481:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5589c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6481:1847765449681024:192.168.204.38@tcp:105: 00000100:00100000:3.0:1762166975.659832:0:6481:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402f780 going to sleep for 11 seconds 00000100:00100000:3.0:1762166975.660905:0:6481:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5589c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6481:1847765449681024:192.168.204.38@tcp:105: 00000100:00100000:2.0:1762166975.661006:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450325888 00000100:00100000:2.0:1762166975.661014:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450325888 00000100:00100000:2.0:1762166975.661062:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18734 00000100:00100000:2.0:1762166975.661072:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcceb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+20:61766:x1847765450325888:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:2.0:1762166975.661091:0:35472:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166975.661099:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166975.661108:0:35472:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8c00/0x2f180c4effba9b17 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e96bc expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.661133:0:35472:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf800/0x2f180c4effba982a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e95a4 expref: 21 pid: 8383 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166975.661143:0:35472:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1762166975.661144:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765450325760:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1537us (1835us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166975.661149:0:35472:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166975.661157:0:35472:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8c00/0x2f180c4effba9b17 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e96bc expref: 21 pid: 35472 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166975.661159:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9460 00010000:00010000:2.0:1762166975.661193:0:35472:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf800/0x2f180c4effba982a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e95a4 expref: 21 pid: 8383 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166975.661207:0:35472:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf800/0x2f180c4effba982a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e95a4 expref: 21 pid: 8383 timeout: 694 lvb_type: 1 00000100:00100000:2.0:1762166975.661220:0:35472:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bc2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:35472:1847765449681152:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166975.661274:0:35472:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf3a33cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166975.662154:0:35472:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bc2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:35472:1847765449681152:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166975.662170:0:35472:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8c00/0x2f180c4effba9b17 lrc: 3/0,0 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e96bc expref: 21 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.662181:0:35472:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa8c00, rc 0) 00000100:00100000:2.0:1762166975.662227:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcceb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+21:61766:x1847765450325888:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 1156us (1277us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166975.662233:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18734 00000100:00100000:0.0:1762166975.662653:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166975.662687:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450326016 00000100:00100000:3.0:1762166975.662692:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450326016 00010000:00010000:3.0:1762166975.662717:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf800/0x2f180c4effba982a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e95a4 expref: 21 pid: 8383 timeout: 694 lvb_type: 1 00000100:00100000:3.0:1762166975.662749:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9461 00000100:00100000:3.0:1762166975.662756:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450326016:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166975.662767:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166975.662785:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf800/0x2f180c4effba982a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e95a4 expref: 21 pid: 8383 timeout: 694 lvb_type: 1 00010000:00010000:3.0:1762166975.662798:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf800/0x2f180c4effba982a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e95a4 expref: 21 pid: 8383 timeout: 694 lvb_type: 1 00010000:00010000:3.0:1762166975.662820:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf800/0x2f180c4effba982a lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e95a4 expref: 21 pid: 8383 timeout: 694 lvb_type: 1 00010000:00010000:3.0:1762166975.662837:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166975.662839:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166975.662845:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8c00/0x2f180c4effba9b17 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e96bc expref: 20 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.662854:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8c00/0x2f180c4effba9b17 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e96bc expref: 20 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.662879:0:6481:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8c00/0x2f180c4effba9b17 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e96bc expref: 20 pid: 35472 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166975.662890:0:6481:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5589c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6481:1847765449681280:192.168.204.38@tcp:105: 00000100:00100000:3.0:1762166975.662948:0:6481:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402f780 going to sleep for 11 seconds 00000100:00100000:3.0:1762166975.663895:0:6481:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5589c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6481:1847765449681280:192.168.204.38@tcp:105: 00010000:00010000:3.0:1762166975.663907:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166975.663950:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450326016:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1194us (1298us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166975.663958:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9461 00000100:00100000:0.0:1762166975.663985:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166975.664088:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450326144 00000100:00100000:2.0:1762166975.664097:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450326144 00000100:00100000:2.0:1762166975.664149:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18735 00000100:00100000:2.0:1762166975.664158:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+23:61766:x1847765450326144:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:2.0:1762166975.664176:0:35472:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166975.664194:0:35472:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8600/0x2f180c4effba9b1e lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e96c3 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.664222:0:35472:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effba9831 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e95ab expref: 24 pid: 8380 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166975.664230:0:35472:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166975.664232:0:35472:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166975.664235:0:35472:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8600/0x2f180c4effba9b1e lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e96c3 expref: 24 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.664264:0:35472:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effba9831 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e95ab expref: 24 pid: 8380 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166975.664277:0:35472:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effba9831 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e95ab expref: 24 pid: 8380 timeout: 694 lvb_type: 1 00000100:00100000:2.0:1762166975.664290:0:35472:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bc2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:35472:1847765449681408:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166975.664354:0:35472:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf3a33cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166975.665144:0:35472:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bc2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:35472:1847765449681408:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166975.665165:0:35472:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8600/0x2f180c4effba9b1e lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e96c3 expref: 24 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.665181:0:35472:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa8600, rc 0) 00000100:00100000:2.0:1762166975.665225:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+24:61766:x1847765450326144:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 1067us (1246us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166975.665235:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18735 00000100:00100000:3.0:1762166975.665288:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166975.665329:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450326272 00000100:00100000:2.0:1762166975.665333:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450326272 00010000:00010000:2.0:1762166975.665348:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effba9831 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e95ab expref: 24 pid: 8380 timeout: 694 lvb_type: 1 00000100:00100000:2.0:1762166975.665375:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9462 00000100:00100000:2.0:1762166975.665386:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5589c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+24:2418:x1847765450326272:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166975.665396:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166975.665417:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effba9831 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e95ab expref: 24 pid: 8380 timeout: 694 lvb_type: 1 00010000:00010000:2.0:1762166975.665430:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effba9831 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e95ab expref: 24 pid: 8380 timeout: 694 lvb_type: 1 00010000:00010000:2.0:1762166975.665450:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effba9831 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e95ab expref: 24 pid: 8380 timeout: 694 lvb_type: 1 00010000:00010000:2.0:1762166975.665463:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166975.665465:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166975.665470:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8600/0x2f180c4effba9b1e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e96c3 expref: 23 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.665504:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8600/0x2f180c4effba9b1e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e96c3 expref: 23 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.665531:0:6481:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8600/0x2f180c4effba9b1e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e96c3 expref: 23 pid: 35472 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166975.665548:0:6481:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bc2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6481:1847765449681536:192.168.204.38@tcp:105: 00000100:00100000:2.0:1762166975.665581:0:6481:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf3a33cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166975.666569:0:6481:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bc2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6481:1847765449681536:192.168.204.38@tcp:105: 00010000:00010000:2.0:1762166975.666580:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166975.666609:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5589c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765450326272:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1227us (1324us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166975.666616:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9462 00000100:00100000:0.0:1762166975.666859:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.666900:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166975.666939:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450326400 00000100:00100000:2.0:1762166975.666947:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450326400 00000100:00100000:0.0:1762166975.666967:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00002000:00010000:2.0:1762166975.666983:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (230388->18446744073709551615) 00002000:00100000:2.0:1762166975.666990:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf783d880 with x1847765450326400 ext(230388->18446744073709551615) 00002000:00010000:2.0:1762166975.667005:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf783d880. 00000100:00100000:2.0:1762166975.667034:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450326656 00000100:00100000:2.0:1762166975.667039:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450326656 00000100:00100000:3.0:1762166975.667051:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1969 00002000:00010000:2.0:1762166975.667052:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:2.0:1762166975.667056:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf783c700 with x1847765450326656 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166975.667062:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf783c700. 00000100:00100000:3.0:1762166975.667064:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+24:2418:x1847765450326400:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:0.0:1762166975.667080:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1971 00000100:00100000:0.0:1762166975.667096:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765450326656:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:0.0:1762166975.667221:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166975.667228:0:23943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166975 -> 1762166975 00002000:00010000:0.0:1762166975.667235:0:23943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00002000:00010000:0.0:1762166975.667240:0:23943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166975 -> 1762166975 00002000:00010000:0.0:1762166975.667246:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1762166975.667300:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765450326656:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 204us (331us total) trans 17179876169 rc 0/0 00000100:00100000:0.0:1762166975.667325:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1971 00002000:00010000:2.0:1762166975.667333:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 262144 -> 230388 00002000:00010000:0.0:1762166975.667333:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00010000:2.0:1762166975.667342:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166975 -> 1762166975 00002000:00100000:0.0:1762166975.667343:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf783c700 with x1847765450326656 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166975.667350:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00002000:00010000:0.0:1762166975.667353:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf783c700. 00002000:00010000:2.0:1762166975.667355:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166975 -> 1762166975 00002000:00010000:2.0:1762166975.667360:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 344 -> 328 00000100:00100000:2.0:1762166975.667383:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+25:2418:x1847765450326400:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 323us (530us total) trans 17179876170 rc 0/0 00000100:00100000:2.0:1762166975.667394:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1969 00002000:00010000:2.0:1762166975.667397:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (230388->18446744073709551615) 00002000:00100000:2.0:1762166975.667400:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf783d880 with x1847765450326400 ext(230388->18446744073709551615) 00002000:00010000:2.0:1762166975.667404:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf783d880. 00000100:00100000:0.0:1762166975.668713:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450326784 00000100:00100000:0.0:1762166975.668719:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450326784 00000100:00100000:0.0:1762166975.668762:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30222 00000100:00100000:0.0:1762166975.668770:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcceb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+525:61766:x1847765450326784:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:0.0:1762166975.668786:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166975.668803:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effba9b25 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e96ca expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.668883:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effba9b2c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166975.668898:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effba9b2c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.668909:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effba9b2c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:0.0:1762166975.668950:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 262144 00000004:00200000:0.0:1762166975.668954:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166975.668971:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effba9b2c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.669007:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effba9b25 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e96ca expref: 527 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.669022:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effba9b2c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e96ca expref: 526 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.669031:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166975.669034:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166975.669038:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdfa00, rc 0) 00000100:00100000:0.0:1762166975.669078:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcceb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+526:61766:x1847765450326784:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 309us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166975.669085:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30222 00000100:00100000:3.0:1762166975.670701:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166975.670756:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450326912 00000100:00100000:2.0:1762166975.670763:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450326912 00000100:00100000:2.0:1762166975.670804:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1972 00000100:00100000:2.0:1762166975.670813:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+25:2416:x1847765450326912:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:2.0:1762166975.671047:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 230388 -> 230388 00002000:00010000:2.0:1762166975.671051:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166975 -> 1762166975 00002000:00010000:2.0:1762166975.671053:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00002000:00010000:2.0:1762166975.671055:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166975 -> 1762166975 00002000:00010000:2.0:1762166975.671057:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 328 -> 328 00000100:00100000:2.0:1762166975.671096:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+26:2416:x1847765450326912:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 284us (397us total) trans 17179876171 rc 0/0 00000100:00100000:2.0:1762166975.671103:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1972 00000100:00100000:3.0:1762166975.672837:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.672877:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450327168 00000100:00100000:0.0:1762166975.672884:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450327168 00000100:00100000:0.0:1762166975.672932:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30223 00000100:00100000:0.0:1762166975.672941:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5589500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+526:61766:x1847765450327168:12345-192.168.204.38@tcp:36:fsx.0 00010000:00010000:0.0:1762166975.672981:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1762166975.673003:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effba9b09 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e96ae expref: 526 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.673020:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effba9b2c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e96ca expref: 525 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.673029:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166975.673033:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166975.673189:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effba9b33 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166975.673202:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effba9b33 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.673210:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effba9b33 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000001:00080000:0.0:1762166975.673252:0:6495:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294991800 00000004:00010000:0.0:1762166975.673270:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000009d91795d reply state 000000003f2bb13b transno 4294991801 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effba9b33 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.673279:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effba9b33 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.673283:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166975.673285:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762166975.673287:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166975.673348:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5589500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+527:61766:x1847765450327168:12345-192.168.204.38@tcp:36:fsx.0 Request processed in 408us (513us total) trans 4294991801 rc 0/0 00000100:00100000:0.0:1762166975.673355:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30223 00000020:00080000:0.0:1762166975.673359:0:6495:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1762166975.674264:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450327296 00000100:00100000:0.0:1762166975.674269:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450327296 00000100:00100000:0.0:1762166975.674301:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30224 00000100:00100000:0.0:1762166975.674309:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcceb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+527:61766:x1847765450327296:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:0.0:1762166975.674322:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166975.674333:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effba9b3a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e96d1 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.674365:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effba9b3a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e96d1 expref: 528 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.674376:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effba9b3a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e96d1 expref: 528 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.674392:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166975.674394:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166975.674397:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdec00, rc 0) 00000100:00100000:0.0:1762166975.674431:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcceb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+528:61766:x1847765450327296:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 123us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166975.674438:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30224 00000100:00100000:3.0:1762166975.675617:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166975.675643:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166975.675655:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450327552 00000100:00100000:2.0:1762166975.675661:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450327552 00000100:00100000:3.0:1762166975.675669:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.675680:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450327424 00000100:00100000:0.0:1762166975.675685:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450327424 00002000:00010000:2.0:1762166975.675688:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:2.0:1762166975.675694:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc558b800 with x1847765450327552 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166975.675702:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc558b800. 00002000:00010000:0.0:1762166975.675706:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (250794->18446744073709551615) 00002000:00100000:0.0:1762166975.675713:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc558bb80 with x1847765450327424 ext(250794->18446744073709551615) 00002000:00010000:0.0:1762166975.675719:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc558bb80. 00000100:00100000:0.0:1762166975.675818:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1973 00000100:00100000:3.0:1762166975.675829:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1974 00000100:00100000:0.0:1762166975.675834:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450327552:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:3.0:1762166975.675846:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+27:2419:x1847765450327424:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:2.0:1762166975.675849:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1975 00000100:00100000:2.0:1762166975.675864:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+27:2419:x1847765450327680:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:0.0:1762166975.675960:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166975.675964:0:23943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166975 -> 1762166975 00002000:00010000:0.0:1762166975.675967:0:23943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00002000:00010000:0.0:1762166975.675969:0:23943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166975 -> 1762166975 00002000:00010000:0.0:1762166975.675972:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00002000:00010000:3.0:1762166975.676011:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 230388 -> 250794 00000100:00100000:0.0:1762166975.676013:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450327552:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 184us (396us total) trans 21474843170 rc 0/0 00002000:00010000:3.0:1762166975.676016:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166975.676021:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166975.676026:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166975 -> 1762166975 00000100:00100000:0.0:1762166975.676030:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1973 00002000:00010000:3.0:1762166975.676031:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 328 -> 328 00002000:00010000:0.0:1762166975.676037:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:0.0:1762166975.676041:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc558b800 with x1847765450327552 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166975.676047:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc558b800. 00000100:00100000:3.0:1762166975.676061:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+28:2419:x1847765450327424:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 219us (415us total) trans 17179876172 rc 0/0 00000100:00100000:3.0:1762166975.676068:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1974 00002000:00010000:3.0:1762166975.676072:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (250794->18446744073709551615) 00002000:00100000:3.0:1762166975.676076:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc558bb80 with x1847765450327424 ext(250794->18446744073709551615) 00002000:00010000:3.0:1762166975.676080:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc558bb80. 00002000:00010000:2.0:1762166975.676580:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166975.676584:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166975 -> 1762166975 00002000:00010000:2.0:1762166975.676587:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00002000:00010000:2.0:1762166975.676589:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166975 -> 1762166975 00002000:00010000:2.0:1762166975.676591:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1762166975.676621:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+28:2419:x1847765450327680:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 760us (952us total) trans 17179876173 rc 0/0 00000100:00100000:2.0:1762166975.676628:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1975 00002000:00010000:2.0:1762166975.676631:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:2.0:1762166975.676634:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc558a300 with x1847765450327680 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166975.676638:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc558a300. 00000100:00100000:0.0:1762166975.677730:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450327808 00000100:00100000:0.0:1762166975.677737:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450327808 00000100:00100000:0.0:1762166975.677768:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30225 00000100:00100000:0.0:1762166975.677777:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcceb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+528:61766:x1847765450327808:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:0.0:1762166975.677787:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166975.677799:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effba9b41 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e96d8 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.677864:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effba9b48 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166975.677875:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effba9b48 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.677884:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effba9b48 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:0.0:1762166975.677905:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 250794 00000004:00200000:0.0:1762166975.677909:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166975.677938:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effba9b48 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.677962:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effba9b41 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e96d8 expref: 530 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.677976:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effba9b48 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e96d8 expref: 529 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.677984:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166975.677987:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166975.677990:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdee00, rc 0) 00000100:00100000:0.0:1762166975.678022:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcceb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+529:61766:x1847765450327808:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 246us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166975.678030:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30225 00000100:00100000:0.0:1762166975.679723:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166975.679788:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450327936 00000100:00100000:2.0:1762166975.679802:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450327936 00000100:00100000:2.0:1762166975.679881:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1976 00000100:00100000:2.0:1762166975.679895:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+28:2419:x1847765450327936:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:2.0:1762166975.680159:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 250794 -> 250794 00002000:00010000:2.0:1762166975.680163:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166975 -> 1762166975 00002000:00010000:2.0:1762166975.680165:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00002000:00010000:2.0:1762166975.680168:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166975 -> 1762166975 00002000:00010000:2.0:1762166975.680171:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 328 -> 328 00000100:00100000:2.0:1762166975.680233:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+29:2419:x1847765450327936:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 343us (513us total) trans 17179876174 rc 0/0 00000100:00100000:2.0:1762166975.680247:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1976 00000100:00100000:2.0:1762166975.682127:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450328064 00000100:00100000:2.0:1762166975.682138:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450328064 00000100:00100000:2.0:1762166975.682199:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1977 00000100:00100000:2.0:1762166975.682211:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcceb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+29:2419:x1847765450328064:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:2.0:1762166975.682412:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 250794 -> 250794 00002000:00010000:2.0:1762166975.682416:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166975 -> 1762166975 00002000:00010000:2.0:1762166975.682418:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00002000:00010000:2.0:1762166975.682420:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166975 -> 1762166975 00002000:00010000:2.0:1762166975.682422:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 328 -> 408 00000100:00100000:2.0:1762166975.682475:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcceb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+30:2419:x1847765450328064:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 267us (408us total) trans 17179876175 rc 0/0 00000100:00100000:2.0:1762166975.682522:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1977 00000100:00100000:2.0:1762166975.684374:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450328192 00000100:00100000:2.0:1762166975.684382:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450328192 00000100:00100000:2.0:1762166975.684424:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1978 00000100:00100000:2.0:1762166975.684433:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcceb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+30:2418:x1847765450328192:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:2.0:1762166975.684726:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 250794 -> 250794 00002000:00010000:2.0:1762166975.684729:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166975 -> 1762166975 00002000:00010000:2.0:1762166975.684732:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00002000:00010000:2.0:1762166975.684734:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166975 -> 1762166975 00002000:00010000:2.0:1762166975.684736:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 408 -> 400 00000100:00100000:2.0:1762166975.684777:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcceb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+31:2418:x1847765450328192:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 346us (458us total) trans 17179876176 rc 0/0 00000100:00100000:2.0:1762166975.684787:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1978 00000100:00100000:0.0:1762166975.686316:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166975.686364:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450328320 00000100:00100000:2.0:1762166975.686369:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450328320 00000100:00100000:2.0:1762166975.686405:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1979 00000100:00100000:2.0:1762166975.686414:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+31:2417:x1847765450328320:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:2.0:1762166975.686587:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 250794 -> 250794 00002000:00010000:2.0:1762166975.686591:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166975 -> 1762166975 00002000:00010000:2.0:1762166975.686594:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00002000:00010000:2.0:1762166975.686596:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166975 -> 1762166975 00002000:00010000:2.0:1762166975.686598:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 400 -> 416 00000100:00100000:2.0:1762166975.686634:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+32:2417:x1847765450328320:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 221us (319us total) trans 17179876177 rc 0/0 00000100:00100000:2.0:1762166975.686642:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1979 00000100:00100000:2.0:1762166975.688355:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450328448 00000100:00100000:2.0:1762166975.688365:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450328448 00000100:00100000:2.0:1762166975.688434:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1980 00000100:00100000:2.0:1762166975.688445:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcceb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+32:2418:x1847765450328448:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:2.0:1762166975.688765:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 250794 -> 250794 00002000:00010000:2.0:1762166975.688769:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166975 -> 1762166975 00002000:00010000:2.0:1762166975.688772:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00002000:00010000:2.0:1762166975.688774:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166975 -> 1762166975 00002000:00010000:2.0:1762166975.688777:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 416 -> 384 00000100:00100000:2.0:1762166975.688830:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcceb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+33:2418:x1847765450328448:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 386us (550us total) trans 17179876178 rc 0/0 00000100:00100000:2.0:1762166975.688838:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1980 00000100:00100000:3.0:1762166975.692459:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450328704 00000100:00100000:3.0:1762166975.692472:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450328704 00000100:00100000:3.0:1762166975.692563:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11780 00000100:00100000:3.0:1762166975.692574:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcceb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+529:61766:x1847765450328704:12345-192.168.204.38@tcp:35:fsx.0 00000100:00100000:3.0:1762166975.692960:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcceb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+530:61766:x1847765450328704:12345-192.168.204.38@tcp:35:fsx.0 Request processed in 386us (596us total) trans 4294991802 rc 0/0 00000100:00100000:3.0:1762166975.692970:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11780 00000100:00100000:0.0:1762166975.701884:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166975.701982:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450328960 00000100:00100000:2.0:1762166975.701998:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450328960 00000100:00100000:2.0:1762166975.702081:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30226 00000100:00100000:2.0:1762166975.702093:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+530:61834:x1847765450328960:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166975.702129:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166975.702163:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effba9b4f lrc: 2/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e96df expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.702274:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effba9b56 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166975.702290:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effba9b56 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.702303:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effba9b56 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.702316:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effba9b5d lrc: 3/1,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166975.702324:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effba9b5d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.702331:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effba9b5d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.702531:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effba9b64 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166975.702542:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effba9b64 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.702550:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effba9b64 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:2.0:1762166975.702562:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 250794 00010000:00010000:2.0:1762166975.702665:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effba9b56 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.702674:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effba9b56 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.702686:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effba9b56 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.702699:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effba9b56 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.702706:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa8800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166975.702710:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effba9b56 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.702718:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effba9b56 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.702732:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0x0 (ffff945bc809bb00) 00010000:00010000:2.0:1762166975.702736:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166975.702741:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effba9b56 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.702747:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effba9b56 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.702763:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effba9b5d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.702769:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effba9b5d lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.702774:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effba9b5d lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.702779:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa8000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166975.702782:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effba9b5d lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.702792:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effba9b5d lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.702799:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0xdd396665 (ffff945bc809bf00) 00010000:00010000:2.0:1762166975.702801:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166975.702804:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effba9b5d lrc: 2/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.702809:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effba9b5d lrc: 0/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.702859:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effba9b4f lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e96df expref: 533 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.702878:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effba9b64 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e96df expref: 532 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.702886:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166975.702888:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166975.702891:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa8200, rc 0) 00000100:00100000:2.0:1762166975.702988:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+532:61834:x1847765450328960:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 897us (1116us total) trans 4294991803 rc 0/0 00000100:00100000:2.0:1762166975.702996:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30226 00000100:00100000:3.0:1762166975.705637:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450329344 00000100:00100000:2.0:1762166975.705641:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450329088 00000100:00100000:3.0:1762166975.705648:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450329344 00000100:00100000:2.0:1762166975.705648:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450329088 00000100:00100000:3.0:1762166975.705703:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11781 00000100:00100000:3.0:1762166975.705718:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcceb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+533:61834:x1847765450329344:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:2.0:1762166975.705718:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 856 00000100:00100000:2.0:1762166975.705731:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcceb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+533:2419:x1847765450329088:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166975.705751:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166975.705777:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effba9b64 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e96df expref: 533 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.705799:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166975.705805:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166975.705860:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcceb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+533:2419:x1847765450329088:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 133us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166975.705868:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 856 00000100:00100000:3.0:1762166975.705923:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcceb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+532:61834:x1847765450329344:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 201us (369us total) trans 4294991804 rc 0/0 00000100:00100000:3.0:1762166975.705931:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11781 00000100:00100000:3.0:1762166975.709215:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.715413:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.718253:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166975.718321:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450329984 00000100:00100000:2.0:1762166975.718329:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450329984 00010000:00010000:2.0:1762166975.718363:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effba9b48 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e96d8 expref: 536 pid: 6495 timeout: 694 lvb_type: 0 00000100:00100000:2.0:1762166975.718412:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9463 00000100:00100000:2.0:1762166975.718422:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+536:2419:x1847765450329984:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166975.718436:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166975.718443:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effba9b48 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e96d8 expref: 536 pid: 6495 timeout: 694 lvb_type: 0 00010000:00010000:2.0:1762166975.718456:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effba9b48 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e96d8 expref: 536 pid: 6495 timeout: 694 lvb_type: 0 00010000:00010000:2.0:1762166975.718497:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effba9b48 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e96d8 expref: 536 pid: 6495 timeout: 694 lvb_type: 0 00010000:00010000:2.0:1762166975.718513:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166975.718519:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7aa00/0x2f180c4effba9b8e lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166975.718533:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7aa00/0x2f180c4effba9b8e lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166975.718541:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7aa00/0x2f180c4effba9b8e lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166975.718565:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166975.718625:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+535:2419:x1847765450329984:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 202us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166975.718636:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9463 00000100:00100000:0.0:1762166975.720555:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166975.722070:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.724848:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.726971:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.728883:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166975.728955:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450331008 00000100:00100000:2.0:1762166975.728961:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450331008 00010000:00010000:2.0:1762166975.728995:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effba9b3a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e96d1 expref: 537 pid: 6495 timeout: 694 lvb_type: 0 00000100:00100000:2.0:1762166975.729032:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9464 00000100:00100000:2.0:1762166975.729041:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf9d1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+537:2418:x1847765450331008:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166975.729057:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166975.729065:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effba9b3a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e96d1 expref: 537 pid: 6495 timeout: 694 lvb_type: 0 00010000:00010000:2.0:1762166975.729077:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effba9b3a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e96d1 expref: 537 pid: 6495 timeout: 694 lvb_type: 0 00010000:00010000:2.0:1762166975.729101:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effba9b3a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e96d1 expref: 537 pid: 6495 timeout: 694 lvb_type: 0 00010000:00010000:2.0:1762166975.729119:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166975.729125:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7b600/0x2f180c4effba9bb1 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166975.729133:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7b600/0x2f180c4effba9bb1 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166975.729139:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166975.729156:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166975.729189:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf9d1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+536:2418:x1847765450331008:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 148us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166975.729199:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9464 00000100:00100000:3.0:1762166975.729209:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450331136 00000100:00100000:3.0:1762166975.729216:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450331136 00010000:00010000:3.0:1762166975.729242:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eeaa00/0x2f180c4effba94cd lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e945b expref: 536 pid: 6495 timeout: 694 lvb_type: 0 00000100:00100000:2.0:1762166975.729261:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9465 00000100:00100000:2.0:1762166975.729272:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945d011ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+536:2418:x1847765450331136:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166975.729280:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166975.729286:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eeaa00/0x2f180c4effba94cd lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e945b expref: 536 pid: 6495 timeout: 694 lvb_type: 0 00010000:00010000:2.0:1762166975.729296:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eeaa00/0x2f180c4effba94cd lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e945b expref: 536 pid: 6495 timeout: 694 lvb_type: 0 00010000:00010000:2.0:1762166975.729308:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eeaa00/0x2f180c4effba94cd lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e945b expref: 536 pid: 6495 timeout: 694 lvb_type: 0 00010000:00010000:2.0:1762166975.729318:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166975.729322:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7b600/0x2f180c4effba9bb1 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166975.729329:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7b600/0x2f180c4effba9bb1 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166975.729337:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7b600/0x2f180c4effba9bb1 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166975.729359:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166975.729391:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945d011ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+535:2418:x1847765450331136:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 121us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166975.729406:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9465 00000100:00100000:0.0:1762166975.730819:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166975.732871:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.735360:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.737284:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166975.738955:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166975.739060:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450332160 00000100:00100000:2.0:1762166975.739066:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450332160 00010000:00010000:2.0:1762166975.739094:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7a600/0x2f180c4effba9bb8 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e96fb expref: 540 pid: 6494 timeout: 694 lvb_type: 0 00000100:00100000:2.0:1762166975.739133:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9466 00000100:00100000:2.0:1762166975.739142:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5589180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+540:2418:x1847765450332160:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166975.739154:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166975.739162:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7a600/0x2f180c4effba9bb8 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e96fb expref: 540 pid: 6494 timeout: 694 lvb_type: 0 00010000:00010000:2.0:1762166975.739173:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7a600/0x2f180c4effba9bb8 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e96fb expref: 540 pid: 6494 timeout: 694 lvb_type: 0 00010000:00010000:2.0:1762166975.739189:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7a600/0x2f180c4effba9bb8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e96fb expref: 540 pid: 6494 timeout: 694 lvb_type: 0 00010000:00010000:2.0:1762166975.739202:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166975.739207:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4e00/0x2f180c4effba9be9 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166975.739221:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4e00/0x2f180c4effba9be9 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166975.739233:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4e00/0x2f180c4effba9be9 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166975.739255:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166975.739300:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5589180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+539:2418:x1847765450332160:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 156us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166975.739312:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9466 00000100:00100000:3.0:1762166975.740618:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166975.740702:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450332288 00000100:00100000:2.0:1762166975.740716:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450332288 00010000:00010000:2.0:1762166975.740752:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7aa00/0x2f180c4effba9bc6 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x606:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9702 expref: 539 pid: 6494 timeout: 694 lvb_type: 0 00000100:00100000:2.0:1762166975.740795:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9467 00000100:00100000:2.0:1762166975.740804:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5589c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+539:2418:x1847765450332288:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166975.740819:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166975.740826:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7aa00/0x2f180c4effba9bc6 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x606:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9702 expref: 539 pid: 6494 timeout: 694 lvb_type: 0 00010000:00010000:2.0:1762166975.740842:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7aa00/0x2f180c4effba9bc6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x606:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9702 expref: 539 pid: 6494 timeout: 694 lvb_type: 0 00010000:00010000:2.0:1762166975.740864:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7aa00/0x2f180c4effba9bc6 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x606:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9702 expref: 539 pid: 6494 timeout: 694 lvb_type: 0 00010000:00010000:2.0:1762166975.740880:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x606:0x0].0x0 (ffff945bc812e500) 00010000:00010000:2.0:1762166975.740885:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7b000/0x2f180c4effba9bf0 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x606:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166975.740897:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7b000/0x2f180c4effba9bf0 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x606:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166975.740905:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7b000/0x2f180c4effba9bf0 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x606:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166975.740948:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166975.741006:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5589c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+538:2418:x1847765450332288:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 199us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166975.741028:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9467 00000100:00100000:2.0:1762166975.741579:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449682304 00000100:00100000:2.0:1762166975.741586:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449682304 00000100:00100000:2.0:1762166975.741633:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1290 00000100:00100000:2.0:1762166975.741641:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcceb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+15:19593:x1847765449682304:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762166975.741752:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcceb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+15:19593:x1847765449682304:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 112us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166975.741760:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1290 00000100:00100000:2.0:1762166975.741931:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449682432 00000100:00100000:2.0:1762166975.741938:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449682432 00000100:00100000:2.0:1762166975.741984:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1291 00000100:00100000:2.0:1762166975.741993:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcceb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+15:19593:x1847765449682432:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762166975.742076:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcceb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+15:19593:x1847765449682432:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 84us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166975.742084:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1291 00000100:00100000:2.0:1762166975.742202:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449682560 00000100:00100000:2.0:1762166975.742207:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449682560 00000100:00100000:2.0:1762166975.742232:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1292 00000100:00100000:2.0:1762166975.742238:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcceb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+15:19593:x1847765449682560:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762166975.742293:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcceb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+15:19593:x1847765449682560:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 55us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166975.742300:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1292 00000100:00100000:2.0:1762166975.742383:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449682688 00000100:00100000:2.0:1762166975.742387:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449682688 00000100:00100000:2.0:1762166975.742412:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1293 00000100:00100000:2.0:1762166975.742418:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcceb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+15:19593:x1847765449682688:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762166975.742474:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcceb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+15:19593:x1847765449682688:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 56us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166975.742503:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1293 00000100:00100000:2.0:1762166975.742605:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449682816 00000100:00100000:2.0:1762166975.742610:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449682816 00000100:00100000:2.0:1762166975.742635:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1294 00000100:00100000:2.0:1762166975.742641:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4492680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+15:19593:x1847765449682816:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762166975.742693:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4492680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+15:19593:x1847765449682816:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 52us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166975.742701:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1294 00000100:00100000:2.0:1762166975.742798:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449682944 00000100:00100000:2.0:1762166975.742803:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449682944 00000100:00100000:2.0:1762166975.742832:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1295 00000100:00100000:2.0:1762166975.742839:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+15:19593:x1847765449682944:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762166975.742888:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+15:19593:x1847765449682944:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 49us (108us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166975.742896:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1295 00000100:00100000:3.0:1762166975.743056:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449683072 00000100:00100000:3.0:1762166975.743061:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449683072 00000100:00100000:3.0:1762166975.743092:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1296 00000100:00100000:3.0:1762166975.743098:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+15:19593:x1847765449683072:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166975.743152:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+15:19593:x1847765449683072:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 53us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166975.743158:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1296 00000100:00100000:3.0:1762166975.743275:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449683200 00000100:00100000:3.0:1762166975.743279:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449683200 00000100:00100000:3.0:1762166975.743302:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1297 00000100:00100000:3.0:1762166975.743308:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+15:19593:x1847765449683200:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166975.743353:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+15:19593:x1847765449683200:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 45us (115us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166975.743361:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1297 00000100:00100000:3.0:1762166975.743679:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449683328 00000100:00100000:3.0:1762166975.743684:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449683328 00000100:00100000:3.0:1762166975.743723:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1298 00000100:00100000:3.0:1762166975.743735:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+15:19593:x1847765449683328:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166975.743836:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+16:19593:x1847765449683328:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 105us (204us total) trans 17179876179 rc 0/0 00000100:00100000:3.0:1762166975.743843:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1298 00000100:00100000:3.0:1762166975.743954:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449683456 00000100:00100000:3.0:1762166975.743959:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449683456 00000100:00100000:3.0:1762166975.743991:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1299 00000100:00100000:3.0:1762166975.743997:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+15:19593:x1847765449683456:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166975.744090:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+16:19593:x1847765449683456:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 92us (184us total) trans 21474843171 rc 0/0 00000100:00100000:3.0:1762166975.744097:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1299 00000100:00100000:3.0:1762166975.746111:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.748284:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:3.0:1762166975.749157:0:7420:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1762166975.749165:0:7420:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7b600/0x2f180c4effba9bfe lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x606:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166975.749174:0:7420:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8c7b600 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166975.749178:0:7420:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7b600/0x2f180c4effba9bfe lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x606:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166975.749187:0:7420:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7b600/0x2f180c4effba9bfe lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x606:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166975.749201:0:7420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x606:0x0].0x0 (ffff945bc812e200) 00010000:00010000:3.0:1762166975.749205:0:7420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1762166975.749209:0:7420:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7b600/0x2f180c4effba9bfe lrc: 1/0,0 mode: --/PW res: [0x240000404:0x606:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166975.749216:0:7420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7b600/0x2f180c4effba9bfe lrc: 0/0,0 mode: --/PW res: [0x240000404:0x606:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166975.749234:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166975.749237:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166975.749239:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166975.750715:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166975.760629:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166975.762627:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945d011e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765449683712:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1762166975.762633:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449683840:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1762166975.762686:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166975.762693:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166975.762751:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1e6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3636:1847765449684352:0@lo:400:kworker.0 00000100:00100000:2.0:1762166975.762756:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1e6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449684224:0@lo:400:kworker.0 00000100:00100000:3.0:1762166975.762780:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449683840 00000100:00100000:3.0:1762166975.762787:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449683840 00000100:00100000:0.0:1762166975.762792:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166975.762800:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166975.762827:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1e6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1847765449684864:0@lo:400:kworker.0 00000100:00100000:2.0:1762166975.762830:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1e6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3635:1847765449684736:0@lo:400:kworker.0 00000100:00100000:3.0:1762166975.762833:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449683584 00000100:00100000:3.0:1762166975.762838:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449683584 00000100:00100000:3.0:1762166975.762859:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449684224 00000100:00100000:3.0:1762166975.762864:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449684224 00000100:00100000:0.0:1762166975.762865:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166975.762878:0:8384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449683712 00000100:00100000:2.0:1762166975.762884:0:8384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449683712 00000100:00100000:3.0:1762166975.762888:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1300 00000100:00100000:0.0:1762166975.762900:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1e6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3636:1847765449685376:0@lo:400:kworker.0 00000100:00100000:3.0:1762166975.762903:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945d011e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:3636:x1847765449683840:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1762166975.762945:0:6499:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445859328 avail 1299619840 00000100:00100000:2.0:1762166975.762953:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1762166975.762955:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166975.762968:0:8384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1847765449683712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1762166975.762985:0:8384:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 484840768 pending 0 free 3920900096 avail 3688058880 00000100:00100000:0.0:1762166975.763000:0:32221:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449684096 00000100:00100000:3.0:1762166975.763005:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945d011e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:3636:x1847765449683840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 106us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166975.763006:0:32221:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449684096 00000100:00100000:3.0:1762166975.763016:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1300 00000100:00100000:2.0:1762166975.763032:0:8384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1847765449683712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166975.763041:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1301 00000100:00100000:2.0:1762166975.763042:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:3.0:1762166975.763057:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1847765449683584:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1762166975.763064:0:32221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1762166975.763075:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1302 00000004:00000024:3.0:1762166975.763078:0:6499:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445273600 avail 1299034112 00000100:00100000:0.0:1762166975.763078:0:32221:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc34e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5309af7-bf8a-40d1-8f22-842c4953c1ea+23:3634:x1847765449684096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1762166975.763090:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3635:x1847765449684224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1762166975.763127:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1847765449683584:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166975.763136:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1301 00000100:00100000:0.0:1762166975.763141:0:32221:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc34e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5309af7-bf8a-40d1-8f22-842c4953c1ea+23:3634:x1847765449684096:12345-0@lo:400:kworker.0 Request processed in 67us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166975.763149:0:32221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1762166975.763154:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3635:x1847765449684224:12345-0@lo:400:kworker.0 Request processed in 67us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166975.763167:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449684992 00000100:00100000:2.0:1762166975.763167:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1302 00000100:00100000:3.0:1762166975.763173:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449684992 00000100:00100000:2.0:1762166975.763196:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1303 00000100:00100000:0.0:1762166975.763197:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166975.763211:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3634:x1847765449684992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1762166975.763227:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1e6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765449685248:0@lo:400:kworker.0 00000100:00100000:3.0:1762166975.763240:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449684352 00000100:00100000:3.0:1762166975.763245:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449684352 00000100:00100000:2.0:1762166975.763253:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3634:x1847765449684992:12345-0@lo:400:kworker.0 Request processed in 46us (96us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166975.763267:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1303 00000100:00100000:0.0:1762166975.763267:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166975.763270:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449684864 00000100:00100000:3.0:1762166975.763274:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449684864 00000100:00100000:3.0:1762166975.763303:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449684480 00000100:00100000:2.0:1762166975.763303:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449685376 00000100:00100000:3.0:1762166975.763310:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449684480 00000100:00100000:2.0:1762166975.763310:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449685376 00000100:00100000:0.0:1762166975.763312:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945d011e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765449683712:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1762166975.763341:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1e6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449684224:0@lo:400:kworker.0 00000100:00100000:2.0:1762166975.763345:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 656 00000100:00100000:2.0:1762166975.763360:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945d011eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1847765449684352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1762166975.763377:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 657 00000100:00100000:0.0:1762166975.763388:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945d011ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1847765449684864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1762166975.763398:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945d011eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1847765449684352:12345-0@lo:400:kworker.0 Request processed in 41us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166975.763407:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 656 00000100:00100000:3.0:1762166975.763427:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 659 00000100:00100000:2.0:1762166975.763434:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 660 00000100:00100000:0.0:1762166975.763434:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945d011ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1847765449684864:12345-0@lo:400:kworker.0 Request processed in 48us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166975.763440:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945d011eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1847765449685376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1762166975.763450:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945d011e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1847765449684736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1762166975.763464:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 657 00000100:00100000:3.0:1762166975.763508:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945d011eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1847765449685376:12345-0@lo:400:kworker.0 Request processed in 72us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166975.763516:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 661 00000100:00100000:3.0:1762166975.763525:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 659 00000100:00100000:0.0:1762166975.763531:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1847765449684480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1762166975.763532:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945d011e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1847765449684736:12345-0@lo:400:kworker.0 Request processed in 82us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166975.763547:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 660 00000100:00080000:3.0:1762166975.763550:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1762166975.763557:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1762166975.763561:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1762166975.763580:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1847765449684480:12345-0@lo:400:kworker.0 Request processed in 56us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166975.763581:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449685120 00000100:00100000:2.0:1762166975.763587:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449685120 00000100:00100000:0.0:1762166975.763592:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 661 00000100:00100000:3.0:1762166975.763600:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449685248 00000100:00100000:3.0:1762166975.763607:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449685248 00000100:00100000:0.0:1762166975.763621:0:9167:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449683968 00000100:00100000:0.0:1762166975.763628:0:9167:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449683968 00000100:00100000:2.0:1762166975.763639:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:3.0:1762166975.763647:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:2.0:1762166975.763653:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcceb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3634:x1847765449685120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1762166975.763661:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945d011e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1847765449685248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1762166975.763668:0:9167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1762166975.763678:0:9167:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3633:x1847765449683968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1762166975.763697:0:9167:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 49152 granted 484889920 pending 0 free 3918098432 avail 3686133760 00000100:00100000:2.0:1762166975.763704:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcceb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3634:x1847765449685120:12345-0@lo:400:kworker.0 Request processed in 55us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166975.763712:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:3.0:1762166975.763720:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945d011e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1847765449685248:12345-0@lo:400:kworker.0 Request processed in 62us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166975.763735:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:0.0:1762166975.763747:0:9167:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1847765449683968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (210us total) trans 0 rc 0/0 00000100:00080000:2.0:1762166975.763748:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1762166975.763756:0:9167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1762166975.763781:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1e6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3636:1847765449684352:0@lo:400:kworker.0 00000100:00100000:2.0:1762166975.763787:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1e6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765449685120:0@lo:400:kworker.0 00000100:00100000:3.0:1762166975.763803:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1e6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1847765449684864:0@lo:400:kworker.0 00000100:00100000:3.0:1762166975.763831:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1e6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3636:1847765449685376:0@lo:400:kworker.0 00000100:00100000:0.0:1762166975.763834:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166975.763849:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449683840:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1762166975.765836:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166975.767607:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166975.767693:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450333696 00000100:00100000:3.0:1762166975.767702:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450333696 00000100:00100000:3.0:1762166975.767750:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 857 00000100:00100000:3.0:1762166975.767757:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+548:61835:x1847765450333696:12345-192.168.204.38@tcp:103:lfs.0 00010000:00010000:3.0:1762166975.767770:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166975.767791:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5ae4a00/0x2f180c4effba9c3d lrc: 0/0,0 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9725 expref: 548 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.767805:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166975.767809:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166975.767846:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+547:61835:x1847765450333696:12345-192.168.204.38@tcp:103:lfs.0 Request processed in 90us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166975.767852:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 857 00000100:00100000:0.0:1762166975.768516:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.770808:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.773035:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166975.773150:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450334336 00000100:00100000:3.0:1762166975.773158:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450334336 00010000:00010000:3.0:1762166975.773194:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7aa00/0x2f180c4effba9c1a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9717 expref: 550 pid: 6494 timeout: 694 lvb_type: 0 00000100:00100000:3.0:1762166975.773232:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9468 00000100:00100000:3.0:1762166975.773241:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945d011e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+550:2419:x1847765450334336:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166975.773254:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166975.773262:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7aa00/0x2f180c4effba9c1a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9717 expref: 550 pid: 6494 timeout: 694 lvb_type: 0 00010000:00010000:3.0:1762166975.773276:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7aa00/0x2f180c4effba9c1a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9717 expref: 550 pid: 6494 timeout: 694 lvb_type: 0 00010000:00010000:3.0:1762166975.773301:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7aa00/0x2f180c4effba9c1a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9717 expref: 550 pid: 6494 timeout: 694 lvb_type: 0 00010000:00010000:3.0:1762166975.773318:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166975.773324:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7a600/0x2f180c4effba9c52 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166975.773334:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7a600/0x2f180c4effba9c52 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166975.773342:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7a600/0x2f180c4effba9c52 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166975.773372:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166975.773411:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945d011e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+549:2419:x1847765450334336:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 171us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166975.773419:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9468 00000100:00100000:0.0:1762166975.775120:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.776972:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166975.777086:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450334592 00000100:00100000:3.0:1762166975.777093:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450334592 00010000:00010000:3.0:1762166975.777122:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7a600/0x2f180c4effba9c52 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e972c expref: 551 pid: 6495 timeout: 694 lvb_type: 0 00000100:00100000:3.0:1762166975.777163:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9469 00000100:00100000:3.0:1762166975.777175:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc70b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+551:2418:x1847765450334592:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166975.777191:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166975.777198:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7a600/0x2f180c4effba9c52 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e972c expref: 551 pid: 6495 timeout: 694 lvb_type: 0 00010000:00010000:3.0:1762166975.777211:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7a600/0x2f180c4effba9c52 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e972c expref: 551 pid: 6495 timeout: 694 lvb_type: 0 00010000:00010000:3.0:1762166975.777235:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7a600/0x2f180c4effba9c52 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e972c expref: 551 pid: 6495 timeout: 694 lvb_type: 0 00010000:00010000:3.0:1762166975.777257:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166975.777262:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7b600/0x2f180c4effba9c67 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166975.777271:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7b600/0x2f180c4effba9c67 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166975.777279:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7b600/0x2f180c4effba9c67 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166975.777304:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166975.777355:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc70b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+550:2418:x1847765450334592:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 182us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166975.777364:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9469 00000100:00100000:0.0:1762166975.780343:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166975.791191:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.794143:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166975.794193:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450335232 00000100:00100000:3.0:1762166975.794204:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450335232 00000100:00100000:0.0:1762166975.794234:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166975.794283:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 858 00000100:00100000:3.0:1762166975.794299:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf9d1f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+552:2419:x1847765450335232:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166975.794317:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166975.794401:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7aa00/0x2f180c4effba9c83 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e973a expref: 553 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.794430:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166975.794440:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166975.794543:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf9d1f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+553:2419:x1847765450335232:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 249us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166975.794553:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 858 00000100:00100000:0.0:1762166975.796405:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.798063:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166975.798119:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450335872 00000100:00100000:3.0:1762166975.798131:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450335872 00010000:00010000:3.0:1762166975.798219:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63400/0x2f180c4effba9c98 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x607:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9741 expref: 555 pid: 6495 timeout: 694 lvb_type: 0 00000100:00100000:3.0:1762166975.798256:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9470 00000100:00100000:3.0:1762166975.798267:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc70b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+555:2419:x1847765450335872:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166975.798282:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166975.798289:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63400/0x2f180c4effba9c98 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x607:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9741 expref: 555 pid: 6495 timeout: 694 lvb_type: 0 00010000:00010000:3.0:1762166975.798302:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63400/0x2f180c4effba9c98 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x607:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9741 expref: 555 pid: 6495 timeout: 694 lvb_type: 0 00010000:00010000:3.0:1762166975.798334:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63400/0x2f180c4effba9c98 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x607:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9741 expref: 555 pid: 6495 timeout: 694 lvb_type: 0 00010000:00010000:3.0:1762166975.798350:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x607:0x0].0x0 (ffff945bc812e700) 00010000:00010000:3.0:1762166975.798355:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62000/0x2f180c4effba9cad lrc: 3/0,1 mode: --/EX res: [0x240000404:0x607:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166975.798363:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62000/0x2f180c4effba9cad lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x607:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166975.798369:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62000/0x2f180c4effba9cad lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x607:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166975.798407:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166975.798513:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc70b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+554:2419:x1847765450335872:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 208us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166975.798541:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9470 00000100:00100000:0.0:1762166975.800519:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.802178:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166975.803976:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166975.804028:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166975.804071:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450336384 00000100:00100000:3.0:1762166975.804083:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450336384 00000100:00100000:0.0:1762166975.804104:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450336512 00000100:00100000:0.0:1762166975.804113:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450336512 00000100:00100000:3.0:1762166975.804159:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18736 00000100:00100000:3.0:1762166975.804174:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450336384:12345-192.168.204.38@tcp:101:lfs.0 00000100:00100000:0.0:1762166975.804185:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18737 00010000:00010000:3.0:1762166975.804194:0:8383:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1762166975.804200:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+33:2418:x1847765450336512:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166975.804213:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166975.804218:0:8383:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc8473a00/0x2f180c4effba9cc9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9756 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.804229:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde000/0x2f180c4effba9cd0 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa87:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e975d expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166975.804247:0:8383:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa88:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:0.0:1762166975.804247:0:28434:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa87:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1762166975.804280:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166975.804282:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166975.804283:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166975.804290:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166975.804296:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde000/0x2f180c4effba9cd0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e975d expref: 34 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166975.804306:0:8383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8473a00/0x2f180c4effba9cc9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9756 expref: 23 pid: 8383 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166975.804325:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde000/0x2f180c4effba9cd0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e975d expref: 34 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166975.804336:0:8383:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc8473a00/0x2f180c4effba9cc9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9756 expref: 23 pid: 8383 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166975.804342:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bde000, rc 0) 00010000:00010000:3.0:1762166975.804352:0:8383:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8473a00, rc 0) 00000100:00100000:0.0:1762166975.804390:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+34:2418:x1847765450336512:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 194us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166975.804395:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765450336384:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 225us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166975.804415:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18736 00000100:00100000:0.0:1762166975.804424:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18737 00000100:00100000:0.0:1762166975.805744:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.808533:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450336896 00000100:00100000:0.0:1762166975.808544:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450336896 00000100:00100000:0.0:1762166975.808602:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450337024 00000100:00100000:0.0:1762166975.808607:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450337024 00000100:00100000:2.0:1762166975.808636:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18738 00000100:00100000:2.0:1762166975.808654:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+35:2416:x1847765450336896:12345-192.168.204.38@tcp:1:lfs.0 00000100:00100000:0.0:1762166975.808666:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18739 00000100:00100000:0.0:1762166975.808682:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+23:2416:x1847765450337024:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:2.0:1762166975.808687:0:9168:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9800/0x2f180c4effba9cec lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.808718:0:9168:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde400/0x2f180c4effba9b10 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e96b5 expref: 35 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.808725:0:28434:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf800/0x2f180c4effba9cfa lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.808753:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166975.808760:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166975.808761:0:28434:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8c00/0x2f180c4effba9b17 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e96bc expref: 23 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.808774:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9800/0x2f180c4effba9cec lrc: 4/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.808809:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166975.808815:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166975.808822:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf800/0x2f180c4effba9cfa lrc: 4/1,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.808865:0:9168:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde400/0x2f180c4effba9b10 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e96b5 expref: 35 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.808881:0:28434:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8c00/0x2f180c4effba9b17 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e96bc expref: 23 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.808889:0:9168:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde400/0x2f180c4effba9b10 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e96b5 expref: 35 pid: 35472 timeout: 694 lvb_type: 0 00010000:00010000:0.0:1762166975.808952:0:28434:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8c00/0x2f180c4effba9b17 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e96bc expref: 23 pid: 35472 timeout: 694 lvb_type: 0 00000100:00100000:2.0:1762166975.808965:0:9168:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bc1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9168:1847765449685888:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166975.809005:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc70b3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765449686144:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166975.809085:0:9168:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf3a33780 going to sleep for 11 seconds 00000100:00100000:0.0:1762166975.809086:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bca7930c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166975.810460:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc70b3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765449686144:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166975.810508:0:28434:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf800/0x2f180c4effba9cfa lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166975.810567:0:35472:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79ea680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:35472:1847765449686016:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166975.810584:0:35472:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62600/0x2f180c4effba9cf3 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166975.810696:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450337408 00000100:00100000:3.0:1762166975.810704:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450337408 00000100:00100000:2.0:1762166975.810727:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450337280 00000100:00100000:2.0:1762166975.810734:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450337280 00010000:00010000:3.0:1762166975.810739:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8600/0x2f180c4effba9b1e lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e96c3 expref: 36 pid: 35472 timeout: 694 lvb_type: 0 00010000:00010000:2.0:1762166975.810757:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde400/0x2f180c4effba9b10 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e96b5 expref: 37 pid: 35472 timeout: 694 lvb_type: 0 00000100:00100000:0.0:1762166975.810761:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450337536 00000100:00100000:0.0:1762166975.810767:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450337536 00010000:00010000:0.0:1762166975.810788:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8c00/0x2f180c4effba9b17 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e96bc expref: 24 pid: 35472 timeout: 694 lvb_type: 0 00000100:00100000:3.0:1762166975.810789:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9471 00000100:00100000:2.0:1762166975.810801:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9472 00000100:00100000:3.0:1762166975.810803:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+37:2419:x1847765450337408:12345-192.168.204.38@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1762166975.810814:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+37:2418:x1847765450337280:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166975.810819:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166975.810825:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1762166975.810831:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9473 00000100:00100000:0.0:1762166975.810843:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765450337536:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166975.810847:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8600/0x2f180c4effba9b1e lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e96c3 expref: 37 pid: 35472 timeout: 694 lvb_type: 0 00010000:00010000:2.0:1762166975.810847:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde400/0x2f180c4effba9b10 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e96b5 expref: 37 pid: 35472 timeout: 694 lvb_type: 0 00010000:00010000:0.0:1762166975.810856:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166975.810875:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde400/0x2f180c4effba9b10 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e96b5 expref: 37 pid: 35472 timeout: 694 lvb_type: 0 00010000:00010000:0.0:1762166975.810880:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8c00/0x2f180c4effba9b17 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e96bc expref: 24 pid: 35472 timeout: 694 lvb_type: 0 00010000:00010000:3.0:1762166975.810881:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8600/0x2f180c4effba9b1e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e96c3 expref: 37 pid: 35472 timeout: 694 lvb_type: 0 00010000:00010000:0.0:1762166975.810904:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8c00/0x2f180c4effba9b17 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e96bc expref: 24 pid: 35472 timeout: 694 lvb_type: 0 00010000:00010000:2.0:1762166975.810934:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde400/0x2f180c4effba9b10 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e96b5 expref: 37 pid: 35472 timeout: 694 lvb_type: 0 00010000:00010000:3.0:1762166975.810935:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8600/0x2f180c4effba9b1e lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e96c3 expref: 37 pid: 35472 timeout: 694 lvb_type: 0 00010000:00010000:0.0:1762166975.810935:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8c00/0x2f180c4effba9b17 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e96bc expref: 24 pid: 35472 timeout: 694 lvb_type: 0 00010000:00010000:0.0:1762166975.810969:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166975.810970:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166975.810971:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166975.810972:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166975.810977:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166975.810977:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166975.810978:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf800/0x2f180c4effba9cfa lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.810985:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62600/0x2f180c4effba9cf3 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.810985:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9800/0x2f180c4effba9cec lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.810988:0:6479:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf800/0x2f180c4effba9cfa lrc: 4/1,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.811011:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62600/0x2f180c4effba9cf3 lrc: 4/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.811012:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9800/0x2f180c4effba9cec lrc: 4/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.811030:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166975.811060:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166975.811067:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166975.811080:0:35472:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62600/0x2f180c4effba9cf3 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166975.811090:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765450337536:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 243us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166975.811101:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+35:2418:x1847765450337280:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 283us (424us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166975.811124:0:35472:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62600/0x2f180c4effba9cf3 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166975.811125:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9473 00000100:00100000:2.0:1762166975.811150:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9472 00010000:00010000:3.0:1762166975.811174:0:35472:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62600/0x2f180c4effba9cf3 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.811184:0:35472:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62600/0x2f180c4effba9cf3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.811188:0:9168:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9800/0x2f180c4effba9cec lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.811220:0:35472:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62600/0x2f180c4effba9cf3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.811229:0:9168:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9800/0x2f180c4effba9cec lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.811266:0:35472:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4b62600 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166975.811273:0:35472:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62600/0x2f180c4effba9cf3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.811277:0:9168:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9800/0x2f180c4effba9cec lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.811294:0:9168:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9800/0x2f180c4effba9cec lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.811358:0:35472:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62600/0x2f180c4effba9cf3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.811364:0:9168:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9800/0x2f180c4effba9cec lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.811385:0:9168:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa9800 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166975.811388:0:35472:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62600/0x2f180c4effba9cf3 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.811393:0:9168:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9800/0x2f180c4effba9cec lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.811431:0:35472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62600/0x2f180c4effba9cf3 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.811435:0:9168:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9800/0x2f180c4effba9cec lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.811466:0:9168:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9800/0x2f180c4effba9cec lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.811515:0:9168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9800/0x2f180c4effba9cec lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166975.811574:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+34:2416:x1847765450337152:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 2891us (3006us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166975.811588:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18740 00000100:00100000:2.0:1762166975.811590:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+34:2416:x1847765450336896:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 2938us (3135us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166975.811602:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18738 00000100:00100000:3.0:1762166975.811644:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+32:2419:x1847765450337408:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 839us (1002us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166975.811654:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9471 00000100:00100000:0.0:1762166975.812915:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450337664 00000100:00100000:0.0:1762166975.812923:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450337664 00000100:00100000:0.0:1762166975.812958:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18741 00000100:00100000:0.0:1762166975.812968:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+32:2417:x1847765450337664:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166975.812985:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166975.813005:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effba9d01 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e976b expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166975.813025:0:28434:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa77:0x0] initial LVB size: 250794, mtime: 0x690888bf, atime: 0x690888bf, ctime: 0x690888bf, blocks: 0x180 00010000:00010000:0.0:1762166975.813042:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166975.813045:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166975.813054:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effba9d01 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e976b expref: 33 pid: 28434 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1762166975.813061:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:0.0:1762166975.813078:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effba9d01 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e976b expref: 33 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166975.813092:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdec00, rc 0) 00000100:00100000:2.0:1762166975.813102:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450337792 00000100:00100000:2.0:1762166975.813106:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450337792 00000100:00100000:0.0:1762166975.813168:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+33:2417:x1847765450337664:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 201us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166975.813175:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18741 00000100:00100000:3.0:1762166975.813199:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.813222:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450337920 00000100:00100000:0.0:1762166975.813227:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450337920 00000100:00100000:0.0:1762166975.813254:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18742 00000100:00100000:0.0:1762166975.813262:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+33:2417:x1847765450337920:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166975.813270:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166975.813285:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effba9d08 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9779 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166975.813298:0:28434:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa79:0x0] initial LVB size: 0, mtime: 0x690888bf, atime: 0x690888bf, ctime: 0x690888bf, blocks: 0x0 00010000:00010000:0.0:1762166975.813307:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166975.813309:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166975.813314:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effba9d08 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9779 expref: 34 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166975.813326:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effba9d08 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9779 expref: 34 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166975.813335:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdfe00, rc 0) 00000100:00100000:2.0:1762166975.813364:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18743 00000100:00100000:0.0:1762166975.813374:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+34:2417:x1847765450337920:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 111us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166975.813375:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+22:2416:x1847765450337792:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166975.813387:0:9168:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1762166975.813396:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18742 00010000:00010000:2.0:1762166975.813400:0:9168:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9c00/0x2f180c4effba9d0f lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9772 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166975.813422:0:9168:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa7a:0x0] initial LVB size: 0, mtime: 0x690888bf, atime: 0x690888bf, ctime: 0x690888bf, blocks: 0x1800 00010000:00010000:2.0:1762166975.813432:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166975.813434:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166975.813441:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9c00/0x2f180c4effba9d0f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9772 expref: 23 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166975.813458:0:9168:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9c00/0x2f180c4effba9d0f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9772 expref: 23 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166975.813468:0:9168:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa9c00, rc 0) 00000100:00100000:2.0:1762166975.813501:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+23:2416:x1847765450337792:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 129us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166975.813509:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18743 00000100:00100000:2.0:1762166975.839157:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450338048 00000100:00100000:2.0:1762166975.839166:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450338048 00000100:00100000:2.0:1762166975.839220:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18744 00000100:00100000:2.0:1762166975.839231:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+34:2417:x1847765450338048:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:2.0:1762166975.839350:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+34:2417:x1847765450338048:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 122us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166975.839360:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18744 00000100:00100000:3.0:1762166975.840717:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.842170:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450338432 00000100:00100000:0.0:1762166975.842175:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450338432 00000100:00100000:0.0:1762166975.842203:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30245 00000100:00100000:0.0:1762166975.842209:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+558:61836:x1847765450338432:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:0.0:1762166975.842234:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166975.842246:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62e00/0x2f180c4effba9cc2 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x607:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e974f expref: 558 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.842254:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x607:0x0].0x0 (ffff945bc812e500) 00010000:00010000:0.0:1762166975.842257:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166975.842374:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effba9d24 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x607:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166975.842384:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effba9d24 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x607:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.842389:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effba9d24 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x607:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000001:00080000:0.0:1762166975.842421:0:6495:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294991828 00000004:00010000:0.0:1762166975.842434:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000002bca3a8a reply state 00000000b3daa733 transno 4294991829 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effba9d24 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x607:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.842442:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effba9d24 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x607:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.842445:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x607:0x0].0x0 (ffff945bc812e500) 00010000:00010000:0.0:1762166975.842447:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762166975.842448:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166975.842510:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+560:61836:x1847765450338432:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 301us (387us total) trans 4294991829 rc 0/0 00000100:00100000:0.0:1762166975.842515:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30245 00000020:00080000:0.0:1762166975.842518:0:6495:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1762166975.843240:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166975.844320:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166975.844371:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450338688 00000100:00100000:2.0:1762166975.844377:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450338688 00000100:00100000:2.0:1762166975.844416:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18745 00000100:00100000:2.0:1762166975.844426:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+23:61836:x1847765450338688:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166975.844436:0:9168:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166975.844449:0:9168:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9800/0x2f180c4effba9d32 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e978e expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.844470:0:9168:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc8473a00/0x2f180c4effba9cc9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9756 expref: 24 pid: 8383 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166975.844506:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166975.844509:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166975.844514:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9800/0x2f180c4effba9d32 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e978e expref: 24 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.844546:0:9168:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc8473a00/0x2f180c4effba9cc9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9756 expref: 24 pid: 8383 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166975.844558:0:9168:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc8473a00/0x2f180c4effba9cc9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9756 expref: 24 pid: 8383 timeout: 694 lvb_type: 1 00000100:00100000:2.0:1762166975.844573:0:9168:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bc2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9168:1847765449686272:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166975.844644:0:9168:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf3a33840 going to sleep for 11 seconds 00000100:00100000:2.0:1762166975.845407:0:9168:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bc2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9168:1847765449686272:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166975.845425:0:9168:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9800/0x2f180c4effba9d32 lrc: 3/0,0 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e978e expref: 24 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.845437:0:9168:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa9800, rc 0) 00000100:00100000:2.0:1762166975.845473:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+24:61836:x1847765450338688:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1047us (1150us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166975.845505:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18745 00000100:00100000:3.0:1762166975.845608:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166975.845642:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450338816 00000100:00100000:2.0:1762166975.845646:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450338816 00010000:00010000:2.0:1762166975.845665:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8473a00/0x2f180c4effba9cc9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9756 expref: 24 pid: 8383 timeout: 694 lvb_type: 1 00000100:00100000:2.0:1762166975.845697:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9474 00000100:00100000:2.0:1762166975.845708:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765450338816:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166975.845718:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166975.845723:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc8473a00/0x2f180c4effba9cc9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9756 expref: 24 pid: 8383 timeout: 694 lvb_type: 1 00010000:00010000:2.0:1762166975.845746:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc8473a00/0x2f180c4effba9cc9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9756 expref: 24 pid: 8383 timeout: 694 lvb_type: 1 00010000:00010000:2.0:1762166975.845764:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc8473a00/0x2f180c4effba9cc9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9756 expref: 24 pid: 8383 timeout: 694 lvb_type: 1 00010000:00010000:2.0:1762166975.845779:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166975.845781:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166975.845786:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9800/0x2f180c4effba9d32 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e978e expref: 23 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.845795:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9800/0x2f180c4effba9d32 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e978e expref: 23 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.845817:0:6481:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9800/0x2f180c4effba9d32 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e978e expref: 23 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166975.845833:0:6481:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bc2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6481:1847765449686400:192.168.204.38@tcp:105: 00000100:00100000:2.0:1762166975.845875:0:6481:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf3a33840 going to sleep for 11 seconds 00000100:00100000:2.0:1762166975.846671:0:6481:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bc2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6481:1847765449686400:192.168.204.38@tcp:105: 00010000:00010000:2.0:1762166975.846684:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166975.846718:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166975.846735:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765450338816:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1028us (1126us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166975.846746:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9474 00000100:00100000:0.0:1762166975.847952:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166975.847988:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450339072 00000100:00100000:2.0:1762166975.847993:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450339072 00010000:00010000:2.0:1762166975.848010:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde000/0x2f180c4effba9cd0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e975d expref: 35 pid: 28434 timeout: 694 lvb_type: 1 00000100:00100000:2.0:1762166975.848039:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9475 00000100:00100000:2.0:1762166975.848047:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc70b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+35:2419:x1847765450339072:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166975.848056:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166975.848061:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde000/0x2f180c4effba9cd0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa87:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e975d expref: 35 pid: 28434 timeout: 694 lvb_type: 1 00010000:00010000:2.0:1762166975.848071:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde000/0x2f180c4effba9cd0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa87:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e975d expref: 35 pid: 28434 timeout: 694 lvb_type: 1 00010000:00010000:2.0:1762166975.848087:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde000/0x2f180c4effba9cd0 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa87:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e975d expref: 35 pid: 28434 timeout: 694 lvb_type: 1 00010000:00010000:2.0:1762166975.848102:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166975.848103:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166975.848107:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62600/0x2f180c4effba9d39 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9795 expref: 34 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.848114:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62600/0x2f180c4effba9d39 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9795 expref: 34 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.848135:0:6481:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62600/0x2f180c4effba9d39 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9795 expref: 34 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166975.848145:0:6481:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bc2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6481:1847765449686656:192.168.204.38@tcp:105: 00000100:00100000:2.0:1762166975.848187:0:6481:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf3a33840 going to sleep for 11 seconds 00000100:00100000:0.0:1762166975.848932:0:6481:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bc2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6481:1847765449686656:192.168.204.38@tcp:105: 00010000:00010000:0.0:1762166975.848944:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166975.848976:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc70b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+34:2419:x1847765450339072:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 929us (1025us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166975.848984:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9475 00000100:00100000:2.0:1762166975.849098:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450339200 00000100:00100000:2.0:1762166975.849103:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450339200 00002000:00010000:2.0:1762166975.849123:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2696 (0->18446744073709551615) 00002000:00100000:2.0:1762166975.849126:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf79e9f80 with x1847765450339200 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166975.849132:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945cf79e9f80. 00000100:00100000:3.0:1762166975.849137:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450339328 00000100:00100000:3.0:1762166975.849142:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450339328 00000100:00100000:2.0:1762166975.849151:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1981 00002000:00010000:3.0:1762166975.849158:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2695 (0->18446744073709551615) 00000100:00100000:2.0:1762166975.849159:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765450339200:12345-192.168.204.38@tcp:10:lfs.0 00002000:00100000:3.0:1762166975.849164:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf79e9c00 with x1847765450339328 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166975.849169:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf79e9c00. 00000100:00100000:3.0:1762166975.849189:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1982 00000100:00100000:3.0:1762166975.849197:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+34:2419:x1847765450339328:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:3.0:1762166975.849299:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166975.849301:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166975.849302:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb mtime from disk: 0 -> 1762166976 00002000:00010000:2.0:1762166975.849305:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb mtime from disk: 0 -> 1762166976 00002000:00010000:3.0:1762166975.849306:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1762166975.849309:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1762166975.849310:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb ctime from disk: 0 -> 1762166976 00002000:00010000:2.0:1762166975.849313:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb ctime from disk: 0 -> 1762166976 00002000:00010000:3.0:1762166975.849314:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:2.0:1762166975.849316:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166975.849346:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+35:2419:x1847765450339328:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 151us (249us total) trans 17179876180 rc 0/0 00000100:00100000:2.0:1762166975.849352:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+24:2418:x1847765450339200:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 192us (282us total) trans 21474843172 rc 0/0 00000100:00100000:3.0:1762166975.849357:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1982 00002000:00010000:3.0:1762166975.849361:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2695 (0->18446744073709551615) 00000100:00100000:2.0:1762166975.849364:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1981 00002000:00100000:3.0:1762166975.849365:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf79e9c00 with x1847765450339328 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166975.849369:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2696 (0->18446744073709551615) 00002000:00010000:3.0:1762166975.849371:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf79e9c00. 00002000:00100000:2.0:1762166975.849372:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf79e9f80 with x1847765450339200 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166975.849379:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945cf79e9f80. 00000100:00100000:3.0:1762166975.850451:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.851656:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.853059:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166975.853099:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450339712 00000100:00100000:2.0:1762166975.853105:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450339712 00000100:00100000:2.0:1762166975.853150:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1983 00000100:00100000:2.0:1762166975.853159:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc70b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+35:2416:x1847765450339712:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:2.0:1762166975.853186:0:8388:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effba9d40 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.853200:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166975.853202:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166975.853206:0:8388:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effba9d40 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->24575] (req 0->24575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.853221:0:8388:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effba9d40 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->24575] (req 0->24575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.854452:0:8388:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effba9d40 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->24575] (req 0->24575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.854466:0:8388:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effba9d40 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->24575] (req 0->24575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.854517:0:8388:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effba9d40 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->24575] (req 0->24575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.854532:0:8388:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa8c00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166975.854537:0:8388:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effba9d40 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->24575] (req 0->24575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.854546:0:8388:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effba9d40 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->24575] (req 0->24575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.854562:0:8388:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effba9d40 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->24575] (req 0->24575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.854570:0:8388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effba9d40 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->24575] (req 0->24575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166975.854630:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc70b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+35:2416:x1847765450339712:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 1470us (1570us total) trans 0 rc 24576/24576 00000100:00100000:2.0:1762166975.854639:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1983 00000100:00100000:0.0:1762166975.855982:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166975.856023:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450339840 00000100:00100000:2.0:1762166975.856031:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450339840 00000100:00100000:2.0:1762166975.856081:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1984 00000100:00100000:2.0:1762166975.856091:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc70b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+24:2418:x1847765450339840:12345-192.168.204.38@tcp:4:lfs.0 00010000:00010000:2.0:1762166975.856118:0:8388:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9400/0x2f180c4effba9d47 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.856132:0:8388:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9800/0x2f180c4effba9d32 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e978e expref: 24 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.856141:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166975.856143:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166975.856147:0:8388:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9400/0x2f180c4effba9d47 lrc: 4/0,1 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->24575] (req 0->24575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.856176:0:8388:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9800/0x2f180c4effba9d32 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e978e expref: 24 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.856189:0:8388:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9800/0x2f180c4effba9d32 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e978e expref: 24 pid: 9168 timeout: 695 lvb_type: 0 00000100:00100000:2.0:1762166975.856203:0:8388:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bc2300 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0000_UUID:8388:1847765449686784:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166975.856262:0:8388:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf3a33840 going to sleep for 11 seconds 00000100:00100000:2.0:1762166975.857079:0:8388:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bc2300 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0000_UUID:8388:1847765449686784:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166975.857098:0:8388:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9400/0x2f180c4effba9d47 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->24575] (req 0->24575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166975.857307:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166975.857380:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450339968 00000100:00100000:2.0:1762166975.857385:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450339968 00010000:00010000:2.0:1762166975.857405:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9800/0x2f180c4effba9d32 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e978e expref: 25 pid: 9168 timeout: 695 lvb_type: 0 00000100:00100000:2.0:1762166975.857436:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9476 00000100:00100000:2.0:1762166975.857444:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf9d1d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+25:2419:x1847765450339968:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166975.857454:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166975.857471:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9800/0x2f180c4effba9d32 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e978e expref: 25 pid: 9168 timeout: 695 lvb_type: 0 00010000:00010000:2.0:1762166975.857509:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9800/0x2f180c4effba9d32 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e978e expref: 25 pid: 9168 timeout: 695 lvb_type: 0 00010000:00010000:2.0:1762166975.857529:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9800/0x2f180c4effba9d32 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e978e expref: 25 pid: 9168 timeout: 695 lvb_type: 0 00010000:00010000:2.0:1762166975.857542:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166975.857545:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166975.857548:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9400/0x2f180c4effba9d47 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->24575] (req 0->24575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.857558:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9400/0x2f180c4effba9d47 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->24575] (req 0->24575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.857585:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166975.857627:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf9d1d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765450339968:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 183us (321us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166975.857630:0:8388:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9400/0x2f180c4effba9d47 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->24575] (req 0->24575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166975.857639:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9476 00010000:00010000:3.0:1762166975.857645:0:8388:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9400/0x2f180c4effba9d47 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->24575] (req 0->24575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000001:00080000:2.0:1762166975.860214:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843173 is committed 00000001:00080000:2.0:1762166975.860230:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843171 is committed 00002000:00010000:3.0:1762166975.860334:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb size from disk: 0 -> 24576 00002000:00010000:3.0:1762166975.860340:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb blocks from disk: 0 -> 48 00010000:00010000:3.0:1762166975.860350:0:8388:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9400/0x2f180c4effba9d47 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->24575] (req 0->24575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.860360:0:8388:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9400/0x2f180c4effba9d47 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->24575] (req 0->24575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.860368:0:8388:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9400/0x2f180c4effba9d47 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->24575] (req 0->24575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.860375:0:8388:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa9400 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166975.860380:0:8388:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9400/0x2f180c4effba9d47 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->24575] (req 0->24575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.860389:0:8388:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9400/0x2f180c4effba9d47 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->24575] (req 0->24575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.860410:0:8388:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9400/0x2f180c4effba9d47 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->24575] (req 0->24575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.860418:0:8388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9400/0x2f180c4effba9d47 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->24575] (req 0->24575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166975.860521:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc70b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+16:2418:x1847765450339840:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 4428us (4538us total) trans 21474843173 rc 0/0 00000100:00100000:3.0:1762166975.860531:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1984 00000100:00100000:3.0:1762166975.862265:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450340096 00000100:00100000:3.0:1762166975.862274:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450340096 00000100:00100000:3.0:1762166975.862321:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18749 00000100:00100000:3.0:1762166975.862333:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+35:2419:x1847765450340096:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:3.0:1762166975.862442:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+35:2419:x1847765450340096:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 112us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166975.862451:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18749 00000100:00100000:0.0:1762166975.863807:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166975.863848:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450340224 00000100:00100000:3.0:1762166975.863853:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450340224 00000100:00100000:3.0:1762166975.863879:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18750 00000100:00100000:3.0:1762166975.863885:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc70b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+35:2418:x1847765450340224:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:3.0:1762166975.863958:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc70b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+35:2418:x1847765450340224:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 73us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166975.863963:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18750 00000100:00100000:0.0:1762166975.865280:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166975.865362:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450340352 00000100:00100000:3.0:1762166975.865368:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450340352 00000100:00100000:3.0:1762166975.865414:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1985 00000100:00100000:3.0:1762166975.865422:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc70b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+35:2416:x1847765450340352:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:3.0:1762166975.865455:0:8388:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effba9d4e lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.865470:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166975.865472:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166975.865515:0:8388:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effba9d4e lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [94208->139263] (req 94208->139263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.865529:0:8388:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effba9d4e lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [94208->139263] (req 94208->139263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.867075:0:8388:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effba9d4e lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [94208->139263] (req 94208->139263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.867094:0:8388:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effba9d4e lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [94208->139263] (req 94208->139263) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.867102:0:8388:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effba9d4e lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [94208->139263] (req 94208->139263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.867110:0:8388:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8473000 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166975.867114:0:8388:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effba9d4e lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [94208->139263] (req 94208->139263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.867124:0:8388:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effba9d4e lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [94208->139263] (req 94208->139263) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.867149:0:8388:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effba9d4e lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [94208->139263] (req 94208->139263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.867158:0:8388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effba9d4e lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [94208->139263] (req 94208->139263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166975.867242:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc70b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+35:2416:x1847765450340352:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 1816us (1958us total) trans 0 rc 45056/45056 00000100:00100000:3.0:1762166975.867255:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1985 00000100:00100000:0.0:1762166975.868647:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166975.868694:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450340480 00000100:00100000:3.0:1762166975.868702:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450340480 00000100:00100000:3.0:1762166975.868751:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1986 00000100:00100000:3.0:1762166975.868760:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc70b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+16:2418:x1847765450340480:12345-192.168.204.38@tcp:4:lfs.0 00002000:00010000:3.0:1762166975.868802:0:8388:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa88:0x0] initial LVB size: 24576, mtime: 0x690888c0, atime: 0x0, ctime: 0x690888c0, blocks: 0x30 00010000:00010000:3.0:1762166975.868809:0:8388:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc8472c00/0x2f180c4effba9d55 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.868820:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166975.868822:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166975.868826:0:8388:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8472c00/0x2f180c4effba9d55 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [94208->139263] (req 94208->139263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.868836:0:8388:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc8472c00/0x2f180c4effba9d55 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [94208->139263] (req 94208->139263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000001:00080000:2.0:1762166975.871214:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843174 is committed 00002000:00010000:3.0:1762166975.871313:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb size from disk: 24576 -> 139264 00002000:00010000:3.0:1762166975.871321:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb blocks from disk: 48 -> 136 00010000:00010000:3.0:1762166975.871331:0:8388:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc8472c00/0x2f180c4effba9d55 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [94208->139263] (req 94208->139263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.871340:0:8388:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8472c00/0x2f180c4effba9d55 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [94208->139263] (req 94208->139263) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.871346:0:8388:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc8472c00/0x2f180c4effba9d55 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [94208->139263] (req 94208->139263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.871350:0:8388:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8472c00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166975.871354:0:8388:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc8472c00/0x2f180c4effba9d55 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [94208->139263] (req 94208->139263) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.871359:0:8388:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc8472c00/0x2f180c4effba9d55 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [94208->139263] (req 94208->139263) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.871373:0:8388:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc8472c00/0x2f180c4effba9d55 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [94208->139263] (req 94208->139263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.871378:0:8388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc8472c00/0x2f180c4effba9d55 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [94208->139263] (req 94208->139263) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166975.871472:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc70b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+16:2418:x1847765450340480:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 2710us (2824us total) trans 21474843174 rc 0/0 00000100:00100000:3.0:1762166975.871528:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1986 00000100:00100000:3.0:1762166975.873127:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450340608 00000100:00100000:3.0:1762166975.873137:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450340608 00000100:00100000:3.0:1762166975.873192:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18751 00000100:00100000:3.0:1762166975.873203:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+35:2419:x1847765450340608:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:3.0:1762166975.873304:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+35:2419:x1847765450340608:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 104us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166975.873311:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18751 00000100:00100000:0.0:1762166975.874543:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.876185:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166975.876216:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450340864 00000100:00100000:3.0:1762166975.876222:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450340864 00000100:00100000:3.0:1762166975.876260:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1987 00000100:00100000:3.0:1762166975.876265:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+35:2418:x1847765450340864:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:3.0:1762166975.876288:0:8388:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8472000/0x2f180c4effba9d5c lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.876299:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166975.876300:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166975.876304:0:8388:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472000/0x2f180c4effba9d5c lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.876312:0:8388:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8472000/0x2f180c4effba9d5c lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.876397:0:8388:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8472000/0x2f180c4effba9d5c lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.876405:0:8388:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472000/0x2f180c4effba9d5c lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.876412:0:8388:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc8472000/0x2f180c4effba9d5c lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.876418:0:8388:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8472000 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166975.876422:0:8388:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8472000/0x2f180c4effba9d5c lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.876430:0:8388:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8472000/0x2f180c4effba9d5c lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.876445:0:8388:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc8472000/0x2f180c4effba9d5c lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.876453:0:8388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8472000/0x2f180c4effba9d5c lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166975.876526:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+35:2418:x1847765450340864:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 260us (343us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1762166975.876534:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1987 00000100:00100000:3.0:1762166975.877857:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166975.877896:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450340992 00000100:00100000:2.0:1762166975.877901:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450340992 00000100:00100000:2.0:1762166975.877956:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1988 00000100:00100000:2.0:1762166975.877966:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+16:2419:x1847765450340992:12345-192.168.204.38@tcp:4:lfs.0 00002000:00010000:2.0:1762166975.878002:0:8388:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa88:0x0] initial LVB size: 139264, mtime: 0x690888c0, atime: 0x0, ctime: 0x690888c0, blocks: 0x88 00010000:00010000:2.0:1762166975.878011:0:8388:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9800/0x2f180c4effba9d63 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.878020:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166975.878022:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166975.878026:0:8388:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9800/0x2f180c4effba9d63 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.878036:0:8388:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9800/0x2f180c4effba9d63 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166975.879364:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb size from disk: 139264 -> 151552 00002000:00010000:2.0:1762166975.879371:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb blocks from disk: 136 -> 144 00010000:00010000:2.0:1762166975.879382:0:8388:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9800/0x2f180c4effba9d63 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.879397:0:8388:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9800/0x2f180c4effba9d63 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.879407:0:8388:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9800/0x2f180c4effba9d63 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.879414:0:8388:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa9800 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166975.879418:0:8388:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9800/0x2f180c4effba9d63 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.879427:0:8388:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9800/0x2f180c4effba9d63 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.879445:0:8388:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9800/0x2f180c4effba9d63 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.879452:0:8388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9800/0x2f180c4effba9d63 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [147456->151551] (req 147456->151551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166975.879591:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+16:2419:x1847765450340992:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 1622us (1732us total) trans 21474843175 rc 0/0 00000100:00100000:2.0:1762166975.879601:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1988 00000100:00100000:0.0:1762166975.880951:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.882470:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450341376 00000100:00100000:0.0:1762166975.882510:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450341376 00000100:00100000:0.0:1762166975.882561:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30247 00000100:00100000:0.0:1762166975.882571:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+561:61836:x1847765450341376:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:0.0:1762166975.882819:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effba9d6a lrc: 3/0,1 mode: --/PW res: [0x240000404:0x607:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166975.882839:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effba9d6a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x607:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.882854:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effba9d6a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x607:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000001:00080000:0.0:1762166975.882902:0:6495:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294991830 00000004:00010000:0.0:1762166975.882941:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000001c509fdf reply state 00000000e9313366 transno 4294991831 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effba9d6a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x607:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.882954:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effba9d6a lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x607:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166975.882962:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x607:0x0].0x0 (ffff945bc812e500) 00010000:00010000:0.0:1762166975.882965:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762166975.882969:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166975.883045:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+564:61836:x1847765450341376:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 476us (660us total) trans 4294991831 rc 0/0 00000100:00100000:0.0:1762166975.883054:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30247 00000020:00080000:0.0:1762166975.883059:0:6495:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1762166975.884144:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166975.885572:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166975.885626:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166975.885657:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450341632 00000100:00100000:3.0:1762166975.885665:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450341632 00002000:00010000:3.0:1762166975.885696:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2696 (250794->18446744073709551615) 00002000:00100000:3.0:1762166975.885702:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5bc2300 with x1847765450341632 ext(250794->18446744073709551615) 00000100:00100000:0.0:1762166975.885703:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450341760 00000100:00100000:0.0:1762166975.885710:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450341760 00002000:00010000:3.0:1762166975.885715:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc5bc2300. 00002000:00010000:0.0:1762166975.885732:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2695 (0->18446744073709551615) 00002000:00100000:0.0:1762166975.885737:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5bc1180 with x1847765450341760 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166975.885746:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5bc1180. 00000100:00100000:3.0:1762166975.885754:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1989 00000100:00100000:3.0:1762166975.885765:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450341632:12345-192.168.204.38@tcp:10:lfs.0 00000100:00100000:0.0:1762166975.885793:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1990 00000100:00100000:0.0:1762166975.885809:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+35:2418:x1847765450341760:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:0.0:1762166975.885957:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166975.885960:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:0.0:1762166975.885964:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1762166975.885966:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:0.0:1762166975.885969:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:3.0:1762166975.885994:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb size from disk: 151552 -> 250794 00002000:00010000:3.0:1762166975.885999:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:3.0:1762166975.886002:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1762166975.886005:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:3.0:1762166975.886008:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb blocks from disk: 144 -> 144 00000100:00100000:0.0:1762166975.886020:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+36:2418:x1847765450341760:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 217us (392us total) trans 17179876181 rc 0/0 00000100:00100000:0.0:1762166975.886029:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1990 00000100:00100000:3.0:1762166975.886035:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450341632:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 270us (462us total) trans 21474843176 rc 0/0 00002000:00010000:0.0:1762166975.886036:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2695 (0->18446744073709551615) 00002000:00100000:0.0:1762166975.886044:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5bc1180 with x1847765450341760 ext(0->18446744073709551615) 00000100:00100000:3.0:1762166975.886050:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1989 00002000:00010000:0.0:1762166975.886053:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5bc1180. 00002000:00010000:3.0:1762166975.886055:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2696 (250794->18446744073709551615) 00002000:00100000:3.0:1762166975.886060:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5bc2300 with x1847765450341632 ext(250794->18446744073709551615) 00002000:00010000:3.0:1762166975.886066:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc5bc2300. 00000100:00100000:0.0:1762166975.887926:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166975.887981:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450341888 00000100:00100000:3.0:1762166975.887990:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450341888 00000100:00100000:3.0:1762166975.888046:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1991 00000100:00100000:3.0:1762166975.888070:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+36:2416:x1847765450341888:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:3.0:1762166975.888107:0:8388:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8472000/0x2f180c4effba9d78 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.888122:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166975.888124:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166975.888130:0:8388:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472000/0x2f180c4effba9d78 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [249856->253951] (req 249856->253951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.888143:0:8388:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8472000/0x2f180c4effba9d78 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [249856->253951] (req 249856->253951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.888270:0:8388:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8472000/0x2f180c4effba9d78 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [249856->253951] (req 249856->253951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.888280:0:8388:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472000/0x2f180c4effba9d78 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [249856->253951] (req 249856->253951) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.888294:0:8388:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc8472000/0x2f180c4effba9d78 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [249856->253951] (req 249856->253951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.888302:0:8388:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8472000 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166975.888307:0:8388:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8472000/0x2f180c4effba9d78 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [249856->253951] (req 249856->253951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.888316:0:8388:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8472000/0x2f180c4effba9d78 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [249856->253951] (req 249856->253951) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.888334:0:8388:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc8472000/0x2f180c4effba9d78 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [249856->253951] (req 249856->253951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.888342:0:8388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8472000/0x2f180c4effba9d78 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [249856->253951] (req 249856->253951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166975.888407:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+36:2416:x1847765450341888:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 351us (499us total) trans 0 rc 938/938 00000100:00100000:3.0:1762166975.888415:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1991 00000100:00100000:3.0:1762166975.889882:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450342016 00000100:00100000:3.0:1762166975.889933:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450342016 00000100:00100000:3.0:1762166975.889984:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1992 00000100:00100000:3.0:1762166975.889993:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+18:2416:x1847765450342016:12345-192.168.204.38@tcp:4:lfs.0 00010000:00010000:3.0:1762166975.890020:0:8388:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc8472c00/0x2f180c4effba9d7f lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.890034:0:8388:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4b62000/0x2f180c4effba9d71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e979c expref: 18 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.890043:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166975.890045:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166975.890048:0:8388:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8472c00/0x2f180c4effba9d7f lrc: 4/0,1 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [249856->253951] (req 249856->253951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.890098:0:8388:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc4b62000/0x2f180c4effba9d71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e979c expref: 18 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.890114:0:8388:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc4b62000/0x2f180c4effba9d71 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e979c expref: 18 pid: 9168 timeout: 695 lvb_type: 0 00000100:00100000:3.0:1762166975.890131:0:8388:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1e6d180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0000_UUID:8388:1847765449686912:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166975.890213:0:8388:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cee171900 going to sleep for 11 seconds 00000100:00100000:3.0:1762166975.891210:0:8388:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1e6d180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0000_UUID:8388:1847765449686912:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166975.891244:0:8388:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bc8472c00/0x2f180c4effba9d7f lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [249856->253951] (req 249856->253951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166975.891346:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450342144 00000100:00100000:0.0:1762166975.891352:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450342144 00010000:00010000:0.0:1762166975.891376:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4b62000/0x2f180c4effba9d71 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e979c expref: 19 pid: 9168 timeout: 695 lvb_type: 0 00000100:00100000:0.0:1762166975.891426:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9477 00000100:00100000:0.0:1762166975.891436:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450342144:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166975.891448:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166975.891473:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc4b62000/0x2f180c4effba9d71 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e979c expref: 19 pid: 9168 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166975.891518:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc4b62000/0x2f180c4effba9d71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e979c expref: 19 pid: 9168 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166975.891543:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4b62000/0x2f180c4effba9d71 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e979c expref: 19 pid: 9168 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166975.891557:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166975.891559:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166975.891563:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc8472c00/0x2f180c4effba9d7f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [249856->253951] (req 249856->253951) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.891572:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8472c00/0x2f180c4effba9d7f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [249856->253951] (req 249856->253951) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.891599:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166975.891608:0:8388:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bc8472c00/0x2f180c4effba9d7f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [249856->253951] (req 249856->253951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.891618:0:8388:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc8472c00/0x2f180c4effba9d7f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [249856->253951] (req 249856->253951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166975.891653:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450342144:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 216us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166975.891663:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9477 00002000:00010000:3.0:1762166975.893012:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb blocks from disk: 144 -> 152 00010000:00010000:3.0:1762166975.893025:0:8388:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc8472c00/0x2f180c4effba9d7f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [249856->253951] (req 249856->253951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.893035:0:8388:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8472c00/0x2f180c4effba9d7f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [249856->253951] (req 249856->253951) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.893043:0:8388:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc8472c00/0x2f180c4effba9d7f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [249856->253951] (req 249856->253951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.893048:0:8388:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8472c00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166975.893052:0:8388:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc8472c00/0x2f180c4effba9d7f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [249856->253951] (req 249856->253951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.893059:0:8388:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc8472c00/0x2f180c4effba9d7f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [249856->253951] (req 249856->253951) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.893073:0:8388:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc8472c00/0x2f180c4effba9d7f lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [249856->253951] (req 249856->253951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.893078:0:8388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc8472c00/0x2f180c4effba9d7f lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [249856->253951] (req 249856->253951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166975.893138:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+16:2416:x1847765450342016:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 3145us (3304us total) trans 21474843177 rc 0/0 00000100:00100000:3.0:1762166975.893147:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1992 00000100:00100000:0.0:1762166975.894163:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450342272 00000100:00100000:0.0:1762166975.894172:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450342272 00000100:00100000:0.0:1762166975.894228:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30248 00000100:00100000:0.0:1762166975.894238:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+564:61836:x1847765450342272:12345-192.168.204.38@tcp:44:lfs.0 00000001:00080000:3.0:1762166975.895310:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294991831 is committed 00000004:00080000:3.0:1762166975.895350:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3224 committed 00010000:00010000:2.0:1762166975.895357:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effba9b33 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00000004:00080000:3.0:1762166975.895364:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3221 committed 00010000:00010000:2.0:1762166975.895370:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effba9b33 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.895379:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effba9b33 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.895387:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdf600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166975.895392:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effba9b33 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00000020:00080000:3.0:1762166975.895393:0:7412:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff945cc4eea9c0 refcount 2 committed 0 result 0 batchid 42 00000020:00080000:3.0:1762166975.895402:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cf399c000 obd lustre-OST0001-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff945d011c7e40 00010000:00010000:2.0:1762166975.895405:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effba9b33 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00000020:00080000:3.0:1762166975.895408:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cf39b2600 obd lustre-OST0000-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff945cca8ae300 00000020:00080000:3.0:1762166975.895417:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cf3a53500 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff945bc4429600 00000020:00080000:3.0:1762166975.895421:0:7412:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000400:0x2:0x0].40 00010000:00010000:2.0:1762166975.895432:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166975.895437:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166975.895442:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effba9b33 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.895447:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effba9b33 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000020:00080000:3.0:1762166975.895499:0:7435:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 42 committed batchid 41 00000100:00100000:0.0:1762166975.895504:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449687040:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1762166975.895506:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effba9d24 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x607:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.895517:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effba9d24 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x607:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.895523:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effba9d24 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x607:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.895537:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bde600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166975.895545:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effba9d24 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x607:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.895552:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effba9d24 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x607:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00000020:00080000:3.0:1762166975.895554:0:7435:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 41 00000100:00100000:0.0:1762166975.895562:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1762166975.895570:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x607:0x0].0x0 (ffff945bc812e500) 00010000:00010000:2.0:1762166975.895575:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166975.895579:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effba9d24 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x607:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.895585:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effba9d24 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x607:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000100:00100000:3.0:1762166975.895593:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449687040 00000100:00100000:3.0:1762166975.895599:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449687040 00010000:00010000:2.0:1762166975.895601:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effba9d6a lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x607:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.895609:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effba9d6a lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x607:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.895615:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effba9d6a lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x607:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00000100:00100000:0.0:1762166975.895621:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1762166975.895628:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdfa00 already unused, calling callback (ffffffffc18e2310) 00000100:00100000:3.0:1762166975.895634:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449687168 00010000:00010000:2.0:1762166975.895634:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effba9d6a lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x607:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00000100:00100000:3.0:1762166975.895638:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449687168 00010000:00010000:2.0:1762166975.895645:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effba9d6a lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x607:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.895658:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x607:0x0].0x0 (ffff945bc812e500) 00000100:00100000:0.0:1762166975.895658:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18755 00010000:00010000:2.0:1762166975.895665:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166975.895668:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effba9d6a lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x607:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000100:00100000:0.0:1762166975.895673:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3633:x1847765449687040:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1762166975.895677:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effba9d6a lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x607:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000100:00100000:3.0:1762166975.895688:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18756 00000100:00100000:3.0:1762166975.895700:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+16:3634:x1847765449687168:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1762166975.895701:0:35472:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:2695 count 1 00002000:00080000:3.0:1762166975.895722:0:35247:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:2694 count 1 00010000:00010000:0.0:1762166975.895729:0:35472:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde400/0x2f180c4effba9d86 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa87:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.895745:0:35472:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bcc8fb800/0x2f180c4effba952f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9485 expref: 15 pid: 8380 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166975.895749:0:35247:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa86:0x0] initial LVB size: 262144, mtime: 0x690888bf, atime: 0x690888be, ctime: 0x690888bf, blocks: 0xd0 00010000:00010000:0.0:1762166975.895751:0:35472:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166975.895756:0:35472:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166975.895758:0:35247:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effba9d8d lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.895761:0:35472:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde400/0x2f180c4effba9d86 lrc: 4/0,1 mode: --/PW res: [0x280000400:0xa87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.895774:0:35247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166975.895778:0:35247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166975.895782:0:35247:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effba9d8d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.895794:0:35247:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effba9d8d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.895801:0:35472:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bcc8fb800/0x2f180c4effba952f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9485 expref: 15 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.895804:0:35247:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effba9d8d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.895824:0:35247:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effba9d8d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.895832:0:35472:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bcc8fb800/0x2f180c4effba952f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9485 expref: 15 pid: 8380 timeout: 695 lvb_type: 0 00010000:00010000:3.0:1762166975.895845:0:35247:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1762166975.895848:0:35472:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bbb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:35472:1847765449687296:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166975.895866:0:6483:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166975.895875:0:6483:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effba9d8d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.895884:0:6483:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8473000 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166975.895888:0:6483:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effba9d8d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.895896:0:6483:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effba9d8d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166975.895922:0:35472:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7a77600 going to sleep for 11 seconds 00010000:00010000:2.0:1762166975.895929:0:6483:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effba9d8d lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.895939:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effba9d8d lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.895968:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166975.895971:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166975.895973:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166975.896559:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+17:3634:x1847765449687168:12345-0@lo:6:osp-syn-1-1.0 Request processed in 860us (937us total) trans 17179876182 rc 0/0 00000100:00100000:3.0:1762166975.896567:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18756 00000004:00080000:0.0:1762166975.896672:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf79e8000/2, rc 0, transno 17179876182 00000100:00100000:0.0:1762166975.896684:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449687168:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1762166975.897255:0:35472:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bbb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:35472:1847765449687296:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166975.897280:0:35472:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde400/0x2f180c4effba9d86 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166975.897283:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450342400 00000100:00100000:3.0:1762166975.897328:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450342400 00000100:00100000:2.0:1762166975.897343:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450342528 00000100:00100000:2.0:1762166975.897350:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450342528 00000100:00100000:3.0:1762166975.897372:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450342656 00000100:00100000:3.0:1762166975.897378:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450342656 00010000:00010000:2.0:1762166975.897381:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bcc8fb800/0x2f180c4effba952f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9485 expref: 17 pid: 8380 timeout: 695 lvb_type: 0 00000100:00100000:3.0:1762166975.897420:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18757 00000100:00100000:2.0:1762166975.897420:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9478 00000100:00100000:3.0:1762166975.897433:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450342400:12345-192.168.204.38@tcp:16:lfs.0 00000100:00100000:2.0:1762166975.897438:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450342528:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166975.897454:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166975.897462:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bcc8fb800/0x2f180c4effba952f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa87:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9485 expref: 17 pid: 8380 timeout: 695 lvb_type: 0 00010000:00010000:2.0:1762166975.897500:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bcc8fb800/0x2f180c4effba952f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa87:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9485 expref: 17 pid: 8380 timeout: 695 lvb_type: 0 00010000:00010000:2.0:1762166975.897522:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bcc8fb800/0x2f180c4effba952f lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa87:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9485 expref: 17 pid: 8380 timeout: 695 lvb_type: 0 00010000:00010000:2.0:1762166975.897535:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166975.897538:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1762166975.897542:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+16:2419:x1847765450342400:12345-192.168.204.38@tcp:16:lfs.0 Request processed in 111us (294us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166975.897544:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde400/0x2f180c4effba9d86 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166975.897554:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18757 00010000:00010000:2.0:1762166975.897558:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde400/0x2f180c4effba9d86 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.897579:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166975.897590:0:35472:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde400/0x2f180c4effba9d86 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.897600:0:35472:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde400/0x2f180c4effba9d86 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.897608:0:35472:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde400/0x2f180c4effba9d86 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.897614:0:35472:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde400/0x2f180c4effba9d86 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166975.897618:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+15:2419:x1847765450342528:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 185us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166975.897631:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9478 00010000:00010000:3.0:1762166975.897638:0:35472:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1762166975.897794:0:10256:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1762166975.897802:0:10256:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde400/0x2f180c4effba9d86 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.897811:0:10256:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bde400 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166975.897816:0:10256:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde400/0x2f180c4effba9d86 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.897826:0:10256:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde400/0x2f180c4effba9d86 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.897838:0:10256:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde400/0x2f180c4effba9d86 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.897845:0:10256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde400/0x2f180c4effba9d86 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.897863:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166975.897865:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166975.897866:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166975.897997:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+6:3633:x1847765449687040:12345-0@lo:6:osp-syn-0-1.0 Request processed in 2328us (2438us total) trans 21474843178 rc 0/0 00000100:00100000:3.0:1762166975.898005:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18755 00000100:00100000:0.0:1762166975.898083:0:3633:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 21474843171 gen 2 00000004:00080000:0.0:1762166975.898090:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc4a2aa00, transno 21474843159 00000004:00080000:0.0:1762166975.898109:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc4a28e00, transno 21474843160 00000004:00080000:0.0:1762166975.898114:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc4a28700, transno 21474843161 00000004:00080000:0.0:1762166975.898118:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc4a28000, transno 21474843162 00000004:00080000:0.0:1762166975.898122:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc4a28380, transno 21474843163 00000004:00080000:0.0:1762166975.898125:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc4493b80, transno 21474843164 00000004:00080000:0.0:1762166975.898128:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc4492a00, transno 21474843165 00000004:00080000:0.0:1762166975.898131:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc4491180, transno 21474843166 00000004:00080000:0.0:1762166975.898135:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf783f800, transno 21474843167 00000004:00080000:0.0:1762166975.898138:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc4493800, transno 21474843168 00000004:00080000:0.0:1762166975.898144:0:3633:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 21474843171 committed transno 21474843171 00000100:00100000:0.0:1762166975.898169:0:3633:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff945bc5bb9180 x1847765449687040/t21474843178(21474843178) o6->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 544/432 e 0 to 0 dl 1762166991 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1762166975.898180:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc5bb9180/2, rc 0, transno 21474843178 00000100:00100000:0.0:1762166975.898185:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449687040:0@lo:6:osp-syn-0-1.0 00000001:00080000:2.0:1762166975.898732:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876182 is committed 00000001:00080000:2.0:1762166975.898738:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876181 is committed 00000100:00100000:2.0:1762166975.905401:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450342912 00000100:00100000:2.0:1762166975.905416:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450342912 00000100:00100000:3.0:1762166975.905442:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450342784 00000100:00100000:3.0:1762166975.905450:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450342784 00000100:00100000:0.0:1762166975.905520:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450343040 00000100:00100000:0.0:1762166975.905526:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450343040 00000100:00100000:2.0:1762166975.905541:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18759 00000100:00100000:3.0:1762166975.905551:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18760 00000100:00100000:2.0:1762166975.905557:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450342784:12345-192.168.204.38@tcp:1:lfs.0 00000100:00100000:3.0:1762166975.905563:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+15:2419:x1847765450342912:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:3.0:1762166975.905620:0:35472:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc8472000/0x2f180c4effba9da2 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.905622:0:9168:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9000/0x2f180c4effba9d9b lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.905652:0:35472:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166975.905652:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166975.905657:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166975.905658:0:35472:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166975.905664:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9000/0x2f180c4effba9d9b lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.905665:0:35472:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8472000/0x2f180c4effba9da2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.905690:0:9168:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9000/0x2f180c4effba9d9b lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.905694:0:35472:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc8472000/0x2f180c4effba9da2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.905728:0:35472:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc8472000/0x2f180c4effba9da2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.905730:0:9168:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9000/0x2f180c4effba9d9b lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.905746:0:35472:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8472000/0x2f180c4effba9da2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.905754:0:9168:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9000/0x2f180c4effba9d9b lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.905764:0:35472:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc8472000/0x2f180c4effba9da2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.905787:0:35472:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8472000 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166975.905795:0:35472:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc8472000/0x2f180c4effba9da2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.905798:0:9168:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9000/0x2f180c4effba9d9b lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.905814:0:35472:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc8472000/0x2f180c4effba9da2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.905815:0:9168:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa9000 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166975.905822:0:9168:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9000/0x2f180c4effba9d9b lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.905840:0:9168:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9000/0x2f180c4effba9d9b lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.905846:0:35472:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc8472000/0x2f180c4effba9da2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.905864:0:9168:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9000/0x2f180c4effba9d9b lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.905866:0:35472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc8472000/0x2f180c4effba9da2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.905888:0:9168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9000/0x2f180c4effba9d9b lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166975.905988:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+15:2419:x1847765450342912:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 427us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166975.905997:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450342784:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 444us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166975.906006:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18760 00000100:00100000:2.0:1762166975.906022:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18759 00000100:00100000:3.0:1762166975.907157:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.908933:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166975.908987:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450343424 00000100:00100000:2.0:1762166975.908996:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450343424 00000100:00100000:2.0:1762166975.909052:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18762 00000100:00100000:2.0:1762166975.909072:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+15:61836:x1847765450343424:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166975.909090:0:9168:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166975.909110:0:9168:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8000/0x2f180c4effba9db0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e97a3 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166975.909148:0:9168:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa88:0x0] initial LVB size: 250794, mtime: 0x690888c0, atime: 0x0, ctime: 0x690888c0, blocks: 0x98 00010000:00010000:2.0:1762166975.909171:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166975.909173:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166975.909181:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8000/0x2f180c4effba9db0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e97a3 expref: 16 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.909198:0:9168:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8000/0x2f180c4effba9db0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e97a3 expref: 16 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.909210:0:9168:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa8000, rc 0) 00000100:00100000:2.0:1762166975.909262:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+16:61836:x1847765450343424:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 195us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166975.909269:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18762 00000100:00100000:2.0:1762166975.910603:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166975.910658:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166975.910676:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450343680 00000100:00100000:3.0:1762166975.910689:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450343680 00000100:00100000:3.0:1762166975.910771:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18763 00000100:00100000:3.0:1762166975.910795:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450343680:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:3.0:1762166975.910982:0:9168:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166975.910988:0:9168:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb mtime from disk: 1762166976 -> 1762166975 00002000:00010000:3.0:1762166975.910993:0:9168:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb atime from disk: 0 -> 1762166975 00002000:00010000:3.0:1762166975.910997:0:9168:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:3.0:1762166975.911003:0:9168:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166975.911077:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450343680:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 294us (477us total) trans 17179876183 rc 0/0 00000100:00100000:3.0:1762166975.911106:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18763 00000100:00100000:3.0:1762166975.912622:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166975.914397:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166975.914459:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450344064 00000100:00100000:2.0:1762166975.914465:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450344064 00010000:00010000:2.0:1762166975.914529:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effba9d1d lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x607:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9780 expref: 532 pid: 6495 timeout: 695 lvb_type: 0 00000100:00100000:2.0:1762166975.914551:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9479 00000100:00100000:2.0:1762166975.914558:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+532:2418:x1847765450344064:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166975.914568:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166975.914574:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effba9d1d lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x607:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9780 expref: 532 pid: 6495 timeout: 695 lvb_type: 0 00010000:00010000:2.0:1762166975.914589:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effba9d1d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x607:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9780 expref: 532 pid: 6495 timeout: 695 lvb_type: 0 00010000:00010000:2.0:1762166975.914615:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effba9d1d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x607:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9780 expref: 532 pid: 6495 timeout: 695 lvb_type: 0 00010000:00010000:2.0:1762166975.914628:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x607:0x0].0x0 (ffff945bc812e500) 00010000:00010000:2.0:1762166975.914632:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63400/0x2f180c4effba9db7 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x607:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.914639:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63400/0x2f180c4effba9db7 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x607:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.914645:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63400/0x2f180c4effba9db7 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x607:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166975.914663:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166975.914707:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+531:2418:x1847765450344064:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 150us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166975.914714:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9479 00010000:00010000:1.0:1762166975.914869:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1762166975.914874:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63400/0x2f180c4effba9db7 lrc: 2/0,0 mode: --/PW res: [0x240000404:0x607:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166975.914879:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63400/0x2f180c4effba9db7 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x607:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000100:00100000:1.0:1762166975.914934:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+530:61836:x1847765450343936:12345-192.168.204.38@tcp:55:lfs.0 Request processed in 2201us (2314us total) trans 0 rc -22/-22 00000100:00100000:1.0:1762166975.914941:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30250 00000100:00100000:3.0:1762166975.916222:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166975.916280:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450344320 00000100:00100000:1.0:1762166975.916290:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450344320 00000100:00100000:1.0:1762166975.916349:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30251 00000100:00100000:1.0:1762166975.916359:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+530:61836:x1847765450344320:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:1.0:1762166975.916432:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166975.916458:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7b600/0x2f180c4effba9c67 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9733 expref: 530 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166975.916517:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166975.916523:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166975.916579:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62c00/0x2f180c4effba9dbe lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166975.916594:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62c00/0x2f180c4effba9dbe lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166975.916604:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62c00/0x2f180c4effba9dbe lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00010000:1.0:1762166975.916745:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000cf64e636 reply state 00000000fd009473 transno 4294991833 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62c00/0x2f180c4effba9dbe lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166975.916758:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62c00/0x2f180c4effba9dbe lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166975.916764:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166975.916767:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166975.916770:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166975.916862:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+531:61836:x1847765450344320:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 504us (646us total) trans 4294991833 rc 0/0 00000100:00100000:1.0:1762166975.916870:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30251 00000100:00100000:0.0:1762166975.917972:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166975.918068:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450344448 00000100:00100000:3.0:1762166975.918076:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450344448 00000100:00100000:3.0:1762166975.918113:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18765 00000100:00100000:3.0:1762166975.918119:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+20:61836:x1847765450344448:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166975.918134:0:9168:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166975.918149:0:9168:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8472000/0x2f180c4effba9dc5 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e97aa expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.918171:0:9168:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effba9d01 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e976b expref: 21 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166975.918177:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166975.918179:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166975.918182:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472000/0x2f180c4effba9dc5 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e97aa expref: 21 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.918209:0:9168:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effba9d01 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e976b expref: 21 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166975.918220:0:9168:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effba9d01 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e976b expref: 21 pid: 28434 timeout: 695 lvb_type: 1 00000100:00100000:3.0:1762166975.918233:0:9168:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1e6e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9168:1847765449687552:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166975.918304:0:9168:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cee171a80 going to sleep for 11 seconds 00000100:00100000:2.0:1762166975.919312:0:9168:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1e6e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9168:1847765449687552:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166975.919361:0:9168:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc8472000/0x2f180c4effba9dc5 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e97aa expref: 21 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.919380:0:9168:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8472000, rc 0) 00000100:00100000:0.0:1762166975.919401:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166975.919441:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+21:61836:x1847765450344448:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1320us (1473us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166975.919451:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18765 00000100:00100000:3.0:1762166975.919517:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450344576 00000100:00100000:3.0:1762166975.919524:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450344576 00010000:00010000:3.0:1762166975.919764:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effba9d01 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e976b expref: 21 pid: 28434 timeout: 695 lvb_type: 1 00000100:00100000:3.0:1762166975.919800:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9480 00000100:00100000:3.0:1762166975.919809:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450344576:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166975.919820:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166975.919839:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effba9d01 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e976b expref: 21 pid: 28434 timeout: 695 lvb_type: 1 00010000:00010000:3.0:1762166975.919852:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effba9d01 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e976b expref: 21 pid: 28434 timeout: 695 lvb_type: 1 00010000:00010000:3.0:1762166975.919872:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effba9d01 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e976b expref: 21 pid: 28434 timeout: 695 lvb_type: 1 00010000:00010000:3.0:1762166975.919888:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166975.919889:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166975.919897:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc8472000/0x2f180c4effba9dc5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e97aa expref: 20 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.919925:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472000/0x2f180c4effba9dc5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e97aa expref: 20 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.919962:0:8398:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff945bc8472000/0x2f180c4effba9dc5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e97aa expref: 20 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166975.919975:0:8398:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1e6ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8398:1847765449687680:192.168.204.38@tcp:105: 00000100:00100000:3.0:1762166975.920034:0:8398:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cee171a80 going to sleep for 11 seconds 00000100:00100000:1.0:1762166975.921444:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166975.921553:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450344704 00000100:00100000:2.0:1762166975.921559:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450344704 00000100:00100000:2.0:1762166975.921607:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18766 00000100:00100000:2.0:1762166975.921618:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4492a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+17:61836:x1847765450344704:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166975.921634:0:9168:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1762166975.921639:0:8398:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1e6ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8398:1847765449687680:192.168.204.38@tcp:105: 00010000:00010000:2.0:1762166975.921651:0:9168:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8200/0x2f180c4effba9dcc lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e97b1 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.921658:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166975.921680:0:9168:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9c00/0x2f180c4effba9d0f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9772 expref: 18 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166975.921689:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166975.921691:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1762166975.921699:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450344576:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1889us (2300us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166975.921707:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8200/0x2f180c4effba9dcc lrc: 4/0,0 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e97b1 expref: 18 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166975.921709:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9480 00010000:00010000:2.0:1762166975.921739:0:9168:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9c00/0x2f180c4effba9d0f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9772 expref: 18 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166975.921752:0:9168:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9c00/0x2f180c4effba9d0f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9772 expref: 18 pid: 9168 timeout: 695 lvb_type: 1 00000100:00100000:2.0:1762166975.921764:0:9168:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bc1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9168:1847765449687808:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166975.921804:0:9168:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf3a33780 going to sleep for 11 seconds 00000100:00100000:3.0:1762166975.923667:0:9168:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bc1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9168:1847765449687808:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166975.923681:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:3.0:1762166975.923706:0:9168:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8200/0x2f180c4effba9dcc lrc: 3/0,0 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e97b1 expref: 18 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.923728:0:9168:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa8200, rc 0) 00000100:00100000:0.0:1762166975.923790:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450344832 00000100:00100000:0.0:1762166975.923801:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450344832 00010000:00010000:0.0:1762166975.923834:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9c00/0x2f180c4effba9d0f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9772 expref: 19 pid: 9168 timeout: 695 lvb_type: 1 00000100:00100000:3.0:1762166975.923837:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4492a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+19:61836:x1847765450344704:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2219us (2393us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166975.923862:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18766 00000100:00100000:0.0:1762166975.923922:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9481 00000100:00100000:0.0:1762166975.923938:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450344832:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166975.923950:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166975.923970:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9c00/0x2f180c4effba9d0f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9772 expref: 18 pid: 9168 timeout: 695 lvb_type: 1 00010000:00010000:0.0:1762166975.923984:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9c00/0x2f180c4effba9d0f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9772 expref: 18 pid: 9168 timeout: 695 lvb_type: 1 00010000:00010000:0.0:1762166975.924001:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9c00/0x2f180c4effba9d0f lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9772 expref: 18 pid: 9168 timeout: 695 lvb_type: 1 00010000:00010000:0.0:1762166975.924016:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166975.924018:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166975.924023:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8200/0x2f180c4effba9dcc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e97b1 expref: 17 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.924032:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8200/0x2f180c4effba9dcc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e97b1 expref: 17 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.924059:0:8398:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8200/0x2f180c4effba9dcc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e97b1 expref: 17 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166975.924071:0:8398:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bbaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8398:1847765449687936:192.168.204.38@tcp:105: 00000100:00100000:0.0:1762166975.924141:0:8398:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7a77600 going to sleep for 11 seconds 00000100:00100000:0.0:1762166975.925117:0:8398:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bbaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8398:1847765449687936:192.168.204.38@tcp:105: 00010000:00010000:0.0:1762166975.925134:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166975.925182:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450344832:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1249us (1503us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166975.925192:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9481 00000100:00100000:2.0:1762166975.925593:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166975.925666:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450344960 00000100:00100000:3.0:1762166975.925673:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450344960 00000100:00100000:3.0:1762166975.925717:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18767 00000100:00100000:3.0:1762166975.925726:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+20:61836:x1847765450344960:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166975.925742:0:9168:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166975.925756:0:9168:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effba9dd3 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e97b8 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.925780:0:9168:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effba9d08 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9779 expref: 21 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166975.925789:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166975.925790:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166975.925794:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effba9dd3 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e97b8 expref: 21 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.925818:0:9168:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effba9d08 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9779 expref: 21 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166975.925830:0:9168:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effba9d08 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9779 expref: 21 pid: 28434 timeout: 695 lvb_type: 1 00000100:00100000:3.0:1762166975.925842:0:9168:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1e6ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9168:1847765449688064:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166975.925900:0:9168:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cee171a80 going to sleep for 11 seconds 00000100:00100000:3.0:1762166975.927293:0:9168:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1e6ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9168:1847765449688064:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166975.927302:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:3.0:1762166975.927319:0:9168:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effba9dd3 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e97b8 expref: 21 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.927333:0:9168:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8472c00, rc 0) 00000100:00100000:0.0:1762166975.927355:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450345088 00000100:00100000:0.0:1762166975.927361:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450345088 00010000:00010000:0.0:1762166975.927384:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effba9d08 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9779 expref: 22 pid: 28434 timeout: 695 lvb_type: 1 00000100:00100000:0.0:1762166975.927411:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9482 00000100:00100000:3.0:1762166975.927417:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+22:61836:x1847765450344960:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1688us (1821us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166975.927428:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4491180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450345088:12345-192.168.204.38@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1762166975.927429:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18767 00010000:00010000:0.0:1762166975.927445:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166975.927463:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effba9d08 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9779 expref: 21 pid: 28434 timeout: 695 lvb_type: 1 00010000:00010000:0.0:1762166975.927502:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effba9d08 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9779 expref: 21 pid: 28434 timeout: 695 lvb_type: 1 00010000:00010000:0.0:1762166975.927523:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effba9d08 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9779 expref: 21 pid: 28434 timeout: 695 lvb_type: 1 00010000:00010000:0.0:1762166975.927535:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166975.927537:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166975.927541:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effba9dd3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e97b8 expref: 20 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.927551:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effba9dd3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e97b8 expref: 20 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.927577:0:8398:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effba9dd3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e97b8 expref: 20 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166975.927594:0:8398:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bbaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8398:1847765449688192:192.168.204.38@tcp:105: 00000100:00100000:0.0:1762166975.927643:0:8398:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7a77600 going to sleep for 11 seconds 00000100:00100000:0.0:1762166975.928922:0:8398:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bbaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8398:1847765449688192:192.168.204.38@tcp:105: 00010000:00010000:0.0:1762166975.928938:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166975.928980:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4491180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450345088:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1561us (1679us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166975.928991:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.928993:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9482 00000100:00100000:1.0:1762166975.929065:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450345344 00000100:00100000:1.0:1762166975.929072:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450345344 00000100:00100000:2.0:1762166975.929076:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166975.929121:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450345216 00000100:00100000:1.0:1762166975.929126:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450345216 00000100:00100000:2.0:1762166975.929144:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166975.929149:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18768 00000100:00100000:1.0:1762166975.929159:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450345344:12345-192.168.204.38@tcp:2:lfs.0 00000100:00100000:2.0:1762166975.929181:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450345472 00000100:00100000:2.0:1762166975.929186:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450345472 00000100:00100000:0.0:1762166975.929203:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18769 00000100:00100000:0.0:1762166975.929224:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450345216:12345-192.168.204.38@tcp:2:lfs.0 00000100:00100000:2.0:1762166975.929232:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18770 00000100:00100000:2.0:1762166975.929250:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450345472:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:1.0:1762166975.929311:0:9168:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166975.929316:0:9168:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166975 -> 1762166975 00002000:00010000:1.0:1762166975.929320:0:9168:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00002000:00010000:1.0:1762166975.929322:0:9168:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166975 -> 1762166976 00002000:00010000:2.0:1762166975.929325:0:28434:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166975.929326:0:9168:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00002000:00010000:2.0:1762166975.929333:0:28434:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166975 -> 1762166975 00002000:00010000:2.0:1762166975.929338:0:28434:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00002000:00010000:2.0:1762166975.929340:0:28434:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166975 -> 1762166976 00002000:00010000:2.0:1762166975.929343:0:28434:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1762166975.929381:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765450345472:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 130us (249us total) trans 17179876184 rc 0/0 00000100:00100000:1.0:1762166975.929384:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450345344:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 218us (389us total) trans 21474843180 rc 0/0 00002000:00010000:0.0:1762166975.929385:0:8380:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 250794 -> 250794 00000100:00100000:2.0:1762166975.929394:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18770 00002000:00010000:0.0:1762166975.929396:0:8380:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166975 -> 1762166975 00002000:00010000:0.0:1762166975.929405:0:8380:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00002000:00010000:0.0:1762166975.929409:0:8380:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166975 -> 1762166976 00000100:00100000:1.0:1762166975.929417:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18768 00002000:00010000:0.0:1762166975.929418:0:8380:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 384 -> 384 00000100:00100000:0.0:1762166975.929475:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450345216:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 258us (399us total) trans 17179876185 rc 0/0 00000100:00100000:0.0:1762166975.929521:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18769 00000100:00100000:3.0:1762166975.930779:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166975.930848:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450345728 00000100:00100000:1.0:1762166975.930854:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450345728 00000100:00100000:1.0:1762166975.930897:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11791 00000100:00100000:1.0:1762166975.930922:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+531:61836:x1847765450345728:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:1.0:1762166975.930989:0:19593:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x240000404:0x5eb:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63000/0x2f180c4effba9cde lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9764 expref: 531 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166975.931021:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63400/0x2f180c4effba9dda lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166975.931030:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7ba00/0x2f180c4effba9bf7 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9710 expref: 531 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166975.931036:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effba9c28 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e971e expref: 531 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166975.931041:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63400/0x2f180c4effba9dda lrc: 5/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166975.931061:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effba9c28 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e971e expref: 531 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166975.931069:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effba9c28 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e971e expref: 531 pid: 6495 timeout: 695 lvb_type: 0 00000100:00100000:1.0:1762166975.931079:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4493800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449688320:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166975.931142:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7ba00/0x2f180c4effba9bf7 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9710 expref: 531 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166975.931151:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7ba00/0x2f180c4effba9bf7 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9710 expref: 531 pid: 6494 timeout: 695 lvb_type: 0 00000100:00100000:1.0:1762166975.931159:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a2aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449688448:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166975.931181:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc3731a80 going to sleep for 11 seconds 00000100:00100000:1.0:1762166975.932362:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4493800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449688320:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166975.932375:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a2aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449688448:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166975.932391:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63400/0x2f180c4effba9dda lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:3.0:1762166975.932609:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166975.932676:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166975.932716:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450346112 00000100:00100000:0.0:1762166975.932719:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450345856 00000100:00100000:2.0:1762166975.932723:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450346112 00000100:00100000:0.0:1762166975.932726:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450345856 00010000:00010000:0.0:1762166975.932757:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7ba00/0x2f180c4effba9bf7 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9710 expref: 533 pid: 6494 timeout: 695 lvb_type: 0 00000100:00100000:2.0:1762166975.932773:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11792 00000100:00100000:2.0:1762166975.932783:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+533:56426:x1847765450346112:12345-192.168.204.38@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1762166975.932799:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9483 00000100:00100000:0.0:1762166975.932809:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf9d1d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+533:2418:x1847765450345856:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166975.932821:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166975.932828:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7ba00/0x2f180c4effba9bf7 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9710 expref: 533 pid: 6494 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166975.932839:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7ba00/0x2f180c4effba9bf7 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9710 expref: 533 pid: 6494 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166975.932856:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7ba00/0x2f180c4effba9bf7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9710 expref: 533 pid: 6494 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166975.932872:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166975.932877:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63400/0x2f180c4effba9dda lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166975.932885:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63400/0x2f180c4effba9dda lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166975.932890:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166975.932943:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf9d1d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+533:2418:x1847765450345856:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 135us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166975.932952:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9483 00000100:00100000:2.0:1762166975.932979:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+532:56426:x1847765450346112:12345-192.168.204.38@tcp:35:ldlm_bl.0 Request processed in 196us (369us total) trans 4294991834 rc 0/0 00000100:00100000:2.0:1762166975.932987:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11792 00000100:00100000:3.0:1762166975.933976:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.934046:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450346240 00000100:00100000:0.0:1762166975.934051:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450346240 00010000:00010000:0.0:1762166975.934075:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effba9c28 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e971e expref: 532 pid: 6495 timeout: 695 lvb_type: 0 00000100:00100000:0.0:1762166975.934111:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9484 00000100:00100000:0.0:1762166975.934119:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+532:2419:x1847765450346240:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166975.934128:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166975.934133:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effba9c28 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e971e expref: 532 pid: 6495 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166975.934144:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effba9c28 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e971e expref: 532 pid: 6495 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166975.934159:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effba9c28 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e971e expref: 532 pid: 6495 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166975.934174:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166975.934179:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63400/0x2f180c4effba9dda lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166975.934187:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63400/0x2f180c4effba9dda lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166975.934194:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63400/0x2f180c4effba9dda lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166975.934223:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166975.934265:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+531:2419:x1847765450346240:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 141us (285us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166975.934268:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63400/0x2f180c4effba9dda lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:0.0:1762166975.934281:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9484 00010000:00010000:1.0:1762166975.934297:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63400/0x2f180c4effba9dda lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166975.934334:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effba9de1 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x607:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166975.934352:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63a00/0x2f180c4effba9d2b lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x607:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9787 expref: 530 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166975.934361:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effba9de1 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x607:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166975.934405:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63a00/0x2f180c4effba9d2b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x607:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9787 expref: 530 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166975.934422:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63a00/0x2f180c4effba9d2b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x607:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9787 expref: 530 pid: 6495 timeout: 695 lvb_type: 0 00000100:00100000:1.0:1762166975.934438:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a2aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449688576:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166975.934577:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc3731a80 going to sleep for 11 seconds 00000100:00100000:1.0:1762166975.936542:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a2aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449688576:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166975.936573:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effba9de1 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x607:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:3.0:1762166975.936835:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.936925:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450346368 00000100:00100000:0.0:1762166975.936933:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450346368 00010000:00010000:0.0:1762166975.936971:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63a00/0x2f180c4effba9d2b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x607:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9787 expref: 531 pid: 6495 timeout: 695 lvb_type: 0 00000100:00100000:0.0:1762166975.937018:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9485 00000100:00100000:0.0:1762166975.937031:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+531:2418:x1847765450346368:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166975.937050:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166975.937058:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63a00/0x2f180c4effba9d2b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x607:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9787 expref: 531 pid: 6495 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166975.937071:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63a00/0x2f180c4effba9d2b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x607:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9787 expref: 531 pid: 6495 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166975.937096:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63a00/0x2f180c4effba9d2b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x607:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9787 expref: 531 pid: 6495 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166975.937114:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x607:0x0].0x0 (ffff945bc812e500) 00010000:00010000:0.0:1762166975.937118:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effba9de1 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x607:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166975.937126:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effba9de1 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x607:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166975.937131:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effba9de1 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x607:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166975.937155:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166975.937179:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effba9de1 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x607:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166975.937189:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effba9de1 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x607:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:0.0:1762166975.937212:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+530:2418:x1847765450346368:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 183us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166975.937221:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9485 00000100:00100000:1.0:1762166975.937768:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a2aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449688704:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166975.937820:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166975.937860:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc3731a80 going to sleep for 11 seconds 00000100:00100000:3.0:1762166975.937940:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449688704 00000100:00100000:3.0:1762166975.937957:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449688704 00000100:00100000:3.0:1762166975.938027:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1304 00000100:00100000:3.0:1762166975.938038:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449688704:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166975.938173:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449688704:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 136us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166975.938182:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1304 00000100:00100000:1.0:1762166975.938214:0:19593:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 17179876182 gen 2 00000004:00080000:1.0:1762166975.938223:0:19593:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc7d21c00, transno 17179876159 00000004:00080000:1.0:1762166975.938249:0:19593:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc7d21180, transno 17179876160 00000004:00080000:1.0:1762166975.938253:0:19593:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc7d20380, transno 17179876161 00000004:00080000:1.0:1762166975.938255:0:19593:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc7d22300, transno 17179876162 00000004:00080000:1.0:1762166975.938258:0:19593:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc7d22a00, transno 17179876163 00000004:00080000:1.0:1762166975.938261:0:19593:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc5bc2a00, transno 17179876164 00000004:00080000:1.0:1762166975.938264:0:19593:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc5bc3480, transno 17179876165 00000004:00080000:1.0:1762166975.938267:0:19593:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc5bc1880, transno 17179876166 00000004:00080000:1.0:1762166975.938270:0:19593:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc5bc2680, transno 17179876167 00000004:00080000:1.0:1762166975.938272:0:19593:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc5bc0700, transno 17179876168 00000004:00080000:1.0:1762166975.938284:0:19593:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 17179876179 committed transno 17179876182 00000004:00080000:1.0:1762166975.938306:0:19593:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf79e8000, transno 17179876182 00000100:00100000:1.0:1762166975.938313:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a2aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449688704:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166975.938361:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a2aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449688832:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166975.938391:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1762166975.938406:0:9994:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0001: 0 changes, 1 in progress, 0 in flight, 10 done 00000100:00100000:1.0:1762166975.938419:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cd123b480 going to sleep for 11 seconds 00000100:00100000:3.0:1762166975.938452:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449688832 00000100:00100000:3.0:1762166975.938458:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449688832 00000100:00100000:3.0:1762166975.938509:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1305 00000100:00100000:3.0:1762166975.938516:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:19593:x1847765449688832:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166975.938607:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:19593:x1847765449688832:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 90us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166975.938614:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1305 00000100:00100000:1.0:1762166975.938686:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a2aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449688832:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166975.938783:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a2aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449688960:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166975.938818:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166975.938850:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc56bf600 going to sleep for 11 seconds 00000100:00100000:3.0:1762166975.938879:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449688960 00000100:00100000:3.0:1762166975.938884:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449688960 00000100:00100000:3.0:1762166975.938933:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1306 00000100:00100000:3.0:1762166975.938943:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:19593:x1847765449688960:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166975.939004:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:19593:x1847765449688960:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 65us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166975.939011:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1306 00000100:00100000:1.0:1762166975.939066:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a2aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449688960:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166975.939099:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a2aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449689088:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166975.939122:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166975.939146:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cca8aed80 going to sleep for 11 seconds 00000100:00100000:2.0:1762166975.939215:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449689088 00000100:00100000:2.0:1762166975.939220:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449689088 00000100:00100000:2.0:1762166975.939251:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1307 00000100:00100000:2.0:1762166975.939257:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449689088:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762166975.939320:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449689088:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 63us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166975.939327:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1307 00000100:00100000:1.0:1762166975.939347:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a2aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449689088:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166975.939387:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a2aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449689216:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166975.939409:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166975.939441:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc56bf600 going to sleep for 11 seconds 00000100:00100000:2.0:1762166975.939469:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449689216 00000100:00100000:2.0:1762166975.939474:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449689216 00000100:00100000:2.0:1762166975.939529:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1308 00000100:00100000:2.0:1762166975.939541:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449689216:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166975.939643:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a2aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449689216:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762166975.939644:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449689216:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 109us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166975.939651:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1308 00000100:00100000:1.0:1762166975.939675:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a2aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449689344:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166975.939698:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166975.939722:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cca8aed80 going to sleep for 11 seconds 00000100:00100000:2.0:1762166975.939759:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449689344 00000100:00100000:2.0:1762166975.939764:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449689344 00000100:00100000:2.0:1762166975.939791:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1309 00000100:00100000:2.0:1762166975.939797:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4491180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:19593:x1847765449689344:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762166975.939857:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4491180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:19593:x1847765449689344:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 59us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166975.939863:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1309 00000100:00100000:1.0:1762166975.939903:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a2aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449689344:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166975.939947:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4493800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449689472:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166975.939965:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166975.939983:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cd43f2180 going to sleep for 11 seconds 00000100:00100000:2.0:1762166975.940003:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449689472 00000100:00100000:2.0:1762166975.940045:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449689472 00000100:00100000:2.0:1762166975.940080:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1310 00000100:00100000:2.0:1762166975.940087:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:19593:x1847765449689472:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762166975.940134:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:19593:x1847765449689472:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 48us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166975.940141:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1310 00000100:00100000:1.0:1762166975.940145:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4493800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449689472:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166975.940176:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4493800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449689600:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166975.940198:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166975.940218:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc56bf600 going to sleep for 11 seconds 00000100:00100000:3.0:1762166975.940239:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449689600 00000100:00100000:3.0:1762166975.940244:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449689600 00000100:00100000:3.0:1762166975.940279:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1311 00000100:00100000:3.0:1762166975.940287:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcceb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449689600:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166975.940345:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcceb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449689600:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 59us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166975.940353:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1311 00000100:00100000:1.0:1762166975.940365:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4493800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449689600:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166975.940402:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcceb5f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449689728:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166975.940426:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166975.940441:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cca8aed80 going to sleep for 11 seconds 00000100:00100000:2.0:1762166975.940447:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449689728 00000100:00100000:2.0:1762166975.940453:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449689728 00000100:00100000:2.0:1762166975.940502:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1312 00000100:00100000:2.0:1762166975.940510:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcceb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:19593:x1847765449689728:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762166975.940568:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcceb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:19593:x1847765449689728:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 58us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166975.940576:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1312 00000100:00100000:1.0:1762166975.940585:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcceb5f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449689728:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166975.940621:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcceb5f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449689856:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166975.940646:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166975.940666:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cd43f2180 going to sleep for 11 seconds 00000100:00100000:3.0:1762166975.940693:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449689856 00000100:00100000:3.0:1762166975.940698:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449689856 00000100:00100000:3.0:1762166975.940728:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1313 00000100:00100000:3.0:1762166975.940735:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcceb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449689856:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166975.940793:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcceb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449689856:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 57us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166975.940800:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1313 00000100:00100000:1.0:1762166975.940807:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcceb5f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449689856:0@lo:1000:mdt_rdpg00_003.0 00000040:00080000:1.0:1762166975.940976:0:19593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x2:0x0].41, 640 off63832 00000001:00080000:1.0:1762166975.940983:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294991835 00000100:00100000:1.0:1762166975.941033:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcceb5f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449689984:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166975.941056:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166975.941082:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cd123ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1762166975.941119:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449689984 00000100:00100000:3.0:1762166975.941124:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449689984 00000100:00100000:3.0:1762166975.941159:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1314 00000100:00100000:3.0:1762166975.941166:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcceb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449689984:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166975.941278:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcceb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:19593:x1847765449689984:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 113us (220us total) trans 17179876186 rc 0/0 00000100:00100000:3.0:1762166975.941286:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1314 00000100:00100000:1.0:1762166975.941349:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcceb5f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449689984:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166975.941375:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcceb7800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449690112:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166975.941402:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166975.941423:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc56bf600 going to sleep for 11 seconds 00000100:00100000:2.0:1762166975.941513:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449690112 00000100:00100000:2.0:1762166975.941525:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449690112 00000100:00100000:2.0:1762166975.941582:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1315 00000100:00100000:2.0:1762166975.941591:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcceb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:19593:x1847765449690112:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762166975.941801:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcceb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:19593:x1847765449690112:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 211us (397us total) trans 21474843181 rc 0/0 00000100:00100000:2.0:1762166975.941810:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1315 00000100:00100000:1.0:1762166975.941845:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcceb7800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449690112:0@lo:1000:mdt_rdpg00_003.0 00000001:00080000:1.0:1762166975.941918:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294991836 00010000:00010000:1.0:1762166975.941945:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effba9de1 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x607:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166975.941960:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effba9de1 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x607:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166975.941967:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effba9de1 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x607:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166975.941973:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4b63e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166975.941977:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effba9de1 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x607:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166975.941985:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effba9de1 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x607:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166975.942000:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x607:0x0].0x0 (ffff945bc812e500) 00010000:00010000:1.0:1762166975.942003:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1762166975.942007:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effba9de1 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x607:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166975.942012:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effba9de1 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x607:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166975.942026:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63400/0x2f180c4effba9dda lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166975.942031:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63400/0x2f180c4effba9dda lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166975.942037:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63400/0x2f180c4effba9dda lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166975.942041:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4b63400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166975.942043:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63400/0x2f180c4effba9dda lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166975.942051:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63400/0x2f180c4effba9dda lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166975.942058:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166975.942060:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1762166975.942063:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63400/0x2f180c4effba9dda lrc: 2/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166975.942068:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63400/0x2f180c4effba9dda lrc: 0/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166975.942078:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166975.942081:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762166975.942087:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63000/0x2f180c4effba9cde lrc: 0/0,0 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9764 expref: 532 pid: 6495 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166975.942171:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+531:61836:x1847765450345728:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 11265us (11395us total) trans 4294991837 rc 0/0 00000100:00100000:1.0:1762166975.942180:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11791 00000020:00080000:1.0:1762166975.942185:0:19593:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1762166975.943725:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166975.943795:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450346496 00000100:00100000:1.0:1762166975.943800:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450346496 00000100:00100000:1.0:1762166975.943837:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30252 00000100:00100000:1.0:1762166975.943845:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+531:61836:x1847765450346496:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166975.943863:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166975.943879:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62e00/0x2f180c4effba9de8 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e97bf expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166975.943932:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62e00/0x2f180c4effba9de8 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e97bf expref: 532 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166975.943949:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62e00/0x2f180c4effba9de8 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e97bf expref: 532 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166975.943967:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166975.943970:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166975.943973:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4b62e00, rc 0) 00000100:00100000:1.0:1762166975.944006:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+532:61836:x1847765450346496:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 163us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166975.944011:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30252 00000100:00100000:3.0:1762166975.945805:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166975.945893:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450346752 00000100:00100000:1.0:1762166975.945902:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450346752 00000100:00100000:1.0:1762166975.945966:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11793 00000100:00100000:1.0:1762166975.945974:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+532:61836:x1847765450346752:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:1.0:1762166975.946157:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+533:61836:x1847765450346752:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 182us (360us total) trans 4294991838 rc 0/0 00000100:00100000:1.0:1762166975.946165:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11793 00000100:00100000:2.0:1762166975.947301:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166975.947350:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450347008 00000100:00100000:1.0:1762166975.947356:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450347008 00000100:00100000:1.0:1762166975.947390:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11794 00000100:00100000:1.0:1762166975.947400:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff2f8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+533:61836:x1847765450347008:12345-192.168.204.38@tcp:35:lfs.0 00000004:00080000:1.0:1762166975.947613:0:19593:0:(mdd_object.c:3965:mdd_close()) Object [0x240000404:0x607:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:1.0:1762166975.947682:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63a00/0x2f180c4effba9def lrc: 3/0,1 mode: --/PW res: [0x240000404:0x607:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166975.947696:0:19593:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63a00/0x2f180c4effba9def lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x607:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166975.947714:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63a00/0x2f180c4effba9def lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x607:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166975.947722:0:19593:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63a00/0x2f180c4effba9def lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x607:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166975.947728:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63a00/0x2f180c4effba9def lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x607:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166975.947734:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63a00/0x2f180c4effba9def lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x607:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166975.947763:0:19593:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1762166975.947810:0:6482:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1762166975.947821:0:6482:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63a00/0x2f180c4effba9def lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x607:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166975.947832:0:6482:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4b63a00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166975.947837:0:6482:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63a00/0x2f180c4effba9def lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x607:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166975.947847:0:6482:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63a00/0x2f180c4effba9def lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x607:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166975.947863:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x607:0x0].0x0 (ffff945bc812e500) 00010000:00010000:3.0:1762166975.947866:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1762166975.947870:0:6482:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63a00/0x2f180c4effba9def lrc: 1/0,0 mode: --/PW res: [0x240000404:0x607:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166975.947876:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63a00/0x2f180c4effba9def lrc: 0/0,0 mode: --/PW res: [0x240000404:0x607:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166975.947890:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166975.947892:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166975.947893:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166975.947931:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff2f8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+534:61836:x1847765450347008:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 532us (633us total) trans 4294991839 rc 0/0 00000100:00100000:1.0:1762166975.947941:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11794 00000100:00100000:3.0:1762166975.958558:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166975.958624:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450347136 00000100:00100000:1.0:1762166975.958641:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450347136 00000100:00100000:1.0:1762166975.958698:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30253 00000100:00100000:1.0:1762166975.958712:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+534:61837:x1847765450347136:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166975.958737:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166975.958761:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63000/0x2f180c4effba9df6 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e97c6 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166975.958833:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63400/0x2f180c4effba9dfd lrc: 3/1,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166975.958847:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63400/0x2f180c4effba9dfd lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166975.958858:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63400/0x2f180c4effba9dfd lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166975.958870:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effba9e04 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166975.958877:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effba9e04 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166975.958883:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effba9e04 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166975.959053:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62800/0x2f180c4effba9e0b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166975.959062:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62800/0x2f180c4effba9e0b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166975.959069:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62800/0x2f180c4effba9e0b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:1.0:1762166975.959111:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 250794 00000004:00200000:1.0:1762166975.959116:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166975.959133:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62800/0x2f180c4effba9e0b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166975.959143:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62800/0x2f180c4effba9e0b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166975.959151:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63400/0x2f180c4effba9dfd lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166975.959157:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63400/0x2f180c4effba9dfd lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166975.959162:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63400/0x2f180c4effba9dfd lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166975.959172:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63400/0x2f180c4effba9dfd lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166975.959177:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4b63400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166975.959181:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63400/0x2f180c4effba9dfd lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166975.959189:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63400/0x2f180c4effba9dfd lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166975.959200:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0x0 (ffff945bc812ee00) 00010000:00010000:1.0:1762166975.959204:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166975.959208:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63400/0x2f180c4effba9dfd lrc: 3/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166975.959213:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63400/0x2f180c4effba9dfd lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166975.959225:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effba9e04 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166975.959231:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effba9e04 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166975.959236:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effba9e04 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166975.959241:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4b63e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166975.959244:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effba9e04 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166975.959249:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effba9e04 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166975.959260:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0xdd396665 (ffff945bc812e300) 00010000:00010000:1.0:1762166975.959263:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166975.959265:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effba9e04 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166975.959271:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effba9e04 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166975.959296:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63000/0x2f180c4effba9df6 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e97c6 expref: 536 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166975.959306:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62800/0x2f180c4effba9e0b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e97c6 expref: 535 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166975.959310:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166975.959312:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166975.959313:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4b62800, rc 0) 00000100:00100000:1.0:1762166975.959363:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+535:61837:x1847765450347136:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 656us (814us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166975.959369:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30253 00000100:00100000:3.0:1762166975.961460:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166975.961552:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450347392 00000100:00100000:1.0:1762166975.961564:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450347392 00000100:00100000:1.0:1762166975.961621:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30254 00000100:00100000:1.0:1762166975.961632:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+535:61837:x1847765450347392:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166975.961650:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166975.961669:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63a00/0x2f180c4effba9e12 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e97cd expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166975.961836:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effba9e19 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166975.961849:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effba9e19 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166975.961859:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effba9e19 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:1.0:1762166975.961868:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 250794 00010000:00010000:1.0:1762166975.962014:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63a00/0x2f180c4effba9e12 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e97cd expref: 538 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166975.962044:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effba9e19 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e97cd expref: 537 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166975.962053:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166975.962056:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1762166975.962062:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cb4200, rc 0) 00000100:00100000:1.0:1762166975.962116:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+537:61837:x1847765450347392:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 487us (679us total) trans 4294991840 rc 0/0 00000100:00100000:1.0:1762166975.962123:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30254 00000100:00100000:2.0:1762166975.964272:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166975.964333:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450347648 00000100:00100000:1.0:1762166975.964344:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450347648 00000100:00100000:1.0:1762166975.964401:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30255 00000100:00100000:1.0:1762166975.964413:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+537:61837:x1847765450347648:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166975.964442:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166975.964467:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4e00/0x2f180c4effba9e27 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e97d4 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166975.964623:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc936a800/0x2f180c4effba9e2e lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166975.964638:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc936a800/0x2f180c4effba9e2e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166975.964649:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc936a800/0x2f180c4effba9e2e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:1.0:1762166975.964661:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 250794 00010000:00010000:1.0:1762166975.964791:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4e00/0x2f180c4effba9e27 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e97d4 expref: 540 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166975.964810:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc936a800/0x2f180c4effba9e2e lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e97d4 expref: 539 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166975.964818:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166975.964821:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762166975.964825:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc936a800, rc 0) 00000100:00100000:1.0:1762166975.964894:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+539:61837:x1847765450347648:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 483us (632us total) trans 4294991841 rc 0/0 00000100:00100000:1.0:1762166975.964903:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30255 00000100:00100000:2.0:1762166975.990070:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166975.990155:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450347776 00000100:00100000:3.0:1762166975.990171:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450347776 00000100:00100000:3.0:1762166975.990253:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1993 00000100:00100000:3.0:1762166975.990262:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765450347776:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:3.0:1762166975.990306:0:8388:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effba9e3c lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.990328:0:8388:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc8472000/0x2f180c4effba9dc5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e97aa expref: 22 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.990337:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166975.990339:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166975.990343:0:8388:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effba9e3c lrc: 4/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.990386:0:8388:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc8472000/0x2f180c4effba9dc5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e97aa expref: 22 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.990399:0:8388:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc8472000/0x2f180c4effba9dc5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e97aa expref: 22 pid: 9168 timeout: 695 lvb_type: 0 00000100:00100000:3.0:1762166975.990412:0:8388:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1e6fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:8388:1847765449690240:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166975.990582:0:8388:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cee171a80 going to sleep for 11 seconds 00000100:00100000:2.0:1762166975.991399:0:8388:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1e6fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:8388:1847765449690240:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166975.991424:0:8388:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effba9e3c lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166975.991808:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.991861:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450347904 00000100:00100000:0.0:1762166975.991868:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450347904 00010000:00010000:0.0:1762166975.991895:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472000/0x2f180c4effba9dc5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e97aa expref: 23 pid: 9168 timeout: 695 lvb_type: 0 00000100:00100000:0.0:1762166975.991941:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9486 00000100:00100000:0.0:1762166975.991950:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765450347904:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166975.991964:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166975.992000:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc8472000/0x2f180c4effba9dc5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e97aa expref: 23 pid: 9168 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166975.992018:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc8472000/0x2f180c4effba9dc5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e97aa expref: 23 pid: 9168 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166975.992041:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8472000/0x2f180c4effba9dc5 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e97aa expref: 23 pid: 9168 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166975.992057:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166975.992060:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166975.992065:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effba9e3c lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.992074:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effba9e3c lrc: 4/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.992098:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166975.992119:0:8388:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effba9e3c lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.992128:0:8388:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effba9e3c lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166975.992139:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765450347904:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 188us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166975.992148:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9486 00010000:00010000:3.0:1762166975.993599:0:8388:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effba9e3c lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.993613:0:8388:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effba9e3c lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.993621:0:8388:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effba9e3c lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.993629:0:8388:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8473000 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166975.993634:0:8388:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effba9e3c lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.993642:0:8388:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effba9e3c lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.993656:0:8388:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effba9e3c lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.993663:0:8388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effba9e3c lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166975.993735:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450347776:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 3472us (3673us total) trans 0 rc 250794/250794 00000100:00100000:3.0:1762166975.993745:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1993 00000100:00100000:3.0:1762166975.996198:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166975.996233:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.996262:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450348032 00000100:00100000:0.0:1762166975.996274:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450348032 00000100:00100000:1.0:1762166975.996294:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450348160 00000100:00100000:1.0:1762166975.996301:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450348160 00000100:00100000:0.0:1762166975.996326:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18771 00000100:00100000:0.0:1762166975.996337:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450348032:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166975.996355:0:8380:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1762166975.996361:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18772 00000100:00100000:1.0:1762166975.996374:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450348160:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166975.996379:0:8380:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effba9e43 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e97db expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166975.996385:0:9168:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166975.996397:0:9168:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc936b200/0x2f180c4effba9e4a lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa87:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e97e2 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166975.996455:0:8380:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bb9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8380:1847765449690368:192.168.204.38@tcp:106: 00000100:00100000:1.0:1762166975.996456:0:9168:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4493800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9168:1847765449690496:192.168.204.38@tcp:106: 00000100:00100000:1.0:1762166975.996566:0:9168:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc56bf600 going to sleep for 11 seconds 00000100:00100000:0.0:1762166975.996566:0:8380:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7a770c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166975.997425:0:9168:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4493800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9168:1847765449690496:192.168.204.38@tcp:106: 00000100:00100000:0.0:1762166975.997425:0:8380:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bb9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8380:1847765449690368:192.168.204.38@tcp:106: 00010000:00010000:1.0:1762166975.997458:0:9168:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc936b200/0x2f180c4effba9e4a lrc: 1/0,0 mode: --/PR res: [0x2c0000400:0xa87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e97e2 expref: 22 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166975.997460:0:8380:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effba9e43 lrc: 1/0,0 mode: --/PR res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e97db expref: 19 pid: 8380 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166975.997506:0:9168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc936b200/0x2f180c4effba9e4a lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e97e2 expref: 22 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166975.997506:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effba9e43 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e97db expref: 19 pid: 8380 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166975.997532:0:8380:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdfe00, rc 0) 00010000:00010000:1.0:1762166975.997538:0:9168:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc936b200, rc 0) 00000100:00100000:1.0:1762166975.997574:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450348160:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1206us (1340us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166975.997578:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450348032:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1241us (1391us total) trans 0 rc 301/301 00000100:00100000:1.0:1762166975.997584:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18772 00000100:00100000:0.0:1762166975.997592:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18771 00000100:00100000:2.0:1762166975.998614:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166975.998644:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450348288 00000100:00100000:3.0:1762166975.998651:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450348288 00000100:00100000:3.0:1762166975.998704:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1994 00000100:00100000:3.0:1762166975.998713:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+18:2416:x1847765450348288:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:3.0:1762166975.998738:0:8388:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc8473a00/0x2f180c4effba9e51 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.998749:0:8388:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8000/0x2f180c4effba9db0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e97a3 expref: 18 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.998755:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166975.998756:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166975.998759:0:8388:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8473a00/0x2f180c4effba9e51 lrc: 4/1,0 mode: --/PR res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.998781:0:8388:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8000/0x2f180c4effba9db0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e97a3 expref: 18 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166975.998795:0:8388:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8000/0x2f180c4effba9db0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e97a3 expref: 18 pid: 9168 timeout: 695 lvb_type: 0 00000100:00100000:3.0:1762166975.998814:0:8388:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1e6ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0000_UUID:8388:1847765449690624:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166975.998866:0:8388:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cee171900 going to sleep for 11 seconds 00000100:00100000:2.0:1762166975.999520:0:8388:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1e6ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0000_UUID:8388:1847765449690624:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166975.999533:0:8388:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bc8473a00/0x2f180c4effba9e51 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166975.999634:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166975.999663:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450348416 00000100:00100000:0.0:1762166975.999667:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450348416 00010000:00010000:0.0:1762166975.999684:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8000/0x2f180c4effba9db0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e97a3 expref: 19 pid: 9168 timeout: 695 lvb_type: 0 00000100:00100000:0.0:1762166975.999707:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9487 00000100:00100000:0.0:1762166975.999713:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450348416:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166975.999721:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166975.999732:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8000/0x2f180c4effba9db0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e97a3 expref: 19 pid: 9168 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166975.999745:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8000/0x2f180c4effba9db0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e97a3 expref: 19 pid: 9168 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166975.999759:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8000/0x2f180c4effba9db0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e97a3 expref: 19 pid: 9168 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166975.999767:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166975.999768:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166975.999779:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc8473a00/0x2f180c4effba9e51 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.999791:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8473a00/0x2f180c4effba9e51 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166975.999816:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166975.999834:0:8388:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bc8473a00/0x2f180c4effba9e51 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166975.999844:0:8388:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc8473a00/0x2f180c4effba9e51 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166975.999851:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450348416:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 137us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166975.999857:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9487 00010000:00010000:3.0:1762166976.001265:0:8388:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc8473a00/0x2f180c4effba9e51 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.001278:0:8388:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8473a00/0x2f180c4effba9e51 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.001286:0:8388:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc8473a00/0x2f180c4effba9e51 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.001292:0:8388:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8473a00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166976.001295:0:8388:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc8473a00/0x2f180c4effba9e51 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.001301:0:8388:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc8473a00/0x2f180c4effba9e51 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.001312:0:8388:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc8473a00/0x2f180c4effba9e51 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.001317:0:8388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc8473a00/0x2f180c4effba9e51 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166976.001371:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+17:2416:x1847765450348288:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 2658us (2757us total) trans 0 rc 250794/250794 00000100:00100000:3.0:1762166976.001379:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1994 00000100:00100000:3.0:1762166976.007948:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166976.008010:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450348544 00000100:00100000:0.0:1762166976.008024:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450348544 00000100:00100000:0.0:1762166976.008088:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 859 00000100:00100000:0.0:1762166976.008098:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+539:61837:x1847765450348544:12345-192.168.204.38@tcp:103:lfs.0 00010000:00010000:0.0:1762166976.008113:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166976.008138:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc936a800/0x2f180c4effba9e2e lrc: 0/0,0 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e97d4 expref: 539 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.008157:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166976.008163:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166976.008217:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+538:61837:x1847765450348544:12345-192.168.204.38@tcp:103:lfs.0 Request processed in 122us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166976.008225:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 859 00000100:00100000:2.0:1762166976.008984:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.009021:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450348800 00000100:00100000:1.0:1762166976.009028:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450348800 00000100:00100000:1.0:1762166976.009069:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11795 00000100:00100000:1.0:1762166976.009077:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+538:61837:x1847765450348800:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:1.0:1762166976.009331:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+539:61837:x1847765450348800:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 254us (347us total) trans 4294991842 rc 0/0 00000100:00100000:1.0:1762166976.009339:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11795 00000100:00100000:2.0:1762166976.011084:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.011124:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450349056 00000100:00100000:1.0:1762166976.011130:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450349056 00000100:00100000:1.0:1762166976.011167:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30256 00000100:00100000:1.0:1762166976.011175:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+539:61766:x1847765450349056:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:1.0:1762166976.011193:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166976.011213:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc936b200/0x2f180c4effba9e58 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e97e9 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.011286:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc936ac00/0x2f180c4effba9e5f lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166976.011298:0:6495:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62800/0x2f180c4effba9e0b lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e97c6 expref: 540 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.011304:0:6495:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc936ac00/0x2f180c4effba9e5f lrc: 4/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166976.011334:0:6495:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62800/0x2f180c4effba9e0b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e97c6 expref: 540 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.011345:0:6495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62800/0x2f180c4effba9e0b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e97c6 expref: 540 pid: 6495 timeout: 695 lvb_type: 0 00000100:00100000:1.0:1762166976.011355:0:6495:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4493800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6495:1847765449690752:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166976.011411:0:6495:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cd123ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1762166976.012125:0:6495:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4493800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6495:1847765449690752:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166976.012144:0:6495:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc936ac00/0x2f180c4effba9e5f lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000100:00100000:2.0:1762166976.012349:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166976.012456:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450349184 00000100:00100000:0.0:1762166976.012464:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450349184 00010000:00010000:0.0:1762166976.012524:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62800/0x2f180c4effba9e0b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e97c6 expref: 541 pid: 6495 timeout: 695 lvb_type: 0 00000100:00100000:0.0:1762166976.012559:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9488 00000100:00100000:0.0:1762166976.012567:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+541:2419:x1847765450349184:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166976.012577:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166976.012583:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62800/0x2f180c4effba9e0b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e97c6 expref: 541 pid: 6495 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166976.012596:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62800/0x2f180c4effba9e0b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e97c6 expref: 541 pid: 6495 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166976.012614:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62800/0x2f180c4effba9e0b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e97c6 expref: 541 pid: 6495 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166976.012625:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166976.012629:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc936ac00/0x2f180c4effba9e5f lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166976.012638:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc936ac00/0x2f180c4effba9e5f lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166976.012646:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc936ac00/0x2f180c4effba9e5f lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166976.012679:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166976.012726:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+540:2419:x1847765450349184:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 159us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166976.012734:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9488 00010000:00010000:1.0:1762166976.012742:0:6495:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc936ac00/0x2f180c4effba9e5f lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166976.012752:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc936ac00/0x2f180c4effba9e5f lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:1.0:1762166976.012779:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 250794 00010000:00010000:1.0:1762166976.012930:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc936b200/0x2f180c4effba9e58 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e97e9 expref: 541 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.012945:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc936ac00/0x2f180c4effba9e5f lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e97e9 expref: 540 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.012953:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.012956:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1762166976.012958:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc936ac00, rc 0) 00000100:00100000:1.0:1762166976.012994:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+540:61766:x1847765450349056:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 1820us (1913us total) trans 4294991843 rc 0/0 00000100:00100000:1.0:1762166976.013002:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30256 00000100:00100000:2.0:1762166976.013924:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.013958:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450349312 00000100:00100000:1.0:1762166976.013962:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450349312 00000100:00100000:1.0:1762166976.013989:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30257 00000100:00100000:1.0:1762166976.013997:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+540:61766:x1847765450349312:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:1.0:1762166976.014013:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166976.014025:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4e00/0x2f180c4effba9e6d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e97f0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.014080:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63a00/0x2f180c4effba9e74 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166976.014088:0:6495:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc936ac00/0x2f180c4effba9e5f lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e97e9 expref: 541 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.014093:0:6495:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63a00/0x2f180c4effba9e74 lrc: 4/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166976.014112:0:6495:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc936ac00/0x2f180c4effba9e5f lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e97e9 expref: 541 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.014120:0:6495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc936ac00/0x2f180c4effba9e5f lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e97e9 expref: 541 pid: 6495 timeout: 695 lvb_type: 0 00000100:00100000:1.0:1762166976.014130:0:6495:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4493800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6495:1847765449690880:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166976.014190:0:6495:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc56bf600 going to sleep for 11 seconds 00000100:00100000:1.0:1762166976.014810:0:6495:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4493800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6495:1847765449690880:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166976.014821:0:6495:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63a00/0x2f180c4effba9e74 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000100:00100000:2.0:1762166976.015018:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166976.015063:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450349440 00000100:00100000:0.0:1762166976.015069:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450349440 00010000:00010000:0.0:1762166976.015088:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc936ac00/0x2f180c4effba9e5f lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e97e9 expref: 542 pid: 6495 timeout: 695 lvb_type: 0 00000100:00100000:0.0:1762166976.015118:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9489 00000100:00100000:0.0:1762166976.015126:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf9d1c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+542:2419:x1847765450349440:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166976.015135:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166976.015140:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc936ac00/0x2f180c4effba9e5f lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e97e9 expref: 542 pid: 6495 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166976.015162:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc936ac00/0x2f180c4effba9e5f lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e97e9 expref: 542 pid: 6495 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166976.015176:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc936ac00/0x2f180c4effba9e5f lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e97e9 expref: 542 pid: 6495 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166976.015187:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166976.015191:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63a00/0x2f180c4effba9e74 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166976.015197:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63a00/0x2f180c4effba9e74 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166976.015208:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63a00/0x2f180c4effba9e74 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166976.015228:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166976.015259:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf9d1c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+541:2419:x1847765450349440:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 133us (242us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166976.015260:0:6495:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63a00/0x2f180c4effba9e74 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000100:00100000:0.0:1762166976.015269:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9489 00010000:00010000:1.0:1762166976.015274:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63a00/0x2f180c4effba9e74 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:1.0:1762166976.015303:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 250794 00000004:00200000:1.0:1762166976.015308:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166976.015322:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63a00/0x2f180c4effba9e74 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166976.015345:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4e00/0x2f180c4effba9e6d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e97f0 expref: 541 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.015358:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63a00/0x2f180c4effba9e74 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e97f0 expref: 540 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.015370:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.015373:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166976.015375:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4b63a00, rc 0) 00000100:00100000:1.0:1762166976.015410:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+540:61766:x1847765450349312:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 1413us (1485us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166976.015420:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30257 00000100:00100000:2.0:1762166976.016314:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166976.016350:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450349568 00000100:00100000:2.0:1762166976.016356:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166976.016357:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450349568 00000100:00100000:0.0:1762166976.016399:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450349696 00000100:00100000:0.0:1762166976.016401:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450349696 00000100:00100000:1.0:1762166976.016425:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18773 00000100:00100000:0.0:1762166976.016433:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18774 00000100:00100000:1.0:1762166976.016441:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+17:2417:x1847765450349568:12345-192.168.204.38@tcp:101:fsx.0 00000100:00100000:0.0:1762166976.016444:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+21:2417:x1847765450349696:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:0.0:1762166976.016455:0:8380:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166976.016458:0:9168:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166976.016465:0:8380:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effba9e7b lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa87:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e97fe expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.016474:0:9168:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4b63000/0x2f180c4effba9e82 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e97f7 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762166976.016515:0:9168:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa88:0x0] initial LVB size: 250794, mtime: 0x690888bf, atime: 0x690888bf, ctime: 0x690888c0, blocks: 0x98 00000100:00100000:0.0:1762166976.016523:0:8380:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bb9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8380:1847765449691008:192.168.204.38@tcp:106: 00010000:00010000:1.0:1762166976.016527:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166976.016530:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00000100:00080000:3.0:1762166976.016534:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1762166976.016536:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4b63000/0x2f180c4effba9e82 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e97f7 expref: 18 pid: 9168 timeout: 0 lvb_type: 1 00000100:00080000:3.0:1762166976.016541:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1762166976.016552:0:9168:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc4b63000/0x2f180c4effba9e82 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e97f7 expref: 18 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166976.016563:0:9168:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4b63000, rc 0) 00000100:00100000:0.0:1762166976.016592:0:8380:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc4eea540 going to sleep for 11 seconds 00000100:00100000:1.0:1762166976.016595:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+18:2417:x1847765450349568:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 160us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166976.016609:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18773 00000100:00100000:0.0:1762166976.017319:0:8380:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bb9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8380:1847765449691008:192.168.204.38@tcp:106: 00010000:00010000:0.0:1762166976.017336:0:8380:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effba9e7b lrc: 1/0,0 mode: --/PR res: [0x2c0000400:0xa87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e97fe expref: 22 pid: 8380 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166976.017349:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effba9e7b lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e97fe expref: 22 pid: 8380 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166976.017362:0:8380:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdfe00, rc 0) 00000100:00100000:0.0:1762166976.017393:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+21:2417:x1847765450349696:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 953us (1039us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166976.017400:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18774 00000100:00100000:2.0:1762166976.018233:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.018274:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450349952 00000100:00100000:1.0:1762166976.018281:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450349952 00000100:00100000:1.0:1762166976.018317:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11796 00000100:00100000:1.0:1762166976.018328:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+540:61766:x1847765450349952:12345-192.168.204.38@tcp:35:fsx.0 00000100:00100000:1.0:1762166976.018468:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+541:61766:x1847765450349952:12345-192.168.204.38@tcp:35:fsx.0 Request processed in 145us (237us total) trans 4294991844 rc 0/0 00000100:00100000:1.0:1762166976.018474:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11796 00000100:00100000:2.0:1762166976.019131:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.019178:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450350208 00000100:00100000:1.0:1762166976.019184:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450350208 00000100:00100000:1.0:1762166976.019219:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30258 00000100:00100000:1.0:1762166976.019229:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+541:61766:x1847765450350208:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:1.0:1762166976.019241:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166976.019244:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 1 00010000:00010000:1.0:1762166976.019258:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63a00/0x2f180c4effba9e74 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e97f0 expref: 541 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.019276:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effba9e19 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e97cd expref: 540 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.019290:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62e00/0x2f180c4effba9de8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e97bf expref: 539 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.019298:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.019302:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166976.019310:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effba9e89 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9805 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.019337:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63400/0x2f180c4effba9e90 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166976.019347:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63400/0x2f180c4effba9e90 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166976.019355:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63400/0x2f180c4effba9e90 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000040:00080000:1.0:1762166976.019587:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5856, 88 off458288 00000004:00080000:1.0:1762166976.019597:0:6495:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 595168118454ns, next at 595897461133ns, rc = 0 00000040:00080000:1.0:1762166976.019642:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5855, 88 off458288 00000004:00080000:1.0:1762166976.019651:0:6495:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 595168173206ns, next at 595897495953ns, rc = 0 00000040:00080000:1.0:1762166976.019684:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5856, 88 off458376 00000004:00080000:1.0:1762166976.019690:0:6495:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 595168212643ns, next at 595897495953ns, rc = 0 00000040:00080000:1.0:1762166976.019706:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5857, 88 off458376 00000004:00080000:1.0:1762166976.019711:0:6495:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 595168233161ns, next at 595897461133ns, rc = 0 00000040:00080000:1.0:1762166976.019734:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5858, 88 off458464 00000004:00080000:1.0:1762166976.019740:0:6495:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 595168262118ns, next at 595897461133ns, rc = 0 00000040:00080000:1.0:1762166976.019759:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5857, 88 off458464 00000004:00080000:1.0:1762166976.019764:0:6495:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 595168285843ns, next at 595897495953ns, rc = 0 00000040:00080000:1.0:1762166976.019782:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5858, 88 off458552 00000004:00080000:1.0:1762166976.019786:0:6495:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 595168308578ns, next at 595897495953ns, rc = 0 00000040:00080000:1.0:1762166976.019804:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5859, 88 off458552 00000004:00080000:1.0:1762166976.019808:0:6495:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 595168330313ns, next at 595897461133ns, rc = 0 00000040:00080000:1.0:1762166976.019835:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5859, 88 off458640 00000004:00080000:1.0:1762166976.019841:0:6495:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 595168362998ns, next at 595897495953ns, rc = 0 00000040:00080000:1.0:1762166976.019864:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5860, 88 off458640 00000004:00080000:1.0:1762166976.019869:0:6495:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 595168391728ns, next at 595897461133ns, rc = 0 00000001:00080000:3.0:1762166976.020769:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294991845 is committed 00000004:00080000:3.0:1762166976.020774:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3226 committed 00000004:00080000:3.0:1762166976.020781:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3229 committed 00000004:00080000:3.0:1762166976.020786:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3225 committed 00000004:00080000:3.0:1762166976.020787:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3228 committed 00000004:00080000:3.0:1762166976.020789:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3227 committed 00000004:00080000:3.0:1762166976.020791:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3224 committed 00000004:00080000:3.0:1762166976.020793:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3223 committed 00000004:00080000:3.0:1762166976.020794:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3226 committed 00000004:00080000:3.0:1762166976.020797:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3225 committed 00000004:00080000:3.0:1762166976.020799:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3222 committed 00010000:00010000:1.0:1762166976.020799:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62000/0x2f180c4effba9da9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x607:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166976.020811:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62000/0x2f180c4effba9da9 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x607:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166976.020819:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62000/0x2f180c4effba9da9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x607:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00000020:00080000:3.0:1762166976.020825:0:7412:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff945cee014e40 refcount 2 committed 0 result 0 batchid 43 00010000:00010000:1.0:1762166976.020825:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4b62000 already unused, calling callback (ffffffffc18e2310) 00000020:00080000:3.0:1762166976.020833:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cc9df1700 obd lustre-OST0001-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff945d011c7e40 00010000:00010000:1.0:1762166976.020834:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62000/0x2f180c4effba9da9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x607:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00000020:00080000:3.0:1762166976.020842:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945bc5e1e700 obd lustre-OST0000-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff945bc3731a80 00010000:00010000:1.0:1762166976.020847:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62000/0x2f180c4effba9da9 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x607:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00000020:00080000:3.0:1762166976.020851:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945bc5e1eb00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff945bc48b5400 00000020:00080000:3.0:1762166976.020857:0:7412:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000400:0x2:0x0].41 00010000:00010000:1.0:1762166976.020860:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x607:0x0].0x0 (ffff945bc812e500) 00010000:00010000:1.0:1762166976.020865:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166976.020870:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62000/0x2f180c4effba9da9 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x607:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166976.020876:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62000/0x2f180c4effba9da9 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x607:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000020:00080000:3.0:1762166976.020877:0:7412:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0001: 42 batchid updated 00000020:00080000:3.0:1762166976.020919:0:7435:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 43 committed batchid 42 00010000:00010000:1.0:1762166976.020921:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62c00/0x2f180c4effba9dbe lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166976.020933:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62c00/0x2f180c4effba9dbe lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166976.020940:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62c00/0x2f180c4effba9dbe lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166976.020947:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4b62c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166976.020953:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62c00/0x2f180c4effba9dbe lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166976.020967:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62c00/0x2f180c4effba9dbe lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166976.020981:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.020985:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762166976.020986:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449691136:0@lo:2:osp-syn-0-1.0 00010000:00010000:1.0:1762166976.020989:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62c00/0x2f180c4effba9dbe lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166976.020998:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62c00/0x2f180c4effba9dbe lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000020:00080000:3.0:1762166976.021010:0:7435:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 42 cancel update log [0x240000400:0x2:0x0].40: rc = 0 00000020:00080000:3.0:1762166976.021019:0:7435:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 42 00000100:00100000:0.0:1762166976.021031:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166976.021042:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449691392:0@lo:2:osp-syn-0-1.0 00010000:00010000:1.0:1762166976.021043:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63400/0x2f180c4effba9e90 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9805 expref: 525 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.021055:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.021058:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000100:00100000:0.0:1762166976.021069:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7d21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449691648:0@lo:2:osp-syn-1-1.0 00010000:00010000:1.0:1762166976.021071:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effba9e89 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9805 expref: 525 pid: 6495 timeout: 0 lvb_type: 3 00000100:00100000:3.0:1762166976.021078:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1762166976.021099:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63400/0x2f180c4effba9e90 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9805 expref: 524 pid: 6495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166976.021101:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449691136 00000100:00100000:2.0:1762166976.021112:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449691136 00000100:00100000:0.0:1762166976.021112:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166976.021113:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7d21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449691904:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1762166976.021140:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449691392 00000100:00100000:0.0:1762166976.021144:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7d20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449692160:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1762166976.021145:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449691392 00000100:00100000:3.0:1762166976.021152:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166976.021188:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1762166976.021194:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166976.021199:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449691520:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1762166976.021201:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449691648 00000100:00100000:2.0:1762166976.021208:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449691648 00000100:00100000:1.0:1762166976.021216:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449691904 00000100:00100000:1.0:1762166976.021219:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449691904 00000100:00100000:3.0:1762166976.021225:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166976.021235:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1762166976.021246:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449691264:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166976.021250:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449692032:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1762166976.021262:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449692160 00000100:00100000:1.0:1762166976.021265:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449691520 00000100:00100000:2.0:1762166976.021268:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449692160 00000100:00100000:1.0:1762166976.021269:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449691520 00000100:00100000:3.0:1762166976.021279:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166976.021317:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449692032 00000100:00100000:1.0:1762166976.021320:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449692032 00000100:00100000:2.0:1762166976.021330:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18775 00000100:00100000:3.0:1762166976.021352:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18776 00000100:00100000:2.0:1762166976.021354:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+9:3635:x1847765449691136:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166976.021365:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+9:3633:x1847765449691392:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1762166976.021366:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18777 00000100:00100000:1.0:1762166976.021381:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18778 00000100:00100000:0.0:1762166976.021383:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+9:3635:x1847765449691648:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1762166976.021392:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+9:3633:x1847765449691904:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:3.0:1762166976.021465:0:28874:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166976.021468:0:28874:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166976.021470:0:28874:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166976.021472:0:28874:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:3.0:1762166976.021474:0:28874:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00002000:00010000:0.0:1762166976.021509:0:35247:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa82:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:0.0:1762166976.021514:0:35247:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa82:0x0] updating lvb mtime from disk: 1762166975 -> 1762166975 00002000:00010000:0.0:1762166976.021517:0:35247:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa82:0x0] updating lvb atime from disk: 1762166972 -> 1762166972 00002000:00010000:0.0:1762166976.021519:0:35247:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa82:0x0] updating lvb ctime from disk: 1762166975 -> 1762166975 00002000:00010000:0.0:1762166976.021524:0:35247:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa82:0x0] updating lvb blocks from disk: 208 -> 208 00002000:00010000:1.0:1762166976.021528:0:8383:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:3.0:1762166976.021533:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+11:3633:x1847765449691392:12345-0@lo:2:osp-syn-0-1.0 Request processed in 171us (455us total) trans 21474843182 rc 0/0 00002000:00010000:1.0:1762166976.021535:0:8383:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb mtime from disk: 1762166975 -> 1762166975 00002000:00010000:1.0:1762166976.021541:0:8383:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb atime from disk: 1762166973 -> 1762166973 00000100:00100000:3.0:1762166976.021543:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18776 00002000:00010000:1.0:1762166976.021547:0:8383:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb ctime from disk: 1762166975 -> 1762166975 00002000:00010000:1.0:1762166976.021550:0:8383:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:2.0:1762166976.021560:0:8380:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:3.0:1762166976.021566:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18779 00000100:00100000:0.0:1762166976.021573:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+11:3635:x1847765449691648:12345-0@lo:2:osp-syn-1-1.0 Request processed in 188us (457us total) trans 17179876187 rc 0/0 00002000:00010000:2.0:1762166976.021574:0:8380:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb mtime from disk: 1762166966 -> 1762166966 00002000:00010000:2.0:1762166976.021578:0:8380:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1762166976.021585:0:8380:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb ctime from disk: 1762166966 -> 1762166966 00000100:00100000:3.0:1762166976.021586:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+11:3633:x1847765449691520:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1762166976.021596:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+11:3633:x1847765449691904:12345-0@lo:2:osp-syn-1-1.0 Request processed in 201us (438us total) trans 17179876188 rc 0/0 00002000:00010000:2.0:1762166976.021600:0:8380:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1762166976.021617:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18777 00000100:00100000:1.0:1762166976.021624:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18778 00002000:00010000:3.0:1762166976.021656:0:28874:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:0.0:1762166976.021659:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18780 00002000:00010000:3.0:1762166976.021662:0:28874:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166975 -> 1762166975 00000100:00100000:2.0:1762166976.021667:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+10:3635:x1847765449691136:12345-0@lo:2:osp-syn-0-1.0 Request processed in 323us (630us total) trans 21474843183 rc 0/0 00002000:00010000:3.0:1762166976.021674:0:28874:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00000100:00100000:1.0:1762166976.021682:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18781 00002000:00010000:3.0:1762166976.021683:0:28874:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00000100:00100000:0.0:1762166976.021684:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+10:3635:x1847765449692160:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:3.0:1762166976.021688:0:28874:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1762166976.021697:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18775 00000100:00100000:1.0:1762166976.021700:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+10:3633:x1847765449692032:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166976.021732:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+10:3633:x1847765449691520:12345-0@lo:2:osp-syn-1-1.0 Request processed in 153us (504us total) trans 17179876189 rc 0/0 00000100:00100000:3.0:1762166976.021744:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18779 00002000:00010000:0.0:1762166976.021764:0:35247:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166976.021769:0:35247:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb mtime from disk: 1762166975 -> 1762166975 00002000:00010000:0.0:1762166976.021773:0:35247:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00002000:00010000:0.0:1762166976.021776:0:35247:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:0.0:1762166976.021779:0:35247:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb blocks from disk: 0 -> 0 00000004:00080000:3.0:1762166976.021792:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf783dc00/2, rc 0, transno 17179876189 00000100:00100000:3.0:1762166976.021796:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449691520:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1762166976.021809:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc5bbaa00/2, rc 0, transno 21474843182 00000100:00100000:3.0:1762166976.021812:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449691392:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1762166976.021822:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+10:3635:x1847765449692160:12345-0@lo:2:osp-syn-1-1.0 Request processed in 142us (635us total) trans 17179876190 rc 0/0 00000100:00100000:1.0:1762166976.021823:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+10:3633:x1847765449692032:12345-0@lo:2:osp-syn-0-1.0 Request processed in 129us (543us total) trans 21474843184 rc 0/0 00000004:00080000:3.0:1762166976.021825:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc7d21180/2, rc 0, transno 17179876188 00000100:00100000:3.0:1762166976.021835:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7d21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449691904:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1762166976.021837:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18780 00000100:00100000:1.0:1762166976.021846:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18781 00000004:00080000:3.0:1762166976.021854:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc5bb8380/2, rc 0, transno 21474843184 00000100:00100000:3.0:1762166976.021860:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449692032:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1762166976.021876:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1762166976.021885:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.021888:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1762166976.021891:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4b63400, rc 0) 00000100:00100000:0.0:1762166976.021923:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449691776:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1762166976.021946:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449691264 00000100:00100000:1.0:1762166976.021947:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+524:61766:x1847765450350208:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 2717us (2815us total) trans 4294991845 rc 0/0 00000100:00100000:2.0:1762166976.021956:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449691264 00000100:00100000:0.0:1762166976.021959:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166976.021971:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30258 00000100:00100000:0.0:1762166976.021996:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449692288:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1762166976.022007:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449691776 00000100:00100000:2.0:1762166976.022014:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449691776 00000100:00100000:1.0:1762166976.022025:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18782 00000100:00100000:1.0:1762166976.022043:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+10:3635:x1847765449691264:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1762166976.022053:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166976.022073:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449692288 00000100:00100000:2.0:1762166976.022078:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449692288 00000004:00080000:0.0:1762166976.022107:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc5bb9c00/2, rc 0, transno 21474843183 00000100:00100000:2.0:1762166976.022115:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18783 00000100:00100000:0.0:1762166976.022118:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449691136:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1762166976.022128:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+11:3635:x1847765449691776:12345-0@lo:2:osp-syn-0-1.0 00000004:00080000:0.0:1762166976.022139:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc7d21c00/2, rc 0, transno 17179876187 00000100:00100000:3.0:1762166976.022144:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18784 00000100:00100000:0.0:1762166976.022147:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7d21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449691648:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166976.022155:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+11:3635:x1847765449692288:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1762166976.022155:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+11:3635:x1847765449691264:12345-0@lo:2:osp-syn-1-1.0 Request processed in 117us (275us total) trans 17179876191 rc 0/0 00000004:00080000:0.0:1762166976.022161:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc7d20380/2, rc 0, transno 17179876190 00000100:00100000:0.0:1762166976.022170:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7d20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449692160:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1762166976.022172:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18782 00000004:00080000:0.0:1762166976.022184:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf783ed80/2, rc 0, transno 17179876191 00000100:00100000:0.0:1762166976.022190:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449691264:0@lo:2:osp-syn-1-1.0 00002000:00010000:2.0:1762166976.022211:0:8383:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa83:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166976.022214:0:8383:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa83:0x0] updating lvb mtime from disk: 1762166975 -> 1762166975 00002000:00010000:2.0:1762166976.022216:0:8383:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa83:0x0] updating lvb atime from disk: 1762166972 -> 1762166972 00002000:00010000:2.0:1762166976.022219:0:8383:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa83:0x0] updating lvb ctime from disk: 1762166975 -> 1762166975 00002000:00010000:2.0:1762166976.022221:0:8383:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa83:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:3.0:1762166976.022222:0:35247:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb size from disk: 250794 -> 250794 00002000:00010000:3.0:1762166976.022227:0:35247:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb mtime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166976.022230:0:35247:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166976.022233:0:35247:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:3.0:1762166976.022234:0:35247:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb blocks from disk: 152 -> 152 00000100:00100000:3.0:1762166976.022286:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+13:3635:x1847765449692288:12345-0@lo:2:osp-syn-0-1.0 Request processed in 129us (233us total) trans 21474843186 rc 0/0 00000100:00100000:2.0:1762166976.022287:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+13:3635:x1847765449691776:12345-0@lo:2:osp-syn-0-1.0 Request processed in 156us (326us total) trans 21474843185 rc 0/0 00000100:00100000:3.0:1762166976.022295:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18784 00000004:00080000:0.0:1762166976.022295:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc5bba680/2, rc 0, transno 21474843185 00000100:00100000:0.0:1762166976.022310:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449691776:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1762166976.022315:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18783 00000004:00080000:0.0:1762166976.022335:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc5bb8700/2, rc 0, transno 21474843186 00000100:00100000:0.0:1762166976.022341:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449692288:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166976.023208:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166976.023272:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450350336 00000100:00100000:2.0:1762166976.023279:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450350336 00000100:00100000:2.0:1762166976.023318:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18785 00000100:00100000:2.0:1762166976.023327:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+21:61766:x1847765450350336:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:2.0:1762166976.023336:0:9168:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166976.023350:0:9168:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8800/0x2f180c4effba9e97 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e980c expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166976.023365:0:9168:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa77:0x0] initial LVB size: 250794, mtime: 0x690888bf, atime: 0x690888bf, ctime: 0x690888c0, blocks: 0x180 00010000:00010000:2.0:1762166976.023377:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166976.023379:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166976.023386:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8800/0x2f180c4effba9e97 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 237568->253951) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e980c expref: 22 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.023399:0:9168:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8800/0x2f180c4effba9e97 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 237568->253951) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e980c expref: 22 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.023408:0:9168:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa8800, rc 0) 00000100:00100000:2.0:1762166976.023442:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+22:61766:x1847765450350336:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 117us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166976.023449:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18785 00000100:00100000:3.0:1762166976.024123:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166976.024167:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450350464 00000100:00100000:2.0:1762166976.024171:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450350464 00000100:00100000:2.0:1762166976.024198:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1995 00000100:00100000:2.0:1762166976.024206:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+22:2416:x1847765450350464:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:2.0:1762166976.024326:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 250794 -> 250794 00002000:00010000:2.0:1762166976.024329:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166975 -> 1762166976 00002000:00010000:2.0:1762166976.024330:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00002000:00010000:2.0:1762166976.024332:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:2.0:1762166976.024333:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 384 -> 384 00000100:00100000:2.0:1762166976.024359:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+23:2416:x1847765450350464:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 152us (237us total) trans 17179876192 rc 0/0 00000100:00100000:2.0:1762166976.024365:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1995 00000100:00100000:0.0:1762166976.025135:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.025174:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450350592 00000100:00100000:1.0:1762166976.025180:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450350592 00000100:00100000:1.0:1762166976.025217:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30259 00000100:00100000:1.0:1762166976.025227:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+524:61766:x1847765450350592:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:1.0:1762166976.025240:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166976.025252:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eefa00/0x2f180c4effba9e9e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9813 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.025318:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eefe00/0x2f180c4effba9ea5 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166976.025329:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eefe00/0x2f180c4effba9ea5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166976.025338:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eefe00/0x2f180c4effba9ea5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:1.0:1762166976.025362:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 0 00000004:00200000:1.0:1762166976.025366:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166976.025382:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eefe00/0x2f180c4effba9ea5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166976.025402:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eefa00/0x2f180c4effba9e9e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9813 expref: 526 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.025415:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eefe00/0x2f180c4effba9ea5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9813 expref: 525 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.025424:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.025426:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166976.025429:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc6eefe00, rc 0) 00000100:00100000:1.0:1762166976.025461:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+525:61766:x1847765450350592:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 236us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166976.025469:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30259 00000100:00100000:3.0:1762166976.026814:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.026857:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450350720 00000100:00100000:1.0:1762166976.026863:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450350720 00000100:00100000:1.0:1762166976.026903:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30260 00000100:00100000:1.0:1762166976.026926:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+525:61766:x1847765450350720:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:1.0:1762166976.026936:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166976.026945:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eef800/0x2f180c4effba9eac lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e981a expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.026965:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eee000/0x2f180c4effba9eb3 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166976.026975:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eee000/0x2f180c4effba9eb3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166976.026984:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eee000/0x2f180c4effba9eb3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166976.027058:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eef800/0x2f180c4effba9eac lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e981a expref: 527 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.027072:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eee000/0x2f180c4effba9eb3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e981a expref: 526 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.027079:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.027082:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1762166976.027084:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc6eee000, rc 0) 00000100:00100000:1.0:1762166976.027120:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+526:61766:x1847765450350720:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 195us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166976.027128:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30260 00000100:00100000:3.0:1762166976.028347:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166976.028395:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450350848 00000100:00100000:2.0:1762166976.028403:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450350848 00002000:00100000:2.0:1762166976.028440:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (180224->184319) req@ffff945bc55df480 x1847765450350848/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:7/0 lens 488/0 e 0 to 0 dl 1762166987 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166976.028447:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc55df480 with x1847765450350848 ext(180224->184319) 00002000:00010000:2.0:1762166976.028452:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc55df480 00000100:00100000:2.0:1762166976.028497:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1996 00000100:00100000:2.0:1762166976.028504:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+23:2417:x1847765450350848:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:2.0:1762166976.028663:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+23:2417:x1847765450350848:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 160us (322us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1762166976.028669:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1996 00002000:00100000:2.0:1762166976.028674:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (180224->184319) req@ffff945bc55df480 x1847765450350848/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:7/0 lens 488/4536 e 0 to 0 dl 1762166987 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166976.028682:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc55df480 with x1847765450350848 ext(180224->184319) 00002000:00010000:2.0:1762166976.028686:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc55df480 00000100:00100000:0.0:1762166976.029859:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166976.029899:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450350976 00000100:00100000:2.0:1762166976.029915:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450350976 00002000:00100000:2.0:1762166976.029936:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (208896->212991) req@ffff945cf1cd2680 x1847765450350976/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:7/0 lens 488/0 e 0 to 0 dl 1762166987 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166976.029943:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1cd2680 with x1847765450350976 ext(208896->212991) 00002000:00010000:2.0:1762166976.029946:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1cd2680 00000100:00100000:2.0:1762166976.029962:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1997 00000100:00100000:2.0:1762166976.029967:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+23:2416:x1847765450350976:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:2.0:1762166976.030046:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+23:2416:x1847765450350976:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 78us (191us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1762166976.030051:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1997 00002000:00100000:2.0:1762166976.030055:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (208896->212991) req@ffff945cf1cd2680 x1847765450350976/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:7/0 lens 488/4536 e 0 to 0 dl 1762166987 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166976.030061:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1cd2680 with x1847765450350976 ext(208896->212991) 00002000:00010000:2.0:1762166976.030064:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1cd2680 00000100:00100000:3.0:1762166976.032375:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166976.032442:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450351104 00000100:00100000:2.0:1762166976.032452:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450351104 00002000:00100000:2.0:1762166976.032525:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (212992->253951) req@ffff945bc55de680 x1847765450351104/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:7/0 lens 488/0 e 0 to 0 dl 1762166987 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166976.032536:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc55de680 with x1847765450351104 ext(212992->253951) 00002000:00010000:2.0:1762166976.032542:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc55de680 00000100:00100000:2.0:1762166976.032569:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1998 00000100:00100000:2.0:1762166976.032578:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+23:2417:x1847765450351104:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:2.0:1762166976.033762:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+23:2417:x1847765450351104:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 1183us (1391us total) trans 0 rc 40960/40960 00000100:00100000:2.0:1762166976.033771:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1998 00002000:00100000:2.0:1762166976.033779:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (212992->253951) req@ffff945bc55de680 x1847765450351104/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:7/0 lens 488/440 e 0 to 0 dl 1762166987 ref 1 fl Complete:/600/0 rc 40960/40960 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166976.033788:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc55de680 with x1847765450351104 ext(212992->253951) 00002000:00010000:2.0:1762166976.033792:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc55de680 00000100:00100000:0.0:1762166976.036096:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166976.036143:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450351232 00000100:00100000:2.0:1762166976.036151:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450351232 00002000:00100000:2.0:1762166976.036182:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (49152->114687) req@ffff945cf1cd1c00 x1847765450351232/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:7/0 lens 488/0 e 0 to 0 dl 1762166987 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166976.036192:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1cd1c00 with x1847765450351232 ext(49152->114687) 00002000:00010000:2.0:1762166976.036196:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1cd1c00 00000100:00100000:2.0:1762166976.036224:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 1999 00000100:00100000:2.0:1762166976.036236:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+23:2416:x1847765450351232:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:2.0:1762166976.037469:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+23:2416:x1847765450351232:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 1236us (1378us total) trans 0 rc 65536/65536 00000100:00100000:2.0:1762166976.037494:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 1999 00002000:00100000:2.0:1762166976.037501:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (49152->114687) req@ffff945cf1cd1c00 x1847765450351232/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:7/0 lens 488/440 e 0 to 0 dl 1762166987 ref 1 fl Complete:/600/0 rc 65536/65536 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166976.037507:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1cd1c00 with x1847765450351232 ext(49152->114687) 00002000:00010000:2.0:1762166976.037510:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1cd1c00 00000100:00100000:3.0:1762166976.041083:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166976.041163:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450351360 00000100:00100000:2.0:1762166976.041175:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450351360 00000100:00100000:2.0:1762166976.041248:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2000 00000100:00100000:2.0:1762166976.041256:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+23:2417:x1847765450351360:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:2.0:1762166976.041423:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 250794 -> 250794 00002000:00010000:2.0:1762166976.041428:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:2.0:1762166976.041430:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00002000:00010000:2.0:1762166976.041433:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:2.0:1762166976.041435:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 384 -> 384 00000100:00100000:2.0:1762166976.041541:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+24:2417:x1847765450351360:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 285us (469us total) trans 17179876193 rc 0/0 00000100:00100000:2.0:1762166976.041555:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2000 00000100:00100000:0.0:1762166976.044008:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.044068:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450351616 00000100:00100000:1.0:1762166976.044081:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450351616 00000100:00100000:1.0:1762166976.044129:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30261 00000100:00100000:1.0:1762166976.044135:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+526:61766:x1847765450351616:12345-192.168.204.38@tcp:36:fsx.0 00010000:00010000:1.0:1762166976.044183:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1762166976.044205:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eefe00/0x2f180c4effba9ea5 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9813 expref: 526 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.044220:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63400/0x2f180c4effba9e90 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9805 expref: 525 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.044227:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.044230:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166976.044401:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eef800/0x2f180c4effba9eba lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166976.044411:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eef800/0x2f180c4effba9eba lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166976.044417:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eef800/0x2f180c4effba9eba lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000001:00080000:1.0:1762166976.044448:0:6495:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294991846 00000004:00010000:1.0:1762166976.044464:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000e0508b9e reply state 00000000087083a0 transno 4294991847 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eef800/0x2f180c4effba9eba lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166976.044471:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eef800/0x2f180c4effba9eba lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166976.044518:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.044521:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166976.044524:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166976.044620:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+527:61766:x1847765450351616:12345-192.168.204.38@tcp:36:fsx.0 Request processed in 483us (622us total) trans 4294991847 rc 0/0 00000100:00100000:1.0:1762166976.044627:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30261 00000020:00080000:1.0:1762166976.044633:0:6495:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1762166976.045730:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.045770:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450351744 00000100:00100000:1.0:1762166976.045774:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450351744 00000100:00100000:1.0:1762166976.045802:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30262 00000100:00100000:1.0:1762166976.045807:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+527:61766:x1847765450351744:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:1.0:1762166976.045818:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166976.045826:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eefa00/0x2f180c4effba9ec1 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9821 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.045852:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eefa00/0x2f180c4effba9ec1 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9821 expref: 528 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.045859:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eefa00/0x2f180c4effba9ec1 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9821 expref: 528 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.045869:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.045871:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166976.045873:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc6eefa00, rc 0) 00000100:00100000:1.0:1762166976.045902:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+528:61766:x1847765450351744:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 95us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166976.045918:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30262 00000100:00100000:3.0:1762166976.047402:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166976.047474:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450351872 00000100:00100000:2.0:1762166976.047508:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450351872 00000100:00100000:3.0:1762166976.047521:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00002000:00010000:2.0:1762166976.047536:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (86874->18446744073709551615) 00002000:00100000:2.0:1762166976.047546:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc55de300 with x1847765450351872 ext(86874->18446744073709551615) 00000100:00100000:0.0:1762166976.047555:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450352000 00002000:00010000:2.0:1762166976.047556:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc55de300. 00000100:00100000:3.0:1762166976.047561:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166976.047561:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450352000 00002000:00010000:0.0:1762166976.047581:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00000100:00100000:2.0:1762166976.047582:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450352128 00000100:00100000:2.0:1762166976.047587:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450352128 00002000:00100000:0.0:1762166976.047588:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc55dd500 with x1847765450352000 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166976.047597:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc55dd500. 00002000:00010000:2.0:1762166976.047602:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:2.0:1762166976.047606:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc55dc380 with x1847765450352128 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166976.047612:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc55dc380. 00000100:00100000:0.0:1762166976.047630:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2001 00000100:00100000:2.0:1762166976.047642:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2002 00000100:00100000:0.0:1762166976.047643:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+25:2416:x1847765450351872:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:1.0:1762166976.047650:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2003 00000100:00100000:2.0:1762166976.047655:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+18:2416:x1847765450352000:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:1.0:1762166976.047663:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+25:2417:x1847765450352128:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:1.0:1762166976.047762:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166976.047766:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166975 -> 1762166976 00002000:00010000:1.0:1762166976.047769:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00002000:00010000:1.0:1762166976.047771:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.047773:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:2.0:1762166976.047776:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166976.047780:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166975 -> 1762166976 00002000:00010000:2.0:1762166976.047783:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00002000:00010000:2.0:1762166976.047786:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:2.0:1762166976.047789:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00000100:00100000:1.0:1762166976.047814:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+26:2417:x1847765450352128:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 156us (256us total) trans 17179876194 rc 0/0 00000100:00100000:2.0:1762166976.047818:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:2416:x1847765450352000:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 165us (295us total) trans 21474843187 rc 0/0 00000100:00100000:1.0:1762166976.047826:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2003 00002000:00010000:1.0:1762166976.047830:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00000100:00100000:2.0:1762166976.047835:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2002 00002000:00100000:1.0:1762166976.047836:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc55dc380 with x1847765450352128 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166976.047840:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00010000:1.0:1762166976.047843:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc55dc380. 00002000:00100000:2.0:1762166976.047844:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc55dd500 with x1847765450352000 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166976.047852:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc55dd500. 00002000:00010000:0.0:1762166976.048049:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 250794 -> 86874 00002000:00010000:0.0:1762166976.048053:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:0.0:1762166976.048055:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00002000:00010000:0.0:1762166976.048057:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:0.0:1762166976.048060:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 384 -> 184 00000100:00100000:0.0:1762166976.048108:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+26:2416:x1847765450351872:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 469us (708us total) trans 17179876195 rc 0/0 00000100:00100000:0.0:1762166976.048119:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2001 00002000:00010000:0.0:1762166976.048122:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (86874->18446744073709551615) 00002000:00100000:0.0:1762166976.048125:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc55de300 with x1847765450351872 ext(86874->18446744073709551615) 00002000:00010000:0.0:1762166976.048129:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc55de300. 00000100:00100000:3.0:1762166976.049534:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.049576:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450352256 00000100:00100000:1.0:1762166976.049581:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450352256 00000100:00100000:1.0:1762166976.049611:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30263 00000100:00100000:1.0:1762166976.049619:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+528:61766:x1847765450352256:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:1.0:1762166976.049633:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166976.049648:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eefe00/0x2f180c4effba9ec8 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9828 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.049721:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eef600/0x2f180c4effba9ecf lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166976.049733:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eef600/0x2f180c4effba9ecf lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166976.049742:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eef600/0x2f180c4effba9ecf lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:1.0:1762166976.049769:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 86874 00000004:00200000:1.0:1762166976.049773:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166976.049789:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eef600/0x2f180c4effba9ecf lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166976.049811:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eefe00/0x2f180c4effba9ec8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9828 expref: 530 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.049823:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eef600/0x2f180c4effba9ecf lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9828 expref: 529 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.049831:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.049833:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166976.049836:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc6eef600, rc 0) 00000100:00100000:1.0:1762166976.049875:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+529:61766:x1847765450352256:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 257us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166976.049882:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30263 00000100:00100000:2.0:1762166976.051582:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.051613:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450352512 00000100:00100000:1.0:1762166976.051618:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450352512 00000100:00100000:1.0:1762166976.051653:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30264 00000100:00100000:1.0:1762166976.051661:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+529:61766:x1847765450352512:12345-192.168.204.38@tcp:36:fsx.0 00010000:00010000:1.0:1762166976.051691:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166976.051705:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eef600/0x2f180c4effba9ecf lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9828 expref: 529 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.051716:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.051719:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166976.051844:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effba9ed6 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166976.051854:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effba9ed6 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166976.051860:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effba9ed6 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000001:00080000:1.0:1762166976.051897:0:6495:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294991848 00000004:00010000:1.0:1762166976.051936:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000004a139297 reply state 0000000066ac9988 transno 4294991849 ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effba9ed6 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166976.051947:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effba9ed6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166976.051953:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.051955:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166976.051958:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166976.052017:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+531:61766:x1847765450352512:12345-192.168.204.38@tcp:36:fsx.0 Request processed in 357us (436us total) trans 4294991849 rc 0/0 00000100:00100000:1.0:1762166976.052023:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30264 00000020:00080000:1.0:1762166976.052027:0:6495:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1762166976.053050:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166976.053097:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450352640 00000100:00100000:0.0:1762166976.053103:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450352640 00002000:00010000:0.0:1762166976.053125:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (54210->18446744073709551615) 00002000:00100000:0.0:1762166976.053130:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc55dea00 with x1847765450352640 ext(54210->18446744073709551615) 00002000:00010000:0.0:1762166976.053137:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc55dea00. 00000100:00100000:0.0:1762166976.053162:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2004 00000100:00100000:0.0:1762166976.053170:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+26:2417:x1847765450352640:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:3.0:1762166976.053253:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166976.053291:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450352768 00000100:00100000:2.0:1762166976.053297:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450352768 00002000:00010000:2.0:1762166976.053317:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:2.0:1762166976.053321:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1dde680 with x1847765450352768 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166976.053329:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945cf1dde680. 00000100:00100000:3.0:1762166976.053349:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166976.053357:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2005 00000100:00100000:2.0:1762166976.053368:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1dde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:2417:x1847765450352768:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:3.0:1762166976.053378:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450352896 00000100:00100000:3.0:1762166976.053384:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450352896 00002000:00010000:3.0:1762166976.053406:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:3.0:1762166976.053411:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1ddca80 with x1847765450352896 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166976.053417:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1ddca80. 00000100:00100000:3.0:1762166976.053445:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2006 00000100:00100000:3.0:1762166976.053456:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+28:2416:x1847765450352896:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:2.0:1762166976.053471:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166976.053500:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:2.0:1762166976.053504:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00002000:00010000:2.0:1762166976.053507:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:2.0:1762166976.053509:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00002000:00010000:0.0:1762166976.053511:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 86874 -> 54210 00002000:00010000:0.0:1762166976.053516:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:0.0:1762166976.053519:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00002000:00010000:0.0:1762166976.053521:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:0.0:1762166976.053524:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 184 -> 120 00000100:00100000:2.0:1762166976.053555:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1dde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:2417:x1847765450352768:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 188us (300us total) trans 21474843188 rc 0/0 00000100:00100000:0.0:1762166976.053557:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+29:2417:x1847765450352640:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 385us (506us total) trans 17179876196 rc 0/0 00002000:00010000:3.0:1762166976.053562:0:14623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166976.053570:0:14623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00000100:00100000:2.0:1762166976.053571:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2005 00002000:00010000:3.0:1762166976.053576:0:14623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00002000:00010000:2.0:1762166976.053578:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00010000:3.0:1762166976.053582:0:14623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00100000:2.0:1762166976.053585:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1dde680 with x1847765450352768 ext(0->18446744073709551615) 00000100:00100000:0.0:1762166976.053585:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2004 00002000:00010000:3.0:1762166976.053587:0:14623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:0.0:1762166976.053593:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (54210->18446744073709551615) 00002000:00010000:2.0:1762166976.053595:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945cf1dde680. 00002000:00100000:0.0:1762166976.053598:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc55dea00 with x1847765450352640 ext(54210->18446744073709551615) 00002000:00010000:0.0:1762166976.053605:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc55dea00. 00000100:00100000:3.0:1762166976.053623:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+28:2416:x1847765450352896:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 167us (271us total) trans 17179876197 rc 0/0 00000100:00100000:3.0:1762166976.053633:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2006 00002000:00010000:3.0:1762166976.053637:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:3.0:1762166976.053640:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1ddca80 with x1847765450352896 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166976.053645:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1ddca80. 00000100:00100000:3.0:1762166976.054606:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.054675:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450353024 00000100:00100000:1.0:1762166976.054680:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450353024 00000100:00100000:1.0:1762166976.054721:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30265 00000100:00100000:1.0:1762166976.054730:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+531:61766:x1847765450353024:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:1.0:1762166976.054743:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166976.054755:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14000/0x2f180c4effba9edd lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e982f expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.054821:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc98f5200/0x2f180c4effba9ee4 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166976.054834:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc98f5200/0x2f180c4effba9ee4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166976.054843:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc98f5200/0x2f180c4effba9ee4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:1.0:1762166976.054867:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 54210 00000004:00200000:1.0:1762166976.054871:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166976.054884:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc98f5200/0x2f180c4effba9ee4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166976.054918:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14000/0x2f180c4effba9edd lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e982f expref: 533 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.054933:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc98f5200/0x2f180c4effba9ee4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e982f expref: 532 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.054942:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.054944:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166976.054947:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc98f5200, rc 0) 00000100:00100000:1.0:1762166976.054990:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+532:61766:x1847765450353024:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 261us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166976.054997:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30265 00000100:00100000:1.0:1762166976.057084:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166976.057211:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450353152 00000100:00100000:3.0:1762166976.057223:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450353152 00002000:00100000:3.0:1762166976.057277:0:14623:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xa77:0x0] (0->49151) req@ffff945bc4493800 x1847765450353152/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:7/0 lens 488/0 e 0 to 0 dl 1762166987 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166976.057289:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4493800 with x1847765450353152 ext(0->49151) 00002000:00010000:3.0:1762166976.057296:0:14623:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4493800 00000100:00100000:3.0:1762166976.057334:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2007 00000100:00100000:3.0:1762166976.057345:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4493800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+28:2416:x1847765450353152:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:0.0:1762166976.058560:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4493800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+28:2416:x1847765450353152:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 1211us (1475us total) trans 0 rc 49152/49152 00000100:00100000:0.0:1762166976.058574:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2007 00002000:00100000:0.0:1762166976.058586:0:14623:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xa77:0x0] (0->49151) req@ffff945bc4493800 x1847765450353152/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:7/0 lens 488/440 e 0 to 0 dl 1762166987 ref 1 fl Complete:/600/0 rc 49152/49152 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166976.058597:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4493800 with x1847765450353152 ext(0->49151) 00002000:00010000:0.0:1762166976.058603:0:14623:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4493800 00000100:00100000:1.0:1762166976.061238:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166976.061304:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450353408 00000100:00100000:2.0:1762166976.061312:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450353408 00000100:00100000:2.0:1762166976.061361:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30266 00000100:00100000:2.0:1762166976.061372:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc70b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+532:61766:x1847765450353408:12345-192.168.204.38@tcp:36:fsx.0 00010000:00010000:2.0:1762166976.061419:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166976.061439:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc98f5200/0x2f180c4effba9ee4 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e982f expref: 532 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.061456:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166976.061460:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166976.061655:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effba9eeb lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166976.061669:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effba9eeb lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166976.061678:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effba9eeb lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000001:00080000:2.0:1762166976.061712:0:6494:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294991850 00000004:00010000:2.0:1762166976.061731:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000050494098 reply state 00000000b4f1ea2c transno 4294991851 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effba9eeb lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166976.061741:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effba9eeb lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166976.061747:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166976.061750:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166976.061752:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166976.061819:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc70b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+534:61766:x1847765450353408:12345-192.168.204.38@tcp:36:fsx.0 Request processed in 449us (584us total) trans 4294991851 rc 0/0 00000100:00100000:2.0:1762166976.061823:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30266 00000020:00080000:2.0:1762166976.061827:0:6494:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1762166976.063043:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.063071:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166976.063091:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450353536 00000100:00100000:0.0:1762166976.063097:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450353536 00000100:00100000:1.0:1762166976.063103:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00002000:00010000:0.0:1762166976.063120:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (259430->18446744073709551615) 00002000:00100000:0.0:1762166976.063125:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc70b1180 with x1847765450353536 ext(259430->18446744073709551615) 00002000:00010000:0.0:1762166976.063131:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc70b1180. 00000100:00100000:2.0:1762166976.063155:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450353664 00000100:00100000:0.0:1762166976.063155:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450353792 00000100:00100000:0.0:1762166976.063158:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450353792 00000100:00100000:2.0:1762166976.063162:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450353664 00002000:00010000:0.0:1762166976.063167:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:0.0:1762166976.063171:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945d011e9880 with x1847765450353792 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166976.063175:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945d011e9880. 00000100:00100000:1.0:1762166976.063180:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2008 00002000:00010000:2.0:1762166976.063188:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00000100:00100000:1.0:1762166976.063194:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc70b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+29:2417:x1847765450353536:12345-192.168.204.38@tcp:10:fsx.0 00002000:00100000:2.0:1762166976.063196:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc70b1f80 with x1847765450353664 ext(0->18446744073709551615) 00000100:00100000:0.0:1762166976.063203:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2009 00002000:00010000:2.0:1762166976.063209:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc70b1f80. 00000100:00100000:0.0:1762166976.063212:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945d011e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+29:2416:x1847765450353792:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:3.0:1762166976.063264:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2010 00000100:00100000:3.0:1762166976.063291:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc70b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+20:2416:x1847765450353664:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:0.0:1762166976.063305:0:14623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166976.063309:0:14623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:0.0:1762166976.063311:0:14623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00002000:00010000:0.0:1762166976.063313:0:14623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:0.0:1762166976.063315:0:14623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1762166976.063351:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945d011e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+31:2416:x1847765450353792:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 140us (248us total) trans 17179876198 rc 0/0 00000100:00100000:0.0:1762166976.063357:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2009 00002000:00010000:0.0:1762166976.063360:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:0.0:1762166976.063363:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945d011e9880 with x1847765450353792 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166976.063367:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945d011e9880. 00002000:00010000:1.0:1762166976.063373:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 54210 -> 259430 00002000:00010000:1.0:1762166976.063378:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.063382:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00002000:00010000:1.0:1762166976.063384:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.063386:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 120 -> 120 00000100:00100000:1.0:1762166976.063415:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc70b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+30:2417:x1847765450353536:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 224us (372us total) trans 17179876199 rc 0/0 00000100:00100000:1.0:1762166976.063423:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2008 00002000:00010000:1.0:1762166976.063426:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (259430->18446744073709551615) 00002000:00100000:1.0:1762166976.063429:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc70b1180 with x1847765450353536 ext(259430->18446744073709551615) 00002000:00010000:1.0:1762166976.063436:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc70b1180. 00002000:00010000:3.0:1762166976.063467:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166976.063472:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:3.0:1762166976.063621:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166976.063626:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:3.0:1762166976.063628:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00000100:00100000:3.0:1762166976.063740:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc70b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+21:2416:x1847765450353664:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 461us (666us total) trans 21474843189 rc 0/0 00000100:00100000:3.0:1762166976.063749:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2010 00002000:00010000:3.0:1762166976.063754:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:3.0:1762166976.063759:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc70b1f80 with x1847765450353664 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166976.063767:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc70b1f80. 00000100:00100000:1.0:1762166976.065688:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166976.065753:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450353920 00000100:00100000:3.0:1762166976.065765:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450353920 00002000:00100000:3.0:1762166976.065817:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (57344->262143) req@ffff945d011ea300 x1847765450353920/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:7/0 lens 488/0 e 0 to 0 dl 1762166987 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166976.065830:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945d011ea300 with x1847765450353920 ext(57344->262143) 00002000:00010000:3.0:1762166976.065837:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945d011ea300 00000100:00100000:3.0:1762166976.065866:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2011 00000100:00100000:3.0:1762166976.065877:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945d011ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+30:2419:x1847765450353920:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:3.0:1762166976.067892:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945d011ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+30:2419:x1847765450353920:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 2012us (2204us total) trans 0 rc 204800/204800 00000100:00100000:3.0:1762166976.067913:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2011 00002000:00100000:3.0:1762166976.067924:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (57344->262143) req@ffff945d011ea300 x1847765450353920/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:7/0 lens 488/440 e 0 to 0 dl 1762166987 ref 1 fl Complete:/600/0 rc 204800/204800 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166976.067931:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945d011ea300 with x1847765450353920 ext(57344->262143) 00002000:00010000:3.0:1762166976.067936:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945d011ea300 00000100:00100000:2.0:1762166976.072773:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166976.072869:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450354048 00000100:00100000:3.0:1762166976.072880:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450354048 00002000:00100000:3.0:1762166976.072942:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (196608->259429) req@ffff945bc7d22a00 x1847765450354048/t0(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:7/0 lens 488/0 e 0 to 0 dl 1762166987 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166976.072955:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc7d22a00 with x1847765450354048 ext(196608->259429) 00002000:00010000:3.0:1762166976.072961:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc7d22a00 00000100:00100000:3.0:1762166976.072992:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2012 00000100:00100000:3.0:1762166976.073003:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+30:2419:x1847765450354048:12345-192.168.204.38@tcp:4:fsx.0 00000100:00100000:3.0:1762166976.075285:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+32:2419:x1847765450354048:12345-192.168.204.38@tcp:4:fsx.0 Request processed in 2278us (2515us total) trans 17179876200 rc 0/0 00000100:00100000:3.0:1762166976.075298:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2012 00002000:00100000:3.0:1762166976.075309:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (196608->259429) req@ffff945bc7d22a00 x1847765450354048/t17179876200(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:7/0 lens 488/448 e 0 to 0 dl 1762166987 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166976.075325:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc7d22a00 with x1847765450354048 ext(196608->259429) 00002000:00010000:3.0:1762166976.075330:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc7d22a00 00000100:00100000:2.0:1762166976.076752:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.076845:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450354176 00000100:00100000:1.0:1762166976.076854:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450354176 00000100:00100000:1.0:1762166976.076914:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18786 00000100:00100000:1.0:1762166976.076924:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+32:2419:x1847765450354176:12345-192.168.204.38@tcp:16:fsx.0 00000001:00080000:2.0:1762166976.077942:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876200 is committed 00000001:00080000:2.0:1762166976.077964:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876191 is committed 00000100:00100000:1.0:1762166976.078104:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450354176:12345-192.168.204.38@tcp:16:fsx.0 Request processed in 1180us (1361us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166976.078113:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18786 00000100:00100000:2.0:1762166976.079669:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.079718:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450354304 00000100:00100000:1.0:1762166976.079727:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450354304 00000100:00100000:1.0:1762166976.079784:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30267 00000100:00100000:1.0:1762166976.079793:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+534:61766:x1847765450354304:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:1.0:1762166976.079818:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166976.079842:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc98f4800/0x2f180c4effba9ef2 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9836 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.079959:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc98f5200/0x2f180c4effba9ef9 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166976.079976:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc98f5200/0x2f180c4effba9ef9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.079988:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc98f5200/0x2f180c4effba9ef9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:1.0:1762166976.080019:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 259430 00000004:00200000:1.0:1762166976.080024:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166976.080043:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc98f5200/0x2f180c4effba9ef9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.080069:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc98f4800/0x2f180c4effba9ef2 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9836 expref: 536 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.080084:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc98f5200/0x2f180c4effba9ef9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9836 expref: 535 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.080093:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.080096:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166976.080100:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc98f5200, rc 0) 00000100:00100000:1.0:1762166976.080150:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+535:61766:x1847765450354304:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 357us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166976.080157:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30267 00000100:00100000:3.0:1762166976.082684:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.082741:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450354560 00000100:00100000:1.0:1762166976.082750:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450354560 00000100:00100000:1.0:1762166976.082799:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30268 00000100:00100000:1.0:1762166976.082811:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+535:61766:x1847765450354560:12345-192.168.204.38@tcp:36:fsx.0 00010000:00010000:1.0:1762166976.082865:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166976.082890:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc98f5200/0x2f180c4effba9ef9 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9836 expref: 535 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.082920:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.082924:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166976.083099:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14000/0x2f180c4effba9f00 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166976.083109:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14000/0x2f180c4effba9f00 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.083115:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14000/0x2f180c4effba9f00 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000001:00080000:1.0:1762166976.083152:0:6494:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294991852 00000004:00010000:1.0:1762166976.083170:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000051abf6ef reply state 00000000339b713a transno 4294991853 ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14000/0x2f180c4effba9f00 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.083178:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14000/0x2f180c4effba9f00 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.083182:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.083184:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166976.083186:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166976.083252:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+537:61766:x1847765450354560:12345-192.168.204.38@tcp:36:fsx.0 Request processed in 446us (578us total) trans 4294991853 rc 0/0 00000100:00100000:1.0:1762166976.083257:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30268 00000020:00080000:1.0:1762166976.083261:0:6494:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1762166976.084521:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166976.084564:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.084608:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450354688 00000100:00100000:3.0:1762166976.084611:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450354816 00000100:00100000:2.0:1762166976.084611:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166976.084626:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450354816 00000100:00100000:1.0:1762166976.084626:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450354688 00000100:00100000:0.0:1762166976.084670:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450354944 00002000:00010000:3.0:1762166976.084671:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00010000:1.0:1762166976.084671:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (243132->18446744073709551615) 00000100:00100000:0.0:1762166976.084678:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450354944 00002000:00100000:3.0:1762166976.084679:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc7d23b80 with x1847765450354816 ext(0->18446744073709551615) 00002000:00100000:1.0:1762166976.084679:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc7d20e00 with x1847765450354688 ext(243132->18446744073709551615) 00002000:00010000:3.0:1762166976.084693:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc7d23b80. 00002000:00010000:1.0:1762166976.084694:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc7d20e00. 00002000:00010000:0.0:1762166976.084699:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:0.0:1762166976.084705:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc7d23800 with x1847765450354944 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166976.084712:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc7d23800. 00000100:00100000:1.0:1762166976.084735:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2013 00000100:00100000:3.0:1762166976.084745:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2014 00000100:00100000:1.0:1762166976.084749:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450354688:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:0.0:1762166976.084756:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2015 00000100:00100000:3.0:1762166976.084760:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450354816:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:0.0:1762166976.084771:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450354944:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:3.0:1762166976.084898:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166976.084898:0:14623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166976.084916:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:0.0:1762166976.084919:0:14623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:3.0:1762166976.084921:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00002000:00010000:0.0:1762166976.084924:0:14623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166976.084926:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:0.0:1762166976.084930:0:14623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:3.0:1762166976.084932:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00002000:00010000:0.0:1762166976.084936:0:14623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166976.085013:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450354816:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 253us (444us total) trans 21474843190 rc 0/0 00000100:00100000:0.0:1762166976.085013:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450354944:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 242us (402us total) trans 17179876201 rc 0/0 00000100:00100000:0.0:1762166976.085033:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2015 00002000:00010000:0.0:1762166976.085037:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00000100:00100000:3.0:1762166976.085040:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2014 00002000:00100000:0.0:1762166976.085042:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc7d23800 with x1847765450354944 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166976.085046:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00010000:0.0:1762166976.085049:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc7d23800. 00002000:00100000:3.0:1762166976.085050:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc7d23b80 with x1847765450354816 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166976.085058:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc7d23b80. 00002000:00010000:1.0:1762166976.085086:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 259430 -> 243132 00002000:00010000:1.0:1762166976.085090:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.085092:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166975 -> 1762166976 00002000:00010000:1.0:1762166976.085094:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.085096:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 120 -> 216 00000100:00100000:1.0:1762166976.085121:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450354688:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 377us (605us total) trans 17179876202 rc 0/0 00000100:00100000:1.0:1762166976.085128:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2013 00002000:00010000:1.0:1762166976.085131:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (243132->18446744073709551615) 00002000:00100000:1.0:1762166976.085134:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc7d20e00 with x1847765450354688 ext(243132->18446744073709551615) 00002000:00010000:1.0:1762166976.085139:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc7d20e00. 00000100:00100000:2.0:1762166976.086469:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.086518:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450355072 00000100:00100000:1.0:1762166976.086524:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450355072 00000100:00100000:1.0:1762166976.086551:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30269 00000100:00100000:1.0:1762166976.086557:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+537:61766:x1847765450355072:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:1.0:1762166976.086572:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166976.086587:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eef600/0x2f180c4effba9f07 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e983d expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.086667:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eefe00/0x2f180c4effba9f0e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166976.086679:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eefe00/0x2f180c4effba9f0e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.086688:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eefe00/0x2f180c4effba9f0e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:1.0:1762166976.086709:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 243132 00000004:00200000:1.0:1762166976.086713:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166976.086728:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eefe00/0x2f180c4effba9f0e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.086751:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eef600/0x2f180c4effba9f07 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e983d expref: 539 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.086771:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eefe00/0x2f180c4effba9f0e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e983d expref: 538 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.086777:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.086779:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166976.086781:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc6eefe00, rc 0) 00000100:00100000:1.0:1762166976.086810:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+538:61766:x1847765450355072:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 254us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166976.086814:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30269 00000100:00100000:2.0:1762166976.089056:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.089133:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450355328 00000100:00100000:1.0:1762166976.089143:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450355328 00000100:00100000:1.0:1762166976.089202:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30270 00000100:00100000:1.0:1762166976.089214:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+538:61766:x1847765450355328:12345-192.168.204.38@tcp:36:fsx.0 00010000:00010000:1.0:1762166976.089270:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166976.089306:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eefe00/0x2f180c4effba9f0e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e983d expref: 538 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.089328:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.089333:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166976.089584:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc98f4800/0x2f180c4effba9f15 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166976.089600:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc98f4800/0x2f180c4effba9f15 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.089610:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc98f4800/0x2f180c4effba9f15 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000001:00080000:1.0:1762166976.089660:0:6494:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294991854 00000004:00010000:1.0:1762166976.089686:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000004de35d6a reply state 000000009475e678 transno 4294991855 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc98f4800/0x2f180c4effba9f15 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.089699:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc98f4800/0x2f180c4effba9f15 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.089705:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.089707:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166976.089709:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166976.089786:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+540:61766:x1847765450355328:12345-192.168.204.38@tcp:36:fsx.0 Request processed in 576us (741us total) trans 4294991855 rc 0/0 00000100:00100000:1.0:1762166976.089792:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30270 00000020:00080000:1.0:1762166976.089796:0:6494:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1762166976.091110:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166976.091153:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.091185:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450355456 00000100:00100000:2.0:1762166976.091192:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.091195:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450355456 00000100:00100000:3.0:1762166976.091226:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450355584 00000100:00100000:3.0:1762166976.091232:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450355584 00002000:00010000:1.0:1762166976.091238:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (220240->18446744073709551615) 00002000:00100000:1.0:1762166976.091244:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc406c380 with x1847765450355456 ext(220240->18446744073709551615) 00002000:00010000:3.0:1762166976.091252:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00010000:1.0:1762166976.091256:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc406c380. 00002000:00100000:3.0:1762166976.091258:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc406d500 with x1847765450355584 ext(0->18446744073709551615) 00000100:00100000:0.0:1762166976.091263:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450355712 00002000:00010000:3.0:1762166976.091268:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc406d500. 00000100:00100000:0.0:1762166976.091270:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450355712 00000100:00100000:1.0:1762166976.091291:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2016 00002000:00010000:0.0:1762166976.091291:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:0.0:1762166976.091298:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc406c700 with x1847765450355712 ext(0->18446744073709551615) 00000100:00100000:3.0:1762166976.091303:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2017 00000100:00100000:1.0:1762166976.091305:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765450355456:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:0.0:1762166976.091309:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc406c700. 00000100:00100000:3.0:1762166976.091317:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450355584:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:0.0:1762166976.091339:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2018 00000100:00100000:0.0:1762166976.091351:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765450355712:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:0.0:1762166976.091438:0:14623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166976.091440:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166976.091442:0:14623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:3.0:1762166976.091445:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:0.0:1762166976.091446:0:14623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166976.091450:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00002000:00010000:0.0:1762166976.091450:0:14623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:0.0:1762166976.091456:0:14623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:3.0:1762166976.091457:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:3.0:1762166976.091461:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00000100:00100000:3.0:1762166976.091533:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765450355584:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 219us (378us total) trans 21474843191 rc 0/0 00000100:00100000:3.0:1762166976.091541:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2017 00002000:00010000:3.0:1762166976.091545:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:3.0:1762166976.091548:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc406d500 with x1847765450355584 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166976.091552:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc406d500. 00002000:00010000:1.0:1762166976.091639:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 243132 -> 220240 00002000:00010000:1.0:1762166976.091643:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.091646:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.091649:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.091651:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 216 -> 168 00000100:00100000:0.0:1762166976.091658:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+24:2418:x1847765450355712:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 309us (464us total) trans 17179876203 rc 0/0 00000100:00100000:0.0:1762166976.091666:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2018 00002000:00010000:0.0:1762166976.091670:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:0.0:1762166976.091674:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc406c700 with x1847765450355712 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166976.091679:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc406c700. 00000100:00100000:1.0:1762166976.091680:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+24:2418:x1847765450355456:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 378us (577us total) trans 17179876204 rc 0/0 00000100:00100000:1.0:1762166976.091690:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2016 00002000:00010000:1.0:1762166976.091695:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (220240->18446744073709551615) 00002000:00100000:1.0:1762166976.091698:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc406c380 with x1847765450355456 ext(220240->18446744073709551615) 00002000:00010000:1.0:1762166976.091704:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc406c380. 00000100:00100000:2.0:1762166976.092847:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.092889:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450355840 00000100:00100000:1.0:1762166976.092896:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450355840 00000100:00100000:1.0:1762166976.092953:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30271 00000100:00100000:1.0:1762166976.092962:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+540:61766:x1847765450355840:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:1.0:1762166976.092980:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166976.092998:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4ac00/0x2f180c4effba9f1c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9844 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.093091:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4a400/0x2f180c4effba9f23 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166976.093105:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4a400/0x2f180c4effba9f23 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.093115:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4a400/0x2f180c4effba9f23 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:1.0:1762166976.093145:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 220240 00000004:00200000:1.0:1762166976.093149:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166976.093165:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4a400/0x2f180c4effba9f23 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.093188:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4ac00/0x2f180c4effba9f1c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9844 expref: 542 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.093203:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4a400/0x2f180c4effba9f23 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9844 expref: 541 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.093212:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.093215:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166976.093218:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc3d4a400, rc 0) 00000100:00100000:1.0:1762166976.093259:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+541:61766:x1847765450355840:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 299us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166976.093266:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30271 00000100:00100000:2.0:1762166976.096300:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.096357:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450355968 00000100:00100000:1.0:1762166976.096366:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450355968 00000100:00100000:1.0:1762166976.096430:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2019 00000100:00100000:1.0:1762166976.096440:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765450355968:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:1.0:1762166976.096657:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 220240 -> 220240 00002000:00010000:1.0:1762166976.096660:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.096661:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.096663:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.096664:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 168 -> 224 00000100:00100000:1.0:1762166976.096706:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765450355968:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 269us (414us total) trans 17179876205 rc 0/0 00000100:00100000:1.0:1762166976.096712:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2019 00000100:00100000:2.0:1762166976.098881:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.098954:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450356096 00000100:00100000:1.0:1762166976.098967:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450356096 00000100:00100000:1.0:1762166976.099038:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2020 00000100:00100000:1.0:1762166976.099047:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+24:2418:x1847765450356096:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:1.0:1762166976.099326:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 220240 -> 220240 00002000:00010000:1.0:1762166976.099329:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.099331:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.099333:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.099334:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 224 -> 248 00000100:00100000:1.0:1762166976.099389:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+25:2418:x1847765450356096:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 343us (521us total) trans 17179876206 rc 0/0 00000100:00100000:1.0:1762166976.099394:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2020 00000100:00100000:2.0:1762166976.101034:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.101074:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450356224 00000100:00100000:1.0:1762166976.101080:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450356224 00000100:00100000:1.0:1762166976.101121:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2021 00000100:00100000:1.0:1762166976.101127:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+25:2419:x1847765450356224:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:1.0:1762166976.101316:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 220240 -> 220240 00002000:00010000:1.0:1762166976.101320:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.101322:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.101324:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.101326:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 248 -> 248 00000100:00100000:1.0:1762166976.101375:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765450356224:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 247us (347us total) trans 17179876207 rc 0/0 00000100:00100000:1.0:1762166976.101388:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2021 00000100:00100000:2.0:1762166976.103455:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.103559:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450356352 00000100:00100000:1.0:1762166976.103568:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450356352 00002000:00100000:1.0:1762166976.103612:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (61440->65535) req@ffff945bc406ce00 x1847765450356352/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:7/0 lens 488/0 e 0 to 0 dl 1762166987 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166976.103621:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc406ce00 with x1847765450356352 ext(61440->65535) 00002000:00010000:1.0:1762166976.103627:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc406ce00 00000100:00100000:1.0:1762166976.103651:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2022 00000100:00100000:1.0:1762166976.103658:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765450356352:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:1.0:1762166976.103862:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765450356352:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 205us (417us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1762166976.103868:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2022 00002000:00100000:1.0:1762166976.103874:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (61440->65535) req@ffff945bc406ce00 x1847765450356352/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:7/0 lens 488/4536 e 0 to 0 dl 1762166987 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166976.103880:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc406ce00 with x1847765450356352 ext(61440->65535) 00002000:00010000:1.0:1762166976.103883:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc406ce00 00000100:00100000:2.0:1762166976.105228:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.105276:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450356480 00000100:00100000:1.0:1762166976.105284:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450356480 00002000:00100000:1.0:1762166976.105307:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (65536->69631) req@ffff945bc406e680 x1847765450356480/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:7/0 lens 488/0 e 0 to 0 dl 1762166987 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166976.105314:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc406e680 with x1847765450356480 ext(65536->69631) 00002000:00010000:1.0:1762166976.105317:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc406e680 00000100:00100000:1.0:1762166976.105335:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2023 00000100:00100000:1.0:1762166976.105340:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+26:2418:x1847765450356480:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:1.0:1762166976.105453:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+26:2418:x1847765450356480:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 111us (227us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1762166976.105461:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2023 00002000:00100000:1.0:1762166976.105468:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (65536->69631) req@ffff945bc406e680 x1847765450356480/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:7/0 lens 488/4536 e 0 to 0 dl 1762166987 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166976.105474:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc406e680 with x1847765450356480 ext(65536->69631) 00002000:00010000:1.0:1762166976.105497:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc406e680 00000100:00100000:2.0:1762166976.107431:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.107495:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450356608 00000100:00100000:1.0:1762166976.107504:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450356608 00002000:00100000:1.0:1762166976.107540:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (61440->167935) req@ffff945bc406dc00 x1847765450356608/t0(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:7/0 lens 520/0 e 0 to 0 dl 1762166987 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166976.107548:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc406dc00 with x1847765450356608 ext(61440->167935) 00002000:00010000:1.0:1762166976.107552:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc406dc00 00000100:00100000:1.0:1762166976.107573:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2024 00000100:00100000:1.0:1762166976.107582:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765450356608:12345-192.168.204.38@tcp:4:fsx.0 00000100:00100000:1.0:1762166976.109109:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+28:2419:x1847765450356608:12345-192.168.204.38@tcp:4:fsx.0 Request processed in 1525us (1680us total) trans 17179876208 rc 0/0 00000100:00100000:1.0:1762166976.109117:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2024 00002000:00100000:1.0:1762166976.109126:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (61440->167935) req@ffff945bc406dc00 x1847765450356608/t17179876208(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:7/0 lens 520/456 e 0 to 0 dl 1762166987 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166976.109136:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc406dc00 with x1847765450356608 ext(61440->167935) 00002000:00010000:1.0:1762166976.109141:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc406dc00 00000100:00100000:2.0:1762166976.110049:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.110095:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450356736 00000100:00100000:1.0:1762166976.110101:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450356736 00000100:00100000:1.0:1762166976.110132:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18787 00000100:00100000:1.0:1762166976.110138:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+28:2419:x1847765450356736:12345-192.168.204.38@tcp:16:fsx.0 00000001:00080000:2.0:1762166976.111115:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876208 is committed 00000100:00100000:1.0:1762166976.111235:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450356736:12345-192.168.204.38@tcp:16:fsx.0 Request processed in 1095us (1188us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166976.111248:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18787 00000100:00100000:2.0:1762166976.114012:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.114072:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450356864 00000100:00100000:1.0:1762166976.114084:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450356864 00002000:00100000:1.0:1762166976.114143:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (147456->155647) req@ffff945bc406f480 x1847765450356864/t0(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:7/0 lens 8680/0 e 0 to 0 dl 1762166987 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166976.114154:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc406f480 with x1847765450356864 ext(147456->155647) 00002000:00010000:1.0:1762166976.114160:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc406f480 00000100:00100000:1.0:1762166976.114195:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2025 00000100:00100000:1.0:1762166976.114206:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450356864:12345-192.168.204.38@tcp:4:fsx.0 00000100:00100000:1.0:1762166976.114829:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450356864:12345-192.168.204.38@tcp:4:fsx.0 Request processed in 625us (828us total) trans 17179876209 rc 0/0 00000100:00100000:1.0:1762166976.114836:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2025 00002000:00100000:1.0:1762166976.114842:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (147456->155647) req@ffff945bc406f480 x1847765450356864/t17179876209(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:7/0 lens 8680/448 e 0 to 0 dl 1762166987 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166976.114848:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc406f480 with x1847765450356864 ext(147456->155647) 00002000:00010000:1.0:1762166976.114851:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc406f480 00000100:00100000:2.0:1762166976.115886:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.115932:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450356992 00000100:00100000:1.0:1762166976.115939:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450356992 00000100:00100000:1.0:1762166976.115970:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18788 00000100:00100000:1.0:1762166976.115977:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450356992:12345-192.168.204.38@tcp:16:fsx.0 00000001:00080000:2.0:1762166976.116813:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876209 is committed 00000100:00100000:1.0:1762166976.116919:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450356992:12345-192.168.204.38@tcp:16:fsx.0 Request processed in 940us (1032us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166976.116929:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18788 00000100:00100000:2.0:1762166976.119173:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.119218:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450357120 00000100:00100000:1.0:1762166976.119226:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450357120 00000100:00100000:1.0:1762166976.119290:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2026 00000100:00100000:1.0:1762166976.119302:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450357120:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:1.0:1762166976.119605:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 220240 -> 220240 00002000:00010000:1.0:1762166976.119610:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.119613:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.119615:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.119618:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 248 -> 384 00000100:00100000:1.0:1762166976.119670:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450357120:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 370us (503us total) trans 17179876210 rc 0/0 00000100:00100000:1.0:1762166976.119678:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2026 00000100:00100000:2.0:1762166976.121175:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.121226:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450357376 00000100:00100000:1.0:1762166976.121233:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450357376 00000100:00100000:1.0:1762166976.121277:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30272 00000100:00100000:1.0:1762166976.121286:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+541:61766:x1847765450357376:12345-192.168.204.38@tcp:36:fsx.0 00010000:00010000:1.0:1762166976.121346:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166976.121378:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4a400/0x2f180c4effba9f23 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9844 expref: 541 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.121401:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.121413:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166976.121626:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4ac00/0x2f180c4effba9f2a lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166976.121644:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4ac00/0x2f180c4effba9f2a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.121654:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4ac00/0x2f180c4effba9f2a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000001:00080000:1.0:1762166976.121696:0:6494:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294991856 00000004:00010000:1.0:1762166976.121719:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000a7d8a65d reply state 00000000ed068a64 transno 4294991857 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4ac00/0x2f180c4effba9f2a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.121731:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4ac00/0x2f180c4effba9f2a lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.121738:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.121741:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166976.121744:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166976.121824:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+543:61766:x1847765450357376:12345-192.168.204.38@tcp:36:fsx.0 Request processed in 538us (654us total) trans 4294991857 rc 0/0 00000100:00100000:1.0:1762166976.121831:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30272 00000020:00080000:1.0:1762166976.121837:0:6494:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1762166976.122839:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.122878:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450357504 00000100:00100000:1.0:1762166976.122883:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450357504 00000100:00100000:2.0:1762166976.122889:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00002000:00010000:1.0:1762166976.122913:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (122521->18446744073709551615) 00002000:00100000:1.0:1762166976.122918:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf3db6300 with x1847765450357504 ext(122521->18446744073709551615) 00000100:00100000:2.0:1762166976.122927:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00002000:00010000:1.0:1762166976.122936:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf3db6300. 00000100:00100000:1.0:1762166976.122963:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450357632 00000100:00100000:1.0:1762166976.122967:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450357632 00000100:00100000:2.0:1762166976.122968:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450357760 00000100:00100000:2.0:1762166976.122974:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450357760 00002000:00010000:2.0:1762166976.122995:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00010000:1.0:1762166976.122996:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00000100:00100000:0.0:1762166976.123002:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2027 00002000:00100000:2.0:1762166976.123003:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf3db7800 with x1847765450357760 ext(0->18446744073709551615) 00002000:00100000:1.0:1762166976.123003:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf3db5f80 with x1847765450357632 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166976.123017:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf3db7800. 00002000:00010000:1.0:1762166976.123018:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945cf3db5f80. 00000100:00100000:0.0:1762166976.123041:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450357504:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:2.0:1762166976.123043:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2028 00000100:00100000:2.0:1762166976.123060:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450357760:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:1.0:1762166976.123063:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2029 00000100:00100000:1.0:1762166976.123075:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765450357632:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:2.0:1762166976.123202:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166976.123202:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166976.123209:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.123209:0:23939:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.123216:0:23939:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00002000:00010000:2.0:1762166976.123217:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00002000:00010000:1.0:1762166976.123218:0:23939:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:2.0:1762166976.123222:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.123222:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00002000:00010000:2.0:1762166976.123228:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1762166976.123269:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765450357632:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 194us (377us total) trans 21474843192 rc 0/0 00000100:00100000:2.0:1762166976.123277:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450357760:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 219us (350us total) trans 17179876211 rc 0/0 00000100:00100000:1.0:1762166976.123279:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2029 00002000:00010000:1.0:1762166976.123286:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:1.0:1762166976.123291:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf3db5f80 with x1847765450357632 ext(0->18446744073709551615) 00000100:00100000:2.0:1762166976.123295:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2028 00002000:00010000:1.0:1762166976.123298:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945cf3db5f80. 00002000:00010000:2.0:1762166976.123303:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:2.0:1762166976.123307:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf3db7800 with x1847765450357760 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166976.123314:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf3db7800. 00002000:00010000:0.0:1762166976.123572:0:14623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 220240 -> 122521 00002000:00010000:0.0:1762166976.123576:0:14623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:0.0:1762166976.123578:0:14623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166976 -> 1762166976 00002000:00010000:0.0:1762166976.123580:0:14623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:0.0:1762166976.123583:0:14623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 384 -> 224 00000100:00100000:0.0:1762166976.123683:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765450357504:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 660us (845us total) trans 17179876212 rc 0/0 00000100:00100000:0.0:1762166976.123691:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2027 00002000:00010000:0.0:1762166976.123695:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (122521->18446744073709551615) 00002000:00100000:0.0:1762166976.123698:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf3db6300 with x1847765450357504 ext(122521->18446744073709551615) 00002000:00010000:0.0:1762166976.123704:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf3db6300. 00000100:00100000:2.0:1762166976.124658:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.124697:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450357888 00000100:00100000:1.0:1762166976.124703:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450357888 00000100:00100000:1.0:1762166976.124739:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30273 00000100:00100000:1.0:1762166976.124745:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+543:61766:x1847765450357888:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:1.0:1762166976.124762:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166976.124781:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4a000/0x2f180c4effba9f31 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e984b expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.124852:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4b200/0x2f180c4effba9f38 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166976.124861:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4b200/0x2f180c4effba9f38 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.124869:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4b200/0x2f180c4effba9f38 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:1.0:1762166976.124887:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 122521 00000004:00200000:1.0:1762166976.124891:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166976.124918:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4b200/0x2f180c4effba9f38 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.124937:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4a000/0x2f180c4effba9f31 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e984b expref: 545 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.124949:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4b200/0x2f180c4effba9f38 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e984b expref: 544 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.124956:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.124958:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166976.124960:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc3d4b200, rc 0) 00000100:00100000:1.0:1762166976.124990:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+544:61766:x1847765450357888:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 246us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166976.124994:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30273 00000100:00100000:2.0:1762166976.127045:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166976.127106:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450358016 00000100:00100000:0.0:1762166976.127112:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450358016 00002000:00100000:0.0:1762166976.127146:0:14623:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xa77:0x0] (0->61439) req@ffff945cf3db6a00 x1847765450358016/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:7/0 lens 504/0 e 0 to 0 dl 1762166987 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166976.127154:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf3db6a00 with x1847765450358016 ext(0->61439) 00002000:00010000:0.0:1762166976.127158:0:14623:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf3db6a00 00000100:00100000:0.0:1762166976.127172:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2030 00000100:00100000:0.0:1762166976.127177:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450358016:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:0.0:1762166976.127972:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450358016:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 794us (930us total) trans 0 rc 24576/24576 00000100:00100000:0.0:1762166976.127978:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2030 00002000:00100000:0.0:1762166976.127983:0:14623:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xa77:0x0] (0->61439) req@ffff945cf3db6a00 x1847765450358016/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:7/0 lens 504/440 e 0 to 0 dl 1762166987 ref 1 fl Complete:/600/0 rc 24576/24576 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166976.127991:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf3db6a00 with x1847765450358016 ext(0->61439) 00002000:00010000:0.0:1762166976.127995:0:14623:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf3db6a00 00000100:00100000:2.0:1762166976.129636:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166976.129679:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450358144 00000100:00100000:0.0:1762166976.129686:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450358144 00000100:00100000:0.0:1762166976.129736:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2031 00000100:00100000:0.0:1762166976.129743:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765450358144:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:0.0:1762166976.130096:0:14623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 122521 -> 122521 00002000:00010000:0.0:1762166976.130100:0:14623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:0.0:1762166976.130103:0:14623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166976 -> 1762166976 00002000:00010000:0.0:1762166976.130105:0:14623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:0.0:1762166976.130108:0:14623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 224 -> 208 00000100:00100000:0.0:1762166976.130168:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765450358144:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 424us (538us total) trans 17179876213 rc 0/0 00000100:00100000:0.0:1762166976.130176:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2031 00000100:00100000:2.0:1762166976.132958:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166976.132999:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450358272 00000100:00100000:0.0:1762166976.133007:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450358272 00002000:00100000:0.0:1762166976.133048:0:14623:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xa77:0x0] (73728->77823) req@ffff945cf3db7480 x1847765450358272/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:7/0 lens 488/0 e 0 to 0 dl 1762166987 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166976.133066:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf3db7480 with x1847765450358272 ext(73728->77823) 00002000:00010000:0.0:1762166976.133072:0:14623:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf3db7480 00000100:00100000:0.0:1762166976.133108:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2032 00000100:00100000:0.0:1762166976.133119:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765450358272:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:0.0:1762166976.133277:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765450358272:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 160us (326us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1762166976.133285:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2032 00002000:00100000:0.0:1762166976.133291:0:14623:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xa77:0x0] (73728->77823) req@ffff945cf3db7480 x1847765450358272/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:7/0 lens 488/4536 e 0 to 0 dl 1762166987 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166976.133298:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf3db7480 with x1847765450358272 ext(73728->77823) 00002000:00010000:0.0:1762166976.133301:0:14623:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf3db7480 00000100:00100000:3.0:1762166976.134625:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166976.134667:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450358400 00000100:00100000:0.0:1762166976.134672:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450358400 00002000:00100000:0.0:1762166976.134695:0:14623:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xa77:0x0] (49152->77823) req@ffff945cf1ddf480 x1847765450358400/t0(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:7/0 lens 488/0 e 0 to 0 dl 1762166987 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166976.134702:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1ddf480 with x1847765450358400 ext(49152->77823) 00002000:00010000:0.0:1762166976.134704:0:14623:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1ddf480 00000100:00100000:0.0:1762166976.134723:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2033 00000100:00100000:0.0:1762166976.134728:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765450358400:12345-192.168.204.38@tcp:4:fsx.0 00000100:00100000:0.0:1762166976.136207:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+26:2418:x1847765450358400:12345-192.168.204.38@tcp:4:fsx.0 Request processed in 1473us (1580us total) trans 17179876215 rc 0/0 00000100:00100000:0.0:1762166976.136217:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2033 00002000:00100000:0.0:1762166976.136228:0:14623:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xa77:0x0] (49152->77823) req@ffff945cf1ddf480 x1847765450358400/t17179876215(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:7/0 lens 488/448 e 0 to 0 dl 1762166987 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166976.136237:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1ddf480 with x1847765450358400 ext(49152->77823) 00002000:00010000:0.0:1762166976.136242:0:14623:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1ddf480 00000100:00100000:2.0:1762166976.137153:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.137196:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450358528 00000100:00100000:1.0:1762166976.137204:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450358528 00000100:00100000:1.0:1762166976.137247:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18789 00000100:00100000:1.0:1762166976.137257:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765450358528:12345-192.168.204.38@tcp:16:fsx.0 00000001:00080000:2.0:1762166976.137940:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876215 is committed 00000100:00100000:1.0:1762166976.138025:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450358528:12345-192.168.204.38@tcp:16:fsx.0 Request processed in 769us (873us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166976.138034:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18789 00000100:00100000:3.0:1762166976.139757:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166976.139815:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450358656 00000100:00100000:0.0:1762166976.139822:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450358656 00000100:00100000:0.0:1762166976.139866:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2034 00000100:00100000:0.0:1762166976.139874:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450358656:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:0.0:1762166976.140071:0:14623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 122521 -> 122521 00002000:00010000:0.0:1762166976.140075:0:14623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:0.0:1762166976.140077:0:14623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166976 -> 1762166976 00002000:00010000:0.0:1762166976.140080:0:14623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:0.0:1762166976.140082:0:14623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 208 -> 240 00000100:00100000:0.0:1762166976.140123:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450358656:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 249us (368us total) trans 17179876216 rc 0/0 00000100:00100000:0.0:1762166976.140130:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2034 00000100:00100000:2.0:1762166976.141569:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.141617:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450358912 00000100:00100000:1.0:1762166976.141623:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450358912 00000100:00100000:1.0:1762166976.141665:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11797 00000100:00100000:1.0:1762166976.141676:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+544:61766:x1847765450358912:12345-192.168.204.38@tcp:35:fsx.0 00000100:00100000:1.0:1762166976.141972:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+545:61766:x1847765450358912:12345-192.168.204.38@tcp:35:fsx.0 Request processed in 297us (403us total) trans 4294991858 rc 0/0 00000100:00100000:1.0:1762166976.141980:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11797 00000100:00100000:2.0:1762166976.149577:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.149648:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450359168 00000100:00100000:1.0:1762166976.149661:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450359168 00000100:00100000:1.0:1762166976.149730:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30274 00000100:00100000:1.0:1762166976.149741:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+545:61838:x1847765450359168:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166976.149772:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166976.149799:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4a000/0x2f180c4effba9f3f lrc: 2/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9852 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.149886:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4a400/0x2f180c4effba9f46 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166976.149916:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4a400/0x2f180c4effba9f46 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.149929:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4a400/0x2f180c4effba9f46 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.149943:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eefe00/0x2f180c4effba9f4d lrc: 3/1,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166976.149951:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eefe00/0x2f180c4effba9f4d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.149957:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eefe00/0x2f180c4effba9f4d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.150089:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eef600/0x2f180c4effba9f54 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166976.150099:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eef600/0x2f180c4effba9f54 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.150106:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eef600/0x2f180c4effba9f54 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:1.0:1762166976.150117:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 122521 00010000:00010000:1.0:1762166976.150207:0:6494:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4a400/0x2f180c4effba9f46 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.150215:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4a400/0x2f180c4effba9f46 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.150222:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4a400/0x2f180c4effba9f46 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.150228:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4a400/0x2f180c4effba9f46 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.150234:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc3d4a400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166976.150238:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4a400/0x2f180c4effba9f46 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.150246:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4a400/0x2f180c4effba9f46 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.150259:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0x0 (ffff945bc812e800) 00010000:00010000:1.0:1762166976.150263:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166976.150268:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4a400/0x2f180c4effba9f46 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.150278:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4a400/0x2f180c4effba9f46 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.150292:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eefe00/0x2f180c4effba9f4d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.150298:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eefe00/0x2f180c4effba9f4d lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.150303:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eefe00/0x2f180c4effba9f4d lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.150307:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc6eefe00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166976.150309:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eefe00/0x2f180c4effba9f4d lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.150314:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eefe00/0x2f180c4effba9f4d lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.150320:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0xdd396665 (ffff945bc812e500) 00010000:00010000:1.0:1762166976.150323:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166976.150325:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eefe00/0x2f180c4effba9f4d lrc: 2/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.150331:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eefe00/0x2f180c4effba9f4d lrc: 0/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.150372:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4a000/0x2f180c4effba9f3f lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9852 expref: 548 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.150387:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eef600/0x2f180c4effba9f54 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9852 expref: 547 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.150399:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.150402:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166976.150405:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc6eef600, rc 0) 00000100:00100000:1.0:1762166976.150470:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+547:61838:x1847765450359168:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 731us (908us total) trans 4294991859 rc 0/0 00000100:00100000:1.0:1762166976.150517:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30274 00000100:00100000:3.0:1762166976.151604:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166976.151665:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450359296 00000100:00100000:0.0:1762166976.151672:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450359296 00000100:00100000:0.0:1762166976.151719:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 860 00000100:00100000:0.0:1762166976.151727:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1dded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+547:2419:x1847765450359296:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166976.151737:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166976.151749:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eef600/0x2f180c4effba9f54 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9852 expref: 547 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.151758:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166976.151760:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166976.151787:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1dded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+546:2419:x1847765450359296:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 62us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166976.151792:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 860 00000100:00100000:2.0:1762166976.152039:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.152088:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450359552 00000100:00100000:1.0:1762166976.152093:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450359552 00000100:00100000:1.0:1762166976.152125:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11798 00000100:00100000:1.0:1762166976.152134:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+546:61838:x1847765450359552:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:1.0:1762166976.152264:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+547:61838:x1847765450359552:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 128us (222us total) trans 4294991860 rc 0/0 00000100:00100000:1.0:1762166976.152271:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11798 00000100:00100000:2.0:1762166976.153238:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.153273:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450359808 00000100:00100000:1.0:1762166976.153283:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450359808 00000100:00100000:1.0:1762166976.153316:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30275 00000100:00100000:1.0:1762166976.153325:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+547:61838:x1847765450359808:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166976.153339:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166976.153355:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc98f5200/0x2f180c4effba9f62 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9859 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.153423:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4410c00/0x2f180c4effba9f69 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166976.153434:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4410c00/0x2f180c4effba9f69 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.153448:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4410c00/0x2f180c4effba9f69 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:1.0:1762166976.153456:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 122521 00010000:00010000:1.0:1762166976.153536:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc98f5200/0x2f180c4effba9f62 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9859 expref: 550 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.153550:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4410c00/0x2f180c4effba9f69 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9859 expref: 549 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.153558:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.153560:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1762166976.153563:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4410c00, rc 0) 00000100:00100000:1.0:1762166976.153598:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+549:61838:x1847765450359808:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 274us (360us total) trans 4294991861 rc 0/0 00000100:00100000:1.0:1762166976.153605:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30275 00000100:00100000:3.0:1762166976.155066:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.155105:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450360064 00000100:00100000:1.0:1762166976.155113:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450360064 00000100:00100000:1.0:1762166976.155148:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30276 00000100:00100000:1.0:1762166976.155156:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+549:61838:x1847765450360064:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166976.155174:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166976.155189:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42ff400/0x2f180c4effba9f77 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9860 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.155251:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb800/0x2f180c4effba9f7e lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166976.155264:0:6494:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4b200/0x2f180c4effba9f38 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e984b expref: 550 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.155275:0:6494:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb800/0x2f180c4effba9f7e lrc: 4/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.155309:0:6494:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4b200/0x2f180c4effba9f38 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e984b expref: 550 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.155324:0:6494:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4b200/0x2f180c4effba9f38 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e984b expref: 550 pid: 6494 timeout: 695 lvb_type: 0 00000100:00100000:1.0:1762166976.155339:0:6494:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945d011e8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765449692416:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166976.155420:0:6494:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cd123ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1762166976.156199:0:6494:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945d011e8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765449692416:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166976.156220:0:6494:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb800/0x2f180c4effba9f7e lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000100:00100000:3.0:1762166976.156371:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166976.156405:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450360192 00000100:00100000:0.0:1762166976.156410:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450360192 00010000:00010000:0.0:1762166976.156429:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4b200/0x2f180c4effba9f38 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e984b expref: 551 pid: 6494 timeout: 695 lvb_type: 0 00000100:00100000:0.0:1762166976.156451:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9490 00000100:00100000:0.0:1762166976.156458:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+551:2418:x1847765450360192:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166976.156469:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166976.156505:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4b200/0x2f180c4effba9f38 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e984b expref: 551 pid: 6494 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166976.156519:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4b200/0x2f180c4effba9f38 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e984b expref: 551 pid: 6494 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166976.156539:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4b200/0x2f180c4effba9f38 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e984b expref: 551 pid: 6494 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166976.156549:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166976.156552:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb800/0x2f180c4effba9f7e lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166976.156559:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb800/0x2f180c4effba9f7e lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166976.156564:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb800/0x2f180c4effba9f7e lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166976.156590:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166976.156611:0:6494:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb800/0x2f180c4effba9f7e lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.156621:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb800/0x2f180c4effba9f7e lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000100:00100000:0.0:1762166976.156629:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+550:2418:x1847765450360192:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 170us (256us total) trans 0 rc 0/0 00000004:00200000:1.0:1762166976.156639:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 122521 00000100:00100000:0.0:1762166976.156640:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9490 00010000:00010000:1.0:1762166976.156733:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42ff400/0x2f180c4effba9f77 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9860 expref: 551 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.156748:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb800/0x2f180c4effba9f7e lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9860 expref: 550 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.156756:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.156759:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1762166976.156761:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc56eb800, rc 0) 00000100:00100000:1.0:1762166976.156791:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+550:61838:x1847765450360064:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1637us (1728us total) trans 4294991862 rc 0/0 00000100:00100000:1.0:1762166976.156796:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30276 00000100:00100000:3.0:1762166976.157671:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.157729:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450360320 00000100:00100000:1.0:1762166976.157755:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450360320 00000100:00100000:1.0:1762166976.157825:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11799 00000100:00100000:1.0:1762166976.157835:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+550:61838:x1847765450360320:12345-192.168.204.38@tcp:33:lfs.0 00000100:00100000:1.0:1762166976.158001:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+550:61838:x1847765450360320:12345-192.168.204.38@tcp:33:lfs.0 Request processed in 168us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166976.158006:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11799 00000100:00100000:2.0:1762166976.158880:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.158941:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450360576 00000100:00100000:1.0:1762166976.158949:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450360576 00000100:00100000:1.0:1762166976.158981:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11800 00000100:00100000:1.0:1762166976.158988:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff2f8050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+550:61838:x1847765450360576:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:1.0:1762166976.159107:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff2f8050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+551:61838:x1847765450360576:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 119us (230us total) trans 4294991863 rc 0/0 00000100:00100000:1.0:1762166976.159112:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11800 00000100:00100000:2.0:1762166976.160126:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.160203:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450360832 00000100:00100000:1.0:1762166976.160210:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450360832 00000100:00100000:1.0:1762166976.160257:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30277 00000100:00100000:1.0:1762166976.160269:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+551:61838:x1847765450360832:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166976.160290:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166976.160293:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:1.0:1762166976.160317:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb800/0x2f180c4effba9f7e lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9860 expref: 551 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.160334:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4410c00/0x2f180c4effba9f69 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9859 expref: 550 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.160342:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.160344:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166976.160354:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb000/0x2f180c4effba9f8c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9867 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.160429:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eae00/0x2f180c4effba9f93 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166976.160440:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eae00/0x2f180c4effba9f93 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.160446:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eae00/0x2f180c4effba9f93 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:1.0:1762166976.160453:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 122521 00010000:00010000:1.0:1762166976.160554:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb000/0x2f180c4effba9f8c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9867 expref: 552 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.160564:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eae00/0x2f180c4effba9f93 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9867 expref: 551 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.160569:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.160570:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762166976.160572:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc56eae00, rc 0) 00000100:00100000:1.0:1762166976.160609:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+551:61838:x1847765450360832:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 344us (487us total) trans 4294991864 rc 0/0 00000100:00100000:1.0:1762166976.160616:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30277 00000100:00100000:3.0:1762166976.161513:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.161540:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450361088 00000100:00100000:1.0:1762166976.161547:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450361088 00000100:00100000:1.0:1762166976.161585:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11801 00000100:00100000:1.0:1762166976.161593:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+551:61838:x1847765450361088:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:1.0:1762166976.161639:0:19593:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x240000404:0x5eb:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eae00/0x2f180c4effba9f93 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9867 expref: 551 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.161663:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eaa00/0x2f180c4effba9fa1 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166976.161674:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eee000/0x2f180c4effba9eb3 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e981a expref: 551 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.161684:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eefa00/0x2f180c4effba9ec1 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9821 expref: 551 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.161691:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eaa00/0x2f180c4effba9fa1 lrc: 5/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166976.161726:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eefa00/0x2f180c4effba9ec1 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9821 expref: 551 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.161741:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eefa00/0x2f180c4effba9ec1 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9821 expref: 551 pid: 6495 timeout: 695 lvb_type: 0 00000100:00100000:1.0:1762166976.161758:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945d011e8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449692544:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166976.161831:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eee000/0x2f180c4effba9eb3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e981a expref: 551 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.161844:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eee000/0x2f180c4effba9eb3 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e981a expref: 551 pid: 6495 timeout: 695 lvb_type: 0 00000100:00100000:1.0:1762166976.161853:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945d011eaa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449692672:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166976.161883:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc37313c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166976.162858:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945d011e8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449692544:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166976.162865:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945d011eaa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449692672:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166976.162880:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eaa00/0x2f180c4effba9fa1 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:3.0:1762166976.163028:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166976.163062:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166976.163117:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450361216 00000100:00100000:1.0:1762166976.163119:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450361344 00000100:00100000:1.0:1762166976.163129:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450361344 00000100:00100000:0.0:1762166976.163133:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450361216 00010000:00010000:1.0:1762166976.163160:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eefa00/0x2f180c4effba9ec1 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9821 expref: 553 pid: 6495 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166976.163170:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eee000/0x2f180c4effba9eb3 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e981a expref: 553 pid: 6495 timeout: 695 lvb_type: 0 00000100:00100000:1.0:1762166976.163213:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9491 00000100:00100000:1.0:1762166976.163232:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+553:2419:x1847765450361344:12345-192.168.204.38@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1762166976.163241:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9492 00010000:00010000:1.0:1762166976.163249:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1762166976.163256:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1dddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+553:2418:x1847765450361216:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166976.163262:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eefa00/0x2f180c4effba9ec1 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9821 expref: 553 pid: 6495 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166976.163274:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166976.163281:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eefa00/0x2f180c4effba9ec1 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9821 expref: 553 pid: 6495 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166976.163287:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eee000/0x2f180c4effba9eb3 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e981a expref: 553 pid: 6495 timeout: 695 lvb_type: 0 00010000:00010000:1.0:1762166976.163310:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eefa00/0x2f180c4effba9ec1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9821 expref: 553 pid: 6495 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166976.163315:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eee000/0x2f180c4effba9eb3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e981a expref: 553 pid: 6495 timeout: 695 lvb_type: 0 00010000:00010000:1.0:1762166976.163373:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166976.163374:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eee000/0x2f180c4effba9eb3 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e981a expref: 552 pid: 6495 timeout: 695 lvb_type: 0 00010000:00010000:1.0:1762166976.163384:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eaa00/0x2f180c4effba9fa1 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166976.163407:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eaa00/0x2f180c4effba9fa1 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166976.163414:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eaa00/0x2f180c4effba9fa1 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166976.163423:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166976.163431:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166976.163452:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166976.163495:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eaa00/0x2f180c4effba9fa1 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166976.163504:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eaa00/0x2f180c4effba9fa1 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:1.0:1762166976.163515:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+551:2419:x1847765450361344:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 291us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166976.163524:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9491 00000100:00100000:0.0:1762166976.163539:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1dddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+550:2418:x1847765450361216:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 283us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166976.163549:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9492 00010000:00010000:3.0:1762166976.163753:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eaa00/0x2f180c4effba9fa1 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166976.163763:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eaa00/0x2f180c4effba9fa1 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166976.163819:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eaa00/0x2f180c4effba9fa1 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166976.163830:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc56eaa00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166976.163835:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eaa00/0x2f180c4effba9fa1 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166976.163843:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eaa00/0x2f180c4effba9fa1 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166976.163854:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166976.163857:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166976.163861:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eaa00/0x2f180c4effba9fa1 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166976.163867:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eaa00/0x2f180c4effba9fa1 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166976.163878:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166976.163881:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166976.163886:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eae00/0x2f180c4effba9f93 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9867 expref: 549 pid: 6494 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166976.164026:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+549:61838:x1847765450361088:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 2433us (2516us total) trans 4294991865 rc -22/-22 00000100:00100000:3.0:1762166976.164038:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11801 00000100:00100000:3.0:1762166976.164876:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.164931:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450361472 00000100:00100000:1.0:1762166976.164941:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450361472 00000100:00100000:1.0:1762166976.164992:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30278 00000100:00100000:1.0:1762166976.165005:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+549:61838:x1847765450361472:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166976.165028:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166976.165046:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eef600/0x2f180c4effba9fa8 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e986e expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.165094:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eef600/0x2f180c4effba9fa8 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e986e expref: 550 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.165107:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eef600/0x2f180c4effba9fa8 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e986e expref: 550 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.165127:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.165130:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166976.165132:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc6eef600, rc 0) 00000100:00100000:1.0:1762166976.165182:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+550:61838:x1847765450361472:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 180us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166976.165189:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30278 00000100:00100000:2.0:1762166976.166978:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.167042:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450361728 00000100:00100000:1.0:1762166976.167051:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450361728 00000100:00100000:1.0:1762166976.167105:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30279 00000100:00100000:1.0:1762166976.167117:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+550:61838:x1847765450361728:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166976.167137:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166976.167158:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eefe00/0x2f180c4effba9faf lrc: 2/0,0 mode: --/CW res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9875 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.168648:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42ff400/0x2f180c4effba9fb6 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x608:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166976.168667:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42ff400/0x2f180c4effba9fb6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x608:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.168680:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42ff400/0x2f180c4effba9fb6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x608:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:1.0:1762166976.168694:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x608:0x0]: returning size 0 00010000:00010000:1.0:1762166976.168757:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eefe00/0x2f180c4effba9faf lrc: 0/0,0 mode: --/CW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9875 expref: 553 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.168784:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42ff400/0x2f180c4effba9fb6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x608:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9875 expref: 552 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.168794:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x608:0x0].0x0 (ffff945bc812e500) 00010000:00010000:1.0:1762166976.168797:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166976.168801:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc42ff400, rc 0) 00000100:00100000:1.0:1762166976.168874:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+552:61838:x1847765450361728:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1759us (1901us total) trans 4294991866 rc 0/0 00000100:00100000:1.0:1762166976.168883:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30279 00000100:00100000:2.0:1762166976.170745:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.170794:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450361984 00000100:00100000:1.0:1762166976.170803:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450361984 00000100:00100000:1.0:1762166976.170851:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30280 00000100:00100000:1.0:1762166976.170859:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5807800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+552:61838:x1847765450361984:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166976.170881:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166976.170896:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eefa00/0x2f180c4effba9fc4 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e987c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.170998:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4410c00/0x2f180c4effba9fcb lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166976.171009:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4410c00/0x2f180c4effba9fcb lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.171017:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4410c00/0x2f180c4effba9fcb lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:1.0:1762166976.171025:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 122521 00010000:00010000:1.0:1762166976.171114:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eefa00/0x2f180c4effba9fc4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e987c expref: 555 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.171131:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4410c00/0x2f180c4effba9fcb lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e987c expref: 554 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.171140:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.171142:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762166976.171146:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4410c00, rc 0) 00000100:00100000:1.0:1762166976.171195:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5807800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+554:61838:x1847765450361984:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 337us (459us total) trans 4294991867 rc 0/0 00000100:00100000:1.0:1762166976.171200:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30280 00000100:00100000:3.0:1762166976.172375:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.172431:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450362240 00000100:00100000:1.0:1762166976.172438:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450362240 00000100:00100000:1.0:1762166976.172518:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11802 00000100:00100000:1.0:1762166976.172531:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+554:61838:x1847765450362240:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:1.0:1762166976.172592:0:19593:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x240000404:0x5eb:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4410c00/0x2f180c4effba9fcb lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e987c expref: 554 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.172629:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eae00/0x2f180c4effba9fd9 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166976.172643:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eef600/0x2f180c4effba9fa8 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e986e expref: 554 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.172652:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eae00/0x2f180c4effba9fd9 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166976.172690:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eef600/0x2f180c4effba9fa8 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e986e expref: 554 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.172705:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eef600/0x2f180c4effba9fa8 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e986e expref: 554 pid: 6494 timeout: 695 lvb_type: 0 00000100:00100000:1.0:1762166976.172728:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945d011eaa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449692800:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166976.172813:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cd123ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1762166976.173825:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945d011eaa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449692800:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166976.173850:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eae00/0x2f180c4effba9fd9 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:3.0:1762166976.173992:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166976.174050:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450362368 00000100:00100000:0.0:1762166976.174055:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450362368 00010000:00010000:0.0:1762166976.174077:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eef600/0x2f180c4effba9fa8 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e986e expref: 555 pid: 6494 timeout: 695 lvb_type: 0 00000100:00100000:0.0:1762166976.174107:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9493 00000100:00100000:0.0:1762166976.174112:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+555:2418:x1847765450362368:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166976.174121:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166976.174126:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eef600/0x2f180c4effba9fa8 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e986e expref: 555 pid: 6494 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166976.174138:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eef600/0x2f180c4effba9fa8 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e986e expref: 555 pid: 6494 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166976.174153:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eef600/0x2f180c4effba9fa8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e986e expref: 555 pid: 6494 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166976.174168:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166976.174172:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eae00/0x2f180c4effba9fd9 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166976.174183:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eae00/0x2f180c4effba9fd9 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166976.174190:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eae00/0x2f180c4effba9fd9 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166976.174216:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166976.174250:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eae00/0x2f180c4effba9fd9 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:0.0:1762166976.174252:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+554:2418:x1847765450362368:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 140us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166976.174266:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9493 00010000:00010000:3.0:1762166976.174267:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eae00/0x2f180c4effba9fd9 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166976.174287:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473a00/0x2f180c4effba9fe0 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x608:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166976.174299:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42ff400/0x2f180c4effba9fb6 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x608:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9875 expref: 553 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.174308:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473a00/0x2f180c4effba9fe0 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x608:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166976.174333:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42ff400/0x2f180c4effba9fb6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x608:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9875 expref: 553 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.174353:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42ff400/0x2f180c4effba9fb6 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x608:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9875 expref: 553 pid: 6494 timeout: 695 lvb_type: 0 00000100:00100000:3.0:1762166976.174364:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf7839180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449692928:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166976.174410:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cee171a80 going to sleep for 11 seconds 00000100:00100000:1.0:1762166976.175334:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf7839180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449692928:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166976.175363:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473a00/0x2f180c4effba9fe0 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x608:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:2.0:1762166976.175567:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166976.175617:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450362496 00000100:00100000:0.0:1762166976.175626:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450362496 00010000:00010000:0.0:1762166976.175662:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42ff400/0x2f180c4effba9fb6 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x608:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9875 expref: 554 pid: 6494 timeout: 695 lvb_type: 0 00000100:00100000:0.0:1762166976.175707:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9494 00000100:00100000:0.0:1762166976.175717:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5806300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+554:2418:x1847765450362496:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166976.175731:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166976.175738:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42ff400/0x2f180c4effba9fb6 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x608:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9875 expref: 554 pid: 6494 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166976.175751:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42ff400/0x2f180c4effba9fb6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x608:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9875 expref: 554 pid: 6494 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166976.175772:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42ff400/0x2f180c4effba9fb6 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x608:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9875 expref: 554 pid: 6494 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166976.175786:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x608:0x0].0x0 (ffff945bc812e500) 00010000:00010000:0.0:1762166976.175790:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473a00/0x2f180c4effba9fe0 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x608:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166976.175800:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473a00/0x2f180c4effba9fe0 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x608:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166976.175807:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473a00/0x2f180c4effba9fe0 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x608:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166976.175832:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166976.175860:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473a00/0x2f180c4effba9fe0 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x608:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166976.175869:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473a00/0x2f180c4effba9fe0 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x608:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:0.0:1762166976.175889:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5806300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+553:2418:x1847765450362496:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 173us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166976.175909:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9494 00000100:00100000:1.0:1762166976.176352:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945d011eaa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449693056:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166976.176394:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166976.176423:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cd123ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1762166976.176444:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449693056 00000100:00100000:2.0:1762166976.176450:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449693056 00000100:00100000:2.0:1762166976.176531:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1316 00000100:00100000:2.0:1762166976.176540:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945d011e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449693056:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762166976.176631:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945d011e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449693056:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 94us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166976.176638:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1316 00000100:00100000:1.0:1762166976.176674:0:19593:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 17179876191 gen 2 00000004:00080000:1.0:1762166976.176680:0:19593:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 17179876186 committed transno 17179876191 00000004:00080000:1.0:1762166976.176698:0:19593:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc7d21c00, transno 17179876187 00000004:00080000:1.0:1762166976.176720:0:19593:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc7d21180, transno 17179876188 00000004:00080000:1.0:1762166976.176723:0:19593:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf783dc00, transno 17179876189 00000004:00080000:1.0:1762166976.176726:0:19593:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc7d20380, transno 17179876190 00000004:00080000:1.0:1762166976.176729:0:19593:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf783ed80, transno 17179876191 00000100:00100000:1.0:1762166976.176748:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945d011eaa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449693056:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166976.176791:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945d011eaa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449693184:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166976.176819:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166976.176852:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cee0836c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166976.176884:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449693184 00000100:00100000:3.0:1762166976.176895:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449693184 00000100:00100000:3.0:1762166976.176961:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1317 00000100:00100000:3.0:1762166976.176971:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945d011eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+12:19593:x1847765449693184:12345-0@lo:1000:mdt_rdpg00_003.0 00000004:00080000:2.0:1762166976.177088:0:9994:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0001: 0 changes, 0 in progress, 0 in flight, 5 done 00000100:00100000:3.0:1762166976.177116:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945d011eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+12:19593:x1847765449693184:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 147us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166976.177124:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1317 00000100:00100000:1.0:1762166976.177164:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945d011eaa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449693184:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166976.177212:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945d011eaa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449693312:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166976.177244:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166976.177272:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cee083840 going to sleep for 11 seconds 00000100:00100000:3.0:1762166976.177303:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449693312 00000100:00100000:3.0:1762166976.177310:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449693312 00000100:00100000:3.0:1762166976.177343:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1318 00000100:00100000:3.0:1762166976.177349:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945d011e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+12:19593:x1847765449693312:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166976.177403:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945d011e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+12:19593:x1847765449693312:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 55us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166976.177408:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1318 00000100:00100000:1.0:1762166976.177448:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945d011eaa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449693312:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166976.177534:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945d011eaa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449693440:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166976.177569:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166976.177595:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cee083d80 going to sleep for 11 seconds 00000100:00100000:3.0:1762166976.177623:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449693440 00000100:00100000:3.0:1762166976.177629:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449693440 00000100:00100000:3.0:1762166976.177660:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1319 00000100:00100000:3.0:1762166976.177666:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945d011e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449693440:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166976.177728:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945d011e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449693440:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 62us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166976.177735:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1319 00000100:00100000:1.0:1762166976.177776:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945d011eaa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449693440:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166976.177824:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945d011eaa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449693568:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166976.177842:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166976.177858:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cd123ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1762166976.177880:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449693568 00000100:00100000:3.0:1762166976.177884:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449693568 00000100:00100000:3.0:1762166976.177927:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1320 00000100:00100000:3.0:1762166976.177933:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcceb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+12:19593:x1847765449693568:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166976.177988:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcceb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+12:19593:x1847765449693568:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 54us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166976.177996:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1320 00000100:00100000:1.0:1762166976.178005:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945d011eaa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449693568:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166976.178031:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945d011eaa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449693696:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166976.178045:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166976.178059:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cca870e40 going to sleep for 11 seconds 00000100:00100000:3.0:1762166976.178071:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449693696 00000100:00100000:3.0:1762166976.178076:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449693696 00000100:00100000:3.0:1762166976.178099:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1321 00000100:00100000:3.0:1762166976.178104:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449693696:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166976.178166:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449693696:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 61us (118us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166976.178174:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1321 00000100:00100000:1.0:1762166976.178191:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945d011eaa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449693696:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166976.178225:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945d011eaa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449693824:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166976.178245:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166976.178262:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011c7e40 going to sleep for 11 seconds 00000100:00100000:3.0:1762166976.178286:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449693824 00000100:00100000:3.0:1762166976.178290:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449693824 00000100:00100000:3.0:1762166976.178314:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1322 00000100:00100000:3.0:1762166976.178320:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+12:19593:x1847765449693824:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166976.178370:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+12:19593:x1847765449693824:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 50us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166976.178377:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1322 00000100:00100000:1.0:1762166976.178393:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945d011eaa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449693824:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166976.178422:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449693952:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166976.178445:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166976.178463:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cd123ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1762166976.178471:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449693952 00000100:00100000:3.0:1762166976.178504:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449693952 00000100:00100000:3.0:1762166976.178530:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1323 00000100:00100000:3.0:1762166976.178539:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449693952:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166976.178588:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449693952:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 50us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166976.178595:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1323 00000100:00100000:1.0:1762166976.178600:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449693952:0@lo:1000:mdt_rdpg00_003.0 00000040:00080000:1.0:1762166976.178777:0:19593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x2:0x0].42, 456 off64288 00000001:00080000:1.0:1762166976.178793:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294991868 00000100:00100000:1.0:1762166976.178841:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449694080:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166976.178860:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166976.178879:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cca870000 going to sleep for 11 seconds 00000100:00100000:3.0:1762166976.178911:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449694080 00000100:00100000:3.0:1762166976.178916:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449694080 00000100:00100000:3.0:1762166976.178941:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1324 00000100:00100000:3.0:1762166976.178946:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945d011eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449694080:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166976.179057:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945d011eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:19593:x1847765449694080:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 110us (194us total) trans 17179876217 rc 0/0 00000100:00100000:3.0:1762166976.179068:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1324 00000100:00100000:1.0:1762166976.179073:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449694080:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166976.179093:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bccb7e300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449694208:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166976.179110:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166976.179128:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cca870000 going to sleep for 11 seconds 00000100:00100000:3.0:1762166976.179148:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449694208 00000100:00100000:3.0:1762166976.179152:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449694208 00000100:00100000:3.0:1762166976.179182:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1325 00000100:00100000:3.0:1762166976.179188:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+12:19593:x1847765449694208:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166976.179272:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+13:19593:x1847765449694208:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 83us (159us total) trans 21474843193 rc 0/0 00000100:00100000:3.0:1762166976.179280:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1325 00000100:00100000:1.0:1762166976.179285:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bccb7e300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449694208:0@lo:1000:mdt_rdpg00_003.0 00000001:00080000:1.0:1762166976.179334:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294991869 00010000:00010000:1.0:1762166976.179359:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473a00/0x2f180c4effba9fe0 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x608:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166976.179370:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473a00/0x2f180c4effba9fe0 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x608:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166976.179378:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473a00/0x2f180c4effba9fe0 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x608:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166976.179385:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8473a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166976.179390:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473a00/0x2f180c4effba9fe0 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x608:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166976.179399:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473a00/0x2f180c4effba9fe0 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x608:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166976.179417:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x608:0x0].0x0 (ffff945bc812e500) 00010000:00010000:1.0:1762166976.179421:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1762166976.179426:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473a00/0x2f180c4effba9fe0 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x608:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166976.179432:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473a00/0x2f180c4effba9fe0 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x608:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166976.179457:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eae00/0x2f180c4effba9fd9 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166976.179462:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eae00/0x2f180c4effba9fd9 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166976.179468:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eae00/0x2f180c4effba9fd9 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166976.179473:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc56eae00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166976.179493:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eae00/0x2f180c4effba9fd9 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166976.179501:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eae00/0x2f180c4effba9fd9 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166976.179510:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.179513:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1762166976.179517:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eae00/0x2f180c4effba9fd9 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166976.179527:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eae00/0x2f180c4effba9fd9 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166976.179541:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.179543:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762166976.179550:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4410c00/0x2f180c4effba9fcb lrc: 0/0,0 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e987c expref: 555 pid: 6494 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166976.179637:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+554:61838:x1847765450362240:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 7112us (7268us total) trans 4294991870 rc 0/0 00000100:00100000:1.0:1762166976.179644:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11802 00000020:00080000:1.0:1762166976.179647:0:19593:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1762166976.180746:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.180798:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450362624 00000100:00100000:1.0:1762166976.180806:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450362624 00000100:00100000:1.0:1762166976.180852:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30281 00000100:00100000:1.0:1762166976.180862:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5807100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+554:61838:x1847765450362624:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166976.180883:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166976.180911:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eaa00/0x2f180c4effba9fe7 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9883 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.180965:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eaa00/0x2f180c4effba9fe7 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9883 expref: 555 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.180981:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eaa00/0x2f180c4effba9fe7 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9883 expref: 555 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.180998:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.181000:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166976.181002:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc56eaa00, rc 0) 00000100:00100000:1.0:1762166976.181040:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5807100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+555:61838:x1847765450362624:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 182us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166976.181045:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30281 00000100:00100000:3.0:1762166976.182615:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.182685:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450362880 00000100:00100000:1.0:1762166976.182693:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450362880 00000100:00100000:1.0:1762166976.182736:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11803 00000100:00100000:1.0:1762166976.182746:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf7838700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+555:61838:x1847765450362880:12345-192.168.204.38@tcp:35:lfs.0 00000004:00080000:1.0:1762166976.183020:0:19593:0:(mdd_object.c:3965:mdd_close()) Object [0x240000404:0x608:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1762166976.183078:0:19593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5861, 64 off458704 00000040:00080000:1.0:1762166976.183099:0:19593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5860, 64 off458704 00000001:00080000:1.0:1762166976.183104:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294991871 00010000:00010000:1.0:1762166976.183133:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb000/0x2f180c4effba9fee lrc: 3/0,1 mode: --/PW res: [0x240000404:0x608:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166976.183143:0:19593:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb000/0x2f180c4effba9fee lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x608:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166976.183153:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb000/0x2f180c4effba9fee lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x608:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166976.183162:0:19593:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb000/0x2f180c4effba9fee lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x608:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166976.183168:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb000/0x2f180c4effba9fee lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x608:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166976.183174:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb000/0x2f180c4effba9fee lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x608:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166976.183198:0:19593:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1762166976.183234:0:10257:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1762166976.183247:0:10257:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb000/0x2f180c4effba9fee lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x608:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166976.183258:0:10257:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc56eb000 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166976.183263:0:10257:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb000/0x2f180c4effba9fee lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x608:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166976.183271:0:10257:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb000/0x2f180c4effba9fee lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x608:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166976.183290:0:10257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x608:0x0].0x0 (ffff945bc812e800) 00010000:00010000:0.0:1762166976.183293:0:10257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1762166976.183296:0:10257:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb000/0x2f180c4effba9fee lrc: 1/0,0 mode: --/PW res: [0x240000404:0x608:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166976.183302:0:10257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb000/0x2f180c4effba9fee lrc: 0/0,0 mode: --/PW res: [0x240000404:0x608:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166976.183321:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166976.183322:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166976.183325:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166976.183413:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf7838700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+557:61838:x1847765450362880:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 662us (797us total) trans 4294991872 rc 0/0 00000100:00100000:1.0:1762166976.183423:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11803 00000020:00080000:1.0:1762166976.183430:0:19593:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1762166976.184426:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.184503:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450363136 00000100:00100000:1.0:1762166976.184513:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450363136 00000100:00100000:1.0:1762166976.184576:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11804 00000100:00100000:1.0:1762166976.184588:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5805c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+557:61838:x1847765450363136:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:1.0:1762166976.184883:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5805c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+558:61838:x1847765450363136:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 297us (460us total) trans 4294991873 rc 0/0 00000100:00100000:1.0:1762166976.184891:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11804 00000100:00100000:2.0:1762166976.194285:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.194344:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450363264 00000100:00100000:1.0:1762166976.194354:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450363264 00000100:00100000:1.0:1762166976.194421:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30282 00000100:00100000:1.0:1762166976.194431:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5806680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+558:61839:x1847765450363264:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166976.194453:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166976.194517:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eae00/0x2f180c4effba9ff5 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e988a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.194586:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb800/0x2f180c4effba9ffc lrc: 3/1,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166976.194602:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb800/0x2f180c4effba9ffc lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.194612:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb800/0x2f180c4effba9ffc lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.194624:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb000/0x2f180c4effbaa003 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166976.194635:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb000/0x2f180c4effbaa003 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.194641:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb000/0x2f180c4effbaa003 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.194712:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4410c00/0x2f180c4effbaa00a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166976.194721:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4410c00/0x2f180c4effbaa00a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.194727:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4410c00/0x2f180c4effbaa00a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:1.0:1762166976.194762:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 122521 00000004:00200000:1.0:1762166976.194767:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166976.194783:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4410c00/0x2f180c4effbaa00a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.194794:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4410c00/0x2f180c4effbaa00a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.194803:0:6494:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb800/0x2f180c4effba9ffc lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.194808:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb800/0x2f180c4effba9ffc lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.194814:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb800/0x2f180c4effba9ffc lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.194819:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb800/0x2f180c4effba9ffc lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.194828:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc56eb800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166976.194832:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb800/0x2f180c4effba9ffc lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.194838:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb800/0x2f180c4effba9ffc lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.194848:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0x0 (ffff945bc812e500) 00010000:00010000:1.0:1762166976.194851:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166976.194855:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb800/0x2f180c4effba9ffc lrc: 3/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.194860:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb800/0x2f180c4effba9ffc lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.194871:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb000/0x2f180c4effbaa003 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.194876:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb000/0x2f180c4effbaa003 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.194880:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb000/0x2f180c4effbaa003 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.194885:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc56eb000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166976.194888:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb000/0x2f180c4effbaa003 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.194893:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb000/0x2f180c4effbaa003 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.194899:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0xdd396665 (ffff945bc812e700) 00010000:00010000:1.0:1762166976.194915:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166976.194918:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb000/0x2f180c4effbaa003 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.194923:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb000/0x2f180c4effbaa003 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.194949:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eae00/0x2f180c4effba9ff5 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e988a expref: 560 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.194961:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4410c00/0x2f180c4effbaa00a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e988a expref: 559 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.194969:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.194971:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166976.194973:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4410c00, rc 0) 00000100:00100000:1.0:1762166976.195027:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5806680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+559:61839:x1847765450363264:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 596us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166976.195034:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30282 00000100:00100000:3.0:1762166976.196838:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.196891:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450363520 00000100:00100000:1.0:1762166976.196899:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450363520 00000100:00100000:1.0:1762166976.196956:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30283 00000100:00100000:1.0:1762166976.196966:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf7839f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+559:61839:x1847765450363520:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166976.196978:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166976.196991:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc98f5200/0x2f180c4effbaa011 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9891 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.197081:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4b200/0x2f180c4effbaa018 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166976.197092:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4b200/0x2f180c4effbaa018 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.197101:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4b200/0x2f180c4effbaa018 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:1.0:1762166976.197109:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 122521 00010000:00010000:1.0:1762166976.197207:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc98f5200/0x2f180c4effbaa011 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9891 expref: 562 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.197222:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4b200/0x2f180c4effbaa018 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9891 expref: 561 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.197230:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.197233:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1762166976.197235:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc3d4b200, rc 0) 00000100:00100000:1.0:1762166976.197279:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf7839f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+561:61839:x1847765450363520:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 314us (449us total) trans 4294991874 rc 0/0 00000100:00100000:1.0:1762166976.197287:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30283 00000100:00100000:2.0:1762166976.198541:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.198597:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450363776 00000100:00100000:1.0:1762166976.198605:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450363776 00000100:00100000:1.0:1762166976.198647:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30284 00000100:00100000:1.0:1762166976.198657:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5804a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+561:61839:x1847765450363776:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166976.198670:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166976.198682:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4a000/0x2f180c4effbaa026 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9898 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.198737:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4a400/0x2f180c4effbaa02d lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166976.198749:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4a400/0x2f180c4effbaa02d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.198758:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4a400/0x2f180c4effbaa02d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:1.0:1762166976.198767:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 122521 00010000:00010000:1.0:1762166976.198840:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4a000/0x2f180c4effbaa026 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9898 expref: 564 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.198855:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4a400/0x2f180c4effbaa02d lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9898 expref: 563 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.198863:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.198866:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762166976.198868:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc3d4a400, rc 0) 00000100:00100000:1.0:1762166976.198919:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5804a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+563:61839:x1847765450363776:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 263us (382us total) trans 4294991875 rc 0/0 00000100:00100000:1.0:1762166976.198926:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30284 00000100:00100000:2.0:1762166976.200861:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166976.200939:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450363904 00000100:00100000:0.0:1762166976.200948:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450363904 00000100:00100000:0.0:1762166976.201013:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 861 00000100:00100000:0.0:1762166976.201023:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf9d1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+563:61839:x1847765450363904:12345-192.168.204.38@tcp:103:lfs.0 00010000:00010000:0.0:1762166976.201039:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166976.201064:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4a400/0x2f180c4effbaa02d lrc: 0/0,0 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9898 expref: 563 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.201088:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166976.201093:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166976.201144:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf9d1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+562:61839:x1847765450363904:12345-192.168.204.38@tcp:103:lfs.0 Request processed in 123us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166976.201152:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 861 00000100:00100000:3.0:1762166976.201888:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.201951:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450364160 00000100:00100000:1.0:1762166976.201956:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450364160 00000100:00100000:1.0:1762166976.201992:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11805 00000100:00100000:1.0:1762166976.202002:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7d2a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+562:61839:x1847765450364160:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:1.0:1762166976.202221:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7d2a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+563:61839:x1847765450364160:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 221us (333us total) trans 4294991876 rc 0/0 00000100:00100000:1.0:1762166976.202230:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11805 00000100:00100000:2.0:1762166976.204183:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.204298:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450364416 00000100:00100000:1.0:1762166976.204307:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450364416 00000100:00100000:1.0:1762166976.204369:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30285 00000100:00100000:1.0:1762166976.204379:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5807480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+563:61766:x1847765450364416:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:1.0:1762166976.204403:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166976.204427:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eae00/0x2f180c4effbaa03b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e989f expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.204564:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb000/0x2f180c4effbaa042 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166976.204584:0:6494:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4410c00/0x2f180c4effbaa00a lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e988a expref: 564 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.204594:0:6494:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb000/0x2f180c4effbaa042 lrc: 4/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.204635:0:6494:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4410c00/0x2f180c4effbaa00a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e988a expref: 564 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.204652:0:6494:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4410c00/0x2f180c4effbaa00a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e988a expref: 564 pid: 6494 timeout: 695 lvb_type: 0 00000100:00100000:1.0:1762166976.204669:0:6494:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bccb7df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765449694336:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166976.204789:0:6494:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cca870000 going to sleep for 11 seconds 00000100:00100000:1.0:1762166976.205701:0:6494:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bccb7df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765449694336:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166976.205727:0:6494:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb000/0x2f180c4effbaa042 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000100:00100000:2.0:1762166976.205868:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166976.205933:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450364544 00000100:00100000:0.0:1762166976.205942:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450364544 00010000:00010000:0.0:1762166976.205976:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4410c00/0x2f180c4effbaa00a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e988a expref: 565 pid: 6494 timeout: 695 lvb_type: 0 00000100:00100000:0.0:1762166976.206019:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9495 00000100:00100000:0.0:1762166976.206036:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5807b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+565:2418:x1847765450364544:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166976.206048:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166976.206055:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4410c00/0x2f180c4effbaa00a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e988a expref: 565 pid: 6494 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166976.206068:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4410c00/0x2f180c4effbaa00a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e988a expref: 565 pid: 6494 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166976.206089:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4410c00/0x2f180c4effbaa00a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e988a expref: 565 pid: 6494 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166976.206107:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166976.206116:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb000/0x2f180c4effbaa042 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166976.206130:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb000/0x2f180c4effbaa042 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166976.206138:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb000/0x2f180c4effbaa042 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166976.206164:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166976.206188:0:6494:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb000/0x2f180c4effbaa042 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.206198:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb000/0x2f180c4effbaa042 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000100:00100000:0.0:1762166976.206211:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5807b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+564:2418:x1847765450364544:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 181us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166976.206224:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9495 00000004:00200000:1.0:1762166976.206229:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 122521 00010000:00010000:1.0:1762166976.206371:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eae00/0x2f180c4effbaa03b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e989f expref: 565 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.206398:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb000/0x2f180c4effbaa042 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e989f expref: 564 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.206407:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.206410:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1762166976.206413:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc56eb000, rc 0) 00000100:00100000:1.0:1762166976.206452:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5807480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+564:61766:x1847765450364416:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 2076us (2278us total) trans 4294991877 rc 0/0 00000100:00100000:1.0:1762166976.206460:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30285 00000100:00100000:2.0:1762166976.208040:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.208102:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450364672 00000100:00100000:1.0:1762166976.208111:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450364672 00000100:00100000:1.0:1762166976.208167:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30286 00000100:00100000:1.0:1762166976.208178:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5804000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+564:61766:x1847765450364672:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:1.0:1762166976.208201:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166976.208218:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb800/0x2f180c4effbaa050 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e98a6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.208308:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc98f5200/0x2f180c4effbaa057 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166976.208329:0:6494:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb000/0x2f180c4effbaa042 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e989f expref: 565 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.208338:0:6494:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc98f5200/0x2f180c4effbaa057 lrc: 4/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.208371:0:6494:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb000/0x2f180c4effbaa042 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e989f expref: 565 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.208383:0:6494:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb000/0x2f180c4effbaa042 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e989f expref: 565 pid: 6494 timeout: 695 lvb_type: 0 00000100:00100000:1.0:1762166976.208397:0:6494:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bccb7df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765449694464:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166976.208469:0:6494:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cca870e40 going to sleep for 11 seconds 00000100:00100000:1.0:1762166976.209384:0:6494:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bccb7df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765449694464:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166976.209405:0:6494:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc98f5200/0x2f180c4effbaa057 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000100:00100000:2.0:1762166976.209557:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166976.209593:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450364800 00000100:00100000:0.0:1762166976.209599:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450364800 00010000:00010000:0.0:1762166976.209626:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb000/0x2f180c4effbaa042 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e989f expref: 566 pid: 6494 timeout: 695 lvb_type: 0 00000100:00100000:0.0:1762166976.209665:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9496 00000100:00100000:0.0:1762166976.209674:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5805880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+566:2419:x1847765450364800:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166976.209687:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166976.209693:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb000/0x2f180c4effbaa042 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e989f expref: 566 pid: 6494 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166976.209704:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb000/0x2f180c4effbaa042 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e989f expref: 566 pid: 6494 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166976.209718:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb000/0x2f180c4effbaa042 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e989f expref: 566 pid: 6494 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166976.209729:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166976.209732:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc98f5200/0x2f180c4effbaa057 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166976.209741:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc98f5200/0x2f180c4effbaa057 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166976.209746:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc98f5200/0x2f180c4effbaa057 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166976.209764:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166976.209787:0:6494:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc98f5200/0x2f180c4effbaa057 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.209797:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc98f5200/0x2f180c4effbaa057 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000100:00100000:0.0:1762166976.209805:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5805880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+565:2419:x1847765450364800:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 130us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166976.209814:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9496 00000004:00200000:1.0:1762166976.209842:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 122521 00000004:00200000:1.0:1762166976.209849:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166976.209870:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc98f5200/0x2f180c4effbaa057 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.209899:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb800/0x2f180c4effbaa050 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e98a6 expref: 565 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.209938:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc98f5200/0x2f180c4effbaa057 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e98a6 expref: 564 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.209956:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.209959:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166976.209961:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc98f5200, rc 0) 00000100:00100000:1.0:1762166976.209999:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5804000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+564:61766:x1847765450364672:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 1824us (1965us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166976.210008:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30286 00000100:00100000:2.0:1762166976.211524:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.211556:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450364928 00000100:00100000:1.0:1762166976.211563:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450364928 00000100:00100000:1.0:1762166976.211602:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30287 00000100:00100000:1.0:1762166976.211611:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5806a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+564:61766:x1847765450364928:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:1.0:1762166976.211630:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166976.211647:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cd1af1200/0x2f180c4effbaa05e lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e98ad expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.211674:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc606fc00/0x2f180c4effbaa065 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166976.211685:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc606fc00/0x2f180c4effbaa065 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.211694:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc606fc00/0x2f180c4effbaa065 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.211789:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cd1af1200/0x2f180c4effbaa05e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e98ad expref: 566 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.211803:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc606fc00/0x2f180c4effbaa065 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e98ad expref: 565 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.211816:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.211819:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1762166976.211822:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc606fc00, rc 0) 00000100:00100000:1.0:1762166976.211860:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5806a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+565:61766:x1847765450364928:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 250us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166976.211867:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30287 00000100:00100000:2.0:1762166976.212811:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.212850:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450365184 00000100:00100000:1.0:1762166976.212856:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450365184 00000100:00100000:1.0:1762166976.212887:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30288 00000100:00100000:1.0:1762166976.212896:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5805500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+565:61766:x1847765450365184:12345-192.168.204.38@tcp:36:fsx.0 00010000:00010000:1.0:1762166976.212945:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166976.212960:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc98f5200/0x2f180c4effbaa057 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e98a6 expref: 565 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.212973:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.212977:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166976.213156:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc606ee00/0x2f180c4effbaa06c lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166976.213169:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc606ee00/0x2f180c4effbaa06c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.213176:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc606ee00/0x2f180c4effbaa06c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000001:00080000:1.0:1762166976.213220:0:6494:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294991878 00000004:00010000:1.0:1762166976.213244:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000979bb48c reply state 000000001aaa9334 transno 4294991879 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc606ee00/0x2f180c4effbaa06c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.213261:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc606ee00/0x2f180c4effbaa06c lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.213268:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.213270:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166976.213273:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166976.213334:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5805500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+567:61766:x1847765450365184:12345-192.168.204.38@tcp:36:fsx.0 Request processed in 439us (526us total) trans 4294991879 rc 0/0 00000100:00100000:1.0:1762166976.213341:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30288 00000020:00080000:1.0:1762166976.213345:0:6494:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1762166976.214473:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166976.214580:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166976.214595:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450365312 00000100:00100000:0.0:1762166976.214603:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450365312 00000100:00100000:3.0:1762166976.214638:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.214639:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450365440 00002000:00010000:0.0:1762166976.214641:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (248925->18446744073709551615) 00002000:00100000:0.0:1762166976.214650:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf7838e00 with x1847765450365312 ext(248925->18446744073709551615) 00000100:00100000:1.0:1762166976.214655:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450365440 00002000:00010000:0.0:1762166976.214663:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf7838e00. 00000100:00100000:0.0:1762166976.214692:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450365568 00002000:00010000:1.0:1762166976.214698:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00000100:00100000:0.0:1762166976.214698:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450365568 00002000:00100000:1.0:1762166976.214707:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf7838a80 with x1847765450365440 ext(0->18446744073709551615) 00000100:00100000:2.0:1762166976.214712:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2035 00002000:00010000:0.0:1762166976.214718:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00010000:1.0:1762166976.214723:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945cf7838a80. 00002000:00100000:0.0:1762166976.214724:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf7839c00 with x1847765450365568 ext(0->18446744073709551615) 00000100:00100000:2.0:1762166976.214735:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf7838e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450365312:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:0.0:1762166976.214739:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf7839c00. 00000100:00100000:1.0:1762166976.214776:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2036 00000100:00100000:0.0:1762166976.214789:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2037 00000100:00100000:1.0:1762166976.214796:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf7838a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765450365440:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:0.0:1762166976.214806:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf7839c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450365568:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:0.0:1762166976.214929:0:14623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166976.214934:0:14623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:0.0:1762166976.214937:0:14623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00002000:00010000:0.0:1762166976.214939:0:14623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:0.0:1762166976.214942:0:14623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:2.0:1762166976.214963:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 122521 -> 248925 00002000:00010000:2.0:1762166976.214968:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:2.0:1762166976.214972:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166976 -> 1762166976 00002000:00010000:2.0:1762166976.214976:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:2.0:1762166976.214979:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 240 -> 240 00002000:00010000:1.0:1762166976.214989:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:0.0:1762166976.214996:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf7839c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765450365568:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 192us (356us total) trans 17179876218 rc 0/0 00002000:00010000:1.0:1762166976.214998:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.215012:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00000100:00100000:2.0:1762166976.215014:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf7838e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765450365312:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 285us (540us total) trans 17179876219 rc 0/0 00002000:00010000:1.0:1762166976.215018:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00000100:00100000:0.0:1762166976.215021:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2037 00002000:00010000:1.0:1762166976.215036:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00002000:00010000:0.0:1762166976.215037:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00000100:00100000:2.0:1762166976.215048:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2035 00002000:00100000:0.0:1762166976.215054:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf7839c00 with x1847765450365568 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166976.215057:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (248925->18446744073709551615) 00002000:00010000:0.0:1762166976.215060:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf7839c00. 00002000:00100000:2.0:1762166976.215062:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf7838e00 with x1847765450365312 ext(248925->18446744073709551615) 00002000:00010000:2.0:1762166976.215070:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf7838e00. 00000100:00100000:1.0:1762166976.215131:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf7838a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+25:2419:x1847765450365440:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 342us (548us total) trans 21474843194 rc 0/0 00000100:00100000:1.0:1762166976.215141:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2036 00002000:00010000:1.0:1762166976.215146:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:1.0:1762166976.215151:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf7838a80 with x1847765450365440 ext(0->18446744073709551615) 00002000:00010000:1.0:1762166976.215158:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945cf7838a80. 00000100:00100000:3.0:1762166976.215893:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.215940:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450365696 00000100:00100000:1.0:1762166976.215946:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450365696 00000100:00100000:1.0:1762166976.215982:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30289 00000100:00100000:1.0:1762166976.215990:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+567:61766:x1847765450365696:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:1.0:1762166976.216007:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166976.216024:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc606e800/0x2f180c4effbaa073 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e98b4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.216121:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4a14000/0x2f180c4effbaa07a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166976.216134:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4a14000/0x2f180c4effbaa07a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.216144:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4a14000/0x2f180c4effbaa07a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:1.0:1762166976.216167:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 248925 00000004:00200000:1.0:1762166976.216171:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166976.216185:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4a14000/0x2f180c4effbaa07a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.216209:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc606e800/0x2f180c4effbaa073 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e98b4 expref: 569 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.216224:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4a14000/0x2f180c4effbaa07a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e98b4 expref: 568 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.216232:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.216236:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166976.216240:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4a14000, rc 0) 00000100:00100000:1.0:1762166976.216275:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+568:61766:x1847765450365696:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 285us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166976.216283:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30289 00000100:00100000:2.0:1762166976.218439:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.218573:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450365824 00000100:00100000:1.0:1762166976.218581:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450365824 00002000:00100000:1.0:1762166976.218623:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (176128->217087) req@ffff945bc5806d80 x1847765450365824/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:7/0 lens 488/0 e 0 to 0 dl 1762166987 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166976.218636:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5806d80 with x1847765450365824 ext(176128->217087) 00002000:00010000:1.0:1762166976.218642:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5806d80 00000100:00100000:1.0:1762166976.218677:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2038 00000100:00100000:1.0:1762166976.218687:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5806d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765450365824:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:1.0:1762166976.219684:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5806d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765450365824:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 996us (1252us total) trans 0 rc 40960/40960 00000100:00100000:1.0:1762166976.219694:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2038 00002000:00100000:1.0:1762166976.219704:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (176128->217087) req@ffff945bc5806d80 x1847765450365824/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:7/0 lens 488/440 e 0 to 0 dl 1762166987 ref 1 fl Complete:/600/0 rc 40960/40960 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166976.219714:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5806d80 with x1847765450365824 ext(176128->217087) 00002000:00010000:1.0:1762166976.219718:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5806d80 00000100:00100000:3.0:1762166976.221338:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.221409:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450365952 00000100:00100000:1.0:1762166976.221419:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450365952 00002000:00100000:1.0:1762166976.221463:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (217088->221183) req@ffff945cf783bb80 x1847765450365952/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:7/0 lens 488/0 e 0 to 0 dl 1762166987 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166976.221474:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf783bb80 with x1847765450365952 ext(217088->221183) 00002000:00010000:1.0:1762166976.221511:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf783bb80 00000100:00100000:1.0:1762166976.221558:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2039 00000100:00100000:1.0:1762166976.221575:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450365952:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:1.0:1762166976.221785:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450365952:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 216us (451us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1762166976.221794:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2039 00002000:00100000:1.0:1762166976.221802:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (217088->221183) req@ffff945cf783bb80 x1847765450365952/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:7/0 lens 488/4536 e 0 to 0 dl 1762166987 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166976.221810:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf783bb80 with x1847765450365952 ext(217088->221183) 00002000:00010000:1.0:1762166976.221814:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf783bb80 00000100:00100000:2.0:1762166976.223579:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.223637:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450366080 00000100:00100000:1.0:1762166976.223647:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450366080 00000100:00100000:1.0:1762166976.223704:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2040 00000100:00100000:1.0:1762166976.223722:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5805f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+22:2417:x1847765450366080:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:1.0:1762166976.223986:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 248925 -> 248925 00002000:00010000:1.0:1762166976.223991:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.223993:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.223996:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.223999:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 240 -> 216 00000100:00100000:1.0:1762166976.224052:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5805f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+23:2417:x1847765450366080:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 335us (482us total) trans 17179876220 rc 0/0 00000100:00100000:1.0:1762166976.224060:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2040 00000100:00100000:3.0:1762166976.225782:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.225859:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450366208 00000100:00100000:1.0:1762166976.225864:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450366208 00000100:00100000:1.0:1762166976.225918:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2041 00000100:00100000:1.0:1762166976.225927:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+23:2416:x1847765450366208:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:1.0:1762166976.226155:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 248925 -> 248925 00002000:00010000:1.0:1762166976.226159:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.226161:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.226163:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.226165:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 216 -> 232 00000100:00100000:1.0:1762166976.226210:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+24:2416:x1847765450366208:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 283us (435us total) trans 17179876221 rc 0/0 00000100:00100000:1.0:1762166976.226217:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2041 00000100:00100000:3.0:1762166976.228896:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.228974:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450366336 00000100:00100000:1.0:1762166976.228984:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450366336 00000100:00100000:1.0:1762166976.229030:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2042 00000100:00100000:1.0:1762166976.229036:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf7838700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+24:2416:x1847765450366336:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:1.0:1762166976.229179:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 248925 -> 248925 00002000:00010000:1.0:1762166976.229182:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.229183:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.229185:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.229186:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 232 -> 232 00000100:00100000:1.0:1762166976.229241:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf7838700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+25:2416:x1847765450366336:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 204us (354us total) trans 17179876222 rc 0/0 00000100:00100000:1.0:1762166976.229249:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2042 00000100:00100000:2.0:1762166976.231157:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.231223:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450366464 00000100:00100000:1.0:1762166976.231230:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450366464 00002000:00100000:1.0:1762166976.231262:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (0->249855) req@ffff945bc5804700 x1847765450366464/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:7/0 lens 504/0 e 0 to 0 dl 1762166987 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166976.231279:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5804700 with x1847765450366464 ext(0->249855) 00002000:00010000:1.0:1762166976.231285:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5804700 00000100:00100000:1.0:1762166976.231316:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2043 00000100:00100000:1.0:1762166976.231325:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5804700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+25:2417:x1847765450366464:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:1.0:1762166976.232666:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5804700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+25:2417:x1847765450366464:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 1338us (1507us total) trans 0 rc 217088/217088 00000100:00100000:1.0:1762166976.232676:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2043 00002000:00100000:1.0:1762166976.232685:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (0->249855) req@ffff945bc5804700 x1847765450366464/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:7/0 lens 504/440 e 0 to 0 dl 1762166987 ref 1 fl Complete:/600/0 rc 217088/217088 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166976.232695:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5804700 with x1847765450366464 ext(0->249855) 00002000:00010000:1.0:1762166976.232699:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5804700 00000100:00100000:3.0:1762166976.235182:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.235280:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450366592 00000100:00100000:1.0:1762166976.235296:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450366592 00002000:00100000:1.0:1762166976.235360:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (24576->221183) req@ffff945cf7839180 x1847765450366592/t0(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:7/0 lens 504/0 e 0 to 0 dl 1762166987 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166976.235374:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf7839180 with x1847765450366592 ext(24576->221183) 00002000:00010000:1.0:1762166976.235381:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf7839180 00000100:00100000:1.0:1762166976.235421:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2044 00000100:00100000:1.0:1762166976.235434:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf7839180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+25:2419:x1847765450366592:12345-192.168.204.38@tcp:4:fsx.0 00000100:00100000:1.0:1762166976.237246:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf7839180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+27:2419:x1847765450366592:12345-192.168.204.38@tcp:4:fsx.0 Request processed in 1809us (2065us total) trans 17179876223 rc 0/0 00000100:00100000:1.0:1762166976.237259:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2044 00002000:00100000:1.0:1762166976.237272:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (24576->221183) req@ffff945cf7839180 x1847765450366592/t17179876223(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:7/0 lens 504/448 e 0 to 0 dl 1762166987 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166976.237282:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf7839180 with x1847765450366592 ext(24576->221183) 00002000:00010000:1.0:1762166976.237289:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf7839180 00000100:00100000:3.0:1762166976.238600:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.238658:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450366720 00000100:00100000:1.0:1762166976.238666:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450366720 00000100:00100000:1.0:1762166976.238724:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18790 00000100:00100000:1.0:1762166976.238736:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3e6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+27:2418:x1847765450366720:12345-192.168.204.38@tcp:16:fsx.0 00000001:00080000:2.0:1762166976.239820:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876223 is committed 00000001:00080000:2.0:1762166976.239842:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876217 is committed 00000100:00100000:1.0:1762166976.239985:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3e6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450366720:12345-192.168.204.38@tcp:16:fsx.0 Request processed in 1247us (1383us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166976.239997:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18790 00000100:00100000:3.0:1762166976.241864:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.241919:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450366848 00000100:00100000:1.0:1762166976.241939:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450366848 00000100:00100000:1.0:1762166976.242006:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2045 00000100:00100000:1.0:1762166976.242018:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6225f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450366848:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:1.0:1762166976.242274:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 248925 -> 248925 00002000:00010000:1.0:1762166976.242277:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.242279:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.242281:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.242282:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 232 -> 264 00000100:00100000:1.0:1762166976.242346:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6225f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450366848:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 330us (489us total) trans 17179876224 rc 0/0 00000100:00100000:1.0:1762166976.242353:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2045 00000100:00100000:2.0:1762166976.245267:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.245327:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450366976 00000100:00100000:1.0:1762166976.245338:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450366976 00000100:00100000:1.0:1762166976.245400:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2046 00000100:00100000:1.0:1762166976.245410:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5805c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450366976:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:1.0:1762166976.245798:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 248925 -> 248925 00002000:00010000:1.0:1762166976.245804:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.245806:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.245808:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.245810:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 264 -> 320 00000100:00100000:1.0:1762166976.245878:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5805c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450366976:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 470us (617us total) trans 17179876225 rc 0/0 00000100:00100000:1.0:1762166976.245888:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2046 00000100:00100000:3.0:1762166976.247958:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.248000:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450367104 00000100:00100000:1.0:1762166976.248010:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450367104 00000100:00100000:1.0:1762166976.248071:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2047 00000100:00100000:1.0:1762166976.248085:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6225500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450367104:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:1.0:1762166976.248529:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 248925 -> 248925 00002000:00010000:1.0:1762166976.248534:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.248536:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.248539:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.248541:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 320 -> 352 00000100:00100000:1.0:1762166976.248599:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6225500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450367104:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 515us (646us total) trans 17179876226 rc 0/0 00000100:00100000:1.0:1762166976.248608:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2047 00000100:00100000:3.0:1762166976.250998:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.251061:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450367232 00000100:00100000:1.0:1762166976.251072:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450367232 00000100:00100000:1.0:1762166976.251140:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2048 00000100:00100000:1.0:1762166976.251151:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6224380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765450367232:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:1.0:1762166976.251461:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 248925 -> 248925 00002000:00010000:1.0:1762166976.251465:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.251468:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.251470:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.251473:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 352 -> 408 00000100:00100000:1.0:1762166976.251577:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6224380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765450367232:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 427us (589us total) trans 17179876227 rc 0/0 00000100:00100000:1.0:1762166976.251585:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2048 00000100:00100000:2.0:1762166976.254751:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.254798:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450367360 00000100:00100000:1.0:1762166976.254808:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450367360 00002000:00100000:1.0:1762166976.254857:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (69632->249855) req@ffff945bc5806300 x1847765450367360/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:7/0 lens 520/0 e 0 to 0 dl 1762166987 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166976.254866:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5806300 with x1847765450367360 ext(69632->249855) 00002000:00010000:1.0:1762166976.254874:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5806300 00000100:00100000:1.0:1762166976.254917:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2049 00000100:00100000:1.0:1762166976.254929:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5806300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765450367360:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:1.0:1762166976.256430:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5806300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765450367360:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 1495us (1689us total) trans 0 rc 102400/102400 00000100:00100000:1.0:1762166976.256443:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2049 00002000:00100000:1.0:1762166976.256453:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (69632->249855) req@ffff945bc5806300 x1847765450367360/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:7/0 lens 520/440 e 0 to 0 dl 1762166987 ref 1 fl Complete:/600/0 rc 102400/102400 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166976.256468:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5806300 with x1847765450367360 ext(69632->249855) 00002000:00010000:1.0:1762166976.256473:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5806300 00000100:00100000:3.0:1762166976.258221:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.258321:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450367488 00000100:00100000:1.0:1762166976.258337:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450367488 00002000:00100000:1.0:1762166976.258396:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (167936->180223) req@ffff945bc6227100 x1847765450367488/t0(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:7/0 lens 12776/0 e 0 to 0 dl 1762166987 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166976.258408:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc6227100 with x1847765450367488 ext(167936->180223) 00002000:00010000:1.0:1762166976.258414:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc6227100 00000100:00100000:1.0:1762166976.258453:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2050 00000100:00100000:1.0:1762166976.258465:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6227100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765450367488:12345-192.168.204.38@tcp:4:fsx.0 00000100:00100000:1.0:1762166976.259110:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6227100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+25:2418:x1847765450367488:12345-192.168.204.38@tcp:4:fsx.0 Request processed in 646us (895us total) trans 17179876228 rc 0/0 00000100:00100000:1.0:1762166976.259119:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2050 00002000:00100000:1.0:1762166976.259128:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (167936->180223) req@ffff945bc6227100 x1847765450367488/t17179876228(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:7/0 lens 12776/448 e 0 to 0 dl 1762166987 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166976.259136:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc6227100 with x1847765450367488 ext(167936->180223) 00002000:00010000:1.0:1762166976.259139:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc6227100 00000100:00100000:2.0:1762166976.260494:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.260540:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450367616 00000100:00100000:1.0:1762166976.260550:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450367616 00000100:00100000:1.0:1762166976.260582:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18791 00000100:00100000:1.0:1762166976.260588:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+25:2418:x1847765450367616:12345-192.168.204.38@tcp:16:fsx.0 00000001:00080000:2.0:1762166976.261629:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876228 is committed 00000100:00100000:1.0:1762166976.261780:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450367616:12345-192.168.204.38@tcp:16:fsx.0 Request processed in 1188us (1297us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166976.261790:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18791 00000100:00100000:3.0:1762166976.265647:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.265703:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450367744 00000100:00100000:1.0:1762166976.265713:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450367744 00000100:00100000:1.0:1762166976.265774:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2051 00000100:00100000:1.0:1762166976.265786:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6227480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450367744:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:1.0:1762166976.266188:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 248925 -> 248925 00002000:00010000:1.0:1762166976.266192:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.266195:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.266197:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.266199:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 408 -> 368 00000100:00100000:1.0:1762166976.266261:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6227480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450367744:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 477us (621us total) trans 17179876229 rc 0/0 00000100:00100000:1.0:1762166976.266269:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2051 00000100:00100000:3.0:1762166976.269453:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.269534:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450367872 00000100:00100000:1.0:1762166976.269544:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450367872 00000100:00100000:1.0:1762166976.269602:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2052 00000100:00100000:1.0:1762166976.269613:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6226a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450367872:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:1.0:1762166976.269786:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 248925 -> 262144 00002000:00010000:1.0:1762166976.269789:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.269790:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.269792:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.269793:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 368 -> 392 00000100:00100000:1.0:1762166976.269837:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6226a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450367872:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 226us (392us total) trans 17179876230 rc 0/0 00000100:00100000:1.0:1762166976.269845:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2052 00000100:00100000:2.0:1762166976.273956:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.274026:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450368000 00000100:00100000:1.0:1762166976.274040:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450368000 00002000:00100000:1.0:1762166976.274091:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (159744->204799) req@ffff945bc7d21c00 x1847765450368000/t0(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:7/0 lens 488/0 e 0 to 0 dl 1762166987 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166976.274104:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc7d21c00 with x1847765450368000 ext(159744->204799) 00002000:00010000:1.0:1762166976.274110:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc7d21c00 00000100:00100000:1.0:1762166976.274145:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2053 00000100:00100000:1.0:1762166976.274155:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450368000:12345-192.168.204.38@tcp:4:fsx.0 00000100:00100000:1.0:1762166976.276394:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+24:2418:x1847765450368000:12345-192.168.204.38@tcp:4:fsx.0 Request processed in 2236us (2448us total) trans 17179876232 rc 0/0 00000100:00100000:1.0:1762166976.276403:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2053 00002000:00100000:1.0:1762166976.276410:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (159744->204799) req@ffff945bc7d21c00 x1847765450368000/t17179876232(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:7/0 lens 488/448 e 0 to 0 dl 1762166987 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166976.276417:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc7d21c00 with x1847765450368000 ext(159744->204799) 00002000:00010000:1.0:1762166976.276421:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc7d21c00 00000100:00100000:2.0:1762166976.277984:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.278049:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450368128 00000100:00100000:1.0:1762166976.278058:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450368128 00000100:00100000:1.0:1762166976.278112:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18792 00000100:00100000:1.0:1762166976.278127:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765450368128:12345-192.168.204.38@tcp:16:fsx.0 00000001:00080000:2.0:1762166976.279536:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876232 is committed 00000100:00100000:1.0:1762166976.279662:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450368128:12345-192.168.204.38@tcp:16:fsx.0 Request processed in 1538us (1683us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166976.279672:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18792 00000100:00100000:2.0:1762166976.282415:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.282457:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450368256 00000100:00100000:1.0:1762166976.282466:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450368256 00000100:00100000:1.0:1762166976.282560:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2054 00000100:00100000:1.0:1762166976.282573:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450368256:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:1.0:1762166976.282720:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:1.0:1762166976.282724:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.282726:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.282729:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.282732:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 392 -> 408 00000100:00100000:1.0:1762166976.282779:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450368256:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 211us (370us total) trans 17179876233 rc 0/0 00000100:00100000:1.0:1762166976.282785:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2054 00000100:00100000:3.0:1762166976.285875:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.285958:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450368384 00000100:00100000:1.0:1762166976.285967:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450368384 00000100:00100000:1.0:1762166976.286031:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2055 00000100:00100000:1.0:1762166976.286041:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6227b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450368384:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:1.0:1762166976.286396:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:1.0:1762166976.286401:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.286403:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.286405:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.286408:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 408 -> 384 00000100:00100000:1.0:1762166976.286457:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6227b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450368384:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 418us (589us total) trans 17179876234 rc 0/0 00000100:00100000:1.0:1762166976.286462:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2055 00000100:00100000:2.0:1762166976.288372:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.288510:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450368640 00000100:00100000:1.0:1762166976.288518:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450368640 00000100:00100000:1.0:1762166976.288569:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30290 00000100:00100000:1.0:1762166976.288579:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6cd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+568:61766:x1847765450368640:12345-192.168.204.38@tcp:36:fsx.0 00010000:00010000:1.0:1762166976.288629:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166976.288656:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4a14000/0x2f180c4effbaa07a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e98b4 expref: 568 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.288674:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.288680:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166976.288841:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc606e800/0x2f180c4effbaa081 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166976.288857:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc606e800/0x2f180c4effbaa081 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.288867:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc606e800/0x2f180c4effbaa081 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000001:00080000:1.0:1762166976.288922:0:6494:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294991880 00000004:00010000:1.0:1762166976.288946:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000209c7ffa reply state 0000000035d7d51b transno 4294991881 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc606e800/0x2f180c4effbaa081 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.288957:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc606e800/0x2f180c4effbaa081 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.288963:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.288966:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166976.288969:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166976.289047:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6cd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+570:61766:x1847765450368640:12345-192.168.204.38@tcp:36:fsx.0 Request processed in 469us (681us total) trans 4294991881 rc 0/0 00000100:00100000:1.0:1762166976.289059:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30290 00000020:00080000:1.0:1762166976.289065:0:6494:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1762166976.290250:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.290297:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450368768 00000100:00100000:1.0:1762166976.290305:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450368768 00002000:00010000:1.0:1762166976.290329:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (73946->18446744073709551615) 00000100:00100000:2.0:1762166976.290331:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00002000:00100000:1.0:1762166976.290338:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc6cd2300 with x1847765450368768 ext(73946->18446744073709551615) 00002000:00010000:1.0:1762166976.290349:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc6cd2300. 00000100:00100000:2.0:1762166976.290370:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.290387:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450369024 00000100:00100000:1.0:1762166976.290394:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450369024 00002000:00010000:1.0:1762166976.290412:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:1.0:1762166976.290417:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc6cd3b80 with x1847765450369024 ext(0->18446744073709551615) 00000100:00100000:0.0:1762166976.290421:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450368896 00002000:00010000:1.0:1762166976.290424:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc6cd3b80. 00000100:00100000:0.0:1762166976.290426:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450368896 00002000:00010000:0.0:1762166976.290443:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:0.0:1762166976.290446:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc6cd2a00 with x1847765450368896 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166976.290453:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc6cd2a00. 00000100:00100000:1.0:1762166976.290528:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2056 00000100:00100000:1.0:1762166976.290539:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6cd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765450368768:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:2.0:1762166976.290549:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2057 00000100:00100000:3.0:1762166976.290562:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2058 00000100:00100000:2.0:1762166976.290571:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6cd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765450369024:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:3.0:1762166976.290612:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+25:2418:x1847765450368896:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:2.0:1762166976.290747:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166976.290750:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166976.290751:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:3.0:1762166976.290757:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:2.0:1762166976.290758:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166976.290765:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00002000:00010000:2.0:1762166976.290765:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:3.0:1762166976.290774:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:2.0:1762166976.290774:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:3.0:1762166976.290781:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00000100:00100000:2.0:1762166976.290851:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6cd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+24:2418:x1847765450369024:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 288us (518us total) trans 17179876235 rc 0/0 00000100:00100000:3.0:1762166976.290852:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+26:2418:x1847765450368896:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 276us (479us total) trans 21474843195 rc 0/0 00000100:00100000:2.0:1762166976.290869:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2057 00002000:00010000:2.0:1762166976.290875:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00000100:00100000:3.0:1762166976.290876:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2058 00002000:00100000:2.0:1762166976.290882:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc6cd3b80 with x1847765450369024 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166976.290883:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:3.0:1762166976.290889:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc6cd2a00 with x1847765450368896 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166976.290894:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc6cd3b80. 00002000:00010000:3.0:1762166976.290895:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc6cd2a00. 00002000:00010000:1.0:1762166976.291056:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 262144 -> 73946 00002000:00010000:1.0:1762166976.291060:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.291061:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.291063:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.291064:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 384 -> 128 00000100:00100000:1.0:1762166976.291109:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6cd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765450368768:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 572us (868us total) trans 17179876236 rc 0/0 00000100:00100000:1.0:1762166976.291116:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2056 00002000:00010000:1.0:1762166976.291120:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (73946->18446744073709551615) 00002000:00100000:1.0:1762166976.291123:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc6cd2300 with x1847765450368768 ext(73946->18446744073709551615) 00002000:00010000:1.0:1762166976.291129:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc6cd2300. 00000100:00100000:2.0:1762166976.292324:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.292368:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450369152 00000100:00100000:1.0:1762166976.292375:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450369152 00000100:00100000:1.0:1762166976.292420:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30291 00000100:00100000:1.0:1762166976.292432:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+570:61766:x1847765450369152:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:1.0:1762166976.292451:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166976.292469:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc98f5200/0x2f180c4effbaa088 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e98bb expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.292601:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cd1af1200/0x2f180c4effbaa08f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166976.292615:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cd1af1200/0x2f180c4effbaa08f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.292626:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cd1af1200/0x2f180c4effbaa08f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:1.0:1762166976.292655:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 73946 00000004:00200000:1.0:1762166976.292660:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166976.292675:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945cd1af1200/0x2f180c4effbaa08f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.292699:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc98f5200/0x2f180c4effbaa088 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e98bb expref: 572 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.292715:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cd1af1200/0x2f180c4effbaa08f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e98bb expref: 571 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.292724:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.292727:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166976.292730:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cd1af1200, rc 0) 00000100:00100000:1.0:1762166976.292773:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+571:61766:x1847765450369152:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 344us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166976.292780:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30291 00000100:00100000:3.0:1762166976.295023:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.295073:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450369280 00000100:00100000:1.0:1762166976.295082:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450369280 00000100:00100000:1.0:1762166976.295135:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2059 00000100:00100000:1.0:1762166976.295144:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6227800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765450369280:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:1.0:1762166976.295531:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 73946 -> 73946 00002000:00010000:1.0:1762166976.295534:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.295536:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.295537:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.295540:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 128 -> 80 00000100:00100000:1.0:1762166976.295583:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6227800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765450369280:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 440us (601us total) trans 17179876237 rc 0/0 00000100:00100000:1.0:1762166976.295592:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2059 00000100:00100000:0.0:1762166976.297821:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.297871:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450369536 00000100:00100000:1.0:1762166976.297878:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450369536 00000100:00100000:1.0:1762166976.297936:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30292 00000100:00100000:1.0:1762166976.297944:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+571:61766:x1847765450369536:12345-192.168.204.38@tcp:36:fsx.0 00010000:00010000:1.0:1762166976.297995:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166976.298016:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cd1af1200/0x2f180c4effbaa08f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e98bb expref: 571 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.298028:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.298032:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166976.298158:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4a14000/0x2f180c4effbaa096 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166976.298170:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4a14000/0x2f180c4effbaa096 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.298177:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4a14000/0x2f180c4effbaa096 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000001:00080000:1.0:1762166976.298205:0:6494:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294991882 00000004:00010000:1.0:1762166976.298221:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000004b88f0bb reply state 00000000933374a5 transno 4294991883 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4a14000/0x2f180c4effbaa096 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.298228:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4a14000/0x2f180c4effbaa096 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.298232:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.298234:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166976.298236:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166976.298291:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+573:61766:x1847765450369536:12345-192.168.204.38@tcp:36:fsx.0 Request processed in 348us (477us total) trans 4294991883 rc 0/0 00000100:00100000:1.0:1762166976.298297:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30292 00000020:00080000:1.0:1762166976.298300:0:6494:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1762166976.299774:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166976.299815:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166976.299846:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.299876:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450369664 00000100:00100000:3.0:1762166976.299881:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450369792 00000100:00100000:1.0:1762166976.299885:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450369664 00000100:00100000:3.0:1762166976.299889:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450369792 00000100:00100000:0.0:1762166976.299910:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450369920 00000100:00100000:0.0:1762166976.299916:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450369920 00002000:00010000:1.0:1762166976.299924:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (141673->18446744073709551615) 00002000:00010000:3.0:1762166976.299929:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:1.0:1762166976.299930:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc6cd1180 with x1847765450369664 ext(141673->18446744073709551615) 00002000:00010000:0.0:1762166976.299936:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:3.0:1762166976.299938:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc6cd2d80 with x1847765450369792 ext(0->18446744073709551615) 00002000:00100000:0.0:1762166976.299943:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc6cd2680 with x1847765450369920 ext(0->18446744073709551615) 00002000:00010000:1.0:1762166976.299944:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc6cd1180. 00002000:00010000:3.0:1762166976.299949:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc6cd2d80. 00002000:00010000:0.0:1762166976.299953:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc6cd2680. 00000100:00100000:1.0:1762166976.299980:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2060 00000100:00100000:1.0:1762166976.299989:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6cd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+25:2418:x1847765450369664:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:3.0:1762166976.300073:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2061 00000100:00100000:2.0:1762166976.300083:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2062 00000100:00100000:3.0:1762166976.300086:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6cd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765450369792:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:2.0:1762166976.300101:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6cd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+25:2418:x1847765450369920:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:1.0:1762166976.300172:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 73946 -> 141673 00002000:00010000:1.0:1762166976.300176:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.300179:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.300182:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:3.0:1762166976.300183:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166976.300185:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 80 -> 80 00002000:00010000:3.0:1762166976.300189:0:23939:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:3.0:1762166976.300193:0:23939:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00002000:00010000:2.0:1762166976.300195:0:14623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166976.300197:0:23939:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:2.0:1762166976.300200:0:14623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:3.0:1762166976.300202:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00002000:00010000:2.0:1762166976.300209:0:14623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00002000:00010000:2.0:1762166976.300213:0:14623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:2.0:1762166976.300216:0:14623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1762166976.300229:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6cd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+27:2418:x1847765450369664:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 241us (459us total) trans 17179876238 rc 0/0 00000100:00100000:3.0:1762166976.300239:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6cd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+27:2419:x1847765450369792:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 155us (421us total) trans 21474843196 rc 0/0 00000100:00100000:1.0:1762166976.300239:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2060 00002000:00010000:1.0:1762166976.300246:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (141673->18446744073709551615) 00000100:00100000:2.0:1762166976.300250:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6cd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+27:2418:x1847765450369920:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 153us (399us total) trans 17179876239 rc 0/0 00002000:00100000:1.0:1762166976.300252:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc6cd1180 with x1847765450369664 ext(141673->18446744073709551615) 00000100:00100000:3.0:1762166976.300257:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2061 00002000:00010000:1.0:1762166976.300261:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc6cd1180. 00002000:00010000:3.0:1762166976.300265:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00000100:00100000:2.0:1762166976.300269:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2062 00002000:00100000:3.0:1762166976.300271:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc6cd2d80 with x1847765450369792 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166976.300275:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00010000:3.0:1762166976.300279:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc6cd2d80. 00002000:00100000:2.0:1762166976.300280:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc6cd2680 with x1847765450369920 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166976.300289:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc6cd2680. 00000100:00100000:3.0:1762166976.301973:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.302025:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450370048 00000100:00100000:1.0:1762166976.302031:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450370048 00000100:00100000:1.0:1762166976.302070:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30293 00000100:00100000:1.0:1762166976.302080:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6224a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+573:61766:x1847765450370048:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:1.0:1762166976.302097:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166976.302115:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb800/0x2f180c4effbaa09d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e98c2 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.302199:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb000/0x2f180c4effbaa0a4 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 15 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166976.302214:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb000/0x2f180c4effbaa0a4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.302224:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb000/0x2f180c4effbaa0a4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:1.0:1762166976.302248:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 141673 00000004:00200000:1.0:1762166976.302252:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166976.302266:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb000/0x2f180c4effbaa0a4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.302289:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb800/0x2f180c4effbaa09d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e98c2 expref: 575 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.302304:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb000/0x2f180c4effbaa0a4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e98c2 expref: 574 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.302312:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.302315:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166976.302318:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc56eb000, rc 0) 00000100:00100000:1.0:1762166976.302362:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6224a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+574:61766:x1847765450370048:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 284us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166976.302369:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30293 00000100:00100000:0.0:1762166976.304964:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166976.305025:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450370176 00000100:00100000:2.0:1762166976.305032:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450370176 00002000:00100000:2.0:1762166976.305071:0:14623:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xa77:0x0] (0->143359) req@ffff945cf1cd1880 x1847765450370176/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:7/0 lens 504/0 e 0 to 0 dl 1762166987 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166976.305084:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1cd1880 with x1847765450370176 ext(0->143359) 00002000:00010000:2.0:1762166976.305088:0:14623:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1cd1880 00000100:00100000:2.0:1762166976.305110:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2063 00000100:00100000:2.0:1762166976.305118:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+26:2417:x1847765450370176:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:0.0:1762166976.306663:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+26:2417:x1847765450370176:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 1539us (1701us total) trans 0 rc 118784/118784 00000100:00100000:0.0:1762166976.306674:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2063 00002000:00100000:0.0:1762166976.306682:0:14623:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xa77:0x0] (0->143359) req@ffff945cf1cd1880 x1847765450370176/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:7/0 lens 504/440 e 0 to 0 dl 1762166987 ref 1 fl Complete:/600/0 rc 118784/118784 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166976.306703:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1cd1880 with x1847765450370176 ext(0->143359) 00002000:00010000:0.0:1762166976.306708:0:14623:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1cd1880 00000100:00100000:3.0:1762166976.310342:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166976.310419:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450370304 00000100:00100000:0.0:1762166976.310428:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450370304 00000100:00100000:0.0:1762166976.310524:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2064 00000100:00100000:0.0:1762166976.310590:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6225180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+26:2418:x1847765450370304:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:0.0:1762166976.310887:0:14623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 141673 -> 141673 00002000:00010000:0.0:1762166976.310891:0:14623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:0.0:1762166976.310894:0:14623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166976 -> 1762166976 00002000:00010000:0.0:1762166976.310897:0:14623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:0.0:1762166976.310925:0:14623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 80 -> 48 00000100:00100000:0.0:1762166976.310982:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6225180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+27:2418:x1847765450370304:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 392us (654us total) trans 17179876240 rc 0/0 00000100:00100000:0.0:1762166976.310991:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2064 00000100:00100000:2.0:1762166976.313119:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166976.313162:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450370432 00000100:00100000:0.0:1762166976.313169:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450370432 00002000:00100000:0.0:1762166976.313207:0:14623:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xa77:0x0] (40960->77823) req@ffff945bc6cd3800 x1847765450370432/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:7/0 lens 488/0 e 0 to 0 dl 1762166987 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166976.313215:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc6cd3800 with x1847765450370432 ext(40960->77823) 00002000:00010000:0.0:1762166976.313220:0:14623:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc6cd3800 00000100:00100000:0.0:1762166976.313243:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2065 00000100:00100000:0.0:1762166976.313249:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6cd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+27:2419:x1847765450370432:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:0.0:1762166976.314635:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6cd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+27:2419:x1847765450370432:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 1383us (1517us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1762166976.314643:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2065 00002000:00100000:0.0:1762166976.314650:0:14623:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xa77:0x0] (40960->77823) req@ffff945bc6cd3800 x1847765450370432/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:7/0 lens 488/440 e 0 to 0 dl 1762166987 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166976.314656:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc6cd3800 with x1847765450370432 ext(40960->77823) 00002000:00010000:0.0:1762166976.314660:0:14623:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc6cd3800 00000100:00100000:2.0:1762166976.318203:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.318371:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450370688 00000100:00100000:1.0:1762166976.318381:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450370688 00000100:00100000:1.0:1762166976.318435:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11806 00000100:00100000:1.0:1762166976.318444:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6cd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+574:61766:x1847765450370688:12345-192.168.204.38@tcp:35:fsx.0 00000100:00100000:1.0:1762166976.318733:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6cd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+575:61766:x1847765450370688:12345-192.168.204.38@tcp:35:fsx.0 Request processed in 289us (537us total) trans 4294991884 rc 0/0 00000100:00100000:1.0:1762166976.318742:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11806 00000100:00100000:2.0:1762166976.328334:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.328400:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450370816 00000100:00100000:1.0:1762166976.328410:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450370816 00000100:00100000:1.0:1762166976.328460:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30294 00000100:00100000:1.0:1762166976.328468:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6cd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+575:61840:x1847765450370816:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166976.328511:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166976.328528:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb800/0x2f180c4effbaa0ab lrc: 2/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e98c9 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.328608:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eae00/0x2f180c4effbaa0b2 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166976.328619:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eae00/0x2f180c4effbaa0b2 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.328626:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eae00/0x2f180c4effbaa0b2 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.328635:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cd1af1200/0x2f180c4effbaa0b9 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166976.328639:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cd1af1200/0x2f180c4effbaa0b9 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.328643:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cd1af1200/0x2f180c4effbaa0b9 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.328700:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc98f5200/0x2f180c4effbaa0c0 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 15 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166976.328707:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc98f5200/0x2f180c4effbaa0c0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 15 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.328714:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc98f5200/0x2f180c4effbaa0c0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 15 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:1.0:1762166976.328753:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 244188 00000004:00200000:1.0:1762166976.328757:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166976.328774:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc98f5200/0x2f180c4effbaa0c0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 15 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.328783:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc98f5200/0x2f180c4effbaa0c0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.328789:0:6494:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eae00/0x2f180c4effbaa0b2 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.328793:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eae00/0x2f180c4effbaa0b2 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.328797:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eae00/0x2f180c4effbaa0b2 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.328800:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eae00/0x2f180c4effbaa0b2 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.328804:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc56eae00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166976.328806:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eae00/0x2f180c4effbaa0b2 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.328811:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eae00/0x2f180c4effbaa0b2 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.328825:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0x0 (ffff945bc812e400) 00010000:00010000:1.0:1762166976.328827:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166976.328830:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eae00/0x2f180c4effbaa0b2 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.328834:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eae00/0x2f180c4effbaa0b2 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.328843:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cd1af1200/0x2f180c4effbaa0b9 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.328846:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cd1af1200/0x2f180c4effbaa0b9 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.328850:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cd1af1200/0x2f180c4effbaa0b9 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.328852:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cd1af1200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166976.328854:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cd1af1200/0x2f180c4effbaa0b9 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.328857:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cd1af1200/0x2f180c4effbaa0b9 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.328860:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0xdd396665 (ffff945bc812e000) 00010000:00010000:1.0:1762166976.328861:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166976.328863:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cd1af1200/0x2f180c4effbaa0b9 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.328865:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cd1af1200/0x2f180c4effbaa0b9 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.328886:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb800/0x2f180c4effbaa0ab lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e98c9 expref: 577 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.328917:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc98f5200/0x2f180c4effbaa0c0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e98c9 expref: 576 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.328922:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.328924:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166976.328926:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc98f5200, rc 0) 00000100:00100000:1.0:1762166976.328972:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6cd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+576:61840:x1847765450370816:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 506us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166976.328977:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30294 00000100:00100000:2.0:1762166976.330518:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166976.330554:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450370944 00000100:00100000:0.0:1762166976.330561:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450370944 00000100:00100000:0.0:1762166976.330608:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 862 00000100:00100000:0.0:1762166976.330619:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6cd3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+576:2419:x1847765450370944:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166976.330629:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166976.330641:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc98f5200/0x2f180c4effbaa0c0 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 16 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e98c9 expref: 576 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.330652:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166976.330654:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166976.330683:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6cd3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+575:2419:x1847765450370944:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 68us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166976.330704:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 862 00000100:00100000:2.0:1762166976.331434:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.331507:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450371200 00000100:00100000:1.0:1762166976.331514:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450371200 00000100:00100000:1.0:1762166976.331552:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30295 00000100:00100000:1.0:1762166976.331561:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6cd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+575:61840:x1847765450371200:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166976.331574:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166976.331586:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cada00/0x2f180c4effbaa0c7 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 15 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e98d0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.331659:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac200/0x2f180c4effbaa0ce lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166976.331673:0:6494:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb000/0x2f180c4effbaa0a4 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 16 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e98c2 expref: 576 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.331681:0:6494:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac200/0x2f180c4effbaa0ce lrc: 4/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 16 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.331721:0:6494:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb000/0x2f180c4effbaa0a4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 16 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e98c2 expref: 576 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.331738:0:6494:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb000/0x2f180c4effbaa0a4 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 16 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e98c2 expref: 576 pid: 6494 timeout: 695 lvb_type: 0 00000100:00100000:1.0:1762166976.331750:0:6494:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bccb7df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765449694592:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166976.331835:0:6494:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cca870e40 going to sleep for 11 seconds 00000100:00100000:1.0:1762166976.332676:0:6494:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bccb7df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765449694592:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166976.332704:0:6494:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac200/0x2f180c4effbaa0ce lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 16 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000100:00100000:2.0:1762166976.332860:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166976.332918:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450371328 00000100:00100000:0.0:1762166976.332925:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450371328 00010000:00010000:0.0:1762166976.332948:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb000/0x2f180c4effbaa0a4 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 16 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e98c2 expref: 577 pid: 6494 timeout: 695 lvb_type: 0 00000100:00100000:0.0:1762166976.332985:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9497 00000100:00100000:0.0:1762166976.332995:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6cd1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+577:2418:x1847765450371328:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166976.333004:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166976.333011:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb000/0x2f180c4effbaa0a4 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 17 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e98c2 expref: 577 pid: 6494 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166976.333022:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb000/0x2f180c4effbaa0a4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 17 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e98c2 expref: 577 pid: 6494 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166976.333043:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb000/0x2f180c4effbaa0a4 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 17 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e98c2 expref: 577 pid: 6494 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166976.333056:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166976.333060:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac200/0x2f180c4effbaa0ce lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 16 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166976.333068:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac200/0x2f180c4effbaa0ce lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 16 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166976.333075:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac200/0x2f180c4effbaa0ce lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 16 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166976.333100:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166976.333126:0:6494:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac200/0x2f180c4effbaa0ce lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.333136:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac200/0x2f180c4effbaa0ce lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000100:00100000:0.0:1762166976.333148:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6cd1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+576:2418:x1847765450371328:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 150us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166976.333163:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9497 00000004:00200000:1.0:1762166976.333170:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 244188 00010000:00010000:1.0:1762166976.333336:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cada00/0x2f180c4effbaa0c7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 15 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e98d0 expref: 577 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.333356:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac200/0x2f180c4effbaa0ce lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e98d0 expref: 576 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.333367:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.333371:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1762166976.333374:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cac200, rc 0) 00000100:00100000:1.0:1762166976.333431:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6cd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+576:61840:x1847765450371200:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1870us (2005us total) trans 4294991885 rc 0/0 00000100:00100000:1.0:1762166976.333447:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30295 00000100:00100000:2.0:1762166976.334799:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.334840:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450371456 00000100:00100000:1.0:1762166976.334848:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450371456 00000100:00100000:1.0:1762166976.334887:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30296 00000100:00100000:1.0:1762166976.334895:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6cd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+576:61840:x1847765450371456:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166976.334945:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166976.334964:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cd1af1200/0x2f180c4effbaa0dc lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 15 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e98d7 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.335052:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb800/0x2f180c4effbaa0e3 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166976.335067:0:6494:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac200/0x2f180c4effbaa0ce lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 16 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e98d0 expref: 577 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.335076:0:6494:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb800/0x2f180c4effbaa0e3 lrc: 4/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 16 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.335105:0:6494:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac200/0x2f180c4effbaa0ce lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 16 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e98d0 expref: 577 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.335114:0:6494:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac200/0x2f180c4effbaa0ce lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 16 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e98d0 expref: 577 pid: 6494 timeout: 695 lvb_type: 0 00000100:00100000:1.0:1762166976.335125:0:6494:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bccb7df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765449694720:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166976.335185:0:6494:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cca870000 going to sleep for 11 seconds 00000100:00100000:1.0:1762166976.335925:0:6494:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bccb7df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765449694720:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166976.335938:0:6494:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb800/0x2f180c4effbaa0e3 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 16 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000100:00100000:2.0:1762166976.336108:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166976.336205:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450371584 00000100:00100000:0.0:1762166976.336211:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450371584 00010000:00010000:0.0:1762166976.336235:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac200/0x2f180c4effbaa0ce lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 16 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e98d0 expref: 578 pid: 6494 timeout: 695 lvb_type: 0 00000100:00100000:0.0:1762166976.336273:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9498 00000100:00100000:0.0:1762166976.336281:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+578:2419:x1847765450371584:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166976.336292:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166976.336299:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac200/0x2f180c4effbaa0ce lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 17 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e98d0 expref: 578 pid: 6494 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166976.336315:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac200/0x2f180c4effbaa0ce lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 17 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e98d0 expref: 578 pid: 6494 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166976.336331:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac200/0x2f180c4effbaa0ce lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 17 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e98d0 expref: 578 pid: 6494 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166976.336344:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166976.336348:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb800/0x2f180c4effbaa0e3 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 16 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166976.336356:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb800/0x2f180c4effbaa0e3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 16 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166976.336362:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb800/0x2f180c4effbaa0e3 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 16 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166976.336389:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166976.336424:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+577:2419:x1847765450371584:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 144us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166976.336432:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9498 00010000:00010000:1.0:1762166976.336448:0:6494:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb800/0x2f180c4effbaa0e3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.336457:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb800/0x2f180c4effbaa0e3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:1.0:1762166976.336516:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 244188 00000004:00200000:1.0:1762166976.336521:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166976.336553:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb800/0x2f180c4effbaa0e3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.336584:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cd1af1200/0x2f180c4effbaa0dc lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e98d7 expref: 577 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.336600:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb800/0x2f180c4effbaa0e3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e98d7 expref: 576 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.336609:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.336612:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166976.336615:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc56eb800, rc 0) 00000100:00100000:1.0:1762166976.336648:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6cd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+576:61840:x1847765450371456:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1753us (1855us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166976.336660:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30296 00000100:00100000:2.0:1762166976.338114:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.338168:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450371840 00000100:00100000:1.0:1762166976.338177:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450371840 00000100:00100000:1.0:1762166976.338232:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11807 00000100:00100000:1.0:1762166976.338242:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+576:61840:x1847765450371840:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:1.0:1762166976.338451:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+577:61840:x1847765450371840:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 210us (343us total) trans 4294991886 rc 0/0 00000100:00100000:1.0:1762166976.338460:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11807 00010000:00010000:0.0:1762166976.338593:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1762166976.339456:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166976.339580:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450372096 00000100:00100000:2.0:1762166976.339588:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450372096 00000100:00100000:2.0:1762166976.339636:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30297 00000100:00100000:2.0:1762166976.339644:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+577:61840:x1847765450372096:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166976.339666:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166976.339668:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1762166976.339690:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4b200/0x2f180c4effbaa018 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9891 expref: 577 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.339705:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166976.339709:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166976.339720:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbaa0ea lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e98de expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.339817:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbaa0f1 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 15 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166976.339833:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbaa0f1 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 15 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166976.339841:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbaa0f1 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 15 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:2.0:1762166976.339853:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 244188 00010000:00010000:2.0:1762166976.339966:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbaa0ea lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 15 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e98de expref: 579 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.339982:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbaa0f1 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e98de expref: 578 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.339995:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166976.339998:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166976.340001:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa9c00, rc 0) 00000100:00100000:2.0:1762166976.340053:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+578:61840:x1847765450372096:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 410us (600us total) trans 4294991887 rc 0/0 00000100:00100000:2.0:1762166976.340061:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30297 00000100:00100000:3.0:1762166976.341292:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166976.341322:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.341351:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450372224 00000100:00100000:3.0:1762166976.341353:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.341360:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450372224 00000100:00100000:2.0:1762166976.341400:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450372352 00000100:00100000:2.0:1762166976.341414:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450372352 00000100:00100000:0.0:1762166976.341435:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450372480 00000100:00100000:0.0:1762166976.341445:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450372480 00000100:00100000:1.0:1762166976.341454:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18793 00000100:00100000:3.0:1762166976.341471:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18794 00000100:00100000:1.0:1762166976.341473:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6224000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+28:2419:x1847765450372224:12345-192.168.204.38@tcp:1:lfs.0 00000100:00100000:2.0:1762166976.341523:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18795 00000100:00100000:3.0:1762166976.341529:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6225c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+27:2418:x1847765450372352:12345-192.168.204.38@tcp:1:lfs.0 00000100:00100000:2.0:1762166976.341545:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6225880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+28:2418:x1847765450372480:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:3.0:1762166976.341580:0:28874:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc8472a00/0x2f180c4effbaa106 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.341580:0:9168:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc56eae00/0x2f180c4effbaa0ff lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.341583:0:8383:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbaa10d lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.341641:0:9168:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8800/0x2f180c4effba9e97 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 237568->253951) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e980c expref: 28 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.341644:0:8383:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effba9dd3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e97b8 expref: 28 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.341646:0:28874:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8200/0x2f180c4effba9dcc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e97b1 expref: 27 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.341699:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166976.341699:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166976.341705:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166976.341706:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166976.341708:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166976.341715:0:8383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbaa10d lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.341716:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166976.341718:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc56eae00/0x2f180c4effbaa0ff lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.341726:0:28874:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8472a00/0x2f180c4effbaa106 lrc: 4/0,1 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.341815:0:8383:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effba9dd3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e97b8 expref: 28 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.341816:0:28874:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8200/0x2f180c4effba9dcc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e97b1 expref: 27 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.341816:0:9168:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8800/0x2f180c4effba9e97 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 237568->253951) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e980c expref: 28 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.341874:0:28874:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8200/0x2f180c4effba9dcc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e97b1 expref: 27 pid: 9168 timeout: 695 lvb_type: 0 00010000:00010000:1.0:1762166976.341876:0:9168:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8800/0x2f180c4effba9e97 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 237568->253951) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e980c expref: 28 pid: 9168 timeout: 695 lvb_type: 0 00010000:00010000:2.0:1762166976.341879:0:8383:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effba9dd3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e97b8 expref: 28 pid: 9168 timeout: 695 lvb_type: 0 00000100:00100000:3.0:1762166976.341943:0:28874:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc6224700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28874:1847765449694848:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166976.341951:0:9168:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bccb7df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9168:1847765449695104:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166976.341973:0:8383:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc48aaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8383:1847765449694976:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166976.342054:0:9168:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cca870e40 going to sleep for 11 seconds 00000100:00100000:2.0:1762166976.342057:0:8383:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf3a33540 going to sleep for 11 seconds 00000100:00100000:3.0:1762166976.342058:0:28874:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cee171900 going to sleep for 11 seconds 00000100:00100000:1.0:1762166976.342992:0:9168:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bccb7df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9168:1847765449695104:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166976.343013:0:9168:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc56eae00/0x2f180c4effbaa0ff lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166976.343109:0:28874:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc6224700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28874:1847765449694848:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166976.343121:0:8383:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc48aaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8383:1847765449694976:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166976.343139:0:28874:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bc8472a00/0x2f180c4effbaa106 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.343150:0:8383:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbaa10d lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166976.343262:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166976.343331:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450372608 00000100:00100000:0.0:1762166976.343338:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450372608 00010000:00010000:0.0:1762166976.343364:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effba9dd3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e97b8 expref: 29 pid: 9168 timeout: 695 lvb_type: 0 00000100:00100000:0.0:1762166976.343399:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9499 00000100:00100000:0.0:1762166976.343412:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6224e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+29:2416:x1847765450372608:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166976.343425:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1762166976.343439:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:0.0:1762166976.343449:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effba9dd3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e97b8 expref: 29 pid: 9168 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166976.343465:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effba9dd3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e97b8 expref: 29 pid: 9168 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166976.343513:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effba9dd3 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e97b8 expref: 29 pid: 9168 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166976.343528:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166976.343530:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166976.343536:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbaa10d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166976.343546:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:0.0:1762166976.343558:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbaa10d lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166976.343584:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450372736 00010000:00010000:0.0:1762166976.343588:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166976.343589:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450372736 00010000:00010000:2.0:1762166976.343609:0:8383:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbaa10d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.343611:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8200/0x2f180c4effba9dcc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e97b1 expref: 28 pid: 9168 timeout: 695 lvb_type: 0 00000100:00100000:0.0:1762166976.343642:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6224e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+28:2416:x1847765450372608:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 226us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166976.343657:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450372864 00010000:00010000:2.0:1762166976.343662:0:8383:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbaa10d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166976.343670:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9499 00000100:00100000:3.0:1762166976.343672:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450372864 00000100:00100000:1.0:1762166976.343685:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9500 00000100:00100000:1.0:1762166976.343698:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf9d1d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+28:2418:x1847765450372736:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166976.343707:0:8383:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbaa10d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.343709:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00100000:3.0:1762166976.343722:0:14623:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xa77:0x0] (98304->244187) req@ffff945bc48aaa00 x1847765450372864/t0(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:7/0 lens 504/0 e 0 to 0 dl 1762166987 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00010000:00010000:2.0:1762166976.343726:0:8383:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbaa10d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.343735:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8200/0x2f180c4effba9dcc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e97b1 expref: 28 pid: 9168 timeout: 695 lvb_type: 0 00002000:00100000:3.0:1762166976.343746:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc48aaa00 with x1847765450372864 ext(98304->244187) 00010000:00010000:3.0:1762166976.343769:0:14623:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8800/0x2f180c4effba9e97 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 237568->253951) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e980c expref: 28 pid: 9168 timeout: 695 lvb_type: 0 00010000:00010000:1.0:1762166976.343783:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8200/0x2f180c4effba9dcc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e97b1 expref: 28 pid: 9168 timeout: 695 lvb_type: 0 00010000:00010000:2.0:1762166976.343788:0:8383:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbaa10d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.343820:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8200/0x2f180c4effba9dcc lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e97b1 expref: 28 pid: 9168 timeout: 695 lvb_type: 0 00010000:00010000:2.0:1762166976.343828:0:8383:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa8600 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166976.343831:0:14623:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8800/0x2f180c4effba9e97 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 237568->253951) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e980c expref: 28 pid: 9168 timeout: 695 lvb_type: 0 00010000:00010000:2.0:1762166976.343839:0:8383:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbaa10d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.343858:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166976.343865:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166976.343876:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc8472a00/0x2f180c4effbaa106 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166976.343877:0:14623:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff945bc48aaa00 00010000:00010000:2.0:1762166976.343884:0:8383:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbaa10d lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.343910:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8472a00/0x2f180c4effbaa106 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166976.343929:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 27 00010000:00010000:2.0:1762166976.343934:0:8383:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbaa10d lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166976.343945:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+28:2418:x1847765450372864:12345-192.168.204.38@tcp:4:fsx.0 00010000:00010000:1.0:1762166976.343948:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166976.343951:0:8383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbaa10d lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.343959:0:28874:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bc8472a00/0x2f180c4effbaa106 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.343974:0:28874:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc8472a00/0x2f180c4effbaa106 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166976.343977:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf9d1d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+27:2418:x1847765450372736:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 281us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166976.343994:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9500 00010000:00010000:0.0:1762166976.344003:0:28874:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc8472a00/0x2f180c4effbaa106 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.344014:0:28874:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8472a00/0x2f180c4effbaa106 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.344024:0:28874:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc8472a00/0x2f180c4effbaa106 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.344031:0:28874:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8472a00 already unused, calling callback (ffffffffc0cd9320) 00000100:00100000:2.0:1762166976.344034:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6225880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+28:2418:x1847765450372480:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 2493us (2677us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166976.344040:0:28874:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc8472a00/0x2f180c4effbaa106 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166976.344050:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18795 00010000:00010000:0.0:1762166976.344059:0:28874:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc8472a00/0x2f180c4effbaa106 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.344079:0:28874:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc8472a00/0x2f180c4effbaa106 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.344087:0:28874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc8472a00/0x2f180c4effbaa106 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166976.344146:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6225c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+26:2418:x1847765450372352:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 2628us (2823us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166976.344154:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18794 00000100:00100000:0.0:1762166976.345665:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+29:2418:x1847765450372864:12345-192.168.204.38@tcp:4:fsx.0 Request processed in 1724us (2123us total) trans 17179876241 rc 0/0 00000100:00100000:0.0:1762166976.345675:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 27 00002000:00100000:0.0:1762166976.345685:0:14623:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xa77:0x0] (98304->244187) req@ffff945bc48aaa00 x1847765450372864/t17179876241(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:7/0 lens 504/448 e 0 to 0 dl 1762166987 ref 1 fl Complete:H/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166976.345695:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc48aaa00 with x1847765450372864 ext(98304->244187) 00010000:00010000:0.0:1762166976.345702:0:14623:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8800/0x2f180c4effba9e97 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 237568->253951) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e980c expref: 29 pid: 9168 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166976.345717:0:14623:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8800/0x2f180c4effba9e97 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 237568->253951) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e980c expref: 29 pid: 9168 timeout: 695 lvb_type: 0 00002000:00010000:0.0:1762166976.345724:0:14623:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff945bc48aaa00 00000100:00100000:1.0:1762166976.346772:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166976.346827:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450372992 00000100:00100000:2.0:1762166976.346836:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450372992 00010000:00010000:2.0:1762166976.346866:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8800/0x2f180c4effba9e97 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 237568->253951) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e980c expref: 29 pid: 9168 timeout: 695 lvb_type: 0 00000100:00100000:2.0:1762166976.346912:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9501 00000100:00100000:2.0:1762166976.346923:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+29:2419:x1847765450372992:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166976.346938:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1762166976.346953:0:6481:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 141673 -> 244188 00002000:00010000:2.0:1762166976.346956:0:6481:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 48 -> 192 00010000:00010000:2.0:1762166976.346962:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8800/0x2f180c4effba9e97 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 237568->253951) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e980c expref: 29 pid: 9168 timeout: 695 lvb_type: 0 00010000:00010000:2.0:1762166976.346982:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8800/0x2f180c4effba9e97 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 237568->253951) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e980c expref: 29 pid: 9168 timeout: 695 lvb_type: 0 00010000:00010000:2.0:1762166976.347005:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8800/0x2f180c4effba9e97 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 237568->253951) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e980c expref: 29 pid: 9168 timeout: 695 lvb_type: 0 00010000:00010000:2.0:1762166976.347020:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166976.347022:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166976.347026:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc56eae00/0x2f180c4effbaa0ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.347036:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc56eae00/0x2f180c4effbaa0ff lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.347067:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166976.347091:0:9168:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc56eae00/0x2f180c4effbaa0ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.347100:0:9168:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc56eae00/0x2f180c4effbaa0ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166976.347112:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+28:2419:x1847765450372992:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 187us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166976.347122:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9501 00010000:00010000:1.0:1762166976.347131:0:9168:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc56eae00/0x2f180c4effbaa0ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.347151:0:9168:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc56eae00/0x2f180c4effbaa0ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.347160:0:9168:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc56eae00/0x2f180c4effbaa0ff lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.347168:0:9168:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc56eae00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166976.347173:0:9168:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc56eae00/0x2f180c4effbaa0ff lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.347181:0:9168:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc56eae00/0x2f180c4effbaa0ff lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.347195:0:9168:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc56eae00/0x2f180c4effbaa0ff lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.347209:0:9168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc56eae00/0x2f180c4effbaa0ff lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166976.347271:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6224000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+27:2419:x1847765450372224:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 5809us (5985us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166976.347277:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18793 00000100:00100000:1.0:1762166976.348241:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166976.348280:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450373248 00000100:00100000:2.0:1762166976.348286:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450373248 00000100:00100000:2.0:1762166976.348323:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30298 00000100:00100000:2.0:1762166976.348331:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5807b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+578:61840:x1847765450373248:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:2.0:1762166976.348369:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1762166976.348387:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb800/0x2f180c4effbaa0e3 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e98d7 expref: 578 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.348413:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eaa00/0x2f180c4effba9fe7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 14 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9883 expref: 577 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.348424:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166976.348429:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166976.348459:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbaa114 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166976.348474:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbaa114 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166976.348511:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbaa114 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000040:00080000:2.0:1762166976.348836:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5863, 88 off458840 00000004:00080000:2.0:1762166976.348845:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 595497366350ns, next at 595897461133ns, rc = 0 00000040:00080000:2.0:1762166976.348984:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5862, 88 off458840 00000004:00080000:2.0:1762166976.348991:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 595497512880ns, next at 595897495953ns, rc = 0 00000040:00080000:2.0:1762166976.349019:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5863, 88 off458928 00000004:00080000:2.0:1762166976.349025:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 595497547000ns, next at 595897495953ns, rc = 0 00000040:00080000:2.0:1762166976.349046:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5864, 88 off458928 00000004:00080000:2.0:1762166976.349050:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 595497572723ns, next at 595897461133ns, rc = 0 00000040:00080000:2.0:1762166976.349073:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5864, 88 off459016 00000004:00080000:2.0:1762166976.349078:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 595497600045ns, next at 595897495953ns, rc = 0 00000040:00080000:2.0:1762166976.349098:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5865, 88 off459016 00000004:00080000:2.0:1762166976.349104:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 595497626231ns, next at 595897461133ns, rc = 0 00000040:00080000:2.0:1762166976.349125:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5865, 88 off459104 00000004:00080000:2.0:1762166976.349131:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 595497652988ns, next at 595897495953ns, rc = 0 00000040:00080000:2.0:1762166976.349151:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5866, 88 off459104 00000004:00080000:2.0:1762166976.349156:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 595497677875ns, next at 595897461133ns, rc = 0 00000001:00080000:3.0:1762166976.350344:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294991888 is committed 00000004:00080000:3.0:1762166976.350352:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3230 committed 00010000:00010000:2.0:1762166976.350364:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eef800/0x2f180c4effba9eba lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00000004:00080000:3.0:1762166976.350365:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3233 committed 00010000:00010000:2.0:1762166976.350374:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eef800/0x2f180c4effba9eba lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00000004:00080000:3.0:1762166976.350376:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3229 committed 00010000:00010000:2.0:1762166976.350378:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eef800/0x2f180c4effba9eba lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00000004:00080000:3.0:1762166976.350381:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3232 committed 00010000:00010000:2.0:1762166976.350385:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc6eef800 already unused, calling callback (ffffffffc18e2310) 00000004:00080000:3.0:1762166976.350387:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3228 committed 00010000:00010000:2.0:1762166976.350389:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eef800/0x2f180c4effba9eba lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00000004:00080000:3.0:1762166976.350391:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3231 committed 00010000:00010000:2.0:1762166976.350396:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eef800/0x2f180c4effba9eba lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00000004:00080000:3.0:1762166976.350398:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3230 committed 00000004:00080000:3.0:1762166976.350406:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3227 committed 00010000:00010000:2.0:1762166976.350410:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166976.350413:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166976.350416:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eef800/0x2f180c4effba9eba lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166976.350420:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eef800/0x2f180c4effba9eba lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166976.350434:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effba9ed6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166976.350438:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effba9ed6 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166976.350443:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effba9ed6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166976.350452:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cb4200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166976.350454:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effba9ed6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166976.350458:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effba9ed6 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00000020:00080000:3.0:1762166976.350460:0:7412:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff945cee0836c0 refcount 2 committed 0 result 0 batchid 44 00010000:00010000:2.0:1762166976.350464:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166976.350468:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000020:00080000:3.0:1762166976.350469:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945bc418aa00 obd lustre-OST0001-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff945cee083d80 00010000:00010000:2.0:1762166976.350470:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effba9ed6 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166976.350493:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effba9ed6 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166976.350503:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effba9eeb lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166976.350507:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effba9eeb lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00000020:00080000:3.0:1762166976.350511:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945bc418ac00 obd lustre-OST0000-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff945cee083000 00010000:00010000:2.0:1762166976.350512:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effba9eeb lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00000020:00080000:3.0:1762166976.350521:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945bc418ab00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff945bc719e200 00010000:00010000:2.0:1762166976.350521:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa8000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166976.350525:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effba9eeb lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00000020:00080000:3.0:1762166976.350528:0:7412:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000400:0x2:0x0].42 00010000:00010000:2.0:1762166976.350531:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effba9eeb lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00000100:00100000:1.0:1762166976.350535:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449695360:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1762166976.350539:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166976.350543:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166976.350545:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effba9eeb lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166976.350549:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effba9eeb lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00000100:00100000:0.0:1762166976.350555:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449695488:0@lo:2:osp-syn-0-1.0 00010000:00010000:2.0:1762166976.350560:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14000/0x2f180c4effba9f00 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166976.350565:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14000/0x2f180c4effba9f00 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166976.350569:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14000/0x2f180c4effba9f00 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166976.350573:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945d00f14000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166976.350575:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14000/0x2f180c4effba9f00 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166976.350579:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14000/0x2f180c4effba9f00 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166976.350585:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166976.350587:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000020:00080000:3.0:1762166976.350589:0:7412:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0001: 43 batchid updated 00010000:00010000:2.0:1762166976.350591:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14000/0x2f180c4effba9f00 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00000100:00100000:1.0:1762166976.350592:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1762166976.350599:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14000/0x2f180c4effba9f00 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166976.350610:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc98f4800/0x2f180c4effba9f15 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166976.350613:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc98f4800/0x2f180c4effba9f15 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00000100:00100000:0.0:1762166976.350618:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166976.350622:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5805880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449695232:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1762166976.350622:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc6cd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449695872:0@lo:2:osp-syn-1-1.0 00010000:00010000:2.0:1762166976.350624:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc98f4800/0x2f180c4effba9f15 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166976.350634:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc98f4800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166976.350637:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc98f4800/0x2f180c4effba9f15 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166976.350641:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc98f4800/0x2f180c4effba9f15 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166976.350646:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166976.350648:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166976.350650:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc98f4800/0x2f180c4effba9f15 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00000100:00100000:0.0:1762166976.350653:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4493b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449696000:0@lo:2:osp-syn-1-1.0 00010000:00010000:2.0:1762166976.350656:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc98f4800/0x2f180c4effba9f15 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00000100:00100000:1.0:1762166976.350661:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1762166976.350673:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4ac00/0x2f180c4effba9f2a lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00000100:00100000:3.0:1762166976.350678:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc6cd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449695616:0@lo:2:osp-syn-1-1.0 00010000:00010000:2.0:1762166976.350678:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4ac00/0x2f180c4effba9f2a lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166976.350689:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4ac00/0x2f180c4effba9f2a lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00000100:00100000:1.0:1762166976.350692:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449696384:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1762166976.350697:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1762166976.350700:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc3d4ac00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166976.350704:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4ac00/0x2f180c4effba9f2a lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166976.350708:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4ac00/0x2f180c4effba9f2a lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166976.350716:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166976.350718:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166976.350720:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4ac00/0x2f180c4effba9f2a lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166976.350724:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4ac00/0x2f180c4effba9f2a lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00000100:00100000:3.0:1762166976.350728:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1762166976.350740:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc606ee00/0x2f180c4effbaa06c lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00000100:00100000:1.0:1762166976.350741:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449695360 00000100:00100000:1.0:1762166976.350747:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449695360 00010000:00010000:2.0:1762166976.350749:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc606ee00/0x2f180c4effbaa06c lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00000100:00100000:0.0:1762166976.350752:0:35248:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449695488 00000100:00100000:0.0:1762166976.350758:0:35248:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449695488 00010000:00010000:2.0:1762166976.350760:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc606ee00/0x2f180c4effbaa06c lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00000100:00100000:3.0:1762166976.350766:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4492a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449696128:0@lo:2:osp-syn-1-1.0 00010000:00010000:2.0:1762166976.350770:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc606ee00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166976.350775:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc606ee00/0x2f180c4effbaa06c lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166976.350781:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc606ee00/0x2f180c4effbaa06c lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00000100:00100000:1.0:1762166976.350782:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449695872 00000100:00100000:1.0:1762166976.350788:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449695872 00000100:00100000:0.0:1762166976.350789:0:35248:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449696000 00010000:00010000:2.0:1762166976.350793:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00000100:00100000:0.0:1762166976.350794:0:35248:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449696000 00000100:00100000:3.0:1762166976.350800:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1762166976.350801:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166976.350806:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc606ee00/0x2f180c4effbaa06c lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166976.350811:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc606ee00/0x2f180c4effbaa06c lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166976.350822:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc606e800/0x2f180c4effbaa081 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166976.350827:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc606e800/0x2f180c4effbaa081 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00000100:00100000:1.0:1762166976.350829:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449695616 00010000:00010000:2.0:1762166976.350832:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc606e800/0x2f180c4effbaa081 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00000100:00100000:1.0:1762166976.350835:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449695616 00000100:00100000:0.0:1762166976.350835:0:35248:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449696128 00010000:00010000:2.0:1762166976.350839:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc606e800 already unused, calling callback (ffffffffc18e2310) 00000100:00100000:0.0:1762166976.350841:0:35248:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449696128 00000020:00080000:3.0:1762166976.350842:0:7435:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 44 committed batchid 43 00010000:00010000:2.0:1762166976.350842:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc606e800/0x2f180c4effbaa081 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166976.350850:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc606e800/0x2f180c4effbaa081 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166976.350857:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166976.350858:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166976.350860:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc606e800/0x2f180c4effbaa081 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00000100:00100000:1.0:1762166976.350865:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18796 00010000:00010000:2.0:1762166976.350866:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc606e800/0x2f180c4effbaa081 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00000100:00100000:0.0:1762166976.350874:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18797 00010000:00010000:2.0:1762166976.350878:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4a14000/0x2f180c4effbaa096 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00000100:00100000:1.0:1762166976.350879:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+14:3634:x1847765449695360:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1762166976.350887:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+14:3635:x1847765449695488:12345-0@lo:2:osp-syn-0-1.0 00010000:00010000:2.0:1762166976.350891:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4a14000/0x2f180c4effbaa096 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166976.350908:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4a14000/0x2f180c4effbaa096 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166976.350918:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4a14000 already unused, calling callback (ffffffffc18e2310) 00002000:00080000:1.0:1762166976.350920:0:8383:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:2691 count 1 00010000:00010000:2.0:1762166976.350922:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4a14000/0x2f180c4effbaa096 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166976.350935:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4a14000/0x2f180c4effbaa096 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.350940:0:8383:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bca743200/0x2f180c4effbaa11b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa83:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.350944:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00000020:00080000:3.0:1762166976.350951:0:7435:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 43 cancel update log [0x240000400:0x2:0x0].41: rc = 0 00010000:00010000:2.0:1762166976.350955:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166976.350960:0:8383:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4b99c00/0x2f180c4effba8abd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa83:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e90b8 expref: 25 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.350961:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4a14000/0x2f180c4effbaa096 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00000020:00080000:3.0:1762166976.350963:0:7435:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 43 00010000:00010000:1.0:1762166976.350977:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166976.350980:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4a14000/0x2f180c4effbaa096 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.350980:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00000100:00100000:3.0:1762166976.350985:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18798 00010000:00010000:1.0:1762166976.350985:0:8383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bca743200/0x2f180c4effbaa11b lrc: 4/0,1 mode: --/PW res: [0x280000400:0xa83:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166976.350998:0:35248:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:3.0:1762166976.351001:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+8:3634:x1847765449695872:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:0.0:1762166976.351002:0:35248:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb mtime from disk: 1762166966 -> 1762166966 00002000:00010000:0.0:1762166976.351006:0:35248:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1762166976.351010:0:35248:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb ctime from disk: 1762166966 -> 1762166966 00010000:00010000:1.0:1762166976.351013:0:8383:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc4b99c00/0x2f180c4effba8abd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa83:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e90b8 expref: 25 pid: 28874 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166976.351013:0:35248:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1762166976.351020:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18799 00010000:00010000:1.0:1762166976.351031:0:8383:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc4b99c00/0x2f180c4effba8abd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa83:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e90b8 expref: 25 pid: 28874 timeout: 695 lvb_type: 0 00000100:00100000:2.0:1762166976.351036:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+8:3635:x1847765449696000:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1762166976.351046:0:8383:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bb9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8383:1847765449696512:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166976.351048:0:35248:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+15:3635:x1847765449695488:12345-0@lo:2:osp-syn-0-1.0 Request processed in 166us (433us total) trans 21474843197 rc 0/0 00000100:00100000:0.0:1762166976.351055:0:35248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18797 00000100:00100000:0.0:1762166976.351070:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18800 00000100:00100000:0.0:1762166976.351077:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6224e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+9:3636:x1847765449695616:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1762166976.351100:0:8383:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cca870000 going to sleep for 11 seconds 00000100:00100000:3.0:1762166976.351109:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+10:3634:x1847765449695872:12345-0@lo:2:osp-syn-1-1.0 Request processed in 111us (450us total) trans 17179876242 rc 0/0 00002000:00010000:2.0:1762166976.351111:0:8380:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166976.351117:0:8380:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb mtime from disk: 1762166975 -> 1762166975 00000100:00100000:1.0:1762166976.351120:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18801 00002000:00010000:2.0:1762166976.351121:0:8380:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb atime from disk: 1762166973 -> 1762166973 00002000:00010000:2.0:1762166976.351124:0:8380:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb ctime from disk: 1762166975 -> 1762166975 00002000:00010000:2.0:1762166976.351126:0:8380:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1762166976.351133:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6224700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+11:3636:x1847765449696128:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166976.351134:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18798 00000100:00100000:0.0:1762166976.351154:0:35248:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6224e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+10:3636:x1847765449695616:12345-0@lo:2:osp-syn-1-1.0 Request processed in 78us (429us total) trans 17179876244 rc 0/0 00000100:00100000:0.0:1762166976.351159:0:35248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18800 00000100:00100000:2.0:1762166976.351163:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+10:3635:x1847765449696000:12345-0@lo:2:osp-syn-1-1.0 Request processed in 132us (470us total) trans 17179876243 rc 0/0 00000100:00100000:2.0:1762166976.351173:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18799 00002000:00010000:1.0:1762166976.351192:0:28434:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166976.351196:0:28434:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb mtime from disk: 1762166975 -> 1762166975 00002000:00010000:1.0:1762166976.351197:0:28434:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00002000:00010000:1.0:1762166976.351199:0:28434:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.351201:0:28434:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1762166976.351210:0:3636:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 17179876217 gen 2 00000004:00080000:0.0:1762166976.351214:0:3636:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 17179876217 committed transno 17179876217 00000004:00010000:2.0:1762166976.351225:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000ae1ffd20 reply state 000000007d14dc7b transno 4294991888 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbaa114 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000100:00100000:1.0:1762166976.351229:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6224700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+9:3636:x1847765449696128:12345-0@lo:2:osp-syn-1-1.0 Request processed in 102us (432us total) trans 17179876245 rc 0/0 00000100:00100000:0.0:1762166976.351235:0:3636:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff945bc6cd3480 x1847765449695616/t17179876244(17179876244) o2->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 440/432 e 0 to 0 dl 1762166992 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1762166976.351244:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18801 00010000:00010000:2.0:1762166976.351248:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbaa114 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166976.351259:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00000004:00080000:0.0:1762166976.351259:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc6cd3480/2, rc 0, transno 17179876244 00010000:00010000:2.0:1762166976.351265:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:0.0:1762166976.351268:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc6cd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449695616:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1762166976.351269:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166976.351270:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000004:00080000:0.0:1762166976.351287:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc4492a00/2, rc 0, transno 17179876245 00000100:00100000:1.0:1762166976.351293:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449695744:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1762166976.351295:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4492a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449696128:0@lo:2:osp-syn-1-1.0 00010000:00080000:2.0:1762166976.351322:0:6494:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1762166976.351328:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166976.351337:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5807b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+526:61840:x1847765450373248:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 3007us (3102us total) trans 4294991888 rc 0/0 00000100:00100000:2.0:1762166976.351345:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30298 00000100:00100000:1.0:1762166976.351349:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449695232 00000100:00100000:1.0:1762166976.351354:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449695232 00000004:00080000:3.0:1762166976.351355:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf1cd3100/2, rc 0, transno 21474843197 00000100:00100000:3.0:1762166976.351364:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449695488:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1762166976.351366:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449696384 00000004:00080000:0.0:1762166976.351369:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc6cd1500/2, rc 0, transno 17179876242 00000100:00100000:2.0:1762166976.351371:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449696384 00000100:00100000:0.0:1762166976.351375:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc6cd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449695872:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1762166976.351387:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc4493b80/2, rc 0, transno 17179876243 00000100:00100000:1.0:1762166976.351391:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18802 00000100:00100000:3.0:1762166976.351396:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4493b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449696000:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1762166976.351405:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18803 00000100:00100000:1.0:1762166976.351405:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+9:3633:x1847765449695232:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1762166976.351418:0:28434:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:2690 count 1 00000100:00100000:2.0:1762166976.351420:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+15:3634:x1847765449696384:12345-0@lo:2:osp-syn-0-1.0 00010000:00010000:1.0:1762166976.351428:0:28434:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bca743600/0x2f180c4effbaa122 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.351438:0:28434:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde800/0x2f180c4effba9af4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e96a7 expref: 26 pid: 8382 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166976.351443:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166976.351444:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166976.351446:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbaa114 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.351447:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bca743600/0x2f180c4effbaa122 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.351460:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbaa114 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166976.351469:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbaa114 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166976.351474:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa8e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166976.351503:0:28434:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde800/0x2f180c4effba9af4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e96a7 expref: 26 pid: 8382 timeout: 0 lvb_type: 1 00002000:00010000:2.0:1762166976.351508:0:8380:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb size from disk: 250794 -> 250794 00002000:00010000:2.0:1762166976.351515:0:8380:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb mtime from disk: 1762166975 -> 1762166975 00002000:00010000:2.0:1762166976.351519:0:8380:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00010000:00010000:1.0:1762166976.351521:0:28434:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde800/0x2f180c4effba9af4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e96a7 expref: 26 pid: 8382 timeout: 695 lvb_type: 1 00002000:00010000:2.0:1762166976.351522:0:8380:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00010000:00010000:0.0:1762166976.351523:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbaa114 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00002000:00010000:2.0:1762166976.351528:0:8380:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb blocks from disk: 152 -> 152 00010000:00010000:0.0:1762166976.351542:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbaa114 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00000100:00100000:1.0:1762166976.351548:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bbb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765449696640:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166976.351556:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00000100:00100000:2.0:1762166976.351560:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+16:3634:x1847765449696384:12345-0@lo:2:osp-syn-0-1.0 Request processed in 144us (231us total) trans 21474843198 rc 0/0 00010000:00010000:0.0:1762166976.351562:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:2.0:1762166976.351568:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18803 00010000:00010000:0.0:1762166976.351569:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbaa114 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166976.351578:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbaa114 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00000100:00100000:3.0:1762166976.351587:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166976.351588:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc37313c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166976.351610:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449695744 00000100:00100000:2.0:1762166976.351613:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449695744 00000100:00100000:3.0:1762166976.351623:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449696256:0@lo:2:osp-syn-0-1.0 00000004:00080000:0.0:1762166976.351624:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf1cd0a80/2, rc 0, transno 21474843198 00000100:00100000:0.0:1762166976.351634:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449696384:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1762166976.351635:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18804 00000100:00100000:2.0:1762166976.351645:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+16:3633:x1847765449695744:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166976.351660:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166976.351687:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449696256 00000100:00100000:0.0:1762166976.351692:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449696256 00000100:00100000:2.0:1762166976.351714:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+18:3633:x1847765449695744:12345-0@lo:2:osp-syn-0-1.0 Request processed in 72us (134us total) trans 21474843199 rc 0/0 00000100:00100000:2.0:1762166976.351719:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18804 00000100:00100000:0.0:1762166976.351729:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18805 00000100:00100000:0.0:1762166976.351739:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+17:3633:x1847765449696256:12345-0@lo:2:osp-syn-0-1.0 00000004:00080000:2.0:1762166976.351761:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf1cd3480/2, rc 0, transno 21474843199 00000100:00100000:2.0:1762166976.351766:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449695744:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1762166976.351823:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+18:3633:x1847765449696256:12345-0@lo:2:osp-syn-0-1.0 Request processed in 86us (164us total) trans 21474843200 rc 0/0 00000100:00100000:0.0:1762166976.351831:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18805 00000004:00080000:2.0:1762166976.351848:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf1cd1180/2, rc 0, transno 21474843200 00000100:00100000:2.0:1762166976.351854:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449696256:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1762166976.352008:0:8383:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bb9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8383:1847765449696512:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166976.352019:0:8383:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bca743200/0x2f180c4effbaa11b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa83:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166976.352287:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bbb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765449696640:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166976.352289:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:1.0:1762166976.352304:0:28434:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bca743600/0x2f180c4effbaa122 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166976.352331:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450373376 00000100:00100000:2.0:1762166976.352336:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450373376 00010000:00010000:2.0:1762166976.352355:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4b99c00/0x2f180c4effba8abd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa83:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e90b8 expref: 26 pid: 28874 timeout: 695 lvb_type: 0 00000100:00100000:2.0:1762166976.352384:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9502 00000100:00100000:2.0:1762166976.352393:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765450373376:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166976.352402:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166976.352408:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc4b99c00/0x2f180c4effba8abd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa83:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e90b8 expref: 26 pid: 28874 timeout: 695 lvb_type: 0 00010000:00010000:2.0:1762166976.352421:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc4b99c00/0x2f180c4effba8abd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa83:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e90b8 expref: 26 pid: 28874 timeout: 695 lvb_type: 0 00010000:00010000:2.0:1762166976.352441:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4b99c00/0x2f180c4effba8abd lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa83:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e90b8 expref: 26 pid: 28874 timeout: 695 lvb_type: 0 00000100:00100000:1.0:1762166976.352447:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:2.0:1762166976.352458:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166976.352461:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166976.352464:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bca743200/0x2f180c4effbaa11b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa83:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.352473:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bca743200/0x2f180c4effbaa11b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa83:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166976.352509:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450373632 00000100:00100000:0.0:1762166976.352514:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450373632 00010000:00010000:2.0:1762166976.352526:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166976.352529:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde800/0x2f180c4effba9af4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e96a7 expref: 27 pid: 8382 timeout: 695 lvb_type: 1 00010000:00010000:3.0:1762166976.352542:0:8383:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bca743200/0x2f180c4effbaa11b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166976.352554:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9503 00010000:00010000:3.0:1762166976.352555:0:8383:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bca743200/0x2f180c4effbaa11b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166976.352560:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166976.352562:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+25:2419:x1847765450373376:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 167us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166976.352568:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bbb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+27:2419:x1847765450373632:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166976.352579:0:8383:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bca743200/0x2f180c4effbaa11b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166976.352584:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9502 00010000:00010000:0.0:1762166976.352584:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166976.352593:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde800/0x2f180c4effba9af4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e96a7 expref: 27 pid: 8382 timeout: 695 lvb_type: 1 00010000:00010000:0.0:1762166976.352608:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde800/0x2f180c4effba9af4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e96a7 expref: 27 pid: 8382 timeout: 695 lvb_type: 1 00010000:00010000:0.0:1762166976.352625:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde800/0x2f180c4effba9af4 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e96a7 expref: 27 pid: 8382 timeout: 695 lvb_type: 1 00010000:00010000:3.0:1762166976.352626:0:8383:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bca743200/0x2f180c4effbaa11b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166976.352644:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450373504 00010000:00010000:0.0:1762166976.352648:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1762166976.352650:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450373504 00010000:00010000:0.0:1762166976.352652:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166976.352657:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bca743600/0x2f180c4effbaa122 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.352667:0:7421:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bca743600/0x2f180c4effbaa122 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.352672:0:6483:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166976.352682:0:6483:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bca743200/0x2f180c4effbaa11b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.352691:0:8383:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00000100:00100000:1.0:1762166976.352693:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30299 00010000:00010000:2.0:1762166976.352694:0:6483:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bca743200 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166976.352698:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166976.352701:0:6483:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bca743200/0x2f180c4effbaa11b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166976.352707:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+525:61840:x1847765450373504:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166976.352718:0:6483:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bca743200/0x2f180c4effbaa11b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.352727:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166976.352732:0:6483:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bca743200/0x2f180c4effbaa11b lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.352742:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847e000/0x2f180c4effbaa129 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e98e5 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.352744:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bca743200/0x2f180c4effbaa11b lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166976.352744:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bbb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765450373632:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 176us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166976.352764:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9503 00010000:00010000:2.0:1762166976.352776:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166976.352780:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166976.352783:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166976.352789:0:28434:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bca743600/0x2f180c4effbaa122 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.352798:0:28434:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bca743600/0x2f180c4effbaa122 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.352807:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847e000/0x2f180c4effbaa129 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e98e5 expref: 526 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.352810:0:28434:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bca743600/0x2f180c4effbaa122 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.352825:0:28434:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bca743600/0x2f180c4effbaa122 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.352831:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847e000/0x2f180c4effbaa129 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e98e5 expref: 526 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.352843:0:28434:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762166976.352848:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.352852:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166976.352856:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc847e000, rc 0) 00010000:00010000:2.0:1762166976.352861:0:10256:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1762166976.352862:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+18:3634:x1847765449695360:12345-0@lo:6:osp-syn-0-1.0 Request processed in 1986us (2271us total) trans 21474843201 rc 0/0 00010000:00010000:2.0:1762166976.352870:0:10256:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bca743600/0x2f180c4effbaa122 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166976.352874:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18796 00000100:00100000:1.0:1762166976.352883:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+526:61840:x1847765450373504:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 178us (329us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166976.352885:0:10256:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bca743600 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166976.352891:0:10256:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bca743600/0x2f180c4effbaa122 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166976.352915:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30299 00010000:00010000:2.0:1762166976.352948:0:10256:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bca743600/0x2f180c4effbaa122 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.352960:0:10256:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bca743600/0x2f180c4effbaa122 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.352967:0:10256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bca743600/0x2f180c4effbaa122 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.352984:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166976.352986:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166976.352988:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166976.353328:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+10:3633:x1847765449695232:12345-0@lo:6:osp-syn-1-1.0 Request processed in 1928us (2059us total) trans 17179876246 rc 0/0 00000100:00100000:0.0:1762166976.353336:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18802 00000004:00080000:2.0:1762166976.353357:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc5805880/2, rc 0, transno 17179876246 00000100:00100000:2.0:1762166976.353365:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5805880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449695232:0@lo:6:osp-syn-1-1.0 00000004:00080000:0.0:1762166976.353375:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf1cd3800/2, rc 0, transno 21474843201 00000100:00100000:0.0:1762166976.353383:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449695360:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1762166976.354860:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.354911:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450373760 00000100:00100000:1.0:1762166976.354917:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450373760 00000100:00100000:1.0:1762166976.354954:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30300 00000100:00100000:1.0:1762166976.354964:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+526:61840:x1847765450373760:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166976.354977:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166976.354990:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847f600/0x2f180c4effbaa130 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e98ec expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.355063:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945ceda5f600/0x2f180c4effbaa137 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166976.355074:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945ceda5f600/0x2f180c4effbaa137 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.355083:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945ceda5f600/0x2f180c4effbaa137 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:1.0:1762166976.355108:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 244188 00000004:00200000:1.0:1762166976.355113:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166976.355129:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945ceda5f600/0x2f180c4effbaa137 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.355150:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847f600/0x2f180c4effbaa130 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e98ec expref: 528 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.355164:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945ceda5f600/0x2f180c4effbaa137 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e98ec expref: 527 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.355171:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.355175:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166976.355178:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945ceda5f600, rc 0) 00000100:00100000:1.0:1762166976.355217:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+527:61840:x1847765450373760:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 255us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166976.355224:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30300 00000100:00100000:0.0:1762166976.356448:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.356510:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450374016 00000100:00100000:0.0:1762166976.356511:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.356517:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450374016 00000100:00100000:0.0:1762166976.356556:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166976.356558:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450373888 00000100:00100000:2.0:1762166976.356562:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450373888 00000100:00100000:1.0:1762166976.356566:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18806 00000100:00100000:1.0:1762166976.356579:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+25:2419:x1847765450374016:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166976.356590:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1762166976.356597:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450374144 00000100:00100000:2.0:1762166976.356601:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450374144 00000100:00100000:0.0:1762166976.356603:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18807 00010000:00010000:1.0:1762166976.356606:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bcc8fb800/0x2f180c4effbaa13e lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e98fa expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166976.356619:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+27:2418:x1847765450373888:12345-192.168.204.38@tcp:101:lfs.0 00002000:00010000:1.0:1762166976.356628:0:28434:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa7a:0x0] initial LVB size: 0, mtime: 0x690888c0, atime: 0x690888bf, ctime: 0x690888c0, blocks: 0x1800 00010000:00010000:0.0:1762166976.356631:0:9168:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1762166976.356635:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18808 00010000:00010000:1.0:1762166976.356647:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166976.356647:0:9168:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbaa145 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e98f3 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166976.356649:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+27:2418:x1847765450374144:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166976.356652:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166976.356665:0:35247:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166976.356665:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bcc8fb800/0x2f180c4effbaa13e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e98fa expref: 26 pid: 28434 timeout: 0 lvb_type: 1 00002000:00010000:0.0:1762166976.356672:0:9168:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa77:0x0] initial LVB size: 244188, mtime: 0x690888c0, atime: 0x690888c0, ctime: 0x690888c0, blocks: 0xc0 00010000:00010000:3.0:1762166976.356680:0:35247:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8472800/0x2f180c4effbaa14c lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9901 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.356685:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bcc8fb800/0x2f180c4effbaa13e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e98fa expref: 26 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166976.356688:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166976.356692:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166976.356699:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbaa145 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e98f3 expref: 28 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166976.356704:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcc8fb800, rc 0) 00010000:00010000:0.0:1762166976.356712:0:9168:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbaa145 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e98f3 expref: 28 pid: 9168 timeout: 0 lvb_type: 1 00002000:00010000:3.0:1762166976.356715:0:35247:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa79:0x0] initial LVB size: 0, mtime: 0x690888c0, atime: 0x690888bf, ctime: 0x690888c0, blocks: 0x0 00010000:00010000:0.0:1762166976.356730:0:9168:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdee00, rc 0) 00010000:00010000:3.0:1762166976.356732:0:35247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166976.356735:0:35247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166976.356742:0:35247:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472800/0x2f180c4effbaa14c lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9901 expref: 29 pid: 35247 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166976.356759:0:35247:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc8472800/0x2f180c4effbaa14c lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9901 expref: 29 pid: 35247 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1762166976.356761:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765450374016:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 180us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166976.356762:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+29:2418:x1847765450373888:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 143us (248us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166976.356782:0:35247:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8472800, rc 0) 00000100:00100000:1.0:1762166976.356782:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18806 00000100:00100000:0.0:1762166976.356792:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18807 00000100:00100000:3.0:1762166976.356814:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+28:2418:x1847765450374144:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 168us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166976.356822:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18808 00000100:00100000:2.0:1762166976.391601:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166976.391660:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450374272 00000100:00100000:3.0:1762166976.391670:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450374272 00000100:00100000:3.0:1762166976.391735:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18809 00000100:00100000:3.0:1762166976.391747:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+28:2419:x1847765450374272:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:3.0:1762166976.391863:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+28:2419:x1847765450374272:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 118us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166976.391873:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18809 00000100:00100000:2.0:1762166976.393069:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166976.393134:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450374400 00000100:00100000:3.0:1762166976.393139:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450374400 00000100:00100000:3.0:1762166976.393167:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18810 00000100:00100000:3.0:1762166976.393175:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+28:2419:x1847765450374400:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:3.0:1762166976.393237:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+28:2419:x1847765450374400:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 59us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166976.393244:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18810 00000100:00100000:0.0:1762166976.394714:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166976.394757:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450374528 00000100:00100000:3.0:1762166976.394763:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450374528 00000100:00100000:3.0:1762166976.394798:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2066 00000100:00100000:3.0:1762166976.394804:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+28:2419:x1847765450374528:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:3.0:1762166976.394828:0:14623:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effbaa153 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.394839:0:14623:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166976.394841:0:14623:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166976.394845:0:14623:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effbaa153 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.394855:0:14623:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effbaa153 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.394951:0:14623:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effbaa153 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.394957:0:14623:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effbaa153 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.394962:0:14623:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effbaa153 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.394966:0:14623:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8473c00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166976.394969:0:14623:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effbaa153 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.394974:0:14623:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effbaa153 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.394985:0:14623:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effbaa153 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.394990:0:14623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effbaa153 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166976.395023:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+28:2419:x1847765450374528:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 219us (311us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1762166976.395029:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2066 00000100:00100000:2.0:1762166976.396497:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166976.396517:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450374656 00000100:00100000:3.0:1762166976.396605:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450374656 00000100:00100000:3.0:1762166976.396644:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2067 00000100:00100000:3.0:1762166976.396652:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765450374656:12345-192.168.204.38@tcp:4:lfs.0 00002000:00010000:3.0:1762166976.396687:0:14623:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa86:0x0] initial LVB size: 262144, mtime: 0x690888bf, atime: 0x690888bd, ctime: 0x690888bf, blocks: 0xd0 00010000:00010000:3.0:1762166976.396691:0:14623:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc8473000/0x2f180c4effbaa15a lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.396697:0:14623:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166976.396699:0:14623:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166976.396701:0:14623:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8473000/0x2f180c4effbaa15a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.396708:0:14623:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc8473000/0x2f180c4effbaa15a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1762166976.397889:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843202 is committed 00000001:00080000:1.0:1762166976.397908:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843201 is committed 00002000:00010000:3.0:1762166976.397983:0:14623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb mtime from disk: 1762166975 -> 1762166976 00002000:00010000:3.0:1762166976.397988:0:14623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb ctime from disk: 1762166975 -> 1762166976 00010000:00010000:3.0:1762166976.397995:0:14623:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc8473000/0x2f180c4effbaa15a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.398002:0:14623:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8473000/0x2f180c4effbaa15a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.398008:0:14623:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc8473000/0x2f180c4effbaa15a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.398014:0:14623:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8473000 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166976.398018:0:14623:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc8473000/0x2f180c4effbaa15a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.398024:0:14623:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc8473000/0x2f180c4effbaa15a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.398036:0:14623:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc8473000/0x2f180c4effbaa15a lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.398042:0:14623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc8473000/0x2f180c4effbaa15a lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166976.398096:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+15:2419:x1847765450374656:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 1444us (1623us total) trans 21474843202 rc 0/0 00000100:00100000:3.0:1762166976.398104:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2067 00000100:00100000:2.0:1762166976.399527:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166976.399556:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450374784 00000100:00100000:3.0:1762166976.399562:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450374784 00000100:00100000:3.0:1762166976.399603:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2068 00000100:00100000:3.0:1762166976.399611:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+15:2419:x1847765450374784:12345-192.168.204.38@tcp:4:lfs.0 00010000:00010000:3.0:1762166976.399637:0:14623:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effbaa161 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.399650:0:14623:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4b63000/0x2f180c4effba9e82 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e97f7 expref: 15 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166976.399658:0:14623:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166976.399659:0:14623:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166976.399662:0:14623:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effbaa161 lrc: 4/0,1 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.399691:0:14623:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc4b63000/0x2f180c4effba9e82 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e97f7 expref: 15 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166976.399704:0:14623:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc4b63000/0x2f180c4effba9e82 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e97f7 expref: 15 pid: 9168 timeout: 695 lvb_type: 1 00000100:00100000:3.0:1762166976.399724:0:14623:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5f100 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0000_UUID:14623:1847765449696768:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166976.399800:0:14623:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cee171a80 going to sleep for 11 seconds 00000100:00100000:3.0:1762166976.400716:0:14623:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5f100 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0000_UUID:14623:1847765449696768:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166976.400734:0:14623:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effbaa161 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166976.401046:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166976.401091:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450374912 00000100:00100000:0.0:1762166976.401097:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450374912 00010000:00010000:0.0:1762166976.401120:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4b63000/0x2f180c4effba9e82 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e97f7 expref: 16 pid: 9168 timeout: 695 lvb_type: 1 00000100:00100000:0.0:1762166976.401153:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9504 00000100:00100000:0.0:1762166976.401163:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+16:2419:x1847765450374912:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166976.401174:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166976.401192:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc4b63000/0x2f180c4effba9e82 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e97f7 expref: 16 pid: 9168 timeout: 695 lvb_type: 1 00010000:00010000:0.0:1762166976.401205:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc4b63000/0x2f180c4effba9e82 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e97f7 expref: 16 pid: 9168 timeout: 695 lvb_type: 1 00010000:00010000:0.0:1762166976.401223:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4b63000/0x2f180c4effba9e82 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e97f7 expref: 16 pid: 9168 timeout: 695 lvb_type: 1 00010000:00010000:0.0:1762166976.401236:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166976.401238:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166976.401242:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effbaa161 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.401251:0:7421:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effbaa161 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.401277:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166976.401298:0:14623:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effbaa161 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.401308:0:14623:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effbaa161 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166976.401309:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+15:2419:x1847765450374912:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 148us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166976.401325:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9504 00000001:00080000:1.0:1762166976.402500:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843203 is committed 00002000:00010000:3.0:1762166976.402601:0:14623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb mtime from disk: 1762166975 -> 1762166976 00010000:00010000:3.0:1762166976.402610:0:14623:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effbaa161 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.402620:0:14623:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effbaa161 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.402629:0:14623:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effbaa161 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.402639:0:14623:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8473600 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166976.402643:0:14623:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effbaa161 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.402651:0:14623:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effbaa161 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.402664:0:14623:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effbaa161 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.402670:0:14623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effbaa161 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166976.402717:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+14:2419:x1847765450374784:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 3107us (3193us total) trans 21474843203 rc 0/0 00000100:00100000:3.0:1762166976.402726:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2068 00000100:00100000:2.0:1762166976.404501:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166976.404540:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450375040 00000100:00100000:3.0:1762166976.404547:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450375040 00000100:00100000:3.0:1762166976.404583:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18811 00000100:00100000:3.0:1762166976.404590:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+28:2418:x1847765450375040:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:3.0:1762166976.404657:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+28:2418:x1847765450375040:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 68us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166976.404662:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18811 00000100:00100000:0.0:1762166976.405684:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166976.405721:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450375168 00000100:00100000:3.0:1762166976.405726:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450375168 00000100:00100000:3.0:1762166976.405751:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18812 00000100:00100000:3.0:1762166976.405756:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1dded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+28:2419:x1847765450375168:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:3.0:1762166976.405803:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1dded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+28:2419:x1847765450375168:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 47us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166976.405807:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18812 00000100:00100000:2.0:1762166976.406916:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.406964:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450375424 00000100:00100000:1.0:1762166976.406969:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450375424 00000100:00100000:1.0:1762166976.407000:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30301 00000100:00100000:1.0:1762166976.407008:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+527:61840:x1847765450375424:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:1.0:1762166976.407050:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166976.407070:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945ceda5f600/0x2f180c4effbaa137 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e98ec expref: 527 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.407084:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.407088:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166976.407243:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fb600/0x2f180c4effbaa168 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166976.407253:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fb600/0x2f180c4effbaa168 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.407260:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fb600/0x2f180c4effbaa168 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000001:00080000:1.0:1762166976.407291:0:6494:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294991889 00000004:00010000:1.0:1762166976.407314:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000b99fcb59 reply state 00000000d734d38f transno 4294991890 ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fb600/0x2f180c4effbaa168 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.407326:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fb600/0x2f180c4effbaa168 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.407332:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.407334:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166976.407337:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166976.407405:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+529:61840:x1847765450375424:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 396us (488us total) trans 4294991890 rc 0/0 00000100:00100000:1.0:1762166976.407413:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30301 00000020:00080000:1.0:1762166976.407418:0:6494:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1762166976.408296:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166976.408336:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450375552 00000100:00100000:3.0:1762166976.408342:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450375552 00000100:00100000:3.0:1762166976.408380:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18813 00000100:00100000:3.0:1762166976.408388:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+14:61840:x1847765450375552:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166976.408400:0:35247:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166976.408413:0:35247:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc8473000/0x2f180c4effbaa16f lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9908 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166976.408433:0:35247:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa86:0x0] initial LVB size: 262144, mtime: 0x690888c0, atime: 0x690888bd, ctime: 0x690888c0, blocks: 0xd0 00010000:00010000:3.0:1762166976.408449:0:35247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166976.408453:0:35247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166976.408459:0:35247:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8473000/0x2f180c4effbaa16f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9908 expref: 15 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.408473:0:35247:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc8473000/0x2f180c4effbaa16f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9908 expref: 15 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.408503:0:35247:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8473000, rc 0) 00000100:00100000:3.0:1762166976.408541:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+15:61840:x1847765450375552:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 153us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166976.408549:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18813 00000100:00100000:0.0:1762166976.409388:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166976.409471:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450375680 00000100:00100000:3.0:1762166976.409498:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450375680 00002000:00010000:3.0:1762166976.409516:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2694 (4096->18446744073709551615) 00002000:00100000:3.0:1762166976.409519:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1ddd880 with x1847765450375680 ext(4096->18446744073709551615) 00002000:00010000:3.0:1762166976.409526:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945cf1ddd880. 00000100:00100000:2.0:1762166976.409532:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166976.409547:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450375808 00000100:00100000:3.0:1762166976.409552:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450375808 00000100:00100000:0.0:1762166976.409561:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2069 00000100:00100000:0.0:1762166976.409572:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+15:2418:x1847765450375680:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:3.0:1762166976.409605:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2693 (0->18446744073709551615) 00002000:00100000:3.0:1762166976.409610:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc48a9c00 with x1847765450375808 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166976.409616:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc48a9c00. 00000100:00100000:3.0:1762166976.409640:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2070 00000100:00100000:3.0:1762166976.409648:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+28:2418:x1847765450375808:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:3.0:1762166976.409771:0:14623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166976.409774:0:14623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb mtime from disk: 1762166975 -> 1762166976 00002000:00010000:3.0:1762166976.409777:0:14623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb atime from disk: 1762166973 -> 1762166973 00002000:00010000:3.0:1762166976.409779:0:14623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb ctime from disk: 1762166975 -> 1762166976 00002000:00010000:3.0:1762166976.409782:0:14623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166976.409821:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+29:2418:x1847765450375808:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 173us (289us total) trans 17179876247 rc 0/0 00000100:00100000:3.0:1762166976.409829:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2070 00002000:00010000:3.0:1762166976.409832:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2693 (0->18446744073709551615) 00002000:00100000:3.0:1762166976.409836:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc48a9c00 with x1847765450375808 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166976.409841:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc48a9c00. 00002000:00010000:0.0:1762166976.410033:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb size from disk: 262144 -> 4096 00002000:00010000:0.0:1762166976.410037:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:0.0:1762166976.410039:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb atime from disk: 1762166973 -> 1762166973 00002000:00010000:0.0:1762166976.410042:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:0.0:1762166976.410044:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb blocks from disk: 208 -> 16 00000100:00100000:0.0:1762166976.410079:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+16:2418:x1847765450375680:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 509us (691us total) trans 21474843204 rc 0/0 00000100:00100000:0.0:1762166976.410085:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2069 00002000:00010000:0.0:1762166976.410088:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2694 (4096->18446744073709551615) 00002000:00100000:0.0:1762166976.410090:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1ddd880 with x1847765450375680 ext(4096->18446744073709551615) 00002000:00010000:0.0:1762166976.410094:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945cf1ddd880. 00000100:00100000:2.0:1762166976.411139:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.411200:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450375936 00000100:00100000:1.0:1762166976.411208:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450375936 00000100:00100000:1.0:1762166976.411247:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30302 00000100:00100000:1.0:1762166976.411255:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+529:61840:x1847765450375936:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166976.411272:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166976.411286:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fba00/0x2f180c4effbaa176 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e990f expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.411378:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa400/0x2f180c4effbaa17d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166976.411390:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa400/0x2f180c4effbaa17d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.411401:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa400/0x2f180c4effbaa17d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:1.0:1762166976.411427:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 4096 00000004:00200000:1.0:1762166976.411432:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166976.411447:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa400/0x2f180c4effbaa17d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.411470:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fba00/0x2f180c4effbaa176 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e990f expref: 531 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.411511:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa400/0x2f180c4effbaa17d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e990f expref: 530 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.411526:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.411529:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166976.411533:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcc8fa400, rc 0) 00000100:00100000:1.0:1762166976.411570:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+530:61840:x1847765450375936:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 316us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166976.411577:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30302 00000100:00100000:3.0:1762166976.413347:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.413427:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450376192 00000100:00100000:1.0:1762166976.413436:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450376192 00000100:00100000:1.0:1762166976.413530:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30303 00000100:00100000:1.0:1762166976.413543:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+530:61840:x1847765450376192:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:1.0:1762166976.413589:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166976.413611:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa400/0x2f180c4effbaa17d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e990f expref: 530 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.413626:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.413630:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166976.413780:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa000/0x2f180c4effbaa184 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166976.413792:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa000/0x2f180c4effbaa184 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.413801:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa000/0x2f180c4effbaa184 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000001:00080000:1.0:1762166976.413844:0:6494:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294991891 00000004:00010000:1.0:1762166976.413867:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000473b9317 reply state 00000000cb5325b6 transno 4294991892 ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa000/0x2f180c4effbaa184 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.413883:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa000/0x2f180c4effbaa184 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.413890:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.413893:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166976.413895:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166976.413998:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+532:61840:x1847765450376192:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 459us (662us total) trans 4294991892 rc 0/0 00000100:00100000:1.0:1762166976.414003:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30303 00000020:00080000:1.0:1762166976.414006:0:6494:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1762166976.415101:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166976.415158:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450376320 00000100:00100000:3.0:1762166976.415169:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450376320 00000100:00100000:3.0:1762166976.415227:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18814 00000100:00100000:3.0:1762166976.415237:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+16:61840:x1847765450376320:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166976.415257:0:35247:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166976.415279:0:35247:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effbaa18b lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9916 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166976.415306:0:35247:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa88:0x0] initial LVB size: 250794, mtime: 0x690888c0, atime: 0x690888bf, ctime: 0x690888c0, blocks: 0x98 00010000:00010000:3.0:1762166976.415328:0:35247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166976.415331:0:35247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166976.415340:0:35247:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effbaa18b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9916 expref: 17 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.415355:0:35247:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effbaa18b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9916 expref: 17 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.415368:0:35247:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8473600, rc 0) 00000100:00100000:3.0:1762166976.415437:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+17:61840:x1847765450376320:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 200us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166976.415446:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18814 00000100:00100000:2.0:1762166976.416420:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166976.416460:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450376448 00000100:00100000:3.0:1762166976.416467:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450376448 00000100:00100000:3.0:1762166976.416544:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18815 00000100:00100000:3.0:1762166976.416556:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+29:61840:x1847765450376448:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166976.416573:0:35247:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166976.416587:0:35247:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effbaa192 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa87:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e991d expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.416612:0:35247:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62600/0x2f180c4effba9d39 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9795 expref: 30 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.416618:0:35247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166976.416620:0:35247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166976.416622:0:35247:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effbaa192 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xa87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e991d expref: 30 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.416647:0:35247:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62600/0x2f180c4effba9d39 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9795 expref: 30 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.416659:0:35247:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62600/0x2f180c4effba9d39 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9795 expref: 30 pid: 9168 timeout: 695 lvb_type: 0 00000100:00100000:3.0:1762166976.416672:0:35247:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:35247:1847765449696896:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166976.416751:0:35247:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cee171a80 going to sleep for 11 seconds 00000100:00100000:3.0:1762166976.417761:0:35247:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:35247:1847765449696896:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166976.417782:0:35247:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effbaa192 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xa87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e991d expref: 30 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.417796:0:35247:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8473c00, rc 0) 00000100:00100000:3.0:1762166976.417833:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+30:61840:x1847765450376448:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1281us (1415us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166976.417841:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18815 00000100:00100000:1.0:1762166976.417921:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166976.417987:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450376576 00000100:00100000:0.0:1762166976.417993:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450376576 00010000:00010000:0.0:1762166976.418018:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62600/0x2f180c4effba9d39 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9795 expref: 30 pid: 9168 timeout: 695 lvb_type: 0 00000100:00100000:0.0:1762166976.418047:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9505 00000100:00100000:0.0:1762166976.418055:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+30:2419:x1847765450376576:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166976.418065:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166976.418082:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62600/0x2f180c4effba9d39 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa87:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9795 expref: 30 pid: 9168 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166976.418094:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62600/0x2f180c4effba9d39 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa87:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9795 expref: 30 pid: 9168 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166976.418111:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62600/0x2f180c4effba9d39 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa87:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9795 expref: 30 pid: 9168 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166976.418123:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166976.418126:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166976.418131:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effbaa192 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e991d expref: 29 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.418141:0:7421:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effbaa192 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e991d expref: 29 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.418165:0:7421:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effbaa192 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e991d expref: 29 pid: 35247 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166976.418175:0:7421:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1ddd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7421:1847765449697024:192.168.204.38@tcp:105: 00000100:00100000:0.0:1762166976.418219:0:7421:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cce457b40 going to sleep for 11 seconds 00000100:00100000:0.0:1762166976.419038:0:7421:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1ddd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7421:1847765449697024:192.168.204.38@tcp:105: 00010000:00010000:0.0:1762166976.419051:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166976.419086:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+29:2419:x1847765450376576:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1031us (1164us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166976.419095:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9505 00000100:00100000:3.0:1762166976.419249:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166976.419279:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166976.419301:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450376704 00000100:00100000:0.0:1762166976.419307:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450376704 00000100:00100000:1.0:1762166976.419326:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450376832 00000100:00100000:1.0:1762166976.419332:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450376832 00002000:00010000:0.0:1762166976.419343:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2696 (4096->18446744073709551615) 00002000:00010000:1.0:1762166976.419348:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2695 (0->18446744073709551615) 00002000:00100000:0.0:1762166976.419354:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc2d5ce00 with x1847765450376704 ext(4096->18446744073709551615) 00002000:00100000:1.0:1762166976.419355:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc2d5d880 with x1847765450376832 ext(0->18446744073709551615) 00002000:00010000:1.0:1762166976.419366:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc2d5d880. 00002000:00010000:0.0:1762166976.419366:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc2d5ce00. 00000100:00100000:1.0:1762166976.419394:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2071 00000100:00100000:1.0:1762166976.419404:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+29:2418:x1847765450376832:12345-192.168.204.38@tcp:10:lfs.0 00000100:00100000:0.0:1762166976.419406:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2072 00000100:00100000:0.0:1762166976.419419:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450376704:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:1.0:1762166976.419545:0:14623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166976.419549:0:14623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb mtime from disk: 1762166975 -> 1762166976 00002000:00010000:1.0:1762166976.419552:0:14623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00002000:00010000:1.0:1762166976.419555:0:14623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.419557:0:14623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1762166976.419592:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+30:2418:x1847765450376832:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 189us (312us total) trans 17179876248 rc 0/0 00000100:00100000:1.0:1762166976.419601:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2071 00002000:00010000:1.0:1762166976.419605:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2695 (0->18446744073709551615) 00002000:00100000:1.0:1762166976.419608:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc2d5d880 with x1847765450376832 ext(0->18446744073709551615) 00002000:00010000:1.0:1762166976.419613:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc2d5d880. 00002000:00010000:0.0:1762166976.419786:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb size from disk: 250794 -> 4096 00002000:00010000:0.0:1762166976.419790:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:0.0:1762166976.419793:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00002000:00010000:0.0:1762166976.419794:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:0.0:1762166976.419796:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb blocks from disk: 152 -> 8 00000100:00100000:0.0:1762166976.419822:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450376704:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 407us (574us total) trans 21474843205 rc 0/0 00000100:00100000:0.0:1762166976.419827:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2072 00002000:00010000:0.0:1762166976.419829:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2696 (4096->18446744073709551615) 00002000:00100000:0.0:1762166976.419831:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc2d5ce00 with x1847765450376704 ext(4096->18446744073709551615) 00002000:00010000:0.0:1762166976.419834:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc2d5ce00. 00000100:00100000:3.0:1762166976.420868:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.420933:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450376960 00000100:00100000:1.0:1762166976.420942:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450376960 00000100:00100000:1.0:1762166976.420987:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30304 00000100:00100000:1.0:1762166976.420994:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+532:61840:x1847765450376960:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166976.421016:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166976.421034:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fac00/0x2f180c4effbaa199 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9924 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.421138:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa200/0x2f180c4effbaa1a0 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166976.421154:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa200/0x2f180c4effbaa1a0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.421167:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa200/0x2f180c4effbaa1a0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:1.0:1762166976.421197:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 4096 00000004:00200000:1.0:1762166976.421201:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166976.421220:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa200/0x2f180c4effbaa1a0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.421248:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fac00/0x2f180c4effbaa199 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9924 expref: 534 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.421266:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa200/0x2f180c4effbaa1a0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9924 expref: 533 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.421281:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.421284:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166976.421288:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcc8fa200, rc 0) 00000100:00100000:1.0:1762166976.421343:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+533:61840:x1847765450376960:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 349us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166976.421351:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30304 00000100:00100000:2.0:1762166976.423280:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166976.423335:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450377088 00000100:00100000:0.0:1762166976.423344:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450377088 00000100:00100000:0.0:1762166976.423410:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2073 00000100:00100000:0.0:1762166976.423426:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+30:2418:x1847765450377088:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:0.0:1762166976.423524:0:8388:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbaa1a7 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.423539:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166976.423542:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166976.423547:0:8388:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbaa1a7 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [28672->36863] (req 28672->36863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.423561:0:8388:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbaa1a7 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [28672->36863] (req 28672->36863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.423655:0:8388:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbaa1a7 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [28672->36863] (req 28672->36863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.423665:0:8388:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbaa1a7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [28672->36863] (req 28672->36863) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.423674:0:8388:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbaa1a7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [28672->36863] (req 28672->36863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.423681:0:8388:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdf000 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166976.423685:0:8388:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbaa1a7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [28672->36863] (req 28672->36863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.423693:0:8388:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbaa1a7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [28672->36863] (req 28672->36863) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.423708:0:8388:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbaa1a7 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [28672->36863] (req 28672->36863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.423716:0:8388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbaa1a7 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [28672->36863] (req 28672->36863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166976.423769:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+30:2418:x1847765450377088:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 347us (496us total) trans 0 rc 8192/8192 00000100:00100000:0.0:1762166976.423776:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2073 00000100:00100000:2.0:1762166976.426747:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166976.426805:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450377216 00000100:00100000:0.0:1762166976.426814:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450377216 00000100:00100000:0.0:1762166976.426873:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2074 00000100:00100000:0.0:1762166976.426882:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450377216:12345-192.168.204.38@tcp:4:lfs.0 00010000:00010000:0.0:1762166976.426928:0:8388:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfc00/0x2f180c4effbaa1ae lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.426944:0:8388:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc8473000/0x2f180c4effbaa16f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9908 expref: 18 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.426951:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166976.426953:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166976.426955:0:8388:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfc00/0x2f180c4effbaa1ae lrc: 4/0,1 mode: --/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [28672->36863] (req 28672->36863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.426986:0:8388:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc8473000/0x2f180c4effbaa16f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9908 expref: 18 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.426996:0:8388:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc8473000/0x2f180c4effbaa16f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9908 expref: 18 pid: 35247 timeout: 695 lvb_type: 0 00000100:00100000:0.0:1762166976.427008:0:8388:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1ddd180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0000_UUID:8388:1847765449697152:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166976.427091:0:8388:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cce457b40 going to sleep for 11 seconds 00000100:00100000:0.0:1762166976.427811:0:8388:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1ddd180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0000_UUID:8388:1847765449697152:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166976.427826:0:8388:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfc00/0x2f180c4effbaa1ae lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [28672->36863] (req 28672->36863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166976.428158:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166976.428233:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450377344 00000100:00100000:0.0:1762166976.428239:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450377344 00010000:00010000:0.0:1762166976.428263:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8473000/0x2f180c4effbaa16f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9908 expref: 19 pid: 35247 timeout: 695 lvb_type: 0 00000100:00100000:0.0:1762166976.428301:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9506 00000100:00100000:0.0:1762166976.428308:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4533480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450377344:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166976.428317:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166976.428337:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc8473000/0x2f180c4effbaa16f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9908 expref: 19 pid: 35247 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166976.428346:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc8473000/0x2f180c4effbaa16f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9908 expref: 19 pid: 35247 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166976.428364:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc8473000/0x2f180c4effbaa16f lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9908 expref: 19 pid: 35247 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166976.428375:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166976.428377:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166976.428380:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfc00/0x2f180c4effbaa1ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [28672->36863] (req 28672->36863) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.428387:0:7421:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfc00/0x2f180c4effbaa1ae lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [28672->36863] (req 28672->36863) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.428407:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166976.428436:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4533480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450377344:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 129us (278us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166976.428441:0:8388:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfc00/0x2f180c4effbaa1ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [28672->36863] (req 28672->36863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166976.428445:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9506 00010000:00010000:3.0:1762166976.428458:0:8388:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfc00/0x2f180c4effbaa1ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [28672->36863] (req 28672->36863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1762166976.429955:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843206 is committed 00002000:00010000:3.0:1762166976.430036:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb size from disk: 4096 -> 36864 00002000:00010000:3.0:1762166976.430041:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb blocks from disk: 16 -> 24 00010000:00010000:3.0:1762166976.430050:0:8388:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfc00/0x2f180c4effbaa1ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [28672->36863] (req 28672->36863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.430061:0:8388:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfc00/0x2f180c4effbaa1ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [28672->36863] (req 28672->36863) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.430070:0:8388:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfc00/0x2f180c4effbaa1ae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [28672->36863] (req 28672->36863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.430078:0:8388:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdfc00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166976.430083:0:8388:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfc00/0x2f180c4effbaa1ae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [28672->36863] (req 28672->36863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.430092:0:8388:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfc00/0x2f180c4effbaa1ae lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [28672->36863] (req 28672->36863) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.430108:0:8388:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfc00/0x2f180c4effbaa1ae lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [28672->36863] (req 28672->36863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.430116:0:8388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfc00/0x2f180c4effbaa1ae lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [28672->36863] (req 28672->36863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166976.430184:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+15:2418:x1847765450377216:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 3300us (3446us total) trans 21474843206 rc 0/0 00000100:00100000:3.0:1762166976.430194:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2074 00000100:00100000:2.0:1762166976.431764:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166976.431928:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450377472 00000100:00100000:3.0:1762166976.431943:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450377472 00000100:00100000:3.0:1762166976.432028:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2075 00000100:00100000:3.0:1762166976.432039:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4531880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+15:2419:x1847765450377472:12345-192.168.204.38@tcp:4:lfs.0 00010000:00010000:3.0:1762166976.432073:0:8388:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc8472400/0x2f180c4effbaa1b5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.432092:0:8388:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effbaa18b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9916 expref: 15 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.432100:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166976.432102:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166976.432106:0:8388:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8472400/0x2f180c4effbaa1b5 lrc: 4/0,1 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [28672->36863] (req 28672->36863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.432139:0:8388:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effbaa18b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9916 expref: 15 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.432154:0:8388:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effbaa18b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9916 expref: 15 pid: 35247 timeout: 695 lvb_type: 0 00000100:00100000:3.0:1762166976.432167:0:8388:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0000_UUID:8388:1847765449697280:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166976.432255:0:8388:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cee171a80 going to sleep for 11 seconds 00000100:00100000:3.0:1762166976.433329:0:8388:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0000_UUID:8388:1847765449697280:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166976.433354:0:8388:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bc8472400/0x2f180c4effbaa1b5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [28672->36863] (req 28672->36863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166976.433568:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166976.433609:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450377600 00000100:00100000:0.0:1762166976.433617:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450377600 00010000:00010000:0.0:1762166976.433647:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effbaa18b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9916 expref: 16 pid: 35247 timeout: 695 lvb_type: 0 00000100:00100000:0.0:1762166976.433680:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9507 00000100:00100000:0.0:1762166976.433689:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf9d1c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+16:2419:x1847765450377600:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166976.433702:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166976.433720:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effbaa18b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9916 expref: 16 pid: 35247 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166976.433729:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effbaa18b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9916 expref: 16 pid: 35247 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166976.433748:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effbaa18b lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9916 expref: 16 pid: 35247 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166976.433761:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166976.433762:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166976.433766:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc8472400/0x2f180c4effbaa1b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [28672->36863] (req 28672->36863) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.433777:0:7421:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8472400/0x2f180c4effbaa1b5 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [28672->36863] (req 28672->36863) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.433798:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166976.433822:0:8388:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bc8472400/0x2f180c4effbaa1b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [28672->36863] (req 28672->36863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.433832:0:8388:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc8472400/0x2f180c4effbaa1b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [28672->36863] (req 28672->36863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166976.433838:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf9d1c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+15:2419:x1847765450377600:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 149us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166976.433846:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9507 00000001:00080000:0.0:1762166976.435469:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843207 is committed 00002000:00010000:3.0:1762166976.435559:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb size from disk: 4096 -> 36864 00002000:00010000:3.0:1762166976.435564:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb blocks from disk: 8 -> 24 00010000:00010000:3.0:1762166976.435575:0:8388:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc8472400/0x2f180c4effbaa1b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [28672->36863] (req 28672->36863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.435586:0:8388:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8472400/0x2f180c4effbaa1b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [28672->36863] (req 28672->36863) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.435602:0:8388:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc8472400/0x2f180c4effbaa1b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [28672->36863] (req 28672->36863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.435609:0:8388:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8472400 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166976.435614:0:8388:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc8472400/0x2f180c4effbaa1b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [28672->36863] (req 28672->36863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.435624:0:8388:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc8472400/0x2f180c4effbaa1b5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [28672->36863] (req 28672->36863) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.435643:0:8388:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc8472400/0x2f180c4effbaa1b5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [28672->36863] (req 28672->36863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.435650:0:8388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc8472400/0x2f180c4effbaa1b5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [28672->36863] (req 28672->36863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166976.435727:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4531880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+14:2419:x1847765450377472:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 3686us (3967us total) trans 21474843207 rc 0/0 00000100:00100000:3.0:1762166976.435738:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2075 00000100:00100000:2.0:1762166976.437993:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166976.438044:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450377728 00000100:00100000:3.0:1762166976.438057:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450377728 00000100:00100000:3.0:1762166976.438133:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18816 00000100:00100000:3.0:1762166976.438145:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4530700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+30:2418:x1847765450377728:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:3.0:1762166976.438290:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4530700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+30:2418:x1847765450377728:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 147us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166976.438298:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18816 00000100:00100000:0.0:1762166976.439678:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166976.439731:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450377856 00000100:00100000:3.0:1762166976.439742:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450377856 00000100:00100000:3.0:1762166976.439787:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18817 00000100:00100000:3.0:1762166976.439795:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+30:2419:x1847765450377856:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:3.0:1762166976.439882:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+30:2419:x1847765450377856:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 86us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166976.439890:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18817 00000100:00100000:2.0:1762166976.441259:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.441337:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450378112 00000100:00100000:1.0:1762166976.441343:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450378112 00000100:00100000:1.0:1762166976.441380:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30305 00000100:00100000:1.0:1762166976.441386:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4530000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+533:61840:x1847765450378112:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:1.0:1762166976.441434:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166976.441470:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa200/0x2f180c4effbaa1a0 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9924 expref: 533 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.441523:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.441530:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166976.441715:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fac00/0x2f180c4effbaa1bc lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166976.441727:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fac00/0x2f180c4effbaa1bc lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.441734:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fac00/0x2f180c4effbaa1bc lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000001:00080000:1.0:1762166976.441773:0:6494:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294991893 00000004:00010000:1.0:1762166976.441795:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000003aa326f1 reply state 00000000437a8686 transno 4294991894 ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fac00/0x2f180c4effbaa1bc lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.441812:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fac00/0x2f180c4effbaa1bc lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.441818:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.441821:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166976.441824:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166976.441891:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4530000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+535:61840:x1847765450378112:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 505us (635us total) trans 4294991894 rc 0/0 00000100:00100000:1.0:1762166976.441909:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30305 00000020:00080000:1.0:1762166976.441913:0:6494:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1762166976.443011:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166976.443051:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450378240 00000100:00100000:3.0:1762166976.443057:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450378240 00000100:00100000:3.0:1762166976.443100:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18818 00000100:00100000:3.0:1762166976.443107:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4531f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+14:61840:x1847765450378240:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166976.443128:0:35247:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166976.443145:0:35247:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc8472600/0x2f180c4effbaa1c3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e992b expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166976.443169:0:35247:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa86:0x0] initial LVB size: 36864, mtime: 0x690888c0, atime: 0x690888bd, ctime: 0x690888c0, blocks: 0x18 00010000:00010000:3.0:1762166976.443188:0:35247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166976.443191:0:35247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166976.443199:0:35247:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8472600/0x2f180c4effbaa1c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e992b expref: 15 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.443213:0:35247:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc8472600/0x2f180c4effbaa1c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e992b expref: 15 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.443225:0:35247:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8472600, rc 0) 00000100:00100000:3.0:1762166976.443263:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4531f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+15:61840:x1847765450378240:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 156us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166976.443274:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18818 00000100:00100000:0.0:1762166976.444303:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166976.444335:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166976.444356:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450378368 00000100:00100000:3.0:1762166976.444363:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450378368 00000100:00100000:1.0:1762166976.444384:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450378496 00000100:00100000:1.0:1762166976.444391:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450378496 00002000:00010000:3.0:1762166976.444392:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2694 (36864->18446744073709551615) 00002000:00100000:3.0:1762166976.444398:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1dddf80 with x1847765450378368 ext(36864->18446744073709551615) 00002000:00010000:3.0:1762166976.444406:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945cf1dddf80. 00002000:00010000:1.0:1762166976.444411:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2693 (0->18446744073709551615) 00002000:00100000:1.0:1762166976.444417:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1ddea00 with x1847765450378496 ext(0->18446744073709551615) 00002000:00010000:1.0:1762166976.444426:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1ddea00. 00000100:00100000:3.0:1762166976.444432:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2076 00000100:00100000:3.0:1762166976.444442:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1dddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+15:2418:x1847765450378368:12345-192.168.204.38@tcp:10:lfs.0 00000100:00100000:1.0:1762166976.444471:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2077 00000100:00100000:1.0:1762166976.444507:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+30:2419:x1847765450378496:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:3.0:1762166976.444633:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb size from disk: 36864 -> 36864 00002000:00010000:1.0:1762166976.444634:0:14623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166976.444640:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.444640:0:14623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:3.0:1762166976.444646:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb atime from disk: 1762166973 -> 1762166973 00002000:00010000:1.0:1762166976.444647:0:14623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb atime from disk: 1762166973 -> 1762166973 00002000:00010000:3.0:1762166976.444651:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.444653:0:14623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:3.0:1762166976.444656:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb blocks from disk: 24 -> 24 00002000:00010000:1.0:1762166976.444658:0:14623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166976.444710:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1dddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+16:2418:x1847765450378368:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 263us (404us total) trans 21474843208 rc 0/0 00000100:00100000:1.0:1762166976.444712:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+31:2419:x1847765450378496:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 232us (375us total) trans 17179876249 rc 0/0 00000100:00100000:3.0:1762166976.444726:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2076 00002000:00010000:3.0:1762166976.444731:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2694 (36864->18446744073709551615) 00000100:00100000:1.0:1762166976.444734:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2077 00002000:00100000:3.0:1762166976.444737:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1dddf80 with x1847765450378368 ext(36864->18446744073709551615) 00002000:00010000:1.0:1762166976.444739:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2693 (0->18446744073709551615) 00002000:00010000:3.0:1762166976.444744:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945cf1dddf80. 00002000:00100000:1.0:1762166976.444745:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1ddea00 with x1847765450378496 ext(0->18446744073709551615) 00002000:00010000:1.0:1762166976.444754:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1ddea00. 00000100:00100000:2.0:1762166976.445667:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.445709:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450378624 00000100:00100000:1.0:1762166976.445716:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450378624 00000100:00100000:1.0:1762166976.445755:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30306 00000100:00100000:1.0:1762166976.445764:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4530e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+535:61840:x1847765450378624:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166976.445787:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166976.445806:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa400/0x2f180c4effbaa1ca lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9932 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.445894:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fba00/0x2f180c4effbaa1d1 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166976.445922:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fba00/0x2f180c4effbaa1d1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.445933:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fba00/0x2f180c4effbaa1d1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:1.0:1762166976.445961:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 36864 00000004:00200000:1.0:1762166976.445966:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166976.445984:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fba00/0x2f180c4effbaa1d1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.446010:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa400/0x2f180c4effbaa1ca lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9932 expref: 537 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.446028:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fba00/0x2f180c4effbaa1d1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9932 expref: 536 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.446036:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.446040:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166976.446043:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcc8fba00, rc 0) 00000100:00100000:1.0:1762166976.446085:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4530e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+536:61840:x1847765450378624:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 323us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166976.446093:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30306 00000100:00100000:2.0:1762166976.447520:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.447595:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450378880 00000100:00100000:1.0:1762166976.447604:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450378880 00000100:00100000:1.0:1762166976.447655:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30307 00000100:00100000:1.0:1762166976.447664:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4533b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+536:61840:x1847765450378880:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:1.0:1762166976.447708:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166976.447732:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fba00/0x2f180c4effbaa1d1 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9932 expref: 536 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.447748:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.447753:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166976.447920:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa200/0x2f180c4effbaa1d8 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166976.447934:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa200/0x2f180c4effbaa1d8 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.447942:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa200/0x2f180c4effbaa1d8 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000001:00080000:1.0:1762166976.447983:0:6494:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294991895 00000004:00010000:1.0:1762166976.448004:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000ab29d406 reply state 00000000a2794707 transno 4294991896 ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa200/0x2f180c4effbaa1d8 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.448014:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa200/0x2f180c4effbaa1d8 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.448024:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.448027:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166976.448030:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166976.448115:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4533b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+538:61840:x1847765450378880:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 451us (635us total) trans 4294991896 rc 0/0 00000100:00100000:1.0:1762166976.448124:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30307 00000020:00080000:1.0:1762166976.448130:0:6494:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1762166976.448893:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166976.448958:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450379008 00000100:00100000:3.0:1762166976.448966:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450379008 00000100:00100000:3.0:1762166976.449014:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18819 00000100:00100000:3.0:1762166976.449025:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+16:61840:x1847765450379008:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166976.449040:0:35247:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166976.449060:0:35247:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc8472400/0x2f180c4effbaa1df lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9939 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166976.449084:0:35247:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa88:0x0] initial LVB size: 36864, mtime: 0x690888c0, atime: 0x690888bf, ctime: 0x690888c0, blocks: 0x18 00010000:00010000:3.0:1762166976.449102:0:35247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166976.449103:0:35247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166976.449109:0:35247:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8472400/0x2f180c4effbaa1df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9939 expref: 17 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.449120:0:35247:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc8472400/0x2f180c4effbaa1df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9939 expref: 17 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.449128:0:35247:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8472400, rc 0) 00000100:00100000:3.0:1762166976.449164:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+17:61840:x1847765450379008:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 143us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166976.449169:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18819 00000100:00100000:2.0:1762166976.450083:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166976.450124:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.450144:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450379136 00000100:00100000:1.0:1762166976.450155:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450379136 00000100:00100000:3.0:1762166976.450173:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450379264 00000100:00100000:3.0:1762166976.450181:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450379264 00002000:00010000:1.0:1762166976.450186:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2696 (36864->18446744073709551615) 00002000:00100000:1.0:1762166976.450197:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4533100 with x1847765450379136 ext(36864->18446744073709551615) 00002000:00010000:3.0:1762166976.450208:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2695 (0->18446744073709551615) 00002000:00010000:1.0:1762166976.450211:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc4533100. 00002000:00100000:3.0:1762166976.450215:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4530380 with x1847765450379264 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166976.450227:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4530380. 00000100:00100000:3.0:1762166976.450281:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2078 00000100:00100000:1.0:1762166976.450299:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2079 00000100:00100000:1.0:1762166976.450312:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4530380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+31:2417:x1847765450379264:12345-192.168.204.38@tcp:10:lfs.0 00000100:00100000:3.0:1762166976.450363:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4533100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+17:2417:x1847765450379136:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:1.0:1762166976.450425:0:14623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166976.450428:0:14623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.450430:0:14623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00002000:00010000:1.0:1762166976.450434:0:14623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.450435:0:14623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1762166976.450509:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4530380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+32:2417:x1847765450379264:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 169us (355us total) trans 17179876250 rc 0/0 00000100:00100000:1.0:1762166976.450521:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2079 00002000:00010000:1.0:1762166976.450526:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2695 (0->18446744073709551615) 00002000:00100000:1.0:1762166976.450530:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4530380 with x1847765450379264 ext(0->18446744073709551615) 00002000:00010000:1.0:1762166976.450540:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4530380. 00002000:00010000:3.0:1762166976.450544:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb size from disk: 36864 -> 36864 00002000:00010000:3.0:1762166976.450549:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:3.0:1762166976.450553:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166976.450557:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:3.0:1762166976.450560:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb blocks from disk: 24 -> 24 00000100:00100000:3.0:1762166976.450596:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4533100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+18:2417:x1847765450379136:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 302us (511us total) trans 21474843209 rc 0/0 00000100:00100000:3.0:1762166976.450605:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2078 00002000:00010000:3.0:1762166976.450609:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2696 (36864->18446744073709551615) 00002000:00100000:3.0:1762166976.450613:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4533100 with x1847765450379136 ext(36864->18446744073709551615) 00002000:00010000:3.0:1762166976.450619:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc4533100. 00000100:00100000:2.0:1762166976.451525:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.451561:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450379392 00000100:00100000:1.0:1762166976.451568:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450379392 00000100:00100000:1.0:1762166976.451597:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30308 00000100:00100000:1.0:1762166976.451603:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4533800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+538:61840:x1847765450379392:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166976.451616:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166976.451631:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945ceda5f600/0x2f180c4effbaa1e6 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9940 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.451714:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847f600/0x2f180c4effbaa1ed lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166976.451727:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847f600/0x2f180c4effbaa1ed lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.451737:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847f600/0x2f180c4effbaa1ed lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:1.0:1762166976.451759:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 36864 00000004:00200000:1.0:1762166976.451763:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166976.451779:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847f600/0x2f180c4effbaa1ed lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.451800:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945ceda5f600/0x2f180c4effbaa1e6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9940 expref: 540 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.451815:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847f600/0x2f180c4effbaa1ed lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9940 expref: 539 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.451824:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.451827:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166976.451830:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc847f600, rc 0) 00000100:00100000:1.0:1762166976.451862:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4533800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+539:61840:x1847765450379392:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 260us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166976.451868:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30308 00000100:00100000:0.0:1762166976.453128:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166976.453202:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450379520 00000100:00100000:3.0:1762166976.453208:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450379520 00000100:00100000:3.0:1762166976.453253:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2080 00000100:00100000:3.0:1762166976.453263:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+32:2418:x1847765450379520:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:3.0:1762166976.453284:0:8388:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effbaa1f4 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.453296:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166976.453298:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166976.453303:0:8388:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effbaa1f4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [98304->147455] (req 98304->147455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.453313:0:8388:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effbaa1f4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [98304->147455] (req 98304->147455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.454302:0:8388:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effbaa1f4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [98304->147455] (req 98304->147455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.454315:0:8388:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effbaa1f4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [98304->147455] (req 98304->147455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.454325:0:8388:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effbaa1f4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [98304->147455] (req 98304->147455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.454330:0:8388:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8473600 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166976.454333:0:8388:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effbaa1f4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [98304->147455] (req 98304->147455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.454339:0:8388:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effbaa1f4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [98304->147455] (req 98304->147455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.454353:0:8388:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effbaa1f4 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [98304->147455] (req 98304->147455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.454357:0:8388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effbaa1f4 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [98304->147455] (req 98304->147455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166976.454411:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+32:2418:x1847765450379520:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 1149us (1282us total) trans 0 rc 49152/49152 00000100:00100000:3.0:1762166976.454418:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2080 00000100:00100000:2.0:1762166976.456056:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166976.456103:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450379648 00000100:00100000:3.0:1762166976.456113:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450379648 00000100:00100000:3.0:1762166976.456170:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2081 00000100:00100000:3.0:1762166976.456176:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4531180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450379648:12345-192.168.204.38@tcp:4:lfs.0 00010000:00010000:3.0:1762166976.456204:0:8388:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc8473000/0x2f180c4effbaa1fb lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.456217:0:8388:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc8472600/0x2f180c4effbaa1c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e992b expref: 18 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.456224:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166976.456225:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166976.456228:0:8388:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8473000/0x2f180c4effbaa1fb lrc: 4/0,1 mode: --/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [98304->147455] (req 98304->147455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.456257:0:8388:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc8472600/0x2f180c4effbaa1c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e992b expref: 18 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.456271:0:8388:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc8472600/0x2f180c4effbaa1c3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e992b expref: 18 pid: 35247 timeout: 695 lvb_type: 0 00000100:00100000:3.0:1762166976.456287:0:8388:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0000_UUID:8388:1847765449697408:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166976.456379:0:8388:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cee171a80 going to sleep for 11 seconds 00000100:00100000:3.0:1762166976.457417:0:8388:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0000_UUID:8388:1847765449697408:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166976.457444:0:8388:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bc8473000/0x2f180c4effbaa1fb lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [98304->147455] (req 98304->147455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166976.457470:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166976.457556:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450379776 00000100:00100000:0.0:1762166976.457564:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450379776 00010000:00010000:0.0:1762166976.457592:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8472600/0x2f180c4effbaa1c3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e992b expref: 19 pid: 35247 timeout: 695 lvb_type: 0 00000100:00100000:0.0:1762166976.457626:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9508 00000100:00100000:0.0:1762166976.457636:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4533480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450379776:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166976.457649:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166976.457668:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc8472600/0x2f180c4effbaa1c3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e992b expref: 19 pid: 35247 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166976.457681:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc8472600/0x2f180c4effbaa1c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e992b expref: 19 pid: 35247 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166976.457705:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc8472600/0x2f180c4effbaa1c3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e992b expref: 19 pid: 35247 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166976.457719:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166976.457721:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166976.457726:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc8473000/0x2f180c4effbaa1fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [98304->147455] (req 98304->147455) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.457735:0:7421:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8473000/0x2f180c4effbaa1fb lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [98304->147455] (req 98304->147455) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.457767:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166976.457799:0:8388:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bc8473000/0x2f180c4effbaa1fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [98304->147455] (req 98304->147455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.457812:0:8388:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc8473000/0x2f180c4effbaa1fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [98304->147455] (req 98304->147455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166976.457822:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4533480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450379776:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 186us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166976.457838:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9508 00000001:00080000:0.0:1762166976.460197:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843210 is committed 00002000:00010000:3.0:1762166976.460304:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb size from disk: 36864 -> 147456 00002000:00010000:3.0:1762166976.460310:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb blocks from disk: 24 -> 120 00010000:00010000:3.0:1762166976.460320:0:8388:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc8473000/0x2f180c4effbaa1fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [98304->147455] (req 98304->147455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.460331:0:8388:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8473000/0x2f180c4effbaa1fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [98304->147455] (req 98304->147455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.460339:0:8388:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc8473000/0x2f180c4effbaa1fb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [98304->147455] (req 98304->147455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.460346:0:8388:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8473000 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166976.460351:0:8388:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc8473000/0x2f180c4effbaa1fb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [98304->147455] (req 98304->147455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.460359:0:8388:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc8473000/0x2f180c4effbaa1fb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [98304->147455] (req 98304->147455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.460377:0:8388:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc8473000/0x2f180c4effbaa1fb lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [98304->147455] (req 98304->147455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.460384:0:8388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc8473000/0x2f180c4effbaa1fb lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [98304->147455] (req 98304->147455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166976.460471:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4531180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+15:2419:x1847765450379648:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 4289us (4416us total) trans 21474843210 rc 0/0 00000100:00100000:3.0:1762166976.460510:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2081 00000100:00100000:0.0:1762166976.462349:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166976.462401:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450379904 00000100:00100000:3.0:1762166976.462409:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450379904 00000100:00100000:3.0:1762166976.462465:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2082 00000100:00100000:3.0:1762166976.462472:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4011f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+15:2417:x1847765450379904:12345-192.168.204.38@tcp:4:lfs.0 00010000:00010000:3.0:1762166976.462536:0:8388:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effbaa202 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.462551:0:8388:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc8472400/0x2f180c4effbaa1df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9939 expref: 15 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.462557:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166976.462558:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166976.462561:0:8388:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effbaa202 lrc: 4/0,1 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [98304->147455] (req 98304->147455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.462595:0:8388:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc8472400/0x2f180c4effbaa1df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9939 expref: 15 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.462605:0:8388:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc8472400/0x2f180c4effbaa1df lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9939 expref: 15 pid: 35247 timeout: 695 lvb_type: 0 00000100:00100000:3.0:1762166976.462615:0:8388:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0000_UUID:8388:1847765449697536:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166976.462685:0:8388:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cee171a80 going to sleep for 11 seconds 00000100:00100000:3.0:1762166976.463730:0:8388:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0000_UUID:8388:1847765449697536:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166976.463746:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:3.0:1762166976.463758:0:8388:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effbaa202 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [98304->147455] (req 98304->147455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166976.463808:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450380032 00000100:00100000:0.0:1762166976.463819:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450380032 00010000:00010000:0.0:1762166976.463855:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8472400/0x2f180c4effbaa1df lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9939 expref: 16 pid: 35247 timeout: 695 lvb_type: 0 00000100:00100000:0.0:1762166976.463891:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9509 00000100:00100000:0.0:1762166976.463912:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+16:2418:x1847765450380032:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166976.463927:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166976.463949:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc8472400/0x2f180c4effbaa1df lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9939 expref: 16 pid: 35247 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166976.463963:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc8472400/0x2f180c4effbaa1df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9939 expref: 16 pid: 35247 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166976.463987:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc8472400/0x2f180c4effbaa1df lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9939 expref: 16 pid: 35247 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166976.463999:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166976.464001:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166976.464005:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effbaa202 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [98304->147455] (req 98304->147455) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.464012:0:7421:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effbaa202 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [98304->147455] (req 98304->147455) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.464040:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166976.464075:0:8388:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effbaa202 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [98304->147455] (req 98304->147455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166976.464086:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+15:2418:x1847765450380032:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 177us (353us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166976.464090:0:8388:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effbaa202 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [98304->147455] (req 98304->147455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166976.464096:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9509 00000001:00080000:0.0:1762166976.465999:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843211 is committed 00002000:00010000:3.0:1762166976.466077:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb size from disk: 36864 -> 147456 00002000:00010000:3.0:1762166976.466083:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb blocks from disk: 24 -> 120 00010000:00010000:3.0:1762166976.466094:0:8388:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effbaa202 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [98304->147455] (req 98304->147455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.466105:0:8388:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effbaa202 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [98304->147455] (req 98304->147455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.466115:0:8388:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effbaa202 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [98304->147455] (req 98304->147455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.466124:0:8388:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8473600 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166976.466128:0:8388:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effbaa202 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [98304->147455] (req 98304->147455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.466139:0:8388:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effbaa202 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [98304->147455] (req 98304->147455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.466155:0:8388:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effbaa202 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [98304->147455] (req 98304->147455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.466163:0:8388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effbaa202 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [98304->147455] (req 98304->147455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166976.466234:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4011f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+14:2417:x1847765450379904:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 3758us (3890us total) trans 21474843211 rc 0/0 00000100:00100000:3.0:1762166976.466244:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2082 00000100:00100000:2.0:1762166976.467734:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166976.467775:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450380160 00000100:00100000:3.0:1762166976.467784:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450380160 00000100:00100000:3.0:1762166976.467844:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18820 00000100:00100000:3.0:1762166976.467854:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+32:2416:x1847765450380160:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:3.0:1762166976.467971:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+32:2416:x1847765450380160:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 117us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166976.467980:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18820 00000100:00100000:1.0:1762166976.469040:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166976.469090:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450380288 00000100:00100000:0.0:1762166976.469097:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450380288 00000100:00100000:0.0:1762166976.469149:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18821 00000100:00100000:0.0:1762166976.469163:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+32:2416:x1847765450380288:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:0.0:1762166976.469231:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+32:2416:x1847765450380288:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 73us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166976.469238:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18821 00000100:00100000:2.0:1762166976.470535:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166976.470587:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450380544 00000100:00100000:3.0:1762166976.470594:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450380544 00000100:00100000:3.0:1762166976.470635:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30309 00000100:00100000:3.0:1762166976.470644:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+539:61840:x1847765450380544:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:3.0:1762166976.470702:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166976.470733:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847f600/0x2f180c4effbaa1ed lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9940 expref: 539 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.470752:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166976.470759:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166976.470980:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473000/0x2f180c4effbaa209 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166976.470994:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473000/0x2f180c4effbaa209 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166976.471001:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473000/0x2f180c4effbaa209 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000001:00080000:3.0:1762166976.471035:0:6494:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294991897 00000004:00010000:3.0:1762166976.471051:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000007c513f09 reply state 00000000d3453863 transno 4294991898 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473000/0x2f180c4effbaa209 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166976.471064:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473000/0x2f180c4effbaa209 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166976.471070:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166976.471074:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1762166976.471076:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166976.471154:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+541:61840:x1847765450380544:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 510us (623us total) trans 4294991898 rc 0/0 00000100:00100000:3.0:1762166976.471161:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30309 00000020:00080000:3.0:1762166976.471167:0:6494:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1762166976.471967:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166976.472005:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450380672 00000100:00100000:0.0:1762166976.472012:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450380672 00000100:00100000:0.0:1762166976.472050:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18822 00000100:00100000:0.0:1762166976.472060:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+14:61840:x1847765450380672:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166976.472073:0:9168:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166976.472091:0:9168:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde400/0x2f180c4effbaa210 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9947 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166976.472114:0:9168:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa86:0x0] initial LVB size: 147456, mtime: 0x690888c0, atime: 0x690888bd, ctime: 0x690888c0, blocks: 0x78 00010000:00010000:0.0:1762166976.472145:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166976.472148:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166976.472155:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde400/0x2f180c4effbaa210 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9947 expref: 15 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.472176:0:9168:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde400/0x2f180c4effbaa210 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9947 expref: 15 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.472188:0:9168:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bde400, rc 0) 00000100:00100000:0.0:1762166976.472223:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+15:61840:x1847765450380672:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 165us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166976.472232:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18822 00000100:00100000:1.0:1762166976.473123:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.473161:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166976.473192:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450380800 00000100:00100000:3.0:1762166976.473198:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450380800 00000100:00100000:2.0:1762166976.473219:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450380928 00000100:00100000:2.0:1762166976.473225:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450380928 00002000:00010000:3.0:1762166976.473226:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2694 (147456->18446744073709551615) 00002000:00100000:3.0:1762166976.473232:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5bbb800 with x1847765450380800 ext(147456->18446744073709551615) 00002000:00010000:3.0:1762166976.473240:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc5bbb800. 00002000:00010000:2.0:1762166976.473248:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2693 (0->18446744073709551615) 00002000:00100000:2.0:1762166976.473254:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5bb9880 with x1847765450380928 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166976.473262:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5bb9880. 00000100:00100000:3.0:1762166976.473268:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2083 00000100:00100000:3.0:1762166976.473278:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+15:2418:x1847765450380800:12345-192.168.204.38@tcp:10:lfs.0 00000100:00100000:2.0:1762166976.473298:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2084 00000100:00100000:2.0:1762166976.473309:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+32:2419:x1847765450380928:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:2.0:1762166976.473415:0:14623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166976.473416:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb size from disk: 147456 -> 147456 00002000:00010000:2.0:1762166976.473418:0:14623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:3.0:1762166976.473423:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:2.0:1762166976.473423:0:14623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb atime from disk: 1762166973 -> 1762166973 00002000:00010000:3.0:1762166976.473431:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb atime from disk: 1762166973 -> 1762166973 00002000:00010000:2.0:1762166976.473431:0:14623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:2.0:1762166976.473436:0:14623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:3.0:1762166976.473439:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:3.0:1762166976.473442:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb blocks from disk: 120 -> 120 00000100:00100000:2.0:1762166976.473472:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+33:2419:x1847765450380928:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 166us (311us total) trans 17179876251 rc 0/0 00000100:00100000:3.0:1762166976.473501:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+16:2418:x1847765450380800:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 198us (353us total) trans 21474843212 rc 0/0 00000100:00100000:2.0:1762166976.473506:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2084 00002000:00010000:2.0:1762166976.473512:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2693 (0->18446744073709551615) 00000100:00100000:3.0:1762166976.473516:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2083 00002000:00100000:2.0:1762166976.473518:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5bb9880 with x1847765450380928 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166976.473522:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2694 (147456->18446744073709551615) 00002000:00010000:2.0:1762166976.473525:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5bb9880. 00002000:00100000:3.0:1762166976.473528:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5bbb800 with x1847765450380800 ext(147456->18446744073709551615) 00002000:00010000:3.0:1762166976.473535:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc5bbb800. 00000100:00100000:2.0:1762166976.474454:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166976.474520:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450381056 00000100:00100000:3.0:1762166976.474525:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450381056 00000100:00100000:2.0:1762166976.474592:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30310 00000100:00100000:2.0:1762166976.474602:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+541:61840:x1847765450381056:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166976.474618:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166976.474632:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbaa217 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e994e expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.474703:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbaa21e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166976.474718:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbaa21e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166976.474729:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbaa21e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:2.0:1762166976.474757:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 147456 00000004:00200000:2.0:1762166976.474761:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166976.474777:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbaa21e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166976.474803:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbaa217 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e994e expref: 543 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.474822:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbaa21e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e994e expref: 542 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.474828:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166976.474830:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166976.474832:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa9000, rc 0) 00000100:00100000:2.0:1762166976.474866:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+542:61840:x1847765450381056:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 268us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166976.474870:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30310 00000100:00100000:1.0:1762166976.476105:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166976.476174:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450381312 00000100:00100000:2.0:1762166976.476190:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450381312 00000100:00100000:2.0:1762166976.476258:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30311 00000100:00100000:2.0:1762166976.476270:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+542:61840:x1847765450381312:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:2.0:1762166976.476329:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166976.476356:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbaa21e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e994e expref: 542 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.476378:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166976.476383:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166976.476553:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbaa225 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166976.476567:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbaa225 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166976.476575:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbaa225 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000001:00080000:2.0:1762166976.476617:0:6495:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294991899 00000004:00010000:2.0:1762166976.476638:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000093bc2341 reply state 0000000013f52f1f transno 4294991900 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbaa225 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166976.476649:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbaa225 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166976.476656:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166976.476658:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166976.476661:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166976.476753:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+544:61840:x1847765450381312:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 485us (650us total) trans 4294991900 rc 0/0 00000100:00100000:2.0:1762166976.476761:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30311 00000020:00080000:2.0:1762166976.476768:0:6495:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1762166976.477441:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166976.477514:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450381440 00000100:00100000:0.0:1762166976.477522:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450381440 00000100:00100000:0.0:1762166976.477569:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18823 00000100:00100000:0.0:1762166976.477580:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+16:61840:x1847765450381440:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166976.477594:0:9168:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166976.477615:0:9168:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf800/0x2f180c4effbaa22c lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9955 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166976.477636:0:9168:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa88:0x0] initial LVB size: 147456, mtime: 0x690888c0, atime: 0x690888bf, ctime: 0x690888c0, blocks: 0x78 00010000:00010000:0.0:1762166976.477656:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166976.477659:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166976.477667:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf800/0x2f180c4effbaa22c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9955 expref: 17 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.477683:0:9168:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf800/0x2f180c4effbaa22c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9955 expref: 17 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.477694:0:9168:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdf800, rc 0) 00000100:00100000:0.0:1762166976.477734:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+17:61840:x1847765450381440:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 157us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166976.477743:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18823 00000100:00100000:3.0:1762166976.478576:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166976.478619:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166976.478643:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450381568 00000100:00100000:0.0:1762166976.478651:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450381568 00000100:00100000:2.0:1762166976.478667:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450381696 00000100:00100000:2.0:1762166976.478677:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450381696 00002000:00010000:0.0:1762166976.478678:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2696 (147456->18446744073709551615) 00002000:00100000:0.0:1762166976.478685:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc2d5ca80 with x1847765450381568 ext(147456->18446744073709551615) 00002000:00010000:0.0:1762166976.478692:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc2d5ca80. 00002000:00010000:2.0:1762166976.478708:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2695 (0->18446744073709551615) 00002000:00100000:2.0:1762166976.478714:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc2d5ea00 with x1847765450381696 ext(0->18446744073709551615) 00000100:00100000:0.0:1762166976.478719:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2085 00002000:00010000:2.0:1762166976.478725:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc2d5ea00. 00000100:00100000:0.0:1762166976.478730:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450381568:12345-192.168.204.38@tcp:10:lfs.0 00000100:00100000:2.0:1762166976.478777:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2086 00000100:00100000:2.0:1762166976.478795:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+33:2419:x1847765450381696:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:0.0:1762166976.478878:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb size from disk: 147456 -> 147456 00002000:00010000:0.0:1762166976.478882:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:0.0:1762166976.478884:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00002000:00010000:0.0:1762166976.478886:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:0.0:1762166976.478888:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb blocks from disk: 120 -> 120 00002000:00010000:2.0:1762166976.478927:0:14623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166976.478932:0:14623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:2.0:1762166976.478938:0:14623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00000100:00100000:0.0:1762166976.478941:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450381568:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 209us (363us total) trans 21474843213 rc 0/0 00002000:00010000:2.0:1762166976.478943:0:14623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:2.0:1762166976.478953:0:14623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1762166976.478960:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2085 00002000:00010000:0.0:1762166976.478966:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2696 (147456->18446744073709551615) 00002000:00100000:0.0:1762166976.478970:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc2d5ca80 with x1847765450381568 ext(147456->18446744073709551615) 00002000:00010000:0.0:1762166976.478978:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc2d5ca80. 00000100:00100000:2.0:1762166976.478999:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+34:2419:x1847765450381696:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 208us (376us total) trans 17179876252 rc 0/0 00000100:00100000:2.0:1762166976.479010:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2086 00002000:00010000:2.0:1762166976.479014:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2695 (0->18446744073709551615) 00002000:00100000:2.0:1762166976.479017:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc2d5ea00 with x1847765450381696 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166976.479024:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc2d5ea00. 00000100:00100000:1.0:1762166976.480030:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166976.480080:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450381824 00000100:00100000:2.0:1762166976.480086:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450381824 00000100:00100000:2.0:1762166976.480124:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30312 00000100:00100000:2.0:1762166976.480133:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+544:61840:x1847765450381824:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166976.480147:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166976.480162:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbaa233 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e995c expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.480249:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbaa23a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166976.480260:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbaa23a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166976.480270:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbaa23a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:2.0:1762166976.480289:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 147456 00000004:00200000:2.0:1762166976.480293:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166976.480306:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbaa23a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166976.480326:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbaa233 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e995c expref: 546 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.480344:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbaa23a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e995c expref: 545 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.480352:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166976.480355:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166976.480358:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa8e00, rc 0) 00000100:00100000:2.0:1762166976.480396:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+545:61840:x1847765450381824:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 265us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166976.480403:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30312 00000100:00100000:0.0:1762166976.482266:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.482323:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450381952 00000100:00100000:1.0:1762166976.482332:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450381952 00000100:00100000:1.0:1762166976.482389:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2087 00000100:00100000:1.0:1762166976.482399:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4011500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+34:2417:x1847765450381952:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:1.0:1762166976.482419:0:14623:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bcc8fa400/0x2f180c4effbaa241 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.482429:0:14623:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166976.482431:0:14623:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166976.482434:0:14623:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bcc8fa400/0x2f180c4effbaa241 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [221184->245759] (req 221184->245759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.482445:0:14623:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bcc8fa400/0x2f180c4effbaa241 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [221184->245759] (req 221184->245759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.483432:0:14623:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bcc8fa400/0x2f180c4effbaa241 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [221184->245759] (req 221184->245759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.483445:0:14623:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bcc8fa400/0x2f180c4effbaa241 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [221184->245759] (req 221184->245759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.483459:0:14623:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bcc8fa400/0x2f180c4effbaa241 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [221184->245759] (req 221184->245759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.483464:0:14623:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcc8fa400 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166976.483468:0:14623:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bcc8fa400/0x2f180c4effbaa241 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [221184->245759] (req 221184->245759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.483474:0:14623:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bcc8fa400/0x2f180c4effbaa241 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [221184->245759] (req 221184->245759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.483522:0:14623:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bcc8fa400/0x2f180c4effbaa241 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [221184->245759] (req 221184->245759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.483527:0:14623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bcc8fa400/0x2f180c4effbaa241 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [221184->245759] (req 221184->245759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166976.483574:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4011500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+34:2417:x1847765450381952:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 1177us (1315us total) trans 0 rc 23004/23004 00000100:00100000:1.0:1762166976.483581:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2087 00000100:00100000:3.0:1762166976.486523:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166976.486565:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450382080 00000100:00100000:3.0:1762166976.486574:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450382080 00000100:00100000:3.0:1762166976.486641:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2088 00000100:00100000:3.0:1762166976.486653:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+18:2416:x1847765450382080:12345-192.168.204.38@tcp:4:lfs.0 00010000:00010000:3.0:1762166976.486686:0:14623:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effbaa248 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.486702:0:14623:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde400/0x2f180c4effbaa210 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9947 expref: 18 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.486710:0:14623:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166976.486713:0:14623:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166976.486716:0:14623:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effbaa248 lrc: 4/0,1 mode: --/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [221184->245759] (req 221184->245759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.486753:0:14623:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde400/0x2f180c4effbaa210 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9947 expref: 18 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.486767:0:14623:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde400/0x2f180c4effbaa210 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9947 expref: 18 pid: 9168 timeout: 695 lvb_type: 0 00000100:00100000:3.0:1762166976.486790:0:14623:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5f800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0000_UUID:14623:1847765449697664:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166976.486893:0:14623:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cee171a80 going to sleep for 11 seconds 00000100:00100000:3.0:1762166976.488161:0:14623:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5f800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0000_UUID:14623:1847765449697664:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166976.488184:0:14623:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effbaa248 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [221184->245759] (req 221184->245759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166976.488379:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.488453:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450382208 00000100:00100000:1.0:1762166976.488459:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450382208 00010000:00010000:1.0:1762166976.488514:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde400/0x2f180c4effbaa210 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9947 expref: 19 pid: 9168 timeout: 695 lvb_type: 0 00000100:00100000:1.0:1762166976.488550:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9510 00000100:00100000:1.0:1762166976.488559:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450382208:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166976.488571:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166976.488598:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde400/0x2f180c4effbaa210 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9947 expref: 19 pid: 9168 timeout: 695 lvb_type: 0 00010000:00010000:1.0:1762166976.488613:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde400/0x2f180c4effbaa210 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9947 expref: 19 pid: 9168 timeout: 695 lvb_type: 0 00010000:00010000:1.0:1762166976.488639:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde400/0x2f180c4effbaa210 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9947 expref: 19 pid: 9168 timeout: 695 lvb_type: 0 00010000:00010000:1.0:1762166976.488654:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166976.488656:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166976.488660:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effbaa248 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [221184->245759] (req 221184->245759) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.488668:0:7421:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effbaa248 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [221184->245759] (req 221184->245759) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.488690:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166976.488702:0:14623:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effbaa248 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [221184->245759] (req 221184->245759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.488713:0:14623:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effbaa248 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [221184->245759] (req 221184->245759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166976.488726:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450382208:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 168us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166976.488736:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9510 00000001:00080000:2.0:1762166976.491088:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843214 is committed 00002000:00010000:3.0:1762166976.491175:0:14623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb size from disk: 147456 -> 245760 00002000:00010000:3.0:1762166976.491181:0:14623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb blocks from disk: 120 -> 168 00010000:00010000:3.0:1762166976.491191:0:14623:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effbaa248 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [221184->245759] (req 221184->245759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.491202:0:14623:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effbaa248 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [221184->245759] (req 221184->245759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.491211:0:14623:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effbaa248 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [221184->245759] (req 221184->245759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.491219:0:14623:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8473600 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166976.491224:0:14623:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effbaa248 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [221184->245759] (req 221184->245759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.491232:0:14623:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effbaa248 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [221184->245759] (req 221184->245759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.491248:0:14623:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effbaa248 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [221184->245759] (req 221184->245759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.491255:0:14623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effbaa248 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [221184->245759] (req 221184->245759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166976.491329:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+15:2416:x1847765450382080:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 4677us (4849us total) trans 21474843214 rc 0/0 00000100:00100000:3.0:1762166976.491339:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2088 00000100:00100000:1.0:1762166976.493281:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166976.493332:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450382336 00000100:00100000:2.0:1762166976.493341:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450382336 00000100:00100000:2.0:1762166976.493413:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2089 00000100:00100000:2.0:1762166976.493425:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+15:2417:x1847765450382336:12345-192.168.204.38@tcp:4:lfs.0 00010000:00010000:2.0:1762166976.493455:0:14623:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9800/0x2f180c4effbaa24f lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.493468:0:14623:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf800/0x2f180c4effbaa22c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9955 expref: 15 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.493473:0:14623:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166976.493658:0:14623:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166976.493661:0:14623:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9800/0x2f180c4effbaa24f lrc: 4/0,1 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [221184->245759] (req 221184->245759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.493689:0:14623:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf800/0x2f180c4effbaa22c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9955 expref: 15 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.493702:0:14623:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf800/0x2f180c4effbaa22c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9955 expref: 15 pid: 9168 timeout: 695 lvb_type: 0 00000100:00100000:2.0:1762166976.493713:0:14623:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda2df80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0000_UUID:14623:1847765449697792:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166976.493794:0:14623:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf3a33a80 going to sleep for 11 seconds 00000100:00100000:2.0:1762166976.494623:0:14623:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda2df80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0000_UUID:14623:1847765449697792:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166976.494643:0:14623:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9800/0x2f180c4effbaa24f lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [221184->245759] (req 221184->245759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166976.494963:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166976.495013:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450382464 00000100:00100000:2.0:1762166976.495019:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450382464 00010000:00010000:2.0:1762166976.495050:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf800/0x2f180c4effbaa22c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9955 expref: 16 pid: 9168 timeout: 695 lvb_type: 0 00000100:00100000:2.0:1762166976.495086:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9511 00000100:00100000:2.0:1762166976.495096:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+16:2418:x1847765450382464:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166976.495108:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166976.495126:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf800/0x2f180c4effbaa22c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9955 expref: 16 pid: 9168 timeout: 695 lvb_type: 0 00010000:00010000:2.0:1762166976.495138:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf800/0x2f180c4effbaa22c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9955 expref: 16 pid: 9168 timeout: 695 lvb_type: 0 00010000:00010000:2.0:1762166976.495158:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf800/0x2f180c4effbaa22c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9955 expref: 16 pid: 9168 timeout: 695 lvb_type: 0 00010000:00010000:2.0:1762166976.495169:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166976.495171:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166976.495174:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9800/0x2f180c4effbaa24f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [221184->245759] (req 221184->245759) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.495184:0:7421:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9800/0x2f180c4effbaa24f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [221184->245759] (req 221184->245759) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.495212:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166976.495239:0:14623:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9800/0x2f180c4effbaa24f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [221184->245759] (req 221184->245759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166976.495252:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+15:2418:x1847765450382464:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 155us (288us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166976.495252:0:14623:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9800/0x2f180c4effbaa24f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [221184->245759] (req 221184->245759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166976.495267:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9511 00000001:00080000:3.0:1762166976.497794:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843215 is committed 00002000:00010000:2.0:1762166976.497891:0:14623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb size from disk: 147456 -> 245760 00002000:00010000:2.0:1762166976.497908:0:14623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb blocks from disk: 120 -> 168 00010000:00010000:2.0:1762166976.497921:0:14623:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9800/0x2f180c4effbaa24f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [221184->245759] (req 221184->245759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.497931:0:14623:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9800/0x2f180c4effbaa24f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [221184->245759] (req 221184->245759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.497940:0:14623:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9800/0x2f180c4effbaa24f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [221184->245759] (req 221184->245759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.497948:0:14623:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa9800 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166976.497954:0:14623:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9800/0x2f180c4effbaa24f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [221184->245759] (req 221184->245759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.497963:0:14623:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9800/0x2f180c4effbaa24f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [221184->245759] (req 221184->245759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.497981:0:14623:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9800/0x2f180c4effbaa24f lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [221184->245759] (req 221184->245759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.497988:0:14623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9800/0x2f180c4effbaa24f lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [221184->245759] (req 221184->245759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166976.498090:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+14:2417:x1847765450382336:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 4662us (4805us total) trans 21474843215 rc 0/0 00000100:00100000:2.0:1762166976.498101:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2089 00000100:00100000:3.0:1762166976.508824:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.508906:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450382720 00000100:00100000:1.0:1762166976.508918:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450382720 00000100:00100000:1.0:1762166976.508987:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30313 00000100:00100000:1.0:1762166976.508999:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+545:61840:x1847765450382720:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:1.0:1762166976.509055:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166976.509084:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbaa23a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e995c expref: 545 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.509102:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.509108:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166976.509246:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42d1200/0x2f180c4effbaa256 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166976.509258:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42d1200/0x2f180c4effbaa256 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166976.509267:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42d1200/0x2f180c4effbaa256 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000001:00080000:1.0:1762166976.509310:0:6495:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294991901 00000004:00010000:1.0:1762166976.509337:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000f543dbee reply state 00000000a54d30a4 transno 4294991902 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42d1200/0x2f180c4effbaa256 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166976.509348:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42d1200/0x2f180c4effbaa256 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166976.509355:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.509358:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166976.509361:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166976.509452:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+547:61840:x1847765450382720:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 454us (646us total) trans 4294991902 rc 0/0 00000100:00100000:1.0:1762166976.509462:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30313 00000020:00080000:1.0:1762166976.509468:0:6495:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1762166976.510907:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166976.510965:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450382848 00000100:00100000:2.0:1762166976.510978:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450382848 00000100:00100000:2.0:1762166976.511056:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18824 00000100:00100000:2.0:1762166976.511071:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+14:61840:x1847765450382848:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166976.511093:0:9168:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166976.511118:0:9168:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9800/0x2f180c4effbaa25d lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9963 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166976.511147:0:9168:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa86:0x0] initial LVB size: 245760, mtime: 0x690888c0, atime: 0x690888bd, ctime: 0x690888c0, blocks: 0xa8 00010000:00010000:2.0:1762166976.511175:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166976.511179:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166976.511189:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9800/0x2f180c4effbaa25d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9963 expref: 15 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.511213:0:9168:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9800/0x2f180c4effbaa25d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9963 expref: 15 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.511227:0:9168:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa9800, rc 0) 00000100:00100000:2.0:1762166976.511297:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+15:61840:x1847765450382848:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 230us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166976.511307:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18824 00000100:00100000:1.0:1762166976.512598:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166976.512728:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450382976 00000100:00100000:3.0:1762166976.512742:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450382976 00002000:00010000:3.0:1762166976.512783:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2694 (244188->18446744073709551615) 00002000:00100000:3.0:1762166976.512789:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5bc1880 with x1847765450382976 ext(244188->18446744073709551615) 00002000:00010000:3.0:1762166976.512801:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc5bc1880. 00000100:00100000:1.0:1762166976.512825:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166976.512893:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450383104 00000100:00100000:3.0:1762166976.512912:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450383104 00000100:00100000:1.0:1762166976.512926:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2090 00000100:00100000:1.0:1762166976.512943:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+15:2418:x1847765450382976:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:3.0:1762166976.512944:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2693 (0->18446744073709551615) 00002000:00100000:3.0:1762166976.512954:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5bc0700 with x1847765450383104 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166976.512963:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5bc0700. 00000100:00100000:3.0:1762166976.512997:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2091 00000100:00100000:3.0:1762166976.513012:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+34:2418:x1847765450383104:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:3.0:1762166976.513182:0:14623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166976.513188:0:14623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:3.0:1762166976.513191:0:14623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb atime from disk: 1762166973 -> 1762166973 00002000:00010000:3.0:1762166976.513194:0:14623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:3.0:1762166976.513196:0:14623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166976.513261:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+35:2418:x1847765450383104:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 252us (439us total) trans 17179876253 rc 0/0 00000100:00100000:3.0:1762166976.513271:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2091 00002000:00010000:3.0:1762166976.513275:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2693 (0->18446744073709551615) 00002000:00100000:3.0:1762166976.513279:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5bc0700 with x1847765450383104 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166976.513284:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5bc0700. 00002000:00010000:1.0:1762166976.513360:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb size from disk: 245760 -> 244188 00002000:00010000:1.0:1762166976.513365:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.513367:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb atime from disk: 1762166973 -> 1762166973 00002000:00010000:1.0:1762166976.513369:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.513371:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb blocks from disk: 168 -> 168 00000100:00100000:1.0:1762166976.513414:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+16:2418:x1847765450382976:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 477us (821us total) trans 21474843216 rc 0/0 00000100:00100000:1.0:1762166976.513423:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2090 00002000:00010000:1.0:1762166976.513428:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2694 (244188->18446744073709551615) 00002000:00100000:1.0:1762166976.513432:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5bc1880 with x1847765450382976 ext(244188->18446744073709551615) 00002000:00010000:1.0:1762166976.513439:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc5bc1880. 00000100:00100000:1.0:1762166976.515063:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166976.515127:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450383232 00000100:00100000:3.0:1762166976.515134:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450383232 00000100:00100000:3.0:1762166976.515184:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30314 00000100:00100000:3.0:1762166976.515196:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+547:61840:x1847765450383232:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166976.515224:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166976.515249:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472a00/0x2f180c4effbaa264 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e996a expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.515359:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473600/0x2f180c4effbaa26b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166976.515376:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473600/0x2f180c4effbaa26b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166976.515391:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473600/0x2f180c4effbaa26b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:3.0:1762166976.515447:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 244188 00000004:00200000:3.0:1762166976.515452:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166976.515473:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473600/0x2f180c4effbaa26b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166976.515556:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472a00/0x2f180c4effbaa264 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e996a expref: 549 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.515575:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473600/0x2f180c4effbaa26b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e996a expref: 548 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.515585:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166976.515588:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166976.515591:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8473600, rc 0) 00000100:00100000:3.0:1762166976.515648:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+548:61840:x1847765450383232:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 455us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166976.515656:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30314 00000100:00100000:3.0:1762166976.517378:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.517434:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450383488 00000100:00100000:1.0:1762166976.517443:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450383488 00000100:00100000:3.0:1762166976.517629:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30315 00000100:00100000:3.0:1762166976.517646:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+548:61840:x1847765450383488:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:3.0:1762166976.517702:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166976.517730:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473600/0x2f180c4effbaa26b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e996a expref: 548 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.517749:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166976.517755:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166976.517976:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472c00/0x2f180c4effbaa272 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166976.517996:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472c00/0x2f180c4effbaa272 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166976.518010:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472c00/0x2f180c4effbaa272 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000001:00080000:3.0:1762166976.518066:0:6494:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294991903 00000004:00010000:3.0:1762166976.518111:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000529db689 reply state 00000000ecc39869 transno 4294991904 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472c00/0x2f180c4effbaa272 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166976.518125:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472c00/0x2f180c4effbaa272 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166976.518135:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166976.518139:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1762166976.518144:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166976.518242:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+550:61840:x1847765450383488:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 601us (868us total) trans 4294991904 rc 0/0 00000100:00100000:3.0:1762166976.518256:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30315 00000020:00080000:3.0:1762166976.518266:0:6494:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1762166976.520123:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.520180:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450383616 00000100:00100000:1.0:1762166976.520190:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450383616 00000100:00100000:1.0:1762166976.520247:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18825 00000100:00100000:1.0:1762166976.520258:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4012a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+16:61840:x1847765450383616:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166976.520279:0:9168:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166976.520303:0:9168:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29a00/0x2f180c4effbaa279 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9971 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762166976.520330:0:9168:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa88:0x0] initial LVB size: 245760, mtime: 0x690888c0, atime: 0x690888bf, ctime: 0x690888c0, blocks: 0xa8 00010000:00010000:1.0:1762166976.520351:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166976.520353:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166976.520361:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29a00/0x2f180c4effbaa279 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9971 expref: 17 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.520378:0:9168:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29a00/0x2f180c4effbaa279 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9971 expref: 17 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.520391:0:9168:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa29a00, rc 0) 00000100:00100000:1.0:1762166976.520453:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4012a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+17:61840:x1847765450383616:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 196us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166976.520461:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18825 00000100:00100000:3.0:1762166976.521619:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166976.521673:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.521693:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450383744 00000100:00100000:1.0:1762166976.521704:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450383744 00000100:00100000:3.0:1762166976.521731:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450383872 00000100:00100000:3.0:1762166976.521738:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450383872 00002000:00010000:1.0:1762166976.521752:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2696 (244188->18446744073709551615) 00002000:00100000:1.0:1762166976.521758:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc2d5ed80 with x1847765450383744 ext(244188->18446744073709551615) 00002000:00010000:3.0:1762166976.521765:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2695 (0->18446744073709551615) 00002000:00100000:3.0:1762166976.521770:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bcce74000 with x1847765450383872 ext(0->18446744073709551615) 00002000:00010000:1.0:1762166976.521771:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc2d5ed80. 00002000:00010000:3.0:1762166976.521778:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bcce74000. 00000100:00100000:1.0:1762166976.521807:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2092 00000100:00100000:3.0:1762166976.521822:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2093 00000100:00100000:1.0:1762166976.521823:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450383744:12345-192.168.204.38@tcp:10:lfs.0 00000100:00100000:3.0:1762166976.521835:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+35:2418:x1847765450383872:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:3.0:1762166976.521991:0:14623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166976.521995:0:14623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:3.0:1762166976.521998:0:14623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166976.522000:0:14623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:3.0:1762166976.522003:0:14623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166976.522068:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+36:2418:x1847765450383872:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 237us (396us total) trans 17179876254 rc 0/0 00000100:00100000:3.0:1762166976.522077:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2093 00002000:00010000:3.0:1762166976.522082:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2695 (0->18446744073709551615) 00002000:00100000:3.0:1762166976.522085:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bcce74000 with x1847765450383872 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166976.522092:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bcce74000. 00002000:00010000:1.0:1762166976.522109:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb size from disk: 245760 -> 244188 00002000:00010000:1.0:1762166976.522114:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.522117:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00002000:00010000:1.0:1762166976.522120:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.522123:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb blocks from disk: 168 -> 168 00000100:00100000:1.0:1762166976.522157:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450383744:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 340us (551us total) trans 21474843217 rc 0/0 00000100:00100000:1.0:1762166976.522168:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2092 00002000:00010000:1.0:1762166976.522172:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2696 (244188->18446744073709551615) 00002000:00100000:1.0:1762166976.522175:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc2d5ed80 with x1847765450383744 ext(244188->18446744073709551615) 00002000:00010000:1.0:1762166976.522180:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc2d5ed80. 00000100:00100000:3.0:1762166976.523260:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166976.523315:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450384128 00000100:00100000:0.0:1762166976.523325:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450384128 00000100:00100000:0.0:1762166976.523391:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30316 00000100:00100000:0.0:1762166976.523405:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+550:61840:x1847765450384128:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:0.0:1762166976.523557:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbaa280 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166976.523574:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbaa280 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166976.523584:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbaa280 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00010000:0.0:1762166976.523703:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000b1319162 reply state 00000000dd021f8a transno 4294991905 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbaa280 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166976.523720:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbaa280 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166976.523729:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166976.523732:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762166976.523737:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166976.523837:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+552:61840:x1847765450384128:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 436us (588us total) trans 4294991905 rc 0/0 00000100:00100000:0.0:1762166976.523848:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30316 00000100:00100000:3.0:1762166976.524964:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.525007:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450384256 00000100:00100000:3.0:1762166976.525013:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.525016:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450384256 00000100:00100000:3.0:1762166976.525058:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.525071:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450384384 00000100:00100000:1.0:1762166976.525077:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450384384 00000100:00100000:3.0:1762166976.525097:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450384512 00000100:00100000:3.0:1762166976.525103:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450384512 00000100:00100000:1.0:1762166976.525127:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18826 00000100:00100000:1.0:1762166976.525142:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+37:2418:x1847765450384256:12345-192.168.204.38@tcp:2:lfs.0 00000100:00100000:3.0:1762166976.525153:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18827 00000100:00100000:3.0:1762166976.525163:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450384384:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:1.0:1762166976.525269:0:9168:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 244188 -> 244188 00002000:00010000:3.0:1762166976.525270:0:35247:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166976.525276:0:9168:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:3.0:1762166976.525277:0:35247:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.525283:0:9168:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166976 -> 1762166976 00002000:00010000:3.0:1762166976.525285:0:35247:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166975 -> 1762166976 00002000:00010000:1.0:1762166976.525288:0:9168:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:3.0:1762166976.525290:0:35247:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.525293:0:9168:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 192 -> 192 00002000:00010000:3.0:1762166976.525295:0:35247:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00000100:00100000:2.0:1762166976.525297:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18828 00000100:00100000:2.0:1762166976.525311:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3e69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+38:2419:x1847765450384512:12345-192.168.204.38@tcp:2:lfs.0 00000100:00100000:1.0:1762166976.525361:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+39:2418:x1847765450384256:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 220us (397us total) trans 17179876255 rc 0/0 00000100:00100000:3.0:1762166976.525362:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450384384:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 195us (344us total) trans 21474843218 rc 0/0 00002000:00010000:2.0:1762166976.525374:0:8383:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166976.525377:0:8383:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:2.0:1762166976.525381:0:8383:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166975 -> 1762166976 00000100:00100000:1.0:1762166976.525382:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18826 00002000:00010000:2.0:1762166976.525384:0:8383:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:2.0:1762166976.525388:0:8383:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166976.525393:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18827 00000100:00100000:2.0:1762166976.525411:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3e69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+38:2419:x1847765450384512:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 103us (354us total) trans 17179876256 rc 0/0 00000100:00100000:2.0:1762166976.525418:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18828 00000100:00100000:3.0:1762166976.526852:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.526893:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450384768 00000100:00100000:1.0:1762166976.526906:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450384768 00000100:00100000:1.0:1762166976.526964:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11808 00000100:00100000:1.0:1762166976.526976:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+552:61840:x1847765450384768:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:1.0:1762166976.527023:0:6497:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x240000404:0x5eb:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbaa0f1 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e98de expref: 552 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.527062:0:6497:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa29000/0x2f180c4effbaa287 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 00010000:00010000:1.0:1762166976.527072:0:6497:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847e000/0x2f180c4effbaa129 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 14 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e98e5 expref: 552 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.527080:0:6497:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa29000/0x2f180c4effbaa287 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166976.527108:0:6497:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847e000/0x2f180c4effbaa129 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 14 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e98e5 expref: 552 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.527117:0:6497:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847e000/0x2f180c4effbaa129 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 14 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e98e5 expref: 552 pid: 6495 timeout: 695 lvb_type: 0 00000100:00100000:1.0:1762166976.527128:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1e6df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6497:1847765449697920:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166976.527209:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc37313c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166976.528198:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1e6df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6497:1847765449697920:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166976.528221:0:6497:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa29000/0x2f180c4effbaa287 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00000100:00100000:3.0:1762166976.528451:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.528625:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450384896 00000100:00100000:1.0:1762166976.528631:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450384896 00010000:00010000:1.0:1762166976.528657:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847e000/0x2f180c4effbaa129 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 14 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e98e5 expref: 553 pid: 6495 timeout: 695 lvb_type: 0 00000100:00100000:1.0:1762166976.528701:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9512 00000100:00100000:1.0:1762166976.528712:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce75f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+553:2418:x1847765450384896:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166976.528725:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166976.528732:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847e000/0x2f180c4effbaa129 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 15 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e98e5 expref: 553 pid: 6495 timeout: 695 lvb_type: 0 00010000:00010000:1.0:1762166976.528744:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847e000/0x2f180c4effbaa129 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 15 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e98e5 expref: 553 pid: 6495 timeout: 695 lvb_type: 0 00010000:00010000:1.0:1762166976.528763:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847e000/0x2f180c4effbaa129 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 15 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e98e5 expref: 553 pid: 6495 timeout: 695 lvb_type: 0 00010000:00010000:1.0:1762166976.528779:0:7421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.528784:0:7421:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa29000/0x2f180c4effbaa287 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166976.528793:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa29000/0x2f180c4effbaa287 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 14 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166976.528802:0:7421:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa29000/0x2f180c4effbaa287 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 14 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166976.528829:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166976.528873:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce75f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+552:2418:x1847765450384896:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 163us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166976.528882:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9512 00010000:00010000:3.0:1762166976.528977:0:6497:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa29000/0x2f180c4effbaa287 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00010000:00010000:3.0:1762166976.528986:0:6497:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa29000/0x2f180c4effbaa287 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00000040:00080000:3.0:1762166976.529317:0:6497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5867, 88 off459192 00000004:00080000:3.0:1762166976.529331:0:6497:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 595677852295ns, next at 595897461133ns, rc = 0 00000040:00080000:3.0:1762166976.529389:0:6497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5866, 88 off459192 00000004:00080000:3.0:1762166976.529397:0:6497:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 595677918920ns, next at 595897495953ns, rc = 0 00000040:00080000:3.0:1762166976.529425:0:6497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5867, 88 off459280 00000004:00080000:3.0:1762166976.529431:0:6497:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 595677953238ns, next at 595897495953ns, rc = 0 00000040:00080000:3.0:1762166976.529449:0:6497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5868, 88 off459280 00000004:00080000:3.0:1762166976.529456:0:6497:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 595677978096ns, next at 595897461133ns, rc = 0 00000040:00080000:3.0:1762166976.529510:0:6497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5868, 88 off459368 00000004:00080000:3.0:1762166976.529516:0:6497:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 595678038056ns, next at 595897495953ns, rc = 0 00000040:00080000:3.0:1762166976.529540:0:6497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5869, 88 off459368 00000004:00080000:3.0:1762166976.529547:0:6497:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 595678068639ns, next at 595897461133ns, rc = 0 00000040:00080000:3.0:1762166976.529569:0:6497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5869, 88 off459456 00000004:00080000:3.0:1762166976.529575:0:6497:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 595678097528ns, next at 595897495953ns, rc = 0 00000040:00080000:3.0:1762166976.529598:0:6497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5870, 88 off459456 00000004:00080000:3.0:1762166976.529606:0:6497:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 595678127813ns, next at 595897461133ns, rc = 0 00000001:00080000:1.0:1762166976.531074:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294991906 is committed 00000004:00080000:1.0:1762166976.531088:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3234 committed 00000004:00080000:1.0:1762166976.531103:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3237 committed 00000004:00080000:1.0:1762166976.531117:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3233 committed 00010000:00010000:3.0:1762166976.531121:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fb600/0x2f180c4effbaa168 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00000004:00080000:1.0:1762166976.531125:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3236 committed 00000004:00080000:1.0:1762166976.531130:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3232 committed 00000004:00080000:1.0:1762166976.531141:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3235 committed 00000004:00080000:1.0:1762166976.531153:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3234 committed 00000004:00080000:1.0:1762166976.531161:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3231 committed 00010000:00010000:3.0:1762166976.531175:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fb600/0x2f180c4effbaa168 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166976.531213:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fb600/0x2f180c4effbaa168 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166976.531223:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcc8fb600 already unused, calling callback (ffffffffc18e2310) 00000020:00080000:1.0:1762166976.531225:0:7412:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0001: 44 batchid updated 00010000:00010000:3.0:1762166976.531230:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fb600/0x2f180c4effbaa168 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166976.531243:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fb600/0x2f180c4effbaa168 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00000020:00080000:1.0:1762166976.531264:0:7435:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 44 00010000:00010000:3.0:1762166976.531269:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166976.531273:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166976.531278:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fb600/0x2f180c4effbaa168 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166976.531285:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fb600/0x2f180c4effbaa168 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166976.531311:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa000/0x2f180c4effbaa184 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166976.531317:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa000/0x2f180c4effbaa184 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166976.531325:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa000/0x2f180c4effbaa184 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166976.531330:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcc8fa000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166976.531336:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa000/0x2f180c4effbaa184 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166976.531345:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa000/0x2f180c4effbaa184 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166976.531359:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166976.531363:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166976.531368:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa000/0x2f180c4effbaa184 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166976.531374:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa000/0x2f180c4effbaa184 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166976.531397:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fac00/0x2f180c4effbaa1bc lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00000020:00080000:1.0:1762166976.531398:0:7435:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 44 cancel update log [0x240000400:0x2:0x0].42: rc = 0 00010000:00010000:3.0:1762166976.531403:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fac00/0x2f180c4effbaa1bc lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166976.531410:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fac00/0x2f180c4effbaa1bc lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166976.531414:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcc8fac00 already unused, calling callback (ffffffffc18e2310) 00000020:00080000:1.0:1762166976.531416:0:7435:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 44 00010000:00010000:3.0:1762166976.531418:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fac00/0x2f180c4effbaa1bc lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166976.531425:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fac00/0x2f180c4effbaa1bc lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166976.531435:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166976.531438:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166976.531442:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fac00/0x2f180c4effbaa1bc lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166976.531449:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fac00/0x2f180c4effbaa1bc lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166976.531471:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa200/0x2f180c4effbaa1d8 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166976.531518:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa200/0x2f180c4effbaa1d8 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166976.531525:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa200/0x2f180c4effbaa1d8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166976.531531:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcc8fa200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166976.531535:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa200/0x2f180c4effbaa1d8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166976.531542:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa200/0x2f180c4effbaa1d8 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166976.531560:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166976.531564:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166976.531568:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa200/0x2f180c4effbaa1d8 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166976.531574:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa200/0x2f180c4effbaa1d8 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166976.531597:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473000/0x2f180c4effbaa209 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166976.531602:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473000/0x2f180c4effbaa209 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166976.531606:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473000/0x2f180c4effbaa209 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166976.531615:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8473000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166976.531618:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473000/0x2f180c4effbaa209 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166976.531628:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473000/0x2f180c4effbaa209 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00000100:00100000:2.0:1762166976.531636:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1e6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449698304:0@lo:2:osp-syn-0-1.0 00010000:00010000:3.0:1762166976.531642:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166976.531648:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166976.531651:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473000/0x2f180c4effbaa209 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00000100:00100000:1.0:1762166976.531654:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1e6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449698048:0@lo:2:osp-syn-0-1.0 00010000:00010000:3.0:1762166976.531663:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473000/0x2f180c4effbaa209 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166976.531679:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbaa225 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166976.531687:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbaa225 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166976.531695:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbaa225 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166976.531701:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa8200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166976.531705:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbaa225 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166976.531712:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbaa225 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00000100:00100000:2.0:1762166976.531719:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166976.531734:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1e6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449698176:0@lo:2:osp-syn-0-1.0 00010000:00010000:3.0:1762166976.531735:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166976.531742:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166976.531747:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbaa225 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166976.531753:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbaa225 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166976.531774:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42d1200/0x2f180c4effbaa256 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00000100:00100000:2.0:1762166976.531775:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1762166976.531791:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1762166976.531795:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42d1200/0x2f180c4effbaa256 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00000100:00100000:2.0:1762166976.531797:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1e6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449698432:0@lo:2:osp-syn-0-1.0 00010000:00010000:3.0:1762166976.531815:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42d1200/0x2f180c4effbaa256 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166976.531826:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc42d1200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166976.531832:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42d1200/0x2f180c4effbaa256 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166976.531839:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42d1200/0x2f180c4effbaa256 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00000100:00100000:2.0:1762166976.531853:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1762166976.531855:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166976.531861:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166976.531867:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42d1200/0x2f180c4effbaa256 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000100:00100000:1.0:1762166976.531867:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449698304 00000100:00100000:1.0:1762166976.531876:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449698304 00010000:00010000:3.0:1762166976.531877:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42d1200/0x2f180c4effbaa256 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166976.531908:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472c00/0x2f180c4effbaa272 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00000100:00100000:2.0:1762166976.531911:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449698176 00000100:00100000:2.0:1762166976.531920:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449698176 00010000:00010000:3.0:1762166976.531921:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472c00/0x2f180c4effbaa272 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166976.531936:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472c00/0x2f180c4effbaa272 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166976.531942:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8472c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166976.531948:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472c00/0x2f180c4effbaa272 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00000100:00100000:1.0:1762166976.531950:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449698432 00000100:00100000:1.0:1762166976.531957:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449698432 00010000:00010000:3.0:1762166976.531958:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472c00/0x2f180c4effbaa272 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166976.531974:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166976.531977:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166976.531982:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472c00/0x2f180c4effbaa272 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00000100:00100000:2.0:1762166976.531983:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18829 00010000:00010000:3.0:1762166976.531995:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472c00/0x2f180c4effbaa272 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00000100:00100000:1.0:1762166976.531997:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18830 00000100:00100000:2.0:1762166976.532009:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+7:3633:x1847765449698304:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1762166976.532025:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+7:3636:x1847765449698176:12345-0@lo:2:osp-syn-0-1.0 00010000:00010000:3.0:1762166976.532036:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbaa280 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166976.532046:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbaa280 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166976.532053:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbaa280 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166976.532059:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdea00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166976.532063:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbaa280 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166976.532070:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbaa280 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166976.532084:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166976.532087:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166976.532091:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbaa280 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166976.532098:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbaa280 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00002000:00010000:2.0:1762166976.532133:0:8383:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb size from disk: 244188 -> 244188 00002000:00010000:2.0:1762166976.532137:0:8383:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:2.0:1762166976.532140:0:8383:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb atime from disk: 1762166973 -> 1762166973 00002000:00010000:2.0:1762166976.532142:0:8383:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:2.0:1762166976.532145:0:8383:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb blocks from disk: 168 -> 168 00002000:00010000:1.0:1762166976.532157:0:8380:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166976.532162:0:8380:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.532166:0:8380:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.532169:0:8380:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.532171:0:8380:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00000100:00100000:2.0:1762166976.532220:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+9:3633:x1847765449698304:12345-0@lo:2:osp-syn-0-1.0 Request processed in 218us (501us total) trans 21474843219 rc 0/0 00000100:00100000:2.0:1762166976.532230:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18829 00000100:00100000:1.0:1762166976.532247:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+8:3636:x1847765449698176:12345-0@lo:2:osp-syn-0-1.0 Request processed in 228us (462us total) trans 21474843220 rc 0/0 00000100:00100000:3.0:1762166976.532253:0:3633:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 21474843201 gen 2 00000100:00100000:1.0:1762166976.532260:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18830 00000004:00080000:3.0:1762166976.532261:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc5bb9180, transno 21474843178 00000100:00100000:2.0:1762166976.532272:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18831 00000004:00080000:3.0:1762166976.532283:0:3633:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 21474843181 committed transno 21474843201 00000100:00100000:2.0:1762166976.532291:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+7:3633:x1847765449698432:12345-0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1762166976.532313:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc5bbaa00, transno 21474843182 00000004:00080000:3.0:1762166976.532319:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc5bb9c00, transno 21474843183 00000004:00080000:3.0:1762166976.532323:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc5bb8380, transno 21474843184 00000004:00080000:3.0:1762166976.532327:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc5bba680, transno 21474843185 00000004:00080000:3.0:1762166976.532330:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc5bb8700, transno 21474843186 00000004:00080000:3.0:1762166976.532335:0:3633:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 21474843193 committed transno 21474843201 00000004:00080000:3.0:1762166976.532353:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf1cd3100, transno 21474843197 00000004:00080000:3.0:1762166976.532361:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf1cd0a80, transno 21474843198 00000004:00080000:3.0:1762166976.532369:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf1cd3480, transno 21474843199 00002000:00010000:2.0:1762166976.532370:0:8383:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb size from disk: 244188 -> 244188 00000004:00080000:3.0:1762166976.532374:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf1cd1180, transno 21474843200 00002000:00010000:2.0:1762166976.532377:0:8383:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00000004:00080000:3.0:1762166976.532384:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf1cd3800, transno 21474843201 00002000:00010000:2.0:1762166976.532384:0:8383:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00002000:00010000:2.0:1762166976.532392:0:8383:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00000100:00100000:1.0:1762166976.532396:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449698944:0@lo:2:osp-syn-1-1.0 00002000:00010000:2.0:1762166976.532399:0:8383:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb blocks from disk: 168 -> 168 00000100:00100000:3.0:1762166976.532400:0:3633:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff945cf1e6e680 x1847765449698304/t21474843219(21474843219) o2->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 440/432 e 0 to 0 dl 1762166992 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1762166976.532424:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf1e6e680/2, rc 0, transno 21474843219 00000100:00100000:3.0:1762166976.532432:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1e6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449698304:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1762166976.532444:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166976.532453:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449698816:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1762166976.532525:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+8:3633:x1847765449698432:12345-0@lo:2:osp-syn-0-1.0 Request processed in 190us (625us total) trans 21474843221 rc 0/0 00000100:00100000:2.0:1762166976.532538:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18831 00000100:00100000:3.0:1762166976.532548:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166976.532557:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449698688:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1762166976.532582:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449698944 00000100:00100000:2.0:1762166976.532589:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449698944 00000004:00080000:3.0:1762166976.532598:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf1e6ea00/2, rc 0, transno 21474843221 00000100:00100000:1.0:1762166976.532602:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166976.532608:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1e6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449698432:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1762166976.532643:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449698816 00000100:00100000:3.0:1762166976.532645:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449698688 00000004:00080000:1.0:1762166976.532649:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf1e6e300/2, rc 0, transno 21474843220 00000100:00100000:2.0:1762166976.532651:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449698816 00000100:00100000:3.0:1762166976.532654:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449698688 00000100:00100000:1.0:1762166976.532660:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1e6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449698176:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1762166976.532673:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1762166976.532681:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1e6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449698560:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1762166976.532698:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18832 00000100:00100000:3.0:1762166976.532711:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18833 00000100:00100000:1.0:1762166976.532721:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166976.532722:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+12:3634:x1847765449698944:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166976.532729:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+12:3633:x1847765449698816:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1762166976.532751:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449698560 00000100:00100000:1.0:1762166976.532756:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449698560 00000100:00100000:1.0:1762166976.532783:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18834 00000100:00100000:1.0:1762166976.532793:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+13:3636:x1847765449698688:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:2.0:1762166976.532822:0:8383:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166976.532827:0:8383:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:2.0:1762166976.532831:0:8383:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00002000:00010000:2.0:1762166976.532833:0:8383:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:2.0:1762166976.532835:0:8383:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:3.0:1762166976.532838:0:28874:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166976.532844:0:28874:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:3.0:1762166976.532847:0:28874:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb atime from disk: 1762166973 -> 1762166973 00002000:00010000:3.0:1762166976.532850:0:28874:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:3.0:1762166976.532854:0:28874:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:1.0:1762166976.532870:0:9165:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166976.532875:0:9165:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.532879:0:9165:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.532882:0:9165:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.532885:0:9165:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1762166976.532893:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+16:3634:x1847765449698944:12345-0@lo:2:osp-syn-1-1.0 Request processed in 182us (446us total) trans 17179876257 rc 0/0 00000100:00100000:2.0:1762166976.532916:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18832 00000100:00100000:3.0:1762166976.532935:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+15:3633:x1847765449698816:12345-0@lo:2:osp-syn-1-1.0 Request processed in 209us (393us total) trans 17179876258 rc 0/0 00000100:00100000:2.0:1762166976.532947:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18835 00000100:00100000:1.0:1762166976.532954:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+15:3636:x1847765449698688:12345-0@lo:2:osp-syn-1-1.0 Request processed in 162us (355us total) trans 17179876259 rc 0/0 00000100:00100000:3.0:1762166976.532957:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18833 00000100:00100000:2.0:1762166976.532967:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+15:3636:x1847765449698560:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1762166976.532973:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18834 00000004:00080000:1.0:1762166976.533022:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf79e9880/2, rc 0, transno 17179876259 00000100:00100000:1.0:1762166976.533029:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449698688:0@lo:2:osp-syn-1-1.0 00002000:00010000:2.0:1762166976.533057:0:8383:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 244188 -> 244188 00002000:00010000:2.0:1762166976.533063:0:8383:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:2.0:1762166976.533066:0:8383:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166976 -> 1762166976 00002000:00010000:2.0:1762166976.533068:0:8383:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:2.0:1762166976.533071:0:8383:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 192 -> 192 00000004:00010000:1.0:1762166976.533094:0:6497:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000000b6971a2 reply state 000000009fcfc84f transno 4294991906 ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa29000/0x2f180c4effbaa287 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00000004:00080000:3.0:1762166976.533109:0:9158:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0001: 0 changes, 4 in progress, 1 in flight, 11 done 00010000:00010000:1.0:1762166976.533113:0:6497:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa29000/0x2f180c4effbaa287 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT1 00000100:00100000:2.0:1762166976.533124:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+14:3636:x1847765449698560:12345-0@lo:2:osp-syn-1-1.0 Request processed in 161us (410us total) trans 17179876260 rc 0/0 00010000:00010000:1.0:1762166976.533128:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.533137:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000004:00080000:3.0:1762166976.533144:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf79ea300/2, rc 0, transno 17179876258 00000100:00100000:2.0:1762166976.533144:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18835 00000100:00100000:1.0:1762166976.533146:0:6497:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166976.533161:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449698816:0@lo:2:osp-syn-1-1.0 00010000:00010000:1.0:1762166976.533162:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.533170:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762166976.533178:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbaa0f1 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e98de expref: 525 pid: 6494 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166976.533226:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166976.533268:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449698048 00000100:00100000:3.0:1762166976.533273:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449698048 00010000:00080000:1.0:1762166976.533279:0:6497:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1762166976.533296:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+525:61840:x1847765450384768:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 6323us (6447us total) trans 4294991906 rc 0/0 00000100:00100000:1.0:1762166976.533305:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11808 00000100:00100000:3.0:1762166976.533322:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18836 00010000:00010000:1.0:1762166976.533329:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa29000/0x2f180c4effbaa287 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT1 00000100:00100000:3.0:1762166976.533335:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+8:3635:x1847765449698048:12345-0@lo:2:osp-syn-0-1.0 00010000:00010000:1.0:1762166976.533337:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa29000/0x2f180c4effbaa287 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT1 00000004:00080000:2.0:1762166976.533342:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf79eaa00/2, rc 0, transno 17179876257 00010000:00010000:1.0:1762166976.533350:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa29000/0x2f180c4effbaa287 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166976.533359:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcaa29000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166976.533362:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa29000/0x2f180c4effbaa287 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT1 00000100:00100000:2.0:1762166976.533364:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449698944:0@lo:2:osp-syn-1-1.0 00010000:00010000:1.0:1762166976.533368:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa29000/0x2f180c4effbaa287 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166976.533380:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.533382:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166976.533384:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa29000/0x2f180c4effbaa287 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166976.533388:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa29000/0x2f180c4effbaa287 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT1 00002000:00010000:3.0:1762166976.533421:0:8382:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166976.533425:0:8382:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb mtime from disk: 1762166966 -> 1762166966 00002000:00010000:3.0:1762166976.533428:0:8382:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1762166976.533430:0:8382:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb ctime from disk: 1762166966 -> 1762166966 00000004:00080000:2.0:1762166976.533430:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf1e6df80/2, rc 0, transno 17179876260 00002000:00010000:3.0:1762166976.533433:0:8382:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1762166976.533443:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1e6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449698560:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166976.533508:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+9:3635:x1847765449698048:12345-0@lo:2:osp-syn-0-1.0 Request processed in 176us (280us total) trans 21474843222 rc 0/0 00000100:00100000:3.0:1762166976.533513:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18836 00000004:00080000:2.0:1762166976.533702:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf1e6fb80/2, rc 0, transno 21474843222 00000100:00100000:2.0:1762166976.533713:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1e6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449698048:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166976.534703:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.534768:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450385024 00000100:00100000:1.0:1762166976.534776:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450385024 00000100:00100000:1.0:1762166976.534821:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30317 00000100:00100000:1.0:1762166976.534832:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+524:61840:x1847765450385024:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166976.534849:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166976.534866:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8200/0x2f180c4effbaa28e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9978 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.534937:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8200/0x2f180c4effbaa28e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9978 expref: 525 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.534952:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8200/0x2f180c4effbaa28e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9978 expref: 525 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.534969:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.534972:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166976.534976:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc5db8200, rc 0) 00000100:00100000:1.0:1762166976.535022:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+525:61840:x1847765450385024:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 193us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166976.535036:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30317 00000100:00100000:1.0:1762166976.536344:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166976.536406:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450385280 00000100:00100000:3.0:1762166976.536413:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450385280 00000100:00100000:3.0:1762166976.536503:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11809 00000100:00100000:3.0:1762166976.536521:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+525:61840:x1847765450385280:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:3.0:1762166976.536756:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+526:61840:x1847765450385280:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 241us (419us total) trans 4294991907 rc 0/0 00000100:00100000:3.0:1762166976.536766:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11809 00000100:00100000:3.0:1762166976.545274:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.545337:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450385408 00000100:00100000:1.0:1762166976.545349:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450385408 00000100:00100000:1.0:1762166976.545416:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30318 00000100:00100000:1.0:1762166976.545429:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+526:61841:x1847765450385408:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166976.545454:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166976.545510:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9a00/0x2f180c4effbaa295 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e997f expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.545586:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbaa29c lrc: 3/1,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166976.545600:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbaa29c lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.545611:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbaa29c lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.545628:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8400/0x2f180c4effbaa2a3 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166976.545635:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8400/0x2f180c4effbaa2a3 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.545642:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8400/0x2f180c4effbaa2a3 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.545718:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbaa2aa lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166976.545727:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbaa2aa lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.545734:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbaa2aa lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:1.0:1762166976.545771:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 244188 00000004:00200000:1.0:1762166976.545775:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166976.545793:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbaa2aa lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.545802:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbaa2aa lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.545812:0:6494:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbaa29c lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.545819:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbaa29c lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.545824:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbaa29c lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.545830:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbaa29c lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.545836:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc5db9c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166976.545840:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbaa29c lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.545847:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbaa29c lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.545859:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0x0 (ffff945cc7f4cc00) 00010000:00010000:1.0:1762166976.545862:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166976.545867:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbaa29c lrc: 3/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.545873:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbaa29c lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.545887:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8400/0x2f180c4effbaa2a3 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.545893:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8400/0x2f180c4effbaa2a3 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.545909:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8400/0x2f180c4effbaa2a3 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.545913:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc5db8400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166976.545915:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8400/0x2f180c4effbaa2a3 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.545921:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8400/0x2f180c4effbaa2a3 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.545930:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0xdd396665 (ffff945cc7f4c000) 00010000:00010000:1.0:1762166976.545933:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166976.545937:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8400/0x2f180c4effbaa2a3 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.545943:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8400/0x2f180c4effbaa2a3 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.545977:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9a00/0x2f180c4effbaa295 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e997f expref: 528 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.545993:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbaa2aa lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e997f expref: 527 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.546006:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.546009:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166976.546011:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc5db8e00, rc 0) 00000100:00100000:1.0:1762166976.546074:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+527:61841:x1847765450385408:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 646us (805us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166976.546089:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30318 00000100:00100000:1.0:1762166976.547682:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166976.547741:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450385664 00000100:00100000:0.0:1762166976.547753:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450385664 00000100:00100000:0.0:1762166976.547798:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30319 00000100:00100000:0.0:1762166976.547809:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+527:61841:x1847765450385664:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166976.547823:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166976.547835:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbaa2b1 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9986 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.547920:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbaa2b8 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166976.547933:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbaa2b8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166976.547943:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbaa2b8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:0.0:1762166976.547951:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 244188 00010000:00010000:0.0:1762166976.548066:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbaa2b1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9986 expref: 530 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.548084:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbaa2b8 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9986 expref: 529 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.548092:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166976.548094:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1762166976.548098:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdfe00, rc 0) 00000100:00100000:0.0:1762166976.548149:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+529:61841:x1847765450385664:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 340us (468us total) trans 4294991908 rc 0/0 00000100:00100000:0.0:1762166976.548163:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30319 00000100:00100000:1.0:1762166976.549340:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166976.549386:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450385920 00000100:00100000:0.0:1762166976.549393:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450385920 00000100:00100000:0.0:1762166976.549439:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30320 00000100:00100000:0.0:1762166976.549456:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+529:61841:x1847765450385920:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166976.549503:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166976.549517:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbaa2c6 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e998d expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.549573:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbaa2cd lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166976.549584:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbaa2cd lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166976.549594:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbaa2cd lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:0.0:1762166976.549603:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 244188 00010000:00010000:0.0:1762166976.549673:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbaa2c6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e998d expref: 532 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.549690:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbaa2cd lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e998d expref: 531 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.549699:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166976.549702:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166976.549705:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdf200, rc 0) 00000100:00100000:0.0:1762166976.549748:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+531:61841:x1847765450385920:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 297us (412us total) trans 4294991909 rc 0/0 00000100:00100000:0.0:1762166976.549757:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30320 00000100:00100000:0.0:1762166976.572535:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166976.572593:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450386048 00000100:00100000:2.0:1762166976.572604:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450386048 00000100:00100000:2.0:1762166976.572677:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2094 00000100:00100000:2.0:1762166976.572691:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4013100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+38:2418:x1847765450386048:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:2.0:1762166976.572725:0:23940:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbaa2db lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.572740:0:23940:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166976.572742:0:23940:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166976.572748:0:23940:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbaa2db lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->245759] (req 0->245759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.572762:0:23940:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbaa2db lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->245759] (req 0->245759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.574326:0:23940:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbaa2db lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->245759] (req 0->245759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.574340:0:23940:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbaa2db lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->245759] (req 0->245759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.574349:0:23940:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbaa2db lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->245759] (req 0->245759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.574355:0:23940:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa8800 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166976.574359:0:23940:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbaa2db lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->245759] (req 0->245759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.574368:0:23940:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbaa2db lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->245759] (req 0->245759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.574403:0:23940:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbaa2db lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->245759] (req 0->245759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.574413:0:23940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbaa2db lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->245759] (req 0->245759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166976.574469:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4013100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+38:2418:x1847765450386048:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 1781us (1942us total) trans 0 rc 244188/244188 00000100:00100000:2.0:1762166976.574639:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2094 00000100:00100000:0.0:1762166976.576707:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166976.576753:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450386176 00000100:00100000:2.0:1762166976.576760:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450386176 00000100:00100000:2.0:1762166976.576825:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2095 00000100:00100000:2.0:1762166976.576842:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4013480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450386176:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:2.0:1762166976.576884:0:23940:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8000/0x2f180c4effbaa2e2 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.576917:0:23940:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9800/0x2f180c4effbaa25d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9963 expref: 19 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.576926:0:23940:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166976.576930:0:23940:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166976.576934:0:23940:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8000/0x2f180c4effbaa2e2 lrc: 4/1,0 mode: --/PR res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->245759] (req 0->245759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.576977:0:23940:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9800/0x2f180c4effbaa25d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9963 expref: 19 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.577003:0:23940:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9800/0x2f180c4effbaa25d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9963 expref: 19 pid: 9168 timeout: 695 lvb_type: 0 00000100:00100000:2.0:1762166976.577023:0:23940:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda2ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_007:lustre-OST0000_UUID:23940:1847765449699072:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166976.577149:0:23940:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1dcef00 going to sleep for 11 seconds 00000100:00100000:2.0:1762166976.578102:0:23940:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda2ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_007:lustre-OST0000_UUID:23940:1847765449699072:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166976.578125:0:23940:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8000/0x2f180c4effbaa2e2 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->245759] (req 0->245759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166976.578226:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166976.578276:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450386304 00000100:00100000:2.0:1762166976.578283:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450386304 00010000:00010000:2.0:1762166976.578305:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9800/0x2f180c4effbaa25d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9963 expref: 20 pid: 9168 timeout: 695 lvb_type: 0 00000100:00100000:2.0:1762166976.578331:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9513 00000100:00100000:2.0:1762166976.578340:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4012680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450386304:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166976.578354:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166976.578383:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9800/0x2f180c4effbaa25d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9963 expref: 20 pid: 9168 timeout: 695 lvb_type: 0 00010000:00010000:2.0:1762166976.578396:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9800/0x2f180c4effbaa25d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9963 expref: 20 pid: 9168 timeout: 695 lvb_type: 0 00010000:00010000:2.0:1762166976.578417:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9800/0x2f180c4effbaa25d lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9963 expref: 20 pid: 9168 timeout: 695 lvb_type: 0 00010000:00010000:2.0:1762166976.578431:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166976.578433:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166976.578437:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8000/0x2f180c4effbaa2e2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->245759] (req 0->245759) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.578446:0:7421:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8000/0x2f180c4effbaa2e2 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->245759] (req 0->245759) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.578558:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166976.578573:0:23940:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8000/0x2f180c4effbaa2e2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->245759] (req 0->245759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.578601:0:23940:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8000/0x2f180c4effbaa2e2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->245759] (req 0->245759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166976.578617:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4012680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450386304:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 276us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166976.578627:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9513 00010000:00010000:1.0:1762166976.580936:0:23940:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8000/0x2f180c4effbaa2e2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->245759] (req 0->245759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.580951:0:23940:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8000/0x2f180c4effbaa2e2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->245759] (req 0->245759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.580960:0:23940:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8000/0x2f180c4effbaa2e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->245759] (req 0->245759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.580968:0:23940:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa8000 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166976.580974:0:23940:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8000/0x2f180c4effbaa2e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->245759] (req 0->245759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.580984:0:23940:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8000/0x2f180c4effbaa2e2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->245759] (req 0->245759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.581004:0:23940:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8000/0x2f180c4effbaa2e2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->245759] (req 0->245759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.581012:0:23940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8000/0x2f180c4effbaa2e2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->245759] (req 0->245759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166976.581094:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4013480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450386176:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 4256us (4386us total) trans 0 rc 244188/244188 00000100:00100000:1.0:1762166976.581105:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2095 00000100:00100000:0.0:1762166976.583185:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.583236:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450386432 00000100:00100000:1.0:1762166976.583245:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450386432 00000100:00100000:1.0:1762166976.583308:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2096 00000100:00100000:1.0:1762166976.583320:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4010000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+18:2417:x1847765450386432:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:1.0:1762166976.583351:0:23940:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc5db9a00/0x2f180c4effbaa2e9 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.583366:0:23940:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29a00/0x2f180c4effbaa279 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9971 expref: 18 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.583376:0:23940:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166976.583378:0:23940:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166976.583382:0:23940:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc5db9a00/0x2f180c4effbaa2e9 lrc: 4/1,0 mode: --/PR res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->245759] (req 0->245759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.583416:0:23940:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29a00/0x2f180c4effbaa279 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9971 expref: 18 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.583432:0:23940:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29a00/0x2f180c4effbaa279 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9971 expref: 18 pid: 9168 timeout: 695 lvb_type: 0 00000100:00100000:1.0:1762166976.583447:0:23940:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406f800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_007:lustre-OST0000_UUID:23940:1847765449699200:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166976.583540:0:23940:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc3731a80 going to sleep for 11 seconds 00000100:00100000:1.0:1762166976.584638:0:23940:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406f800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_007:lustre-OST0000_UUID:23940:1847765449699200:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166976.584658:0:23940:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bc5db9a00/0x2f180c4effbaa2e9 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->245759] (req 0->245759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166976.584727:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.584770:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450386560 00000100:00100000:1.0:1762166976.584775:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450386560 00010000:00010000:1.0:1762166976.584798:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29a00/0x2f180c4effbaa279 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9971 expref: 19 pid: 9168 timeout: 695 lvb_type: 0 00000100:00100000:1.0:1762166976.584843:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9514 00000100:00100000:1.0:1762166976.584853:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf9d1e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450386560:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166976.584865:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166976.584883:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29a00/0x2f180c4effbaa279 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9971 expref: 19 pid: 9168 timeout: 695 lvb_type: 0 00010000:00010000:1.0:1762166976.584909:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29a00/0x2f180c4effbaa279 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9971 expref: 19 pid: 9168 timeout: 695 lvb_type: 0 00010000:00010000:1.0:1762166976.584928:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29a00/0x2f180c4effbaa279 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9971 expref: 19 pid: 9168 timeout: 695 lvb_type: 0 00010000:00010000:1.0:1762166976.584939:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166976.584941:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166976.584945:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc5db9a00/0x2f180c4effbaa2e9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->245759] (req 0->245759) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.584954:0:7421:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc5db9a00/0x2f180c4effbaa2e9 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->245759] (req 0->245759) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.584979:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166976.585004:0:23940:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bc5db9a00/0x2f180c4effbaa2e9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->245759] (req 0->245759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.585012:0:23940:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc5db9a00/0x2f180c4effbaa2e9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->245759] (req 0->245759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166976.585017:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf9d1e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450386560:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 164us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166976.585039:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9514 00010000:00010000:1.0:1762166976.586654:0:23940:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc5db9a00/0x2f180c4effbaa2e9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->245759] (req 0->245759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.586673:0:23940:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc5db9a00/0x2f180c4effbaa2e9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->245759] (req 0->245759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.586683:0:23940:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc5db9a00/0x2f180c4effbaa2e9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->245759] (req 0->245759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.586690:0:23940:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc5db9a00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166976.586695:0:23940:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc5db9a00/0x2f180c4effbaa2e9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->245759] (req 0->245759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.586704:0:23940:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc5db9a00/0x2f180c4effbaa2e9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->245759] (req 0->245759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.586719:0:23940:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc5db9a00/0x2f180c4effbaa2e9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->245759] (req 0->245759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.586726:0:23940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc5db9a00/0x2f180c4effbaa2e9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->245759] (req 0->245759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166976.586785:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4010000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+17:2417:x1847765450386432:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 3466us (3600us total) trans 0 rc 244188/244188 00000100:00100000:1.0:1762166976.586794:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2096 00000100:00100000:1.0:1762166976.593978:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.594019:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450386688 00000100:00100000:1.0:1762166976.594029:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450386688 00000100:00100000:0.0:1762166976.594106:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 863 00000100:00100000:0.0:1762166976.594119:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+531:61841:x1847765450386688:12345-192.168.204.38@tcp:103:lfs.0 00010000:00010000:0.0:1762166976.594135:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166976.594162:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbaa2cd lrc: 0/0,0 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e998d expref: 531 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.594181:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166976.594186:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166976.594243:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+530:61841:x1847765450386688:12345-192.168.204.38@tcp:103:lfs.0 Request processed in 127us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166976.594252:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 863 00000100:00100000:1.0:1762166976.595075:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166976.595109:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450386944 00000100:00100000:3.0:1762166976.595115:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450386944 00000100:00100000:3.0:1762166976.595155:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11810 00000100:00100000:3.0:1762166976.595164:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7d2b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+530:61841:x1847765450386944:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:3.0:1762166976.595375:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7d2b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+531:61841:x1847765450386944:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 212us (302us total) trans 4294991910 rc 0/0 00000100:00100000:3.0:1762166976.595385:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11810 00000100:00100000:0.0:1762166976.597314:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166976.597337:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450387200 00000100:00100000:0.0:1762166976.597344:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450387200 00000100:00100000:0.0:1762166976.597391:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30321 00000100:00100000:0.0:1762166976.597401:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4010a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+531:61766:x1847765450387200:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:0.0:1762166976.597417:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166976.597432:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbaa2f0 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9994 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.597526:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbaa2f7 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166976.597539:0:6494:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbaa2aa lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e997f expref: 532 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.597553:0:6494:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbaa2f7 lrc: 4/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166976.597601:0:6494:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbaa2aa lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e997f expref: 532 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.597615:0:6494:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbaa2aa lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e997f expref: 532 pid: 6494 timeout: 695 lvb_type: 0 00000100:00100000:0.0:1762166976.597629:0:6494:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4012300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765449699328:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166976.597698:0:6494:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc10c1e40 going to sleep for 11 seconds 00000100:00100000:0.0:1762166976.598520:0:6494:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4012300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765449699328:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166976.598547:0:6494:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbaa2f7 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000100:00100000:0.0:1762166976.598734:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166976.598759:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450387328 00000100:00100000:0.0:1762166976.598764:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450387328 00010000:00010000:0.0:1762166976.598787:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbaa2aa lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e997f expref: 533 pid: 6494 timeout: 695 lvb_type: 0 00000100:00100000:0.0:1762166976.598816:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9515 00000100:00100000:0.0:1762166976.598825:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4012300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+533:2419:x1847765450387328:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166976.598834:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166976.598841:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbaa2aa lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e997f expref: 533 pid: 6494 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166976.598858:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbaa2aa lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e997f expref: 533 pid: 6494 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166976.598877:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbaa2aa lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e997f expref: 533 pid: 6494 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166976.598890:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166976.598907:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbaa2f7 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166976.598924:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbaa2f7 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166976.598930:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbaa2f7 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166976.598948:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166976.598983:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4012300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+532:2419:x1847765450387328:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 160us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166976.598991:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9515 00010000:00010000:0.0:1762166976.599081:0:6494:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbaa2f7 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166976.599088:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbaa2f7 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:0.0:1762166976.599104:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 244188 00010000:00010000:0.0:1762166976.599209:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbaa2f0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9994 expref: 533 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.599229:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbaa2f7 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9994 expref: 532 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.599237:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166976.599241:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1762166976.599244:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdf800, rc 0) 00000100:00100000:0.0:1762166976.599275:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4010a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+532:61766:x1847765450387200:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 1876us (1964us total) trans 4294991911 rc 0/0 00000100:00100000:0.0:1762166976.599282:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30321 00000100:00100000:0.0:1762166976.600157:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166976.600180:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450387456 00000100:00100000:0.0:1762166976.600185:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450387456 00000100:00100000:0.0:1762166976.600214:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30322 00000100:00100000:0.0:1762166976.600222:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4013800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+532:61766:x1847765450387456:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:0.0:1762166976.600238:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166976.600251:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbaa305 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e999b expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.600333:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbaa30c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166976.600345:0:6494:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbaa2f7 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9994 expref: 533 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.600353:0:6494:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbaa30c lrc: 4/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166976.600382:0:6494:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbaa2f7 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9994 expref: 533 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.600405:0:6494:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbaa2f7 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9994 expref: 533 pid: 6494 timeout: 695 lvb_type: 0 00000100:00100000:0.0:1762166976.600421:0:6494:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4012680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765449699456:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166976.600473:0:6494:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc10c1540 going to sleep for 11 seconds 00000100:00100000:0.0:1762166976.601181:0:6494:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4012680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765449699456:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166976.601196:0:6494:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbaa30c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000100:00100000:0.0:1762166976.601369:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166976.601392:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450387584 00000100:00100000:0.0:1762166976.601396:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450387584 00010000:00010000:0.0:1762166976.601415:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbaa2f7 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9994 expref: 534 pid: 6494 timeout: 695 lvb_type: 0 00000100:00100000:0.0:1762166976.601438:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9516 00000100:00100000:0.0:1762166976.601445:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4012680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+534:2418:x1847765450387584:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166976.601455:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166976.601460:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbaa2f7 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9994 expref: 534 pid: 6494 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166976.601471:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbaa2f7 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9994 expref: 534 pid: 6494 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166976.601516:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbaa2f7 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9994 expref: 534 pid: 6494 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166976.601536:0:7421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166976.601541:0:7421:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbaa30c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166976.601550:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbaa30c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166976.601556:0:7421:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbaa30c lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166976.601578:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166976.601608:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4012680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+533:2418:x1847765450387584:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 164us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166976.601616:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9516 00010000:00010000:0.0:1762166976.601690:0:6494:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbaa30c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166976.601697:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbaa30c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:0.0:1762166976.601730:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 244188 00000004:00200000:0.0:1762166976.601735:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166976.601752:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbaa30c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166976.601776:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbaa305 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e999b expref: 533 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.601789:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbaa30c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e999b expref: 532 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.601802:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166976.601805:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166976.601808:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdf600, rc 0) 00000100:00100000:0.0:1762166976.601837:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4013800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+532:61766:x1847765450387456:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 1616us (1682us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166976.601844:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30322 00000100:00100000:0.0:1762166976.603568:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166976.603603:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450387712 00000100:00100000:0.0:1762166976.603610:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450387712 00002000:00100000:0.0:1762166976.603647:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (143360->212991) req@ffff945bc4012a00 x1847765450387712/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:7/0 lens 488/0 e 0 to 0 dl 1762166987 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166976.603659:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4012a00 with x1847765450387712 ext(143360->212991) 00002000:00010000:0.0:1762166976.603664:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4012a00 00000100:00100000:0.0:1762166976.603692:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2097 00000100:00100000:0.0:1762166976.603702:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4012a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+38:2417:x1847765450387712:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:1.0:1762166976.604745:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4012a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+38:2417:x1847765450387712:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 1044us (1179us total) trans 0 rc 69632/69632 00000100:00100000:1.0:1762166976.604752:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2097 00002000:00100000:1.0:1762166976.604759:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (143360->212991) req@ffff945bc4012a00 x1847765450387712/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:7/0 lens 488/440 e 0 to 0 dl 1762166987 ref 1 fl Complete:/600/0 rc 69632/69632 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166976.604765:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4012a00 with x1847765450387712 ext(143360->212991) 00002000:00010000:1.0:1762166976.604769:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4012a00 00000100:00100000:0.0:1762166976.606189:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.606242:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450387968 00000100:00100000:1.0:1762166976.606249:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450387968 00000100:00100000:1.0:1762166976.606288:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11811 00000100:00100000:1.0:1762166976.606295:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+532:61766:x1847765450387968:12345-192.168.204.38@tcp:35:fsx.0 00000100:00100000:1.0:1762166976.606516:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+533:61766:x1847765450387968:12345-192.168.204.38@tcp:35:fsx.0 Request processed in 219us (325us total) trans 4294991912 rc 0/0 00000100:00100000:1.0:1762166976.606526:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11811 00000100:00100000:0.0:1762166976.607335:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.607392:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450388224 00000100:00100000:1.0:1762166976.607396:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450388224 00000100:00100000:1.0:1762166976.607438:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30323 00000100:00100000:1.0:1762166976.607448:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+533:61766:x1847765450388224:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:1.0:1762166976.607465:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166976.607468:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 1 00010000:00010000:1.0:1762166976.607526:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbaa2b8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9986 expref: 533 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.607552:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8200/0x2f180c4effbaa28e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9978 expref: 532 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.607571:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbaa30c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e999b expref: 531 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.607586:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.607591:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166976.607605:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42f6200/0x2f180c4effbaa313 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e99a2 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.607649:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945d02174400/0x2f180c4effbaa31a lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166976.607663:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945d02174400/0x2f180c4effbaa31a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.607679:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945d02174400/0x2f180c4effbaa31a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000040:00080000:1.0:1762166976.607881:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5871, 88 off459544 00000004:00080000:1.0:1762166976.607889:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 595756411219ns, next at 595897461133ns, rc = 0 00000040:00080000:1.0:1762166976.607952:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5870, 88 off459544 00000004:00080000:1.0:1762166976.607960:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 595756481696ns, next at 595897495953ns, rc = 0 00000040:00080000:1.0:1762166976.607988:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5871, 88 off459632 00000004:00080000:1.0:1762166976.607993:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 595756515117ns, next at 595897495953ns, rc = 0 00000040:00080000:1.0:1762166976.608002:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5872, 88 off459632 00000004:00080000:1.0:1762166976.608006:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 595756528232ns, next at 595897461133ns, rc = 0 00000040:00080000:1.0:1762166976.608024:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5872, 88 off459720 00000004:00080000:1.0:1762166976.608028:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 595756550657ns, next at 595897495953ns, rc = 0 00000040:00080000:1.0:1762166976.608038:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5873, 88 off459720 00000004:00080000:1.0:1762166976.608041:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 595756563577ns, next at 595897461133ns, rc = 0 00000040:00080000:1.0:1762166976.608053:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5873, 88 off459808 00000004:00080000:1.0:1762166976.608058:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 595756580233ns, next at 595897495953ns, rc = 0 00000040:00080000:1.0:1762166976.608073:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5874, 88 off459808 00000004:00080000:1.0:1762166976.608077:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 595756599529ns, next at 595897461133ns, rc = 0 00000001:00080000:3.0:1762166976.609271:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294991913 is committed 00000004:00080000:3.0:1762166976.609279:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3238 committed 00000004:00080000:3.0:1762166976.609292:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3241 committed 00000004:00080000:3.0:1762166976.609302:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3237 committed 00000004:00080000:3.0:1762166976.609305:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3240 committed 00000004:00080000:3.0:1762166976.609307:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3236 committed 00000004:00080000:3.0:1762166976.609310:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3239 committed 00000004:00080000:3.0:1762166976.609312:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3238 committed 00000004:00080000:3.0:1762166976.609315:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3235 committed 00000100:00100000:3.0:1762166976.609371:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf3db5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449699584:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1762166976.609418:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7b20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449699712:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166976.609432:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166976.609459:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166976.609474:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5588380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449700096:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1762166976.609505:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7b22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449699840:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166976.609522:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166976.609549:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc558a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449700224:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1762166976.609554:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166976.609581:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449699584 00000100:00100000:3.0:1762166976.609587:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449699584 00000100:00100000:1.0:1762166976.609595:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5589f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449699968:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1762166976.609624:0:35248:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449699712 00000100:00100000:3.0:1762166976.609625:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449700096 00000100:00100000:3.0:1762166976.609629:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449700096 00000100:00100000:2.0:1762166976.609632:0:35248:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449699712 00000100:00100000:0.0:1762166976.609653:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7b20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449700352:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166976.609656:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449699840 00000100:00100000:1.0:1762166976.609661:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166976.609662:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449699840 00000100:00100000:2.0:1762166976.609673:0:35248:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449699968 00000100:00100000:2.0:1762166976.609678:0:35248:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449699968 00000100:00100000:1.0:1762166976.609690:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7b21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449700480:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1762166976.609693:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166976.609696:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18837 00000100:00100000:3.0:1762166976.609711:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+16:3635:x1847765449699584:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1762166976.609714:0:35248:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449700352 00000100:00100000:2.0:1762166976.609719:0:35248:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449700352 00000100:00100000:1.0:1762166976.609729:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166976.609744:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449700480 00000100:00100000:0.0:1762166976.609750:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449700480 00000100:00100000:2.0:1762166976.609751:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18838 00000100:00100000:2.0:1762166976.609764:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+16:3635:x1847765449700096:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1762166976.609769:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18839 00000100:00100000:1.0:1762166976.609780:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5589180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+12:3636:x1847765449699712:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1762166976.609790:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18840 00000100:00100000:0.0:1762166976.609800:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+12:3633:x1847765449699840:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:3.0:1762166976.609827:0:8382:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 244188 -> 244188 00002000:00010000:3.0:1762166976.609831:0:8382:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:3.0:1762166976.609834:0:8382:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166976 -> 1762166976 00002000:00010000:3.0:1762166976.609838:0:8382:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:3.0:1762166976.609841:0:8382:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 192 -> 192 00002000:00010000:2.0:1762166976.609842:0:35248:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166976.609846:0:35248:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:2.0:1762166976.609849:0:35248:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb atime from disk: 1762166973 -> 1762166973 00002000:00010000:2.0:1762166976.609851:0:35248:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:2.0:1762166976.609854:0:35248:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:1.0:1762166976.609866:0:28434:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166976.609870:0:28434:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb mtime from disk: 1762166966 -> 1762166966 00002000:00010000:1.0:1762166976.609873:0:28434:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1762166976.609876:0:28434:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb ctime from disk: 1762166966 -> 1762166966 00002000:00010000:1.0:1762166976.609878:0:28434:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:0.0:1762166976.609882:0:28874:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:3.0:1762166976.609887:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+18:3635:x1847765449699584:12345-0@lo:2:osp-syn-1-1.0 Request processed in 178us (453us total) trans 17179876261 rc 0/0 00002000:00010000:0.0:1762166976.609888:0:28874:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:0.0:1762166976.609904:0:28874:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166976 -> 1762166976 00002000:00010000:0.0:1762166976.609907:0:28874:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00000100:00100000:2.0:1762166976.609910:0:35248:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+18:3635:x1847765449700096:12345-0@lo:2:osp-syn-1-1.0 Request processed in 134us (372us total) trans 17179876262 rc 0/0 00002000:00010000:0.0:1762166976.609913:0:28874:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00000100:00100000:3.0:1762166976.609918:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18837 00000100:00100000:2.0:1762166976.609931:0:35248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18838 00000100:00100000:1.0:1762166976.609936:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5589180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+14:3636:x1847765449699712:12345-0@lo:2:osp-syn-0-1.0 Request processed in 155us (476us total) trans 21474843223 rc 0/0 00000100:00100000:3.0:1762166976.609944:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18841 00000100:00100000:1.0:1762166976.609951:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18839 00000100:00100000:3.0:1762166976.609956:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5589c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+16:3634:x1847765449699968:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1762166976.609962:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+14:3633:x1847765449699840:12345-0@lo:2:osp-syn-0-1.0 Request processed in 161us (411us total) trans 21474843224 rc 0/0 00000100:00100000:2.0:1762166976.609964:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18842 00000100:00100000:1.0:1762166976.609973:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18843 00000100:00100000:2.0:1762166976.609978:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+13:3633:x1847765449700352:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1762166976.609983:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18840 00000100:00100000:1.0:1762166976.609987:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5588e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+13:3634:x1847765449700480:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:3.0:1762166976.610018:0:8382:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166976.610021:0:8382:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:3.0:1762166976.610024:0:8382:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166976 -> 1762166976 00002000:00010000:3.0:1762166976.610028:0:8382:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00000004:00080000:0.0:1762166976.610028:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc7b22300/2, rc 0, transno 21474843224 00002000:00010000:3.0:1762166976.610035:0:8382:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1762166976.610039:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7b22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449699840:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166976.610087:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5589c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+17:3634:x1847765449699968:12345-0@lo:2:osp-syn-1-1.0 Request processed in 136us (429us total) trans 17179876263 rc 0/0 00000100:00100000:2.0:1762166976.610092:0:35248:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+14:3633:x1847765449700352:12345-0@lo:2:osp-syn-0-1.0 Request processed in 116us (400us total) trans 21474843225 rc 0/0 00000100:00100000:1.0:1762166976.610097:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5588e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+14:3634:x1847765449700480:12345-0@lo:2:osp-syn-0-1.0 Request processed in 112us (366us total) trans 21474843226 rc 0/0 00000100:00100000:3.0:1762166976.610101:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18841 00000100:00100000:2.0:1762166976.610110:0:35248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18842 00000004:00080000:0.0:1762166976.610112:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc5589f80/2, rc 0, transno 17179876263 00000100:00100000:0.0:1762166976.610119:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5589f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449699968:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1762166976.610125:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18843 00000004:00080000:0.0:1762166976.610139:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc7b21880/2, rc 0, transno 21474843226 00000100:00100000:0.0:1762166976.610146:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7b21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449700480:0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1762166976.610150:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc5588380/2, rc 0, transno 17179876262 00000100:00100000:3.0:1762166976.610157:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5588380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449700096:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1762166976.610170:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf3db5c00/2, rc 0, transno 17179876261 00000100:00100000:3.0:1762166976.610174:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3db5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449699584:0@lo:2:osp-syn-1-1.0 00000004:00080000:0.0:1762166976.610178:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc7b20a80/2, rc 0, transno 21474843225 00000100:00100000:1.0:1762166976.610182:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166976.610186:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7b20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449700352:0@lo:2:osp-syn-0-1.0 00000004:00080000:1.0:1762166976.610221:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc7b20e00/2, rc 0, transno 21474843223 00000100:00100000:2.0:1762166976.610225:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449700224 00000100:00100000:1.0:1762166976.610228:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7b20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449699712:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1762166976.610231:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449700224 00000100:00100000:2.0:1762166976.610266:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18844 00000100:00100000:2.0:1762166976.610274:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+17:3636:x1847765449700224:12345-0@lo:2:osp-syn-1-1.0 00010000:00010000:1.0:1762166976.610282:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945d02174400/0x2f180c4effbaa31a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99a2 expref: 526 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.610294:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.610297:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1762166976.610317:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42f6200/0x2f180c4effbaa313 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99a2 expref: 526 pid: 6494 timeout: 0 lvb_type: 3 00002000:00010000:2.0:1762166976.610320:0:9165:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166976.610325:0:9165:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:2.0:1762166976.610330:0:9165:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00002000:00010000:2.0:1762166976.610332:0:9165:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:2.0:1762166976.610334:0:9165:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00010000:1.0:1762166976.610341:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945d02174400/0x2f180c4effbaa31a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99a2 expref: 525 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.610365:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00000100:00100000:2.0:1762166976.610369:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+18:3636:x1847765449700224:12345-0@lo:2:osp-syn-1-1.0 Request processed in 95us (190us total) trans 17179876264 rc 0/0 00010000:00010000:1.0:1762166976.610371:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1762166976.610376:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945d02174400, rc 0) 00000100:00100000:2.0:1762166976.610377:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18844 00000100:00100000:1.0:1762166976.610428:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+525:61766:x1847765450388224:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 2981us (3093us total) trans 4294991913 rc 0/0 00000100:00100000:1.0:1762166976.610437:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30323 00000004:00080000:0.0:1762166976.610448:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc558a680/2, rc 0, transno 17179876264 00000100:00100000:0.0:1762166976.610455:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc558a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449700224:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1762166976.612264:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.612305:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450388352 00000100:00100000:1.0:1762166976.612312:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450388352 00000100:00100000:1.0:1762166976.612353:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18845 00000100:00100000:1.0:1762166976.612362:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+38:61766:x1847765450388352:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:1.0:1762166976.612375:0:9165:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166976.612390:0:9165:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945d02174e00/0x2f180c4effbaa321 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e99a9 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.612421:0:9165:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbaa145 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e98f3 expref: 39 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166976.612430:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166976.612432:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166976.612437:0:9165:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945d02174e00/0x2f180c4effbaa321 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [40960->94207] (req 40960->94207) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99a9 expref: 39 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.612464:0:9165:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbaa145 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e98f3 expref: 39 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166976.612534:0:9165:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbaa145 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e98f3 expref: 39 pid: 9168 timeout: 695 lvb_type: 1 00000100:00100000:1.0:1762166976.612549:0:9165:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc47b7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9165:1847765449700608:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166976.612631:0:9165:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cee0836c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166976.613739:0:9165:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc47b7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9165:1847765449700608:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166976.613744:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:1.0:1762166976.613769:0:9165:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945d02174e00/0x2f180c4effbaa321 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [40960->94207] (req 40960->94207) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99a9 expref: 39 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.613785:0:9165:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945d02174e00, rc 0) 00000100:00100000:0.0:1762166976.613803:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450388480 00000100:00100000:0.0:1762166976.613811:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450388480 00000100:00100000:1.0:1762166976.613830:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+40:61766:x1847765450388352:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 1469us (1566us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166976.613834:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbaa145 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e98f3 expref: 40 pid: 9168 timeout: 695 lvb_type: 1 00000100:00100000:1.0:1762166976.613846:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18845 00000100:00100000:0.0:1762166976.613878:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9517 00000100:00100000:0.0:1762166976.613904:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+39:2418:x1847765450388480:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166976.613917:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166976.613933:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbaa145 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e98f3 expref: 39 pid: 9168 timeout: 695 lvb_type: 1 00010000:00010000:0.0:1762166976.613946:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbaa145 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e98f3 expref: 39 pid: 9168 timeout: 695 lvb_type: 1 00010000:00010000:0.0:1762166976.613965:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbaa145 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e98f3 expref: 39 pid: 9168 timeout: 695 lvb_type: 1 00010000:00010000:0.0:1762166976.613979:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166976.613981:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166976.613989:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945d02174e00/0x2f180c4effbaa321 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 40960->94207) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99a9 expref: 38 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.613999:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945d02174e00/0x2f180c4effbaa321 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 40960->94207) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99a9 expref: 38 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.614025:0:8398:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff945d02174e00/0x2f180c4effbaa321 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 40960->94207) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99a9 expref: 38 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166976.614039:0:8398:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7b23100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8398:1847765449700736:192.168.204.38@tcp:105: 00000100:00100000:0.0:1762166976.614081:0:8398:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc10c1540 going to sleep for 11 seconds 00000100:00100000:0.0:1762166976.615025:0:8398:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7b23100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8398:1847765449700736:192.168.204.38@tcp:105: 00010000:00010000:0.0:1762166976.615039:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166976.615093:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+38:2418:x1847765450388480:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1206us (1363us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166976.615101:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9517 00000100:00100000:2.0:1762166976.615179:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166976.615231:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450388608 00000100:00100000:0.0:1762166976.615237:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450388608 00000100:00100000:0.0:1762166976.615288:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2098 00000100:00100000:0.0:1762166976.615298:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+38:2416:x1847765450388608:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:0.0:1762166976.615660:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 244188 -> 244188 00002000:00010000:0.0:1762166976.615664:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:0.0:1762166976.615666:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166976 -> 1762166976 00002000:00010000:0.0:1762166976.615669:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:0.0:1762166976.615672:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 192 -> 288 00000100:00100000:0.0:1762166976.615710:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+39:2416:x1847765450388608:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 415us (535us total) trans 17179876265 rc 0/0 00000100:00100000:0.0:1762166976.615719:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2098 00000100:00100000:2.0:1762166976.616809:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.616878:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450388736 00000100:00100000:1.0:1762166976.616888:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450388736 00000100:00100000:1.0:1762166976.616947:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30324 00000100:00100000:1.0:1762166976.616957:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+525:61766:x1847765450388736:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:1.0:1762166976.616975:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166976.616991:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaa328 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e99b0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.617074:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221e00/0x2f180c4effbaa32f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166976.617085:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221e00/0x2f180c4effbaa32f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.617093:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221e00/0x2f180c4effbaa32f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:1.0:1762166976.617113:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 244188 00000004:00200000:1.0:1762166976.617116:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166976.617129:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221e00/0x2f180c4effbaa32f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.617150:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaa328 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99b0 expref: 527 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.617164:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221e00/0x2f180c4effbaa32f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99b0 expref: 526 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.617173:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.617176:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166976.617180:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc6221e00, rc 0) 00000100:00100000:1.0:1762166976.617229:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+526:61766:x1847765450388736:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 274us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166976.617237:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30324 00000100:00100000:2.0:1762166976.619930:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166976.619977:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450388864 00000100:00100000:0.0:1762166976.619986:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450388864 00002000:00100000:0.0:1762166976.620028:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (0->245759) req@ffff945bc7d20000 x1847765450388864/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:7/0 lens 488/0 e 0 to 0 dl 1762166987 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166976.620039:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc7d20000 with x1847765450388864 ext(0->245759) 00002000:00010000:0.0:1762166976.620044:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc7d20000 00000100:00100000:0.0:1762166976.620072:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2099 00000100:00100000:0.0:1762166976.620082:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+39:2419:x1847765450388864:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:0.0:1762166976.621647:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+39:2419:x1847765450388864:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 1561us (1718us total) trans 0 rc 245760/245760 00000100:00100000:0.0:1762166976.621661:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2099 00002000:00100000:0.0:1762166976.621670:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (0->245759) req@ffff945bc7d20000 x1847765450388864/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:7/0 lens 488/440 e 0 to 0 dl 1762166987 ref 1 fl Complete:/600/0 rc 245760/245760 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166976.621680:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc7d20000 with x1847765450388864 ext(0->245759) 00002000:00010000:0.0:1762166976.621684:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc7d20000 00000100:00100000:2.0:1762166976.625796:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166976.625847:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450388992 00000100:00100000:0.0:1762166976.625858:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450388992 00002000:00100000:0.0:1762166976.625917:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (188416->241663) req@ffff945bc7d21180 x1847765450388992/t0(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:7/0 lens 488/0 e 0 to 0 dl 1762166987 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166976.625930:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc7d21180 with x1847765450388992 ext(188416->241663) 00002000:00010000:0.0:1762166976.625936:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc7d21180 00000100:00100000:0.0:1762166976.625973:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2100 00000100:00100000:0.0:1762166976.625984:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+39:2418:x1847765450388992:12345-192.168.204.38@tcp:4:fsx.0 00000100:00100000:0.0:1762166976.628320:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+41:2418:x1847765450388992:12345-192.168.204.38@tcp:4:fsx.0 Request processed in 2331us (2525us total) trans 17179876266 rc 0/0 00000100:00100000:0.0:1762166976.628334:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2100 00002000:00100000:0.0:1762166976.628346:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (188416->241663) req@ffff945bc7d21180 x1847765450388992/t17179876266(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:7/0 lens 488/448 e 0 to 0 dl 1762166987 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166976.628356:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc7d21180 with x1847765450388992 ext(188416->241663) 00002000:00010000:0.0:1762166976.628363:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc7d21180 00000100:00100000:2.0:1762166976.629963:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.630016:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450389120 00000100:00100000:1.0:1762166976.630024:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450389120 00000100:00100000:1.0:1762166976.630081:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18846 00000100:00100000:1.0:1762166976.630091:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6225880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+41:2419:x1847765450389120:12345-192.168.204.38@tcp:16:fsx.0 00000001:00080000:2.0:1762166976.631040:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876266 is committed 00000001:00080000:2.0:1762166976.631052:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876264 is committed 00000100:00100000:1.0:1762166976.631191:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6225880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450389120:12345-192.168.204.38@tcp:16:fsx.0 Request processed in 1099us (1233us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166976.631198:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18846 00000100:00100000:2.0:1762166976.633380:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.633437:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450389376 00000100:00100000:1.0:1762166976.633449:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450389376 00000100:00100000:1.0:1762166976.633536:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11812 00000100:00100000:1.0:1762166976.633548:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6225c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+526:61766:x1847765450389376:12345-192.168.204.38@tcp:35:fsx.0 00000100:00100000:1.0:1762166976.633787:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6225c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+527:61766:x1847765450389376:12345-192.168.204.38@tcp:35:fsx.0 Request processed in 241us (417us total) trans 4294991914 rc 0/0 00000100:00100000:1.0:1762166976.633796:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11812 00000100:00100000:2.0:1762166976.644367:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.644467:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450389504 00000100:00100000:1.0:1762166976.644502:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450389504 00000100:00100000:1.0:1762166976.644572:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30325 00000100:00100000:1.0:1762166976.644595:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6224000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+527:61842:x1847765450389504:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166976.644619:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166976.644641:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaa336 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e99b7 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.644705:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaa33d lrc: 3/1,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166976.644724:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaa33d lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.644734:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaa33d lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.644748:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221200/0x2f180c4effbaa344 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166976.644755:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221200/0x2f180c4effbaa344 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.644761:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221200/0x2f180c4effbaa344 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.644825:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220600/0x2f180c4effbaa34b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166976.644834:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220600/0x2f180c4effbaa34b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.644840:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220600/0x2f180c4effbaa34b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:1.0:1762166976.644876:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 244188 00000004:00200000:1.0:1762166976.644880:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166976.644909:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220600/0x2f180c4effbaa34b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.644921:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220600/0x2f180c4effbaa34b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.644929:0:6494:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaa33d lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.644939:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaa33d lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.644944:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaa33d lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.644951:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaa33d lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.644956:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc6220e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166976.644960:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaa33d lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.644967:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaa33d lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.644977:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0x0 (ffff945cc7f4cd00) 00010000:00010000:1.0:1762166976.644980:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166976.644984:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaa33d lrc: 3/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.644990:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaa33d lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.645003:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221200/0x2f180c4effbaa344 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.645008:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221200/0x2f180c4effbaa344 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.645013:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221200/0x2f180c4effbaa344 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.645017:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc6221200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166976.645020:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221200/0x2f180c4effbaa344 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.645025:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221200/0x2f180c4effbaa344 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.645031:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0xdd396665 (ffff945cc7f4c000) 00010000:00010000:1.0:1762166976.645033:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166976.645036:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221200/0x2f180c4effbaa344 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.645042:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221200/0x2f180c4effbaa344 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.645069:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaa336 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99b7 expref: 529 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.645083:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220600/0x2f180c4effbaa34b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99b7 expref: 528 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.645090:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.645092:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166976.645094:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc6220600, rc 0) 00000100:00100000:1.0:1762166976.645162:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6224000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+528:61842:x1847765450389504:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 574us (811us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166976.645169:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30325 00000100:00100000:2.0:1762166976.646819:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166976.646911:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450389632 00000100:00100000:0.0:1762166976.646921:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450389632 00000100:00100000:0.0:1762166976.646982:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 864 00000100:00100000:0.0:1762166976.646993:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6224e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+528:2416:x1847765450389632:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166976.647007:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166976.647026:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220600/0x2f180c4effbaa34b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99b7 expref: 528 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.647042:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166976.647046:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166976.647095:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6224e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+527:2416:x1847765450389632:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 104us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166976.647103:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 864 00000100:00100000:2.0:1762166976.647610:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.647655:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450389888 00000100:00100000:1.0:1762166976.647663:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450389888 00000100:00100000:1.0:1762166976.647707:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30326 00000100:00100000:1.0:1762166976.647722:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6224700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+527:61842:x1847765450389888:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166976.647739:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166976.647752:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220400/0x2f180c4effbaa352 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e99be expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.647842:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221600/0x2f180c4effbaa359 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166976.647857:0:6494:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221e00/0x2f180c4effbaa32f lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99b0 expref: 528 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.647865:0:6494:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221600/0x2f180c4effbaa359 lrc: 4/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.647910:0:6494:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221e00/0x2f180c4effbaa32f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99b0 expref: 528 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.647924:0:6494:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221e00/0x2f180c4effbaa32f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99b0 expref: 528 pid: 6494 timeout: 695 lvb_type: 0 00000100:00100000:1.0:1762166976.647937:0:6494:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc47b7100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765449700864:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166976.648022:0:6494:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cee083780 going to sleep for 11 seconds 00000100:00100000:1.0:1762166976.648992:0:6494:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc47b7100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765449700864:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166976.649009:0:6494:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221600/0x2f180c4effbaa359 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000100:00100000:2.0:1762166976.649222:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166976.649275:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450390016 00000100:00100000:0.0:1762166976.649283:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450390016 00010000:00010000:0.0:1762166976.649316:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221e00/0x2f180c4effbaa32f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99b0 expref: 529 pid: 6494 timeout: 695 lvb_type: 0 00000100:00100000:0.0:1762166976.649347:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9518 00000100:00100000:0.0:1762166976.649354:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+529:2419:x1847765450390016:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166976.649368:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166976.649375:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221e00/0x2f180c4effbaa32f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99b0 expref: 529 pid: 6494 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166976.649389:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221e00/0x2f180c4effbaa32f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99b0 expref: 529 pid: 6494 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166976.649415:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221e00/0x2f180c4effbaa32f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99b0 expref: 529 pid: 6494 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166976.649433:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166976.649439:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221600/0x2f180c4effbaa359 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166976.649449:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221600/0x2f180c4effbaa359 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166976.649458:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221600/0x2f180c4effbaa359 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166976.649519:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166976.649578:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+528:2419:x1847765450390016:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 222us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166976.649590:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9518 00010000:00010000:1.0:1762166976.649593:0:6494:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221600/0x2f180c4effbaa359 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.649605:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221600/0x2f180c4effbaa359 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:1.0:1762166976.649630:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 244188 00010000:00010000:1.0:1762166976.649761:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220400/0x2f180c4effbaa352 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99be expref: 529 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.649781:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221600/0x2f180c4effbaa359 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99be expref: 528 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.649789:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.649794:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1762166976.649797:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc6221600, rc 0) 00000100:00100000:1.0:1762166976.649850:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6224700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+528:61842:x1847765450389888:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2134us (2242us total) trans 4294991915 rc 0/0 00000100:00100000:1.0:1762166976.649858:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30326 00000100:00100000:2.0:1762166976.651309:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.651356:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450390144 00000100:00100000:1.0:1762166976.651363:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450390144 00000100:00100000:1.0:1762166976.651410:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30327 00000100:00100000:1.0:1762166976.651420:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+528:61842:x1847765450390144:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166976.651438:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166976.651453:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220c00/0x2f180c4effbaa367 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e99c5 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.651588:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaa36e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166976.651601:0:6494:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221600/0x2f180c4effbaa359 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99be expref: 529 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.651609:0:6494:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaa36e lrc: 4/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.651637:0:6494:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221600/0x2f180c4effbaa359 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99be expref: 529 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.651649:0:6494:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221600/0x2f180c4effbaa359 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99be expref: 529 pid: 6494 timeout: 695 lvb_type: 0 00000100:00100000:1.0:1762166976.651662:0:6494:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc47b7100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765449700992:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166976.651733:0:6494:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cee083000 going to sleep for 11 seconds 00000100:00100000:1.0:1762166976.652747:0:6494:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc47b7100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765449700992:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166976.652764:0:6494:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaa36e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000100:00100000:2.0:1762166976.652878:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166976.652937:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450390272 00000100:00100000:0.0:1762166976.652942:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450390272 00010000:00010000:0.0:1762166976.652964:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221600/0x2f180c4effbaa359 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99be expref: 530 pid: 6494 timeout: 695 lvb_type: 0 00000100:00100000:0.0:1762166976.652990:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9519 00000100:00100000:0.0:1762166976.652995:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf9d1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+530:2418:x1847765450390272:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166976.653003:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166976.653007:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221600/0x2f180c4effbaa359 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99be expref: 530 pid: 6494 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166976.653015:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221600/0x2f180c4effbaa359 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99be expref: 530 pid: 6494 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166976.653027:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221600/0x2f180c4effbaa359 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99be expref: 530 pid: 6494 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166976.653041:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166976.653044:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaa36e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166976.653050:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaa36e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166976.653054:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaa36e lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166976.653071:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166976.653091:0:6494:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaa36e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.653098:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaa36e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000100:00100000:0.0:1762166976.653103:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf9d1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+529:2418:x1847765450390272:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 107us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166976.653109:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9519 00000004:00200000:1.0:1762166976.653131:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 244188 00000004:00200000:1.0:1762166976.653136:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166976.653153:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaa36e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.653178:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220c00/0x2f180c4effbaa367 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99c5 expref: 529 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.653191:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaa36e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99c5 expref: 528 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.653203:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.653206:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166976.653208:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc6221400, rc 0) 00000100:00100000:1.0:1762166976.653256:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+528:61842:x1847765450390144:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1837us (1951us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166976.653263:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30327 00000100:00100000:2.0:1762166976.654825:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.654863:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450390528 00000100:00100000:1.0:1762166976.654869:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450390528 00000100:00100000:1.0:1762166976.654916:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30328 00000100:00100000:1.0:1762166976.654926:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+528:61842:x1847765450390528:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166976.654941:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166976.654955:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221200/0x2f180c4effbaa375 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e99cc expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.655026:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaa37c lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166976.655038:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaa37c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.655048:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaa37c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:1.0:1762166976.655057:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 244188 00010000:00010000:1.0:1762166976.655146:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221200/0x2f180c4effbaa375 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99cc expref: 531 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.655160:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaa37c lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99cc expref: 530 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.655167:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.655170:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762166976.655172:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc6220e00, rc 0) 00000100:00100000:1.0:1762166976.655208:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+530:61842:x1847765450390528:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 285us (386us total) trans 4294991916 rc 0/0 00000100:00100000:1.0:1762166976.655215:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30328 00000100:00100000:2.0:1762166976.656443:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.656518:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450390656 00000100:00100000:2.0:1762166976.656524:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.656524:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450390656 00000100:00100000:1.0:1762166976.656567:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450390784 00000100:00100000:1.0:1762166976.656571:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450390784 00000100:00100000:0.0:1762166976.656575:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18847 00000100:00100000:0.0:1762166976.656589:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450390656:12345-192.168.204.38@tcp:1:lfs.0 00000100:00100000:1.0:1762166976.656604:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18848 00000100:00100000:1.0:1762166976.656615:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450390784:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:0.0:1762166976.656623:0:35247:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbaa38a lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166976.656639:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:0.0:1762166976.656641:0:35247:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945d02174e00/0x2f180c4effbaa321 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 40960->94207) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99a9 expref: 18 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.656642:0:9165:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc6221800/0x2f180c4effbaa391 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.656657:0:35247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00000100:00100000:3.0:1762166976.656661:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450390912 00010000:00010000:0.0:1762166976.656661:0:35247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166976.656664:0:35247:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbaa38a lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166976.656667:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450390912 00010000:00010000:1.0:1762166976.656667:0:9165:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bcc8fb800/0x2f180c4effbaa13e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e98fa expref: 17 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166976.656679:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166976.656682:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166976.656685:0:9165:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc6221800/0x2f180c4effbaa391 lrc: 4/0,1 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.656696:0:35247:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945d02174e00/0x2f180c4effbaa321 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 40960->94207) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99a9 expref: 19 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166976.656698:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18849 00010000:00010000:1.0:1762166976.656713:0:9165:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bcc8fb800/0x2f180c4effbaa13e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e98fa expref: 17 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166976.656715:0:35247:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945d02174e00/0x2f180c4effbaa321 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 40960->94207) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99a9 expref: 19 pid: 9165 timeout: 695 lvb_type: 0 00000100:00100000:3.0:1762166976.656716:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450390912:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:1.0:1762166976.656740:0:9165:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bcc8fb800/0x2f180c4effbaa13e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e98fa expref: 17 pid: 28434 timeout: 695 lvb_type: 1 00000100:00100000:0.0:1762166976.656744:0:35247:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7b23100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:35247:1847765449701120:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166976.656745:0:8380:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effbaa398 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166976.656767:0:9165:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc47b7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9165:1847765449701248:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166976.656770:0:8380:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc8472800/0x2f180c4effbaa14c lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9901 expref: 19 pid: 35247 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166976.656781:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166976.656783:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166976.656787:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effbaa398 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166976.656804:0:9165:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cee0836c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166976.656804:0:35247:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc10c1480 going to sleep for 11 seconds 00010000:00010000:3.0:1762166976.656812:0:8380:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc8472800/0x2f180c4effbaa14c lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9901 expref: 19 pid: 35247 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166976.656822:0:8380:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc8472800/0x2f180c4effbaa14c lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9901 expref: 19 pid: 35247 timeout: 695 lvb_type: 1 00000100:00100000:3.0:1762166976.656834:0:8380:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcce74380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8380:1847765449701376:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166976.656864:0:8380:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc2c72480 going to sleep for 11 seconds 00000100:00100000:0.0:1762166976.658167:0:35247:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7b23100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:35247:1847765449701120:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166976.658182:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:0.0:1762166976.658188:0:35247:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbaa38a lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166976.658217:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450391040 00000100:00100000:3.0:1762166976.658218:0:8380:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcce74380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8380:1847765449701376:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166976.658223:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450391040 00000100:00100000:2.0:1762166976.658236:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:3.0:1762166976.658237:0:8380:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effbaa398 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166976.658244:0:9165:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc47b7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9165:1847765449701248:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166976.658250:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bcc8fb800/0x2f180c4effbaa13e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e98fa expref: 18 pid: 28434 timeout: 695 lvb_type: 1 00010000:00010000:1.0:1762166976.658269:0:9165:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bc6221800/0x2f180c4effbaa391 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166976.658271:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450391168 00000100:00100000:3.0:1762166976.658277:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450391168 00000100:00100000:0.0:1762166976.658282:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9520 00000100:00100000:0.0:1762166976.658292:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+18:2417:x1847765450391040:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166976.658301:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472800/0x2f180c4effbaa14c lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9901 expref: 20 pid: 35247 timeout: 695 lvb_type: 1 00010000:00010000:0.0:1762166976.658313:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166976.658336:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bcc8fb800/0x2f180c4effbaa13e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e98fa expref: 18 pid: 28434 timeout: 695 lvb_type: 1 00000100:00100000:3.0:1762166976.658339:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9521 00010000:00010000:0.0:1762166976.658352:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bcc8fb800/0x2f180c4effbaa13e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e98fa expref: 18 pid: 28434 timeout: 695 lvb_type: 1 00000100:00100000:3.0:1762166976.658354:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450391168:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166976.658369:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166976.658383:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc8472800/0x2f180c4effbaa14c lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9901 expref: 20 pid: 35247 timeout: 695 lvb_type: 1 00010000:00010000:0.0:1762166976.658393:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bcc8fb800/0x2f180c4effbaa13e lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e98fa expref: 18 pid: 28434 timeout: 695 lvb_type: 1 00010000:00010000:0.0:1762166976.658412:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166976.658414:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166976.658418:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc6221800/0x2f180c4effbaa391 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.658427:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc6221800/0x2f180c4effbaa391 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.658451:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166976.658474:0:9165:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bc6221800/0x2f180c4effbaa391 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.658506:0:9165:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc6221800/0x2f180c4effbaa391 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166976.658515:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+17:2417:x1847765450391040:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 222us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166976.658524:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9520 00010000:00010000:1.0:1762166976.658525:0:9165:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc6221800/0x2f180c4effbaa391 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.658534:0:9165:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc6221800/0x2f180c4effbaa391 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.658540:0:9165:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc6221800/0x2f180c4effbaa391 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.658544:0:9165:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc6221800 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166976.658548:0:9165:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc6221800/0x2f180c4effbaa391 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.658557:0:9165:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc6221800/0x2f180c4effbaa391 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.658566:0:9165:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc6221800/0x2f180c4effbaa391 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.658573:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc8472800/0x2f180c4effbaa14c lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9901 expref: 20 pid: 35247 timeout: 695 lvb_type: 1 00010000:00010000:1.0:1762166976.658573:0:9165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc6221800/0x2f180c4effbaa391 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.658603:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8472800/0x2f180c4effbaa14c lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9901 expref: 20 pid: 35247 timeout: 695 lvb_type: 1 00010000:00010000:3.0:1762166976.658616:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166976.658618:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166976.658622:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effbaa398 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166976.658631:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.658638:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+16:2419:x1847765450390784:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 2024us (2113us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166976.658645:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18848 00000100:00100000:0.0:1762166976.658653:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450391296 00000100:00100000:0.0:1762166976.658659:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450391296 00010000:00010000:0.0:1762166976.658676:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945d02174e00/0x2f180c4effbaa321 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 40960->94207) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99a9 expref: 20 pid: 9165 timeout: 695 lvb_type: 0 00010000:00010000:3.0:1762166976.658693:0:7421:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effbaa398 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166976.658708:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9522 00010000:00010000:3.0:1762166976.658717:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166976.658721:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450391296:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166976.658730:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166976.658737:0:8380:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effbaa398 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166976.658738:0:8398:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 288 -> 352 00010000:00010000:0.0:1762166976.658745:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945d02174e00/0x2f180c4effbaa321 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 40960->94207) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99a9 expref: 20 pid: 9165 timeout: 695 lvb_type: 0 00010000:00010000:2.0:1762166976.658759:0:8380:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effbaa398 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.658766:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945d02174e00/0x2f180c4effbaa321 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 40960->94207) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99a9 expref: 20 pid: 9165 timeout: 695 lvb_type: 0 00010000:00010000:2.0:1762166976.658781:0:8380:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effbaa398 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.658790:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945d02174e00/0x2f180c4effbaa321 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 40960->94207) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99a9 expref: 20 pid: 9165 timeout: 695 lvb_type: 0 00010000:00010000:2.0:1762166976.658793:0:8380:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effbaa398 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166976.658794:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450391168:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 442us (557us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166976.658813:0:8380:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effbaa398 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.658814:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1762166976.658815:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9521 00010000:00010000:0.0:1762166976.658819:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166976.658826:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbaa38a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.658827:0:8380:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8472c00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166976.658834:0:8380:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effbaa398 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.658839:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbaa38a lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.658845:0:8380:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effbaa398 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.658863:0:8380:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effbaa398 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.658871:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effbaa398 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.658871:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166976.658876:0:35247:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbaa38a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.658887:0:35247:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbaa38a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.658912:0:35247:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbaa38a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166976.658920:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450391296:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 200us (288us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166976.658921:0:35247:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbaa38a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166976.658939:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9522 00000100:00100000:2.0:1762166976.658940:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450390912:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 2227us (2300us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166976.658940:0:35247:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbaa38a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166976.658961:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18849 00010000:00010000:1.0:1762166976.658967:0:35247:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdee00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166976.658980:0:35247:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbaa38a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.658991:0:35247:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbaa38a lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.659002:0:35247:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbaa38a lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.659010:0:35247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbaa38a lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166976.659049:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+16:2418:x1847765450390656:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 2464us (2609us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166976.659057:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18847 00000100:00100000:2.0:1762166976.659853:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.659901:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450391552 00000100:00100000:1.0:1762166976.659906:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450391552 00000100:00100000:1.0:1762166976.659937:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30329 00000100:00100000:1.0:1762166976.659945:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+530:61842:x1847765450391552:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:1.0:1762166976.659983:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1762166976.659998:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945d02174400/0x2f180c4effbaa31a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99a2 expref: 530 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.660014:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaa36e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99c5 expref: 529 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.660028:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.660031:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166976.660052:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaa39f lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166976.660062:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaa39f lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.660068:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaa39f lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000040:00080000:1.0:1762166976.660268:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5875, 88 off459896 00000004:00080000:1.0:1762166976.660275:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 595808797067ns, next at 595897461133ns, rc = 0 00000040:00080000:1.0:1762166976.660302:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5874, 88 off459896 00000004:00080000:1.0:1762166976.660305:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 595808827523ns, next at 595897495953ns, rc = 0 00000040:00080000:1.0:1762166976.660324:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5875, 88 off459984 00000004:00080000:1.0:1762166976.660330:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 595808852281ns, next at 595897495953ns, rc = 0 00000040:00080000:1.0:1762166976.660352:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5876, 88 off459984 00000004:00080000:1.0:1762166976.660358:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 595808879875ns, next at 595897461133ns, rc = 0 00000040:00080000:1.0:1762166976.660373:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5876, 88 off460072 00000004:00080000:1.0:1762166976.660376:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 595808897965ns, next at 595897495953ns, rc = 0 00000040:00080000:1.0:1762166976.660386:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5877, 88 off460072 00000004:00080000:1.0:1762166976.660389:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 595808911303ns, next at 595897461133ns, rc = 0 00000040:00080000:1.0:1762166976.660398:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5877, 88 off460160 00000004:00080000:1.0:1762166976.660401:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 595808923438ns, next at 595897495953ns, rc = 0 00000040:00080000:1.0:1762166976.660411:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5878, 88 off460160 00000004:00080000:1.0:1762166976.660414:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 595808936348ns, next at 595897461133ns, rc = 0 00000001:00080000:3.0:1762166976.661396:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294991917 is committed 00000004:00080000:3.0:1762166976.661402:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3242 committed 00000004:00080000:3.0:1762166976.661417:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3245 committed 00000004:00080000:3.0:1762166976.661434:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3241 committed 00000004:00080000:3.0:1762166976.661437:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3244 committed 00000004:00080000:3.0:1762166976.661439:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3240 committed 00000004:00080000:3.0:1762166976.661441:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3243 committed 00000004:00080000:3.0:1762166976.661443:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3242 committed 00000004:00080000:3.0:1762166976.661447:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3239 committed 00000004:00010000:1.0:1762166976.661538:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000009781448 reply state 0000000081defa69 transno 4294991917 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaa39f lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000100:00100000:3.0:1762166976.661545:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449701504:0@lo:2:osp-syn-1-1.0 00010000:00010000:1.0:1762166976.661557:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaa39f lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.661567:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.661570:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1762166976.661574:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166976.661598:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166976.661629:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449701632:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166976.661638:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7b22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449702016:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1762166976.661642:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449701504 00000100:00100000:2.0:1762166976.661648:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449701504 00010000:00080000:1.0:1762166976.661651:0:6494:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1762166976.661665:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+526:61842:x1847765450391552:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 1721us (1811us total) trans 4294991917 rc 0/0 00000100:00100000:0.0:1762166976.661674:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166976.661678:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30329 00000100:00100000:2.0:1762166976.661694:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449701632 00000100:00100000:2.0:1762166976.661699:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449701632 00000100:00100000:0.0:1762166976.661717:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449702144:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166976.661720:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18850 00000100:00100000:2.0:1762166976.661730:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18851 00000100:00100000:3.0:1762166976.661735:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3635:x1847765449701504:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1762166976.661745:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+6:3636:x1847765449701632:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1762166976.661754:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1762166976.661768:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaa39f lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.661775:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaa39f lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.661779:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaa39f lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.661783:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc6221a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166976.661786:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaa39f lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.661791:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaa39f lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00000100:00100000:0.0:1762166976.661796:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7b23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449701760:0@lo:2:osp-syn-0-1.0 00010000:00010000:1.0:1762166976.661798:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.661803:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166976.661805:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaa39f lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.661809:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaa39f lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00000100:00100000:1.0:1762166976.661828:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449702144 00000100:00100000:0.0:1762166976.661828:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166976.661833:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449702144 00000100:00100000:0.0:1762166976.661855:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7b21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449702400:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1762166976.661856:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449701760 00000100:00100000:1.0:1762166976.661859:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449701760 00000100:00100000:1.0:1762166976.661886:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18852 00000100:00100000:2.0:1762166976.661904:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+9:3636:x1847765449701632:12345-0@lo:2:osp-syn-1-1.0 Request processed in 150us (220us total) trans 17179876267 rc 0/0 00000100:00100000:1.0:1762166976.661914:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+9:3636:x1847765449702144:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1762166976.661914:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166976.661921:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18851 00000100:00100000:3.0:1762166976.661934:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+9:3635:x1847765449701504:12345-0@lo:2:osp-syn-1-1.0 Request processed in 202us (335us total) trans 17179876268 rc 0/0 00000100:00100000:2.0:1762166976.661943:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449702400 00000100:00100000:3.0:1762166976.661946:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18850 00000100:00100000:2.0:1762166976.661948:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449702400 00000100:00100000:0.0:1762166976.661949:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1762166976.661961:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449701888:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166976.661970:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18853 00000100:00100000:3.0:1762166976.661981:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+14:3634:x1847765449701760:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1762166976.661986:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18854 00000100:00100000:0.0:1762166976.661993:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1762166976.661997:0:28434:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:2.0:1762166976.662003:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+14:3634:x1847765449702400:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:1.0:1762166976.662004:0:28434:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.662011:0:28434:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00000100:00100000:0.0:1762166976.662011:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7b21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449702272:0@lo:2:osp-syn-0-1.0 00002000:00010000:1.0:1762166976.662019:0:28434:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.662023:0:28434:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1762166976.662052:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:3.0:1762166976.662056:0:9165:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:1.0:1762166976.662057:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+8:3636:x1847765449702144:12345-0@lo:2:osp-syn-1-1.0 Request processed in 165us (307us total) trans 17179876269 rc 0/0 00002000:00010000:3.0:1762166976.662065:0:9165:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb mtime from disk: 1762166966 -> 1762166966 00000100:00100000:1.0:1762166976.662069:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18852 00002000:00010000:3.0:1762166976.662072:0:9165:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1762166976.662076:0:9165:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb ctime from disk: 1762166966 -> 1762166966 00002000:00010000:3.0:1762166976.662079:0:9165:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1762166976.662085:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449702272 00000100:00100000:0.0:1762166976.662085:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449701888 00000100:00100000:1.0:1762166976.662090:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449702272 00000100:00100000:0.0:1762166976.662092:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449701888 00000100:00100000:1.0:1762166976.662106:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18855 00000100:00100000:1.0:1762166976.662114:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+17:3634:x1847765449702272:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1762166976.662123:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+17:3634:x1847765449702400:12345-0@lo:2:osp-syn-0-1.0 Request processed in 125us (229us total) trans 21474843228 rc 0/0 00000100:00100000:3.0:1762166976.662125:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+17:3634:x1847765449701760:12345-0@lo:2:osp-syn-0-1.0 Request processed in 147us (298us total) trans 21474843227 rc 0/0 00000100:00100000:0.0:1762166976.662126:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18856 00000100:00100000:2.0:1762166976.662141:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18854 00000100:00100000:0.0:1762166976.662143:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+8:3634:x1847765449701888:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166976.662159:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18853 00000100:00100000:1.0:1762166976.662184:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+16:3634:x1847765449702272:12345-0@lo:2:osp-syn-0-1.0 Request processed in 70us (133us total) trans 21474843229 rc 0/0 00000100:00100000:1.0:1762166976.662204:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18855 00002000:00010000:0.0:1762166976.662214:0:28874:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166976.662219:0:28874:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:0.0:1762166976.662221:0:28874:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb atime from disk: 1762166973 -> 1762166973 00002000:00010000:0.0:1762166976.662224:0:28874:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:0.0:1762166976.662226:0:28874:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1762166976.662251:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166976.662259:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+9:3634:x1847765449701888:12345-0@lo:2:osp-syn-1-1.0 Request processed in 121us (267us total) trans 17179876270 rc 0/0 00000100:00100000:0.0:1762166976.662268:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18856 00000100:00100000:0.0:1762166976.662285:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449702016 00000100:00100000:0.0:1762166976.662288:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449702016 00000100:00100000:1.0:1762166976.662295:0:3635:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 17179876264 gen 2 00000004:00080000:1.0:1762166976.662300:0:3635:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc6cd1500, transno 17179876242 00000100:00100000:0.0:1762166976.662318:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18857 00000004:00080000:1.0:1762166976.662319:0:3635:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc4493b80, transno 17179876243 00000004:00080000:1.0:1762166976.662327:0:3635:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc6cd3480, transno 17179876244 00000100:00100000:0.0:1762166976.662329:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+16:3635:x1847765449702016:12345-0@lo:2:osp-syn-0-1.0 00000004:00080000:1.0:1762166976.662332:0:3635:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc4492a00, transno 17179876245 00000004:00080000:1.0:1762166976.662338:0:3635:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc5805880, transno 17179876246 00000004:00080000:1.0:1762166976.662341:0:3635:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf79eaa00, transno 17179876257 00000004:00080000:1.0:1762166976.662345:0:3635:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf79ea300, transno 17179876258 00000004:00080000:1.0:1762166976.662347:0:3635:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf79e9880, transno 17179876259 00000004:00080000:1.0:1762166976.662350:0:3635:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf1e6df80, transno 17179876260 00000004:00080000:1.0:1762166976.662352:0:3635:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf3db5c00, transno 17179876261 00000004:00080000:1.0:1762166976.662355:0:3635:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc5588380, transno 17179876262 00000004:00080000:1.0:1762166976.662358:0:3635:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc5589f80, transno 17179876263 00000004:00080000:1.0:1762166976.662360:0:3635:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc558a680, transno 17179876264 00000100:00100000:1.0:1762166976.662367:0:3635:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff945cf1cd3b80 x1847765449701504/t17179876268(17179876268) o2->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 440/432 e 0 to 0 dl 1762166992 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1762166976.662377:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf1cd3b80/2, rc 0, transno 17179876268 00000100:00100000:1.0:1762166976.662382:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449701504:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1762166976.662416:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+17:3635:x1847765449702016:12345-0@lo:2:osp-syn-0-1.0 Request processed in 88us (162us total) trans 21474843230 rc 0/0 00000004:00080000:1.0:1762166976.662420:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf1cd0000/2, rc 0, transno 17179876267 00000100:00100000:1.0:1762166976.662425:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449701632:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1762166976.662426:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18857 00000004:00080000:1.0:1762166976.662433:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf783e680/2, rc 0, transno 17179876269 00000100:00100000:1.0:1762166976.662437:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449702144:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1762166976.662449:0:9994:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0001: 0 changes, 13 in progress, 1 in flight, 4 done 00000004:00080000:1.0:1762166976.662464:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc7b22a00/2, rc 0, transno 21474843230 00000004:00080000:0.0:1762166976.662465:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf1cd2a00/2, rc 0, transno 17179876270 00000100:00100000:1.0:1762166976.662469:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7b22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449702016:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1762166976.662472:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449701888:0@lo:2:osp-syn-1-1.0 00000004:00080000:0.0:1762166976.662499:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc7b21180/2, rc 0, transno 21474843229 00000100:00100000:0.0:1762166976.662502:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7b21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449702272:0@lo:2:osp-syn-0-1.0 00000004:00080000:0.0:1762166976.662508:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc7b23100/2, rc 0, transno 21474843227 00000100:00100000:0.0:1762166976.662511:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7b23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449701760:0@lo:2:osp-syn-0-1.0 00000004:00080000:0.0:1762166976.662516:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc7b21c00/2, rc 0, transno 21474843228 00000100:00100000:0.0:1762166976.662518:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7b21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449702400:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1762166976.662592:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000004:00080000:3.0:1762166976.662621:0:9994:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0001: 0 changes, 4 in progress, 0 in flight, 9 done 00000100:00100000:1.0:1762166976.662629:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450391680 00000100:00100000:1.0:1762166976.662634:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450391680 00000100:00100000:1.0:1762166976.662665:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30330 00000100:00100000:1.0:1762166976.662672:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4012300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+525:61842:x1847765450391680:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166976.662686:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166976.662710:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220a00/0x2f180c4effbaa3a6 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e99d3 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.662743:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220a00/0x2f180c4effbaa3a6 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99d3 expref: 526 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.662754:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220a00/0x2f180c4effbaa3a6 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99d3 expref: 526 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.662768:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.662770:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166976.662773:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc6220a00, rc 0) 00000100:00100000:1.0:1762166976.662805:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4012300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+526:61842:x1847765450391680:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 133us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166976.662812:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30330 00000100:00100000:1.0:1762166976.663946:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166976.664000:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450391808 00000100:00100000:2.0:1762166976.664005:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450391808 00000100:00100000:2.0:1762166976.664039:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30331 00000100:00100000:2.0:1762166976.664046:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+526:61842:x1847765450391808:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166976.664056:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166976.664066:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbaa3ad lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e99da expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.664129:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbaa3b4 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166976.664140:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbaa3b4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166976.664149:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbaa3b4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:2.0:1762166976.664168:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 244188 00000004:00200000:2.0:1762166976.664171:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166976.664183:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbaa3b4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166976.664199:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbaa3ad lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99da expref: 528 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.664211:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbaa3b4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99da expref: 527 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.664216:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166976.664218:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166976.664219:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa8600, rc 0) 00000100:00100000:2.0:1762166976.664248:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+527:61842:x1847765450391808:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 203us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166976.664252:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30331 00000100:00100000:2.0:1762166976.665159:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166976.665199:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.665222:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450391936 00000100:00100000:1.0:1762166976.665230:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450391936 00000100:00100000:2.0:1762166976.665241:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166976.665260:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450392064 00000100:00100000:0.0:1762166976.665268:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450392064 00000100:00100000:1.0:1762166976.665284:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450392192 00000100:00100000:1.0:1762166976.665289:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450392192 00000100:00100000:3.0:1762166976.665303:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18858 00000100:00100000:3.0:1762166976.665321:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450391936:12345-192.168.204.38@tcp:101:lfs.0 00000100:00100000:0.0:1762166976.665329:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18859 00000100:00100000:1.0:1762166976.665342:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18860 00000100:00100000:0.0:1762166976.665345:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+16:2419:x1847765450392064:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166976.665346:0:35248:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1762166976.665359:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450392192:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166976.665362:0:28874:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166976.665371:0:8382:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166976.665374:0:35248:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effbaa3bb lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e99e1 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.665380:0:28874:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf400/0x2f180c4effbaa3c2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e99e8 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.665385:0:8382:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc6221200/0x2f180c4effbaa3c9 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e99ef expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166976.665428:0:28874:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa7a:0x0] initial LVB size: 0, mtime: 0x690888c0, atime: 0x690888c0, ctime: 0x690888c0, blocks: 0x1800 00002000:00010000:1.0:1762166976.665437:0:8382:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa79:0x0] initial LVB size: 0, mtime: 0x690888c0, atime: 0x690888c0, ctime: 0x690888c0, blocks: 0x0 00010000:00010000:0.0:1762166976.665457:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166976.665458:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166976.665460:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00002000:00010000:3.0:1762166976.665462:0:35248:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa77:0x0] initial LVB size: 244188, mtime: 0x690888c0, atime: 0x690888c0, ctime: 0x690888c0, blocks: 0x160 00010000:00010000:1.0:1762166976.665463:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166976.665470:0:28874:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf400/0x2f180c4effbaa3c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99e8 expref: 17 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166976.665506:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc6221200/0x2f180c4effbaa3c9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99ef expref: 18 pid: 8382 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166976.665529:0:8382:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc6221200/0x2f180c4effbaa3c9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99ef expref: 19 pid: 8382 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166976.665530:0:35248:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166976.665535:0:35248:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166976.665544:0:28874:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf400/0x2f180c4effbaa3c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99e8 expref: 17 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166976.665554:0:35248:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effbaa3bb lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99e1 expref: 19 pid: 35248 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166976.665559:0:8382:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc6221200, rc 0) 00010000:00010000:0.0:1762166976.665562:0:28874:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdf400, rc 0) 00010000:00010000:3.0:1762166976.665586:0:35248:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effbaa3bb lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99e1 expref: 19 pid: 35248 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166976.665601:0:35248:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8473600, rc 0) 00000100:00100000:0.0:1762166976.665613:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450392064:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 272us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166976.665619:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450392192:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 263us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166976.665629:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18859 00000100:00100000:1.0:1762166976.665637:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18860 00000100:00100000:3.0:1762166976.665654:0:35248:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450391936:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 334us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166976.665668:0:35248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18858 00000100:00100000:0.0:1762166976.689591:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166976.689660:0:35248:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450392320 00000100:00100000:3.0:1762166976.689674:0:35248:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450392320 00000100:00100000:3.0:1762166976.689746:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18861 00000100:00100000:3.0:1762166976.689759:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4012680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+18:2417:x1847765450392320:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:3.0:1762166976.689919:0:35248:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4012680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+18:2417:x1847765450392320:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 163us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166976.689928:0:35248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18861 00000100:00100000:2.0:1762166976.690960:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166976.691007:0:35248:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450392448 00000100:00100000:3.0:1762166976.691013:0:35248:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450392448 00000100:00100000:3.0:1762166976.691044:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18862 00000100:00100000:3.0:1762166976.691053:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450392448:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:3.0:1762166976.691113:0:35248:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450392448:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 61us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166976.691123:0:35248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18862 00000100:00100000:2.0:1762166976.692470:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166976.692524:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450392576 00000100:00100000:0.0:1762166976.692529:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450392576 00000100:00100000:0.0:1762166976.692572:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2101 00000100:00100000:0.0:1762166976.692578:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450392576:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:0.0:1762166976.692606:0:23940:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde800/0x2f180c4effbaa3d0 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.692620:0:23940:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166976.692622:0:23940:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166976.692628:0:23940:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde800/0x2f180c4effbaa3d0 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.692639:0:23940:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde800/0x2f180c4effbaa3d0 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.692731:0:23940:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde800/0x2f180c4effbaa3d0 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.692737:0:23940:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde800/0x2f180c4effbaa3d0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.692743:0:23940:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde800/0x2f180c4effbaa3d0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.692747:0:23940:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bde800 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166976.692751:0:23940:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde800/0x2f180c4effbaa3d0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.692756:0:23940:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde800/0x2f180c4effbaa3d0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.692769:0:23940:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde800/0x2f180c4effbaa3d0 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.692773:0:23940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde800/0x2f180c4effbaa3d0 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166976.692806:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450392576:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 229us (341us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1762166976.692811:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2101 00000100:00100000:0.0:1762166976.694311:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.694445:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450392704 00000100:00100000:1.0:1762166976.694460:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450392704 00000100:00100000:1.0:1762166976.694581:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2102 00000100:00100000:1.0:1762166976.694597:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450392704:12345-192.168.204.38@tcp:4:lfs.0 00002000:00010000:1.0:1762166976.694647:0:23940:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa86:0x0] initial LVB size: 244188, mtime: 0x690888c0, atime: 0x690888bd, ctime: 0x690888c0, blocks: 0xa8 00010000:00010000:1.0:1762166976.694656:0:23940:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc6221a00/0x2f180c4effbaa3d7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.694669:0:23940:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166976.694671:0:23940:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166976.694676:0:23940:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc6221a00/0x2f180c4effbaa3d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.694689:0:23940:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc6221a00/0x2f180c4effbaa3d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00000001:00080000:3.0:1762166976.696239:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843231 is committed 00000001:00080000:3.0:1762166976.696252:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843230 is committed 00010000:00010000:1.0:1762166976.696354:0:23940:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc6221a00/0x2f180c4effbaa3d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.696372:0:23940:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc6221a00/0x2f180c4effbaa3d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.696380:0:23940:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc6221a00/0x2f180c4effbaa3d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.696388:0:23940:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc6221a00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166976.696392:0:23940:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc6221a00/0x2f180c4effbaa3d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.696401:0:23940:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc6221a00/0x2f180c4effbaa3d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.696417:0:23940:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc6221a00/0x2f180c4effbaa3d7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.696425:0:23940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc6221a00/0x2f180c4effbaa3d7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166976.696532:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+14:2418:x1847765450392704:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 1935us (2219us total) trans 21474843231 rc 0/0 00000100:00100000:1.0:1762166976.696545:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2102 00000100:00100000:2.0:1762166976.698238:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.698290:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450392832 00000100:00100000:1.0:1762166976.698302:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450392832 00000100:00100000:1.0:1762166976.698378:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2103 00000100:00100000:1.0:1762166976.698388:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+14:2419:x1847765450392832:12345-192.168.204.38@tcp:4:lfs.0 00002000:00010000:1.0:1762166976.698427:0:23940:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa88:0x0] initial LVB size: 244188, mtime: 0x690888c0, atime: 0x690888bf, ctime: 0x690888c0, blocks: 0xa8 00010000:00010000:1.0:1762166976.698435:0:23940:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc6221400/0x2f180c4effbaa3de lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.698447:0:23940:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166976.698449:0:23940:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166976.698454:0:23940:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc6221400/0x2f180c4effbaa3de lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.698466:0:23940:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc6221400/0x2f180c4effbaa3de lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00000001:00080000:3.0:1762166976.699474:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843232 is committed 00010000:00010000:1.0:1762166976.699589:0:23940:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc6221400/0x2f180c4effbaa3de lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.699603:0:23940:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc6221400/0x2f180c4effbaa3de lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.699611:0:23940:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc6221400/0x2f180c4effbaa3de lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.699619:0:23940:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc6221400 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166976.699624:0:23940:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc6221400/0x2f180c4effbaa3de lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.699633:0:23940:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc6221400/0x2f180c4effbaa3de lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.699652:0:23940:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc6221400/0x2f180c4effbaa3de lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.699664:0:23940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc6221400/0x2f180c4effbaa3de lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166976.699753:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+14:2419:x1847765450392832:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 1364us (1520us total) trans 21474843232 rc 0/0 00000100:00100000:1.0:1762166976.699766:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2103 00000100:00100000:2.0:1762166976.701367:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166976.701421:0:35248:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450392960 00000100:00100000:3.0:1762166976.701432:0:35248:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450392960 00000100:00100000:3.0:1762166976.701523:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18863 00000100:00100000:3.0:1762166976.701535:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450392960:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:3.0:1762166976.701650:0:35248:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450392960:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 119us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166976.701656:0:35248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18863 00000100:00100000:0.0:1762166976.703157:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166976.703213:0:35248:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450393088 00000100:00100000:3.0:1762166976.703220:0:35248:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450393088 00000100:00100000:3.0:1762166976.703261:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18864 00000100:00100000:3.0:1762166976.703272:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6224e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450393088:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:3.0:1762166976.703361:0:35248:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6224e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450393088:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 93us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166976.703367:0:35248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18864 00000100:00100000:2.0:1762166976.704711:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.704757:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450393344 00000100:00100000:1.0:1762166976.704765:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450393344 00000100:00100000:1.0:1762166976.704812:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30332 00000100:00100000:1.0:1762166976.704821:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+527:61842:x1847765450393344:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:1.0:1762166976.704870:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166976.704909:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbaa3b4 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99da expref: 527 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.704931:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.704936:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166976.705153:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaa3e5 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166976.705172:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaa3e5 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.705183:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaa3e5 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000001:00080000:1.0:1762166976.705228:0:6494:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294991918 00000004:00010000:1.0:1762166976.705246:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000b072b4f3 reply state 0000000085a30ef6 transno 4294991919 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaa3e5 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.705259:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaa3e5 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.705263:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.705265:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166976.705267:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166976.705329:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+529:61842:x1847765450393344:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 510us (624us total) trans 4294991919 rc 0/0 00000100:00100000:1.0:1762166976.705334:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30332 00000020:00080000:1.0:1762166976.705337:0:6494:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1762166976.706314:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166976.706357:0:35248:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450393472 00000100:00100000:3.0:1762166976.706364:0:35248:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450393472 00000100:00100000:3.0:1762166976.706410:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18865 00000100:00100000:3.0:1762166976.706420:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3e69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+14:61842:x1847765450393472:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166976.706436:0:35248:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166976.706455:0:35248:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc8472800/0x2f180c4effbaa3ec lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e99f6 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166976.706518:0:35248:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa86:0x0] initial LVB size: 244188, mtime: 0x690888c0, atime: 0x690888bd, ctime: 0x690888c0, blocks: 0xa8 00010000:00010000:3.0:1762166976.706548:0:35248:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166976.706550:0:35248:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166976.706557:0:35248:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8472800/0x2f180c4effbaa3ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99f6 expref: 15 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.706572:0:35248:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc8472800/0x2f180c4effbaa3ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99f6 expref: 15 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.706583:0:35248:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8472800, rc 0) 00000100:00100000:3.0:1762166976.706627:0:35248:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3e69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+15:61842:x1847765450393472:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 205us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166976.706635:0:35248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18865 00000100:00100000:0.0:1762166976.707619:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.707661:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450393600 00000100:00100000:1.0:1762166976.707669:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450393600 00000100:00100000:0.0:1762166976.707682:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00002000:00010000:1.0:1762166976.707702:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2694 (4096->18446744073709551615) 00002000:00100000:1.0:1762166976.707709:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc6225880 with x1847765450393600 ext(4096->18446744073709551615) 00002000:00010000:1.0:1762166976.707720:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc6225880. 00000100:00100000:1.0:1762166976.707751:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450393728 00000100:00100000:1.0:1762166976.707755:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450393728 00002000:00010000:1.0:1762166976.707768:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2693 (0->18446744073709551615) 00002000:00100000:1.0:1762166976.707773:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc6224e00 with x1847765450393728 ext(0->18446744073709551615) 00000100:00100000:3.0:1762166976.707774:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2104 00002000:00010000:1.0:1762166976.707784:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc6224e00. 00000100:00100000:3.0:1762166976.707791:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6225880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+15:2418:x1847765450393600:12345-192.168.204.38@tcp:10:lfs.0 00000100:00100000:1.0:1762166976.707809:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2105 00000100:00100000:1.0:1762166976.707820:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6224e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450393728:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:1.0:1762166976.707961:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166976.707965:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.707968:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb atime from disk: 1762166973 -> 1762166973 00002000:00010000:1.0:1762166976.707971:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.707973:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1762166976.708022:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6224e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450393728:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 205us (339us total) trans 17179876271 rc 0/0 00000100:00100000:1.0:1762166976.708030:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2105 00002000:00010000:1.0:1762166976.708034:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2693 (0->18446744073709551615) 00002000:00100000:1.0:1762166976.708037:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc6224e00 with x1847765450393728 ext(0->18446744073709551615) 00002000:00010000:1.0:1762166976.708041:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc6224e00. 00002000:00010000:3.0:1762166976.708326:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb size from disk: 244188 -> 4096 00002000:00010000:3.0:1762166976.708330:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:3.0:1762166976.708332:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb atime from disk: 1762166973 -> 1762166973 00002000:00010000:3.0:1762166976.708334:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:3.0:1762166976.708337:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb blocks from disk: 168 -> 8 00000100:00100000:3.0:1762166976.708379:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6225880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+16:2418:x1847765450393600:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 594us (765us total) trans 21474843233 rc 0/0 00000100:00100000:3.0:1762166976.708388:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2104 00002000:00010000:3.0:1762166976.708391:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2694 (4096->18446744073709551615) 00002000:00100000:3.0:1762166976.708395:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc6225880 with x1847765450393600 ext(4096->18446744073709551615) 00002000:00010000:3.0:1762166976.708400:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc6225880. 00000100:00100000:0.0:1762166976.709776:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.709837:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450393856 00000100:00100000:1.0:1762166976.709852:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450393856 00000100:00100000:1.0:1762166976.709928:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30333 00000100:00100000:1.0:1762166976.709939:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+529:61842:x1847765450393856:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166976.709963:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166976.709991:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaa3f3 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e99fd expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.710092:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221800/0x2f180c4effbaa3fa lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166976.710107:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221800/0x2f180c4effbaa3fa lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.710117:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221800/0x2f180c4effbaa3fa lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:1.0:1762166976.710148:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 4096 00000004:00200000:1.0:1762166976.710152:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166976.710170:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221800/0x2f180c4effbaa3fa lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.710194:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaa3f3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99fd expref: 531 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.710215:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221800/0x2f180c4effbaa3fa lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99fd expref: 530 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.710224:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.710227:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166976.710231:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc6221800, rc 0) 00000100:00100000:1.0:1762166976.710294:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+530:61842:x1847765450393856:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 357us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166976.710301:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30333 00000100:00100000:2.0:1762166976.711705:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.711831:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450394112 00000100:00100000:1.0:1762166976.711840:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450394112 00000100:00100000:1.0:1762166976.711886:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30334 00000100:00100000:1.0:1762166976.711907:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+530:61842:x1847765450394112:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:1.0:1762166976.711943:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166976.711961:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221800/0x2f180c4effbaa3fa lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99fd expref: 530 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.711975:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.711978:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166976.712125:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220c00/0x2f180c4effbaa401 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166976.712137:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220c00/0x2f180c4effbaa401 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.712144:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220c00/0x2f180c4effbaa401 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000001:00080000:1.0:1762166976.712193:0:6494:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294991920 00000004:00010000:1.0:1762166976.712212:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000009d0bf92b reply state 00000000a7832828 transno 4294991921 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220c00/0x2f180c4effbaa401 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.712224:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220c00/0x2f180c4effbaa401 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.712230:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.712233:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166976.712235:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166976.712304:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+532:61842:x1847765450394112:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 410us (605us total) trans 4294991921 rc 0/0 00000100:00100000:1.0:1762166976.712319:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30334 00000020:00080000:1.0:1762166976.712324:0:6494:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1762166976.713414:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166976.713467:0:35248:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450394240 00000100:00100000:3.0:1762166976.713474:0:35248:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450394240 00000100:00100000:3.0:1762166976.713536:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18866 00000100:00100000:3.0:1762166976.713545:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+16:61842:x1847765450394240:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166976.713557:0:35248:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166976.713572:0:35248:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc8473000/0x2f180c4effbaa408 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9a04 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166976.713592:0:35248:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa88:0x0] initial LVB size: 244188, mtime: 0x690888c0, atime: 0x690888bf, ctime: 0x690888c0, blocks: 0xa8 00010000:00010000:3.0:1762166976.713608:0:35248:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166976.713610:0:35248:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166976.713617:0:35248:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8473000/0x2f180c4effbaa408 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a04 expref: 17 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.713630:0:35248:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc8473000/0x2f180c4effbaa408 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a04 expref: 17 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.713640:0:35248:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8473000, rc 0) 00000100:00100000:3.0:1762166976.713677:0:35248:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+17:61842:x1847765450394240:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 133us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166976.713683:0:35248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18866 00000100:00100000:0.0:1762166976.714787:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166976.714826:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166976.714851:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450394368 00000100:00100000:3.0:1762166976.714864:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450394368 00000100:00100000:1.0:1762166976.714872:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450394496 00000100:00100000:1.0:1762166976.714880:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450394496 00002000:00010000:3.0:1762166976.714916:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2696 (4096->18446744073709551615) 00002000:00010000:1.0:1762166976.714918:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2695 (0->18446744073709551615) 00002000:00100000:3.0:1762166976.714927:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1cd0a80 with x1847765450394368 ext(4096->18446744073709551615) 00002000:00100000:1.0:1762166976.714927:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc7b20000 with x1847765450394496 ext(0->18446744073709551615) 00002000:00010000:1.0:1762166976.714948:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc7b20000. 00002000:00010000:3.0:1762166976.714949:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945cf1cd0a80. 00000100:00100000:1.0:1762166976.714990:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2106 00000100:00100000:1.0:1762166976.715004:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450394496:12345-192.168.204.38@tcp:10:lfs.0 00000100:00100000:3.0:1762166976.715017:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2107 00000100:00100000:3.0:1762166976.715033:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450394368:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:1.0:1762166976.715126:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166976.715131:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.715134:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00002000:00010000:1.0:1762166976.715137:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.715140:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1762166976.715183:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450394496:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 181us (354us total) trans 17179876272 rc 0/0 00000100:00100000:1.0:1762166976.715195:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2106 00002000:00010000:1.0:1762166976.715200:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2695 (0->18446744073709551615) 00002000:00100000:1.0:1762166976.715204:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc7b20000 with x1847765450394496 ext(0->18446744073709551615) 00002000:00010000:1.0:1762166976.715210:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc7b20000. 00002000:00010000:3.0:1762166976.715607:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb size from disk: 244188 -> 4096 00002000:00010000:3.0:1762166976.715613:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:3.0:1762166976.715615:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166976.715618:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:3.0:1762166976.715620:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb blocks from disk: 168 -> 8 00000100:00100000:3.0:1762166976.715679:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450394368:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 650us (893us total) trans 21474843234 rc 0/0 00000100:00100000:3.0:1762166976.715689:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2107 00002000:00010000:3.0:1762166976.715693:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2696 (4096->18446744073709551615) 00002000:00100000:3.0:1762166976.715698:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1cd0a80 with x1847765450394368 ext(4096->18446744073709551615) 00002000:00010000:3.0:1762166976.715705:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945cf1cd0a80. 00000100:00100000:0.0:1762166976.716788:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.716837:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450394624 00000100:00100000:1.0:1762166976.716844:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450394624 00000100:00100000:1.0:1762166976.716878:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30335 00000100:00100000:1.0:1762166976.716885:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+532:61842:x1847765450394624:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166976.716912:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166976.716929:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa40f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9a0b expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.717001:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221000/0x2f180c4effbaa416 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166976.717015:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221000/0x2f180c4effbaa416 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.717024:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221000/0x2f180c4effbaa416 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:1.0:1762166976.717046:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 4096 00000004:00200000:1.0:1762166976.717051:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166976.717065:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221000/0x2f180c4effbaa416 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.717085:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa40f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a0b expref: 534 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.717100:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221000/0x2f180c4effbaa416 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a0b expref: 533 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.717107:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.717110:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166976.717112:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc6221000, rc 0) 00000100:00100000:1.0:1762166976.717157:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+533:61842:x1847765450394624:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 272us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166976.717164:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30335 00000100:00100000:2.0:1762166976.718697:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166976.718838:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450394752 00000100:00100000:3.0:1762166976.718844:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450394752 00000100:00100000:3.0:1762166976.718902:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2108 00000100:00100000:3.0:1762166976.718912:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:2416:x1847765450394752:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:3.0:1762166976.718956:0:8388:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8473a00/0x2f180c4effbaa41d lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.718969:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166976.718971:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166976.718976:0:8388:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8473a00/0x2f180c4effbaa41d lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [28672->36863] (req 28672->36863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.718987:0:8388:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8473a00/0x2f180c4effbaa41d lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [28672->36863] (req 28672->36863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.719077:0:8388:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8473a00/0x2f180c4effbaa41d lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [28672->36863] (req 28672->36863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.719086:0:8388:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8473a00/0x2f180c4effbaa41d lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [28672->36863] (req 28672->36863) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.719095:0:8388:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc8473a00/0x2f180c4effbaa41d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [28672->36863] (req 28672->36863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.719102:0:8388:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8473a00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166976.719106:0:8388:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8473a00/0x2f180c4effbaa41d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [28672->36863] (req 28672->36863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.719115:0:8388:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8473a00/0x2f180c4effbaa41d lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [28672->36863] (req 28672->36863) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.719129:0:8388:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc8473a00/0x2f180c4effbaa41d lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [28672->36863] (req 28672->36863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.719137:0:8388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8473a00/0x2f180c4effbaa41d lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [28672->36863] (req 28672->36863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166976.719183:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:2416:x1847765450394752:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 272us (489us total) trans 0 rc 8192/8192 00000100:00100000:3.0:1762166976.719191:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2108 00000100:00100000:2.0:1762166976.720670:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166976.720753:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450394880 00000100:00100000:3.0:1762166976.720759:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450394880 00000100:00100000:3.0:1762166976.720801:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2109 00000100:00100000:3.0:1762166976.720809:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+18:2417:x1847765450394880:12345-192.168.204.38@tcp:4:lfs.0 00010000:00010000:3.0:1762166976.720831:0:8388:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc8472a00/0x2f180c4effbaa424 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.720845:0:8388:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc8472800/0x2f180c4effbaa3ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99f6 expref: 18 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.720853:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166976.720855:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166976.720857:0:8388:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8472a00/0x2f180c4effbaa424 lrc: 4/0,1 mode: --/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [28672->36863] (req 28672->36863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.720903:0:8388:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc8472800/0x2f180c4effbaa3ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99f6 expref: 18 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.720918:0:8388:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc8472800/0x2f180c4effbaa3ec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99f6 expref: 18 pid: 35248 timeout: 695 lvb_type: 0 00000100:00100000:3.0:1762166976.720932:0:8388:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcce77800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0000_UUID:8388:1847765449702528:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166976.721007:0:8388:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc2c72900 going to sleep for 11 seconds 00000100:00100000:3.0:1762166976.722029:0:8388:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcce77800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0000_UUID:8388:1847765449702528:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166976.722050:0:8388:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bc8472a00/0x2f180c4effbaa424 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [28672->36863] (req 28672->36863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166976.722082:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166976.722164:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450395008 00000100:00100000:0.0:1762166976.722170:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450395008 00010000:00010000:0.0:1762166976.722192:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8472800/0x2f180c4effbaa3ec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99f6 expref: 19 pid: 35248 timeout: 695 lvb_type: 0 00000100:00100000:0.0:1762166976.722222:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9523 00000100:00100000:0.0:1762166976.722232:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450395008:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166976.722243:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166976.722261:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc8472800/0x2f180c4effbaa3ec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99f6 expref: 19 pid: 35248 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166976.722273:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc8472800/0x2f180c4effbaa3ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99f6 expref: 19 pid: 35248 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166976.722290:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc8472800/0x2f180c4effbaa3ec lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99f6 expref: 19 pid: 35248 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166976.722301:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166976.722303:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166976.722306:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc8472a00/0x2f180c4effbaa424 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [28672->36863] (req 28672->36863) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.722314:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8472a00/0x2f180c4effbaa424 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [28672->36863] (req 28672->36863) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.722337:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166976.722365:0:8388:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bc8472a00/0x2f180c4effbaa424 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [28672->36863] (req 28672->36863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166976.722371:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450395008:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 139us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166976.722388:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9523 00010000:00010000:3.0:1762166976.722389:0:8388:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc8472a00/0x2f180c4effbaa424 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [28672->36863] (req 28672->36863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000001:00080000:2.0:1762166976.724051:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843235 is committed 00002000:00010000:3.0:1762166976.724200:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb size from disk: 4096 -> 36864 00002000:00010000:3.0:1762166976.724210:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb blocks from disk: 8 -> 24 00010000:00010000:3.0:1762166976.724223:0:8388:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc8472a00/0x2f180c4effbaa424 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [28672->36863] (req 28672->36863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.724235:0:8388:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8472a00/0x2f180c4effbaa424 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [28672->36863] (req 28672->36863) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.724245:0:8388:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc8472a00/0x2f180c4effbaa424 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [28672->36863] (req 28672->36863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.724268:0:8388:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8472a00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166976.724273:0:8388:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc8472a00/0x2f180c4effbaa424 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [28672->36863] (req 28672->36863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.724282:0:8388:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc8472a00/0x2f180c4effbaa424 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [28672->36863] (req 28672->36863) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.724303:0:8388:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc8472a00/0x2f180c4effbaa424 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [28672->36863] (req 28672->36863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.724311:0:8388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc8472a00/0x2f180c4effbaa424 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [28672->36863] (req 28672->36863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166976.724407:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+15:2417:x1847765450394880:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 3595us (3735us total) trans 21474843235 rc 0/0 00000100:00100000:3.0:1762166976.724420:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2109 00000100:00100000:2.0:1762166976.726742:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166976.726814:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450395136 00000100:00100000:3.0:1762166976.726823:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450395136 00000100:00100000:3.0:1762166976.726883:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2110 00000100:00100000:3.0:1762166976.726903:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1dded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+15:2418:x1847765450395136:12345-192.168.204.38@tcp:4:lfs.0 00010000:00010000:3.0:1762166976.726937:0:8388:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc8473a00/0x2f180c4effbaa42b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.726956:0:8388:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc8473000/0x2f180c4effbaa408 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a04 expref: 15 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.726963:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166976.726965:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166976.726969:0:8388:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8473a00/0x2f180c4effbaa42b lrc: 4/0,1 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [28672->36863] (req 28672->36863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.726998:0:8388:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc8473000/0x2f180c4effbaa408 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a04 expref: 15 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.727011:0:8388:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc8473000/0x2f180c4effbaa408 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a04 expref: 15 pid: 35248 timeout: 695 lvb_type: 0 00000100:00100000:3.0:1762166976.727025:0:8388:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcce77800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0000_UUID:8388:1847765449702656:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166976.727099:0:8388:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc2c72900 going to sleep for 11 seconds 00000100:00100000:3.0:1762166976.728105:0:8388:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcce77800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0000_UUID:8388:1847765449702656:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166976.728125:0:8388:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bc8473a00/0x2f180c4effbaa42b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [28672->36863] (req 28672->36863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166976.728149:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166976.728195:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450395264 00000100:00100000:0.0:1762166976.728201:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450395264 00010000:00010000:0.0:1762166976.728224:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8473000/0x2f180c4effbaa408 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a04 expref: 16 pid: 35248 timeout: 695 lvb_type: 0 00000100:00100000:0.0:1762166976.728252:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9524 00000100:00100000:0.0:1762166976.728259:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+16:2418:x1847765450395264:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166976.728270:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166976.728287:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc8473000/0x2f180c4effbaa408 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a04 expref: 16 pid: 35248 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166976.728299:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc8473000/0x2f180c4effbaa408 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a04 expref: 16 pid: 35248 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166976.728320:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc8473000/0x2f180c4effbaa408 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a04 expref: 16 pid: 35248 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166976.728333:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166976.728335:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166976.728340:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc8473a00/0x2f180c4effbaa42b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [28672->36863] (req 28672->36863) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.728350:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8473a00/0x2f180c4effbaa42b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [28672->36863] (req 28672->36863) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.728375:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166976.728390:0:8388:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bc8473a00/0x2f180c4effbaa42b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [28672->36863] (req 28672->36863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.728406:0:8388:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc8473a00/0x2f180c4effbaa42b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [28672->36863] (req 28672->36863) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166976.728419:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+15:2418:x1847765450395264:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 157us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166976.728429:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9524 00000001:00080000:2.0:1762166976.729816:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843236 is committed 00002000:00010000:3.0:1762166976.729883:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb size from disk: 4096 -> 36864 00002000:00010000:3.0:1762166976.729888:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb blocks from disk: 8 -> 24 00010000:00010000:3.0:1762166976.729908:0:8388:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc8473a00/0x2f180c4effbaa42b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [28672->36863] (req 28672->36863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.729918:0:8388:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8473a00/0x2f180c4effbaa42b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [28672->36863] (req 28672->36863) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.729927:0:8388:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc8473a00/0x2f180c4effbaa42b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [28672->36863] (req 28672->36863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.729934:0:8388:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8473a00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166976.729939:0:8388:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc8473a00/0x2f180c4effbaa42b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [28672->36863] (req 28672->36863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.729947:0:8388:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc8473a00/0x2f180c4effbaa42b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [28672->36863] (req 28672->36863) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.729963:0:8388:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc8473a00/0x2f180c4effbaa42b lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [28672->36863] (req 28672->36863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.729970:0:8388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc8473a00/0x2f180c4effbaa42b lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [28672->36863] (req 28672->36863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166976.730050:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1dded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+14:2418:x1847765450395136:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 3156us (3310us total) trans 21474843236 rc 0/0 00000100:00100000:3.0:1762166976.730063:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2110 00000100:00100000:2.0:1762166976.731726:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166976.731766:0:35248:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450395392 00000100:00100000:3.0:1762166976.731777:0:35248:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450395392 00000100:00100000:3.0:1762166976.731835:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18867 00000100:00100000:3.0:1762166976.731846:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4533480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450395392:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:3.0:1762166976.731968:0:35248:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4533480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450395392:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 123us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166976.731975:0:35248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18867 00000100:00100000:0.0:1762166976.733205:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166976.733241:0:35248:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450395520 00000100:00100000:3.0:1762166976.733247:0:35248:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450395520 00000100:00100000:3.0:1762166976.733278:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18868 00000100:00100000:3.0:1762166976.733283:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450395520:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:3.0:1762166976.733333:0:35248:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450395520:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 50us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166976.733338:0:35248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18868 00000100:00100000:2.0:1762166976.734601:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.734660:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450395776 00000100:00100000:1.0:1762166976.734665:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450395776 00000100:00100000:1.0:1762166976.734711:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30336 00000100:00100000:1.0:1762166976.734720:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4530700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+533:61842:x1847765450395776:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:1.0:1762166976.734788:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166976.734819:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221000/0x2f180c4effbaa416 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a0b expref: 533 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.734837:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.734843:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166976.735053:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa432 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166976.735069:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa432 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.735080:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa432 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000001:00080000:1.0:1762166976.735126:0:6494:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294991922 00000004:00010000:1.0:1762166976.735150:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000001c9f84da reply state 00000000052d9b40 transno 4294991923 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa432 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.735168:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa432 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.735175:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.735178:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166976.735181:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166976.735253:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4530700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+535:61842:x1847765450395776:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 535us (656us total) trans 4294991923 rc 0/0 00000100:00100000:1.0:1762166976.735258:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30336 00000020:00080000:1.0:1762166976.735261:0:6494:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1762166976.736217:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166976.736281:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450395904 00000100:00100000:0.0:1762166976.736294:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450395904 00000100:00100000:0.0:1762166976.736351:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18869 00000100:00100000:0.0:1762166976.736363:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4531f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+14:61842:x1847765450395904:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166976.736380:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166976.736401:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf000/0x2f180c4effbaa439 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9a12 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166976.736424:0:28434:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa86:0x0] initial LVB size: 36864, mtime: 0x690888c0, atime: 0x690888bd, ctime: 0x690888c0, blocks: 0x18 00010000:00010000:0.0:1762166976.736444:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166976.736446:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166976.736453:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf000/0x2f180c4effbaa439 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a12 expref: 15 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.736468:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf000/0x2f180c4effbaa439 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a12 expref: 15 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.736508:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdf000, rc 0) 00000100:00100000:0.0:1762166976.736575:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4531f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+15:61842:x1847765450395904:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 215us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166976.736583:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18869 00000100:00100000:0.0:1762166976.738014:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166976.738053:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450396032 00000100:00100000:3.0:1762166976.738060:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450396032 00002000:00010000:3.0:1762166976.738086:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2694 (36864->18446744073709551615) 00002000:00100000:3.0:1762166976.738091:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc7b21f80 with x1847765450396032 ext(36864->18446744073709551615) 00002000:00010000:3.0:1762166976.738099:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc7b21f80. 00000100:00100000:3.0:1762166976.738124:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2111 00000100:00100000:3.0:1762166976.738132:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+15:2419:x1847765450396032:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:3.0:1762166976.738349:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb size from disk: 36864 -> 36864 00002000:00010000:3.0:1762166976.738353:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:3.0:1762166976.738355:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb atime from disk: 1762166973 -> 1762166973 00002000:00010000:3.0:1762166976.738358:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:3.0:1762166976.738360:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb blocks from disk: 24 -> 24 00000100:00100000:3.0:1762166976.738399:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+16:2419:x1847765450396032:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 267us (385us total) trans 21474843237 rc 0/0 00000100:00100000:3.0:1762166976.738408:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2111 00002000:00010000:3.0:1762166976.738413:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2694 (36864->18446744073709551615) 00002000:00100000:3.0:1762166976.738416:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc7b21f80 with x1847765450396032 ext(36864->18446744073709551615) 00002000:00010000:3.0:1762166976.738420:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc7b21f80. 00000100:00100000:1.0:1762166976.738464:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166976.738569:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450396160 00000100:00100000:3.0:1762166976.738574:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450396160 00002000:00010000:3.0:1762166976.738639:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2693 (0->18446744073709551615) 00002000:00100000:3.0:1762166976.738643:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc47b4380 with x1847765450396160 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166976.738651:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc47b4380. 00000100:00100000:3.0:1762166976.738673:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2112 00000100:00100000:3.0:1762166976.738681:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450396160:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:3.0:1762166976.738753:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166976.738757:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:3.0:1762166976.738759:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb atime from disk: 1762166973 -> 1762166973 00002000:00010000:3.0:1762166976.738761:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:3.0:1762166976.738764:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166976.738803:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450396160:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 123us (339us total) trans 17179876273 rc 0/0 00000100:00100000:3.0:1762166976.738814:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2112 00002000:00010000:3.0:1762166976.738817:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2693 (0->18446744073709551615) 00002000:00100000:3.0:1762166976.738819:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc47b4380 with x1847765450396160 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166976.738824:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc47b4380. 00000100:00100000:1.0:1762166976.739841:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166976.739932:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450396288 00000100:00100000:2.0:1762166976.739939:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450396288 00000100:00100000:2.0:1762166976.739984:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30337 00000100:00100000:2.0:1762166976.739993:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+535:61842:x1847765450396288:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166976.740010:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166976.740026:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbaa440 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9a19 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.740108:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbaa447 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166976.740122:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbaa447 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166976.740133:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbaa447 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:2.0:1762166976.740158:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 36864 00000004:00200000:2.0:1762166976.740162:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166976.740177:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbaa447 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166976.740201:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbaa440 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a19 expref: 537 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.740218:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbaa447 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a19 expref: 536 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.740232:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166976.740235:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166976.740238:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa8800, rc 0) 00000100:00100000:2.0:1762166976.740287:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+536:61842:x1847765450396288:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 295us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166976.740294:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30337 00000100:00100000:0.0:1762166976.741921:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166976.741966:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450396544 00000100:00100000:2.0:1762166976.741973:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450396544 00000100:00100000:2.0:1762166976.742016:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30338 00000100:00100000:2.0:1762166976.742026:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+536:61842:x1847765450396544:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:2.0:1762166976.742061:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166976.742080:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbaa447 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a19 expref: 536 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.742095:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166976.742099:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166976.742234:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbaa44e lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166976.742246:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbaa44e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166976.742253:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbaa44e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000001:00080000:2.0:1762166976.742293:0:6494:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294991924 00000004:00010000:2.0:1762166976.742315:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000021ed5742 reply state 000000002db9b945 transno 4294991925 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbaa44e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166976.742331:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbaa44e lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166976.742337:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166976.742340:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166976.742342:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166976.742406:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+538:61842:x1847765450396544:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 381us (488us total) trans 4294991925 rc 0/0 00000100:00100000:2.0:1762166976.742412:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30338 00000020:00080000:2.0:1762166976.742416:0:6494:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1762166976.743329:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.743420:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450396672 00000100:00100000:1.0:1762166976.743427:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450396672 00000100:00100000:1.0:1762166976.743465:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18870 00000100:00100000:1.0:1762166976.743472:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+16:61842:x1847765450396672:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166976.743507:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166976.743524:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc6221400/0x2f180c4effbaa455 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9a20 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762166976.743544:0:28434:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa88:0x0] initial LVB size: 36864, mtime: 0x690888c0, atime: 0x690888bf, ctime: 0x690888c0, blocks: 0x18 00010000:00010000:1.0:1762166976.743558:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166976.743559:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166976.743564:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc6221400/0x2f180c4effbaa455 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a20 expref: 17 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.743573:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc6221400/0x2f180c4effbaa455 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a20 expref: 17 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.743584:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc6221400, rc 0) 00000100:00100000:1.0:1762166976.743619:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+17:61842:x1847765450396672:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 149us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166976.743624:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18870 00000100:00100000:1.0:1762166976.744999:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.745058:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166976.745082:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450396800 00000100:00100000:3.0:1762166976.745089:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450396800 00002000:00010000:3.0:1762166976.745116:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2696 (36864->18446744073709551615) 00000100:00100000:0.0:1762166976.745120:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450396928 00002000:00100000:3.0:1762166976.745121:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc47b4e00 with x1847765450396800 ext(36864->18446744073709551615) 00000100:00100000:0.0:1762166976.745128:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450396928 00002000:00010000:3.0:1762166976.745132:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc47b4e00. 00002000:00010000:0.0:1762166976.745150:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2695 (0->18446744073709551615) 00002000:00100000:0.0:1762166976.745156:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc47b5180 with x1847765450396928 ext(0->18446744073709551615) 00000100:00100000:3.0:1762166976.745163:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2113 00002000:00010000:0.0:1762166976.745164:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc47b5180. 00000100:00100000:3.0:1762166976.745176:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450396800:12345-192.168.204.38@tcp:10:lfs.0 00000100:00100000:1.0:1762166976.745200:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2114 00000100:00100000:1.0:1762166976.745212:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450396928:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:1.0:1762166976.745310:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166976.745314:0:23939:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.745317:0:23939:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00002000:00010000:1.0:1762166976.745319:0:23939:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:3.0:1762166976.745322:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb size from disk: 36864 -> 36864 00002000:00010000:1.0:1762166976.745322:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:3.0:1762166976.745331:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:3.0:1762166976.745335:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166976.745337:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:3.0:1762166976.745340:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb blocks from disk: 24 -> 24 00000100:00100000:1.0:1762166976.745366:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450396928:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 157us (313us total) trans 17179876274 rc 0/0 00000100:00100000:3.0:1762166976.745372:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450396800:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 196us (374us total) trans 21474843238 rc 0/0 00000100:00100000:1.0:1762166976.745380:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2114 00002000:00010000:1.0:1762166976.745384:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2695 (0->18446744073709551615) 00000100:00100000:3.0:1762166976.745388:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2113 00002000:00100000:1.0:1762166976.745390:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc47b5180 with x1847765450396928 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166976.745394:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2696 (36864->18446744073709551615) 00002000:00010000:1.0:1762166976.745397:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc47b5180. 00002000:00100000:3.0:1762166976.745399:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc47b4e00 with x1847765450396800 ext(36864->18446744073709551615) 00002000:00010000:3.0:1762166976.745407:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc47b4e00. 00000100:00100000:0.0:1762166976.746446:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166976.746510:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450397056 00000100:00100000:2.0:1762166976.746516:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450397056 00000100:00100000:2.0:1762166976.746554:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30339 00000100:00100000:2.0:1762166976.746563:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+538:61842:x1847765450397056:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166976.746579:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166976.746593:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbaa45c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9a27 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.746664:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbaa463 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166976.746677:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbaa463 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166976.746686:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbaa463 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:2.0:1762166976.746711:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 36864 00000004:00200000:2.0:1762166976.746715:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166976.746729:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbaa463 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166976.746752:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbaa45c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a27 expref: 540 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.746768:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbaa463 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a27 expref: 539 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.746775:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166976.746778:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166976.746781:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa8200, rc 0) 00000100:00100000:2.0:1762166976.746816:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+539:61842:x1847765450397056:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 255us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166976.746823:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30339 00000100:00100000:0.0:1762166976.748317:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166976.748408:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450397184 00000100:00100000:3.0:1762166976.748414:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450397184 00000100:00100000:3.0:1762166976.748458:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2115 00000100:00100000:3.0:1762166976.748467:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+22:2416:x1847765450397184:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:3.0:1762166976.748515:0:8388:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8473a00/0x2f180c4effbaa46a lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.748527:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166976.748530:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166976.748534:0:8388:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8473a00/0x2f180c4effbaa46a lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [98304->147455] (req 98304->147455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166976.748544:0:8388:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8473a00/0x2f180c4effbaa46a lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [98304->147455] (req 98304->147455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.749698:0:8388:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8473a00/0x2f180c4effbaa46a lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [98304->147455] (req 98304->147455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.749710:0:8388:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8473a00/0x2f180c4effbaa46a lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [98304->147455] (req 98304->147455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.749719:0:8388:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc8473a00/0x2f180c4effbaa46a lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [98304->147455] (req 98304->147455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.749727:0:8388:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8473a00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166976.749731:0:8388:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8473a00/0x2f180c4effbaa46a lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [98304->147455] (req 98304->147455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.749739:0:8388:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8473a00/0x2f180c4effbaa46a lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [98304->147455] (req 98304->147455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.749759:0:8388:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc8473a00/0x2f180c4effbaa46a lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [98304->147455] (req 98304->147455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.749767:0:8388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8473a00/0x2f180c4effbaa46a lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [98304->147455] (req 98304->147455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166976.749811:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+22:2416:x1847765450397184:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 1344us (1498us total) trans 0 rc 49152/49152 00000100:00100000:2.0:1762166976.749817:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2115 00000100:00100000:0.0:1762166976.751389:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166976.751431:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450397312 00000100:00100000:2.0:1762166976.751438:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450397312 00000100:00100000:2.0:1762166976.751501:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2116 00000100:00100000:2.0:1762166976.751510:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+18:2417:x1847765450397312:12345-192.168.204.38@tcp:4:lfs.0 00010000:00010000:2.0:1762166976.751533:0:8388:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8000/0x2f180c4effbaa471 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.751547:0:8388:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf000/0x2f180c4effbaa439 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a12 expref: 18 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.751555:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166976.751557:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166976.751561:0:8388:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8000/0x2f180c4effbaa471 lrc: 4/0,1 mode: --/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [98304->147455] (req 98304->147455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.751590:0:8388:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf000/0x2f180c4effbaa439 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a12 expref: 18 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.751613:0:8388:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf000/0x2f180c4effbaa439 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a12 expref: 18 pid: 28434 timeout: 695 lvb_type: 0 00000100:00100000:2.0:1762166976.751627:0:8388:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bccb7e300 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0000_UUID:8388:1847765449702784:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166976.751703:0:8388:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1dcef00 going to sleep for 11 seconds 00000100:00100000:2.0:1762166976.752946:0:8388:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bccb7e300 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0000_UUID:8388:1847765449702784:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166976.752966:0:8388:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8000/0x2f180c4effbaa471 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [98304->147455] (req 98304->147455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166976.753255:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166976.753306:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450397440 00000100:00100000:2.0:1762166976.753312:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450397440 00010000:00010000:2.0:1762166976.753351:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf000/0x2f180c4effbaa439 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a12 expref: 19 pid: 28434 timeout: 695 lvb_type: 0 00000100:00100000:2.0:1762166976.753385:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9525 00000100:00100000:2.0:1762166976.753395:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450397440:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166976.753406:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166976.753429:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf000/0x2f180c4effbaa439 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a12 expref: 19 pid: 28434 timeout: 695 lvb_type: 0 00010000:00010000:2.0:1762166976.753440:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf000/0x2f180c4effbaa439 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a12 expref: 19 pid: 28434 timeout: 695 lvb_type: 0 00010000:00010000:2.0:1762166976.753459:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf000/0x2f180c4effbaa439 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a12 expref: 19 pid: 28434 timeout: 695 lvb_type: 0 00010000:00010000:2.0:1762166976.753472:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166976.753474:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166976.753513:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8000/0x2f180c4effbaa471 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [98304->147455] (req 98304->147455) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.753523:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8000/0x2f180c4effbaa471 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [98304->147455] (req 98304->147455) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.753544:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166976.753563:0:8388:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8000/0x2f180c4effbaa471 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [98304->147455] (req 98304->147455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.753575:0:8388:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8000/0x2f180c4effbaa471 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [98304->147455] (req 98304->147455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166976.753590:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450397440:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 196us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166976.753600:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9525 00000001:00080000:3.0:1762166976.757076:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843239 is committed 00002000:00010000:2.0:1762166976.757179:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb size from disk: 36864 -> 147456 00002000:00010000:2.0:1762166976.757184:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb blocks from disk: 24 -> 120 00010000:00010000:2.0:1762166976.757195:0:8388:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8000/0x2f180c4effbaa471 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [98304->147455] (req 98304->147455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.757206:0:8388:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8000/0x2f180c4effbaa471 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [98304->147455] (req 98304->147455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.757213:0:8388:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8000/0x2f180c4effbaa471 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [98304->147455] (req 98304->147455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.757218:0:8388:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa8000 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166976.757222:0:8388:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8000/0x2f180c4effbaa471 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [98304->147455] (req 98304->147455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.757235:0:8388:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8000/0x2f180c4effbaa471 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [98304->147455] (req 98304->147455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.757250:0:8388:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8000/0x2f180c4effbaa471 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [98304->147455] (req 98304->147455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.757257:0:8388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8000/0x2f180c4effbaa471 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [98304->147455] (req 98304->147455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166976.757345:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+15:2417:x1847765450397312:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 5834us (5957us total) trans 21474843239 rc 0/0 00000100:00100000:2.0:1762166976.757354:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2116 00000100:00100000:2.0:1762166976.760806:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166976.760905:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450397568 00000100:00100000:0.0:1762166976.760913:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450397568 00000100:00100000:0.0:1762166976.760979:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2117 00000100:00100000:0.0:1762166976.760989:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+15:2418:x1847765450397568:12345-192.168.204.38@tcp:4:lfs.0 00010000:00010000:0.0:1762166976.761024:0:8388:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde400/0x2f180c4effbaa478 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.761042:0:8388:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc6221400/0x2f180c4effbaa455 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a20 expref: 15 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.761052:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166976.761054:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166976.761057:0:8388:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde400/0x2f180c4effbaa478 lrc: 4/0,1 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [98304->147455] (req 98304->147455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.761089:0:8388:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc6221400/0x2f180c4effbaa455 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a20 expref: 15 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.761102:0:8388:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc6221400/0x2f180c4effbaa455 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a20 expref: 15 pid: 28434 timeout: 695 lvb_type: 0 00000100:00100000:0.0:1762166976.761117:0:8388:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0000_UUID:8388:1847765449702912:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166976.761193:0:8388:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc10c1e40 going to sleep for 11 seconds 00000100:00100000:0.0:1762166976.762538:0:8388:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0000_UUID:8388:1847765449702912:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166976.762571:0:8388:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde400/0x2f180c4effbaa478 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [98304->147455] (req 98304->147455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166976.762718:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166976.762786:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450397696 00000100:00100000:0.0:1762166976.762799:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450397696 00010000:00010000:0.0:1762166976.762831:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc6221400/0x2f180c4effbaa455 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a20 expref: 16 pid: 28434 timeout: 695 lvb_type: 0 00000100:00100000:0.0:1762166976.762861:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9526 00000100:00100000:0.0:1762166976.762867:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf9d1c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+16:2418:x1847765450397696:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166976.762880:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166976.762912:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc6221400/0x2f180c4effbaa455 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a20 expref: 16 pid: 28434 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166976.762922:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc6221400/0x2f180c4effbaa455 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a20 expref: 16 pid: 28434 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166976.762948:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc6221400/0x2f180c4effbaa455 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a20 expref: 16 pid: 28434 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166976.762966:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166976.762969:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166976.762973:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde400/0x2f180c4effbaa478 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [98304->147455] (req 98304->147455) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.762983:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde400/0x2f180c4effbaa478 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [98304->147455] (req 98304->147455) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.763014:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166976.763052:0:8388:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde400/0x2f180c4effbaa478 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [98304->147455] (req 98304->147455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.763064:0:8388:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde400/0x2f180c4effbaa478 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [98304->147455] (req 98304->147455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166976.763076:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf9d1c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+15:2418:x1847765450397696:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 207us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166976.763086:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9526 00000001:00080000:3.0:1762166976.765879:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843240 is committed 00002000:00010000:0.0:1762166976.766013:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb size from disk: 36864 -> 147456 00002000:00010000:0.0:1762166976.766018:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb blocks from disk: 24 -> 120 00010000:00010000:0.0:1762166976.766032:0:8388:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde400/0x2f180c4effbaa478 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [98304->147455] (req 98304->147455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.766044:0:8388:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde400/0x2f180c4effbaa478 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [98304->147455] (req 98304->147455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.766053:0:8388:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde400/0x2f180c4effbaa478 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [98304->147455] (req 98304->147455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.766060:0:8388:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bde400 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166976.766065:0:8388:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde400/0x2f180c4effbaa478 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [98304->147455] (req 98304->147455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.766073:0:8388:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde400/0x2f180c4effbaa478 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [98304->147455] (req 98304->147455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.766093:0:8388:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde400/0x2f180c4effbaa478 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [98304->147455] (req 98304->147455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.766100:0:8388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde400/0x2f180c4effbaa478 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [98304->147455] (req 98304->147455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166976.766208:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+14:2418:x1847765450397568:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 5215us (5411us total) trans 21474843240 rc 0/0 00000100:00100000:0.0:1762166976.766219:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2117 00000100:00100000:3.0:1762166976.768287:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.768368:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450397824 00000100:00100000:1.0:1762166976.768379:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450397824 00000100:00100000:1.0:1762166976.768456:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18871 00000100:00100000:1.0:1762166976.768469:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450397824:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:1.0:1762166976.768632:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450397824:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 167us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166976.768639:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18871 00000100:00100000:3.0:1762166976.770723:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.770788:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450397952 00000100:00100000:1.0:1762166976.770796:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450397952 00000100:00100000:1.0:1762166976.770844:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18872 00000100:00100000:1.0:1762166976.770853:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450397952:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:1.0:1762166976.770976:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450397952:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 123us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166976.770984:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18872 00000100:00100000:2.0:1762166976.772669:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.772715:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450398208 00000100:00100000:1.0:1762166976.772727:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450398208 00000100:00100000:1.0:1762166976.772786:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30340 00000100:00100000:1.0:1762166976.772799:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+539:61842:x1847765450398208:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:1.0:1762166976.772853:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166976.772878:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbaa463 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a27 expref: 539 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.772908:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.772913:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166976.773074:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221000/0x2f180c4effbaa47f lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166976.773089:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221000/0x2f180c4effbaa47f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.773098:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221000/0x2f180c4effbaa47f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000001:00080000:1.0:1762166976.773142:0:6494:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294991926 00000004:00010000:1.0:1762166976.773164:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000e3a464a8 reply state 000000005189b4fa transno 4294991927 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221000/0x2f180c4effbaa47f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.773175:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221000/0x2f180c4effbaa47f lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.773181:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.773184:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166976.773187:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166976.773290:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+541:61842:x1847765450398208:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 495us (627us total) trans 4294991927 rc 0/0 00000100:00100000:1.0:1762166976.773298:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30340 00000020:00080000:1.0:1762166976.773304:0:6494:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1762166976.774449:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.774544:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450398336 00000100:00100000:1.0:1762166976.774553:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450398336 00000100:00100000:1.0:1762166976.774598:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18873 00000100:00100000:1.0:1762166976.774610:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+14:61842:x1847765450398336:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166976.774623:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166976.774640:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc6221800/0x2f180c4effbaa486 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9a2e expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762166976.774662:0:28434:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa86:0x0] initial LVB size: 147456, mtime: 0x690888c0, atime: 0x690888bd, ctime: 0x690888c0, blocks: 0x78 00010000:00010000:1.0:1762166976.774678:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166976.774681:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166976.774687:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc6221800/0x2f180c4effbaa486 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a2e expref: 15 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.774699:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc6221800/0x2f180c4effbaa486 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a2e expref: 15 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.774710:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc6221800, rc 0) 00000100:00100000:1.0:1762166976.774751:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+15:61842:x1847765450398336:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 145us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166976.774759:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18873 00000100:00100000:3.0:1762166976.775809:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166976.775833:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166976.775867:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450398464 00000100:00100000:0.0:1762166976.775876:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450398464 00000100:00100000:1.0:1762166976.775882:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450398592 00000100:00100000:1.0:1762166976.775901:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450398592 00002000:00010000:0.0:1762166976.775916:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2694 (147456->18446744073709551615) 00002000:00100000:0.0:1762166976.775922:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bcce74380 with x1847765450398464 ext(147456->18446744073709551615) 00002000:00010000:0.0:1762166976.775931:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bcce74380. 00002000:00010000:1.0:1762166976.775933:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2693 (0->18446744073709551615) 00002000:00100000:1.0:1762166976.775939:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bcce74a80 with x1847765450398592 ext(0->18446744073709551615) 00002000:00010000:1.0:1762166976.775951:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bcce74a80. 00000100:00100000:0.0:1762166976.775967:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2118 00000100:00100000:0.0:1762166976.775986:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+15:2419:x1847765450398464:12345-192.168.204.38@tcp:10:lfs.0 00000100:00100000:1.0:1762166976.775998:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2119 00000100:00100000:1.0:1762166976.776019:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765450398592:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:0.0:1762166976.776132:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb size from disk: 147456 -> 147456 00002000:00010000:0.0:1762166976.776138:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:0.0:1762166976.776141:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb atime from disk: 1762166973 -> 1762166973 00002000:00010000:0.0:1762166976.776144:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:0.0:1762166976.776147:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb blocks from disk: 120 -> 120 00002000:00010000:1.0:1762166976.776170:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166976.776176:0:23939:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.776180:0:23939:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb atime from disk: 1762166973 -> 1762166973 00002000:00010000:1.0:1762166976.776183:0:23939:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb ctime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.776185:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1762166976.776214:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+16:2419:x1847765450398464:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 233us (401us total) trans 21474843241 rc 0/0 00000100:00100000:0.0:1762166976.776225:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2118 00002000:00010000:0.0:1762166976.776230:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2694 (147456->18446744073709551615) 00000100:00100000:1.0:1762166976.776239:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765450398592:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 223us (396us total) trans 17179876275 rc 0/0 00002000:00100000:0.0:1762166976.776240:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bcce74380 with x1847765450398464 ext(147456->18446744073709551615) 00002000:00010000:0.0:1762166976.776258:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bcce74380. 00000100:00100000:1.0:1762166976.776266:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2119 00002000:00010000:1.0:1762166976.776275:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2693 (0->18446744073709551615) 00002000:00100000:1.0:1762166976.776281:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bcce74a80 with x1847765450398592 ext(0->18446744073709551615) 00002000:00010000:1.0:1762166976.776289:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bcce74a80. 00000100:00100000:2.0:1762166976.777378:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.777418:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450398720 00000100:00100000:1.0:1762166976.777424:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450398720 00000100:00100000:1.0:1762166976.777468:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30341 00000100:00100000:1.0:1762166976.777502:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+541:61842:x1847765450398720:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166976.777524:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166976.777545:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221600/0x2f180c4effbaa48d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9a35 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.777678:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220400/0x2f180c4effbaa494 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166976.777695:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220400/0x2f180c4effbaa494 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.777707:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220400/0x2f180c4effbaa494 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:1.0:1762166976.777734:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 147456 00000004:00200000:1.0:1762166976.777738:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166976.777753:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220400/0x2f180c4effbaa494 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.777774:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221600/0x2f180c4effbaa48d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a35 expref: 543 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.777788:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220400/0x2f180c4effbaa494 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a35 expref: 542 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.777794:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.777796:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166976.777799:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc6220400, rc 0) 00000100:00100000:1.0:1762166976.777835:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+542:61842:x1847765450398720:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 360us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166976.777843:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30341 00000100:00100000:3.0:1762166976.779392:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.779621:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450398976 00000100:00100000:1.0:1762166976.779631:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450398976 00000100:00100000:1.0:1762166976.779687:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30342 00000100:00100000:1.0:1762166976.779700:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+542:61842:x1847765450398976:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:1.0:1762166976.779752:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166976.779776:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220400/0x2f180c4effbaa494 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a35 expref: 542 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.779795:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.779800:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166976.779970:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221e00/0x2f180c4effbaa49b lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166976.779986:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221e00/0x2f180c4effbaa49b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.779996:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221e00/0x2f180c4effbaa49b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000001:00080000:1.0:1762166976.780038:0:6494:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294991928 00000004:00010000:1.0:1762166976.780059:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000005c358c15 reply state 00000000a9457730 transno 4294991929 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221e00/0x2f180c4effbaa49b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.780069:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221e00/0x2f180c4effbaa49b lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.780075:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.780077:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166976.780080:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166976.780157:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+544:61842:x1847765450398976:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 462us (776us total) trans 4294991929 rc 0/0 00000100:00100000:1.0:1762166976.780166:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30342 00000020:00080000:1.0:1762166976.780171:0:6494:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1762166976.781252:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.781293:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450399104 00000100:00100000:1.0:1762166976.781300:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450399104 00000100:00100000:1.0:1762166976.781339:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18874 00000100:00100000:1.0:1762166976.781348:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+16:61842:x1847765450399104:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166976.781361:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166976.781379:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc6220800/0x2f180c4effbaa4a2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9a3c expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762166976.781411:0:28434:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa88:0x0] initial LVB size: 147456, mtime: 0x690888c0, atime: 0x690888bf, ctime: 0x690888c0, blocks: 0x78 00010000:00010000:1.0:1762166976.781429:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166976.781431:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166976.781437:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc6220800/0x2f180c4effbaa4a2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a3c expref: 17 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.781450:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc6220800/0x2f180c4effbaa4a2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a3c expref: 17 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.781461:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc6220800, rc 0) 00000100:00100000:1.0:1762166976.781521:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+17:61842:x1847765450399104:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 175us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166976.781527:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18874 00000100:00100000:2.0:1762166976.782981:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166976.783042:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.783068:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450399360 00000100:00100000:1.0:1762166976.783077:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450399360 00000100:00100000:0.0:1762166976.783122:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450399232 00000100:00100000:0.0:1762166976.783131:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450399232 00002000:00010000:1.0:1762166976.783152:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2695 (0->18446744073709551615) 00002000:00100000:1.0:1762166976.783160:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5bbaa00 with x1847765450399360 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166976.783162:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2696 (147456->18446744073709551615) 00002000:00100000:0.0:1762166976.783168:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5bb9c00 with x1847765450399232 ext(147456->18446744073709551615) 00002000:00010000:1.0:1762166976.783170:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5bbaa00. 00002000:00010000:0.0:1762166976.783180:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc5bb9c00. 00000100:00100000:1.0:1762166976.783210:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2120 00000100:00100000:1.0:1762166976.783232:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+23:2416:x1847765450399360:12345-192.168.204.38@tcp:10:lfs.0 00000100:00100000:0.0:1762166976.783232:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2121 00000100:00100000:0.0:1762166976.783252:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+17:2417:x1847765450399232:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:1.0:1762166976.783378:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166976.783388:0:23939:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb mtime from disk: 1762166976 -> 1762166977 00002000:00010000:1.0:1762166976.783392:0:23939:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00002000:00010000:1.0:1762166976.783394:0:23939:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb ctime from disk: 1762166976 -> 1762166977 00002000:00010000:0.0:1762166976.783398:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb size from disk: 147456 -> 147456 00002000:00010000:1.0:1762166976.783399:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:0.0:1762166976.783409:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb mtime from disk: 1762166976 -> 1762166977 00002000:00010000:0.0:1762166976.783412:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00002000:00010000:0.0:1762166976.783414:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb ctime from disk: 1762166976 -> 1762166977 00002000:00010000:0.0:1762166976.783416:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb blocks from disk: 120 -> 120 00000100:00100000:1.0:1762166976.783463:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+24:2416:x1847765450399360:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 241us (503us total) trans 17179876276 rc 0/0 00000100:00100000:0.0:1762166976.783471:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+18:2417:x1847765450399232:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 221us (423us total) trans 21474843242 rc 0/0 00000100:00100000:1.0:1762166976.783521:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2120 00002000:00010000:1.0:1762166976.783528:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2695 (0->18446744073709551615) 00000100:00100000:0.0:1762166976.783533:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2121 00002000:00100000:1.0:1762166976.783536:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5bbaa00 with x1847765450399360 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166976.783541:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2696 (147456->18446744073709551615) 00002000:00010000:1.0:1762166976.783543:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5bbaa00. 00002000:00100000:0.0:1762166976.783551:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5bb9c00 with x1847765450399232 ext(147456->18446744073709551615) 00002000:00010000:0.0:1762166976.783561:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc5bb9c00. 00000100:00100000:3.0:1762166976.784767:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.784815:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450399488 00000100:00100000:1.0:1762166976.784823:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450399488 00000100:00100000:1.0:1762166976.784868:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30343 00000100:00100000:1.0:1762166976.784880:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+544:61842:x1847765450399488:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166976.784906:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166976.784923:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220600/0x2f180c4effbaa4a9 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9a43 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.785002:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220000/0x2f180c4effbaa4b0 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166976.785016:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220000/0x2f180c4effbaa4b0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.785028:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220000/0x2f180c4effbaa4b0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:1.0:1762166976.785067:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 147456 00000004:00200000:1.0:1762166976.785072:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166976.785090:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220000/0x2f180c4effbaa4b0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.785115:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220600/0x2f180c4effbaa4a9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a43 expref: 546 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.785133:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220000/0x2f180c4effbaa4b0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a43 expref: 545 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.785141:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.785144:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166976.785147:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc6220000, rc 0) 00000100:00100000:1.0:1762166976.785192:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+545:61842:x1847765450399488:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 315us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166976.785199:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30343 00000100:00100000:2.0:1762166976.787655:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166976.787710:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450399616 00000100:00100000:0.0:1762166976.787742:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450399616 00000100:00100000:0.0:1762166976.787818:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2122 00000100:00100000:0.0:1762166976.787830:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+24:2418:x1847765450399616:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:0.0:1762166976.787866:0:8388:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde400/0x2f180c4effbaa4b7 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.787882:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166976.787884:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166976.787904:0:8388:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde400/0x2f180c4effbaa4b7 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [188416->245759] (req 188416->245759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.787924:0:8388:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde400/0x2f180c4effbaa4b7 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [188416->245759] (req 188416->245759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.789018:0:8388:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde400/0x2f180c4effbaa4b7 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [188416->245759] (req 188416->245759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.789047:0:8388:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde400/0x2f180c4effbaa4b7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [188416->245759] (req 188416->245759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.789056:0:8388:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde400/0x2f180c4effbaa4b7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [188416->245759] (req 188416->245759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.789064:0:8388:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bde400 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166976.789069:0:8388:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde400/0x2f180c4effbaa4b7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [188416->245759] (req 188416->245759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.789078:0:8388:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde400/0x2f180c4effbaa4b7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [188416->245759] (req 188416->245759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.789098:0:8388:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde400/0x2f180c4effbaa4b7 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [188416->245759] (req 188416->245759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.789106:0:8388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde400/0x2f180c4effbaa4b7 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [188416->245759] (req 188416->245759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166976.789172:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+24:2418:x1847765450399616:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 1343us (1523us total) trans 0 rc 55772/55772 00000100:00100000:0.0:1762166976.789186:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2122 00000100:00100000:3.0:1762166976.790994:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166976.791043:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450399744 00000100:00100000:0.0:1762166976.791053:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450399744 00000100:00100000:0.0:1762166976.791121:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2123 00000100:00100000:0.0:1762166976.791134:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450399744:12345-192.168.204.38@tcp:4:lfs.0 00010000:00010000:0.0:1762166976.791172:0:8388:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf000/0x2f180c4effbaa4be lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.791191:0:8388:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc6221800/0x2f180c4effbaa486 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a2e expref: 18 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.791199:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166976.791201:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166976.791204:0:8388:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf000/0x2f180c4effbaa4be lrc: 4/0,1 mode: --/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [188416->245759] (req 188416->245759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.791244:0:8388:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc6221800/0x2f180c4effbaa486 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a2e expref: 18 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.791259:0:8388:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc6221800/0x2f180c4effbaa486 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a2e expref: 18 pid: 28434 timeout: 695 lvb_type: 0 00000100:00100000:0.0:1762166976.791278:0:8388:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0000_UUID:8388:1847765449703040:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166976.791371:0:8388:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc10c1480 going to sleep for 11 seconds 00000100:00100000:0.0:1762166976.792319:0:8388:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0000_UUID:8388:1847765449703040:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166976.792338:0:8388:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf000/0x2f180c4effbaa4be lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [188416->245759] (req 188416->245759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166976.792458:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166976.792521:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450399872 00000100:00100000:0.0:1762166976.792528:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450399872 00010000:00010000:0.0:1762166976.792555:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc6221800/0x2f180c4effbaa486 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a2e expref: 19 pid: 28434 timeout: 695 lvb_type: 0 00000100:00100000:0.0:1762166976.792592:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9527 00000100:00100000:0.0:1762166976.792598:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce75f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450399872:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166976.792609:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166976.792628:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc6221800/0x2f180c4effbaa486 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a2e expref: 19 pid: 28434 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166976.792637:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc6221800/0x2f180c4effbaa486 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a2e expref: 19 pid: 28434 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166976.792667:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc6221800/0x2f180c4effbaa486 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a2e expref: 19 pid: 28434 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166976.792684:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166976.792686:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166976.792690:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf000/0x2f180c4effbaa4be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [188416->245759] (req 188416->245759) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.792701:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf000/0x2f180c4effbaa4be lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [188416->245759] (req 188416->245759) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.792737:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166976.792794:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce75f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450399872:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 195us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166976.792805:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9527 00010000:00010000:2.0:1762166976.792857:0:8388:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf000/0x2f180c4effbaa4be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [188416->245759] (req 188416->245759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.792874:0:8388:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf000/0x2f180c4effbaa4be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [188416->245759] (req 188416->245759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000001:00080000:3.0:1762166976.796418:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843243 is committed 00002000:00010000:2.0:1762166976.796553:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb size from disk: 147456 -> 245760 00002000:00010000:2.0:1762166976.796558:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb mtime from disk: 1762166976 -> 1762166977 00002000:00010000:2.0:1762166976.796561:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb ctime from disk: 1762166976 -> 1762166977 00002000:00010000:2.0:1762166976.796563:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb blocks from disk: 120 -> 232 00010000:00010000:2.0:1762166976.796586:0:8388:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf000/0x2f180c4effbaa4be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [188416->245759] (req 188416->245759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.796597:0:8388:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf000/0x2f180c4effbaa4be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [188416->245759] (req 188416->245759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.796606:0:8388:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf000/0x2f180c4effbaa4be lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [188416->245759] (req 188416->245759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.796612:0:8388:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdf000 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166976.796617:0:8388:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf000/0x2f180c4effbaa4be lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [188416->245759] (req 188416->245759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.796625:0:8388:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf000/0x2f180c4effbaa4be lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [188416->245759] (req 188416->245759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.796648:0:8388:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf000/0x2f180c4effbaa4be lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [188416->245759] (req 188416->245759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.796656:0:8388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf000/0x2f180c4effbaa4be lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [188416->245759] (req 188416->245759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166976.796752:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+15:2418:x1847765450399744:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 5618us (5761us total) trans 21474843243 rc 0/0 00000100:00100000:2.0:1762166976.796763:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2123 00000100:00100000:0.0:1762166976.798656:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166976.798720:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450400000 00000100:00100000:2.0:1762166976.798732:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450400000 00000100:00100000:2.0:1762166976.798806:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2124 00000100:00100000:2.0:1762166976.798818:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+15:2416:x1847765450400000:12345-192.168.204.38@tcp:4:lfs.0 00010000:00010000:2.0:1762166976.798850:0:8388:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8600/0x2f180c4effbaa4c5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.798868:0:8388:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc6220800/0x2f180c4effbaa4a2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a3c expref: 15 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.798876:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166976.798878:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166976.798882:0:8388:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8600/0x2f180c4effbaa4c5 lrc: 4/0,1 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [188416->245759] (req 188416->245759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.798943:0:8388:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc6220800/0x2f180c4effbaa4a2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a3c expref: 15 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.798958:0:8388:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc6220800/0x2f180c4effbaa4a2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a3c expref: 15 pid: 28434 timeout: 695 lvb_type: 0 00000100:00100000:2.0:1762166976.798973:0:8388:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bba680 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0000_UUID:8388:1847765449703168:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166976.799052:0:8388:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1dcec00 going to sleep for 11 seconds 00000100:00100000:2.0:1762166976.800096:0:8388:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bba680 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0000_UUID:8388:1847765449703168:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166976.800119:0:8388:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8600/0x2f180c4effbaa4c5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [188416->245759] (req 188416->245759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166976.800197:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166976.800244:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450400128 00000100:00100000:2.0:1762166976.800251:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450400128 00010000:00010000:2.0:1762166976.800273:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc6220800/0x2f180c4effbaa4a2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a3c expref: 16 pid: 28434 timeout: 695 lvb_type: 0 00000100:00100000:2.0:1762166976.800304:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9528 00000100:00100000:2.0:1762166976.800313:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+16:2419:x1847765450400128:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166976.800326:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166976.800345:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc6220800/0x2f180c4effbaa4a2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a3c expref: 16 pid: 28434 timeout: 695 lvb_type: 0 00010000:00010000:2.0:1762166976.800356:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc6220800/0x2f180c4effbaa4a2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a3c expref: 16 pid: 28434 timeout: 695 lvb_type: 0 00010000:00010000:2.0:1762166976.800376:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc6220800/0x2f180c4effbaa4a2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a3c expref: 16 pid: 28434 timeout: 695 lvb_type: 0 00010000:00010000:2.0:1762166976.800393:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166976.800395:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166976.800399:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8600/0x2f180c4effbaa4c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [188416->245759] (req 188416->245759) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.800408:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8600/0x2f180c4effbaa4c5 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [188416->245759] (req 188416->245759) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.800435:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166976.800522:0:8388:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8600/0x2f180c4effbaa4c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [188416->245759] (req 188416->245759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166976.800523:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+15:2419:x1847765450400128:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 165us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166976.800556:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9528 00010000:00010000:0.0:1762166976.800556:0:8388:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8600/0x2f180c4effbaa4c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [188416->245759] (req 188416->245759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000001:00080000:3.0:1762166976.803447:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843244 is committed 00002000:00010000:2.0:1762166976.803559:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb size from disk: 147456 -> 245760 00002000:00010000:2.0:1762166976.803566:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb blocks from disk: 120 -> 232 00010000:00010000:2.0:1762166976.803588:0:8388:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8600/0x2f180c4effbaa4c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [188416->245759] (req 188416->245759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.803601:0:8388:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8600/0x2f180c4effbaa4c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [188416->245759] (req 188416->245759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.803610:0:8388:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8600/0x2f180c4effbaa4c5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [188416->245759] (req 188416->245759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.803617:0:8388:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa8600 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166976.803624:0:8388:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8600/0x2f180c4effbaa4c5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [188416->245759] (req 188416->245759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.803633:0:8388:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8600/0x2f180c4effbaa4c5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [188416->245759] (req 188416->245759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.803647:0:8388:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8600/0x2f180c4effbaa4c5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [188416->245759] (req 188416->245759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.803654:0:8388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8600/0x2f180c4effbaa4c5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [188416->245759] (req 188416->245759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166976.803735:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+14:2416:x1847765450400000:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 4918us (5084us total) trans 21474843244 rc 0/0 00000100:00100000:2.0:1762166976.803744:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2124 00000100:00100000:1.0:1762166976.811937:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166976.812234:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450400384 00000100:00100000:2.0:1762166976.812246:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450400384 00000100:00100000:2.0:1762166976.812310:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30344 00000100:00100000:2.0:1762166976.812320:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+545:61842:x1847765450400384:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:2.0:1762166976.812370:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166976.812398:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220000/0x2f180c4effbaa4b0 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a43 expref: 545 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.812418:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166976.812423:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166976.812622:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbaa4cc lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166976.812637:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbaa4cc lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166976.812647:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbaa4cc lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000001:00080000:2.0:1762166976.812687:0:6494:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294991930 00000004:00010000:2.0:1762166976.812716:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000e42bcd40 reply state 0000000057fc2dd3 transno 4294991931 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbaa4cc lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166976.812728:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbaa4cc lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166976.812737:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166976.812740:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166976.812743:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166976.812835:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+547:61842:x1847765450400384:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 515us (908us total) trans 4294991931 rc 0/0 00000100:00100000:2.0:1762166976.812843:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30344 00000020:00080000:2.0:1762166976.812849:0:6494:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1762166976.814411:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.814547:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450400512 00000100:00100000:1.0:1762166976.814555:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450400512 00000100:00100000:1.0:1762166976.814594:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18875 00000100:00100000:1.0:1762166976.814605:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+14:61842:x1847765450400512:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166976.814619:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166976.814638:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc6220800/0x2f180c4effbaa4d3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9a4a expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762166976.814665:0:28434:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa86:0x0] initial LVB size: 245760, mtime: 0x690888c1, atime: 0x690888bd, ctime: 0x690888c1, blocks: 0xe8 00010000:00010000:1.0:1762166976.814684:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166976.814686:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166976.814693:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc6220800/0x2f180c4effbaa4d3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a4a expref: 15 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.814717:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc6220800/0x2f180c4effbaa4d3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a4a expref: 15 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.814731:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc6220800, rc 0) 00000100:00100000:1.0:1762166976.814778:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+15:61842:x1847765450400512:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 175us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166976.814785:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18875 00000100:00100000:3.0:1762166976.816621:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166976.816659:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166976.816678:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450400768 00000100:00100000:2.0:1762166976.816685:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450400768 00000100:00100000:1.0:1762166976.816715:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450400640 00002000:00010000:2.0:1762166976.816717:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2693 (0->18446744073709551615) 00000100:00100000:1.0:1762166976.816722:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450400640 00002000:00100000:2.0:1762166976.816724:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bcce76300 with x1847765450400768 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166976.816735:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bcce76300. 00002000:00010000:1.0:1762166976.816742:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2694 (244188->18446744073709551615) 00002000:00100000:1.0:1762166976.816747:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945ceda2f100 with x1847765450400640 ext(244188->18446744073709551615) 00002000:00010000:1.0:1762166976.816754:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945ceda2f100. 00000100:00100000:2.0:1762166976.816763:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2125 00000100:00100000:2.0:1762166976.816774:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+24:2418:x1847765450400768:12345-192.168.204.38@tcp:10:lfs.0 00000100:00100000:1.0:1762166976.816797:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2126 00000100:00100000:1.0:1762166976.816810:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+15:2419:x1847765450400640:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:2.0:1762166976.816927:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166976.816932:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb mtime from disk: 1762166976 -> 1762166977 00002000:00010000:2.0:1762166976.816934:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb atime from disk: 1762166973 -> 1762166973 00002000:00010000:2.0:1762166976.816937:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb ctime from disk: 1762166976 -> 1762166977 00002000:00010000:2.0:1762166976.816940:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1762166976.816987:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+25:2418:x1847765450400768:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 216us (370us total) trans 17179876277 rc 0/0 00000100:00100000:2.0:1762166976.816995:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2125 00002000:00010000:2.0:1762166976.816999:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2693 (0->18446744073709551615) 00002000:00100000:2.0:1762166976.817002:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bcce76300 with x1847765450400768 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166976.817006:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bcce76300. 00002000:00010000:1.0:1762166976.817057:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb size from disk: 245760 -> 244188 00002000:00010000:1.0:1762166976.817062:0:23939:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:1.0:1762166976.817065:0:23939:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb atime from disk: 1762166973 -> 1762166973 00002000:00010000:1.0:1762166976.817067:0:23939:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:1.0:1762166976.817069:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb blocks from disk: 232 -> 232 00000100:00100000:1.0:1762166976.817095:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+16:2419:x1847765450400640:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 289us (436us total) trans 21474843245 rc 0/0 00000100:00100000:1.0:1762166976.817103:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2126 00002000:00010000:1.0:1762166976.817106:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2694 (244188->18446744073709551615) 00002000:00100000:1.0:1762166976.817109:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945ceda2f100 with x1847765450400640 ext(244188->18446744073709551615) 00002000:00010000:1.0:1762166976.817114:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945ceda2f100. 00000100:00100000:2.0:1762166976.818668:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.818709:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450400896 00000100:00100000:1.0:1762166976.818715:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450400896 00000100:00100000:1.0:1762166976.818747:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30345 00000100:00100000:1.0:1762166976.818752:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+547:61842:x1847765450400896:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166976.818767:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166976.818780:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221600/0x2f180c4effbaa4da lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9a51 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.818845:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220600/0x2f180c4effbaa4e1 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166976.818855:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220600/0x2f180c4effbaa4e1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.818863:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220600/0x2f180c4effbaa4e1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:1.0:1762166976.818881:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 244188 00000004:00200000:1.0:1762166976.818883:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166976.818909:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220600/0x2f180c4effbaa4e1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.818927:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221600/0x2f180c4effbaa4da lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a51 expref: 549 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.818941:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220600/0x2f180c4effbaa4e1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a51 expref: 548 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.818947:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.818950:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166976.818952:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc6220600, rc 0) 00000100:00100000:1.0:1762166976.818982:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+548:61842:x1847765450400896:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 231us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166976.818987:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30345 00000100:00100000:3.0:1762166976.820755:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.820822:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450401152 00000100:00100000:1.0:1762166976.820833:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450401152 00000100:00100000:1.0:1762166976.820902:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30346 00000100:00100000:1.0:1762166976.820915:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+548:61842:x1847765450401152:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:1.0:1762166976.820974:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166976.821001:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220600/0x2f180c4effbaa4e1 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a51 expref: 548 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.821023:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.821028:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166976.821235:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221800/0x2f180c4effbaa4e8 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166976.821251:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221800/0x2f180c4effbaa4e8 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.821261:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221800/0x2f180c4effbaa4e8 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000001:00080000:1.0:1762166976.821317:0:6494:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294991932 00000004:00010000:1.0:1762166976.821340:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000e54b38a3 reply state 000000000c209c5f transno 4294991933 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221800/0x2f180c4effbaa4e8 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.821353:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221800/0x2f180c4effbaa4e8 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.821360:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.821363:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166976.821366:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166976.821461:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+550:61842:x1847765450401152:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 548us (712us total) trans 4294991933 rc 0/0 00000100:00100000:1.0:1762166976.821469:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30346 00000020:00080000:1.0:1762166976.821505:0:6494:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1762166976.822424:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.822493:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450401280 00000100:00100000:1.0:1762166976.822501:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450401280 00000100:00100000:1.0:1762166976.822545:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18876 00000100:00100000:1.0:1762166976.822555:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+16:61842:x1847765450401280:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166976.822570:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166976.822589:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc6220400/0x2f180c4effbaa4ef lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9a58 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762166976.822613:0:28434:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa88:0x0] initial LVB size: 245760, mtime: 0x690888c1, atime: 0x690888bf, ctime: 0x690888c1, blocks: 0xe8 00010000:00010000:1.0:1762166976.822633:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166976.822636:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166976.822644:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc6220400/0x2f180c4effbaa4ef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a58 expref: 17 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.822666:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc6220400/0x2f180c4effbaa4ef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a58 expref: 17 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.822678:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc6220400, rc 0) 00000100:00100000:1.0:1762166976.822717:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+17:61842:x1847765450401280:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 164us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166976.822724:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18876 00000100:00100000:2.0:1762166976.823760:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.823819:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450401408 00000100:00100000:2.0:1762166976.823821:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.823829:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450401408 00002000:00010000:1.0:1762166976.823866:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2696 (244188->18446744073709551615) 00002000:00100000:1.0:1762166976.823872:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5bb8700 with x1847765450401408 ext(244188->18446744073709551615) 00002000:00010000:1.0:1762166976.823882:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc5bb8700. 00000100:00100000:0.0:1762166976.823886:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450401536 00000100:00100000:0.0:1762166976.823904:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450401536 00000100:00100000:1.0:1762166976.823922:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2127 00002000:00010000:0.0:1762166976.823924:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2695 (0->18446744073709551615) 00002000:00100000:0.0:1762166976.823929:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5bbad80 with x1847765450401536 ext(0->18446744073709551615) 00000100:00100000:1.0:1762166976.823933:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+17:2417:x1847765450401408:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:0.0:1762166976.823938:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5bbad80. 00000100:00100000:0.0:1762166976.823966:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2128 00000100:00100000:0.0:1762166976.823975:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+25:2417:x1847765450401536:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:0.0:1762166976.824073:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166976.824077:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:0.0:1762166976.824079:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00002000:00010000:0.0:1762166976.824082:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:0.0:1762166976.824085:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1762166976.824133:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+26:2417:x1847765450401536:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 160us (313us total) trans 17179876278 rc 0/0 00000100:00100000:0.0:1762166976.824138:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2128 00002000:00010000:0.0:1762166976.824142:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2695 (0->18446744073709551615) 00002000:00100000:0.0:1762166976.824144:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5bbad80 with x1847765450401536 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166976.824147:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5bbad80. 00002000:00010000:1.0:1762166976.824177:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb size from disk: 245760 -> 244188 00002000:00010000:1.0:1762166976.824181:0:23939:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:1.0:1762166976.824183:0:23939:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00002000:00010000:1.0:1762166976.824185:0:23939:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:1.0:1762166976.824187:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb blocks from disk: 232 -> 232 00000100:00100000:1.0:1762166976.824209:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+18:2417:x1847765450401408:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 279us (457us total) trans 21474843246 rc 0/0 00000100:00100000:1.0:1762166976.824216:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2127 00002000:00010000:1.0:1762166976.824219:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2696 (244188->18446744073709551615) 00002000:00100000:1.0:1762166976.824222:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5bb8700 with x1847765450401408 ext(244188->18446744073709551615) 00002000:00010000:1.0:1762166976.824227:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc5bb8700. 00000100:00100000:3.0:1762166976.826105:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.826189:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450401792 00000100:00100000:1.0:1762166976.826193:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450401792 00000100:00100000:1.0:1762166976.826228:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30347 00000100:00100000:1.0:1762166976.826236:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+550:61842:x1847765450401792:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:1.0:1762166976.826340:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaa4f6 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166976.826357:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaa4f6 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.826368:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaa4f6 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00010000:1.0:1762166976.826450:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000e0b77935 reply state 00000000986f5889 transno 4294991934 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaa4f6 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.826463:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaa4f6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.826470:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.826473:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166976.826510:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166976.826577:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+552:61842:x1847765450401792:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 340us (475us total) trans 4294991934 rc 0/0 00000100:00100000:1.0:1762166976.826584:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30347 00000100:00100000:3.0:1762166976.827561:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.827611:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450401920 00000100:00100000:1.0:1762166976.827616:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450401920 00000100:00100000:1.0:1762166976.827651:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18877 00000100:00100000:1.0:1762166976.827659:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5589180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+26:61842:x1847765450401920:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166976.827674:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166976.827686:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc6220200/0x2f180c4effbaa4fd lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9a5f expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.827711:0:28434:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effbaa3bb lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99e1 expref: 27 pid: 35248 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166976.827720:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166976.827722:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166976.827726:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc6220200/0x2f180c4effbaa4fd lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a5f expref: 27 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.827756:0:28434:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effbaa3bb lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99e1 expref: 27 pid: 35248 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166976.827769:0:28434:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effbaa3bb lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99e1 expref: 27 pid: 35248 timeout: 695 lvb_type: 1 00000100:00100000:1.0:1762166976.827782:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc47b5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765449703296:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166976.827851:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cee0836c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166976.828781:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc47b5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765449703296:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166976.828801:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc6220200/0x2f180c4effbaa4fd lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a5f expref: 27 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.828815:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc6220200, rc 0) 00000100:00100000:1.0:1762166976.828846:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5589180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+27:61842:x1847765450401920:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1188us (1286us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166976.828858:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18877 00000100:00100000:3.0:1762166976.828995:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166976.829050:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450402048 00000100:00100000:2.0:1762166976.829055:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450402048 00010000:00010000:2.0:1762166976.829079:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effbaa3bb lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99e1 expref: 27 pid: 35248 timeout: 695 lvb_type: 1 00000100:00100000:2.0:1762166976.829108:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9529 00000100:00100000:2.0:1762166976.829117:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5589c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+27:2419:x1847765450402048:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166976.829127:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166976.829141:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effbaa3bb lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99e1 expref: 27 pid: 35248 timeout: 695 lvb_type: 1 00010000:00010000:2.0:1762166976.829152:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effbaa3bb lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99e1 expref: 27 pid: 35248 timeout: 695 lvb_type: 1 00010000:00010000:2.0:1762166976.829169:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effbaa3bb lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99e1 expref: 27 pid: 35248 timeout: 695 lvb_type: 1 00010000:00010000:2.0:1762166976.829180:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166976.829182:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166976.829188:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc6220200/0x2f180c4effbaa4fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a5f expref: 26 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.829197:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc6220200/0x2f180c4effbaa4fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a5f expref: 26 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166976.829220:0:8398:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff945bc6220200/0x2f180c4effbaa4fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a5f expref: 26 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166976.829231:0:8398:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bbbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8398:1847765449703424:192.168.204.38@tcp:105: 00000100:00100000:2.0:1762166976.829274:0:8398:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1dcec00 going to sleep for 11 seconds 00000100:00100000:1.0:1762166976.830358:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166976.830409:0:8398:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bbbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8398:1847765449703424:192.168.204.38@tcp:105: 00000100:00100000:0.0:1762166976.830416:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450402176 00000100:00100000:0.0:1762166976.830423:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450402176 00010000:00010000:2.0:1762166976.830429:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166976.830461:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18878 00000100:00100000:0.0:1762166976.830470:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+18:61842:x1847765450402176:12345-192.168.204.38@tcp:101:lfs.0 00000100:00100000:2.0:1762166976.830507:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5589c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765450402048:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1359us (1479us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166976.830510:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1762166976.830519:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9529 00010000:00010000:0.0:1762166976.830529:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfc00/0x2f180c4effbaa504 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9a66 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.830552:0:28434:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf400/0x2f180c4effbaa3c2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99e8 expref: 19 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166976.830574:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166976.830587:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166976.830591:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfc00/0x2f180c4effbaa504 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a66 expref: 19 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.830619:0:28434:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf400/0x2f180c4effbaa3c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99e8 expref: 19 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166976.830633:0:28434:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf400/0x2f180c4effbaa3c2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99e8 expref: 19 pid: 28874 timeout: 695 lvb_type: 1 00000100:00100000:0.0:1762166976.830643:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765449703552:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166976.830701:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc10c1480 going to sleep for 11 seconds 00000100:00100000:0.0:1762166976.831923:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765449703552:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166976.831939:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfc00/0x2f180c4effbaa504 lrc: 3/0,0 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a66 expref: 19 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.831951:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdfc00, rc 0) 00000100:00100000:0.0:1762166976.831987:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+19:61842:x1847765450402176:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1519us (1631us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166976.831994:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18878 00000100:00100000:2.0:1762166976.832269:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166976.832354:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450402304 00000100:00100000:0.0:1762166976.832364:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450402304 00010000:00010000:0.0:1762166976.832401:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf400/0x2f180c4effbaa3c2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99e8 expref: 19 pid: 28874 timeout: 695 lvb_type: 1 00000100:00100000:0.0:1762166976.832450:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9530 00000100:00100000:0.0:1762166976.832459:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450402304:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166976.832502:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166976.832526:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf400/0x2f180c4effbaa3c2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99e8 expref: 19 pid: 28874 timeout: 695 lvb_type: 1 00010000:00010000:0.0:1762166976.832540:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf400/0x2f180c4effbaa3c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99e8 expref: 19 pid: 28874 timeout: 695 lvb_type: 1 00010000:00010000:0.0:1762166976.832565:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf400/0x2f180c4effbaa3c2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99e8 expref: 19 pid: 28874 timeout: 695 lvb_type: 1 00010000:00010000:0.0:1762166976.832581:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166976.832584:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166976.832591:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfc00/0x2f180c4effbaa504 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a66 expref: 18 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.832600:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfc00/0x2f180c4effbaa504 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a66 expref: 18 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.832636:0:8398:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfc00/0x2f180c4effbaa504 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a66 expref: 18 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166976.832655:0:8398:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8398:1847765449703680:192.168.204.38@tcp:105: 00000100:00100000:0.0:1762166976.832734:0:8398:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc10c1480 going to sleep for 11 seconds 00000100:00100000:0.0:1762166976.833621:0:8398:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8398:1847765449703680:192.168.204.38@tcp:105: 00010000:00010000:0.0:1762166976.833638:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166976.833671:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450402304:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1213us (1410us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166976.833678:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9530 00000100:00100000:1.0:1762166976.833805:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166976.833858:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450402432 00000100:00100000:0.0:1762166976.833864:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450402432 00000100:00100000:0.0:1762166976.833910:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18879 00000100:00100000:0.0:1762166976.833918:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+26:61842:x1847765450402432:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166976.833933:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166976.833950:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbaa50b lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9a6d expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.833973:0:28434:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc6221200/0x2f180c4effbaa3c9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99ef expref: 27 pid: 8382 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166976.833986:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166976.833988:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166976.833992:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbaa50b lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a6d expref: 27 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.834015:0:28434:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc6221200/0x2f180c4effbaa3c9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99ef expref: 27 pid: 8382 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166976.834027:0:28434:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc6221200/0x2f180c4effbaa3c9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99ef expref: 27 pid: 8382 timeout: 695 lvb_type: 1 00000100:00100000:0.0:1762166976.834038:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765449703808:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166976.834098:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc10c1480 going to sleep for 11 seconds 00000100:00100000:0.0:1762166976.835085:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765449703808:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166976.835105:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbaa50b lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a6d expref: 27 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.835114:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdea00, rc 0) 00000100:00100000:0.0:1762166976.835159:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+27:61842:x1847765450402432:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1241us (1357us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166976.835168:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18879 00000100:00100000:1.0:1762166976.835262:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166976.835300:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450402560 00000100:00100000:0.0:1762166976.835306:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450402560 00010000:00010000:0.0:1762166976.835326:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc6221200/0x2f180c4effbaa3c9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99ef expref: 27 pid: 8382 timeout: 695 lvb_type: 1 00000100:00100000:0.0:1762166976.835356:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9531 00000100:00100000:0.0:1762166976.835366:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+27:2419:x1847765450402560:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166976.835378:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166976.835395:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc6221200/0x2f180c4effbaa3c9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99ef expref: 27 pid: 8382 timeout: 695 lvb_type: 1 00010000:00010000:0.0:1762166976.835407:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc6221200/0x2f180c4effbaa3c9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99ef expref: 27 pid: 8382 timeout: 695 lvb_type: 1 00010000:00010000:0.0:1762166976.835426:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc6221200/0x2f180c4effbaa3c9 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99ef expref: 27 pid: 8382 timeout: 695 lvb_type: 1 00010000:00010000:0.0:1762166976.835437:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166976.835439:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166976.835444:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbaa50b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a6d expref: 26 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.835453:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbaa50b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a6d expref: 26 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.835514:0:8398:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbaa50b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a6d expref: 26 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166976.835528:0:8398:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8398:1847765449703936:192.168.204.38@tcp:105: 00000100:00100000:0.0:1762166976.835585:0:8398:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc10c1480 going to sleep for 11 seconds 00000100:00100000:0.0:1762166976.836663:0:8398:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8398:1847765449703936:192.168.204.38@tcp:105: 00010000:00010000:0.0:1762166976.836681:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166976.836736:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765450402560:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1372us (1474us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166976.836744:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9531 00000100:00100000:1.0:1762166976.836834:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.836862:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166976.836881:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450402688 00000100:00100000:0.0:1762166976.836886:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450402688 00000100:00100000:1.0:1762166976.836920:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166976.836954:0:35248:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450402816 00000100:00100000:3.0:1762166976.836960:0:35248:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450402816 00000100:00100000:1.0:1762166976.836962:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450402944 00000100:00100000:1.0:1762166976.836968:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450402944 00000100:00100000:2.0:1762166976.836982:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18880 00000100:00100000:2.0:1762166976.836998:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+27:2419:x1847765450402688:12345-192.168.204.38@tcp:2:lfs.0 00000100:00100000:3.0:1762166976.836999:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18881 00000100:00100000:1.0:1762166976.837010:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18882 00000100:00100000:3.0:1762166976.837016:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450402816:12345-192.168.204.38@tcp:2:lfs.0 00000100:00100000:1.0:1762166976.837025:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+27:2418:x1847765450402944:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:3.0:1762166976.837132:0:35248:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166976.837132:0:8382:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166976.837138:0:8382:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:3.0:1762166976.837139:0:35248:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.837144:0:8382:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166976 -> 1762166976 00002000:00010000:3.0:1762166976.837146:0:35248:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.837150:0:8382:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166976 -> 1762166977 00002000:00010000:3.0:1762166976.837152:0:35248:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166976 -> 1762166977 00002000:00010000:1.0:1762166976.837156:0:8382:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:3.0:1762166976.837157:0:35248:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00000100:00100000:1.0:1762166976.837208:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+29:2418:x1847765450402944:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 186us (286us total) trans 17179876279 rc 0/0 00000100:00100000:3.0:1762166976.837209:0:35248:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450402816:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 196us (343us total) trans 21474843247 rc 0/0 00000100:00100000:1.0:1762166976.837223:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18882 00000100:00100000:3.0:1762166976.837231:0:35248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18881 00002000:00010000:2.0:1762166976.837299:0:35472:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 244188 -> 244188 00002000:00010000:2.0:1762166976.837303:0:35472:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:2.0:1762166976.837305:0:35472:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166976 -> 1762166976 00002000:00010000:2.0:1762166976.837308:0:35472:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166976 -> 1762166977 00002000:00010000:2.0:1762166976.837310:0:35472:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 352 -> 352 00000100:00100000:2.0:1762166976.837342:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+28:2419:x1847765450402688:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 351us (507us total) trans 17179876280 rc 0/0 00000100:00100000:2.0:1762166976.837349:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18880 00000100:00100000:0.0:1762166976.838582:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.838631:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450403200 00000100:00100000:1.0:1762166976.838637:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450403200 00000100:00100000:1.0:1762166976.838667:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11813 00000100:00100000:1.0:1762166976.838673:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+552:61842:x1847765450403200:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:1.0:1762166976.838708:0:6497:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x240000404:0x5eb:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaa37c lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99cc expref: 552 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.838740:0:6497:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220600/0x2f180c4effbaa512 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 00010000:00010000:1.0:1762166976.838748:0:6497:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220a00/0x2f180c4effbaa3a6 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 14 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99d3 expref: 552 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.838754:0:6497:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220600/0x2f180c4effbaa512 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166976.838770:0:6497:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220a00/0x2f180c4effbaa3a6 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 14 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99d3 expref: 552 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.838778:0:6497:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220a00/0x2f180c4effbaa3a6 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 14 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99d3 expref: 552 pid: 6494 timeout: 695 lvb_type: 0 00000100:00100000:1.0:1762166976.838787:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc47b5c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6497:1847765449704064:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166976.838826:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cee083780 going to sleep for 11 seconds 00000100:00100000:1.0:1762166976.840176:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc47b5c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6497:1847765449704064:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166976.840195:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:1.0:1762166976.840235:0:6497:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220600/0x2f180c4effbaa512 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00000100:00100000:0.0:1762166976.840260:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450403328 00000100:00100000:0.0:1762166976.840271:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450403328 00010000:00010000:0.0:1762166976.840309:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220a00/0x2f180c4effbaa3a6 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 14 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99d3 expref: 553 pid: 6494 timeout: 695 lvb_type: 0 00000100:00100000:0.0:1762166976.840349:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9532 00000100:00100000:0.0:1762166976.840359:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5588e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+553:2418:x1847765450403328:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166976.840374:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166976.840382:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220a00/0x2f180c4effbaa3a6 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 15 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99d3 expref: 553 pid: 6494 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166976.840395:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220a00/0x2f180c4effbaa3a6 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 15 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99d3 expref: 553 pid: 6494 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166976.840416:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220a00/0x2f180c4effbaa3a6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 15 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99d3 expref: 553 pid: 6494 timeout: 695 lvb_type: 0 00010000:00010000:0.0:1762166976.840433:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166976.840439:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220600/0x2f180c4effbaa512 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166976.840450:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220600/0x2f180c4effbaa512 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 14 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166976.840465:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220600/0x2f180c4effbaa512 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 14 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166976.840519:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166976.840555:0:6497:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220600/0x2f180c4effbaa512 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166976.840565:0:6497:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220600/0x2f180c4effbaa512 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00000100:00100000:0.0:1762166976.840583:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5588e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+552:2418:x1847765450403328:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 222us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166976.840593:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9532 00000040:00080000:1.0:1762166976.840792:0:6497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5879, 88 off460248 00000004:00080000:1.0:1762166976.840801:0:6497:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 595989322776ns, next at 595897461133ns, rc = 0 00000040:00080000:1.0:1762166976.840834:0:6497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5878, 88 off460248 00000004:00080000:1.0:1762166976.840839:0:6497:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 595989361398ns, next at 595897495953ns, rc = 0 00000040:00080000:1.0:1762166976.840863:0:6497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5879, 88 off460336 00000004:00080000:1.0:1762166976.840868:0:6497:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 595989390386ns, next at 595897495953ns, rc = 0 00000040:00080000:1.0:1762166976.840882:0:6497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5880, 88 off460336 00000004:00080000:1.0:1762166976.840886:0:6497:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 595989407945ns, next at 595897461133ns, rc = 0 00000040:00080000:1.0:1762166976.840933:0:6497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5880, 88 off460424 00000004:00080000:1.0:1762166976.840940:0:6497:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 595989461716ns, next at 595897495953ns, rc = 0 00000040:00080000:1.0:1762166976.840960:0:6497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5881, 88 off460424 00000004:00080000:1.0:1762166976.840965:0:6497:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 595989487004ns, next at 595897461133ns, rc = 0 00000040:00080000:1.0:1762166976.840995:0:6497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5881, 88 off460512 00000004:00080000:1.0:1762166976.841000:0:6497:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 595989521984ns, next at 595897495953ns, rc = 0 00000040:00080000:1.0:1762166976.841019:0:6497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5882, 88 off460512 00000004:00080000:1.0:1762166976.841025:0:6497:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 595989547005ns, next at 595897461133ns, rc = 0 00000001:00080000:3.0:1762166976.841952:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294991935 is committed 00000004:00080000:3.0:1762166976.841958:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3246 committed 00000004:00080000:3.0:1762166976.841971:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3249 committed 00000004:00080000:3.0:1762166976.841987:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3245 committed 00000004:00080000:3.0:1762166976.841994:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3248 committed 00010000:00010000:2.0:1762166976.841994:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaa3e5 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00000004:00080000:3.0:1762166976.841998:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3244 committed 00000004:00080000:3.0:1762166976.842003:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3247 committed 00000004:00080000:3.0:1762166976.842009:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3246 committed 00010000:00010000:2.0:1762166976.842010:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaa3e5 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00000004:00080000:3.0:1762166976.842016:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3243 committed 00010000:00010000:2.0:1762166976.842020:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaa3e5 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166976.842031:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc6221a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166976.842038:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaa3e5 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166976.842046:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaa3e5 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166976.842066:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166976.842074:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166976.842080:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaa3e5 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166976.842087:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaa3e5 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166976.842108:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220c00/0x2f180c4effbaa401 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166976.842116:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220c00/0x2f180c4effbaa401 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00000100:00100000:0.0:1762166976.842123:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449704576:0@lo:2:osp-syn-1-1.0 00010000:00010000:2.0:1762166976.842128:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220c00/0x2f180c4effbaa401 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166976.842141:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc6220c00 already unused, calling callback (ffffffffc18e2310) 00000100:00100000:1.0:1762166976.842145:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449704192:0@lo:2:osp-syn-1-1.0 00010000:00010000:2.0:1762166976.842146:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220c00/0x2f180c4effbaa401 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166976.842156:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220c00/0x2f180c4effbaa401 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166976.842164:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166976.842168:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166976.842171:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220c00/0x2f180c4effbaa401 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166976.842177:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220c00/0x2f180c4effbaa401 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166976.842189:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa432 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166976.842196:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa432 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166976.842202:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa432 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00000100:00100000:1.0:1762166976.842203:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1762166976.842211:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc6221c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166976.842214:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa432 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166976.842219:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa432 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166976.842228:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166976.842231:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166976.842234:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa432 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166976.842241:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa432 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00000100:00100000:3.0:1762166976.842244:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449704192 00000100:00100000:1.0:1762166976.842245:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1ddc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449704704:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166976.842253:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449704192 00010000:00010000:2.0:1762166976.842259:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbaa44e lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00000100:00100000:0.0:1762166976.842264:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1762166976.842274:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbaa44e lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166976.842282:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbaa44e lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166976.842288:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa9800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166976.842292:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbaa44e lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00000100:00100000:1.0:1762166976.842294:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc47b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449704320:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166976.842302:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449704576 00010000:00010000:2.0:1762166976.842307:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbaa44e lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00000100:00100000:3.0:1762166976.842308:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449704576 00010000:00010000:2.0:1762166976.842322:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166976.842325:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166976.842328:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbaa44e lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166976.842334:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbaa44e lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00000100:00100000:1.0:1762166976.842343:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166976.842345:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18883 00000100:00100000:0.0:1762166976.842349:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc47b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449705088:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166976.842361:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6cd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+10:3635:x1847765449704192:12345-0@lo:2:osp-syn-1-1.0 00010000:00010000:2.0:1762166976.842361:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221000/0x2f180c4effbaa47f lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166976.842374:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221000/0x2f180c4effbaa47f lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00000100:00100000:1.0:1762166976.842380:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1ddd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449704832:0@lo:2:osp-syn-1-1.0 00010000:00010000:2.0:1762166976.842382:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221000/0x2f180c4effbaa47f lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00000100:00100000:0.0:1762166976.842396:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1762166976.842397:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc6221000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166976.842403:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221000/0x2f180c4effbaa47f lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166976.842409:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221000/0x2f180c4effbaa47f lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166976.842422:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166976.842425:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166976.842429:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221000/0x2f180c4effbaa47f lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166976.842435:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221000/0x2f180c4effbaa47f lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00000100:00100000:1.0:1762166976.842444:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166976.842448:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00010000:00010000:2.0:1762166976.842455:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221e00/0x2f180c4effbaa49b lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00000100:00100000:0.0:1762166976.842463:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc47b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449704448:0@lo:2:osp-syn-0-1.0 00002000:00010000:3.0:1762166976.842464:0:35472:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 244188 -> 244188 00010000:00010000:2.0:1762166976.842468:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221e00/0x2f180c4effbaa49b lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166976.842512:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221e00/0x2f180c4effbaa49b lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00002000:00010000:3.0:1762166976.842519:0:35472:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00010000:00010000:2.0:1762166976.842520:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc6221e00 already unused, calling callback (ffffffffc18e2310) 00002000:00010000:3.0:1762166976.842525:0:35472:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166976 -> 1762166976 00010000:00010000:2.0:1762166976.842527:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221e00/0x2f180c4effbaa49b lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00002000:00010000:3.0:1762166976.842530:0:35472:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00000100:00100000:1.0:1762166976.842532:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449704320 00002000:00010000:3.0:1762166976.842537:0:35472:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 352 -> 352 00010000:00010000:2.0:1762166976.842541:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221e00/0x2f180c4effbaa49b lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00000100:00100000:1.0:1762166976.842541:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449704320 00000100:00100000:0.0:1762166976.842555:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1762166976.842561:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166976.842566:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166976.842571:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221e00/0x2f180c4effbaa49b lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166976.842577:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221e00/0x2f180c4effbaa49b lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00000100:00100000:1.0:1762166976.842594:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449705088 00000100:00100000:0.0:1762166976.842596:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc47b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449704960:0@lo:2:osp-syn-0-1.0 00010000:00010000:2.0:1762166976.842598:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbaa4cc lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00000100:00100000:1.0:1762166976.842600:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449705088 00000100:00100000:3.0:1762166976.842610:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6cd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+11:3635:x1847765449704192:12345-0@lo:2:osp-syn-1-1.0 Request processed in 251us (403us total) trans 17179876281 rc 0/0 00010000:00010000:2.0:1762166976.842613:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbaa4cc lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166976.842623:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbaa4cc lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00000100:00100000:3.0:1762166976.842625:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18883 00000100:00100000:0.0:1762166976.842641:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1762166976.842649:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa8c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166976.842655:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbaa4cc lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00000100:00100000:3.0:1762166976.842662:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449704448 00000100:00100000:1.0:1762166976.842662:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449704832 00010000:00010000:2.0:1762166976.842664:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbaa4cc lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00000100:00100000:1.0:1762166976.842668:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449704832 00000100:00100000:3.0:1762166976.842669:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449704448 00010000:00010000:2.0:1762166976.842680:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166976.842685:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166976.842689:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbaa4cc lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166976.842696:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbaa4cc lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00000100:00100000:1.0:1762166976.842702:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449704960 00000100:00100000:1.0:1762166976.842708:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449704960 00000100:00100000:3.0:1762166976.842709:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18884 00010000:00010000:2.0:1762166976.842709:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221800/0x2f180c4effbaa4e8 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166976.842719:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221800/0x2f180c4effbaa4e8 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00000100:00100000:0.0:1762166976.842726:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18885 00000100:00100000:3.0:1762166976.842729:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+11:3634:x1847765449704576:12345-0@lo:2:osp-syn-1-1.0 00010000:00010000:2.0:1762166976.842746:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221800/0x2f180c4effbaa4e8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00000100:00100000:0.0:1762166976.842747:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6cd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+8:3636:x1847765449704320:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1762166976.842761:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18886 00010000:00010000:2.0:1762166976.842766:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc6221800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166976.842772:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221800/0x2f180c4effbaa4e8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00000100:00100000:1.0:1762166976.842777:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+8:3634:x1847765449705088:12345-0@lo:2:osp-syn-0-1.0 00010000:00010000:2.0:1762166976.842791:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221800/0x2f180c4effbaa4e8 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00002000:00010000:3.0:1762166976.842797:0:35472:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00010000:00010000:2.0:1762166976.842800:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00002000:00010000:3.0:1762166976.842801:0:35472:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:3.0:1762166976.842809:0:35472:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166976 -> 1762166976 00010000:00010000:2.0:1762166976.842809:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00002000:00010000:3.0:1762166976.842815:0:35472:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00010000:00010000:2.0:1762166976.842816:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221800/0x2f180c4effbaa4e8 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00002000:00010000:3.0:1762166976.842819:0:35472:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00010000:2.0:1762166976.842828:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221800/0x2f180c4effbaa4e8 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166976.842840:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaa4f6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166976.842847:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaa4f6 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166976.842853:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaa4f6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166976.842859:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc6221400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166976.842865:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaa4f6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00000100:00100000:3.0:1762166976.842872:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+12:3634:x1847765449704576:12345-0@lo:2:osp-syn-1-1.0 Request processed in 150us (615us total) trans 17179876282 rc 0/0 00010000:00010000:2.0:1762166976.842874:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaa4f6 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00002000:00010000:0.0:1762166976.842886:0:8383:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166976.842888:0:28874:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb size from disk: 244188 -> 244188 00000100:00100000:3.0:1762166976.842903:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18884 00010000:00010000:2.0:1762166976.842904:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00002000:00010000:0.0:1762166976.842907:0:8383:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb mtime from disk: 1762166966 -> 1762166966 00010000:00010000:2.0:1762166976.842912:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00002000:00010000:1.0:1762166976.842914:0:28874:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:0.0:1762166976.842918:0:8383:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb atime from disk: 0 -> 0 00010000:00010000:2.0:1762166976.842920:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaa4f6 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00002000:00010000:1.0:1762166976.842921:0:28874:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00002000:00010000:0.0:1762166976.842927:0:8383:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb ctime from disk: 1762166966 -> 1762166966 00000100:00100000:3.0:1762166976.842928:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18887 00002000:00010000:1.0:1762166976.842933:0:28874:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:0.0:1762166976.842940:0:8383:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:1.0:1762166976.842945:0:28874:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb blocks from disk: 232 -> 232 00000100:00100000:3.0:1762166976.842953:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6cd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+11:3636:x1847765449704832:12345-0@lo:2:osp-syn-1-1.0 00010000:00010000:2.0:1762166976.842954:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaa4f6 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00000100:00100000:2.0:1762166976.843004:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18888 00000100:00100000:0.0:1762166976.843010:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6cd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+10:3636:x1847765449704320:12345-0@lo:2:osp-syn-0-1.0 Request processed in 264us (666us total) trans 21474843248 rc 0/0 00000100:00100000:1.0:1762166976.843022:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+10:3634:x1847765449705088:12345-0@lo:2:osp-syn-0-1.0 Request processed in 242us (622us total) trans 21474843249 rc 0/0 00000100:00100000:2.0:1762166976.843026:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+10:3634:x1847765449704448:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1762166976.843032:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18885 00002000:00010000:3.0:1762166976.843039:0:35472:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:1.0:1762166976.843046:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18886 00002000:00010000:3.0:1762166976.843047:0:35472:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:3.0:1762166976.843052:0:35472:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166976.843056:0:35472:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:3.0:1762166976.843060:0:35472:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1762166976.843067:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18889 00000100:00100000:0.0:1762166976.843078:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5805880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+8:3634:x1847765449704960:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1762166976.843097:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166976.843104:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6cd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+12:3636:x1847765449704832:12345-0@lo:2:osp-syn-1-1.0 Request processed in 160us (662us total) trans 17179876283 rc 0/0 00000100:00100000:3.0:1762166976.843113:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18887 00002000:00010000:2.0:1762166976.843120:0:8380:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166976.843125:0:8380:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:2.0:1762166976.843128:0:8380:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166976 -> 1762166976 00002000:00010000:2.0:1762166976.843132:0:8380:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:2.0:1762166976.843136:0:8380:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00000100:00100000:3.0:1762166976.843141:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449704704 00002000:00010000:0.0:1762166976.843148:0:8383:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb size from disk: 244188 -> 244188 00000100:00100000:3.0:1762166976.843149:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449704704 00000004:00080000:1.0:1762166976.843151:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf1cd1180/2, rc 0, transno 17179876281 00002000:00010000:0.0:1762166976.843153:0:8383:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:0.0:1762166976.843159:0:8383:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb atime from disk: 1762166973 -> 1762166973 00002000:00010000:0.0:1762166976.843165:0:8383:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00000100:00100000:1.0:1762166976.843166:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449704192:0@lo:2:osp-syn-1-1.0 00002000:00010000:0.0:1762166976.843171:0:8383:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb blocks from disk: 232 -> 232 00000100:00100000:3.0:1762166976.843181:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18890 00000100:00100000:2.0:1762166976.843183:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+10:3634:x1847765449704448:12345-0@lo:2:osp-syn-0-1.0 Request processed in 161us (631us total) trans 21474843250 rc 0/0 00000100:00100000:2.0:1762166976.843194:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18888 00000100:00100000:3.0:1762166976.843196:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+12:3635:x1847765449704704:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1762166976.843217:0:3636:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 21474843230 gen 2 00000004:00080000:1.0:1762166976.843223:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf1e6e680, transno 21474843219 00000100:00100000:0.0:1762166976.843229:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5805880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+9:3634:x1847765449704960:12345-0@lo:2:osp-syn-0-1.0 Request processed in 151us (596us total) trans 21474843251 rc 0/0 00000004:00080000:1.0:1762166976.843238:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf1e6e300, transno 21474843220 00000100:00100000:0.0:1762166976.843240:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18889 00000004:00080000:1.0:1762166976.843248:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf1e6ea00, transno 21474843221 00000004:00080000:1.0:1762166976.843256:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf1e6fb80, transno 21474843222 00000004:00080000:1.0:1762166976.843263:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc7b20e00, transno 21474843223 00000004:00080000:1.0:1762166976.843267:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc7b22300, transno 21474843224 00000004:00080000:1.0:1762166976.843269:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc7b20a80, transno 21474843225 00000004:00080000:1.0:1762166976.843271:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc7b21880, transno 21474843226 00000004:00080000:1.0:1762166976.843272:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc7b23100, transno 21474843227 00000004:00080000:1.0:1762166976.843275:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc7b21c00, transno 21474843228 00000004:00080000:1.0:1762166976.843276:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc7b21180, transno 21474843229 00000004:00080000:1.0:1762166976.843285:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc7b22a00, transno 21474843230 00000100:00100000:1.0:1762166976.843300:0:3636:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff945bc47b5c00 x1847765449704320/t21474843248(21474843248) o2->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 440/432 e 0 to 0 dl 1762166992 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1762166976.843307:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc47b5c00/2, rc 0, transno 21474843248 00000100:00100000:1.0:1762166976.843311:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc47b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449704320:0@lo:2:osp-syn-0-1.0 00000004:00080000:1.0:1762166976.843346:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf1ddd180/2, rc 0, transno 17179876283 00000004:00080000:0.0:1762166976.843348:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc47b7800/2, rc 0, transno 21474843250 00000100:00100000:1.0:1762166976.843354:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1ddd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449704832:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1762166976.843362:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc47b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449704448:0@lo:2:osp-syn-0-1.0 00000004:00080000:0.0:1762166976.843392:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc47b5880/2, rc 0, transno 21474843251 00000100:00100000:0.0:1762166976.843397:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc47b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449704960:0@lo:2:osp-syn-0-1.0 00000004:00080000:0.0:1762166976.843422:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc47b7100/2, rc 0, transno 21474843249 00000100:00100000:0.0:1762166976.843427:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc47b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449705088:0@lo:2:osp-syn-0-1.0 00000004:00080000:0.0:1762166976.843450:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf1cd3800/2, rc 0, transno 17179876282 00000004:00010000:1.0:1762166976.843453:0:6497:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000b3cbf85a reply state 00000000bbf28559 transno 4294991935 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220600/0x2f180c4effbaa512 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00000100:00100000:0.0:1762166976.843458:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449704576:0@lo:2:osp-syn-1-1.0 00000004:00080000:2.0:1762166976.843473:0:9158:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0001: 0 changes, 4 in progress, 0 in flight, 12 done 00010000:00010000:1.0:1762166976.843515:0:6497:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220600/0x2f180c4effbaa512 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166976.843527:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.843529:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1762166976.843531:0:6497:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1762166976.843536:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.843538:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762166976.843543:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaa37c lrc: 0/0,0 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e99cc expref: 525 pid: 6494 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166976.843549:0:35472:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166976.843553:0:35472:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:2.0:1762166976.843556:0:35472:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb atime from disk: 1762166973 -> 1762166973 00002000:00010000:2.0:1762166976.843559:0:35472:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:2.0:1762166976.843562:0:35472:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00080000:1.0:1762166976.843615:0:6497:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1762166976.843617:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+13:3635:x1847765449704704:12345-0@lo:2:osp-syn-1-1.0 Request processed in 426us (523us total) trans 17179876284 rc 0/0 00000100:00100000:2.0:1762166976.843628:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18890 00000100:00100000:1.0:1762166976.843632:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+525:61842:x1847765450403200:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 4955us (5055us total) trans 4294991935 rc 0/0 00000100:00100000:1.0:1762166976.843643:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11813 00010000:00010000:1.0:1762166976.843665:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220600/0x2f180c4effbaa512 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166976.843670:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220600/0x2f180c4effbaa512 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166976.843674:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220600/0x2f180c4effbaa512 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166976.843677:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc6220600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166976.843679:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220600/0x2f180c4effbaa512 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166976.843685:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220600/0x2f180c4effbaa512 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166976.843695:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.843697:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166976.843701:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220600/0x2f180c4effbaa512 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166976.843706:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220600/0x2f180c4effbaa512 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT1 00000004:00080000:0.0:1762166976.843721:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf1ddc700/2, rc 0, transno 17179876284 00000100:00100000:0.0:1762166976.843728:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1ddc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449704704:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166976.844841:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.844883:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450403456 00000100:00100000:1.0:1762166976.844888:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450403456 00000100:00100000:1.0:1762166976.844933:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30348 00000100:00100000:1.0:1762166976.844943:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5588380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+524:61842:x1847765450403456:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166976.844957:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166976.844969:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220000/0x2f180c4effbaa519 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9a74 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.845023:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220000/0x2f180c4effbaa519 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a74 expref: 525 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.845035:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220000/0x2f180c4effbaa519 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a74 expref: 525 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.845050:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.845053:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166976.845055:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc6220000, rc 0) 00000100:00100000:1.0:1762166976.845092:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5588380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+525:61842:x1847765450403456:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 152us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166976.845100:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30348 00000100:00100000:2.0:1762166976.846295:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.846365:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450403712 00000100:00100000:1.0:1762166976.846374:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450403712 00000100:00100000:1.0:1762166976.846423:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11814 00000100:00100000:1.0:1762166976.846434:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+525:61842:x1847765450403712:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:1.0:1762166976.846702:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+526:61842:x1847765450403712:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 270us (408us total) trans 4294991936 rc 0/0 00000100:00100000:1.0:1762166976.846711:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11814 00000100:00100000:3.0:1762166976.855326:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.855399:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450403840 00000100:00100000:1.0:1762166976.855410:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450403840 00000100:00100000:1.0:1762166976.855467:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30349 00000100:00100000:1.0:1762166976.855498:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5589f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+526:61843:x1847765450403840:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166976.855526:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166976.855549:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220600/0x2f180c4effbaa520 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9a7b expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.855632:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaa527 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166976.855647:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaa527 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.855663:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaa527 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.855677:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaa52e lrc: 3/1,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166976.855681:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaa52e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.855684:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaa52e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.855771:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221800/0x2f180c4effbaa535 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166976.855780:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221800/0x2f180c4effbaa535 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.855786:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221800/0x2f180c4effbaa535 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:1.0:1762166976.855831:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 244188 00000004:00200000:1.0:1762166976.855835:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166976.855854:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221800/0x2f180c4effbaa535 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.855864:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221800/0x2f180c4effbaa535 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.855871:0:6494:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaa527 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.855875:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaa527 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.855882:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaa527 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.855887:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaa527 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.855905:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc6220e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166976.855908:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaa527 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.855913:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaa527 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.855924:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0x0 (ffff945bc812ee00) 00010000:00010000:1.0:1762166976.855926:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166976.855929:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaa527 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.855934:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaa527 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.855944:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaa52e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.855948:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaa52e lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.855951:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaa52e lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.855954:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc6221400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166976.855956:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaa52e lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.855962:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaa52e lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.855966:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0xdd396665 (ffff945bc812e300) 00010000:00010000:1.0:1762166976.855967:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166976.855968:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaa52e lrc: 2/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.855971:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaa52e lrc: 0/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.855995:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220600/0x2f180c4effbaa520 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a7b expref: 528 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.856004:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221800/0x2f180c4effbaa535 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a7b expref: 527 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.856008:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.856010:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166976.856011:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc6221800, rc 0) 00000100:00100000:1.0:1762166976.856090:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5589f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+527:61843:x1847765450403840:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 615us (777us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166976.856098:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30349 00000100:00100000:3.0:1762166976.857597:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.857631:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450404096 00000100:00100000:1.0:1762166976.857637:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450404096 00000100:00100000:1.0:1762166976.857674:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30350 00000100:00100000:1.0:1762166976.857679:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+527:61843:x1847765450404096:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166976.857692:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166976.857703:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221e00/0x2f180c4effbaa53c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9a82 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.857805:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221000/0x2f180c4effbaa543 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166976.857814:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221000/0x2f180c4effbaa543 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.857820:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221000/0x2f180c4effbaa543 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:1.0:1762166976.857827:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 244188 00010000:00010000:1.0:1762166976.857929:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221e00/0x2f180c4effbaa53c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a82 expref: 530 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.857944:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221000/0x2f180c4effbaa543 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a82 expref: 529 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.857952:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.857955:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1762166976.857958:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc6221000, rc 0) 00000100:00100000:1.0:1762166976.857999:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+529:61843:x1847765450404096:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 319us (408us total) trans 4294991937 rc 0/0 00000100:00100000:1.0:1762166976.858004:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30350 00000100:00100000:2.0:1762166976.859446:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.859515:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450404352 00000100:00100000:1.0:1762166976.859522:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450404352 00000100:00100000:1.0:1762166976.859564:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30351 00000100:00100000:1.0:1762166976.859572:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+529:61843:x1847765450404352:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166976.859592:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166976.859610:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa551 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9a89 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.859681:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220c00/0x2f180c4effbaa558 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166976.859693:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220c00/0x2f180c4effbaa558 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.859701:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220c00/0x2f180c4effbaa558 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:1.0:1762166976.859711:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 244188 00010000:00010000:1.0:1762166976.859779:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa551 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a89 expref: 532 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.859795:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220c00/0x2f180c4effbaa558 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a89 expref: 531 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.859804:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.859807:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762166976.859809:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc6220c00, rc 0) 00000100:00100000:1.0:1762166976.859852:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+531:61843:x1847765450404352:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 281us (412us total) trans 4294991938 rc 0/0 00000100:00100000:1.0:1762166976.859860:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30351 00000100:00100000:3.0:1762166976.884305:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.884387:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450404480 00000100:00100000:1.0:1762166976.884401:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450404480 00000100:00100000:1.0:1762166976.884511:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2129 00000100:00100000:1.0:1762166976.884524:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+28:2418:x1847765450404480:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:1.0:1762166976.884568:0:23939:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa566 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.884587:0:23939:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc6220200/0x2f180c4effbaa4fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a5f expref: 28 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.884594:0:23939:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166976.884596:0:23939:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166976.884598:0:23939:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa566 lrc: 4/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->245759] (req 0->245759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.884632:0:23939:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc6220200/0x2f180c4effbaa4fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a5f expref: 28 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.884643:0:23939:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc6220200/0x2f180c4effbaa4fd lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a5f expref: 28 pid: 28434 timeout: 696 lvb_type: 0 00000100:00100000:1.0:1762166976.884657:0:23939:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79e8000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:23939:1847765449705216:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166976.884762:0:23939:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cee0836c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166976.885608:0:23939:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79e8000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:23939:1847765449705216:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166976.885629:0:23939:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa566 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->245759] (req 0->245759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166976.885768:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166976.885830:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450404608 00000100:00100000:0.0:1762166976.885837:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450404608 00010000:00010000:0.0:1762166976.885864:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc6220200/0x2f180c4effbaa4fd lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a5f expref: 29 pid: 28434 timeout: 696 lvb_type: 0 00000100:00100000:0.0:1762166976.885911:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9533 00000100:00100000:0.0:1762166976.885921:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf9d1f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+29:2418:x1847765450404608:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166976.885936:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166976.885966:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc6220200/0x2f180c4effbaa4fd lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a5f expref: 29 pid: 28434 timeout: 696 lvb_type: 0 00010000:00010000:0.0:1762166976.885979:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc6220200/0x2f180c4effbaa4fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a5f expref: 29 pid: 28434 timeout: 696 lvb_type: 0 00010000:00010000:0.0:1762166976.886005:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc6220200/0x2f180c4effbaa4fd lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a5f expref: 29 pid: 28434 timeout: 696 lvb_type: 0 00010000:00010000:0.0:1762166976.886020:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166976.886022:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166976.886026:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa566 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->245759] (req 0->245759) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.886035:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa566 lrc: 4/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->245759] (req 0->245759) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.886059:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166976.886078:0:23939:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa566 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->245759] (req 0->245759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.886085:0:23939:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa566 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->245759] (req 0->245759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166976.886102:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf9d1f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+28:2418:x1847765450404608:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 181us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166976.886111:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9533 00010000:00010000:1.0:1762166976.887825:0:23939:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa566 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->245759] (req 0->245759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.887840:0:23939:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa566 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->245759] (req 0->245759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.887848:0:23939:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa566 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->245759] (req 0->245759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.887855:0:23939:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc6221c00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166976.887859:0:23939:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa566 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->245759] (req 0->245759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.887868:0:23939:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa566 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->245759] (req 0->245759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.887883:0:23939:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa566 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->245759] (req 0->245759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.887903:0:23939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa566 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->245759] (req 0->245759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166976.887964:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+27:2418:x1847765450404480:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 3442us (3711us total) trans 0 rc 244188/244188 00000100:00100000:1.0:1762166976.887970:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2129 00000100:00100000:3.0:1762166976.890229:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.890281:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450404736 00000100:00100000:1.0:1762166976.890292:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450404736 00000100:00100000:1.0:1762166976.890366:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2130 00000100:00100000:1.0:1762166976.890377:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4492a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450404736:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:1.0:1762166976.890414:0:23939:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc6221e00/0x2f180c4effbaa56d lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.890434:0:23939:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc6220800/0x2f180c4effbaa4d3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a4a expref: 19 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.890443:0:23939:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166976.890446:0:23939:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166976.890451:0:23939:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc6221e00/0x2f180c4effbaa56d lrc: 4/1,0 mode: --/PR res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->245759] (req 0->245759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.890512:0:23939:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc6220800/0x2f180c4effbaa4d3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a4a expref: 19 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.890531:0:23939:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc6220800/0x2f180c4effbaa4d3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a4a expref: 19 pid: 28434 timeout: 696 lvb_type: 0 00000100:00100000:1.0:1762166976.890548:0:23939:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79e8000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0000_UUID:23939:1847765449705344:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166976.890645:0:23939:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cee0836c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166976.891541:0:23939:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79e8000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0000_UUID:23939:1847765449705344:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166976.891563:0:23939:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bc6221e00/0x2f180c4effbaa56d lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->245759] (req 0->245759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166976.891774:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166976.891841:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450404864 00000100:00100000:0.0:1762166976.891847:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450404864 00010000:00010000:0.0:1762166976.891874:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc6220800/0x2f180c4effbaa4d3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a4a expref: 20 pid: 28434 timeout: 696 lvb_type: 0 00000100:00100000:0.0:1762166976.891916:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9534 00000100:00100000:0.0:1762166976.891925:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcceb7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450404864:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166976.891937:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166976.891958:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc6220800/0x2f180c4effbaa4d3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a4a expref: 20 pid: 28434 timeout: 696 lvb_type: 0 00010000:00010000:0.0:1762166976.891971:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc6220800/0x2f180c4effbaa4d3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a4a expref: 20 pid: 28434 timeout: 696 lvb_type: 0 00010000:00010000:0.0:1762166976.891995:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc6220800/0x2f180c4effbaa4d3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a4a expref: 20 pid: 28434 timeout: 696 lvb_type: 0 00010000:00010000:0.0:1762166976.892009:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166976.892011:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166976.892015:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc6221e00/0x2f180c4effbaa56d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->245759] (req 0->245759) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.892024:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc6221e00/0x2f180c4effbaa56d lrc: 4/1,0 mode: PR/PR res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->245759] (req 0->245759) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.892050:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166976.892083:0:23939:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bc6221e00/0x2f180c4effbaa56d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->245759] (req 0->245759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.892094:0:23939:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc6221e00/0x2f180c4effbaa56d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->245759] (req 0->245759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166976.892102:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcceb7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450404864:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 176us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166976.892126:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9534 00010000:00010000:1.0:1762166976.894145:0:23939:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc6221e00/0x2f180c4effbaa56d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->245759] (req 0->245759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.894160:0:23939:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc6221e00/0x2f180c4effbaa56d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->245759] (req 0->245759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.894165:0:23939:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc6221e00/0x2f180c4effbaa56d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->245759] (req 0->245759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.894170:0:23939:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc6221e00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166976.894173:0:23939:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc6221e00/0x2f180c4effbaa56d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->245759] (req 0->245759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.894178:0:23939:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc6221e00/0x2f180c4effbaa56d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->245759] (req 0->245759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.894189:0:23939:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc6221e00/0x2f180c4effbaa56d lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->245759] (req 0->245759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.894193:0:23939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc6221e00/0x2f180c4effbaa56d lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->245759] (req 0->245759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166976.894270:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4492a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450404736:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 3893us (4048us total) trans 0 rc 244188/244188 00000100:00100000:1.0:1762166976.894278:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2130 00000100:00100000:2.0:1762166976.896399:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.896460:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450404992 00000100:00100000:1.0:1762166976.896470:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450404992 00000100:00100000:1.0:1762166976.896573:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2131 00000100:00100000:1.0:1762166976.896586:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+18:2417:x1847765450404992:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:1.0:1762166976.896626:0:23939:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc6221c00/0x2f180c4effbaa574 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.896645:0:23939:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc6220400/0x2f180c4effbaa4ef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a58 expref: 18 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.896653:0:23939:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166976.896655:0:23939:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166976.896658:0:23939:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc6221c00/0x2f180c4effbaa574 lrc: 4/1,0 mode: --/PR res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->245759] (req 0->245759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.896689:0:23939:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc6220400/0x2f180c4effbaa4ef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a58 expref: 18 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.896701:0:23939:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc6220400/0x2f180c4effbaa4ef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a58 expref: 18 pid: 28434 timeout: 696 lvb_type: 0 00000100:00100000:1.0:1762166976.896713:0:23939:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79e8000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0000_UUID:23939:1847765449705472:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166976.896801:0:23939:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cee0836c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166976.897681:0:23939:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79e8000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0000_UUID:23939:1847765449705472:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166976.897708:0:23939:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bc6221c00/0x2f180c4effbaa574 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->245759] (req 0->245759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166976.897870:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166976.897927:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450405120 00000100:00100000:0.0:1762166976.897936:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450405120 00010000:00010000:0.0:1762166976.897969:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc6220400/0x2f180c4effbaa4ef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a58 expref: 19 pid: 28434 timeout: 696 lvb_type: 0 00000100:00100000:0.0:1762166976.898008:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9535 00000100:00100000:0.0:1762166976.898019:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450405120:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166976.898032:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166976.898049:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc6220400/0x2f180c4effbaa4ef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a58 expref: 19 pid: 28434 timeout: 696 lvb_type: 0 00010000:00010000:0.0:1762166976.898061:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc6220400/0x2f180c4effbaa4ef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a58 expref: 19 pid: 28434 timeout: 696 lvb_type: 0 00010000:00010000:0.0:1762166976.898084:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc6220400/0x2f180c4effbaa4ef lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a58 expref: 19 pid: 28434 timeout: 696 lvb_type: 0 00010000:00010000:0.0:1762166976.898098:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166976.898100:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166976.898104:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc6221c00/0x2f180c4effbaa574 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->245759] (req 0->245759) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.898113:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc6221c00/0x2f180c4effbaa574 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->245759] (req 0->245759) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.898140:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166976.898176:0:23939:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bc6221c00/0x2f180c4effbaa574 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->245759] (req 0->245759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166976.898181:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450405120:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 162us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166976.898200:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9535 00010000:00010000:1.0:1762166976.898205:0:23939:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc6221c00/0x2f180c4effbaa574 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->245759] (req 0->245759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.899766:0:23939:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc6221c00/0x2f180c4effbaa574 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->245759] (req 0->245759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.899779:0:23939:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc6221c00/0x2f180c4effbaa574 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->245759] (req 0->245759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.899786:0:23939:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc6221c00/0x2f180c4effbaa574 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->245759] (req 0->245759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.899793:0:23939:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc6221c00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166976.899797:0:23939:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc6221c00/0x2f180c4effbaa574 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->245759] (req 0->245759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.899805:0:23939:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc6221c00/0x2f180c4effbaa574 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->245759] (req 0->245759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.899818:0:23939:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc6221c00/0x2f180c4effbaa574 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->245759] (req 0->245759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.899830:0:23939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc6221c00/0x2f180c4effbaa574 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->245759] (req 0->245759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166976.899905:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+17:2417:x1847765450404992:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 3308us (3499us total) trans 0 rc 244188/244188 00000100:00100000:1.0:1762166976.899914:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2131 00000100:00100000:3.0:1762166976.907243:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166976.907314:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450405248 00000100:00100000:0.0:1762166976.907328:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450405248 00000100:00100000:0.0:1762166976.907408:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 865 00000100:00100000:0.0:1762166976.907419:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc59d7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+531:61843:x1847765450405248:12345-192.168.204.38@tcp:103:lfs.0 00010000:00010000:0.0:1762166976.907435:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166976.907463:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220c00/0x2f180c4effbaa558 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a89 expref: 531 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.907521:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166976.907528:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166976.907587:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc59d7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+530:61843:x1847765450405248:12345-192.168.204.38@tcp:103:lfs.0 Request processed in 169us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166976.907597:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 865 00000100:00100000:3.0:1762166976.908391:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.908438:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450405504 00000100:00100000:1.0:1762166976.908450:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450405504 00000100:00100000:1.0:1762166976.908556:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11815 00000100:00100000:1.0:1762166976.908571:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7d2bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+530:61843:x1847765450405504:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:1.0:1762166976.908786:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7d2bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+531:61843:x1847765450405504:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 220us (395us total) trans 4294991939 rc 0/0 00000100:00100000:1.0:1762166976.908795:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11815 00000100:00100000:2.0:1762166976.910722:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.910773:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450405760 00000100:00100000:1.0:1762166976.910780:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450405760 00000100:00100000:1.0:1762166976.910823:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30352 00000100:00100000:1.0:1762166976.910832:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+531:61766:x1847765450405760:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:1.0:1762166976.910850:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166976.910867:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa57b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9a90 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.910961:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221e00/0x2f180c4effbaa582 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166976.910980:0:6494:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221800/0x2f180c4effbaa535 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a7b expref: 532 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.910992:0:6494:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221e00/0x2f180c4effbaa582 lrc: 4/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.911026:0:6494:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221800/0x2f180c4effbaa535 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a7b expref: 532 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.911038:0:6494:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221800/0x2f180c4effbaa535 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a7b expref: 532 pid: 6494 timeout: 696 lvb_type: 0 00000100:00100000:1.0:1762166976.911055:0:6494:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79e8000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765449705600:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166976.911128:0:6494:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cee083000 going to sleep for 11 seconds 00000100:00100000:1.0:1762166976.911984:0:6494:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79e8000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765449705600:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166976.912003:0:6494:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221e00/0x2f180c4effbaa582 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000100:00100000:2.0:1762166976.912290:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166976.912336:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450405888 00000100:00100000:0.0:1762166976.912343:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450405888 00010000:00010000:0.0:1762166976.912365:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221800/0x2f180c4effbaa535 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a7b expref: 533 pid: 6494 timeout: 696 lvb_type: 0 00000100:00100000:0.0:1762166976.912393:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9536 00000100:00100000:0.0:1762166976.912408:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b20700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+533:2419:x1847765450405888:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166976.912420:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166976.912425:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221800/0x2f180c4effbaa535 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a7b expref: 533 pid: 6494 timeout: 696 lvb_type: 0 00010000:00010000:0.0:1762166976.912441:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221800/0x2f180c4effbaa535 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a7b expref: 533 pid: 6494 timeout: 696 lvb_type: 0 00010000:00010000:0.0:1762166976.912460:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221800/0x2f180c4effbaa535 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a7b expref: 533 pid: 6494 timeout: 696 lvb_type: 0 00010000:00010000:0.0:1762166976.912473:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166976.912497:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221e00/0x2f180c4effbaa582 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166976.912505:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221e00/0x2f180c4effbaa582 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166976.912512:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221e00/0x2f180c4effbaa582 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166976.912533:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166976.912555:0:6494:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221e00/0x2f180c4effbaa582 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.912565:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221e00/0x2f180c4effbaa582 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000100:00100000:0.0:1762166976.912566:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b20700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+532:2419:x1847765450405888:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 160us (275us total) trans 0 rc 0/0 00000004:00200000:1.0:1762166976.912588:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 244188 00000100:00100000:0.0:1762166976.912591:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9536 00010000:00010000:1.0:1762166976.912686:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa57b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a90 expref: 533 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.912701:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221e00/0x2f180c4effbaa582 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a90 expref: 532 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.912709:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.912712:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1762166976.912714:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc6221e00, rc 0) 00000100:00100000:1.0:1762166976.912747:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+532:61766:x1847765450405760:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 1915us (2027us total) trans 4294991940 rc 0/0 00000100:00100000:1.0:1762166976.912755:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30352 00000100:00100000:2.0:1762166976.913725:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.913764:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450406016 00000100:00100000:1.0:1762166976.913770:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450406016 00000100:00100000:1.0:1762166976.913808:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30353 00000100:00100000:1.0:1762166976.913817:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+532:61766:x1847765450406016:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:1.0:1762166976.913832:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166976.913845:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220600/0x2f180c4effbaa590 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9a97 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.913933:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaa597 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166976.913945:0:6494:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221e00/0x2f180c4effbaa582 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a90 expref: 533 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.913952:0:6494:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaa597 lrc: 4/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.913977:0:6494:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221e00/0x2f180c4effbaa582 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a90 expref: 533 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.913988:0:6494:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221e00/0x2f180c4effbaa582 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a90 expref: 533 pid: 6494 timeout: 696 lvb_type: 0 00000100:00100000:1.0:1762166976.913997:0:6494:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79e8000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765449705728:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166976.914044:0:6494:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cee083780 going to sleep for 11 seconds 00000100:00100000:1.0:1762166976.914788:0:6494:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79e8000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765449705728:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166976.914804:0:6494:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaa597 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000100:00100000:2.0:1762166976.915034:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166976.915065:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450406144 00000100:00100000:0.0:1762166976.915070:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450406144 00010000:00010000:0.0:1762166976.915085:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221e00/0x2f180c4effbaa582 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a90 expref: 534 pid: 6494 timeout: 696 lvb_type: 0 00000100:00100000:0.0:1762166976.915114:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9537 00000100:00100000:0.0:1762166976.915122:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b22300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+534:2418:x1847765450406144:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166976.915131:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166976.915137:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221e00/0x2f180c4effbaa582 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a90 expref: 534 pid: 6494 timeout: 696 lvb_type: 0 00010000:00010000:0.0:1762166976.915147:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221e00/0x2f180c4effbaa582 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a90 expref: 534 pid: 6494 timeout: 696 lvb_type: 0 00010000:00010000:0.0:1762166976.915161:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221e00/0x2f180c4effbaa582 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a90 expref: 534 pid: 6494 timeout: 696 lvb_type: 0 00010000:00010000:0.0:1762166976.915173:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166976.915177:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaa597 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166976.915184:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaa597 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166976.915191:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaa597 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166976.915207:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166976.915234:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b22300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+533:2418:x1847765450406144:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 112us (200us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166976.915235:0:6494:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaa597 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000100:00100000:0.0:1762166976.915251:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9537 00010000:00010000:1.0:1762166976.915260:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaa597 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:1.0:1762166976.915292:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 244188 00000004:00200000:1.0:1762166976.915295:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166976.915309:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaa597 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.915325:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220600/0x2f180c4effbaa590 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a97 expref: 533 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.915333:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaa597 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a97 expref: 532 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.915339:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.915341:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166976.915342:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc6221400, rc 0) 00000100:00100000:1.0:1762166976.915368:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+532:61766:x1847765450406016:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 1554us (1646us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166976.915375:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30353 00000100:00100000:2.0:1762166976.916600:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166976.916644:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450406272 00000100:00100000:0.0:1762166976.916650:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450406272 00000100:00100000:0.0:1762166976.916684:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18891 00000100:00100000:0.0:1762166976.916693:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+27:2419:x1847765450406272:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:0.0:1762166976.916705:0:35472:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166976.916721:0:35472:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbaa59e lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9a9e expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166976.916761:0:35472:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa77:0x0] initial LVB size: 244188, mtime: 0x690888c0, atime: 0x690888c0, ctime: 0x690888c1, blocks: 0x160 00010000:00010000:0.0:1762166976.916775:0:35472:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166976.916777:0:35472:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166976.916785:0:35472:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbaa59e lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a9e expref: 28 pid: 35472 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166976.916799:0:35472:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbaa59e lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a9e expref: 28 pid: 35472 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166976.916810:0:35472:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdf400, rc 0) 00000100:00100000:0.0:1762166976.916844:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+28:2419:x1847765450406272:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 153us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166976.916851:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18891 00000100:00100000:3.0:1762166976.918306:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.918426:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450406400 00000100:00100000:1.0:1762166976.918433:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450406400 00002000:00100000:1.0:1762166976.918463:0:23939:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xa77:0x0] (45056->86015) req@ffff945bc59d5f80 x1847765450406400/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:7/0 lens 488/0 e 0 to 0 dl 1762166987 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166976.918473:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc59d5f80 with x1847765450406400 ext(45056->86015) 00002000:00010000:1.0:1762166976.918509:0:23939:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc59d5f80 00000100:00100000:1.0:1762166976.918534:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2132 00000100:00100000:1.0:1762166976.918544:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc59d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+28:2419:x1847765450406400:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:1.0:1762166976.919566:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc59d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+28:2419:x1847765450406400:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 1022us (1267us total) trans 0 rc 40960/40960 00000100:00100000:1.0:1762166976.919574:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2132 00002000:00100000:1.0:1762166976.919589:0:23939:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xa77:0x0] (45056->86015) req@ffff945bc59d5f80 x1847765450406400/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:7/0 lens 488/440 e 0 to 0 dl 1762166987 ref 1 fl Complete:/600/0 rc 40960/40960 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166976.919597:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc59d5f80 with x1847765450406400 ext(45056->86015) 00002000:00010000:1.0:1762166976.919601:0:23939:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc59d5f80 00000100:00100000:2.0:1762166976.921239:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.921305:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450406656 00000100:00100000:1.0:1762166976.921311:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450406656 00000100:00100000:1.0:1762166976.921352:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11816 00000100:00100000:1.0:1762166976.921360:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+532:61766:x1847765450406656:12345-192.168.204.38@tcp:35:fsx.0 00000100:00100000:1.0:1762166976.921551:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+533:61766:x1847765450406656:12345-192.168.204.38@tcp:35:fsx.0 Request processed in 191us (313us total) trans 4294991941 rc 0/0 00000100:00100000:1.0:1762166976.921567:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11816 00000100:00100000:3.0:1762166976.922405:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.922449:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450406912 00000100:00100000:1.0:1762166976.922453:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450406912 00000100:00100000:1.0:1762166976.922509:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30354 00000100:00100000:1.0:1762166976.922517:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc59d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+533:61766:x1847765450406912:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:1.0:1762166976.922529:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166976.922533:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 1 00010000:00010000:1.0:1762166976.922556:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221000/0x2f180c4effbaa543 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a82 expref: 533 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.922576:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220000/0x2f180c4effbaa519 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a74 expref: 532 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.922607:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaa597 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a97 expref: 531 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.922616:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.922620:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166976.922631:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaa5a5 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9aa5 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.922665:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaa5ac lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166976.922676:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaa5ac lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.922686:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaa5ac lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000040:00080000:1.0:1762166976.922877:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5883, 88 off460600 00000004:00080000:1.0:1762166976.922885:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 596071406688ns, next at 595897461133ns, rc = 0 00000040:00080000:1.0:1762166976.922934:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5882, 88 off460600 00000004:00080000:1.0:1762166976.922939:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 596071461358ns, next at 595897495953ns, rc = 0 00000040:00080000:1.0:1762166976.922967:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5883, 88 off460688 00000004:00080000:1.0:1762166976.922972:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 596071494529ns, next at 595897495953ns, rc = 0 00000040:00080000:1.0:1762166976.922983:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5884, 88 off460688 00000004:00080000:1.0:1762166976.922987:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 596071508953ns, next at 595897461133ns, rc = 0 00000040:00080000:1.0:1762166976.923007:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5884, 88 off460776 00000004:00080000:1.0:1762166976.923013:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 596071535253ns, next at 595897495953ns, rc = 0 00000040:00080000:1.0:1762166976.923027:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5885, 88 off460776 00000004:00080000:1.0:1762166976.923032:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 596071553719ns, next at 595897461133ns, rc = 0 00000040:00080000:1.0:1762166976.923043:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5885, 88 off460864 00000004:00080000:1.0:1762166976.923047:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 596071569507ns, next at 595897495953ns, rc = 0 00000040:00080000:1.0:1762166976.923065:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5886, 88 off460864 00000004:00080000:1.0:1762166976.923070:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 596071591989ns, next at 595897461133ns, rc = 0 00000001:00080000:3.0:1762166976.924055:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294991942 is committed 00000004:00080000:3.0:1762166976.924061:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3250 committed 00000004:00080000:3.0:1762166976.924071:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3253 committed 00000004:00080000:3.0:1762166976.924081:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3249 committed 00000004:00080000:3.0:1762166976.924084:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3252 committed 00000004:00080000:3.0:1762166976.924087:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3248 committed 00000004:00080000:3.0:1762166976.924090:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3251 committed 00000004:00080000:3.0:1762166976.924092:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3250 committed 00000004:00080000:3.0:1762166976.924094:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3247 committed 00000100:00100000:3.0:1762166976.924147:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1762166976.924167:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7b23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449705984:0@lo:2:osp-syn-0-1.0 00010000:00010000:1.0:1762166976.924178:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaa5ac lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9aa5 expref: 526 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.924189:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.924194:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1762166976.924205:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaa5a5 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9aa5 expref: 526 pid: 6494 timeout: 0 lvb_type: 3 00000100:00100000:0.0:1762166976.924221:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449706112:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166976.924225:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1762166976.924225:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaa5ac lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9aa5 expref: 525 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.924246:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.924250:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1762166976.924253:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc6221a00, rc 0) 00000100:00100000:2.0:1762166976.924259:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449706368:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1762166976.924267:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166976.924273:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcce75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449705856:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1762166976.924294:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc59d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+525:61766:x1847765450406912:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 1776us (1888us total) trans 4294991942 rc 0/0 00000100:00100000:0.0:1762166976.924299:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc47b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449706624:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1762166976.924305:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30354 00000100:00100000:2.0:1762166976.924313:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166976.924340:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166976.924351:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449705984 00000100:00100000:2.0:1762166976.924354:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1762166976.924358:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449705984 00000100:00100000:1.0:1762166976.924361:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449706112 00000100:00100000:0.0:1762166976.924365:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1762166976.924366:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7b21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449706496:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1762166976.924368:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449706112 00000100:00100000:0.0:1762166976.924376:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7b21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449706240:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166976.924395:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449706368 00000100:00100000:3.0:1762166976.924401:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449706368 00000100:00100000:1.0:1762166976.924404:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449706624 00000100:00100000:1.0:1762166976.924409:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449706624 00000100:00100000:2.0:1762166976.924413:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166976.924432:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449706496 00000100:00100000:0.0:1762166976.924438:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449706496 00000100:00100000:3.0:1762166976.924442:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18892 00000100:00100000:1.0:1762166976.924451:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18893 00000100:00100000:3.0:1762166976.924461:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc59d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+10:3636:x1847765449705984:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1762166976.924463:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5589c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+15:3633:x1847765449706112:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1762166976.924502:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18894 00000100:00100000:0.0:1762166976.924509:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18895 00000100:00100000:2.0:1762166976.924514:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+15:3635:x1847765449706368:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1762166976.924522:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5588e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+15:3633:x1847765449706624:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:2.0:1762166976.924591:0:9168:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166976.924595:0:9168:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:2.0:1762166976.924598:0:9168:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb atime from disk: 1762166973 -> 1762166973 00002000:00010000:3.0:1762166976.924600:0:8382:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166976.924601:0:9168:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:1.0:1762166976.924601:0:35472:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166976.924606:0:9165:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166976.924608:0:8382:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb mtime from disk: 1762166966 -> 1762166966 00002000:00010000:1.0:1762166976.924610:0:35472:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:2.0:1762166976.924611:0:9168:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:0.0:1762166976.924614:0:9165:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:3.0:1762166976.924616:0:8382:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1762166976.924619:0:35472:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166976 -> 1762166976 00002000:00010000:0.0:1762166976.924622:0:9165:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166976.924623:0:8382:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb ctime from disk: 1762166966 -> 1762166966 00002000:00010000:1.0:1762166976.924624:0:35472:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:0.0:1762166976.924629:0:9165:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:3.0:1762166976.924630:0:8382:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:1.0:1762166976.924632:0:35472:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:0.0:1762166976.924637:0:9165:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1762166976.924654:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+18:3635:x1847765449706368:12345-0@lo:2:osp-syn-1-1.0 Request processed in 144us (342us total) trans 17179876285 rc 0/0 00000100:00100000:2.0:1762166976.924660:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18894 00000100:00100000:2.0:1762166976.924677:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18896 00000100:00100000:2.0:1762166976.924684:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+11:3635:x1847765449706496:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166976.924689:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc59d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+11:3636:x1847765449705984:12345-0@lo:2:osp-syn-0-1.0 Request processed in 232us (469us total) trans 21474843252 rc 0/0 00000100:00100000:1.0:1762166976.924691:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5589c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+17:3633:x1847765449706112:12345-0@lo:2:osp-syn-1-1.0 Request processed in 232us (427us total) trans 17179876286 rc 0/0 00000100:00100000:1.0:1762166976.924706:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18893 00000100:00100000:0.0:1762166976.924706:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5588e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+17:3633:x1847765449706624:12345-0@lo:2:osp-syn-1-1.0 Request processed in 175us (354us total) trans 17179876287 rc 0/0 00000100:00100000:3.0:1762166976.924717:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18892 00000100:00100000:0.0:1762166976.924725:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18895 00000100:00100000:2.0:1762166976.924759:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+11:3635:x1847765449706496:12345-0@lo:2:osp-syn-0-1.0 Request processed in 74us (347us total) trans 21474843253 rc 0/0 00000100:00100000:2.0:1762166976.924766:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18896 00000100:00100000:0.0:1762166976.924785:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1762166976.924808:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc7b21180/2, rc 0, transno 21474843253 00000100:00100000:2.0:1762166976.924814:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7b21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449706496:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166976.924823:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449706240 00000100:00100000:3.0:1762166976.924829:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449706240 00000004:00080000:2.0:1762166976.924832:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc5bbbb80/2, rc 0, transno 17179876285 00000100:00100000:0.0:1762166976.924835:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7b22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449706752:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1762166976.924840:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449706368:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166976.924868:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18897 00000100:00100000:3.0:1762166976.924879:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4012680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+11:3633:x1847765449706240:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1762166976.924886:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166976.924917:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449706752 00000100:00100000:1.0:1762166976.924923:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449706752 00000100:00100000:2.0:1762166976.924934:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1762166976.924934:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf783fb80/2, rc 0, transno 17179876286 00000100:00100000:0.0:1762166976.924942:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449706112:0@lo:2:osp-syn-1-1.0 00002000:00010000:3.0:1762166976.924952:0:9168:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:1.0:1762166976.924955:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449705856 00000004:00080000:0.0:1762166976.924957:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc47b6a00/2, rc 0, transno 17179876287 00000100:00100000:1.0:1762166976.924961:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449705856 00000100:00100000:0.0:1762166976.924965:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc47b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449706624:0@lo:2:osp-syn-1-1.0 00000004:00080000:2.0:1762166976.924988:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc7b23100/2, rc 0, transno 21474843252 00000100:00100000:1.0:1762166976.924990:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18898 00000100:00100000:2.0:1762166976.924998:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7b23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449705984:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1762166976.925002:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5765880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+13:3633:x1847765449706752:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:3.0:1762166976.925008:0:9168:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00000100:00100000:0.0:1762166976.925008:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18899 00002000:00010000:3.0:1762166976.925014:0:9168:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166976 -> 1762166976 00002000:00010000:3.0:1762166976.925017:0:9168:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:3.0:1762166976.925019:0:9168:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00000100:00100000:0.0:1762166976.925021:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+16:3636:x1847765449705856:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166976.925062:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4012680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+14:3633:x1847765449706240:12345-0@lo:2:osp-syn-0-1.0 Request processed in 184us (276us total) trans 21474843254 rc 0/0 00000100:00100000:3.0:1762166976.925069:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18897 00000004:00080000:2.0:1762166976.925091:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc7b21c00/2, rc 0, transno 21474843254 00002000:00010000:0.0:1762166976.925095:0:28434:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 244188 -> 244188 00000100:00100000:2.0:1762166976.925100:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7b21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449706240:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1762166976.925101:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5765880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+13:3633:x1847765449706752:12345-0@lo:2:osp-syn-0-1.0 Request processed in 99us (214us total) trans 21474843255 rc 0/0 00002000:00010000:0.0:1762166976.925102:0:28434:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:0.0:1762166976.925109:0:28434:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166976 -> 1762166976 00002000:00010000:0.0:1762166976.925115:0:28434:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00000004:00080000:2.0:1762166976.925119:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc7b22a00/2, rc 0, transno 21474843255 00000100:00100000:1.0:1762166976.925119:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18898 00002000:00010000:0.0:1762166976.925121:0:28434:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 352 -> 352 00000100:00100000:2.0:1762166976.925130:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7b22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449706752:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1762166976.925157:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+17:3636:x1847765449705856:12345-0@lo:2:osp-syn-1-1.0 Request processed in 140us (226us total) trans 17179876288 rc 0/0 00000100:00100000:0.0:1762166976.925165:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18899 00000004:00080000:2.0:1762166976.925182:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bcce75f80/2, rc 0, transno 17179876288 00000100:00100000:2.0:1762166976.925188:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcce75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449705856:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166976.926625:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166976.926668:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450407040 00000100:00100000:0.0:1762166976.926673:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450407040 00000100:00100000:0.0:1762166976.926714:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18900 00000100:00100000:0.0:1762166976.926722:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc59d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+28:61766:x1847765450407040:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:0.0:1762166976.926732:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166976.926744:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde200/0x2f180c4effbaa5b3 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9aac expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.926766:0:28434:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbaa59e lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a9e expref: 29 pid: 35472 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166976.926774:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166976.926776:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166976.926780:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde200/0x2f180c4effbaa5b3 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [73728->94207] (req 73728->94207) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9aac expref: 29 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.926807:0:28434:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbaa59e lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a9e expref: 29 pid: 35472 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166976.926819:0:28434:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbaa59e lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a9e expref: 29 pid: 35472 timeout: 696 lvb_type: 1 00000100:00100000:0.0:1762166976.926830:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5764e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765449706880:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166976.926897:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc37313c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166976.927782:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5764e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765449706880:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166976.927804:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde200/0x2f180c4effbaa5b3 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [73728->94207] (req 73728->94207) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9aac expref: 29 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.927817:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bde200, rc 0) 00000100:00100000:0.0:1762166976.927852:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc59d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+29:61766:x1847765450407040:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 1131us (1230us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166976.927859:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18900 00000100:00100000:3.0:1762166976.928112:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166976.928167:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450407168 00000100:00100000:0.0:1762166976.928173:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450407168 00010000:00010000:0.0:1762166976.928196:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbaa59e lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a9e expref: 29 pid: 35472 timeout: 696 lvb_type: 1 00000100:00100000:0.0:1762166976.928235:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9538 00000100:00100000:0.0:1762166976.928247:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc59d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+29:2419:x1847765450407168:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166976.928259:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166976.928272:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbaa59e lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a9e expref: 29 pid: 35472 timeout: 696 lvb_type: 1 00010000:00010000:0.0:1762166976.928283:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbaa59e lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a9e expref: 29 pid: 35472 timeout: 696 lvb_type: 1 00010000:00010000:0.0:1762166976.928301:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbaa59e lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a9e expref: 29 pid: 35472 timeout: 696 lvb_type: 1 00010000:00010000:0.0:1762166976.928312:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166976.928314:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166976.928320:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde200/0x2f180c4effbaa5b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 73728->94207) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9aac expref: 28 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.928330:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde200/0x2f180c4effbaa5b3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 73728->94207) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9aac expref: 28 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166976.928356:0:8398:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde200/0x2f180c4effbaa5b3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 73728->94207) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9aac expref: 28 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166976.928366:0:8398:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5764e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8398:1847765449707008:192.168.204.38@tcp:105: 00000100:00100000:0.0:1762166976.928414:0:8398:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc37313c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166976.929607:0:8398:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5764e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8398:1847765449707008:192.168.204.38@tcp:105: 00010000:00010000:2.0:1762166976.929622:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166976.929655:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc59d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+28:2419:x1847765450407168:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1413us (1550us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166976.929660:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9538 00000100:00100000:1.0:1762166976.929871:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166976.929922:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450407296 00000100:00100000:0.0:1762166976.929927:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450407296 00000100:00100000:0.0:1762166976.929971:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2133 00000100:00100000:0.0:1762166976.929990:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+28:2419:x1847765450407296:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:0.0:1762166976.930114:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 244188 -> 244188 00002000:00010000:0.0:1762166976.930118:0:23939:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166976 -> 1762166976 00002000:00010000:0.0:1762166976.930120:0:23939:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166976 -> 1762166976 00002000:00010000:0.0:1762166976.930123:0:23939:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:0.0:1762166976.930125:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 352 -> 352 00000100:00100000:0.0:1762166976.930160:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+29:2419:x1847765450407296:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 170us (287us total) trans 17179876289 rc 0/0 00000100:00100000:0.0:1762166976.930168:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2133 00000100:00100000:3.0:1762166976.931594:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.931727:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450407424 00000100:00100000:1.0:1762166976.931736:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450407424 00000100:00100000:1.0:1762166976.931780:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30355 00000100:00100000:1.0:1762166976.931789:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc59d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+525:61766:x1847765450407424:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:1.0:1762166976.931808:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166976.931825:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221200/0x2f180c4effbaa5ba lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9ab3 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.931942:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221600/0x2f180c4effbaa5c1 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166976.931955:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221600/0x2f180c4effbaa5c1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.931966:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221600/0x2f180c4effbaa5c1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:1.0:1762166976.931991:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 244188 00000004:00200000:1.0:1762166976.931995:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166976.932011:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221600/0x2f180c4effbaa5c1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.932034:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221200/0x2f180c4effbaa5ba lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ab3 expref: 527 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.932050:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221600/0x2f180c4effbaa5c1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ab3 expref: 526 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.932058:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.932061:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166976.932063:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc6221600, rc 0) 00000100:00100000:1.0:1762166976.932116:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc59d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+526:61766:x1847765450407424:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 325us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166976.932123:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30355 00000100:00100000:3.0:1762166976.934123:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.934254:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450407680 00000100:00100000:1.0:1762166976.934262:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450407680 00000100:00100000:1.0:1762166976.934309:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30356 00000100:00100000:1.0:1762166976.934317:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc59d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+526:61766:x1847765450407680:12345-192.168.204.38@tcp:36:fsx.0 00010000:00010000:1.0:1762166976.934356:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1762166976.934376:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaa5ac lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9aa5 expref: 526 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.934394:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221600/0x2f180c4effbaa5c1 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ab3 expref: 525 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.934401:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.934403:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166976.934566:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221e00/0x2f180c4effbaa5c8 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166976.934575:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221e00/0x2f180c4effbaa5c8 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.934582:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221e00/0x2f180c4effbaa5c8 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000001:00080000:1.0:1762166976.934622:0:6494:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294991943 00000004:00010000:1.0:1762166976.934642:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000e574852a reply state 00000000c0798d7b transno 4294991944 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221e00/0x2f180c4effbaa5c8 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.934650:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221e00/0x2f180c4effbaa5c8 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.934654:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.934656:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166976.934658:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166976.934712:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc59d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+527:61766:x1847765450407680:12345-192.168.204.38@tcp:36:fsx.0 Request processed in 395us (591us total) trans 4294991944 rc 0/0 00000100:00100000:1.0:1762166976.934719:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30356 00000020:00080000:1.0:1762166976.934724:0:6494:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1762166976.935835:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.935881:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450407808 00000100:00100000:1.0:1762166976.935899:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450407808 00000100:00100000:1.0:1762166976.935946:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30357 00000100:00100000:1.0:1762166976.935954:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc576a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+527:61766:x1847765450407808:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:1.0:1762166976.935969:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166976.935981:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221800/0x2f180c4effbaa5cf lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9aba expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.936015:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221800/0x2f180c4effbaa5cf lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9aba expref: 528 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.936027:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221800/0x2f180c4effbaa5cf lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9aba expref: 528 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.936042:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.936045:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166976.936048:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc6221800, rc 0) 00000100:00100000:1.0:1762166976.936090:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc576a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+528:61766:x1847765450407808:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 137us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166976.936096:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30357 00000100:00100000:3.0:1762166976.937555:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166976.937595:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166976.937621:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450407936 00000100:00100000:0.0:1762166976.937632:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450407936 00000100:00100000:3.0:1762166976.937637:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166976.937639:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450408064 00000100:00100000:2.0:1762166976.937652:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450408064 00002000:00010000:0.0:1762166976.937686:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (251107->18446744073709551615) 00002000:00010000:2.0:1762166976.937689:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:0.0:1762166976.937693:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc59d5500 with x1847765450407936 ext(251107->18446744073709551615) 00002000:00100000:2.0:1762166976.937696:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc59d4a80 with x1847765450408064 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166976.937705:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc59d5500. 00002000:00010000:2.0:1762166976.937711:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc59d4a80. 00000100:00100000:0.0:1762166976.937741:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450408192 00000100:00100000:0.0:1762166976.937748:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450408192 00002000:00010000:0.0:1762166976.937769:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00000100:00100000:1.0:1762166976.937773:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2134 00002000:00100000:0.0:1762166976.937773:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc59d5880 with x1847765450408192 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166976.937781:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc59d5880. 00000100:00100000:2.0:1762166976.937792:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2135 00000100:00100000:1.0:1762166976.937792:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc59d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+30:2419:x1847765450407936:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:2.0:1762166976.937811:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc59d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450408064:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:3.0:1762166976.937818:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2136 00000100:00100000:3.0:1762166976.937833:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc59d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+30:2419:x1847765450408192:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:2.0:1762166976.937997:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166976.937998:0:14623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166976.938003:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166976 -> 1762166977 00002000:00010000:3.0:1762166976.938005:0:14623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166976 -> 1762166977 00002000:00010000:2.0:1762166976.938006:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166976 -> 1762166976 00002000:00010000:3.0:1762166976.938014:0:14623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166976 -> 1762166976 00002000:00010000:2.0:1762166976.938014:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:2.0:1762166976.938020:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00002000:00010000:3.0:1762166976.938022:0:14623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:3.0:1762166976.938026:0:14623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:1.0:1762166976.938035:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 244188 -> 251107 00002000:00010000:1.0:1762166976.938041:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166976 -> 1762166977 00002000:00010000:1.0:1762166976.938044:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.938047:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:1.0:1762166976.938050:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 352 -> 352 00000100:00100000:2.0:1762166976.938100:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc59d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450408064:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 295us (505us total) trans 21474843256 rc 0/0 00000100:00100000:2.0:1762166976.938106:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2135 00002000:00010000:2.0:1762166976.938110:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00000100:00100000:1.0:1762166976.938112:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc59d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+32:2419:x1847765450407936:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 327us (562us total) trans 17179876291 rc 0/0 00002000:00100000:2.0:1762166976.938114:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc59d4a80 with x1847765450408064 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166976.938123:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc59d4a80. 00000100:00100000:1.0:1762166976.938139:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2134 00002000:00010000:1.0:1762166976.938145:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (251107->18446744073709551615) 00002000:00100000:1.0:1762166976.938149:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc59d5500 with x1847765450407936 ext(251107->18446744073709551615) 00002000:00010000:1.0:1762166976.938157:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc59d5500. 00000100:00100000:3.0:1762166976.938273:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc59d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+31:2419:x1847765450408192:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 271us (466us total) trans 17179876290 rc 0/0 00000100:00100000:3.0:1762166976.938280:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2136 00002000:00010000:3.0:1762166976.938284:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:3.0:1762166976.938286:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc59d5880 with x1847765450408192 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166976.938291:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc59d5880. 00000100:00100000:3.0:1762166976.939865:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166976.940080:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450408320 00000100:00100000:2.0:1762166976.940089:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450408320 00002000:00100000:2.0:1762166976.940129:0:14623:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xa77:0x0] (233472->237567) req@ffff945bc59d4e00 x1847765450408320/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:7/0 lens 488/0 e 0 to 0 dl 1762166987 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166976.940140:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc59d4e00 with x1847765450408320 ext(233472->237567) 00002000:00010000:2.0:1762166976.940145:0:14623:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc59d4e00 00000100:00100000:2.0:1762166976.940176:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2137 00000100:00100000:2.0:1762166976.940188:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc59d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+31:2416:x1847765450408320:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:2.0:1762166976.940341:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc59d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+31:2416:x1847765450408320:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 156us (482us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1762166976.940356:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2137 00002000:00100000:2.0:1762166976.940365:0:14623:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xa77:0x0] (233472->237567) req@ffff945bc59d4e00 x1847765450408320/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:7/0 lens 488/4536 e 0 to 0 dl 1762166987 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166976.940381:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc59d4e00 with x1847765450408320 ext(233472->237567) 00002000:00010000:2.0:1762166976.940387:0:14623:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc59d4e00 00000100:00100000:0.0:1762166976.941674:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166976.941746:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450408448 00000100:00100000:2.0:1762166976.941755:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450408448 00002000:00100000:2.0:1762166976.941791:0:14623:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xa77:0x0] (237568->241663) req@ffff945bc5764700 x1847765450408448/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:7/0 lens 488/0 e 0 to 0 dl 1762166987 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166976.941798:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5764700 with x1847765450408448 ext(237568->241663) 00002000:00010000:2.0:1762166976.941802:0:14623:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5764700 00000100:00100000:2.0:1762166976.941824:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2138 00000100:00100000:2.0:1762166976.941831:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+31:2416:x1847765450408448:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:2.0:1762166976.941960:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+31:2416:x1847765450408448:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 128us (291us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1762166976.941967:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2138 00002000:00100000:2.0:1762166976.941974:0:14623:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xa77:0x0] (237568->241663) req@ffff945bc5764700 x1847765450408448/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:7/0 lens 488/4536 e 0 to 0 dl 1762166987 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166976.941982:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5764700 with x1847765450408448 ext(237568->241663) 00002000:00010000:2.0:1762166976.941985:0:14623:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5764700 00000100:00100000:3.0:1762166976.943248:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166976.943310:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450408576 00000100:00100000:2.0:1762166976.943316:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450408576 00002000:00100000:2.0:1762166976.943343:0:14623:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xa77:0x0] (212992->253951) req@ffff945bc59d4700 x1847765450408576/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:7/0 lens 504/0 e 0 to 0 dl 1762166987 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166976.943352:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc59d4700 with x1847765450408576 ext(212992->253951) 00002000:00010000:2.0:1762166976.943356:0:14623:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc59d4700 00000100:00100000:2.0:1762166976.943391:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2139 00000100:00100000:2.0:1762166976.943400:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc59d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+31:2416:x1847765450408576:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:2.0:1762166976.944543:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc59d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+31:2416:x1847765450408576:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 1129us (1284us total) trans 0 rc 32768/32768 00000100:00100000:2.0:1762166976.944554:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2139 00002000:00100000:2.0:1762166976.944567:0:14623:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xa77:0x0] (212992->253951) req@ffff945bc59d4700 x1847765450408576/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:7/0 lens 504/440 e 0 to 0 dl 1762166987 ref 1 fl Complete:/600/0 rc 32768/32768 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166976.944577:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc59d4700 with x1847765450408576 ext(212992->253951) 00002000:00010000:2.0:1762166976.944582:0:14623:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc59d4700 00000100:00100000:0.0:1762166976.946727:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166976.946818:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450408704 00000100:00100000:2.0:1762166976.946828:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450408704 00002000:00100000:2.0:1762166976.946883:0:14623:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xa77:0x0] (233472->251106) req@ffff945bc5766300 x1847765450408704/t0(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:7/0 lens 488/0 e 0 to 0 dl 1762166987 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166976.946915:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5766300 with x1847765450408704 ext(233472->251106) 00002000:00010000:2.0:1762166976.946921:0:14623:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5766300 00000100:00100000:2.0:1762166976.946954:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2140 00000100:00100000:2.0:1762166976.946965:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+31:2417:x1847765450408704:12345-192.168.204.38@tcp:4:fsx.0 00000100:00100000:2.0:1762166976.949227:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+34:2417:x1847765450408704:12345-192.168.204.38@tcp:4:fsx.0 Request processed in 2254us (2502us total) trans 17179876293 rc 0/0 00000100:00100000:2.0:1762166976.949241:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2140 00002000:00100000:2.0:1762166976.949256:0:14623:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xa77:0x0] (233472->251106) req@ffff945bc5766300 x1847765450408704/t17179876293(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:7/0 lens 488/448 e 0 to 0 dl 1762166987 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166976.949267:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5766300 with x1847765450408704 ext(233472->251106) 00002000:00010000:2.0:1762166976.949274:0:14623:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5766300 00000100:00100000:3.0:1762166976.950610:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166976.950666:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450408832 00000100:00100000:0.0:1762166976.950675:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450408832 00000100:00100000:0.0:1762166976.950733:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18901 00000100:00100000:0.0:1762166976.950743:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc59d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+34:2418:x1847765450408832:12345-192.168.204.38@tcp:16:fsx.0 00000001:00080000:2.0:1762166976.951768:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876293 is committed 00000001:00080000:2.0:1762166976.951786:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876288 is committed 00000100:00100000:0.0:1762166976.951919:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc59d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450408832:12345-192.168.204.38@tcp:16:fsx.0 Request processed in 1175us (1309us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166976.951929:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18901 00000100:00100000:0.0:1762166976.953204:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.953306:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450408960 00000100:00100000:1.0:1762166976.953324:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450408960 00000100:00100000:1.0:1762166976.953367:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30358 00000100:00100000:1.0:1762166976.953376:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5765c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+528:61766:x1847765450408960:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:1.0:1762166976.953393:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166976.953412:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221600/0x2f180c4effbaa5d6 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9ac1 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.953523:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaa5dd lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166976.953538:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaa5dd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.953550:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaa5dd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:1.0:1762166976.953575:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 251107 00000004:00200000:1.0:1762166976.953579:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166976.953595:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaa5dd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.953618:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221600/0x2f180c4effbaa5d6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ac1 expref: 530 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.953632:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaa5dd lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ac1 expref: 529 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.953642:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.953645:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166976.953648:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc6221a00, rc 0) 00000100:00100000:1.0:1762166976.953695:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5765c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+529:61766:x1847765450408960:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 319us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166976.953702:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30358 00000100:00100000:3.0:1762166976.956399:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166976.956555:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450409088 00000100:00100000:2.0:1762166976.956563:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450409088 00002000:00100000:2.0:1762166976.956602:0:14623:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xa77:0x0] (139264->204799) req@ffff945bc59d5c00 x1847765450409088/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:7/0 lens 488/0 e 0 to 0 dl 1762166987 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166976.956613:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc59d5c00 with x1847765450409088 ext(139264->204799) 00002000:00010000:2.0:1762166976.956619:0:14623:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc59d5c00 00000100:00100000:2.0:1762166976.956658:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2141 00000100:00100000:2.0:1762166976.956667:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc59d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450409088:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:2.0:1762166976.958735:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc59d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450409088:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 2063us (2335us total) trans 0 rc 65536/65536 00000100:00100000:2.0:1762166976.958745:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2141 00002000:00100000:2.0:1762166976.958754:0:14623:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xa77:0x0] (139264->204799) req@ffff945bc59d5c00 x1847765450409088/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:7/0 lens 488/440 e 0 to 0 dl 1762166987 ref 1 fl Complete:/600/0 rc 65536/65536 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166976.958763:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc59d5c00 with x1847765450409088 ext(139264->204799) 00002000:00010000:2.0:1762166976.958767:0:14623:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc59d5c00 00000100:00100000:0.0:1762166976.962278:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.962345:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450409344 00000100:00100000:1.0:1762166976.962362:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450409344 00000100:00100000:1.0:1762166976.962438:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30359 00000100:00100000:1.0:1762166976.962462:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+529:61766:x1847765450409344:12345-192.168.204.38@tcp:36:fsx.0 00010000:00010000:1.0:1762166976.962583:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166976.962619:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaa5dd lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ac1 expref: 529 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.962642:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.962647:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166976.962873:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221200/0x2f180c4effbaa5e4 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166976.962902:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221200/0x2f180c4effbaa5e4 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.962913:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221200/0x2f180c4effbaa5e4 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000001:00080000:1.0:1762166976.962960:0:6494:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294991945 00000004:00010000:1.0:1762166976.962987:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000006fd9df05 reply state 0000000004063395 transno 4294991946 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221200/0x2f180c4effbaa5e4 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.963003:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221200/0x2f180c4effbaa5e4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.963010:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.963013:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166976.963015:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166976.963124:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+531:61766:x1847765450409344:12345-192.168.204.38@tcp:36:fsx.0 Request processed in 675us (853us total) trans 4294991946 rc 0/0 00000100:00100000:1.0:1762166976.963132:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30359 00000020:00080000:1.0:1762166976.963139:0:6494:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1762166976.965111:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166976.965144:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166976.965177:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450409472 00000100:00100000:3.0:1762166976.965178:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166976.965188:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450409472 00000100:00100000:1.0:1762166976.965209:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450409600 00000100:00100000:1.0:1762166976.965216:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450409600 00002000:00010000:2.0:1762166976.965238:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (7479->18446744073709551615) 00002000:00010000:1.0:1762166976.965238:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:1.0:1762166976.965245:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc59d7b80 with x1847765450409600 ext(0->18446744073709551615) 00000100:00100000:0.0:1762166976.965245:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450409728 00002000:00100000:2.0:1762166976.965248:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc59d4000 with x1847765450409472 ext(7479->18446744073709551615) 00000100:00100000:0.0:1762166976.965253:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450409728 00002000:00010000:2.0:1762166976.965261:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc59d4000. 00002000:00010000:1.0:1762166976.965261:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc59d7b80. 00002000:00010000:0.0:1762166976.965274:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:0.0:1762166976.965280:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc59d6a00 with x1847765450409728 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166976.965288:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc59d6a00. 00000100:00100000:2.0:1762166976.965323:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2142 00000100:00100000:2.0:1762166976.965333:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc59d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450409600:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:1.0:1762166976.965371:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2143 00000100:00100000:1.0:1762166976.965382:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc59d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450409472:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:0.0:1762166976.965405:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2144 00002000:00010000:2.0:1762166976.965470:0:14623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166976.965474:0:14623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:2.0:1762166976.965504:0:14623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166976 -> 1762166976 00002000:00010000:2.0:1762166976.965507:0:14623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:2.0:1762166976.965509:0:14623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00000100:00100000:2.0:1762166976.965559:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc59d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450409600:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 227us (415us total) trans 21474843257 rc 0/0 00000100:00100000:2.0:1762166976.965568:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2142 00002000:00010000:2.0:1762166976.965571:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:2.0:1762166976.965574:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc59d7b80 with x1847765450409600 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166976.965579:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc59d7b80. 00000100:00100000:0.0:1762166976.965681:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc59d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450409728:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:0.0:1762166976.965769:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166976.965773:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:0.0:1762166976.965776:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166976 -> 1762166976 00002000:00010000:0.0:1762166976.965778:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:0.0:1762166976.965781:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1762166976.965824:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc59d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450409728:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 410us (645us total) trans 17179876295 rc 0/0 00000100:00100000:0.0:1762166976.965833:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2144 00002000:00010000:0.0:1762166976.965838:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:0.0:1762166976.965841:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc59d6a00 with x1847765450409728 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166976.965847:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc59d6a00. 00002000:00010000:1.0:1762166976.965927:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 251107 -> 7479 00002000:00010000:1.0:1762166976.965932:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:1.0:1762166976.965934:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.965937:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:1.0:1762166976.965940:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 352 -> 16 00000100:00100000:1.0:1762166976.965977:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc59d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450409472:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 596us (870us total) trans 17179876294 rc 0/0 00000100:00100000:1.0:1762166976.965985:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2143 00002000:00010000:1.0:1762166976.965989:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (7479->18446744073709551615) 00002000:00100000:1.0:1762166976.965993:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc59d4000 with x1847765450409472 ext(7479->18446744073709551615) 00002000:00010000:1.0:1762166976.965998:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc59d4000. 00000100:00100000:2.0:1762166976.967266:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.967314:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450409856 00000100:00100000:1.0:1762166976.967320:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450409856 00000100:00100000:1.0:1762166976.967357:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30360 00000100:00100000:1.0:1762166976.967366:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5769c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+531:61766:x1847765450409856:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:1.0:1762166976.967382:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166976.967400:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221600/0x2f180c4effbaa5eb lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9ac8 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.967496:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaa5f2 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166976.967511:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaa5f2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.967523:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaa5f2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:1.0:1762166976.967549:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 7479 00000004:00200000:1.0:1762166976.967554:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166976.967569:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaa5f2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.967603:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221600/0x2f180c4effbaa5eb lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ac8 expref: 533 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.967620:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaa5f2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ac8 expref: 532 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.967628:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.967632:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166976.967636:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc6220e00, rc 0) 00000100:00100000:1.0:1762166976.967668:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5769c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+532:61766:x1847765450409856:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 304us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166976.967674:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30360 00000100:00100000:2.0:1762166976.969774:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166976.969864:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450409984 00000100:00100000:3.0:1762166976.969869:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450409984 00000100:00100000:3.0:1762166976.969925:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2145 00000100:00100000:3.0:1762166976.969935:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5768000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450409984:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:3.0:1762166976.970139:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 7479 -> 7479 00002000:00010000:3.0:1762166976.970143:0:23943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:3.0:1762166976.970145:0:23943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166976 -> 1762166976 00002000:00010000:3.0:1762166976.970147:0:23943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:3.0:1762166976.970150:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 16 -> 16 00000100:00100000:3.0:1762166976.970199:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5768000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450409984:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 265us (429us total) trans 17179876296 rc 0/0 00000100:00100000:3.0:1762166976.970206:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2145 00000100:00100000:2.0:1762166976.974244:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166976.974288:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450410112 00000100:00100000:3.0:1762166976.974295:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450410112 00000100:00100000:3.0:1762166976.974342:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2146 00000100:00100000:3.0:1762166976.974348:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc576bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450410112:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:3.0:1762166976.974544:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 7479 -> 196909 00002000:00010000:3.0:1762166976.974548:0:23943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:3.0:1762166976.974551:0:23943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166976 -> 1762166976 00002000:00010000:3.0:1762166976.974553:0:23943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:3.0:1762166976.974555:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 16 -> 144 00000100:00100000:3.0:1762166976.974615:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc576bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450410112:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 266us (377us total) trans 17179876297 rc 0/0 00000100:00100000:3.0:1762166976.974623:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2146 00000100:00100000:2.0:1762166976.977004:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166976.977055:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450410240 00000100:00100000:3.0:1762166976.977063:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450410240 00000100:00100000:3.0:1762166976.977130:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2147 00000100:00100000:3.0:1762166976.977139:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc576aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450410240:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:3.0:1762166976.977354:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 196909 -> 196909 00002000:00010000:3.0:1762166976.977358:0:23943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:3.0:1762166976.977360:0:23943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166976 -> 1762166976 00002000:00010000:3.0:1762166976.977362:0:23943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:3.0:1762166976.977364:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 144 -> 248 00000100:00100000:3.0:1762166976.977419:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc576aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765450410240:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 280us (419us total) trans 17179876298 rc 0/0 00000100:00100000:3.0:1762166976.977426:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2147 00000100:00100000:2.0:1762166976.980039:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.980100:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450410496 00000100:00100000:1.0:1762166976.980108:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450410496 00000100:00100000:1.0:1762166976.980163:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30361 00000100:00100000:1.0:1762166976.980173:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc576b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+532:61766:x1847765450410496:12345-192.168.204.38@tcp:36:fsx.0 00010000:00010000:1.0:1762166976.980223:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166976.980247:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaa5f2 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ac8 expref: 532 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.980263:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.980268:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166976.980425:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221600/0x2f180c4effbaa5f9 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166976.980436:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221600/0x2f180c4effbaa5f9 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.980450:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221600/0x2f180c4effbaa5f9 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000001:00080000:1.0:1762166976.980525:0:6494:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294991947 00000004:00010000:1.0:1762166976.980549:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000d9d100c7 reply state 0000000026118fac transno 4294991948 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221600/0x2f180c4effbaa5f9 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.980561:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221600/0x2f180c4effbaa5f9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.980571:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.980573:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166976.980581:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166976.980664:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc576b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+534:61766:x1847765450410496:12345-192.168.204.38@tcp:36:fsx.0 Request processed in 491us (630us total) trans 4294991948 rc 0/0 00000100:00100000:1.0:1762166976.980672:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30361 00000020:00080000:1.0:1762166976.980678:0:6494:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1762166976.982962:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166976.983007:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166976.983026:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.983095:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450410752 00000100:00100000:1.0:1762166976.983112:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450410752 00000100:00100000:0.0:1762166976.983119:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450410624 00000100:00100000:0.0:1762166976.983124:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450410624 00002000:00010000:0.0:1762166976.983144:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (262144->18446744073709551615) 00002000:00010000:1.0:1762166976.983145:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:0.0:1762166976.983149:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc8121180 with x1847765450410624 ext(262144->18446744073709551615) 00002000:00100000:1.0:1762166976.983151:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc8121f80 with x1847765450410752 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166976.983158:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc8121180. 00002000:00010000:1.0:1762166976.983161:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc8121f80. 00000100:00100000:0.0:1762166976.983179:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450410880 00000100:00100000:0.0:1762166976.983182:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450410880 00002000:00010000:0.0:1762166976.983189:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:0.0:1762166976.983192:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc8122d80 with x1847765450410880 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166976.983196:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc8122d80. 00000100:00100000:2.0:1762166976.983208:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2148 00000100:00100000:1.0:1762166976.983218:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2149 00000100:00100000:2.0:1762166976.983224:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc8121180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765450410624:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:0.0:1762166976.983236:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2150 00000100:00100000:1.0:1762166976.983241:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc8121f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450410752:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:0.0:1762166976.983251:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc8122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765450410880:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:0.0:1762166976.983355:0:14623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166976.983357:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166976.983358:0:14623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:1.0:1762166976.983363:0:23943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:0.0:1762166976.983364:0:14623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166976 -> 1762166976 00002000:00010000:0.0:1762166976.983369:0:14623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:2.0:1762166976.983372:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 196909 -> 262144 00002000:00010000:1.0:1762166976.983372:0:23943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166976 -> 1762166976 00002000:00010000:0.0:1762166976.983373:0:14623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:2.0:1762166976.983381:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:1.0:1762166976.983381:0:23943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:2.0:1762166976.983388:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166976.983388:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00002000:00010000:2.0:1762166976.983395:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:2.0:1762166976.983397:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 248 -> 248 00000100:00100000:0.0:1762166976.983414:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc8122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765450410880:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 168us (386us total) trans 17179876299 rc 0/0 00000100:00100000:0.0:1762166976.983423:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2150 00000100:00100000:1.0:1762166976.983425:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc8121f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450410752:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 195us (464us total) trans 21474843258 rc 0/0 00002000:00010000:0.0:1762166976.983427:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00000100:00100000:2.0:1762166976.983430:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc8121180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765450410624:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 210us (420us total) trans 17179876300 rc 0/0 00002000:00100000:0.0:1762166976.983434:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc8122d80 with x1847765450410880 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166976.983443:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc8122d80. 00000100:00100000:1.0:1762166976.983448:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2149 00002000:00010000:1.0:1762166976.983454:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00000100:00100000:2.0:1762166976.983458:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2148 00002000:00100000:1.0:1762166976.983460:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc8121f80 with x1847765450410752 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166976.983465:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (262144->18446744073709551615) 00002000:00010000:1.0:1762166976.983467:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc8121f80. 00002000:00100000:2.0:1762166976.983469:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc8121180 with x1847765450410624 ext(262144->18446744073709551615) 00002000:00010000:2.0:1762166976.983495:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc8121180. 00000100:00100000:2.0:1762166976.985533:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.985667:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450411008 00000100:00100000:1.0:1762166976.985674:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450411008 00002000:00100000:1.0:1762166976.985706:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (225280->262143) req@ffff945bc5769f80 x1847765450411008/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:7/0 lens 488/0 e 0 to 0 dl 1762166987 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166976.985716:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5769f80 with x1847765450411008 ext(225280->262143) 00002000:00010000:1.0:1762166976.985720:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5769f80 00000100:00100000:1.0:1762166976.985750:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2151 00000100:00100000:1.0:1762166976.985759:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5769f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+25:2419:x1847765450411008:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:1.0:1762166976.986739:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5769f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+25:2419:x1847765450411008:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 979us (1208us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1762166976.986748:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2151 00002000:00100000:1.0:1762166976.986756:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (225280->262143) req@ffff945bc5769f80 x1847765450411008/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:7/0 lens 488/440 e 0 to 0 dl 1762166987 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166976.986765:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5769f80 with x1847765450411008 ext(225280->262143) 00002000:00010000:1.0:1762166976.986768:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5769f80 00000100:00100000:3.0:1762166976.988330:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.988403:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450411136 00000100:00100000:1.0:1762166976.988410:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450411136 00002000:00100000:1.0:1762166976.988436:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (253952->262143) req@ffff945bc8122680 x1847765450411136/t0(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:7/0 lens 8680/0 e 0 to 0 dl 1762166987 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166976.988445:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc8122680 with x1847765450411136 ext(253952->262143) 00002000:00010000:1.0:1762166976.988448:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc8122680 00000100:00100000:1.0:1762166976.988471:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2152 00000100:00100000:1.0:1762166976.988505:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc8122680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+25:2419:x1847765450411136:12345-192.168.204.38@tcp:4:fsx.0 00000100:00100000:1.0:1762166976.989119:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc8122680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+27:2419:x1847765450411136:12345-192.168.204.38@tcp:4:fsx.0 Request processed in 639us (789us total) trans 17179876301 rc 0/0 00000100:00100000:1.0:1762166976.989131:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2152 00002000:00100000:1.0:1762166976.989139:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (253952->262143) req@ffff945bc8122680 x1847765450411136/t17179876301(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:7/0 lens 8680/448 e 0 to 0 dl 1762166987 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166976.989147:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc8122680 with x1847765450411136 ext(253952->262143) 00002000:00010000:1.0:1762166976.989151:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc8122680 00000100:00100000:2.0:1762166976.990248:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166976.990322:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450411264 00000100:00100000:0.0:1762166976.990327:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450411264 00000100:00100000:0.0:1762166976.990367:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18902 00000100:00100000:0.0:1762166976.990376:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5769180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+27:2418:x1847765450411264:12345-192.168.204.38@tcp:16:fsx.0 00000001:00080000:2.0:1762166976.991690:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876301 is committed 00000100:00100000:1.0:1762166976.991881:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5769180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450411264:12345-192.168.204.38@tcp:16:fsx.0 Request processed in 1504us (1631us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166976.991901:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18902 00000100:00100000:0.0:1762166976.993302:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.993381:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450411392 00000100:00100000:1.0:1762166976.993387:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450411392 00000100:00100000:1.0:1762166976.993428:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30362 00000100:00100000:1.0:1762166976.993437:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5767b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+534:61766:x1847765450411392:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:1.0:1762166976.993453:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166976.993468:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaa600 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9acf expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.993619:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaa607 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166976.993634:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaa607 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.993644:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaa607 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:1.0:1762166976.993669:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 262144 00000004:00200000:1.0:1762166976.993673:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166976.993688:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaa607 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166976.993712:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaa600 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9acf expref: 536 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.993724:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaa607 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9acf expref: 535 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166976.993732:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166976.993735:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166976.993738:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc6221a00, rc 0) 00000100:00100000:1.0:1762166976.993774:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5767b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+535:61766:x1847765450411392:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 338us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166976.993781:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30362 00000100:00100000:3.0:1762166976.996843:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166976.996901:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450411520 00000100:00100000:1.0:1762166976.996910:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450411520 00002000:00100000:1.0:1762166976.996964:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (12288->77823) req@ffff945bc8123800 x1847765450411520/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:7/0 lens 488/0 e 0 to 0 dl 1762166987 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166976.996975:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc8123800 with x1847765450411520 ext(12288->77823) 00002000:00010000:1.0:1762166976.996980:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc8123800 00000100:00100000:1.0:1762166976.997006:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2153 00000100:00100000:1.0:1762166976.997012:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc8123800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450411520:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:1.0:1762166976.999079:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc8123800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450411520:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 2063us (2243us total) trans 0 rc 65536/65536 00000100:00100000:1.0:1762166976.999088:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2153 00002000:00100000:1.0:1762166976.999097:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (12288->77823) req@ffff945bc8123800 x1847765450411520/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:7/0 lens 488/440 e 0 to 0 dl 1762166987 ref 1 fl Complete:/600/0 rc 65536/65536 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166976.999114:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc8123800 with x1847765450411520 ext(12288->77823) 00002000:00010000:1.0:1762166976.999118:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc8123800 00000100:00100000:0.0:1762166977.001279:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.001331:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450411648 00000100:00100000:1.0:1762166977.001338:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450411648 00002000:00100000:1.0:1762166977.001369:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (90112->94207) req@ffff945bc5766a00 x1847765450411648/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 488/0 e 0 to 0 dl 1762166988 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166977.001378:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5766a00 with x1847765450411648 ext(90112->94207) 00002000:00010000:1.0:1762166977.001383:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5766a00 00000100:00100000:1.0:1762166977.001407:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2154 00000100:00100000:1.0:1762166977.001415:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5766a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450411648:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:1.0:1762166977.001579:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5766a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450411648:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 163us (303us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1762166977.001587:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2154 00002000:00100000:1.0:1762166977.001594:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (90112->94207) req@ffff945bc5766a00 x1847765450411648/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 488/4536 e 0 to 0 dl 1762166988 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166977.001602:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5766a00 with x1847765450411648 ext(90112->94207) 00002000:00010000:1.0:1762166977.001605:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5766a00 00000100:00100000:3.0:1762166977.003962:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.004076:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450411904 00000100:00100000:1.0:1762166977.004085:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450411904 00000100:00080000:3.0:1762166977.004146:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1762166977.004159:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30363 00000100:00100000:1.0:1762166977.004172:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc8120380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+535:61766:x1847765450411904:12345-192.168.204.38@tcp:36:fsx.0 00010000:00010000:1.0:1762166977.004240:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166977.004267:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaa607 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9acf expref: 535 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.004286:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166977.004290:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166977.004509:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaa60e lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166977.004523:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaa60e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166977.004531:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaa60e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000001:00080000:1.0:1762166977.004570:0:6494:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294991949 00000004:00010000:1.0:1762166977.004586:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000000ecdc21f reply state 00000000f1081be2 transno 4294991950 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaa60e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166977.004594:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaa60e lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166977.004598:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166977.004600:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166977.004602:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166977.004674:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc8120380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+537:61766:x1847765450411904:12345-192.168.204.38@tcp:36:fsx.0 Request processed in 506us (722us total) trans 4294991950 rc 0/0 00000100:00100000:1.0:1762166977.004679:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30363 00000020:00080000:1.0:1762166977.004684:0:6494:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1762166977.005944:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.005991:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.006014:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450412032 00000100:00100000:1.0:1762166977.006023:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450412032 00000100:00100000:2.0:1762166977.006048:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00002000:00010000:1.0:1762166977.006061:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (49949->18446744073709551615) 00002000:00100000:1.0:1762166977.006067:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc576ad80 with x1847765450412032 ext(49949->18446744073709551615) 00000100:00100000:3.0:1762166977.006082:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450412160 00002000:00010000:1.0:1762166977.006083:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc576ad80. 00000100:00100000:3.0:1762166977.006091:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450412160 00000100:00100000:1.0:1762166977.006114:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450412288 00002000:00010000:3.0:1762166977.006117:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:3.0:1762166977.006122:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc576a680 with x1847765450412160 ext(0->18446744073709551615) 00000100:00100000:1.0:1762166977.006129:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450412288 00002000:00010000:3.0:1762166977.006133:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc576a680. 00002000:00010000:1.0:1762166977.006146:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:1.0:1762166977.006151:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc576b800 with x1847765450412288 ext(0->18446744073709551615) 00002000:00010000:1.0:1762166977.006160:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc576b800. 00000100:00100000:0.0:1762166977.006163:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2155 00000100:00100000:3.0:1762166977.006178:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2156 00000100:00100000:3.0:1762166977.006193:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc576a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450412160:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:1.0:1762166977.006215:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2157 00000100:00100000:1.0:1762166977.006230:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc576b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450412288:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:1.0:1762166977.006348:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166977.006352:0:23943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:1.0:1762166977.006354:0:23943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166977.006357:0:23943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:1.0:1762166977.006359:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1762166977.006408:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc576b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450412288:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 182us (364us total) trans 17179876302 rc 0/0 00002000:00010000:2.0:1762166977.006411:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:1.0:1762166977.006418:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2157 00002000:00010000:2.0:1762166977.006419:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:1.0:1762166977.006425:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00010000:2.0:1762166977.006427:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166976 -> 1762166976 00002000:00100000:1.0:1762166977.006435:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc576b800 with x1847765450412288 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166977.006437:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:2.0:1762166977.006447:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00002000:00010000:1.0:1762166977.006449:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc576b800. 00000100:00100000:2.0:1762166977.006561:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc576a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450412160:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 373us (572us total) trans 21474843259 rc 0/0 00000100:00100000:0.0:1762166977.006561:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc576ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450412032:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:2.0:1762166977.006572:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2156 00002000:00010000:2.0:1762166977.006576:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:2.0:1762166977.006588:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc576a680 with x1847765450412160 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166977.006596:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc576a680. 00002000:00010000:0.0:1762166977.006852:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 262144 -> 49949 00002000:00010000:0.0:1762166977.006855:0:23939:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:0.0:1762166977.006856:0:23939:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166976 -> 1762166976 00002000:00010000:0.0:1762166977.006857:0:23939:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:0.0:1762166977.006859:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 248 -> 56 00000100:00100000:0.0:1762166977.006904:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc576ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450412032:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 728us (969us total) trans 17179876303 rc 0/0 00000100:00100000:0.0:1762166977.006911:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2155 00002000:00010000:0.0:1762166977.006914:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (49949->18446744073709551615) 00002000:00100000:0.0:1762166977.006918:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc576ad80 with x1847765450412032 ext(49949->18446744073709551615) 00002000:00010000:0.0:1762166977.006924:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc576ad80. 00000100:00100000:2.0:1762166977.007961:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.008077:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450412416 00000100:00100000:1.0:1762166977.008086:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450412416 00000100:00100000:1.0:1762166977.008126:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30364 00000100:00100000:1.0:1762166977.008133:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5768380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+537:61766:x1847765450412416:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:1.0:1762166977.008148:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166977.008162:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaa615 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9ad6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.008233:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220000/0x2f180c4effbaa61c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166977.008244:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220000/0x2f180c4effbaa61c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166977.008251:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220000/0x2f180c4effbaa61c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:1.0:1762166977.008270:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 49949 00000004:00200000:1.0:1762166977.008273:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166977.008285:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220000/0x2f180c4effbaa61c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166977.008302:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaa615 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ad6 expref: 539 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.008325:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220000/0x2f180c4effbaa61c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ad6 expref: 538 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.008334:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166977.008337:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166977.008340:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc6220000, rc 0) 00000100:00100000:1.0:1762166977.008377:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5768380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+538:61766:x1847765450412416:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 243us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166977.008384:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30364 00000100:00100000:2.0:1762166977.010385:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.010419:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450412672 00000100:00100000:1.0:1762166977.010426:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450412672 00000100:00100000:1.0:1762166977.010455:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30365 00000100:00100000:1.0:1762166977.010461:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc576b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+538:61766:x1847765450412672:12345-192.168.204.38@tcp:36:fsx.0 00010000:00010000:1.0:1762166977.010521:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166977.010537:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220000/0x2f180c4effbaa61c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ad6 expref: 538 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.010555:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166977.010559:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166977.010701:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaa623 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166977.010712:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaa623 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166977.010720:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaa623 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000001:00080000:1.0:1762166977.010760:0:6494:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294991951 00000004:00010000:1.0:1762166977.010780:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000004a280658 reply state 00000000e5643929 transno 4294991952 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaa623 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166977.010792:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaa623 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166977.010798:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166977.010800:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166977.010803:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166977.010858:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc576b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+540:61766:x1847765450412672:12345-192.168.204.38@tcp:36:fsx.0 Request processed in 396us (474us total) trans 4294991952 rc 0/0 00000100:00100000:1.0:1762166977.010865:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30365 00000020:00080000:1.0:1762166977.010870:0:6494:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1762166977.012039:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166977.012072:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.012174:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450412800 00000100:00100000:0.0:1762166977.012180:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450412800 00002000:00010000:0.0:1762166977.012206:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (69582->18446744073709551615) 00002000:00100000:0.0:1762166977.012211:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc8123480 with x1847765450412800 ext(69582->18446744073709551615) 00000100:00100000:3.0:1762166977.012220:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00002000:00010000:0.0:1762166977.012221:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc8123480. 00000100:00100000:0.0:1762166977.012249:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450413056 00000100:00100000:0.0:1762166977.012253:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450413056 00002000:00010000:0.0:1762166977.012263:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:0.0:1762166977.012267:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc8121500 with x1847765450413056 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166977.012272:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc8121500. 00000100:00100000:2.0:1762166977.012276:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450412928 00000100:00100000:2.0:1762166977.012282:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450412928 00002000:00010000:2.0:1762166977.012302:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00000100:00100000:0.0:1762166977.012305:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2158 00002000:00100000:2.0:1762166977.012314:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc8120a80 with x1847765450412928 ext(0->18446744073709551615) 00000100:00100000:1.0:1762166977.012316:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2159 00002000:00010000:2.0:1762166977.012324:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc8120a80. 00000100:00100000:0.0:1762166977.012324:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc8123480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450412800:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:1.0:1762166977.012333:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc8121500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450413056:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:2.0:1762166977.012352:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2160 00000100:00100000:2.0:1762166977.012362:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc8120a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450412928:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:1.0:1762166977.012438:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166977.012446:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:2.0:1762166977.012448:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166977.012449:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166976 -> 1762166976 00002000:00010000:2.0:1762166977.012454:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:1.0:1762166977.012456:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:2.0:1762166977.012461:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166977.012462:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:2.0:1762166977.012468:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:2.0:1762166977.012472:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00002000:00010000:0.0:1762166977.012508:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 49949 -> 69582 00002000:00010000:0.0:1762166977.012512:0:23939:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:0.0:1762166977.012515:0:23939:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166976 -> 1762166976 00002000:00010000:0.0:1762166977.012518:0:23939:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00000100:00100000:1.0:1762166977.012523:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc8121500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765450413056:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 194us (448us total) trans 17179876304 rc 0/0 00002000:00010000:0.0:1762166977.012524:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 56 -> 56 00000100:00100000:2.0:1762166977.012530:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc8120a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450412928:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 166us (307us total) trans 21474843260 rc 0/0 00000100:00100000:1.0:1762166977.012539:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2159 00002000:00010000:1.0:1762166977.012544:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:1.0:1762166977.012547:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc8121500 with x1847765450413056 ext(0->18446744073709551615) 00002000:00010000:1.0:1762166977.012552:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc8121500. 00000100:00100000:0.0:1762166977.012558:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc8123480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765450412800:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 243us (520us total) trans 17179876305 rc 0/0 00000100:00100000:2.0:1762166977.012671:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2160 00002000:00010000:2.0:1762166977.012676:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00000100:00100000:0.0:1762166977.012680:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2158 00002000:00100000:2.0:1762166977.012682:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc8120a80 with x1847765450412928 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166977.012687:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (69582->18446744073709551615) 00002000:00010000:2.0:1762166977.012689:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc8120a80. 00002000:00100000:0.0:1762166977.012694:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc8123480 with x1847765450412800 ext(69582->18446744073709551615) 00002000:00010000:0.0:1762166977.012712:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc8123480. 00000100:00100000:2.0:1762166977.013661:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.013715:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450413184 00000100:00100000:1.0:1762166977.013720:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450413184 00000100:00100000:1.0:1762166977.013758:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30366 00000100:00100000:1.0:1762166977.013767:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5769500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+540:61766:x1847765450413184:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:1.0:1762166977.013782:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166977.013797:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220600/0x2f180c4effbaa62a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9add expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.013860:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220a00/0x2f180c4effbaa631 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166977.013871:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220a00/0x2f180c4effbaa631 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166977.013881:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220a00/0x2f180c4effbaa631 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:1.0:1762166977.013933:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 69582 00000004:00200000:1.0:1762166977.013938:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166977.013952:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220a00/0x2f180c4effbaa631 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166977.013973:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220600/0x2f180c4effbaa62a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9add expref: 542 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.013986:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220a00/0x2f180c4effbaa631 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9add expref: 541 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.013994:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166977.013997:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166977.013999:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc6220a00, rc 0) 00000100:00100000:1.0:1762166977.014036:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5769500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+541:61766:x1847765450413184:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 271us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166977.014042:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30366 00000100:00100000:1.0:1762166977.016012:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.016111:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450413440 00000100:00100000:2.0:1762166977.016121:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450413440 00000100:00100000:2.0:1762166977.016170:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30367 00000100:00100000:2.0:1762166977.016180:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+541:61766:x1847765450413440:12345-192.168.204.38@tcp:36:fsx.0 00010000:00010000:2.0:1762166977.016227:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166977.016247:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220a00/0x2f180c4effbaa631 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9add expref: 541 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.016267:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166977.016271:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166977.016409:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbaa638 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166977.016417:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbaa638 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166977.016422:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbaa638 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000001:00080000:2.0:1762166977.016449:0:6494:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294991953 00000004:00010000:2.0:1762166977.016464:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000008e6a985e reply state 00000000829e565c transno 4294991954 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbaa638 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166977.016471:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbaa638 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166977.016504:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166977.016507:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166977.016511:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166977.016572:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+543:61766:x1847765450413440:12345-192.168.204.38@tcp:36:fsx.0 Request processed in 394us (568us total) trans 4294991954 rc 0/0 00000100:00100000:2.0:1762166977.016578:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30367 00000020:00080000:2.0:1762166977.016582:0:6494:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1762166977.017619:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166977.017647:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.017665:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450413696 00000100:00100000:0.0:1762166977.017676:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450413696 00000100:00100000:3.0:1762166977.017681:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.017716:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450413568 00002000:00010000:0.0:1762166977.017717:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:0.0:1762166977.017726:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc8121880 with x1847765450413696 ext(0->18446744073709551615) 00000100:00100000:2.0:1762166977.017727:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450413568 00000100:00100000:1.0:1762166977.017730:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450413824 00000100:00100000:1.0:1762166977.017738:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450413824 00002000:00010000:0.0:1762166977.017745:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc8121880. 00002000:00010000:2.0:1762166977.017760:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (261927->18446744073709551615) 00002000:00010000:1.0:1762166977.017763:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:2.0:1762166977.017768:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc8120e00 with x1847765450413568 ext(261927->18446744073709551615) 00002000:00100000:1.0:1762166977.017771:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc8120700 with x1847765450413824 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166977.017782:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc8120e00. 00002000:00010000:1.0:1762166977.017784:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc8120700. 00000100:00100000:0.0:1762166977.017786:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2161 00000100:00100000:0.0:1762166977.017801:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc8121880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450413696:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:1.0:1762166977.017816:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2162 00000100:00100000:2.0:1762166977.017829:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2163 00000100:00100000:1.0:1762166977.017831:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc8120700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765450413824:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:2.0:1762166977.017846:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc8120e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765450413568:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:1.0:1762166977.017973:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166977.017975:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166977.017977:0:23943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:0.0:1762166977.017980:0:23939:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:1.0:1762166977.017982:0:23943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166976 -> 1762166976 00002000:00010000:0.0:1762166977.017985:0:23939:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166976 -> 1762166976 00002000:00010000:1.0:1762166977.017986:0:23943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:1.0:1762166977.017993:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:0.0:1762166977.017994:0:23939:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:0.0:1762166977.017998:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00000100:00100000:1.0:1762166977.018049:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc8120700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+25:2418:x1847765450413824:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 223us (368us total) trans 17179876306 rc 0/0 00000100:00100000:0.0:1762166977.018058:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc8121880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765450413696:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 257us (440us total) trans 21474843261 rc 0/0 00000100:00100000:1.0:1762166977.018063:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2162 00002000:00010000:1.0:1762166977.018070:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00010000:2.0:1762166977.018072:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 69582 -> 261927 00000100:00100000:0.0:1762166977.018077:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2161 00002000:00100000:1.0:1762166977.018081:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc8120700 with x1847765450413824 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166977.018086:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00010000:2.0:1762166977.018087:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:1.0:1762166977.018090:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc8120700. 00002000:00100000:0.0:1762166977.018095:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc8121880 with x1847765450413696 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166977.018102:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166976 -> 1762166976 00002000:00010000:0.0:1762166977.018108:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc8121880. 00002000:00010000:2.0:1762166977.018113:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:2.0:1762166977.018121:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 56 -> 56 00000100:00100000:2.0:1762166977.018160:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc8120e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+24:2418:x1847765450413568:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 320us (511us total) trans 17179876307 rc 0/0 00000100:00100000:2.0:1762166977.018168:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2163 00002000:00010000:2.0:1762166977.018171:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (261927->18446744073709551615) 00002000:00100000:2.0:1762166977.018175:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc8120e00 with x1847765450413568 ext(261927->18446744073709551615) 00002000:00010000:2.0:1762166977.018180:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc8120e00. 00000100:00100000:0.0:1762166977.019860:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.019903:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450413952 00000100:00100000:2.0:1762166977.019910:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450413952 00002000:00100000:2.0:1762166977.019941:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (212992->262143) req@ffff945bc5767100 x1847765450413952/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 488/0 e 0 to 0 dl 1762166988 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166977.019956:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5767100 with x1847765450413952 ext(212992->262143) 00002000:00010000:2.0:1762166977.019960:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5767100 00000100:00100000:2.0:1762166977.019982:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2164 00000100:00100000:2.0:1762166977.019994:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5767100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+24:2417:x1847765450413952:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:2.0:1762166977.020913:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5767100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+24:2417:x1847765450413952:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 923us (1057us total) trans 0 rc 49152/49152 00000100:00100000:2.0:1762166977.020923:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2164 00002000:00100000:2.0:1762166977.020931:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (212992->262143) req@ffff945bc5767100 x1847765450413952/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 488/440 e 0 to 0 dl 1762166988 ref 1 fl Complete:/600/0 rc 49152/49152 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166977.020948:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5767100 with x1847765450413952 ext(212992->262143) 00002000:00010000:2.0:1762166977.020952:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5767100 00000100:00100000:3.0:1762166977.022755:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.022809:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450414080 00000100:00100000:2.0:1762166977.022816:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450414080 00002000:00100000:2.0:1762166977.022843:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (40960->261926) req@ffff945bc8122300 x1847765450414080/t0(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 504/0 e 0 to 0 dl 1762166988 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166977.022852:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc8122300 with x1847765450414080 ext(40960->261926) 00002000:00010000:2.0:1762166977.022856:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc8122300 00000100:00100000:2.0:1762166977.022879:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2165 00000100:00100000:2.0:1762166977.022900:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc8122300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+24:2418:x1847765450414080:12345-192.168.204.38@tcp:4:fsx.0 00000100:00100000:2.0:1762166977.024217:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc8122300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+26:2418:x1847765450414080:12345-192.168.204.38@tcp:4:fsx.0 Request processed in 1327us (1464us total) trans 17179876308 rc 0/0 00000100:00100000:2.0:1762166977.024227:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2165 00002000:00100000:2.0:1762166977.024236:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (40960->261926) req@ffff945bc8122300 x1847765450414080/t17179876308(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 504/448 e 0 to 0 dl 1762166988 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166977.024243:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc8122300 with x1847765450414080 ext(40960->261926) 00002000:00010000:2.0:1762166977.024247:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc8122300 00000100:00100000:3.0:1762166977.025019:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.025065:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450414208 00000100:00100000:1.0:1762166977.025073:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450414208 00000100:00100000:1.0:1762166977.025124:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18903 00000100:00100000:1.0:1762166977.025134:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc8121c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765450414208:12345-192.168.204.38@tcp:16:fsx.0 00000001:00080000:2.0:1762166977.025900:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876308 is committed 00000100:00100000:1.0:1762166977.025997:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc8121c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450414208:12345-192.168.204.38@tcp:16:fsx.0 Request processed in 865us (978us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166977.026003:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18903 00000100:00100000:3.0:1762166977.026847:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.026882:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450414336 00000100:00100000:2.0:1762166977.026897:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450414336 00000100:00100000:2.0:1762166977.026939:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30368 00000100:00100000:2.0:1762166977.026949:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc8120000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+543:61766:x1847765450414336:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:2.0:1762166977.026970:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166977.026995:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbaa63f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9ae4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.027096:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbaa646 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166977.027116:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbaa646 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166977.027130:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbaa646 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:2.0:1762166977.027159:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 261927 00000004:00200000:2.0:1762166977.027163:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166977.027181:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbaa646 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166977.027207:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbaa63f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ae4 expref: 545 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.027226:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbaa646 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ae4 expref: 544 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.027233:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166977.027235:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166977.027238:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa8e00, rc 0) 00000100:00100000:2.0:1762166977.027267:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc8120000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+544:61766:x1847765450414336:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 322us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166977.027271:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30368 00000100:00100000:0.0:1762166977.029599:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.029648:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450414464 00000100:00100000:2.0:1762166977.029659:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450414464 00002000:00100000:2.0:1762166977.029707:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (61440->126975) req@ffff945bc5765f80 x1847765450414464/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 488/0 e 0 to 0 dl 1762166988 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166977.029717:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5765f80 with x1847765450414464 ext(61440->126975) 00002000:00010000:2.0:1762166977.029722:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5765f80 00000100:00100000:2.0:1762166977.029748:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2166 00000100:00100000:2.0:1762166977.029756:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5765f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450414464:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:2.0:1762166977.030847:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5765f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450414464:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 1087us (1255us total) trans 0 rc 65536/65536 00000100:00100000:2.0:1762166977.030854:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2166 00002000:00100000:2.0:1762166977.030863:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (61440->126975) req@ffff945bc5765f80 x1847765450414464/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 488/440 e 0 to 0 dl 1762166988 ref 1 fl Complete:/600/0 rc 65536/65536 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166977.030872:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5765f80 with x1847765450414464 ext(61440->126975) 00002000:00010000:2.0:1762166977.030876:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5765f80 00000100:00100000:3.0:1762166977.032099:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.032146:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450414592 00000100:00100000:2.0:1762166977.032151:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450414592 00002000:00100000:2.0:1762166977.032181:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (126976->163839) req@ffff945bc8123b80 x1847765450414592/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 488/0 e 0 to 0 dl 1762166988 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166977.032191:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc8123b80 with x1847765450414592 ext(126976->163839) 00002000:00010000:2.0:1762166977.032195:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc8123b80 00000100:00100000:2.0:1762166977.032228:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2167 00000100:00100000:2.0:1762166977.032239:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc8123b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450414592:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:2.0:1762166977.033235:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc8123b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450414592:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 997us (1136us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1762166977.033245:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2167 00002000:00100000:2.0:1762166977.033253:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (126976->163839) req@ffff945bc8123b80 x1847765450414592/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 488/440 e 0 to 0 dl 1762166988 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166977.033262:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc8123b80 with x1847765450414592 ext(126976->163839) 00002000:00010000:2.0:1762166977.033266:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc8123b80 00000100:00100000:3.0:1762166977.036637:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.036704:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450414720 00000100:00100000:2.0:1762166977.036715:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450414720 00002000:00100000:2.0:1762166977.036764:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (0->212991) req@ffff945bc8122a00 x1847765450414720/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 520/0 e 0 to 0 dl 1762166988 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166977.036774:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc8122a00 with x1847765450414720 ext(0->212991) 00002000:00010000:2.0:1762166977.036780:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc8122a00 00000100:00100000:2.0:1762166977.036811:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2168 00000100:00100000:2.0:1762166977.036823:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc8122a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450414720:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:2.0:1762166977.037832:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc8122a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450414720:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 1012us (1202us total) trans 0 rc 69632/69632 00000100:00100000:2.0:1762166977.037839:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2168 00002000:00100000:2.0:1762166977.037845:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (0->212991) req@ffff945bc8122a00 x1847765450414720/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 520/440 e 0 to 0 dl 1762166988 ref 1 fl Complete:/600/0 rc 69632/69632 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166977.037852:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc8122a00 with x1847765450414720 ext(0->212991) 00002000:00010000:2.0:1762166977.037855:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc8122a00 00000100:00100000:0.0:1762166977.039317:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.039368:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450414848 00000100:00100000:2.0:1762166977.039374:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450414848 00000100:00100000:2.0:1762166977.039421:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2169 00000100:00100000:2.0:1762166977.039430:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5765180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+18:2417:x1847765450414848:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:2.0:1762166977.039772:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 261927 -> 261927 00002000:00010000:2.0:1762166977.039778:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:2.0:1762166977.039780:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166976 -> 1762166976 00002000:00010000:2.0:1762166977.039783:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:2.0:1762166977.039785:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 56 -> 216 00000100:00100000:2.0:1762166977.039825:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5765180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+19:2417:x1847765450414848:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 397us (511us total) trans 17179876309 rc 0/0 00000100:00100000:2.0:1762166977.039831:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2169 00000100:00100000:3.0:1762166977.041357:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.041418:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450414976 00000100:00100000:2.0:1762166977.041424:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450414976 00000100:00100000:2.0:1762166977.041462:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2170 00000100:00100000:2.0:1762166977.041468:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc8123100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450414976:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:2.0:1762166977.041797:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 261927 -> 261927 00002000:00010000:2.0:1762166977.041801:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:2.0:1762166977.041803:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166976 -> 1762166976 00002000:00010000:2.0:1762166977.041805:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:2.0:1762166977.041808:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 216 -> 272 00000100:00100000:2.0:1762166977.041854:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc8123100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450414976:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 384us (501us total) trans 17179876310 rc 0/0 00000100:00100000:2.0:1762166977.041862:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2170 00000100:00100000:3.0:1762166977.044376:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.044436:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450415104 00000100:00100000:2.0:1762166977.044446:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450415104 00002000:00100000:2.0:1762166977.044517:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (245760->249855) req@ffff945bcb385f80 x1847765450415104/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 488/0 e 0 to 0 dl 1762166988 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166977.044529:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bcb385f80 with x1847765450415104 ext(245760->249855) 00002000:00010000:2.0:1762166977.044537:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bcb385f80 00000100:00100000:2.0:1762166977.044565:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2171 00000100:00100000:2.0:1762166977.044577:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb385f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450415104:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:2.0:1762166977.044786:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb385f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450415104:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 210us (416us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1762166977.044794:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2171 00002000:00100000:2.0:1762166977.044802:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (245760->249855) req@ffff945bcb385f80 x1847765450415104/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 488/4536 e 0 to 0 dl 1762166988 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166977.044811:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bcb385f80 with x1847765450415104 ext(245760->249855) 00002000:00010000:2.0:1762166977.044816:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bcb385f80 00000100:00100000:0.0:1762166977.048740:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.048797:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450415232 00000100:00100000:2.0:1762166977.048811:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450415232 00002000:00100000:2.0:1762166977.048899:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (4096->262143) req@ffff945bc5766d80 x1847765450415232/t0(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 504/0 e 0 to 0 dl 1762166988 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166977.048912:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5766d80 with x1847765450415232 ext(4096->262143) 00002000:00010000:2.0:1762166977.048919:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5766d80 00000100:00100000:2.0:1762166977.048957:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2172 00000100:00100000:2.0:1762166977.048971:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5766d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450415232:12345-192.168.204.38@tcp:4:fsx.0 00000100:00100000:2.0:1762166977.051088:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5766d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450415232:12345-192.168.204.38@tcp:4:fsx.0 Request processed in 2111us (2352us total) trans 17179876311 rc 0/0 00000100:00100000:2.0:1762166977.051102:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2172 00002000:00100000:2.0:1762166977.051112:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (4096->262143) req@ffff945bc5766d80 x1847765450415232/t17179876311(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 504/448 e 0 to 0 dl 1762166988 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166977.051122:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5766d80 with x1847765450415232 ext(4096->262143) 00002000:00010000:2.0:1762166977.051128:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5766d80 00000100:00100000:3.0:1762166977.052028:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.052093:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450415360 00000100:00100000:1.0:1762166977.052101:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450415360 00000100:00100000:1.0:1762166977.052152:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18904 00000100:00100000:1.0:1762166977.052163:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3e68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765450415360:12345-192.168.204.38@tcp:16:fsx.0 00000001:00080000:2.0:1762166977.054279:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876311 is committed 00000100:00100000:1.0:1762166977.054431:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3e68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450415360:12345-192.168.204.38@tcp:16:fsx.0 Request processed in 2266us (2401us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166977.054442:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18904 00000100:00100000:0.0:1762166977.056460:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.056532:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450415488 00000100:00100000:2.0:1762166977.056542:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450415488 00000100:00100000:2.0:1762166977.056600:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2173 00000100:00100000:2.0:1762166977.056610:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5766680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450415488:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:2.0:1762166977.056846:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 261927 -> 262144 00002000:00010000:2.0:1762166977.056850:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:2.0:1762166977.056853:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166976 -> 1762166977 00002000:00010000:2.0:1762166977.056856:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:2.0:1762166977.056858:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 272 -> 416 00000100:00100000:2.0:1762166977.056922:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5766680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450415488:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 313us (475us total) trans 17179876312 rc 0/0 00000100:00100000:2.0:1762166977.056929:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2173 00000100:00100000:3.0:1762166977.058741:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.058812:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450415616 00000100:00100000:2.0:1762166977.058820:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450415616 00000100:00100000:2.0:1762166977.058874:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2174 00000100:00100000:2.0:1762166977.058883:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb385180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+19:2416:x1847765450415616:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:2.0:1762166977.059013:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:2.0:1762166977.059017:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:2.0:1762166977.059019:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166977 -> 1762166977 00002000:00010000:2.0:1762166977.059022:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:2.0:1762166977.059024:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 416 -> 416 00000100:00100000:2.0:1762166977.059073:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb385180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+20:2416:x1847765450415616:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 191us (340us total) trans 17179876313 rc 0/0 00000100:00100000:2.0:1762166977.059082:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2174 00000100:00100000:3.0:1762166977.060675:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.060740:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450415872 00000100:00100000:2.0:1762166977.060749:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450415872 00000100:00100000:2.0:1762166977.060802:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30369 00000100:00100000:2.0:1762166977.060813:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb386d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+544:61766:x1847765450415872:12345-192.168.204.38@tcp:36:fsx.0 00010000:00010000:2.0:1762166977.060870:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166977.060913:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbaa646 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ae4 expref: 544 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.060931:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166977.060936:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166977.061111:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbaa64d lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166977.061127:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbaa64d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166977.061137:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbaa64d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000001:00080000:2.0:1762166977.061194:0:6494:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294991955 00000004:00010000:2.0:1762166977.061223:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000007a686219 reply state 0000000086fed945 transno 4294991956 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbaa64d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166977.061235:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbaa64d lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166977.061240:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166977.061242:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166977.061244:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166977.061313:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb386d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+546:61766:x1847765450415872:12345-192.168.204.38@tcp:36:fsx.0 Request processed in 503us (644us total) trans 4294991956 rc 0/0 00000100:00100000:2.0:1762166977.061322:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30369 00000020:00080000:2.0:1762166977.061328:0:6494:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1762166977.062515:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.062545:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.062589:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.062606:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450416000 00000100:00100000:1.0:1762166977.062613:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450416256 00000100:00100000:2.0:1762166977.062614:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450416000 00000100:00100000:1.0:1762166977.062621:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450416256 00002000:00010000:2.0:1762166977.062649:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (177340->18446744073709551615) 00002000:00010000:1.0:1762166977.062649:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:2.0:1762166977.062659:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5767800 with x1847765450416000 ext(177340->18446744073709551615) 00002000:00100000:1.0:1762166977.062659:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5764380 with x1847765450416256 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166977.062671:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5767800. 00002000:00010000:1.0:1762166977.062672:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5764380. 00000100:00100000:2.0:1762166977.062706:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450416128 00000100:00100000:2.0:1762166977.062711:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450416128 00002000:00010000:2.0:1762166977.062729:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00000100:00100000:1.0:1762166977.062729:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2175 00002000:00100000:2.0:1762166977.062736:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5767480 with x1847765450416128 ext(0->18446744073709551615) 00000100:00100000:0.0:1762166977.062745:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2176 00002000:00010000:2.0:1762166977.062746:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc5767480. 00000100:00100000:1.0:1762166977.062747:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5767800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450416000:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:0.0:1762166977.062763:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5764380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450416256:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:3.0:1762166977.062775:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2177 00000100:00100000:3.0:1762166977.062801:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5767480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765450416128:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:0.0:1762166977.062903:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166977.062909:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:0.0:1762166977.062912:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166976 -> 1762166976 00002000:00010000:0.0:1762166977.062914:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:0.0:1762166977.062918:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1762166977.062977:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5764380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765450416256:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 220us (430us total) trans 17179876314 rc 0/0 00002000:00010000:3.0:1762166977.062983:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:0.0:1762166977.062991:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2176 00002000:00010000:3.0:1762166977.062993:0:23943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:0.0:1762166977.062999:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00010000:3.0:1762166977.063000:0:23943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166976 -> 1762166976 00002000:00100000:0.0:1762166977.063008:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5764380 with x1847765450416256 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166977.063010:0:23943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:3.0:1762166977.063019:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00002000:00010000:0.0:1762166977.063019:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5764380. 00000100:00100000:3.0:1762166977.063105:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5767480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765450416128:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 313us (513us total) trans 21474843262 rc 0/0 00000100:00100000:3.0:1762166977.063114:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2177 00002000:00010000:1.0:1762166977.063117:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 262144 -> 177340 00002000:00010000:1.0:1762166977.063123:0:23939:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:1.0:1762166977.063127:0:23939:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166977 -> 1762166977 00002000:00010000:1.0:1762166977.063130:0:23939:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:1.0:1762166977.063133:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 416 -> 296 00000100:00100000:1.0:1762166977.063177:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5767800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450416000:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 436us (664us total) trans 17179876315 rc 0/0 00000100:00100000:1.0:1762166977.063186:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2175 00002000:00010000:1.0:1762166977.063191:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (177340->18446744073709551615) 00002000:00100000:1.0:1762166977.063194:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5767800 with x1847765450416000 ext(177340->18446744073709551615) 00002000:00010000:1.0:1762166977.063199:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5767800. 00002000:00010000:3.0:1762166977.063220:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:3.0:1762166977.063224:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5767480 with x1847765450416128 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166977.063231:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc5767480. 00000100:00100000:2.0:1762166977.064563:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.064694:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450416384 00000100:00100000:1.0:1762166977.064704:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450416384 00000100:00100000:1.0:1762166977.064754:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30370 00000100:00100000:1.0:1762166977.064765:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+546:61766:x1847765450416384:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:1.0:1762166977.064785:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166977.064802:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220600/0x2f180c4effbaa654 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9aeb expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.064881:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220000/0x2f180c4effbaa65b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166977.064915:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220000/0x2f180c4effbaa65b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166977.064926:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220000/0x2f180c4effbaa65b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:1.0:1762166977.064952:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 177340 00000004:00200000:1.0:1762166977.064956:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166977.064972:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220000/0x2f180c4effbaa65b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166977.064995:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220600/0x2f180c4effbaa654 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9aeb expref: 548 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.065011:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220000/0x2f180c4effbaa65b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9aeb expref: 547 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.065020:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166977.065023:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166977.065026:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc6220000, rc 0) 00000100:00100000:1.0:1762166977.065067:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+547:61766:x1847765450416384:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 306us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166977.065075:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30370 00000100:00100000:0.0:1762166977.066953:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166977.067010:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450416512 00000100:00100000:3.0:1762166977.067018:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450416512 00002000:00100000:3.0:1762166977.067050:0:23943:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000400:0xa77:0x0] (122880->126975) req@ffff945bc5765500 x1847765450416512/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 488/0 e 0 to 0 dl 1762166988 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166977.067061:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5765500 with x1847765450416512 ext(122880->126975) 00002000:00010000:3.0:1762166977.067065:0:23943:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5765500 00000100:00100000:3.0:1762166977.067092:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2178 00000100:00100000:3.0:1762166977.067100:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5765500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450416512:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:3.0:1762166977.067274:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5765500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450416512:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 175us (329us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1762166977.067282:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2178 00002000:00100000:3.0:1762166977.067288:0:23943:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000400:0xa77:0x0] (122880->126975) req@ffff945bc5765500 x1847765450416512/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 488/4536 e 0 to 0 dl 1762166988 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166977.067295:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5765500 with x1847765450416512 ext(122880->126975) 00002000:00010000:3.0:1762166977.067298:0:23943:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5765500 00000100:00100000:0.0:1762166977.068622:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166977.068671:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450416640 00000100:00100000:3.0:1762166977.068681:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450416640 00002000:00100000:3.0:1762166977.068727:0:23943:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000400:0xa77:0x0] (147456->151551) req@ffff945bc5764a80 x1847765450416640/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 488/0 e 0 to 0 dl 1762166988 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166977.068737:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5764a80 with x1847765450416640 ext(147456->151551) 00002000:00010000:3.0:1762166977.068743:0:23943:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5764a80 00000100:00100000:3.0:1762166977.068776:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2179 00000100:00100000:3.0:1762166977.068783:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5764a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765450416640:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:3.0:1762166977.068953:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5764a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765450416640:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 170us (334us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1762166977.068960:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2179 00002000:00100000:3.0:1762166977.068967:0:23943:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000400:0xa77:0x0] (147456->151551) req@ffff945bc5764a80 x1847765450416640/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 488/4536 e 0 to 0 dl 1762166988 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166977.068976:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5764a80 with x1847765450416640 ext(147456->151551) 00002000:00010000:3.0:1762166977.068979:0:23943:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5764a80 00000100:00100000:2.0:1762166977.073109:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166977.073175:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450416768 00000100:00100000:3.0:1762166977.073189:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450416768 00002000:00100000:3.0:1762166977.073243:0:23943:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000400:0xa77:0x0] (69632->151551) req@ffff945bc5769880 x1847765450416768/t0(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 504/0 e 0 to 0 dl 1762166988 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166977.073256:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5769880 with x1847765450416768 ext(69632->151551) 00002000:00010000:3.0:1762166977.073261:0:23943:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5769880 00000100:00100000:3.0:1762166977.073296:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2180 00000100:00100000:3.0:1762166977.073306:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5769880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450416768:12345-192.168.204.38@tcp:4:fsx.0 00000100:00100000:3.0:1762166977.075232:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5769880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765450416768:12345-192.168.204.38@tcp:4:fsx.0 Request processed in 1923us (2126us total) trans 17179876316 rc 0/0 00000100:00100000:3.0:1762166977.075246:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2180 00002000:00100000:3.0:1762166977.075258:0:23943:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000400:0xa77:0x0] (69632->151551) req@ffff945bc5769880 x1847765450416768/t17179876316(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 504/448 e 0 to 0 dl 1762166988 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166977.075268:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5769880 with x1847765450416768 ext(69632->151551) 00002000:00010000:3.0:1762166977.075274:0:23943:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5769880 00000100:00100000:0.0:1762166977.076339:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.076399:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450416896 00000100:00100000:1.0:1762166977.076411:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450416896 00000100:00100000:1.0:1762166977.076453:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18905 00000100:00100000:1.0:1762166977.076463:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5765880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+24:2418:x1847765450416896:12345-192.168.204.38@tcp:16:fsx.0 00000001:00080000:2.0:1762166977.077675:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876316 is committed 00000100:00100000:1.0:1762166977.077832:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5765880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450416896:12345-192.168.204.38@tcp:16:fsx.0 Request processed in 1369us (1493us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166977.077845:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18905 00000100:00100000:2.0:1762166977.079756:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.079805:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450417152 00000100:00100000:1.0:1762166977.079811:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450417152 00000100:00100000:1.0:1762166977.079853:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11817 00000100:00100000:1.0:1762166977.079861:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5768e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+547:61766:x1847765450417152:12345-192.168.204.38@tcp:35:fsx.0 00000100:00100000:1.0:1762166977.080115:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5768e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+548:61766:x1847765450417152:12345-192.168.204.38@tcp:35:fsx.0 Request processed in 254us (361us total) trans 4294991957 rc 0/0 00000100:00100000:1.0:1762166977.080122:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11817 00000100:00100000:0.0:1762166977.089247:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.089331:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450417280 00000100:00100000:1.0:1762166977.089340:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450417280 00000100:00100000:1.0:1762166977.089391:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30371 00000100:00100000:1.0:1762166977.089401:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5764e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+548:61844:x1847765450417280:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166977.089425:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166977.089444:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220600/0x2f180c4effbaa662 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9af2 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.089536:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaa669 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166977.089550:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaa669 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166977.089560:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaa669 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166977.089571:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa670 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166977.089583:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa670 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166977.089590:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa670 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166977.089661:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220c00/0x2f180c4effbaa677 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166977.089670:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220c00/0x2f180c4effbaa677 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166977.089676:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220c00/0x2f180c4effbaa677 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:1.0:1762166977.089716:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 177340 00000004:00200000:1.0:1762166977.089720:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166977.089738:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220c00/0x2f180c4effbaa677 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166977.089748:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220c00/0x2f180c4effbaa677 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166977.089756:0:6494:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaa669 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166977.089763:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaa669 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166977.089768:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaa669 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166977.089774:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaa669 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166977.089779:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc6221400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166977.089782:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaa669 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166977.089789:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaa669 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166977.089799:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0x0 (ffff945bc812ea00) 00010000:00010000:1.0:1762166977.089802:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166977.089806:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaa669 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166977.089812:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaa669 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166977.089823:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa670 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166977.089829:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa670 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166977.089834:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa670 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166977.089838:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc6221c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166977.089840:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa670 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166977.089844:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa670 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166977.089849:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0xdd396665 (ffff945bc812e600) 00010000:00010000:1.0:1762166977.089852:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166977.089854:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa670 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166977.089858:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa670 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166977.089899:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220600/0x2f180c4effbaa662 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9af2 expref: 550 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.089914:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220c00/0x2f180c4effbaa677 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9af2 expref: 549 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.089921:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166977.089923:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166977.089925:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc6220c00, rc 0) 00000100:00100000:1.0:1762166977.089981:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5764e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+549:61844:x1847765450417280:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 581us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166977.089988:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30371 00000100:00100000:0.0:1762166977.091272:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.091336:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450417408 00000100:00100000:2.0:1762166977.091343:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450417408 00000100:00100000:2.0:1762166977.091386:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 866 00000100:00100000:2.0:1762166977.091395:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf9d1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+549:2419:x1847765450417408:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166977.091406:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166977.091422:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220c00/0x2f180c4effbaa677 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9af2 expref: 549 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.091435:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166977.091438:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166977.091500:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf9d1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+548:2419:x1847765450417408:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 83us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166977.091508:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 866 00000100:00100000:2.0:1762166977.091998:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.092041:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450417664 00000100:00100000:1.0:1762166977.092047:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450417664 00000100:00100000:1.0:1762166977.092082:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30372 00000100:00100000:1.0:1762166977.092091:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5768700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+548:61844:x1847765450417664:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166977.092104:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166977.092115:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220400/0x2f180c4effbaa67e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9af9 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.092187:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220800/0x2f180c4effbaa685 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166977.092198:0:6494:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220000/0x2f180c4effbaa65b lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9aeb expref: 549 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.092207:0:6494:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220800/0x2f180c4effbaa685 lrc: 4/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166977.092234:0:6494:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220000/0x2f180c4effbaa65b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9aeb expref: 549 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.092245:0:6494:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220000/0x2f180c4effbaa65b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9aeb expref: 549 pid: 6494 timeout: 696 lvb_type: 0 00000100:00100000:1.0:1762166977.092257:0:6494:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79ea680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765449707136:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166977.092325:0:6494:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011c7000 going to sleep for 11 seconds 00000100:00100000:1.0:1762166977.093244:0:6494:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79ea680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765449707136:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166977.093263:0:6494:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220800/0x2f180c4effbaa685 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000100:00100000:2.0:1762166977.093846:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166977.093931:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450417792 00000100:00100000:3.0:1762166977.093936:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450417792 00010000:00010000:3.0:1762166977.093953:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220000/0x2f180c4effbaa65b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9aeb expref: 550 pid: 6494 timeout: 696 lvb_type: 0 00000100:00100000:3.0:1762166977.093977:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9539 00000100:00100000:3.0:1762166977.093985:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5769180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+550:2418:x1847765450417792:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166977.093995:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166977.094001:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220000/0x2f180c4effbaa65b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9aeb expref: 550 pid: 6494 timeout: 696 lvb_type: 0 00010000:00010000:3.0:1762166977.094013:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220000/0x2f180c4effbaa65b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9aeb expref: 550 pid: 6494 timeout: 696 lvb_type: 0 00010000:00010000:3.0:1762166977.094029:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220000/0x2f180c4effbaa65b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9aeb expref: 550 pid: 6494 timeout: 696 lvb_type: 0 00010000:00010000:3.0:1762166977.094042:0:7421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166977.094046:0:7421:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220800/0x2f180c4effbaa685 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166977.094054:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220800/0x2f180c4effbaa685 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166977.094061:0:7421:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220800/0x2f180c4effbaa685 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166977.094084:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166977.094108:0:6494:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220800/0x2f180c4effbaa685 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000100:00100000:3.0:1762166977.094119:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5769180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+549:2418:x1847765450417792:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 133us (273us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166977.094119:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220800/0x2f180c4effbaa685 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000100:00100000:3.0:1762166977.094132:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9539 00000004:00200000:1.0:1762166977.094145:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 177340 00010000:00010000:1.0:1762166977.094255:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220400/0x2f180c4effbaa67e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9af9 expref: 550 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.094269:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220800/0x2f180c4effbaa685 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9af9 expref: 549 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.094276:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166977.094279:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1762166977.094282:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc6220800, rc 0) 00000100:00100000:1.0:1762166977.094324:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5768700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+549:61844:x1847765450417664:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2234us (2326us total) trans 4294991958 rc 0/0 00000100:00100000:1.0:1762166977.094331:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30372 00000100:00100000:2.0:1762166977.095656:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.095705:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450417920 00000100:00100000:1.0:1762166977.095711:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450417920 00000100:00100000:1.0:1762166977.095754:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30373 00000100:00100000:1.0:1762166977.095762:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcceb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+549:61844:x1847765450417920:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166977.095777:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166977.095788:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220600/0x2f180c4effbaa693 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9b00 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.095854:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa69a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166977.095866:0:6494:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220800/0x2f180c4effbaa685 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9af9 expref: 550 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.095873:0:6494:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa69a lrc: 4/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166977.095912:0:6494:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220800/0x2f180c4effbaa685 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9af9 expref: 550 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.095923:0:6494:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220800/0x2f180c4effbaa685 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9af9 expref: 550 pid: 6494 timeout: 696 lvb_type: 0 00000100:00100000:1.0:1762166977.095935:0:6494:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79ea680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765449707264:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166977.095999:0:6494:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011c7e40 going to sleep for 11 seconds 00000100:00100000:1.0:1762166977.096836:0:6494:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79ea680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765449707264:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166977.096852:0:6494:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa69a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000100:00100000:2.0:1762166977.097069:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166977.097140:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450418048 00000100:00100000:3.0:1762166977.097153:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450418048 00010000:00010000:3.0:1762166977.097195:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220800/0x2f180c4effbaa685 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9af9 expref: 551 pid: 6494 timeout: 696 lvb_type: 0 00000100:00100000:3.0:1762166977.097232:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9540 00000100:00100000:3.0:1762166977.097242:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+551:2418:x1847765450418048:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166977.097258:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166977.097264:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220800/0x2f180c4effbaa685 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9af9 expref: 551 pid: 6494 timeout: 696 lvb_type: 0 00010000:00010000:3.0:1762166977.097278:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220800/0x2f180c4effbaa685 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9af9 expref: 551 pid: 6494 timeout: 696 lvb_type: 0 00010000:00010000:3.0:1762166977.097299:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220800/0x2f180c4effbaa685 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9af9 expref: 551 pid: 6494 timeout: 696 lvb_type: 0 00010000:00010000:3.0:1762166977.097317:0:7421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166977.097321:0:7421:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa69a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166977.097335:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa69a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166977.097342:0:7421:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa69a lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166977.097370:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166977.097396:0:6494:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa69a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166977.097407:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa69a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000100:00100000:3.0:1762166977.097436:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+550:2418:x1847765450418048:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 194us (365us total) trans 0 rc 0/0 00000004:00200000:1.0:1762166977.097442:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 177340 00000100:00100000:3.0:1762166977.097450:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9540 00000004:00200000:1.0:1762166977.097453:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166977.097510:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa69a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166977.097541:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220600/0x2f180c4effbaa693 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b00 expref: 550 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.097557:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa69a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b00 expref: 549 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.097565:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166977.097568:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166977.097571:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc6221c00, rc 0) 00000100:00100000:1.0:1762166977.097779:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcceb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+549:61844:x1847765450417920:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2017us (2124us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166977.097787:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30373 00000100:00100000:2.0:1762166977.099342:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.099395:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450418304 00000100:00100000:1.0:1762166977.099401:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450418304 00000100:00100000:1.0:1762166977.099444:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30374 00000100:00100000:1.0:1762166977.099452:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+549:61844:x1847765450418304:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166977.099470:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166977.099511:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaa6a1 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9b07 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.099589:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220200/0x2f180c4effbaa6a8 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166977.099602:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220200/0x2f180c4effbaa6a8 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166977.099611:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220200/0x2f180c4effbaa6a8 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:1.0:1762166977.099620:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 177340 00010000:00010000:1.0:1762166977.099703:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaa6a1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 13 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b07 expref: 552 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.099716:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220200/0x2f180c4effbaa6a8 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b07 expref: 551 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.099724:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166977.099727:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762166977.099729:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc6220200, rc 0) 00000100:00100000:1.0:1762166977.099777:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+551:61844:x1847765450418304:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 325us (438us total) trans 4294991959 rc 0/0 00000100:00100000:1.0:1762166977.099785:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30374 00000100:00100000:2.0:1762166977.101231:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.101312:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.101344:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166977.101378:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450418432 00000100:00100000:3.0:1762166977.101385:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450418432 00000100:00100000:3.0:1762166977.101419:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450418560 00000100:00100000:0.0:1762166977.101420:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450418688 00000100:00100000:3.0:1762166977.101422:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450418560 00000100:00100000:0.0:1762166977.101427:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450418688 00000100:00100000:2.0:1762166977.101443:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18906 00000100:00100000:2.0:1762166977.101519:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450418432:12345-192.168.204.38@tcp:1:lfs.0 00000100:00100000:1.0:1762166977.101526:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18907 00000100:00100000:3.0:1762166977.101537:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18908 00000100:00100000:1.0:1762166977.101543:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+24:2418:x1847765450418560:12345-192.168.204.38@tcp:1:lfs.0 00000100:00100000:3.0:1762166977.101554:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450418688:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:2.0:1762166977.101555:0:8383:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbaa6b6 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.101572:0:28434:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc6220400/0x2f180c4effbaa6bd lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.101586:0:8383:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde200/0x2f180c4effbaa5b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 73728->94207) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9aac expref: 19 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.101589:0:35247:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc8473a00/0x2f180c4effbaa6c4 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.101609:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166977.101613:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166977.101618:0:28434:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfc00/0x2f180c4effbaa504 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a66 expref: 24 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.101621:0:35247:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbaa50b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a6d expref: 19 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.101624:0:8383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbaa6b6 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.101641:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166977.101647:0:35247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166977.101647:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166977.101652:0:35247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166977.101654:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc6220400/0x2f180c4effbaa6bd lrc: 4/0,1 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.101657:0:35247:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8473a00/0x2f180c4effbaa6c4 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.101671:0:8383:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde200/0x2f180c4effbaa5b3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 73728->94207) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9aac expref: 19 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.101686:0:8383:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde200/0x2f180c4effbaa5b3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 73728->94207) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9aac expref: 19 pid: 28434 timeout: 696 lvb_type: 0 00010000:00010000:1.0:1762166977.101692:0:28434:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfc00/0x2f180c4effbaa504 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a66 expref: 24 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.101695:0:35247:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbaa50b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a6d expref: 19 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166977.101709:0:8383:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc47b6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8383:1847765449707392:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166977.101728:0:28434:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfc00/0x2f180c4effbaa504 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a66 expref: 24 pid: 28434 timeout: 696 lvb_type: 0 00010000:00010000:3.0:1762166977.101730:0:35247:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbaa50b lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a6d expref: 19 pid: 28434 timeout: 696 lvb_type: 0 00000100:00100000:3.0:1762166977.101757:0:35247:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcb386680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:35247:1847765449707648:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166977.101760:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79ea680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765449707520:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166977.101787:0:8383:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1dcef00 going to sleep for 11 seconds 00000100:00100000:3.0:1762166977.101797:0:35247:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc2c72600 going to sleep for 11 seconds 00000100:00100000:1.0:1762166977.101803:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011c7900 going to sleep for 11 seconds 00000100:00100000:2.0:1762166977.103980:0:8383:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc47b6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8383:1847765449707392:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166977.104021:0:8383:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbaa6b6 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166977.104061:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.104132:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79ea680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765449707520:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166977.104141:0:35247:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcb386680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:35247:1847765449707648:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166977.104166:0:28434:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bc6220400/0x2f180c4effbaa6bd lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.104167:0:35247:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc8473a00/0x2f180c4effbaa6c4 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166977.104269:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.104305:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166977.104355:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450418816 00000100:00100000:3.0:1762166977.104364:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450418816 00000100:00100000:2.0:1762166977.104394:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450418944 00000100:00100000:2.0:1762166977.104402:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450418944 00010000:00010000:3.0:1762166977.104418:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbaa50b lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a6d expref: 21 pid: 28434 timeout: 696 lvb_type: 0 00010000:00010000:2.0:1762166977.104434:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde200/0x2f180c4effbaa5b3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 73728->94207) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9aac expref: 21 pid: 28434 timeout: 696 lvb_type: 0 00000100:00100000:3.0:1762166977.104465:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450419072 00000100:00100000:3.0:1762166977.104472:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450419072 00000100:00100000:2.0:1762166977.104520:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9541 00010000:00010000:3.0:1762166977.104531:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfc00/0x2f180c4effbaa504 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a66 expref: 25 pid: 28434 timeout: 696 lvb_type: 0 00000100:00100000:2.0:1762166977.104538:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6cd1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450418816:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166977.104566:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1762166977.104587:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9542 00010000:00010000:2.0:1762166977.104592:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbaa50b lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a6d expref: 21 pid: 28434 timeout: 696 lvb_type: 0 00000100:00100000:3.0:1762166977.104605:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6cd3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450418944:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166977.104617:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbaa50b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a6d expref: 21 pid: 28434 timeout: 696 lvb_type: 0 00010000:00010000:3.0:1762166977.104623:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166977.104650:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbaa50b lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a6d expref: 21 pid: 28434 timeout: 696 lvb_type: 0 00002000:00010000:3.0:1762166977.104652:0:8398:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 296 -> 344 00010000:00010000:3.0:1762166977.104670:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde200/0x2f180c4effbaa5b3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 73728->94207) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9aac expref: 21 pid: 28434 timeout: 696 lvb_type: 0 00010000:00010000:2.0:1762166977.104680:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166977.104685:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166977.104690:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc8473a00/0x2f180c4effbaa6c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.104691:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde200/0x2f180c4effbaa5b3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 73728->94207) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9aac expref: 20 pid: 28434 timeout: 696 lvb_type: 0 00010000:00010000:2.0:1762166977.104745:0:7421:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8473a00/0x2f180c4effbaa6c4 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.104756:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde200/0x2f180c4effbaa5b3 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 73728->94207) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9aac expref: 20 pid: 28434 timeout: 696 lvb_type: 0 00010000:00010000:2.0:1762166977.104773:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166977.104775:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166977.104779:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166977.104784:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbaa6b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.104794:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbaa6b6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166977.104817:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6cd1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450418816:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 285us (762us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166977.104824:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166977.104830:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9541 00000100:00100000:2.0:1762166977.104869:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9543 00000100:00100000:2.0:1762166977.104896:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6cd0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+25:2418:x1847765450419072:12345-192.168.204.38@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1762166977.104901:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6cd3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450418944:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 283us (614us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166977.104911:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1762166977.104918:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9542 00010000:00010000:2.0:1762166977.104933:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfc00/0x2f180c4effbaa504 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a66 expref: 25 pid: 28434 timeout: 696 lvb_type: 0 00010000:00010000:2.0:1762166977.104954:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfc00/0x2f180c4effbaa504 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a66 expref: 25 pid: 28434 timeout: 696 lvb_type: 0 00010000:00010000:1.0:1762166977.104955:0:8383:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbaa6b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.104977:0:8383:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbaa6b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.104990:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfc00/0x2f180c4effbaa504 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9a66 expref: 25 pid: 28434 timeout: 696 lvb_type: 0 00010000:00010000:2.0:1762166977.105006:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166977.105007:0:8383:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbaa6b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.105011:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166977.105017:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc6220400/0x2f180c4effbaa6bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.105021:0:8383:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbaa6b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.105031:0:7421:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc6220400/0x2f180c4effbaa6bd lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.105035:0:8383:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbaa6b6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.105039:0:35247:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc8473a00/0x2f180c4effbaa6c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.105054:0:8383:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa9c00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166977.105055:0:35247:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8473a00/0x2f180c4effbaa6c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.105060:0:8383:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbaa6b6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.105067:0:8383:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbaa6b6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.105068:0:35247:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc8473a00/0x2f180c4effbaa6c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.105071:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166977.105079:0:35247:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8473a00/0x2f180c4effbaa6c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.105091:0:8383:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbaa6b6 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.105093:0:35247:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc8473a00/0x2f180c4effbaa6c4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.105100:0:8383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbaa6b6 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.105100:0:35247:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8473a00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166977.105104:0:35247:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8473a00/0x2f180c4effbaa6c4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.105110:0:35247:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8473a00/0x2f180c4effbaa6c4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166977.105118:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6cd0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+24:2418:x1847765450419072:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 238us (809us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166977.105124:0:35247:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc8473a00/0x2f180c4effbaa6c4 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166977.105129:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9543 00010000:00010000:0.0:1762166977.105138:0:35247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8473a00/0x2f180c4effbaa6c4 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166977.105149:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450418432:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 3635us (3919us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166977.105155:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18906 00000100:00100000:0.0:1762166977.105172:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+16:2419:x1847765450418688:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 3625us (3827us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166977.105179:0:28434:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bc6220400/0x2f180c4effbaa6bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166977.105179:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18908 00010000:00010000:1.0:1762166977.105187:0:28434:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc6220400/0x2f180c4effbaa6bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.105200:0:28434:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc6220400/0x2f180c4effbaa6bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.105208:0:28434:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc6220400/0x2f180c4effbaa6bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.105216:0:28434:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc6220400/0x2f180c4effbaa6bd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.105223:0:28434:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc6220400 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166977.105227:0:28434:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc6220400/0x2f180c4effbaa6bd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.105233:0:28434:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc6220400/0x2f180c4effbaa6bd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.105240:0:28434:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc6220400/0x2f180c4effbaa6bd lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.105243:0:28434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc6220400/0x2f180c4effbaa6bd lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166977.105293:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765450418560:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 3757us (4027us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166977.105301:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18907 00000100:00100000:3.0:1762166977.106935:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.106970:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450419328 00000100:00100000:1.0:1762166977.106976:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450419328 00000100:00100000:1.0:1762166977.107012:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30375 00000100:00100000:1.0:1762166977.107017:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb386680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+551:61844:x1847765450419328:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:1.0:1762166977.107057:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1762166977.107070:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221800/0x2f180c4effbaa5cf lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9aba expref: 551 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.107082:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa69a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b00 expref: 550 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.107088:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166977.107090:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166977.107108:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220600/0x2f180c4effbaa6cb lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166977.107116:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220600/0x2f180c4effbaa6cb lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166977.107121:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220600/0x2f180c4effbaa6cb lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000040:00080000:1.0:1762166977.107338:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5887, 88 off460952 00000004:00080000:1.0:1762166977.107347:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 596255869309ns, next at 595897461133ns, rc = 0 00000040:00080000:1.0:1762166977.107382:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5886, 88 off460952 00000004:00080000:1.0:1762166977.107389:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 596255910826ns, next at 595897495953ns, rc = 0 00000040:00080000:1.0:1762166977.107415:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5887, 88 off461040 00000004:00080000:1.0:1762166977.107420:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 596255941965ns, next at 595897495953ns, rc = 0 00000040:00080000:1.0:1762166977.107433:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5888, 88 off461040 00000004:00080000:1.0:1762166977.107437:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 596255959331ns, next at 595897461133ns, rc = 0 00000040:00080000:1.0:1762166977.107458:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5888, 88 off461128 00000004:00080000:1.0:1762166977.107462:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 596255984256ns, next at 595897495953ns, rc = 0 00000040:00080000:1.0:1762166977.107538:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5889, 88 off461128 00000004:00080000:1.0:1762166977.107543:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 596256065744ns, next at 595897461133ns, rc = 0 00000040:00080000:1.0:1762166977.107563:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5889, 88 off461216 00000004:00080000:1.0:1762166977.107569:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 596256091195ns, next at 595897495953ns, rc = 0 00000040:00080000:1.0:1762166977.107597:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5890, 88 off461216 00000004:00080000:1.0:1762166977.107601:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 596256123440ns, next at 595897461133ns, rc = 0 00000001:00080000:3.0:1762166977.108658:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294991960 is committed 00000004:00080000:3.0:1762166977.108667:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3254 committed 00000004:00080000:3.0:1762166977.108677:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3257 committed 00010000:00010000:2.0:1762166977.108683:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221e00/0x2f180c4effbaa5c8 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00000004:00080000:3.0:1762166977.108691:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3253 committed 00000004:00080000:3.0:1762166977.108695:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3256 committed 00010000:00010000:2.0:1762166977.108695:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221e00/0x2f180c4effbaa5c8 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00000004:00080000:3.0:1762166977.108699:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3252 committed 00000004:00080000:3.0:1762166977.108704:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3255 committed 00000004:00080000:3.0:1762166977.108708:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3254 committed 00010000:00010000:2.0:1762166977.108709:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221e00/0x2f180c4effbaa5c8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00000004:00080000:3.0:1762166977.108712:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3251 committed 00010000:00010000:2.0:1762166977.108720:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc6221e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166977.108725:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221e00/0x2f180c4effbaa5c8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166977.108732:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221e00/0x2f180c4effbaa5c8 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166977.108748:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166977.108752:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166977.108756:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221e00/0x2f180c4effbaa5c8 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166977.108762:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221e00/0x2f180c4effbaa5c8 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166977.108780:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221200/0x2f180c4effbaa5e4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00000100:00100000:3.0:1762166977.108787:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449707776:0@lo:2:osp-syn-0-1.0 00010000:00010000:2.0:1762166977.108789:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221200/0x2f180c4effbaa5e4 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166977.108801:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221200/0x2f180c4effbaa5e4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166977.108806:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc6221200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166977.108811:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221200/0x2f180c4effbaa5e4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166977.108819:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221200/0x2f180c4effbaa5e4 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166977.108830:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00000100:00100000:0.0:1762166977.108831:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5805880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449707904:0@lo:2:osp-syn-1-1.0 00010000:00010000:2.0:1762166977.108835:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166977.108840:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221200/0x2f180c4effbaa5e4 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00000100:00100000:1.0:1762166977.108842:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449708032:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166977.108853:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1762166977.108856:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221200/0x2f180c4effbaa5e4 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166977.108869:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221600/0x2f180c4effbaa5f9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166977.108875:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221600/0x2f180c4effbaa5f9 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166977.108882:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221600/0x2f180c4effbaa5f9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166977.108898:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc6221600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166977.108904:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221600/0x2f180c4effbaa5f9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00000100:00100000:0.0:1762166977.108904:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1762166977.108914:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221600/0x2f180c4effbaa5f9 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00000100:00100000:1.0:1762166977.108921:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1e6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449708160:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166977.108923:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1e6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449708288:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1762166977.108936:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449708416:0@lo:2:osp-syn-0-1.0 00010000:00010000:2.0:1762166977.108938:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166977.108942:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166977.108946:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221600/0x2f180c4effbaa5f9 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166977.108952:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221600/0x2f180c4effbaa5f9 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166977.108964:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaa60e lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00000100:00100000:1.0:1762166977.108970:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1762166977.108977:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaa60e lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166977.108983:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaa60e lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00000100:00100000:0.0:1762166977.108985:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449707776 00010000:00010000:2.0:1762166977.108991:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc6220e00 already unused, calling callback (ffffffffc18e2310) 00000100:00100000:0.0:1762166977.108991:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449707776 00000004:00010000:3.0:1762166977.108994:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000d536b3b1 reply state 000000007015926d transno 4294991960 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220600/0x2f180c4effbaa6cb lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166977.108997:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaa60e lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00000100:00100000:1.0:1762166977.109008:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449708672:0@lo:2:osp-syn-0-1.0 00010000:00010000:3.0:1762166977.109015:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220600/0x2f180c4effbaa6cb lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166977.109026:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166977.109027:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaa60e lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00000100:00100000:0.0:1762166977.109028:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449707904 00000100:00100000:0.0:1762166977.109032:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449707904 00010000:00010000:3.0:1762166977.109033:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1762166977.109038:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166977.109043:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1762166977.109045:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166977.109049:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166977.109053:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaa60e lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00000100:00100000:0.0:1762166977.109058:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449708160 00010000:00010000:2.0:1762166977.109059:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaa60e lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00000100:00100000:0.0:1762166977.109062:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449708160 00010000:00010000:2.0:1762166977.109078:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaa623 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00000100:00100000:0.0:1762166977.109085:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449708672 00010000:00010000:2.0:1762166977.109086:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaa623 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00000100:00100000:0.0:1762166977.109088:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449708672 00010000:00010000:2.0:1762166977.109097:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaa623 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00000100:00100000:1.0:1762166977.109102:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18909 00010000:00010000:2.0:1762166977.109106:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc6221a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166977.109111:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaa623 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00080000:3.0:1762166977.109117:0:6494:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1762166977.109118:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb387800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+14:3635:x1847765449707776:12345-0@lo:2:osp-syn-0-1.0 00010000:00010000:2.0:1762166977.109120:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaa623 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00000100:00100000:0.0:1762166977.109124:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18910 00000100:00100000:3.0:1762166977.109135:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb386680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+529:61844:x1847765450419328:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 2114us (2198us total) trans 4294991960 rc 0/0 00010000:00010000:2.0:1762166977.109137:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00000100:00100000:0.0:1762166977.109138:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+6:3636:x1847765449707904:12345-0@lo:2:osp-syn-1-1.0 00010000:00010000:2.0:1762166977.109145:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166977.109150:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaa623 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00000100:00100000:3.0:1762166977.109153:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30375 00010000:00010000:2.0:1762166977.109162:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaa623 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166977.109174:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbaa638 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166977.109180:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbaa638 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166977.109186:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbaa638 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166977.109190:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa8c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166977.109193:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbaa638 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166977.109203:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbaa638 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166977.109212:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166977.109215:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166977.109217:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbaa638 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166977.109223:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbaa638 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00002000:00010000:1.0:1762166977.109232:0:28434:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb size from disk: 0 -> 0 00010000:00010000:2.0:1762166977.109234:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbaa64d lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00002000:00010000:1.0:1762166977.109238:0:28434:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb mtime from disk: 1762166966 -> 1762166966 00002000:00010000:1.0:1762166977.109246:0:28434:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb atime from disk: 0 -> 0 00010000:00010000:2.0:1762166977.109248:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbaa64d lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00002000:00010000:1.0:1762166977.109251:0:28434:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb ctime from disk: 1762166966 -> 1762166966 00010000:00010000:2.0:1762166977.109258:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbaa64d lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00002000:00010000:1.0:1762166977.109258:0:28434:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1762166977.109265:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+7:3636:x1847765449707904:12345-0@lo:2:osp-syn-1-1.0 Request processed in 128us (361us total) trans 17179876317 rc 0/0 00010000:00010000:2.0:1762166977.109271:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa9800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166977.109276:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbaa64d lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00000100:00100000:0.0:1762166977.109279:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18910 00010000:00010000:2.0:1762166977.109289:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbaa64d lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166977.109299:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00000100:00100000:1.0:1762166977.109300:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb387800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+15:3635:x1847765449707776:12345-0@lo:2:osp-syn-0-1.0 Request processed in 187us (452us total) trans 21474843263 rc 0/0 00000100:00100000:0.0:1762166977.109304:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18911 00010000:00010000:2.0:1762166977.109307:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166977.109312:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbaa64d lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166977.109313:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220600/0x2f180c4effbaa6cb lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00000100:00100000:0.0:1762166977.109318:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+6:3634:x1847765449708160:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1762166977.109319:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18909 00010000:00010000:2.0:1762166977.109330:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbaa64d lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166977.109333:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220600/0x2f180c4effbaa6cb lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00000100:00100000:1.0:1762166977.109344:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18912 00010000:00010000:3.0:1762166977.109347:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220600/0x2f180c4effbaa6cb lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166977.109355:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc6220600 already unused, calling callback (ffffffffc18e2310) 00000100:00100000:1.0:1762166977.109357:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+14:3634:x1847765449708672:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1762166977.109381:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1762166977.109416:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220600/0x2f180c4effbaa6cb lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00000100:00100000:0.0:1762166977.109425:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+7:3634:x1847765449708160:12345-0@lo:2:osp-syn-1-1.0 Request processed in 109us (456us total) trans 17179876318 rc 0/0 00000004:00080000:2.0:1762166977.109426:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf79ea680/2, rc 0, transno 21474843263 00010000:00010000:3.0:1762166977.109429:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220600/0x2f180c4effbaa6cb lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00000100:00100000:2.0:1762166977.109436:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449707776:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1762166977.109444:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18911 00000100:00100000:1.0:1762166977.109449:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+15:3634:x1847765449708672:12345-0@lo:2:osp-syn-0-1.0 Request processed in 93us (406us total) trans 21474843264 rc 0/0 00010000:00010000:3.0:1762166977.109452:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166977.109459:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166977.109464:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220600/0x2f180c4effbaa6cb lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00000100:00100000:1.0:1762166977.109464:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18912 00000100:00100000:2.0:1762166977.109466:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449708288 00000100:00100000:2.0:1762166977.109472:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449708288 00010000:00010000:3.0:1762166977.109475:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220600/0x2f180c4effbaa6cb lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00000100:00080000:0.0:1762166977.109516:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1762166977.109521:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1762166977.109537:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18913 00000100:00100000:1.0:1762166977.109549:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+7:3635:x1847765449708288:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1762166977.109561:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166977.109576:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449708416 00000100:00100000:0.0:1762166977.109582:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449708416 00000100:00100000:2.0:1762166977.109603:0:3636:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 17179876288 gen 2 00000004:00080000:2.0:1762166977.109609:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf1cd0000, transno 17179876267 00000004:00080000:2.0:1762166977.109618:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf1cd3b80, transno 17179876268 00000004:00080000:2.0:1762166977.109623:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf783e680, transno 17179876269 00000100:00100000:0.0:1762166977.109627:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18914 00000004:00080000:2.0:1762166977.109630:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf1cd2a00, transno 17179876270 00000004:00080000:2.0:1762166977.109635:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf1cd1180, transno 17179876281 00002000:00010000:1.0:1762166977.109639:0:28434:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:0.0:1762166977.109640:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+15:3636:x1847765449708416:12345-0@lo:2:osp-syn-0-1.0 00000004:00080000:2.0:1762166977.109641:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf1cd3800, transno 17179876282 00002000:00010000:1.0:1762166977.109643:0:28434:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00000004:00080000:2.0:1762166977.109648:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf1ddd180, transno 17179876283 00002000:00010000:1.0:1762166977.109649:0:28434:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb atime from disk: 1762166973 -> 1762166973 00000004:00080000:2.0:1762166977.109653:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf1ddc700, transno 17179876284 00002000:00010000:1.0:1762166977.109653:0:28434:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:1.0:1762166977.109655:0:28434:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb blocks from disk: 0 -> 0 00000004:00080000:2.0:1762166977.109659:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc5bbbb80, transno 17179876285 00000004:00080000:2.0:1762166977.109664:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf783fb80, transno 17179876286 00000004:00080000:2.0:1762166977.109668:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc47b6a00, transno 17179876287 00000004:00080000:2.0:1762166977.109672:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bcce75f80, transno 17179876288 00000100:00100000:2.0:1762166977.109681:0:3636:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff945bc5805880 x1847765449707904/t17179876317(17179876317) o2->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 440/432 e 0 to 0 dl 1762166993 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1762166977.109690:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+8:3635:x1847765449708288:12345-0@lo:2:osp-syn-1-1.0 Request processed in 145us (310us total) trans 17179876319 rc 0/0 00000004:00080000:2.0:1762166977.109691:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc5805880/2, rc 0, transno 17179876317 00000100:00100000:1.0:1762166977.109697:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18913 00000100:00100000:2.0:1762166977.109701:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5805880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449707904:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1762166977.109730:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166977.109750:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+16:3636:x1847765449708416:12345-0@lo:2:osp-syn-0-1.0 Request processed in 112us (187us total) trans 21474843265 rc 0/0 00000100:00100000:0.0:1762166977.109758:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18914 00000004:00080000:2.0:1762166977.109764:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf79ea300/2, rc 0, transno 21474843265 00000100:00100000:1.0:1762166977.109765:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1e6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449708544:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1762166977.109776:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449708416:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1762166977.109776:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449708032 00000100:00100000:0.0:1762166977.109782:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449708032 00000100:00100000:1.0:1762166977.109803:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166977.109818:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449708544 00000100:00100000:0.0:1762166977.109823:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449708544 00000004:00080000:2.0:1762166977.109838:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf1e6fb80/2, rc 0, transno 17179876318 00000100:00100000:2.0:1762166977.109845:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1e6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449708160:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1762166977.109847:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf1e6ed80/2, rc 0, transno 17179876319 00000100:00100000:3.0:1762166977.109856:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1e6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449708288:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1762166977.109861:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18915 00000004:00080000:2.0:1762166977.109862:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf79e9880/2, rc 0, transno 21474843264 00000100:00100000:2.0:1762166977.109870:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449708672:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1762166977.109871:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18916 00000100:00100000:1.0:1762166977.109876:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4533480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+16:3633:x1847765449708032:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1762166977.109900:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4531f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+8:3633:x1847765449708544:12345-0@lo:2:osp-syn-1-1.0 00000004:00080000:2.0:1762166977.109938:0:9994:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0001: 0 changes, 5 in progress, 1 in flight, 11 done 00002000:00010000:0.0:1762166977.109974:0:9165:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:1.0:1762166977.109975:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4533480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+17:3633:x1847765449708032:12345-0@lo:2:osp-syn-0-1.0 Request processed in 104us (244us total) trans 21474843266 rc 0/0 00002000:00010000:0.0:1762166977.109980:0:9165:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:0.0:1762166977.109985:0:9165:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00000100:00100000:1.0:1762166977.109988:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18915 00002000:00010000:0.0:1762166977.109990:0:9165:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00000004:00080000:3.0:1762166977.109992:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf79eaa00/2, rc 0, transno 21474843266 00002000:00010000:0.0:1762166977.109996:0:9165:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166977.110003:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449708032:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1762166977.110036:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4531f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+9:3633:x1847765449708544:12345-0@lo:2:osp-syn-1-1.0 Request processed in 154us (233us total) trans 17179876320 rc 0/0 00000004:00080000:2.0:1762166977.110037:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf1e6df80/2, rc 0, transno 17179876320 00000100:00100000:2.0:1762166977.110046:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1e6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449708544:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1762166977.110050:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18916 00000100:00100000:0.0:1762166977.110438:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166977.110500:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450419456 00000100:00100000:3.0:1762166977.110506:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450419456 00000100:00100000:0.0:1762166977.110561:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30376 00000100:00100000:0.0:1762166977.110571:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+525:61844:x1847765450419456:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166977.110585:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166977.110599:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbaa6d2 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9b0e expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.110639:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbaa6d2 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b0e expref: 526 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.110650:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbaa6d2 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b0e expref: 526 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.110662:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166977.110664:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166977.110665:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdfc00, rc 0) 00000100:00100000:0.0:1762166977.110693:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+526:61844:x1847765450419456:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 125us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166977.110698:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30376 00000100:00100000:3.0:1762166977.112049:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.112096:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450419584 00000100:00100000:0.0:1762166977.112102:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450419584 00000100:00100000:0.0:1762166977.112133:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30377 00000100:00100000:0.0:1762166977.112140:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb384380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+526:61844:x1847765450419584:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166977.112149:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166977.112158:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbaa6d9 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9b15 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.112220:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbaa6e0 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166977.112231:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbaa6e0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.112243:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbaa6e0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:0.0:1762166977.112265:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 177340 00000004:00200000:0.0:1762166977.112269:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166977.112285:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbaa6e0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.112300:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbaa6d9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b15 expref: 528 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.112309:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbaa6e0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b15 expref: 527 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.112314:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166977.112316:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166977.112318:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdea00, rc 0) 00000100:00100000:0.0:1762166977.112344:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb384380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+527:61844:x1847765450419584:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 205us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166977.112348:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30377 00000100:00100000:3.0:1762166977.113440:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.113507:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450419712 00000100:00100000:0.0:1762166977.113512:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450419712 00000100:00100000:0.0:1762166977.113544:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18917 00000100:00100000:0.0:1762166977.113553:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb387480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+16:2418:x1847765450419712:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166977.113562:0:9165:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166977.113574:0:9165:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbaa6e7 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9b1c expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166977.113594:0:9165:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa77:0x0] initial LVB size: 177340, mtime: 0x690888c1, atime: 0x690888c1, ctime: 0x690888c1, blocks: 0x158 00010000:00010000:0.0:1762166977.113608:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166977.113610:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166977.113617:0:9165:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbaa6e7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b1c expref: 17 pid: 9165 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166977.113629:0:9165:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbaa6e7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b1c expref: 17 pid: 9165 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166977.113638:0:9165:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdee00, rc 0) 00000100:00100000:0.0:1762166977.113671:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb387480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450419712:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 120us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166977.113679:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18917 00000100:00100000:3.0:1762166977.113686:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.113709:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450419968 00000100:00100000:0.0:1762166977.113714:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450419968 00000100:00100000:0.0:1762166977.113742:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18918 00000100:00100000:0.0:1762166977.113750:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb385500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450419968:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166977.113758:0:9165:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166977.113767:0:9165:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde800/0x2f180c4effbaa6ee lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9b2a expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166977.113779:0:9165:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa79:0x0] initial LVB size: 0, mtime: 0x690888c1, atime: 0x690888c0, ctime: 0x690888c1, blocks: 0x0 00010000:00010000:0.0:1762166977.113788:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166977.113792:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1762166977.113793:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:0.0:1762166977.113799:0:9165:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde800/0x2f180c4effbaa6ee lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b2a expref: 18 pid: 9165 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166977.113810:0:9165:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde800/0x2f180c4effbaa6ee lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b2a expref: 18 pid: 9165 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166977.113818:0:9165:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bde800, rc 0) 00000100:00100000:0.0:1762166977.113848:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb385500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450419968:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 99us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166977.113851:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450419840 00000100:00100000:2.0:1762166977.113858:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450419840 00000100:00100000:0.0:1762166977.113859:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18918 00000100:00100000:2.0:1762166977.113911:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18919 00000100:00100000:2.0:1762166977.113922:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb384a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765450419840:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166977.113931:0:8380:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166977.113944:0:8380:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8e00/0x2f180c4effbaa6f5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9b23 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166977.113959:0:8380:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa7a:0x0] initial LVB size: 0, mtime: 0x690888c1, atime: 0x690888c0, ctime: 0x690888c1, blocks: 0x1800 00010000:00010000:2.0:1762166977.113969:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166977.113971:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166977.113977:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8e00/0x2f180c4effbaa6f5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b23 expref: 24 pid: 8380 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166977.113995:0:8380:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8e00/0x2f180c4effbaa6f5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b23 expref: 24 pid: 8380 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166977.114004:0:8380:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa8e00, rc 0) 00000100:00100000:2.0:1762166977.114036:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb384a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+24:2418:x1847765450419840:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 116us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166977.114058:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18919 00000100:00100000:3.0:1762166977.147860:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.147928:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450420096 00000100:00100000:2.0:1762166977.147937:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450420096 00000100:00100000:2.0:1762166977.147981:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18920 00000100:00100000:2.0:1762166977.147988:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb385880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+18:2416:x1847765450420096:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:2.0:1762166977.148077:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb385880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+18:2416:x1847765450420096:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 90us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166977.148082:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18920 00000100:00100000:1.0:1762166977.149559:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.149598:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450420224 00000100:00100000:2.0:1762166977.149604:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450420224 00000100:00100000:2.0:1762166977.149635:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18921 00000100:00100000:2.0:1762166977.149641:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+18:2417:x1847765450420224:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:2.0:1762166977.149699:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+18:2417:x1847765450420224:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 57us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166977.149706:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18921 00000100:00100000:1.0:1762166977.151013:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166977.151053:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450420352 00000100:00100000:3.0:1762166977.151058:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450420352 00000100:00100000:3.0:1762166977.151096:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2181 00000100:00100000:3.0:1762166977.151104:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+18:2416:x1847765450420352:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:3.0:1762166977.151129:0:23943:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8472a00/0x2f180c4effbaa6fc lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.151141:0:23943:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166977.151144:0:23943:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166977.151148:0:23943:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472a00/0x2f180c4effbaa6fc lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->106495] (req 0->106495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.151160:0:23943:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8472a00/0x2f180c4effbaa6fc lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->106495] (req 0->106495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.152237:0:23943:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8472a00/0x2f180c4effbaa6fc lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->106495] (req 0->106495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.152248:0:23943:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472a00/0x2f180c4effbaa6fc lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->106495] (req 0->106495) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.152257:0:23943:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc8472a00/0x2f180c4effbaa6fc lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->106495] (req 0->106495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.152265:0:23943:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8472a00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166977.152269:0:23943:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8472a00/0x2f180c4effbaa6fc lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->106495] (req 0->106495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.152277:0:23943:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8472a00/0x2f180c4effbaa6fc lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->106495] (req 0->106495) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.152290:0:23943:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc8472a00/0x2f180c4effbaa6fc lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->106495] (req 0->106495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.152297:0:23943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8472a00/0x2f180c4effbaa6fc lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->106495] (req 0->106495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166977.152349:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+18:2416:x1847765450420352:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 1246us (1336us total) trans 0 rc 106496/106496 00000100:00100000:1.0:1762166977.152357:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2181 00000100:00100000:1.0:1762166977.153718:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166977.153779:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450420480 00000100:00100000:3.0:1762166977.153791:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450420480 00000100:00100000:3.0:1762166977.153859:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2182 00000100:00100000:3.0:1762166977.153873:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+24:2417:x1847765450420480:12345-192.168.204.38@tcp:4:lfs.0 00002000:00010000:3.0:1762166977.153934:0:23943:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa86:0x0] initial LVB size: 244188, mtime: 0x690888c1, atime: 0x690888bd, ctime: 0x690888c1, blocks: 0xe8 00010000:00010000:3.0:1762166977.153944:0:23943:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effbaa703 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.153956:0:23943:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166977.153958:0:23943:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166977.153963:0:23943:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effbaa703 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->106495] (req 0->106495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.153975:0:23943:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effbaa703 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->106495] (req 0->106495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00000001:00080000:3.0:1762166977.156321:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843267 is committed 00000001:00080000:3.0:1762166977.156338:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843266 is committed 00002000:00010000:1.0:1762166977.156448:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb blocks from disk: 232 -> 408 00010000:00010000:1.0:1762166977.156460:0:23943:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effbaa703 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->106495] (req 0->106495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.156475:0:23943:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effbaa703 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->106495] (req 0->106495) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.156506:0:23943:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effbaa703 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->106495] (req 0->106495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.156512:0:23943:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8473600 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166977.156516:0:23943:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effbaa703 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->106495] (req 0->106495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.156521:0:23943:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effbaa703 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->106495] (req 0->106495) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.156535:0:23943:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effbaa703 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->106495] (req 0->106495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.156540:0:23943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effbaa703 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->106495] (req 0->106495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166977.156605:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+14:2417:x1847765450420480:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 2735us (2884us total) trans 21474843267 rc 0/0 00000100:00100000:1.0:1762166977.156613:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2182 00000100:00100000:2.0:1762166977.158156:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.158191:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450420608 00000100:00100000:1.0:1762166977.158199:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450420608 00000100:00100000:1.0:1762166977.158249:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2183 00000100:00100000:1.0:1762166977.158256:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+14:2418:x1847765450420608:12345-192.168.204.38@tcp:4:lfs.0 00002000:00010000:1.0:1762166977.158286:0:23943:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa88:0x0] initial LVB size: 244188, mtime: 0x690888c1, atime: 0x690888bf, ctime: 0x690888c1, blocks: 0xe8 00010000:00010000:1.0:1762166977.158292:0:23943:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc6221800/0x2f180c4effbaa70a lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.158301:0:23943:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166977.158303:0:23943:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166977.158307:0:23943:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc6221800/0x2f180c4effbaa70a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->106495] (req 0->106495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.158316:0:23943:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc6221800/0x2f180c4effbaa70a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->106495] (req 0->106495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00000001:00080000:3.0:1762166977.160080:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843268 is committed 00002000:00010000:1.0:1762166977.160128:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb blocks from disk: 232 -> 408 00010000:00010000:1.0:1762166977.160136:0:23943:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc6221800/0x2f180c4effbaa70a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->106495] (req 0->106495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.160143:0:23943:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc6221800/0x2f180c4effbaa70a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->106495] (req 0->106495) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.160148:0:23943:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc6221800/0x2f180c4effbaa70a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->106495] (req 0->106495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.160152:0:23943:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc6221800 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166977.160155:0:23943:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc6221800/0x2f180c4effbaa70a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->106495] (req 0->106495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.160160:0:23943:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc6221800/0x2f180c4effbaa70a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->106495] (req 0->106495) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.160169:0:23943:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc6221800/0x2f180c4effbaa70a lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->106495] (req 0->106495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.160178:0:23943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc6221800/0x2f180c4effbaa70a lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->106495] (req 0->106495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166977.160230:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+14:2418:x1847765450420608:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 1972us (2075us total) trans 21474843268 rc 0/0 00000100:00100000:1.0:1762166977.160239:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2183 00000100:00100000:3.0:1762166977.161608:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.161647:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450420736 00000100:00100000:2.0:1762166977.161654:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450420736 00000100:00100000:2.0:1762166977.161691:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18922 00000100:00100000:2.0:1762166977.161702:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb384e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+18:2417:x1847765450420736:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:2.0:1762166977.161800:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb384e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+18:2417:x1847765450420736:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 103us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166977.161805:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18922 00000100:00100000:2.0:1762166977.162806:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.162841:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450420864 00000100:00100000:1.0:1762166977.162845:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450420864 00000100:00100000:1.0:1762166977.162871:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18923 00000100:00100000:1.0:1762166977.162876:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4012680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450420864:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:1.0:1762166977.162937:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4012680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450420864:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 60us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166977.162942:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18923 00000100:00100000:3.0:1762166977.163899:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.163964:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450421120 00000100:00100000:0.0:1762166977.163975:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450421120 00000100:00100000:0.0:1762166977.164037:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30378 00000100:00100000:0.0:1762166977.164052:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7d22450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+527:61844:x1847765450421120:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:0.0:1762166977.164105:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166977.164131:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbaa6e0 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b15 expref: 527 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.164154:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166977.164157:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166977.164301:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbaa711 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166977.164311:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbaa711 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.164317:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbaa711 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000001:00080000:0.0:1762166977.164351:0:6495:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294991961 00000004:00010000:0.0:1762166977.164369:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000014b2ac2f reply state 000000003361b42f transno 4294991962 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbaa711 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.164377:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbaa711 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.164381:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166977.164383:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762166977.164384:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166977.164458:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7d22450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+529:61844:x1847765450421120:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 412us (560us total) trans 4294991962 rc 0/0 00000100:00100000:0.0:1762166977.164463:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30378 00000020:00080000:0.0:1762166977.164468:0:6495:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1762166977.165269:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.165309:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450421248 00000100:00100000:1.0:1762166977.165316:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450421248 00000100:00100000:1.0:1762166977.165347:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18924 00000100:00100000:1.0:1762166977.165353:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb384700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+14:61844:x1847765450421248:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166977.165365:0:8380:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166977.165381:0:8380:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc6220600/0x2f180c4effbaa718 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9b31 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762166977.165399:0:8380:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa86:0x0] initial LVB size: 244188, mtime: 0x690888c1, atime: 0x690888bd, ctime: 0x690888c1, blocks: 0x198 00010000:00010000:1.0:1762166977.165413:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166977.165414:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166977.165420:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc6220600/0x2f180c4effbaa718 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b31 expref: 15 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.165437:0:8380:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc6220600/0x2f180c4effbaa718 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b31 expref: 15 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.165450:0:8380:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc6220600, rc 0) 00000100:00100000:1.0:1762166977.165518:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb384700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+15:61844:x1847765450421248:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 164us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166977.165526:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18924 00000100:00100000:2.0:1762166977.166400:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.166437:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.166452:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450421376 00000100:00100000:1.0:1762166977.166457:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450421376 00000100:00100000:0.0:1762166977.166529:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450421504 00002000:00010000:1.0:1762166977.166539:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2694 (106496->18446744073709551615) 00000100:00100000:0.0:1762166977.166540:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450421504 00002000:00100000:1.0:1762166977.166548:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4011180 with x1847765450421376 ext(106496->18446744073709551615) 00002000:00010000:1.0:1762166977.166556:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc4011180. 00002000:00010000:0.0:1762166977.166568:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2693 (0->18446744073709551615) 00002000:00100000:0.0:1762166977.166572:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4010380 with x1847765450421504 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166977.166582:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4010380. 00000100:00100000:1.0:1762166977.166590:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2184 00000100:00100000:1.0:1762166977.166604:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4011180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+15:2419:x1847765450421376:12345-192.168.204.38@tcp:10:lfs.0 00000100:00100000:3.0:1762166977.166627:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2185 00000100:00100000:3.0:1762166977.166644:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4010380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450421504:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:3.0:1762166977.166761:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166977.166765:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:3.0:1762166977.166768:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb atime from disk: 1762166973 -> 1762166973 00002000:00010000:3.0:1762166977.166771:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:3.0:1762166977.166773:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166977.166820:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4010380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450421504:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 182us (382us total) trans 17179876321 rc 0/0 00000100:00100000:3.0:1762166977.166828:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2185 00002000:00010000:3.0:1762166977.166831:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2693 (0->18446744073709551615) 00002000:00100000:3.0:1762166977.166834:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4010380 with x1847765450421504 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166977.166839:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4010380. 00002000:00010000:1.0:1762166977.166925:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb size from disk: 244188 -> 106496 00002000:00010000:1.0:1762166977.166928:0:23943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:1.0:1762166977.166930:0:23943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb atime from disk: 1762166973 -> 1762166973 00002000:00010000:1.0:1762166977.166932:0:23943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:1.0:1762166977.166933:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb blocks from disk: 408 -> 216 00000100:00100000:1.0:1762166977.166956:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4011180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+16:2419:x1847765450421376:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 359us (559us total) trans 21474843269 rc 0/0 00000100:00100000:1.0:1762166977.166961:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2184 00002000:00010000:1.0:1762166977.166964:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2694 (106496->18446744073709551615) 00002000:00100000:1.0:1762166977.166966:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4011180 with x1847765450421376 ext(106496->18446744073709551615) 00002000:00010000:1.0:1762166977.166970:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc4011180. 00000100:00100000:2.0:1762166977.167828:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.167860:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450421632 00000100:00100000:0.0:1762166977.167866:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450421632 00000100:00100000:0.0:1762166977.167907:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30379 00000100:00100000:0.0:1762166977.167914:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4012d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+529:61844:x1847765450421632:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166977.167928:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166977.167941:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbaa71f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9b38 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.168011:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbaa726 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166977.168022:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbaa726 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.168029:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbaa726 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:0.0:1762166977.168053:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 106496 00000004:00200000:0.0:1762166977.168057:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166977.168070:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbaa726 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.168090:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbaa71f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b38 expref: 531 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.168101:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbaa726 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b38 expref: 530 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.168106:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166977.168108:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166977.168110:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdf400, rc 0) 00000100:00100000:0.0:1762166977.168140:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4012d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+530:61844:x1847765450421632:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 227us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166977.168147:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30379 00000100:00100000:3.0:1762166977.169239:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.169278:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450421888 00000100:00100000:0.0:1762166977.169282:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450421888 00000100:00100000:0.0:1762166977.169307:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30380 00000100:00100000:0.0:1762166977.169313:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb386300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+530:61844:x1847765450421888:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:0.0:1762166977.169339:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166977.169351:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbaa726 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b38 expref: 530 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.169360:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166977.169362:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166977.169500:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbaa72d lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166977.169508:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbaa72d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.169514:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbaa72d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000001:00080000:0.0:1762166977.169546:0:6495:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294991963 00000004:00010000:0.0:1762166977.169563:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000c9375fe3 reply state 0000000045573216 transno 4294991964 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbaa72d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.169571:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbaa72d lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.169576:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166977.169577:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762166977.169580:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166977.169620:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb386300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+532:61844:x1847765450421888:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 308us (383us total) trans 4294991964 rc 0/0 00000100:00100000:0.0:1762166977.169629:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30380 00000020:00080000:0.0:1762166977.169633:0:6495:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1762166977.170265:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.170311:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450422016 00000100:00100000:1.0:1762166977.170315:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450422016 00000100:00100000:1.0:1762166977.170340:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18925 00000100:00100000:1.0:1762166977.170345:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb385c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+16:61844:x1847765450422016:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166977.170353:0:8380:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166977.170364:0:8380:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc6221800/0x2f180c4effbaa734 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9b3f expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762166977.170377:0:8380:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa88:0x0] initial LVB size: 244188, mtime: 0x690888c1, atime: 0x690888bf, ctime: 0x690888c1, blocks: 0x198 00010000:00010000:1.0:1762166977.170386:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166977.170388:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166977.170393:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc6221800/0x2f180c4effbaa734 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b3f expref: 17 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.170402:0:8380:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc6221800/0x2f180c4effbaa734 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b3f expref: 17 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.170409:0:8380:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc6221800, rc 0) 00000100:00100000:1.0:1762166977.170433:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb385c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+17:61844:x1847765450422016:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 89us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166977.170438:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18925 00000100:00100000:2.0:1762166977.171208:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.171231:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.171251:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450422144 00000100:00100000:1.0:1762166977.171256:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450422144 00002000:00010000:1.0:1762166977.171272:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2696 (106496->18446744073709551615) 00002000:00100000:1.0:1762166977.171276:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4011c00 with x1847765450422144 ext(106496->18446744073709551615) 00000100:00100000:3.0:1762166977.171280:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450422272 00002000:00010000:1.0:1762166977.171282:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc4011c00. 00000100:00100000:3.0:1762166977.171287:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450422272 00000100:00100000:1.0:1762166977.171302:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2186 00002000:00010000:3.0:1762166977.171309:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2695 (0->18446744073709551615) 00000100:00100000:1.0:1762166977.171312:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4011c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450422144:12345-192.168.204.38@tcp:10:lfs.0 00002000:00100000:3.0:1762166977.171314:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4011880 with x1847765450422272 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166977.171322:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4011880. 00000100:00100000:3.0:1762166977.171343:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2187 00000100:00100000:3.0:1762166977.171351:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4011880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450422272:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:3.0:1762166977.171427:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166977.171430:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:3.0:1762166977.171433:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166977.171435:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:3.0:1762166977.171437:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166977.171467:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4011880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450422272:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 118us (235us total) trans 17179876322 rc 0/0 00000100:00100000:3.0:1762166977.171472:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2187 00002000:00010000:3.0:1762166977.171474:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2695 (0->18446744073709551615) 00002000:00100000:3.0:1762166977.171492:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4011880 with x1847765450422272 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166977.171496:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4011880. 00002000:00010000:1.0:1762166977.171659:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb size from disk: 244188 -> 106496 00002000:00010000:1.0:1762166977.171663:0:23943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:1.0:1762166977.171666:0:23943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00002000:00010000:1.0:1762166977.171668:0:23943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:1.0:1762166977.171670:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb blocks from disk: 408 -> 216 00000100:00100000:1.0:1762166977.171702:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4011c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450422144:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 393us (494us total) trans 21474843270 rc 0/0 00000100:00100000:1.0:1762166977.171710:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2186 00002000:00010000:1.0:1762166977.171713:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2696 (106496->18446744073709551615) 00002000:00100000:1.0:1762166977.171715:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4011c00 with x1847765450422144 ext(106496->18446744073709551615) 00002000:00010000:1.0:1762166977.171719:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc4011c00. 00000100:00100000:2.0:1762166977.172528:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.172559:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450422400 00000100:00100000:0.0:1762166977.172564:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450422400 00000100:00100000:0.0:1762166977.172589:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30381 00000100:00100000:0.0:1762166977.172594:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4013b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+532:61844:x1847765450422400:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166977.172607:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166977.172617:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbaa73b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9b46 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.172672:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbaa742 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166977.172681:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbaa742 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.172687:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbaa742 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:0.0:1762166977.172701:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 106496 00000004:00200000:0.0:1762166977.172704:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166977.172713:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbaa742 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.172729:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbaa73b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b46 expref: 534 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.172739:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbaa742 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b46 expref: 533 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.172748:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166977.172750:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166977.172752:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdfe00, rc 0) 00000100:00100000:0.0:1762166977.172780:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4013b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+533:61844:x1847765450422400:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 185us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166977.172786:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30381 00000100:00100000:3.0:1762166977.174054:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.174098:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450422528 00000100:00100000:1.0:1762166977.174102:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450422528 00000100:00100000:1.0:1762166977.174134:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2188 00000100:00100000:1.0:1762166977.174140:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb384000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450422528:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:1.0:1762166977.174160:0:23943:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaa749 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.174169:0:23943:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166977.174170:0:23943:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166977.174173:0:23943:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaa749 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [122880->151551] (req 122880->151551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.174181:0:23943:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaa749 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [122880->151551] (req 122880->151551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.174904:0:23943:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaa749 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [122880->151551] (req 122880->151551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.174915:0:23943:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaa749 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [122880->151551] (req 122880->151551) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.174922:0:23943:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaa749 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [122880->151551] (req 122880->151551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.174929:0:23943:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc6221a00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166977.174934:0:23943:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaa749 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [122880->151551] (req 122880->151551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.174942:0:23943:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaa749 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [122880->151551] (req 122880->151551) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.174957:0:23943:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaa749 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [122880->151551] (req 122880->151551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.174964:0:23943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaa749 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [122880->151551] (req 122880->151551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166977.175007:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb384000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450422528:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 865us (954us total) trans 0 rc 28672/28672 00000100:00100000:1.0:1762166977.175015:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2188 00000100:00100000:2.0:1762166977.176178:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.176228:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450422656 00000100:00100000:1.0:1762166977.176235:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450422656 00000100:00100000:1.0:1762166977.176281:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2189 00000100:00100000:1.0:1762166977.176290:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4010e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450422656:12345-192.168.204.38@tcp:4:lfs.0 00010000:00010000:1.0:1762166977.176317:0:23943:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc6220e00/0x2f180c4effbaa750 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.176332:0:23943:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc6220600/0x2f180c4effbaa718 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b31 expref: 18 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.176340:0:23943:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166977.176342:0:23943:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166977.176345:0:23943:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc6220e00/0x2f180c4effbaa750 lrc: 4/0,1 mode: --/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [122880->151551] (req 122880->151551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.176382:0:23943:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc6220600/0x2f180c4effbaa718 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b31 expref: 18 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.176395:0:23943:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc6220600/0x2f180c4effbaa718 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b31 expref: 18 pid: 8380 timeout: 696 lvb_type: 0 00000100:00100000:1.0:1762166977.176407:0:23943:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcce75180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_010:lustre-OST0000_UUID:23943:1847765449708800:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166977.176495:0:23943:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011c7900 going to sleep for 11 seconds 00000100:00100000:1.0:1762166977.177336:0:23943:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcce75180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_010:lustre-OST0000_UUID:23943:1847765449708800:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166977.177360:0:23943:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bc6220e00/0x2f180c4effbaa750 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [122880->151551] (req 122880->151551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166977.177550:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166977.177632:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450422784 00000100:00100000:3.0:1762166977.177639:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450422784 00010000:00010000:3.0:1762166977.177661:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc6220600/0x2f180c4effbaa718 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b31 expref: 19 pid: 8380 timeout: 696 lvb_type: 0 00000100:00100000:3.0:1762166977.177691:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9544 00000100:00100000:3.0:1762166977.177700:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4010a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450422784:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166977.177713:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166977.177733:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc6220600/0x2f180c4effbaa718 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b31 expref: 19 pid: 8380 timeout: 696 lvb_type: 0 00010000:00010000:3.0:1762166977.177743:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc6220600/0x2f180c4effbaa718 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b31 expref: 19 pid: 8380 timeout: 696 lvb_type: 0 00010000:00010000:3.0:1762166977.177761:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc6220600/0x2f180c4effbaa718 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b31 expref: 19 pid: 8380 timeout: 696 lvb_type: 0 00010000:00010000:3.0:1762166977.177771:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166977.177773:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166977.177775:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc6220e00/0x2f180c4effbaa750 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [122880->151551] (req 122880->151551) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.177782:0:7421:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc6220e00/0x2f180c4effbaa750 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [122880->151551] (req 122880->151551) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.177810:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166977.177832:0:23943:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bc6220e00/0x2f180c4effbaa750 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [122880->151551] (req 122880->151551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.177849:0:23943:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc6220e00/0x2f180c4effbaa750 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [122880->151551] (req 122880->151551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166977.177851:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4010a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450422784:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 151us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166977.177868:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9544 00000001:00080000:3.0:1762166977.179923:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843271 is committed 00002000:00010000:1.0:1762166977.180005:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb size from disk: 106496 -> 151552 00002000:00010000:1.0:1762166977.180010:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb blocks from disk: 216 -> 272 00010000:00010000:1.0:1762166977.180021:0:23943:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc6220e00/0x2f180c4effbaa750 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [122880->151551] (req 122880->151551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.180031:0:23943:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc6220e00/0x2f180c4effbaa750 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [122880->151551] (req 122880->151551) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.180039:0:23943:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc6220e00/0x2f180c4effbaa750 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [122880->151551] (req 122880->151551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.180046:0:23943:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc6220e00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166977.180050:0:23943:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc6220e00/0x2f180c4effbaa750 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [122880->151551] (req 122880->151551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.180064:0:23943:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc6220e00/0x2f180c4effbaa750 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [122880->151551] (req 122880->151551) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.180080:0:23943:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc6220e00/0x2f180c4effbaa750 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [122880->151551] (req 122880->151551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.180087:0:23943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc6220e00/0x2f180c4effbaa750 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [122880->151551] (req 122880->151551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166977.180173:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4010e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+15:2419:x1847765450422656:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 3879us (3992us total) trans 21474843271 rc 0/0 00000100:00100000:1.0:1762166977.180185:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2189 00000100:00100000:3.0:1762166977.181673:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.181732:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450422912 00000100:00100000:1.0:1762166977.181743:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450422912 00000100:00100000:1.0:1762166977.181817:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2190 00000100:00100000:1.0:1762166977.181827:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb387b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+15:2417:x1847765450422912:12345-192.168.204.38@tcp:4:lfs.0 00010000:00010000:1.0:1762166977.181857:0:23943:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc6221a00/0x2f180c4effbaa757 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.181873:0:23943:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc6221800/0x2f180c4effbaa734 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b3f expref: 15 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.181881:0:23943:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166977.181896:0:23943:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166977.181899:0:23943:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc6221a00/0x2f180c4effbaa757 lrc: 4/0,1 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [122880->151551] (req 122880->151551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.181934:0:23943:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc6221800/0x2f180c4effbaa734 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b3f expref: 15 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.181947:0:23943:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc6221800/0x2f180c4effbaa734 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b3f expref: 15 pid: 8380 timeout: 696 lvb_type: 0 00000100:00100000:1.0:1762166977.181961:0:23943:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcce75180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_010:lustre-OST0000_UUID:23943:1847765449708928:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166977.182031:0:23943:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011c7900 going to sleep for 11 seconds 00000100:00100000:1.0:1762166977.183035:0:23943:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcce75180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_010:lustre-OST0000_UUID:23943:1847765449708928:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166977.183053:0:23943:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bc6221a00/0x2f180c4effbaa757 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [122880->151551] (req 122880->151551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166977.183207:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.183262:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450423040 00000100:00100000:2.0:1762166977.183268:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450423040 00010000:00010000:2.0:1762166977.183294:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc6221800/0x2f180c4effbaa734 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b3f expref: 16 pid: 8380 timeout: 696 lvb_type: 0 00000100:00100000:2.0:1762166977.183327:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9545 00000100:00100000:2.0:1762166977.183337:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf9d1e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+16:2419:x1847765450423040:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166977.183351:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166977.183370:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc6221800/0x2f180c4effbaa734 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b3f expref: 16 pid: 8380 timeout: 696 lvb_type: 0 00010000:00010000:2.0:1762166977.183392:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc6221800/0x2f180c4effbaa734 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b3f expref: 16 pid: 8380 timeout: 696 lvb_type: 0 00010000:00010000:2.0:1762166977.183413:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc6221800/0x2f180c4effbaa734 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b3f expref: 16 pid: 8380 timeout: 696 lvb_type: 0 00010000:00010000:2.0:1762166977.183425:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166977.183427:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166977.183431:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc6221a00/0x2f180c4effbaa757 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [122880->151551] (req 122880->151551) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.183446:0:7421:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc6221a00/0x2f180c4effbaa757 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [122880->151551] (req 122880->151551) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.183472:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166977.183520:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf9d1e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+15:2419:x1847765450423040:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 186us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166977.183526:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9545 00010000:00010000:1.0:1762166977.183606:0:23943:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bc6221a00/0x2f180c4effbaa757 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [122880->151551] (req 122880->151551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.183616:0:23943:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc6221a00/0x2f180c4effbaa757 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [122880->151551] (req 122880->151551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00000001:00080000:3.0:1762166977.185799:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843272 is committed 00002000:00010000:1.0:1762166977.185899:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb size from disk: 106496 -> 151552 00002000:00010000:1.0:1762166977.185905:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb blocks from disk: 216 -> 272 00010000:00010000:1.0:1762166977.185916:0:23943:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc6221a00/0x2f180c4effbaa757 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [122880->151551] (req 122880->151551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.185926:0:23943:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc6221a00/0x2f180c4effbaa757 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [122880->151551] (req 122880->151551) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.185935:0:23943:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc6221a00/0x2f180c4effbaa757 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [122880->151551] (req 122880->151551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.185943:0:23943:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc6221a00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166977.185948:0:23943:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc6221a00/0x2f180c4effbaa757 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [122880->151551] (req 122880->151551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.185957:0:23943:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc6221a00/0x2f180c4effbaa757 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [122880->151551] (req 122880->151551) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.185974:0:23943:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc6221a00/0x2f180c4effbaa757 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [122880->151551] (req 122880->151551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.185982:0:23943:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc6221a00/0x2f180c4effbaa757 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [122880->151551] (req 122880->151551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23943 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166977.186064:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb387b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+14:2417:x1847765450422912:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 4236us (4397us total) trans 21474843272 rc 0/0 00000100:00100000:1.0:1762166977.186075:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2190 00000100:00100000:0.0:1762166977.187411:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.187454:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450423168 00000100:00100000:1.0:1762166977.187462:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450423168 00000100:00100000:1.0:1762166977.187521:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18926 00000100:00100000:1.0:1762166977.187528:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+20:2416:x1847765450423168:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:1.0:1762166977.187623:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+20:2416:x1847765450423168:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 96us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166977.187628:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18926 00000100:00100000:3.0:1762166977.188988:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.189038:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450423424 00000100:00100000:0.0:1762166977.189043:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450423424 00000100:00100000:0.0:1762166977.189089:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30382 00000100:00100000:0.0:1762166977.189099:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb386a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+533:61844:x1847765450423424:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:0.0:1762166977.189156:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166977.189182:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbaa742 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b46 expref: 533 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.189196:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166977.189200:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166977.189355:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbaa75e lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166977.189367:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbaa75e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.189374:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbaa75e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000001:00080000:0.0:1762166977.189410:0:6495:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294991965 00000004:00010000:0.0:1762166977.189434:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000fc2c5c8c reply state 0000000058f1a828 transno 4294991966 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbaa75e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.189447:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbaa75e lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.189453:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166977.189456:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762166977.189459:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166977.189568:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb386a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+535:61844:x1847765450423424:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 470us (582us total) trans 4294991966 rc 0/0 00000100:00100000:0.0:1762166977.189577:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30382 00000020:00080000:0.0:1762166977.189583:0:6495:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1762166977.190348:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.190384:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450423552 00000100:00100000:1.0:1762166977.190390:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450423552 00000100:00100000:1.0:1762166977.190425:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18927 00000100:00100000:1.0:1762166977.190433:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb387100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+14:61844:x1847765450423552:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166977.190446:0:8380:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166977.190461:0:8380:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc6220e00/0x2f180c4effbaa765 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9b4d expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762166977.190506:0:8380:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa86:0x0] initial LVB size: 151552, mtime: 0x690888c1, atime: 0x690888bd, ctime: 0x690888c1, blocks: 0x110 00010000:00010000:1.0:1762166977.190527:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166977.190530:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166977.190537:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc6220e00/0x2f180c4effbaa765 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b4d expref: 15 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.190554:0:8380:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc6220e00/0x2f180c4effbaa765 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b4d expref: 15 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.190566:0:8380:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc6220e00, rc 0) 00000100:00100000:1.0:1762166977.190599:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb387100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+15:61844:x1847765450423552:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 168us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166977.190605:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18927 00000100:00100000:3.0:1762166977.191432:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.191505:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450423680 00000100:00100000:1.0:1762166977.191511:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450423680 00002000:00010000:1.0:1762166977.191539:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2694 (151552->18446744073709551615) 00002000:00100000:1.0:1762166977.191544:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bcb386d80 with x1847765450423680 ext(151552->18446744073709551615) 00002000:00010000:1.0:1762166977.191553:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bcb386d80. 00000100:00100000:3.0:1762166977.191554:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.191594:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450423808 00000100:00100000:1.0:1762166977.191600:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2191 00000100:00100000:0.0:1762166977.191602:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450423808 00000100:00100000:1.0:1762166977.191613:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb386d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+15:2416:x1847765450423680:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:0.0:1762166977.191627:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2693 (0->18446744073709551615) 00002000:00100000:0.0:1762166977.191633:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bcb386680 with x1847765450423808 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166977.191642:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bcb386680. 00000100:00100000:0.0:1762166977.191671:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2192 00000100:00100000:0.0:1762166977.191685:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb386680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:2417:x1847765450423808:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:1.0:1762166977.191763:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb size from disk: 151552 -> 151552 00002000:00010000:1.0:1762166977.191768:0:23943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:1.0:1762166977.191770:0:23943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb atime from disk: 1762166973 -> 1762166973 00002000:00010000:1.0:1762166977.191773:0:23943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:1.0:1762166977.191776:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb blocks from disk: 272 -> 272 00002000:00010000:0.0:1762166977.191787:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166977.191791:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:0.0:1762166977.191795:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb atime from disk: 1762166973 -> 1762166973 00002000:00010000:0.0:1762166977.191798:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:0.0:1762166977.191800:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1762166977.191817:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb386d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+16:2416:x1847765450423680:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 208us (384us total) trans 21474843273 rc 0/0 00000100:00100000:1.0:1762166977.191826:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2191 00002000:00010000:1.0:1762166977.191831:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2694 (151552->18446744073709551615) 00000100:00100000:0.0:1762166977.191834:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb386680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:2417:x1847765450423808:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 152us (278us total) trans 17179876323 rc 0/0 00002000:00100000:1.0:1762166977.191836:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bcb386d80 with x1847765450423680 ext(151552->18446744073709551615) 00002000:00010000:1.0:1762166977.191846:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bcb386d80. 00000100:00100000:0.0:1762166977.191850:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2192 00002000:00010000:0.0:1762166977.191855:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2693 (0->18446744073709551615) 00002000:00100000:0.0:1762166977.191860:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bcb386680 with x1847765450423808 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166977.191866:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bcb386680. 00000100:00100000:3.0:1762166977.192681:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.192716:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450423936 00000100:00100000:0.0:1762166977.192721:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450423936 00000100:00100000:0.0:1762166977.192755:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30383 00000100:00100000:0.0:1762166977.192764:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb384380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+535:61844:x1847765450423936:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166977.192780:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166977.192795:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbaa76c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9b54 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.192872:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbaa773 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166977.192898:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbaa773 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.192909:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbaa773 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:0.0:1762166977.192933:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 151552 00000004:00200000:0.0:1762166977.192938:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166977.192954:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbaa773 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.192977:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbaa76c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b54 expref: 537 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.192993:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbaa773 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b54 expref: 536 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.193000:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166977.193004:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166977.193007:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bde000, rc 0) 00000100:00100000:0.0:1762166977.193040:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb384380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+536:61844:x1847765450423936:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 277us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166977.193047:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30383 00000100:00100000:3.0:1762166977.194178:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.194213:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450424192 00000100:00100000:0.0:1762166977.194219:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450424192 00000100:00100000:0.0:1762166977.194255:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30384 00000100:00100000:0.0:1762166977.194264:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1dddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+536:61844:x1847765450424192:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:0.0:1762166977.194296:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166977.194312:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbaa773 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b54 expref: 536 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.194322:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166977.194326:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166977.194468:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbaa77a lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166977.194503:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbaa77a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.194516:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbaa77a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000001:00080000:0.0:1762166977.194560:0:6495:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294991967 00000004:00010000:0.0:1762166977.194590:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000062757371 reply state 00000000fc9b6cca transno 4294991968 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbaa77a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.194602:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbaa77a lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.194611:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166977.194614:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762166977.194616:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166977.194670:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1dddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+538:61844:x1847765450424192:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 407us (494us total) trans 4294991968 rc 0/0 00000100:00100000:0.0:1762166977.194678:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30384 00000020:00080000:0.0:1762166977.194683:0:6495:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1762166977.195705:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.195757:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450424320 00000100:00100000:2.0:1762166977.195765:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.195766:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450424320 00002000:00010000:0.0:1762166977.195794:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2694 (177340->18446744073709551615) 00002000:00100000:0.0:1762166977.195798:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4010a80 with x1847765450424320 ext(177340->18446744073709551615) 00002000:00010000:0.0:1762166977.195808:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc4010a80. 00000100:00100000:1.0:1762166977.195810:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450424448 00000100:00100000:1.0:1762166977.195817:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450424448 00000100:00100000:0.0:1762166977.195836:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2193 00002000:00010000:1.0:1762166977.195837:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2693 (0->18446744073709551615) 00002000:00100000:1.0:1762166977.195843:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4013800 with x1847765450424448 ext(0->18446744073709551615) 00000100:00100000:0.0:1762166977.195850:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4010a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+16:2419:x1847765450424320:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:1.0:1762166977.195854:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4013800. 00000100:00100000:1.0:1762166977.195897:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2194 00000100:00100000:1.0:1762166977.195909:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4013800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450424448:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:1.0:1762166977.196014:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166977.196019:0:23943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:1.0:1762166977.196022:0:23943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb atime from disk: 1762166973 -> 1762166973 00002000:00010000:1.0:1762166977.196024:0:23943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:1.0:1762166977.196027:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:0.0:1762166977.196061:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb size from disk: 151552 -> 177340 00002000:00010000:0.0:1762166977.196065:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00000100:00100000:1.0:1762166977.196069:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4013800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765450424448:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 162us (309us total) trans 17179876324 rc 0/0 00002000:00010000:0.0:1762166977.196070:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb atime from disk: 1762166973 -> 1762166973 00002000:00010000:0.0:1762166977.196081:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00000100:00100000:1.0:1762166977.196082:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2194 00002000:00010000:0.0:1762166977.196086:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb blocks from disk: 272 -> 272 00002000:00010000:1.0:1762166977.196088:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2693 (0->18446744073709551615) 00002000:00100000:1.0:1762166977.196093:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4013800 with x1847765450424448 ext(0->18446744073709551615) 00002000:00010000:1.0:1762166977.196099:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4013800. 00000100:00100000:0.0:1762166977.196116:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4010a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450424320:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 270us (419us total) trans 21474843274 rc 0/0 00000100:00100000:0.0:1762166977.196124:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2193 00002000:00010000:0.0:1762166977.196128:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2694 (177340->18446744073709551615) 00002000:00100000:0.0:1762166977.196131:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4010a80 with x1847765450424320 ext(177340->18446744073709551615) 00002000:00010000:0.0:1762166977.196136:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc4010a80. 00000100:00100000:3.0:1762166977.196993:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.197038:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450424576 00000100:00100000:0.0:1762166977.197047:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450424576 00000100:00100000:0.0:1762166977.197091:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30385 00000100:00100000:0.0:1762166977.197098:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1dde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+538:61844:x1847765450424576:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166977.197116:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166977.197130:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbaa781 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9b5b expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.197211:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbaa788 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166977.197226:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbaa788 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.197236:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbaa788 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:0.0:1762166977.197263:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 177340 00000004:00200000:0.0:1762166977.197267:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166977.197281:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbaa788 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.197300:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbaa781 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b5b expref: 540 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.197311:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbaa788 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b5b expref: 539 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.197317:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166977.197319:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166977.197321:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdfa00, rc 0) 00000100:00100000:0.0:1762166977.197376:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1dde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+539:61844:x1847765450424576:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 277us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166977.197395:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30385 00000100:00100000:3.0:1762166977.198663:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.198698:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450424832 00000100:00100000:0.0:1762166977.198703:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450424832 00000100:00100000:0.0:1762166977.198731:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30386 00000100:00100000:0.0:1762166977.198738:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+539:61844:x1847765450424832:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:0.0:1762166977.198761:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166977.198772:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbaa788 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b5b expref: 539 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.198779:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166977.198781:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166977.198899:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbaa78f lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166977.198906:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbaa78f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.198911:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbaa78f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000001:00080000:0.0:1762166977.198940:0:6495:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294991969 00000004:00010000:0.0:1762166977.198955:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000000b82c8be reply state 000000004be5b812 transno 4294991970 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbaa78f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.198963:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbaa78f lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.198967:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166977.198969:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762166977.198971:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166977.199016:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+541:61844:x1847765450424832:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 279us (357us total) trans 4294991970 rc 0/0 00000100:00100000:0.0:1762166977.199020:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30386 00000020:00080000:0.0:1762166977.199023:0:6495:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1762166977.199838:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.199903:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450424960 00000100:00100000:1.0:1762166977.199910:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450424960 00000100:00100000:1.0:1762166977.199959:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18928 00000100:00100000:1.0:1762166977.199971:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4012300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+17:61844:x1847765450424960:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166977.199988:0:8380:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166977.200008:0:8380:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc6221a00/0x2f180c4effbaa796 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9b62 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762166977.200031:0:8380:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa88:0x0] initial LVB size: 151552, mtime: 0x690888c1, atime: 0x690888bf, ctime: 0x690888c1, blocks: 0x110 00010000:00010000:1.0:1762166977.200048:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166977.200050:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166977.200057:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc6221a00/0x2f180c4effbaa796 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b62 expref: 18 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.200068:0:8380:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc6221a00/0x2f180c4effbaa796 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b62 expref: 18 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.200077:0:8380:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc6221a00, rc 0) 00000100:00100000:1.0:1762166977.200115:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4012300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+18:61844:x1847765450424960:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 150us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166977.200120:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18928 00000100:00100000:3.0:1762166977.200900:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.200943:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450425088 00000100:00100000:0.0:1762166977.200950:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450425088 00002000:00010000:0.0:1762166977.200974:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2696 (151552->18446744073709551615) 00002000:00100000:0.0:1762166977.200977:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1ddc380 with x1847765450425088 ext(151552->18446744073709551615) 00002000:00010000:0.0:1762166977.200984:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945cf1ddc380. 00000100:00100000:0.0:1762166977.201005:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2195 00000100:00100000:0.0:1762166977.201011:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450425088:12345-192.168.204.38@tcp:10:lfs.0 00000100:00100000:2.0:1762166977.201044:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.201074:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450425216 00000100:00100000:1.0:1762166977.201082:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450425216 00002000:00010000:0.0:1762166977.201099:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb size from disk: 151552 -> 151552 00002000:00010000:0.0:1762166977.201102:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:0.0:1762166977.201104:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00002000:00010000:0.0:1762166977.201106:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:1.0:1762166977.201107:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2695 (0->18446744073709551615) 00002000:00010000:0.0:1762166977.201110:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb blocks from disk: 272 -> 272 00002000:00100000:1.0:1762166977.201116:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc59d5180 with x1847765450425216 ext(0->18446744073709551615) 00002000:00010000:1.0:1762166977.201127:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc59d5180. 00000100:00100000:0.0:1762166977.201153:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450425088:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 141us (255us total) trans 21474843275 rc 0/0 00000100:00100000:1.0:1762166977.201162:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2196 00000100:00100000:0.0:1762166977.201171:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2195 00002000:00010000:0.0:1762166977.201176:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2696 (151552->18446744073709551615) 00000100:00100000:1.0:1762166977.201177:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc59d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450425216:12345-192.168.204.38@tcp:10:lfs.0 00002000:00100000:0.0:1762166977.201184:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1ddc380 with x1847765450425088 ext(151552->18446744073709551615) 00002000:00010000:0.0:1762166977.201192:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945cf1ddc380. 00002000:00010000:1.0:1762166977.201297:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166977.201302:0:23943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:1.0:1762166977.201305:0:23943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00002000:00010000:1.0:1762166977.201307:0:23943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:1.0:1762166977.201310:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1762166977.201351:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc59d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765450425216:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 179us (307us total) trans 17179876325 rc 0/0 00000100:00100000:1.0:1762166977.201360:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2196 00002000:00010000:1.0:1762166977.201364:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2695 (0->18446744073709551615) 00002000:00100000:1.0:1762166977.201368:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc59d5180 with x1847765450425216 ext(0->18446744073709551615) 00002000:00010000:1.0:1762166977.201373:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc59d5180. 00000100:00100000:2.0:1762166977.202206:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.202242:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450425344 00000100:00100000:0.0:1762166977.202248:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450425344 00000100:00100000:0.0:1762166977.202273:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30387 00000100:00100000:0.0:1762166977.202278:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc59d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+541:61844:x1847765450425344:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166977.202290:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166977.202299:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbaa79d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9b69 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.202343:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbaa7a4 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166977.202351:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbaa7a4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.202357:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbaa7a4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:0.0:1762166977.202369:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 151552 00000004:00200000:0.0:1762166977.202371:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166977.202379:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbaa7a4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.202393:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbaa79d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b69 expref: 543 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.202407:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbaa7a4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b69 expref: 542 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.202412:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166977.202414:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166977.202431:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdf400, rc 0) 00000100:00100000:0.0:1762166977.202458:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc59d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+542:61844:x1847765450425344:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 180us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166977.202464:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30387 00000100:00100000:3.0:1762166977.203665:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.203694:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450425600 00000100:00100000:0.0:1762166977.203698:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450425600 00000100:00100000:0.0:1762166977.203720:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30388 00000100:00100000:0.0:1762166977.203725:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+542:61844:x1847765450425600:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:0.0:1762166977.203746:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166977.203759:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbaa7a4 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b69 expref: 542 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.203770:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166977.203773:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166977.203862:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbaa7ab lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166977.203869:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbaa7ab lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.203874:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbaa7ab lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000001:00080000:0.0:1762166977.203928:0:6495:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294991971 00000004:00010000:0.0:1762166977.203951:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000c676ed52 reply state 0000000089c80a04 transno 4294991972 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbaa7ab lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.203960:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbaa7ab lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.203966:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166977.203969:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762166977.203971:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166977.204026:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+544:61844:x1847765450425600:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 300us (361us total) trans 4294991972 rc 0/0 00000100:00100000:0.0:1762166977.204032:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30388 00000020:00080000:0.0:1762166977.204036:0:6495:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1762166977.205154:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.205192:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166977.205212:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450425856 00000100:00100000:3.0:1762166977.205218:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450425856 00000100:00100000:0.0:1762166977.205233:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450425728 00000100:00100000:0.0:1762166977.205239:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450425728 00002000:00010000:3.0:1762166977.205245:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2695 (0->18446744073709551615) 00002000:00100000:3.0:1762166977.205251:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bcce75180 with x1847765450425856 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166977.205256:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2696 (177340->18446744073709551615) 00002000:00010000:3.0:1762166977.205260:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bcce75180. 00002000:00100000:0.0:1762166977.205262:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bcce76680 with x1847765450425728 ext(177340->18446744073709551615) 00002000:00010000:0.0:1762166977.205270:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bcce76680. 00000100:00100000:3.0:1762166977.205287:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2197 00000100:00100000:3.0:1762166977.205295:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765450425856:12345-192.168.204.38@tcp:10:lfs.0 00000100:00100000:0.0:1762166977.205310:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2198 00000100:00100000:0.0:1762166977.205321:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450425728:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:3.0:1762166977.205382:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166977.205386:0:23943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:3.0:1762166977.205389:0:23943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166977.205391:0:23943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:3.0:1762166977.205394:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166977.205431:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765450425856:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 137us (279us total) trans 17179876326 rc 0/0 00000100:00100000:3.0:1762166977.205437:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2197 00002000:00010000:3.0:1762166977.205440:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2695 (0->18446744073709551615) 00002000:00100000:3.0:1762166977.205442:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bcce75180 with x1847765450425856 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166977.205446:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bcce75180. 00002000:00010000:0.0:1762166977.205454:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb size from disk: 151552 -> 177340 00002000:00010000:0.0:1762166977.205458:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:0.0:1762166977.205462:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00002000:00010000:0.0:1762166977.205464:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:0.0:1762166977.205467:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb blocks from disk: 272 -> 272 00000100:00100000:0.0:1762166977.205516:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450425728:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 196us (323us total) trans 21474843276 rc 0/0 00000100:00100000:0.0:1762166977.205524:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2198 00002000:00010000:0.0:1762166977.205528:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2696 (177340->18446744073709551615) 00002000:00100000:0.0:1762166977.205531:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bcce76680 with x1847765450425728 ext(177340->18446744073709551615) 00002000:00010000:0.0:1762166977.205537:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bcce76680. 00000100:00100000:2.0:1762166977.213060:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.213109:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450425984 00000100:00100000:0.0:1762166977.213118:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450425984 00000100:00100000:0.0:1762166977.213170:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30389 00000100:00100000:0.0:1762166977.213180:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc59d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+544:61844:x1847765450425984:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166977.213202:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166977.213219:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbaa7b2 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9b70 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.213307:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbaa7b9 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166977.213320:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbaa7b9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.213331:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbaa7b9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:0.0:1762166977.213355:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 177340 00000004:00200000:0.0:1762166977.213359:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166977.213373:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbaa7b9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.213396:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbaa7b2 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b70 expref: 546 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.213410:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbaa7b9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b70 expref: 545 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.213418:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166977.213421:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166977.213424:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdfe00, rc 0) 00000100:00100000:0.0:1762166977.213498:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc59d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+545:61844:x1847765450425984:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 319us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166977.213507:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30389 00000100:00100000:2.0:1762166977.215100:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.215141:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450426240 00000100:00100000:0.0:1762166977.215147:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450426240 00000100:00100000:0.0:1762166977.215182:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30390 00000100:00100000:0.0:1762166977.215191:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc59d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+545:61844:x1847765450426240:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:0.0:1762166977.215223:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166977.215240:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbaa7b9 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b70 expref: 545 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.215253:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166977.215257:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166977.215367:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbaa7c0 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166977.215374:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbaa7c0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.215379:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbaa7c0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000001:00080000:0.0:1762166977.215417:0:6495:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294991973 00000004:00010000:0.0:1762166977.215435:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000ac97e69d reply state 000000002635d814 transno 4294991974 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbaa7c0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.215446:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbaa7c0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.215452:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166977.215455:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762166977.215457:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166977.215533:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc59d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+547:61844:x1847765450426240:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 343us (435us total) trans 4294991974 rc 0/0 00000100:00100000:0.0:1762166977.215540:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30390 00000020:00080000:0.0:1762166977.215544:0:6495:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1762166977.216452:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.216516:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450426368 00000100:00100000:0.0:1762166977.216521:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450426368 00002000:00010000:0.0:1762166977.216544:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2694 (177340->18446744073709551615) 00002000:00100000:0.0:1762166977.216548:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bcce74700 with x1847765450426368 ext(177340->18446744073709551615) 00002000:00010000:0.0:1762166977.216557:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bcce74700. 00000100:00100000:2.0:1762166977.216570:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.216593:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450426496 00000100:00100000:0.0:1762166977.216597:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450426496 00002000:00010000:0.0:1762166977.216612:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2693 (0->18446744073709551615) 00002000:00100000:0.0:1762166977.216615:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc59d7800 with x1847765450426496 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166977.216622:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc59d7800. 00000100:00100000:3.0:1762166977.216653:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2199 00000100:00100000:1.0:1762166977.216665:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2200 00000100:00100000:3.0:1762166977.216667:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450426368:12345-192.168.204.38@tcp:10:lfs.0 00000100:00100000:1.0:1762166977.216680:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc59d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765450426496:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:3.0:1762166977.216782:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb size from disk: 177340 -> 177340 00002000:00010000:3.0:1762166977.216786:0:23943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:1.0:1762166977.216788:0:14623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166977.216789:0:23943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb atime from disk: 1762166973 -> 1762166973 00002000:00010000:1.0:1762166977.216793:0:14623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:3.0:1762166977.216795:0:23943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:1.0:1762166977.216796:0:14623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb atime from disk: 1762166973 -> 1762166973 00002000:00010000:1.0:1762166977.216801:0:14623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:3.0:1762166977.216803:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb blocks from disk: 272 -> 272 00002000:00010000:1.0:1762166977.216804:0:14623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1762166977.216850:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc59d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+25:2419:x1847765450426496:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 175us (279us total) trans 17179876327 rc 0/0 00000100:00100000:3.0:1762166977.216856:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450426368:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 192us (403us total) trans 21474843277 rc 0/0 00000100:00100000:1.0:1762166977.216863:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2200 00002000:00010000:1.0:1762166977.216868:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2693 (0->18446744073709551615) 00000100:00100000:3.0:1762166977.216871:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2199 00002000:00100000:1.0:1762166977.216873:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc59d7800 with x1847765450426496 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166977.216876:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2694 (177340->18446744073709551615) 00002000:00100000:3.0:1762166977.216880:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bcce74700 with x1847765450426368 ext(177340->18446744073709551615) 00002000:00010000:1.0:1762166977.216895:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc59d7800. 00002000:00010000:3.0:1762166977.216902:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bcce74700. 00000100:00100000:1.0:1762166977.217875:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.217920:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450426624 00000100:00100000:0.0:1762166977.217926:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450426624 00000100:00100000:0.0:1762166977.217961:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30391 00000100:00100000:0.0:1762166977.217969:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+547:61844:x1847765450426624:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166977.217982:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166977.217995:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbaa7c7 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9b77 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.218059:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbaa7ce lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166977.218069:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbaa7ce lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.218078:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbaa7ce lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:0.0:1762166977.218098:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 177340 00000004:00200000:0.0:1762166977.218102:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166977.218115:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbaa7ce lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.218136:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbaa7c7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b77 expref: 549 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.218156:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbaa7ce lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b77 expref: 548 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.218164:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166977.218167:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166977.218170:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdec00, rc 0) 00000100:00100000:0.0:1762166977.218207:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+548:61844:x1847765450426624:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 238us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166977.218222:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30391 00000100:00100000:2.0:1762166977.219566:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.219596:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450426880 00000100:00100000:0.0:1762166977.219601:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450426880 00000100:00100000:0.0:1762166977.219624:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30392 00000100:00100000:0.0:1762166977.219631:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc59d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+548:61844:x1847765450426880:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:0.0:1762166977.219658:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166977.219674:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbaa7ce lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b77 expref: 548 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.219686:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166977.219689:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166977.219779:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbaa7d5 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166977.219787:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbaa7d5 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.219792:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbaa7d5 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000001:00080000:0.0:1762166977.219819:0:6495:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294991975 00000004:00010000:0.0:1762166977.219832:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000004a6018f5 reply state 00000000b2cf2406 transno 4294991976 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbaa7d5 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.219839:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbaa7d5 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.219843:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166977.219845:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762166977.219846:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166977.219896:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc59d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+550:61844:x1847765450426880:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 265us (331us total) trans 4294991976 rc 0/0 00000100:00100000:0.0:1762166977.219901:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30392 00000020:00080000:0.0:1762166977.219904:0:6495:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1762166977.220793:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166977.220827:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450427008 00000100:00100000:3.0:1762166977.220834:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450427008 00000100:00100000:2.0:1762166977.220834:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00002000:00010000:3.0:1762166977.220852:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2696 (177340->18446744073709551615) 00002000:00100000:3.0:1762166977.220856:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc59d6680 with x1847765450427008 ext(177340->18446744073709551615) 00002000:00010000:3.0:1762166977.220862:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc59d6680. 00000100:00100000:3.0:1762166977.220874:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450427136 00000100:00100000:3.0:1762166977.220876:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450427136 00000100:00100000:1.0:1762166977.220895:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2201 00002000:00010000:3.0:1762166977.220900:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2695 (0->18446744073709551615) 00000100:00100000:1.0:1762166977.220906:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc59d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450427008:12345-192.168.204.38@tcp:10:lfs.0 00002000:00100000:3.0:1762166977.220907:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc59d6300 with x1847765450427136 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166977.220915:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc59d6300. 00000100:00100000:3.0:1762166977.220933:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2202 00000100:00100000:3.0:1762166977.220940:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc59d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+25:2419:x1847765450427136:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:1.0:1762166977.221001:0:14623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb size from disk: 177340 -> 177340 00002000:00010000:1.0:1762166977.221005:0:14623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:3.0:1762166977.221006:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166977.221010:0:23943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:1.0:1762166977.221012:0:14623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166977.221013:0:23943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166977.221018:0:23943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:1.0:1762166977.221020:0:14623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:3.0:1762166977.221021:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:1.0:1762166977.221027:0:14623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb blocks from disk: 272 -> 272 00000100:00100000:3.0:1762166977.221053:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc59d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765450427136:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 113us (221us total) trans 17179876328 rc 0/0 00000100:00100000:1.0:1762166977.221059:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc59d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765450427008:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 153us (263us total) trans 21474843278 rc 0/0 00000100:00100000:3.0:1762166977.221065:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2202 00002000:00010000:3.0:1762166977.221072:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2695 (0->18446744073709551615) 00000100:00100000:1.0:1762166977.221077:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2201 00002000:00100000:3.0:1762166977.221078:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc59d6300 with x1847765450427136 ext(0->18446744073709551615) 00002000:00010000:1.0:1762166977.221084:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2696 (177340->18446744073709551615) 00002000:00010000:3.0:1762166977.221086:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc59d6300. 00002000:00100000:1.0:1762166977.221091:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc59d6680 with x1847765450427008 ext(177340->18446744073709551615) 00002000:00010000:1.0:1762166977.221098:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc59d6680. 00000100:00100000:1.0:1762166977.221860:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.221900:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450427392 00000100:00100000:0.0:1762166977.221904:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450427392 00000100:00100000:0.0:1762166977.221931:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30393 00000100:00100000:0.0:1762166977.221936:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+550:61844:x1847765450427392:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:0.0:1762166977.221972:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbaa7dc lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166977.221979:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbaa7dc lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.221985:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbaa7dc lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00010000:0.0:1762166977.222019:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000055bb720f reply state 00000000087c2a20 transno 4294991977 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbaa7dc lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.222025:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbaa7dc lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.222030:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166977.222032:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762166977.222033:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166977.222067:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+552:61844:x1847765450427392:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 131us (210us total) trans 4294991977 rc 0/0 00000100:00100000:0.0:1762166977.222071:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30393 00000100:00100000:2.0:1762166977.222734:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.222756:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.222787:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450427520 00000100:00100000:1.0:1762166977.222792:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450427520 00000100:00100000:0.0:1762166977.222797:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450427648 00000100:00100000:0.0:1762166977.222801:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450427648 00000100:00100000:1.0:1762166977.222834:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18929 00000100:00100000:0.0:1762166977.222842:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18930 00000100:00100000:1.0:1762166977.222847:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+26:2416:x1847765450427520:12345-192.168.204.38@tcp:2:lfs.0 00000100:00100000:0.0:1762166977.222854:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+22:2416:x1847765450427648:12345-192.168.204.38@tcp:2:lfs.0 00000100:00100000:3.0:1762166977.222862:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.222897:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450427776 00000100:00100000:2.0:1762166977.222903:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450427776 00002000:00010000:1.0:1762166977.222934:0:8380:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 177340 -> 177340 00000100:00100000:2.0:1762166977.222939:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18931 00002000:00010000:1.0:1762166977.222940:0:8380:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:1.0:1762166977.222946:0:8380:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166977 -> 1762166977 00002000:00010000:1.0:1762166977.222949:0:8380:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:0.0:1762166977.222949:0:9165:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166977.222956:0:9165:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:1.0:1762166977.222957:0:8380:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 344 -> 344 00000100:00100000:2.0:1762166977.222958:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+28:2417:x1847765450427776:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:0.0:1762166977.222964:0:9165:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166976 -> 1762166977 00002000:00010000:0.0:1762166977.222969:0:9165:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:0.0:1762166977.222972:0:9165:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00000100:00100000:0.0:1762166977.223004:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+23:2416:x1847765450427648:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 150us (241us total) trans 21474843279 rc 0/0 00000100:00100000:1.0:1762166977.223005:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+28:2416:x1847765450427520:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 159us (266us total) trans 17179876329 rc 0/0 00000100:00100000:0.0:1762166977.223014:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18930 00000100:00100000:1.0:1762166977.223022:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18929 00002000:00010000:2.0:1762166977.223031:0:35247:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166977.223035:0:35247:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:2.0:1762166977.223039:0:35247:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166976 -> 1762166977 00002000:00010000:2.0:1762166977.223041:0:35247:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:2.0:1762166977.223043:0:35247:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1762166977.223069:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+28:2417:x1847765450427776:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 120us (211us total) trans 17179876330 rc 0/0 00000100:00100000:2.0:1762166977.223077:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18931 00000100:00100000:2.0:1762166977.223931:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.223973:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450428032 00000100:00100000:1.0:1762166977.223978:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450428032 00000100:00100000:1.0:1762166977.224010:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11818 00000100:00100000:1.0:1762166977.224016:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+552:61844:x1847765450428032:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:1.0:1762166977.224053:0:6497:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x240000404:0x5eb:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220200/0x2f180c4effbaa6a8 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b07 expref: 552 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.224082:0:6497:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa7e3 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 00010000:00010000:1.0:1762166977.224092:0:6497:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbaa6d2 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 14 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b0e expref: 552 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.224100:0:6497:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa7e3 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166977.224129:0:6497:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbaa6d2 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 14 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b0e expref: 552 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.224141:0:6497:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbaa6d2 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 14 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b0e expref: 552 pid: 6495 timeout: 696 lvb_type: 0 00000100:00100000:1.0:1762166977.224154:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcce75c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6497:1847765449709056:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166977.224213:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011c7900 going to sleep for 11 seconds 00000100:00100000:1.0:1762166977.224995:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcce75c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6497:1847765449709056:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166977.225014:0:6497:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa7e3 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00000100:00100000:2.0:1762166977.225109:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166977.225149:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450428160 00000100:00100000:3.0:1762166977.225188:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450428160 00010000:00010000:3.0:1762166977.225209:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbaa6d2 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 14 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b0e expref: 553 pid: 6495 timeout: 696 lvb_type: 0 00000100:00100000:3.0:1762166977.225237:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9546 00000100:00100000:3.0:1762166977.225244:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+553:2418:x1847765450428160:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166977.225255:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166977.225261:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbaa6d2 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 15 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b0e expref: 553 pid: 6495 timeout: 696 lvb_type: 0 00010000:00010000:3.0:1762166977.225271:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbaa6d2 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 15 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b0e expref: 553 pid: 6495 timeout: 696 lvb_type: 0 00010000:00010000:3.0:1762166977.225284:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbaa6d2 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 15 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b0e expref: 553 pid: 6495 timeout: 696 lvb_type: 0 00010000:00010000:3.0:1762166977.225296:0:7421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166977.225300:0:7421:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa7e3 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00010000:00010000:3.0:1762166977.225308:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa7e3 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 14 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT1 00010000:00010000:3.0:1762166977.225313:0:7421:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa7e3 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 14 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT1 00010000:00010000:3.0:1762166977.225333:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166977.225366:0:6497:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa7e3 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00000100:00100000:3.0:1762166977.225368:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+552:2418:x1847765450428160:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 123us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166977.225385:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9546 00010000:00010000:1.0:1762166977.225388:0:6497:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa7e3 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00000040:00080000:1.0:1762166977.225628:0:6497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5891, 88 off461304 00000004:00080000:1.0:1762166977.225636:0:6497:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 596374158258ns, next at 595897461133ns, rc = 0 00000040:00080000:1.0:1762166977.225674:0:6497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5890, 88 off461304 00000004:00080000:1.0:1762166977.225679:0:6497:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 596374201369ns, next at 595897495953ns, rc = 0 00000040:00080000:1.0:1762166977.225702:0:6497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5891, 88 off461392 00000004:00080000:1.0:1762166977.225707:0:6497:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 596374229556ns, next at 595897495953ns, rc = 0 00000040:00080000:1.0:1762166977.225721:0:6497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5892, 88 off461392 00000004:00080000:1.0:1762166977.225725:0:6497:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 596374247493ns, next at 595897461133ns, rc = 0 00000040:00080000:1.0:1762166977.225748:0:6497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5892, 88 off461480 00000004:00080000:1.0:1762166977.225753:0:6497:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 596374275400ns, next at 595897495953ns, rc = 0 00000040:00080000:1.0:1762166977.225770:0:6497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5893, 88 off461480 00000004:00080000:1.0:1762166977.225775:0:6497:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 596374296819ns, next at 595897461133ns, rc = 0 00000040:00080000:1.0:1762166977.225792:0:6497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5893, 88 off461568 00000004:00080000:1.0:1762166977.225797:0:6497:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 596374319688ns, next at 595897495953ns, rc = 0 00000040:00080000:1.0:1762166977.225815:0:6497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5894, 88 off461568 00000004:00080000:1.0:1762166977.225819:0:6497:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 596374341775ns, next at 595897461133ns, rc = 0 00000001:00080000:3.0:1762166977.226656:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294991978 is committed 00000004:00080000:3.0:1762166977.226662:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3258 committed 00000004:00080000:3.0:1762166977.226672:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3261 committed 00000004:00080000:3.0:1762166977.226680:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3257 committed 00000004:00080000:3.0:1762166977.226684:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3260 committed 00000004:00080000:3.0:1762166977.226688:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3256 committed 00010000:00010000:2.0:1762166977.226690:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbaa711 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00000004:00080000:3.0:1762166977.226691:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3259 committed 00000004:00080000:3.0:1762166977.226696:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3258 committed 00000004:00080000:3.0:1762166977.226703:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3255 committed 00010000:00010000:2.0:1762166977.226704:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbaa711 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166977.226714:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbaa711 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166977.226721:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bde200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166977.226726:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbaa711 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166977.226734:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbaa711 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166977.226746:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166977.226750:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166977.226758:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbaa711 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166977.226765:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbaa711 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000100:00100000:3.0:1762166977.226779:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcce77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449709440:0@lo:2:osp-syn-0-1.0 00010000:00010000:2.0:1762166977.226788:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbaa72d lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166977.226797:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbaa72d lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166977.226803:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbaa72d lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166977.226808:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bde600 already unused, calling callback (ffffffffc18e2310) 00000100:00100000:0.0:1762166977.226813:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7b23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449709184:0@lo:2:osp-syn-1-1.0 00010000:00010000:2.0:1762166977.226814:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbaa72d lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00000100:00100000:1.0:1762166977.226822:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcce75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449709312:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166977.226827:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1762166977.226829:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbaa72d lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166977.226839:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166977.226842:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166977.226845:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbaa72d lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166977.226850:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbaa72d lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166977.226862:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbaa75e lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00000100:00100000:0.0:1762166977.226862:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166977.226866:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7b20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449709952:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1762166977.226872:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7b20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449709568:0@lo:2:osp-syn-1-1.0 00010000:00010000:2.0:1762166977.226876:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbaa75e lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166977.226897:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbaa75e lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166977.226903:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdf000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166977.226906:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbaa75e lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166977.226912:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbaa75e lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00000100:00100000:0.0:1762166977.226914:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7b22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449709696:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166977.226924:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1762166977.226928:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166977.226932:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166977.226935:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbaa75e lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166977.226940:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbaa75e lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000004:00010000:1.0:1762166977.226945:0:6497:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000093bc2341 reply state 00000000033df544 transno 4294991978 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa7e3 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.226953:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbaa77a lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00000100:00100000:0.0:1762166977.226955:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1762166977.226963:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbaa77a lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166977.226969:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbaa77a lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.226973:0:6497:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa7e3 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.226983:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bde400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166977.226983:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166977.226986:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1762166977.226987:0:6497:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1762166977.226988:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbaa77a lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.226992:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166977.226995:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166977.226999:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbaa77a lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.227000:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220200/0x2f180c4effbaa6a8 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b07 expref: 531 pid: 6494 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166977.227005:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449709440 00010000:00010000:2.0:1762166977.227008:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00000100:00100000:0.0:1762166977.227011:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449709440 00010000:00010000:2.0:1762166977.227012:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166977.227017:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbaa77a lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166977.227026:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbaa77a lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166977.227036:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbaa78f lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166977.227041:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbaa78f lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00000100:00100000:0.0:1762166977.227046:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449709184 00010000:00010000:2.0:1762166977.227047:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbaa78f lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00000100:00100000:0.0:1762166977.227052:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449709184 00010000:00010000:2.0:1762166977.227055:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdf600 already unused, calling callback (ffffffffc18e2310) 00000100:00100000:3.0:1762166977.227057:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449709952 00010000:00010000:2.0:1762166977.227060:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbaa78f lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00000100:00100000:3.0:1762166977.227064:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449709952 00010000:00080000:1.0:1762166977.227067:0:6497:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00010000:00010000:2.0:1762166977.227071:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbaa78f lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166977.227080:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00000100:00100000:0.0:1762166977.227082:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449709696 00010000:00010000:2.0:1762166977.227084:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166977.227084:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+530:61844:x1847765450428032:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 3067us (3153us total) trans 4294991978 rc 0/0 00000100:00100000:0.0:1762166977.227087:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449709696 00010000:00010000:2.0:1762166977.227089:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbaa78f lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166977.227095:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbaa78f lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000100:00100000:1.0:1762166977.227097:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11818 00000100:00100000:3.0:1762166977.227101:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18932 00010000:00010000:2.0:1762166977.227109:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbaa7ab lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00000100:00100000:3.0:1762166977.227113:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3633:x1847765449709440:12345-0@lo:2:osp-syn-0-1.0 00010000:00010000:2.0:1762166977.227124:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbaa7ab lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00000100:00100000:0.0:1762166977.227124:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18933 00010000:00010000:2.0:1762166977.227133:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbaa7ab lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.227136:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa7e3 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT1 00000100:00100000:0.0:1762166977.227137:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+11:3635:x1847765449709184:12345-0@lo:2:osp-syn-1-1.0 00010000:00010000:1.0:1762166977.227149:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa7e3 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.227156:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdea00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166977.227156:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa7e3 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.227159:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbaa7ab lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.227161:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc6221c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166977.227164:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa7e3 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.227166:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbaa7ab lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.227171:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa7e3 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.227173:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166977.227176:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166977.227178:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbaa7ab lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.227180:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166977.227183:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166977.227184:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbaa7ab lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.227185:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa7e3 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166977.227191:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa7e3 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.227195:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbaa7c0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166977.227200:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbaa7c0 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166977.227205:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbaa7c0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166977.227211:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bde000 already unused, calling callback (ffffffffc18e2310) 00002000:00010000:3.0:1762166977.227212:0:8383:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:1.0:1762166977.227213:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1762166977.227214:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbaa7c0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00002000:00010000:3.0:1762166977.227218:0:8383:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:0.0:1762166977.227223:0:28434:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 177340 -> 177340 00002000:00010000:3.0:1762166977.227225:0:8383:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166977 -> 1762166977 00010000:00010000:2.0:1762166977.227225:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbaa7c0 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00002000:00010000:0.0:1762166977.227230:0:28434:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:3.0:1762166977.227232:0:8383:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:0.0:1762166977.227237:0:28434:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166977 -> 1762166977 00000100:00100000:1.0:1762166977.227238:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcce74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449709824:0@lo:2:osp-syn-0-1.0 00002000:00010000:3.0:1762166977.227240:0:8383:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00010000:00010000:2.0:1762166977.227243:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00002000:00010000:0.0:1762166977.227244:0:28434:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00010000:00010000:2.0:1762166977.227250:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00002000:00010000:0.0:1762166977.227250:0:28434:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 344 -> 344 00010000:00010000:2.0:1762166977.227255:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbaa7c0 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166977.227263:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbaa7c0 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166977.227274:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbaa7d5 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00000100:00100000:1.0:1762166977.227279:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1762166977.227280:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbaa7d5 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166977.227286:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbaa7d5 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00000100:00100000:3.0:1762166977.227292:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3633:x1847765449709440:12345-0@lo:2:osp-syn-0-1.0 Request processed in 180us (467us total) trans 21474843280 rc 0/0 00010000:00010000:2.0:1762166977.227294:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdf200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166977.227300:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbaa7d5 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00000100:00100000:0.0:1762166977.227303:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+12:3635:x1847765449709184:12345-0@lo:2:osp-syn-1-1.0 Request processed in 167us (441us total) trans 17179876331 rc 0/0 00000100:00100000:3.0:1762166977.227309:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18932 00000100:00100000:1.0:1762166977.227315:0:35248:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449709312 00010000:00010000:2.0:1762166977.227318:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbaa7d5 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00000100:00100000:1.0:1762166977.227319:0:35248:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449709312 00000100:00100000:0.0:1762166977.227322:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18933 00000100:00100000:3.0:1762166977.227330:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449709824 00010000:00010000:2.0:1762166977.227331:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00000100:00100000:3.0:1762166977.227336:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449709824 00010000:00010000:2.0:1762166977.227336:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166977.227342:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbaa7d5 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000100:00100000:1.0:1762166977.227344:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18934 00010000:00010000:2.0:1762166977.227348:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbaa7d5 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000100:00100000:0.0:1762166977.227352:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18935 00000100:00100000:1.0:1762166977.227354:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+11:3633:x1847765449709952:12345-0@lo:2:osp-syn-1-1.0 00010000:00010000:2.0:1762166977.227364:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbaa7dc lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00000100:00100000:0.0:1762166977.227368:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+11:3635:x1847765449709696:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166977.227374:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18936 00010000:00010000:2.0:1762166977.227376:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbaa7dc lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00000100:00100000:3.0:1762166977.227389:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+7:3636:x1847765449709312:12345-0@lo:2:osp-syn-0-1.0 00010000:00010000:2.0:1762166977.227391:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbaa7dc lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166977.227400:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdfa00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166977.227403:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbaa7dc lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166977.227409:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbaa7dc lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166977.227416:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00002000:00010000:1.0:1762166977.227418:0:35248:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb size from disk: 0 -> 0 00010000:00010000:2.0:1762166977.227419:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00002000:00010000:1.0:1762166977.227421:0:35248:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00010000:00010000:2.0:1762166977.227422:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbaa7dc lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00002000:00010000:1.0:1762166977.227424:0:35248:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00002000:00010000:1.0:1762166977.227427:0:35248:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00010000:00010000:2.0:1762166977.227428:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbaa7dc lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00002000:00010000:1.0:1762166977.227430:0:35248:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:0.0:1762166977.227440:0:28434:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166977.227444:0:28434:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:0.0:1762166977.227448:0:28434:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb atime from disk: 1762166973 -> 1762166973 00002000:00010000:0.0:1762166977.227451:0:28434:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00000100:00100000:2.0:1762166977.227456:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18937 00002000:00010000:0.0:1762166977.227457:0:28434:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:3.0:1762166977.227462:0:8383:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:1.0:1762166977.227462:0:35248:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+13:3633:x1847765449709952:12345-0@lo:2:osp-syn-1-1.0 Request processed in 110us (540us total) trans 17179876332 rc 0/0 00002000:00010000:3.0:1762166977.227468:0:8383:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb mtime from disk: 1762166966 -> 1762166966 00000100:00100000:2.0:1762166977.227469:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc8120380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+8:3636:x1847765449709824:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:3.0:1762166977.227475:0:8383:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:1.0:1762166977.227499:0:35248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18934 00002000:00010000:3.0:1762166977.227505:0:8383:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb ctime from disk: 1762166966 -> 1762166966 00002000:00010000:3.0:1762166977.227508:0:8383:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1762166977.227526:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+12:3635:x1847765449709696:12345-0@lo:2:osp-syn-1-1.0 Request processed in 162us (573us total) trans 17179876333 rc 0/0 00000100:00100000:1.0:1762166977.227535:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166977.227539:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18935 00000100:00100000:3.0:1762166977.227550:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+9:3636:x1847765449709312:12345-0@lo:2:osp-syn-0-1.0 Request processed in 165us (336us total) trans 21474843281 rc 0/0 00000100:00100000:0.0:1762166977.227558:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449709568 00000100:00100000:3.0:1762166977.227559:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18936 00002000:00010000:2.0:1762166977.227563:0:8382:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb size from disk: 177340 -> 177340 00000100:00100000:0.0:1762166977.227564:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449709568 00000100:00100000:1.0:1762166977.227565:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcce75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449710080:0@lo:2:osp-syn-0-1.0 00002000:00010000:2.0:1762166977.227568:0:8382:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:2.0:1762166977.227571:0:8382:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb atime from disk: 1762166973 -> 1762166973 00002000:00010000:2.0:1762166977.227574:0:8382:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:2.0:1762166977.227576:0:8382:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa86:0x0] updating lvb blocks from disk: 272 -> 272 00000100:00100000:3.0:1762166977.227594:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18938 00000100:00100000:1.0:1762166977.227600:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166977.227603:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc8120380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+8:3636:x1847765449709824:12345-0@lo:2:osp-syn-0-1.0 Request processed in 138us (323us total) trans 21474843282 rc 0/0 00000100:00100000:0.0:1762166977.227610:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449710080 00000100:00100000:3.0:1762166977.227614:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc8120000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+12:3634:x1847765449709568:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1762166977.227614:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18937 00000100:00100000:0.0:1762166977.227616:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449710080 00000100:00100000:1.0:1762166977.227645:0:3636:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 21474843266 gen 2 00000100:00100000:2.0:1762166977.227646:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18939 00000004:00080000:1.0:1762166977.227650:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc47b5c00, transno 21474843248 00000100:00100000:2.0:1762166977.227654:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc8121c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+8:3634:x1847765449710080:12345-0@lo:2:osp-syn-0-1.0 00000004:00080000:1.0:1762166977.227660:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc47b7100, transno 21474843249 00000004:00080000:1.0:1762166977.227665:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc47b7800, transno 21474843250 00000004:00080000:1.0:1762166977.227668:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc47b5880, transno 21474843251 00000004:00080000:1.0:1762166977.227673:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc7b23100, transno 21474843252 00002000:00010000:3.0:1762166977.227676:0:8383:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00000004:00080000:1.0:1762166977.227677:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc7b21180, transno 21474843253 00002000:00010000:3.0:1762166977.227681:0:8383:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00000004:00080000:0.0:1762166977.227683:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc7b23b80/2, rc 0, transno 17179876331 00000004:00080000:1.0:1762166977.227684:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc7b21c00, transno 21474843254 00002000:00010000:3.0:1762166977.227685:0:8383:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166977 -> 1762166977 00000004:00080000:1.0:1762166977.227690:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc7b22a00, transno 21474843255 00002000:00010000:3.0:1762166977.227692:0:8383:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00000004:00080000:1.0:1762166977.227695:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf79ea680, transno 21474843263 00000100:00100000:0.0:1762166977.227695:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7b23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449709184:0@lo:2:osp-syn-1-1.0 00002000:00010000:3.0:1762166977.227696:0:8383:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00000004:00080000:1.0:1762166977.227701:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf79e9880, transno 21474843264 00002000:00010000:2.0:1762166977.227708:0:8382:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb size from disk: 177340 -> 177340 00000004:00080000:1.0:1762166977.227708:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf79ea300, transno 21474843265 00002000:00010000:2.0:1762166977.227711:0:8382:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00000004:00080000:1.0:1762166977.227712:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf79eaa00, transno 21474843266 00002000:00010000:2.0:1762166977.227713:0:8382:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00002000:00010000:2.0:1762166977.227716:0:8382:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00000004:00080000:0.0:1762166977.227717:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc7b22680/2, rc 0, transno 17179876333 00002000:00010000:2.0:1762166977.227720:0:8382:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa88:0x0] updating lvb blocks from disk: 272 -> 272 00000100:00100000:1.0:1762166977.227721:0:3636:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff945bcce75c00 x1847765449709312/t21474843281(21474843281) o2->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 440/432 e 0 to 0 dl 1762166993 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1762166977.227726:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7b22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449709696:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166977.227737:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc8120000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+13:3634:x1847765449709568:12345-0@lo:2:osp-syn-1-1.0 Request processed in 130us (203us total) trans 17179876334 rc 0/0 00000004:00080000:1.0:1762166977.227740:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bcce75c00/2, rc 0, transno 21474843281 00000100:00100000:3.0:1762166977.227747:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18938 00000100:00100000:1.0:1762166977.227748:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcce75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449709312:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1762166977.227753:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc8121c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+9:3634:x1847765449710080:12345-0@lo:2:osp-syn-0-1.0 Request processed in 100us (156us total) trans 21474843283 rc 0/0 00000100:00100000:2.0:1762166977.227760:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18939 00000004:00080000:1.0:1762166977.227764:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bcce74e00/2, rc 0, transno 21474843282 00000100:00100000:1.0:1762166977.227768:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcce74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449709824:0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1762166977.227790:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc7b20e00/2, rc 0, transno 17179876332 00000100:00100000:3.0:1762166977.227797:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7b20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449709952:0@lo:2:osp-syn-1-1.0 00000004:00080000:0.0:1762166977.227817:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc7b20380/2, rc 0, transno 17179876334 00000004:00080000:3.0:1762166977.227820:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bcce77480/2, rc 0, transno 21474843280 00000100:00100000:0.0:1762166977.227826:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7b20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449709568:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166977.227827:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcce77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449709440:0@lo:2:osp-syn-0-1.0 00000004:00080000:0.0:1762166977.227848:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bcce75500/2, rc 0, transno 21474843283 00000100:00100000:0.0:1762166977.227854:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcce75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449710080:0@lo:2:osp-syn-0-1.0 00000004:00080000:1.0:1762166977.227870:0:9158:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0001: 0 changes, 4 in progress, 0 in flight, 12 done 00000100:00100000:2.0:1762166977.228774:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.228820:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450428288 00000100:00100000:0.0:1762166977.228825:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450428288 00000100:00100000:0.0:1762166977.228859:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30394 00000100:00100000:0.0:1762166977.228869:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+524:61844:x1847765450428288:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166977.228896:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166977.228909:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbaa7ea lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9b7e expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.228949:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbaa7ea lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b7e expref: 525 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.228963:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbaa7ea lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b7e expref: 525 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.228977:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166977.228980:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166977.228982:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdec00, rc 0) 00000100:00100000:0.0:1762166977.229017:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+525:61844:x1847765450428288:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 150us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166977.229028:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30394 00000100:00100000:3.0:1762166977.230275:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.230307:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450428544 00000100:00100000:1.0:1762166977.230311:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450428544 00000100:00100000:1.0:1762166977.230338:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11819 00000100:00100000:1.0:1762166977.230342:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+525:61844:x1847765450428544:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:1.0:1762166977.230461:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+526:61844:x1847765450428544:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 117us (188us total) trans 4294991979 rc 0/0 00000100:00100000:1.0:1762166977.230469:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11819 00000100:00100000:3.0:1762166977.239240:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.239317:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450428672 00000100:00100000:0.0:1762166977.239327:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450428672 00000100:00100000:0.0:1762166977.239384:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30395 00000100:00100000:0.0:1762166977.239395:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+526:61845:x1847765450428672:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166977.239418:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166977.239439:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbaa7f1 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9b85 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.239530:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbaa7f8 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166977.239544:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbaa7f8 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.239553:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbaa7f8 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.239566:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbaa7ff lrc: 3/1,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166977.239573:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbaa7ff lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.239579:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbaa7ff lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.239650:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbaa806 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166977.239659:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbaa806 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.239666:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbaa806 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:0.0:1762166977.239704:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 177340 00000004:00200000:0.0:1762166977.239708:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166977.239725:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbaa806 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.239736:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbaa806 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.239742:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbaa7f8 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.239746:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbaa7f8 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.239750:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbaa7f8 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.239754:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbaa7f8 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.239757:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdf800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166977.239760:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbaa7f8 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.239764:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbaa7f8 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.239771:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0x0 (ffff945bc2e87700) 00010000:00010000:0.0:1762166977.239773:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166977.239776:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbaa7f8 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.239780:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbaa7f8 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.239790:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbaa7ff lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.239793:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbaa7ff lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.239796:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbaa7ff lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.239799:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdfa00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166977.239800:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbaa7ff lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.239803:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbaa7ff lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.239806:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0xdd396665 (ffff945bc2e87900) 00010000:00010000:0.0:1762166977.239808:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166977.239809:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbaa7ff lrc: 2/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.239812:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbaa7ff lrc: 0/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.239830:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbaa7f1 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b85 expref: 528 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.239838:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbaa806 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b85 expref: 527 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.239846:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166977.239848:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166977.239849:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdf200, rc 0) 00000100:00100000:0.0:1762166977.239903:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+527:61845:x1847765450428672:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 511us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166977.239908:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30395 00000100:00100000:2.0:1762166977.241409:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.241504:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450428928 00000100:00100000:0.0:1762166977.241510:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450428928 00000100:00100000:0.0:1762166977.241549:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30396 00000100:00100000:0.0:1762166977.241556:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+527:61845:x1847765450428928:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166977.241568:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166977.241580:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbaa80d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9b8c expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.241645:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbaa814 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166977.241654:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbaa814 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.241663:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbaa814 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:0.0:1762166977.241670:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 177340 00010000:00010000:0.0:1762166977.241752:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbaa80d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b8c expref: 530 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.241766:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbaa814 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b8c expref: 529 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.241773:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166977.241775:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1762166977.241778:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdea00, rc 0) 00000100:00100000:0.0:1762166977.241816:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+529:61845:x1847765450428928:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 260us (411us total) trans 4294991980 rc 0/0 00000100:00100000:0.0:1762166977.241823:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30396 00000100:00100000:3.0:1762166977.242936:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.242964:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450429184 00000100:00100000:0.0:1762166977.242969:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450429184 00000100:00100000:0.0:1762166977.242993:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30397 00000100:00100000:0.0:1762166977.242997:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+529:61845:x1847765450429184:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166977.243007:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166977.243014:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbaa822 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9b93 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.243052:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbaa829 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166977.243059:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbaa829 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.243064:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbaa829 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:0.0:1762166977.243069:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 177340 00010000:00010000:0.0:1762166977.243107:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbaa822 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b93 expref: 532 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.243122:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbaa829 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b93 expref: 531 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.243130:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166977.243132:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166977.243135:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bde400, rc 0) 00000100:00100000:0.0:1762166977.243169:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+531:61845:x1847765450429184:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 170us (234us total) trans 4294991981 rc 0/0 00000100:00100000:0.0:1762166977.243176:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30397 00000100:00100000:3.0:1762166977.277280:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.277356:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450429312 00000100:00100000:1.0:1762166977.277366:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450429312 00000100:00100000:1.0:1762166977.277437:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2203 00000100:00100000:1.0:1762166977.277449:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+28:2418:x1847765450429312:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:1.0:1762166977.277513:0:14623:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa837 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.277528:0:14623:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166977.277530:0:14623:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166977.277536:0:14623:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa837 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->180223] (req 0->180223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.277549:0:14623:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa837 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->180223] (req 0->180223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.278936:0:14623:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa837 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->180223] (req 0->180223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.278948:0:14623:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa837 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->180223] (req 0->180223) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.278955:0:14623:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa837 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->180223] (req 0->180223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.278961:0:14623:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc6221c00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166977.278965:0:14623:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa837 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->180223] (req 0->180223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.278973:0:14623:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa837 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->180223] (req 0->180223) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.278987:0:14623:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa837 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->180223] (req 0->180223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.278995:0:14623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa837 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->180223] (req 0->180223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166977.279041:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+28:2418:x1847765450429312:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 1594us (1766us total) trans 0 rc 177340/177340 00000100:00100000:1.0:1762166977.279049:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2203 00000100:00100000:3.0:1762166977.281162:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.281199:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450429440 00000100:00100000:1.0:1762166977.281206:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450429440 00000100:00100000:1.0:1762166977.281255:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2204 00000100:00100000:1.0:1762166977.281265:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765450429440:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:1.0:1762166977.281291:0:14623:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc6220200/0x2f180c4effbaa83e lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.281308:0:14623:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc6220e00/0x2f180c4effbaa765 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b4d expref: 23 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.281317:0:14623:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166977.281319:0:14623:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166977.281322:0:14623:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc6220200/0x2f180c4effbaa83e lrc: 4/1,0 mode: --/PR res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->180223] (req 0->180223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.281354:0:14623:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc6220e00/0x2f180c4effbaa765 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b4d expref: 23 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.281368:0:14623:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc6220e00/0x2f180c4effbaa765 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b4d expref: 23 pid: 8380 timeout: 696 lvb_type: 0 00000100:00100000:1.0:1762166977.281388:0:14623:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc6226300 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0000_UUID:14623:1847765449710208:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166977.281463:0:14623:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011c7300 going to sleep for 11 seconds 00000100:00100000:1.0:1762166977.282286:0:14623:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc6226300 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0000_UUID:14623:1847765449710208:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166977.282301:0:14623:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bc6220200/0x2f180c4effbaa83e lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->180223] (req 0->180223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166977.282535:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.282582:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450429568 00000100:00100000:2.0:1762166977.282588:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450429568 00010000:00010000:2.0:1762166977.282611:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc6220e00/0x2f180c4effbaa765 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b4d expref: 24 pid: 8380 timeout: 696 lvb_type: 0 00000100:00100000:2.0:1762166977.282650:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9547 00000100:00100000:2.0:1762166977.282659:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765450429568:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166977.282670:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166977.282688:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc6220e00/0x2f180c4effbaa765 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b4d expref: 24 pid: 8380 timeout: 696 lvb_type: 0 00010000:00010000:2.0:1762166977.282700:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc6220e00/0x2f180c4effbaa765 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b4d expref: 24 pid: 8380 timeout: 696 lvb_type: 0 00010000:00010000:2.0:1762166977.282721:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc6220e00/0x2f180c4effbaa765 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b4d expref: 24 pid: 8380 timeout: 696 lvb_type: 0 00010000:00010000:2.0:1762166977.282740:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166977.282742:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166977.282746:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc6220200/0x2f180c4effbaa83e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->180223] (req 0->180223) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.282754:0:7421:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc6220200/0x2f180c4effbaa83e lrc: 4/1,0 mode: PR/PR res: [0x280000400:0xa86:0x0].0x0 rrc: 3 type: EXT [0->180223] (req 0->180223) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.282780:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166977.282809:0:14623:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bc6220200/0x2f180c4effbaa83e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->180223] (req 0->180223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166977.282821:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765450429568:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 162us (285us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166977.282821:0:14623:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc6220200/0x2f180c4effbaa83e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->180223] (req 0->180223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166977.282839:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9547 00010000:00010000:1.0:1762166977.283929:0:14623:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc6220200/0x2f180c4effbaa83e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->180223] (req 0->180223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.283942:0:14623:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc6220200/0x2f180c4effbaa83e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->180223] (req 0->180223) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.283950:0:14623:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc6220200/0x2f180c4effbaa83e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->180223] (req 0->180223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.283957:0:14623:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc6220200 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166977.283961:0:14623:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc6220200/0x2f180c4effbaa83e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->180223] (req 0->180223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.283969:0:14623:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc6220200/0x2f180c4effbaa83e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->180223] (req 0->180223) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.283979:0:14623:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc6220200/0x2f180c4effbaa83e lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->180223] (req 0->180223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.283983:0:14623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc6220200/0x2f180c4effbaa83e lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->180223] (req 0->180223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166977.284030:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450429440:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 2766us (2869us total) trans 0 rc 177340/177340 00000100:00100000:1.0:1762166977.284041:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2204 00000100:00100000:3.0:1762166977.286029:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.286094:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450429696 00000100:00100000:1.0:1762166977.286107:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450429696 00000100:00100000:1.0:1762166977.286188:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2205 00000100:00100000:1.0:1762166977.286200:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+22:2416:x1847765450429696:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:1.0:1762166977.286243:0:14623:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc6221c00/0x2f180c4effbaa845 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.286264:0:14623:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc6221a00/0x2f180c4effbaa796 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b62 expref: 22 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.286274:0:14623:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166977.286276:0:14623:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166977.286280:0:14623:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc6221c00/0x2f180c4effbaa845 lrc: 4/1,0 mode: --/PR res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->180223] (req 0->180223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.286320:0:14623:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc6221a00/0x2f180c4effbaa796 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b62 expref: 22 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.286341:0:14623:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc6221a00/0x2f180c4effbaa796 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b62 expref: 22 pid: 8380 timeout: 696 lvb_type: 0 00000100:00100000:1.0:1762166977.286358:0:14623:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc6226300 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0000_UUID:14623:1847765449710336:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166977.286441:0:14623:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011c7300 going to sleep for 11 seconds 00000100:00100000:1.0:1762166977.287224:0:14623:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc6226300 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0000_UUID:14623:1847765449710336:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166977.287239:0:14623:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bc6221c00/0x2f180c4effbaa845 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->180223] (req 0->180223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166977.287538:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.287581:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450429824 00000100:00100000:2.0:1762166977.287593:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450429824 00010000:00010000:2.0:1762166977.287634:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc6221a00/0x2f180c4effbaa796 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b62 expref: 23 pid: 8380 timeout: 696 lvb_type: 0 00000100:00100000:2.0:1762166977.287673:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9548 00000100:00100000:2.0:1762166977.287684:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765450429824:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166977.287697:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166977.287715:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc6221a00/0x2f180c4effbaa796 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b62 expref: 23 pid: 8380 timeout: 696 lvb_type: 0 00010000:00010000:2.0:1762166977.287728:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc6221a00/0x2f180c4effbaa796 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b62 expref: 23 pid: 8380 timeout: 696 lvb_type: 0 00010000:00010000:2.0:1762166977.287756:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc6221a00/0x2f180c4effbaa796 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b62 expref: 23 pid: 8380 timeout: 696 lvb_type: 0 00010000:00010000:2.0:1762166977.287770:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166977.287772:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166977.287776:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc6221c00/0x2f180c4effbaa845 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->180223] (req 0->180223) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.287786:0:7421:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc6221c00/0x2f180c4effbaa845 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->180223] (req 0->180223) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.287820:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166977.287849:0:14623:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bc6221c00/0x2f180c4effbaa845 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->180223] (req 0->180223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.287862:0:14623:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc6221c00/0x2f180c4effbaa845 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->180223] (req 0->180223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166977.287874:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765450429824:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 191us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166977.287894:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9548 00010000:00010000:1.0:1762166977.288958:0:14623:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc6221c00/0x2f180c4effbaa845 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->180223] (req 0->180223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.288967:0:14623:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc6221c00/0x2f180c4effbaa845 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->180223] (req 0->180223) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.288972:0:14623:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc6221c00/0x2f180c4effbaa845 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->180223] (req 0->180223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.288977:0:14623:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc6221c00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166977.288979:0:14623:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc6221c00/0x2f180c4effbaa845 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->180223] (req 0->180223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.288985:0:14623:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc6221c00/0x2f180c4effbaa845 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->180223] (req 0->180223) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.288993:0:14623:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc6221c00/0x2f180c4effbaa845 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->180223] (req 0->180223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.288997:0:14623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc6221c00/0x2f180c4effbaa845 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->180223] (req 0->180223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166977.289043:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+21:2416:x1847765450429696:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 2847us (3022us total) trans 0 rc 177340/177340 00000100:00100000:1.0:1762166977.289049:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2205 00000100:00100000:3.0:1762166977.295448:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.295559:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450429952 00000100:00100000:2.0:1762166977.295573:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450429952 00000100:00100000:2.0:1762166977.295654:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 867 00000100:00100000:2.0:1762166977.295669:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+531:61845:x1847765450429952:12345-192.168.204.38@tcp:103:lfs.0 00010000:00010000:2.0:1762166977.295688:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166977.295720:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbaa829 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b93 expref: 531 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.295744:0:7421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166977.295750:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166977.295820:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+530:61845:x1847765450429952:12345-192.168.204.38@tcp:103:lfs.0 Request processed in 155us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166977.295833:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 867 00000100:00100000:3.0:1762166977.296830:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.296903:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450430208 00000100:00100000:1.0:1762166977.296914:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450430208 00000100:00100000:1.0:1762166977.296965:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11820 00000100:00100000:1.0:1762166977.296977:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7d2b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+530:61845:x1847765450430208:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:1.0:1762166977.297206:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7d2b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+531:61845:x1847765450430208:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 232us (391us total) trans 4294991982 rc 0/0 00000100:00100000:1.0:1762166977.297215:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11820 00000100:00100000:1.0:1762166977.298652:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1762166977.298673:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449710464:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1762166977.298715:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166977.298776:0:9167:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449710464 00000100:00100000:0.0:1762166977.298781:0:9167:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449710464 00000100:00100000:0.0:1762166977.298814:0:9167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1762166977.298819:0:9167:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6226300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+9:3636:x1847765449710464:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1762166977.298834:0:9167:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 57344 granted 484898112 pending 0 free 3917905920 avail 3686014976 00000100:00100000:0.0:1762166977.298889:0:9167:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6226300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+9:3636:x1847765449710464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 61us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166977.298897:0:9167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1762166977.298930:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449710464:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1762166977.299126:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.299172:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450430464 00000100:00100000:0.0:1762166977.299176:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450430464 00000100:00100000:0.0:1762166977.299202:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30398 00000100:00100000:0.0:1762166977.299209:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+531:61766:x1847765450430464:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:0.0:1762166977.299220:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166977.299234:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbaa84c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9b9a expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.299298:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbaa853 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166977.299308:0:6495:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbaa806 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b85 expref: 532 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.299315:0:6495:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbaa853 lrc: 4/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.299336:0:6495:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbaa806 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b85 expref: 532 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.299347:0:6495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbaa806 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b85 expref: 532 pid: 6495 timeout: 696 lvb_type: 0 00000100:00100000:0.0:1762166977.299358:0:6495:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7b23800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6495:1847765449710592:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166977.299415:0:6495:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc56bff00 going to sleep for 11 seconds 00000100:00100000:0.0:1762166977.300191:0:6495:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7b23800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6495:1847765449710592:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166977.300205:0:6495:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbaa853 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000100:00100000:3.0:1762166977.300469:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.300537:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450430592 00000100:00100000:2.0:1762166977.300545:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450430592 00010000:00010000:2.0:1762166977.300578:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbaa806 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b85 expref: 533 pid: 6495 timeout: 696 lvb_type: 0 00000100:00100000:2.0:1762166977.300619:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9549 00000100:00100000:2.0:1762166977.300628:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+533:2419:x1847765450430592:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166977.300642:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166977.300648:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbaa806 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b85 expref: 533 pid: 6495 timeout: 696 lvb_type: 0 00010000:00010000:2.0:1762166977.300661:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbaa806 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b85 expref: 533 pid: 6495 timeout: 696 lvb_type: 0 00010000:00010000:2.0:1762166977.300680:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbaa806 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b85 expref: 533 pid: 6495 timeout: 696 lvb_type: 0 00010000:00010000:2.0:1762166977.300696:0:7421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166977.300700:0:7421:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbaa853 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166977.300711:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbaa853 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166977.300719:0:7421:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbaa853 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166977.300744:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166977.300767:0:6495:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbaa853 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.300777:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbaa853 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000100:00100000:2.0:1762166977.300784:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+532:2419:x1847765450430592:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 158us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166977.300790:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9549 00000004:00200000:0.0:1762166977.300801:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 177340 00010000:00010000:0.0:1762166977.300950:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbaa84c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b9a expref: 533 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.300966:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbaa853 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b9a expref: 532 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.300974:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166977.300978:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1762166977.300982:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bde000, rc 0) 00000100:00100000:0.0:1762166977.301017:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+532:61766:x1847765450430464:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 1808us (1894us total) trans 4294991983 rc 0/0 00000100:00100000:0.0:1762166977.301024:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30398 00000100:00100000:3.0:1762166977.302113:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.302196:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450430720 00000100:00100000:0.0:1762166977.302202:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450430720 00000100:00100000:0.0:1762166977.302240:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30399 00000100:00100000:0.0:1762166977.302248:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+532:61766:x1847765450430720:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:0.0:1762166977.302267:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166977.302282:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbaa861 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9ba1 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.302364:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbaa868 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166977.302376:0:6495:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbaa853 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b9a expref: 533 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.302385:0:6495:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbaa868 lrc: 4/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.302412:0:6495:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbaa853 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b9a expref: 533 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.302424:0:6495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbaa853 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b9a expref: 533 pid: 6495 timeout: 696 lvb_type: 0 00000100:00100000:0.0:1762166977.302439:0:6495:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7b23800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6495:1847765449710720:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166977.302536:0:6495:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc56bf6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166977.303162:0:6495:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7b23800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6495:1847765449710720:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166977.303181:0:6495:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbaa868 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000100:00100000:3.0:1762166977.303415:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.303455:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450430848 00000100:00100000:2.0:1762166977.303461:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450430848 00010000:00010000:2.0:1762166977.303512:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbaa853 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b9a expref: 534 pid: 6495 timeout: 696 lvb_type: 0 00000100:00100000:2.0:1762166977.303545:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9550 00000100:00100000:2.0:1762166977.303556:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+534:2419:x1847765450430848:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166977.303566:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166977.303572:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbaa853 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b9a expref: 534 pid: 6495 timeout: 696 lvb_type: 0 00010000:00010000:2.0:1762166977.303583:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbaa853 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b9a expref: 534 pid: 6495 timeout: 696 lvb_type: 0 00010000:00010000:2.0:1762166977.303600:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbaa853 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b9a expref: 534 pid: 6495 timeout: 696 lvb_type: 0 00010000:00010000:2.0:1762166977.303609:0:7421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166977.303611:0:7421:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbaa868 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166977.303617:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbaa868 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166977.303620:0:7421:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbaa868 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166977.303640:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166977.303657:0:6495:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbaa868 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.303664:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbaa868 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000100:00100000:2.0:1762166977.303670:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+533:2419:x1847765450430848:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 116us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166977.303676:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9550 00000004:00200000:0.0:1762166977.303696:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 177340 00000004:00200000:0.0:1762166977.303701:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166977.303715:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbaa868 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.303734:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbaa861 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ba1 expref: 533 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.303743:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbaa868 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ba1 expref: 532 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.303748:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166977.303750:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166977.303752:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdfa00, rc 0) 00000100:00100000:0.0:1762166977.303779:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+532:61766:x1847765450430720:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 1532us (1669us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166977.303785:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30399 00000100:00100000:3.0:1762166977.305037:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.305133:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450431104 00000100:00100000:1.0:1762166977.305140:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450431104 00000100:00100000:1.0:1762166977.305180:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11821 00000100:00100000:1.0:1762166977.305189:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+532:61766:x1847765450431104:12345-192.168.204.38@tcp:35:fsx.0 00000100:00100000:1.0:1762166977.305344:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+533:61766:x1847765450431104:12345-192.168.204.38@tcp:35:fsx.0 Request processed in 156us (309us total) trans 4294991984 rc 0/0 00000100:00100000:1.0:1762166977.305351:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11821 00000100:00100000:3.0:1762166977.306098:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.306139:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450431360 00000100:00100000:0.0:1762166977.306145:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450431360 00000100:00100000:0.0:1762166977.306186:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30400 00000100:00100000:0.0:1762166977.306194:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+533:61766:x1847765450431360:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:0.0:1762166977.306209:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166977.306212:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 1 00010000:00010000:0.0:1762166977.306231:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbaa814 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b8c expref: 533 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.306250:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbaa7ea lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b7e expref: 532 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.306261:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbaa868 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ba1 expref: 531 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.306271:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166977.306274:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166977.306285:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbaa86f lrc: 2/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9ba8 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.306322:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbaa876 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166977.306332:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbaa876 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.306340:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbaa876 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000040:00080000:0.0:1762166977.306628:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5895, 88 off461656 00000004:00080000:0.0:1762166977.306636:0:6495:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 596455157987ns, next at 595897461133ns, rc = 0 00000040:00080000:0.0:1762166977.306679:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5894, 88 off461656 00000004:00080000:0.0:1762166977.306685:0:6495:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 596455207382ns, next at 595897495953ns, rc = 0 00000040:00080000:0.0:1762166977.306711:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5895, 88 off461744 00000004:00080000:0.0:1762166977.306716:0:6495:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 596455238323ns, next at 595897495953ns, rc = 0 00000040:00080000:0.0:1762166977.306726:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5896, 88 off461744 00000004:00080000:0.0:1762166977.306729:0:6495:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 596455251164ns, next at 595897461133ns, rc = 0 00000040:00080000:0.0:1762166977.306742:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5896, 88 off461832 00000004:00080000:0.0:1762166977.306746:0:6495:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 596455268154ns, next at 595897495953ns, rc = 0 00000040:00080000:0.0:1762166977.306752:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5897, 88 off461832 00000004:00080000:0.0:1762166977.306755:0:6495:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 596455277539ns, next at 595897461133ns, rc = 0 00000040:00080000:0.0:1762166977.306764:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5897, 88 off461920 00000004:00080000:0.0:1762166977.306768:0:6495:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 596455289788ns, next at 595897495953ns, rc = 0 00000040:00080000:0.0:1762166977.306776:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5898, 88 off461920 00000004:00080000:0.0:1762166977.306779:0:6495:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 596455300779ns, next at 595897461133ns, rc = 0 00000001:00080000:3.0:1762166977.307854:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294991985 is committed 00000004:00080000:3.0:1762166977.307861:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3262 committed 00000004:00080000:3.0:1762166977.307875:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3265 committed 00000004:00080000:3.0:1762166977.307898:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3261 committed 00000004:00080000:3.0:1762166977.307901:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3264 committed 00000004:00080000:3.0:1762166977.307904:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3260 committed 00000004:00080000:3.0:1762166977.307906:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3263 committed 00000004:00080000:3.0:1762166977.307908:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3262 committed 00000004:00080000:3.0:1762166977.307910:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3259 committed 00000100:00100000:0.0:1762166977.307994:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc6224a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449711104:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166977.308000:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc6226d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449710976:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1762166977.308054:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449711232:0@lo:2:osp-syn-1-1.0 00010000:00010000:1.0:1762166977.308071:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbaa876 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ba8 expref: 526 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.308083:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00000100:00100000:3.0:1762166977.308086:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1762166977.308087:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1762166977.308099:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbaa86f lrc: 0/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ba8 expref: 526 pid: 6495 timeout: 0 lvb_type: 3 00000100:00100000:0.0:1762166977.308115:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449710848:0@lo:2:osp-syn-1-1.0 00010000:00010000:1.0:1762166977.308116:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbaa876 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ba8 expref: 525 pid: 6495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166977.308128:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1762166977.308152:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166977.308157:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000100:00100000:3.0:1762166977.308160:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc6224700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449711488:0@lo:2:osp-syn-0-1.0 00010000:00010000:1.0:1762166977.308162:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdf000, rc 0) 00000100:00100000:2.0:1762166977.308174:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449711744:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1762166977.308187:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166977.308227:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166977.308228:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+525:61766:x1847765450431360:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 2030us (2126us total) trans 4294991985 rc 0/0 00000100:00100000:1.0:1762166977.308240:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30400 00000100:00100000:0.0:1762166977.308243:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc6224000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449711360:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166977.308269:0:35248:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449710976 00000100:00100000:3.0:1762166977.308277:0:35248:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449710976 00000100:00100000:2.0:1762166977.308296:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449711232 00000100:00100000:0.0:1762166977.308302:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166977.308306:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449711232 00000100:00100000:3.0:1762166977.308332:0:35248:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449710848 00000100:00100000:3.0:1762166977.308339:0:35248:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449710848 00000100:00100000:2.0:1762166977.308352:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449711744 00000100:00100000:2.0:1762166977.308358:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449711744 00000100:00100000:3.0:1762166977.308376:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18940 00000100:00100000:1.0:1762166977.308386:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449711360 00000100:00100000:1.0:1762166977.308391:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449711360 00000100:00100000:2.0:1762166977.308406:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18941 00000100:00100000:2.0:1762166977.308425:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+15:3635:x1847765449711232:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1762166977.308425:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18942 00000100:00100000:1.0:1762166977.308444:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18943 00000100:00100000:0.0:1762166977.308451:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+15:3636:x1847765449710848:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166977.308454:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+10:3633:x1847765449710976:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1762166977.308467:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+15:3635:x1847765449711744:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:1.0:1762166977.308597:0:8380:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166977.308598:0:35247:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166977.308604:0:35248:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166977.308605:0:8380:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:2.0:1762166977.308606:0:35247:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:3.0:1762166977.308612:0:35248:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb mtime from disk: 1762166966 -> 1762166966 00002000:00010000:2.0:1762166977.308614:0:35247:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166977 -> 1762166977 00002000:00010000:1.0:1762166977.308614:0:8380:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb atime from disk: 1762166975 -> 1762166975 00002000:00010000:3.0:1762166977.308618:0:35248:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1762166977.308623:0:35247:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:3.0:1762166977.308624:0:35248:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb ctime from disk: 1762166966 -> 1762166966 00002000:00010000:1.0:1762166977.308624:0:8380:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:2.0:1762166977.308631:0:35247:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:1.0:1762166977.308632:0:8380:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa87:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:3.0:1762166977.308633:0:35248:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:0.0:1762166977.308670:0:35472:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 177340 -> 177340 00002000:00010000:0.0:1762166977.308676:0:35472:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:0.0:1762166977.308680:0:35472:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166977 -> 1762166977 00002000:00010000:0.0:1762166977.308683:0:35472:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:0.0:1762166977.308686:0:35472:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 344 -> 344 00000100:00100000:2.0:1762166977.308696:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+18:3635:x1847765449711232:12345-0@lo:2:osp-syn-1-1.0 Request processed in 273us (570us total) trans 17179876335 rc 0/0 00000100:00100000:1.0:1762166977.308696:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+18:3635:x1847765449711744:12345-0@lo:2:osp-syn-1-1.0 Request processed in 234us (470us total) trans 17179876336 rc 0/0 00000100:00100000:3.0:1762166977.308702:0:35248:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+11:3633:x1847765449710976:12345-0@lo:2:osp-syn-0-1.0 Request processed in 304us (617us total) trans 21474843284 rc 0/0 00000100:00100000:1.0:1762166977.308709:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18943 00000100:00100000:2.0:1762166977.308718:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18941 00000100:00100000:3.0:1762166977.308725:0:35248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18940 00000100:00100000:1.0:1762166977.308739:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18944 00000100:00100000:1.0:1762166977.308750:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+10:3636:x1847765449711360:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1762166977.308763:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+16:3636:x1847765449710848:12345-0@lo:2:osp-syn-1-1.0 Request processed in 320us (575us total) trans 17179876337 rc 0/0 00000100:00100000:0.0:1762166977.308772:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18942 00000004:00080000:2.0:1762166977.308847:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc5bc0380/2, rc 0, transno 17179876335 00000004:00080000:0.0:1762166977.308850:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc5bc3800/2, rc 0, transno 17179876337 00000100:00100000:2.0:1762166977.308865:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449711232:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1762166977.308865:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449710848:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1762166977.308877:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+11:3636:x1847765449711360:12345-0@lo:2:osp-syn-0-1.0 Request processed in 123us (576us total) trans 21474843285 rc 0/0 00000100:00100000:1.0:1762166977.308903:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18944 00000004:00080000:2.0:1762166977.308919:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf1cd0700/2, rc 0, transno 17179876336 00000004:00080000:0.0:1762166977.308925:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc6224000/2, rc 0, transno 21474843285 00000100:00100000:2.0:1762166977.308931:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449711744:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1762166977.308939:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc6224000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449711360:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1762166977.308941:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166977.308974:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166977.308993:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449711616:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166977.309021:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449711104 00000004:00080000:2.0:1762166977.309024:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc6226d80/2, rc 0, transno 21474843284 00000100:00100000:0.0:1762166977.309025:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449711488 00000100:00100000:3.0:1762166977.309028:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449711104 00000100:00100000:1.0:1762166977.309037:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166977.309037:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449711488 00000100:00100000:2.0:1762166977.309038:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc6226d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449710976:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166977.309069:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449711616 00000100:00100000:3.0:1762166977.309074:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449711616 00000100:00100000:0.0:1762166977.309104:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18945 00000100:00100000:2.0:1762166977.309114:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18946 00000100:00100000:0.0:1762166977.309123:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3d5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+12:3634:x1847765449711104:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1762166977.309125:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+12:3633:x1847765449711488:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1762166977.309125:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18947 00000100:00100000:1.0:1762166977.309149:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6225c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+16:3634:x1847765449711616:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:1.0:1762166977.309233:0:28434:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166977.309236:0:28434:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:1.0:1762166977.309238:0:28434:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb atime from disk: 1762166973 -> 1762166973 00002000:00010000:1.0:1762166977.309240:0:28434:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:1.0:1762166977.309243:0:28434:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa85:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1762166977.309261:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+14:3633:x1847765449711488:12345-0@lo:2:osp-syn-0-1.0 Request processed in 137us (287us total) trans 21474843286 rc 0/0 00002000:00010000:0.0:1762166977.309262:0:9165:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166977.309273:0:9165:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00000100:00100000:1.0:1762166977.309278:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6225c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+17:3634:x1847765449711616:12345-0@lo:2:osp-syn-1-1.0 Request processed in 137us (241us total) trans 17179876338 rc 0/0 00000100:00100000:2.0:1762166977.309283:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18946 00002000:00010000:0.0:1762166977.309289:0:9165:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166977 -> 1762166977 00000100:00100000:1.0:1762166977.309295:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18947 00000004:00080000:3.0:1762166977.309298:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc6224700/2, rc 0, transno 21474843286 00002000:00010000:0.0:1762166977.309302:0:9165:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00000100:00100000:3.0:1762166977.309309:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc6224700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449711488:0@lo:2:osp-syn-0-1.0 00002000:00010000:0.0:1762166977.309310:0:9165:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00000004:00080000:1.0:1762166977.309328:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf1cd2300/2, rc 0, transno 17179876338 00000100:00100000:1.0:1762166977.309334:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449711616:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1762166977.309376:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3d5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+13:3634:x1847765449711104:12345-0@lo:2:osp-syn-0-1.0 Request processed in 261us (439us total) trans 21474843287 rc 0/0 00000100:00100000:0.0:1762166977.309389:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18945 00000004:00080000:1.0:1762166977.309412:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc6224a80/2, rc 0, transno 21474843287 00000100:00100000:1.0:1762166977.309421:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc6224a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449711104:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166977.309964:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.310065:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450431488 00000100:00100000:0.0:1762166977.310071:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450431488 00000100:00100000:0.0:1762166977.310114:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18948 00000100:00100000:0.0:1762166977.310123:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+28:61766:x1847765450431488:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:0.0:1762166977.310134:0:9165:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166977.310147:0:9165:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbaa87d lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9baf expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.310176:0:9165:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbaa6e7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b1c expref: 29 pid: 9165 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166977.310185:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166977.310187:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166977.310191:0:9165:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbaa87d lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [163840->188415] (req 163840->188415) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9baf expref: 29 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.310221:0:9165:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbaa6e7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b1c expref: 29 pid: 9165 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166977.310235:0:9165:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbaa6e7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b1c expref: 29 pid: 9165 timeout: 696 lvb_type: 1 00000100:00100000:0.0:1762166977.310248:0:9165:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7b20700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9165:1847765449711872:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166977.310318:0:9165:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc56bf6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166977.311352:0:9165:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7b20700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9165:1847765449711872:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166977.311374:0:9165:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbaa87d lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [163840->188415] (req 163840->188415) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9baf expref: 29 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.311387:0:9165:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdf600, rc 0) 00000100:00100000:3.0:1762166977.311440:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.311473:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+29:61766:x1847765450431488:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 1349us (1511us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166977.311502:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18948 00000100:00100000:1.0:1762166977.311509:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450431616 00000100:00100000:1.0:1762166977.311515:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450431616 00010000:00010000:1.0:1762166977.311538:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbaa6e7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b1c expref: 29 pid: 9165 timeout: 696 lvb_type: 1 00000100:00100000:1.0:1762166977.311571:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9551 00000100:00100000:1.0:1762166977.311579:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff1a9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+29:2418:x1847765450431616:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166977.311738:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166977.311754:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbaa6e7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b1c expref: 29 pid: 9165 timeout: 696 lvb_type: 1 00010000:00010000:1.0:1762166977.311774:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbaa6e7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b1c expref: 29 pid: 9165 timeout: 696 lvb_type: 1 00010000:00010000:1.0:1762166977.311792:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbaa6e7 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b1c expref: 29 pid: 9165 timeout: 696 lvb_type: 1 00010000:00010000:1.0:1762166977.311803:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166977.311805:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166977.311811:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbaa87d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 163840->188415) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9baf expref: 28 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.311819:0:7421:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbaa87d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 163840->188415) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9baf expref: 28 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.311851:0:7421:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbaa87d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 163840->188415) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9baf expref: 28 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166977.311861:0:7421:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bb8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7421:1847765449712000:192.168.204.38@tcp:105: 00000100:00100000:1.0:1762166977.311919:0:7421:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011c7e40 going to sleep for 11 seconds 00000100:00100000:1.0:1762166977.313113:0:7421:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bb8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7421:1847765449712000:192.168.204.38@tcp:105: 00000100:00100000:3.0:1762166977.313116:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:1.0:1762166977.313128:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166977.313161:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff1a9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+28:2418:x1847765450431616:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1584us (1722us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166977.313168:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9551 00000100:00100000:2.0:1762166977.313182:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450431744 00000100:00100000:2.0:1762166977.313190:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450431744 00002000:00100000:2.0:1762166977.313228:0:14623:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xa77:0x0] (163840->167935) req@ffff945bc48a9500 x1847765450431744/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 488/0 e 0 to 0 dl 1762166988 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166977.313238:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc48a9500 with x1847765450431744 ext(163840->167935) 00002000:00010000:2.0:1762166977.313242:0:14623:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc48a9500 00000100:00100000:2.0:1762166977.313272:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2206 00000100:00100000:2.0:1762166977.313281:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+28:2417:x1847765450431744:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:2.0:1762166977.313412:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+28:2417:x1847765450431744:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 133us (302us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1762166977.313417:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2206 00002000:00100000:2.0:1762166977.313422:0:14623:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xa77:0x0] (163840->167935) req@ffff945bc48a9500 x1847765450431744/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 488/4536 e 0 to 0 dl 1762166988 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166977.313428:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc48a9500 with x1847765450431744 ext(163840->167935) 00002000:00010000:2.0:1762166977.313431:0:14623:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc48a9500 00000100:00100000:0.0:1762166977.314545:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.314600:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450431872 00000100:00100000:1.0:1762166977.314606:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450431872 00000100:00100000:1.0:1762166977.314646:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30401 00000100:00100000:1.0:1762166977.314655:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+525:61766:x1847765450431872:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:1.0:1762166977.314672:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166977.314690:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220200/0x2f180c4effbaa884 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9bb6 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.314776:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220800/0x2f180c4effbaa88b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166977.314791:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220800/0x2f180c4effbaa88b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.314801:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220800/0x2f180c4effbaa88b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:1.0:1762166977.314831:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 184500 00000004:00200000:1.0:1762166977.314836:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166977.314851:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220800/0x2f180c4effbaa88b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.314869:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220200/0x2f180c4effbaa884 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9bb6 expref: 527 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.314890:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220800/0x2f180c4effbaa88b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9bb6 expref: 526 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.314896:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166977.314898:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166977.314900:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc6220800, rc 0) 00000100:00100000:1.0:1762166977.314932:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+526:61766:x1847765450431872:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 279us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166977.314939:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30401 00000100:00100000:3.0:1762166977.316747:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.316811:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450432000 00000100:00100000:2.0:1762166977.316818:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450432000 00000100:00100000:2.0:1762166977.316866:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2207 00000100:00100000:2.0:1762166977.316876:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+28:2417:x1847765450432000:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:2.0:1762166977.317233:0:14623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 177340 -> 177340 00002000:00010000:2.0:1762166977.317237:0:14623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:2.0:1762166977.317239:0:14623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166977 -> 1762166977 00002000:00010000:2.0:1762166977.317241:0:14623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:2.0:1762166977.317243:0:14623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 344 -> 344 00000100:00100000:2.0:1762166977.317283:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+29:2417:x1847765450432000:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 410us (541us total) trans 17179876339 rc 0/0 00000100:00100000:2.0:1762166977.317291:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2207 00000100:00100000:3.0:1762166977.318629:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.318665:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450432256 00000100:00100000:1.0:1762166977.318671:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450432256 00000100:00100000:1.0:1762166977.318700:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30402 00000100:00100000:1.0:1762166977.318706:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+526:61766:x1847765450432256:12345-192.168.204.38@tcp:36:fsx.0 00010000:00010000:1.0:1762166977.318746:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1762166977.318769:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbaa876 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ba8 expref: 526 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.318784:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220800/0x2f180c4effbaa88b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9bb6 expref: 525 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.318800:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166977.318804:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166977.318950:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220c00/0x2f180c4effbaa892 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166977.318963:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220c00/0x2f180c4effbaa892 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.318969:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220c00/0x2f180c4effbaa892 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000001:00080000:1.0:1762166977.319000:0:6495:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294991986 00000004:00010000:1.0:1762166977.319016:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000b072b4f3 reply state 00000000ba54ddee transno 4294991987 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220c00/0x2f180c4effbaa892 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.319024:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220c00/0x2f180c4effbaa892 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.319028:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166977.319031:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166977.319032:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166977.319099:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+527:61766:x1847765450432256:12345-192.168.204.38@tcp:36:fsx.0 Request processed in 392us (471us total) trans 4294991987 rc 0/0 00000100:00100000:1.0:1762166977.319107:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30402 00000020:00080000:1.0:1762166977.319111:0:6495:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1762166977.319732:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.319774:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450432384 00000100:00100000:1.0:1762166977.319780:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450432384 00000100:00100000:1.0:1762166977.319810:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30403 00000100:00100000:1.0:1762166977.319818:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+527:61766:x1847765450432384:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:1.0:1762166977.319830:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166977.319839:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220000/0x2f180c4effbaa899 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9bbd expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.319867:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220000/0x2f180c4effbaa899 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9bbd expref: 528 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.319879:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220000/0x2f180c4effbaa899 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9bbd expref: 528 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.319907:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166977.319910:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166977.319913:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc6220000, rc 0) 00000100:00100000:1.0:1762166977.319943:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+528:61766:x1847765450432384:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 126us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166977.319949:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30403 00000100:00100000:3.0:1762166977.320772:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.320827:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450432512 00000100:00100000:0.0:1762166977.320833:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450432512 00000100:00100000:0.0:1762166977.320866:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18949 00000100:00100000:0.0:1762166977.320875:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+21:61766:x1847765450432512:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:0.0:1762166977.320900:0:9165:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166977.320911:0:9165:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfa00/0x2f180c4effbaa8a0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9bc4 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.320933:0:9165:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8e00/0x2f180c4effbaa6f5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b23 expref: 22 pid: 8380 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166977.320942:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166977.320944:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166977.320948:0:9165:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfa00/0x2f180c4effbaa8a0 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9bc4 expref: 22 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.320976:0:9165:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8e00/0x2f180c4effbaa6f5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b23 expref: 22 pid: 8380 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166977.320990:0:9165:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8e00/0x2f180c4effbaa6f5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b23 expref: 22 pid: 8380 timeout: 696 lvb_type: 1 00000100:00100000:0.0:1762166977.321004:0:9165:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7b22300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9165:1847765449712128:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166977.321067:0:9165:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc56bf6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166977.321900:0:9165:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7b22300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9165:1847765449712128:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166977.321902:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:0.0:1762166977.321930:0:9165:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfa00/0x2f180c4effbaa8a0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9bc4 expref: 22 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.321944:0:9165:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdfa00, rc 0) 00000100:00100000:1.0:1762166977.321965:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450432640 00000100:00100000:1.0:1762166977.321971:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450432640 00000100:00100000:0.0:1762166977.321989:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+23:61766:x1847765450432512:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 1115us (1218us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166977.322000:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8e00/0x2f180c4effbaa6f5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b23 expref: 23 pid: 8380 timeout: 696 lvb_type: 1 00000100:00100000:0.0:1762166977.322000:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18949 00000100:00100000:1.0:1762166977.322057:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9552 00000100:00100000:1.0:1762166977.322068:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765450432640:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166977.322076:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166977.322090:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8e00/0x2f180c4effbaa6f5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b23 expref: 22 pid: 8380 timeout: 696 lvb_type: 1 00010000:00010000:1.0:1762166977.322100:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8e00/0x2f180c4effbaa6f5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b23 expref: 22 pid: 8380 timeout: 696 lvb_type: 1 00010000:00010000:1.0:1762166977.322120:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8e00/0x2f180c4effbaa6f5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b23 expref: 22 pid: 8380 timeout: 696 lvb_type: 1 00010000:00010000:1.0:1762166977.322127:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166977.322129:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166977.322133:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfa00/0x2f180c4effbaa8a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9bc4 expref: 21 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.322139:0:7421:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfa00/0x2f180c4effbaa8a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9bc4 expref: 21 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.322156:0:7421:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfa00/0x2f180c4effbaa8a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9bc4 expref: 21 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166977.322163:0:7421:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bba680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7421:1847765449712256:192.168.204.38@tcp:105: 00000100:00100000:1.0:1762166977.322200:0:7421:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011c7000 going to sleep for 11 seconds 00000100:00100000:1.0:1762166977.322866:0:7421:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bba680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7421:1847765449712256:192.168.204.38@tcp:105: 00010000:00010000:1.0:1762166977.322876:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166977.322913:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450432640:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 850us (1035us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166977.322925:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9552 00000100:00100000:3.0:1762166977.323038:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.323092:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450432768 00000100:00100000:1.0:1762166977.323104:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450432768 00000100:00100000:1.0:1762166977.323144:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18950 00000100:00100000:1.0:1762166977.323157:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+29:61766:x1847765450432768:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:1.0:1762166977.323169:0:9165:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166977.323182:0:9165:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc6220a00/0x2f180c4effbaa8a7 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9bcb expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.323198:0:9165:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde800/0x2f180c4effbaa6ee lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b2a expref: 30 pid: 9165 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166977.323203:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166977.323205:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166977.323207:0:9165:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc6220a00/0x2f180c4effbaa8a7 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9bcb expref: 30 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.323229:0:9165:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde800/0x2f180c4effbaa6ee lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b2a expref: 30 pid: 9165 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166977.323236:0:9165:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde800/0x2f180c4effbaa6ee lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b2a expref: 30 pid: 9165 timeout: 696 lvb_type: 1 00000100:00100000:1.0:1762166977.323243:0:9165:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bba680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9165:1847765449712384:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166977.323282:0:9165:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011c7000 going to sleep for 11 seconds 00000100:00100000:1.0:1762166977.324010:0:9165:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bba680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9165:1847765449712384:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166977.324033:0:9165:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc6220a00/0x2f180c4effbaa8a7 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9bcb expref: 30 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.324047:0:9165:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc6220a00, rc 0) 00000100:00100000:1.0:1762166977.324084:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+30:61766:x1847765450432768:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 933us (1048us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166977.324092:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18950 00000100:00100000:3.0:1762166977.324244:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.324273:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450432896 00000100:00100000:1.0:1762166977.324278:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450432896 00010000:00010000:1.0:1762166977.324297:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde800/0x2f180c4effbaa6ee lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b2a expref: 30 pid: 9165 timeout: 696 lvb_type: 1 00000100:00100000:1.0:1762166977.324321:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9553 00000100:00100000:1.0:1762166977.324326:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4533480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+30:2419:x1847765450432896:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166977.324336:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166977.324352:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde800/0x2f180c4effbaa6ee lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b2a expref: 30 pid: 9165 timeout: 696 lvb_type: 1 00010000:00010000:1.0:1762166977.324360:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde800/0x2f180c4effbaa6ee lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b2a expref: 30 pid: 9165 timeout: 696 lvb_type: 1 00010000:00010000:1.0:1762166977.324377:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde800/0x2f180c4effbaa6ee lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9b2a expref: 30 pid: 9165 timeout: 696 lvb_type: 1 00010000:00010000:1.0:1762166977.324386:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166977.324387:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166977.324390:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc6220a00/0x2f180c4effbaa8a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9bcb expref: 29 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.324397:0:7421:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc6220a00/0x2f180c4effbaa8a7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9bcb expref: 29 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.324421:0:7421:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff945bc6220a00/0x2f180c4effbaa8a7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9bcb expref: 29 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166977.324430:0:7421:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bba680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7421:1847765449712512:192.168.204.38@tcp:105: 00000100:00100000:1.0:1762166977.324471:0:7421:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011c7000 going to sleep for 11 seconds 00000100:00100000:1.0:1762166977.325231:0:7421:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bba680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7421:1847765449712512:192.168.204.38@tcp:105: 00010000:00010000:1.0:1762166977.325248:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166977.325288:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4533480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+29:2419:x1847765450432896:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 960us (1044us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166977.325296:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9553 00000100:00100000:3.0:1762166977.325566:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166977.325617:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.325650:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450433024 00000100:00100000:2.0:1762166977.325659:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450433024 00000100:00100000:3.0:1762166977.325660:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.325667:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450433280 00000100:00100000:1.0:1762166977.325675:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450433280 00002000:00010000:2.0:1762166977.325693:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (238000->18446744073709551615) 00002000:00010000:1.0:1762166977.325695:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:2.0:1762166977.325699:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4531f80 with x1847765450433024 ext(238000->18446744073709551615) 00002000:00100000:1.0:1762166977.325701:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4532d80 with x1847765450433280 ext(0->18446744073709551615) 00002000:00010000:1.0:1762166977.325713:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4532d80. 00002000:00010000:2.0:1762166977.325714:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4531f80. 00000100:00100000:0.0:1762166977.325717:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450433152 00000100:00100000:0.0:1762166977.325723:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450433152 00002000:00010000:0.0:1762166977.325744:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:0.0:1762166977.325748:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4531500 with x1847765450433152 ext(0->18446744073709551615) 00000100:00100000:1.0:1762166977.325757:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2208 00002000:00010000:0.0:1762166977.325760:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc4531500. 00000100:00100000:1.0:1762166977.325778:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4532d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+30:2418:x1847765450433280:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:3.0:1762166977.325781:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2209 00000100:00100000:2.0:1762166977.325799:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2210 00000100:00100000:3.0:1762166977.325812:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4531f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+30:2418:x1847765450433024:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:2.0:1762166977.325824:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4531500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450433152:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:2.0:1762166977.325941:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166977.325942:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166977.325945:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:1.0:1762166977.325948:0:23943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:2.0:1762166977.325949:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166977 -> 1762166977 00002000:00010000:2.0:1762166977.325955:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:1.0:1762166977.325956:0:23943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166977 -> 1762166977 00002000:00010000:2.0:1762166977.325957:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00002000:00010000:1.0:1762166977.325963:0:23943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:1.0:1762166977.325967:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1762166977.325998:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4531500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450433152:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 182us (341us total) trans 21474843288 rc 0/0 00000100:00100000:1.0:1762166977.326003:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4532d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+31:2418:x1847765450433280:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 232us (382us total) trans 17179876340 rc 0/0 00000100:00100000:2.0:1762166977.326011:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2210 00002000:00010000:2.0:1762166977.326018:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:2.0:1762166977.326023:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4531500 with x1847765450433152 ext(0->18446744073709551615) 00000100:00100000:1.0:1762166977.326027:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2208 00002000:00010000:2.0:1762166977.326030:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc4531500. 00002000:00010000:1.0:1762166977.326032:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:1.0:1762166977.326040:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4532d80 with x1847765450433280 ext(0->18446744073709551615) 00002000:00010000:1.0:1762166977.326048:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4532d80. 00002000:00010000:3.0:1762166977.326083:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 177340 -> 238000 00002000:00010000:3.0:1762166977.326089:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:3.0:1762166977.326092:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166977 -> 1762166977 00002000:00010000:3.0:1762166977.326095:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:3.0:1762166977.326098:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 344 -> 344 00000100:00100000:3.0:1762166977.326140:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4531f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+31:2418:x1847765450433024:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 342us (575us total) trans 17179876341 rc 0/0 00000100:00100000:3.0:1762166977.326150:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2209 00002000:00010000:3.0:1762166977.326154:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (238000->18446744073709551615) 00002000:00100000:3.0:1762166977.326157:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4531f80 with x1847765450433024 ext(238000->18446744073709551615) 00002000:00010000:3.0:1762166977.326163:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4531f80. 00000100:00100000:3.0:1762166977.327388:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.327435:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450433408 00000100:00100000:1.0:1762166977.327442:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450433408 00000100:00100000:1.0:1762166977.327493:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30404 00000100:00100000:1.0:1762166977.327499:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4532300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+528:61766:x1847765450433408:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:1.0:1762166977.327510:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166977.327524:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221000/0x2f180c4effbaa8ae lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9bd2 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.327601:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa8b5 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166977.327614:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa8b5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.327625:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa8b5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:1.0:1762166977.327650:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 238000 00000004:00200000:1.0:1762166977.327653:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166977.327667:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa8b5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.327684:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221000/0x2f180c4effbaa8ae lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9bd2 expref: 530 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.327695:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa8b5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9bd2 expref: 529 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.327702:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166977.327705:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166977.327708:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc6221c00, rc 0) 00000100:00100000:1.0:1762166977.327753:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4532300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+529:61766:x1847765450433408:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 254us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166977.327761:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30404 00000100:00100000:0.0:1762166977.330301:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166977.330500:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450433536 00000100:00100000:3.0:1762166977.330509:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450433536 00000100:00100000:3.0:1762166977.330559:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2211 00000100:00100000:3.0:1762166977.330567:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+31:2419:x1847765450433536:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:3.0:1762166977.330693:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 238000 -> 238000 00002000:00010000:3.0:1762166977.330697:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:3.0:1762166977.330699:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166977 -> 1762166977 00002000:00010000:3.0:1762166977.330702:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:3.0:1762166977.330705:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 344 -> 344 00000100:00100000:3.0:1762166977.330750:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+32:2419:x1847765450433536:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 183us (455us total) trans 17179876342 rc 0/0 00000100:00100000:3.0:1762166977.330767:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2211 00000100:00100000:0.0:1762166977.333175:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166977.333240:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450433664 00000100:00100000:3.0:1762166977.333247:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450433664 00002000:00100000:3.0:1762166977.333281:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (221184->225279) req@ffff945bc7b23480 x1847765450433664/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 488/0 e 0 to 0 dl 1762166988 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166977.333293:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc7b23480 with x1847765450433664 ext(221184->225279) 00002000:00010000:3.0:1762166977.333298:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc7b23480 00000100:00100000:3.0:1762166977.333321:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2212 00000100:00100000:3.0:1762166977.333332:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+32:2419:x1847765450433664:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:3.0:1762166977.333533:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+32:2419:x1847765450433664:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 202us (363us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1762166977.333543:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2212 00002000:00100000:3.0:1762166977.333551:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (221184->225279) req@ffff945bc7b23480 x1847765450433664/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 488/4536 e 0 to 0 dl 1762166988 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166977.333560:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc7b23480 with x1847765450433664 ext(221184->225279) 00002000:00010000:3.0:1762166977.333565:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc7b23480 00000100:00100000:0.0:1762166977.334908:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166977.334998:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450433792 00000100:00100000:3.0:1762166977.335004:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450433792 00002000:00100000:3.0:1762166977.335028:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (196608->241663) req@ffff945bc7b21880 x1847765450433792/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 504/0 e 0 to 0 dl 1762166988 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166977.335037:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc7b21880 with x1847765450433792 ext(196608->241663) 00002000:00010000:3.0:1762166977.335048:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc7b21880 00000100:00100000:3.0:1762166977.335066:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2213 00000100:00100000:3.0:1762166977.335071:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+32:2419:x1847765450433792:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:3.0:1762166977.335957:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+32:2419:x1847765450433792:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 883us (1050us total) trans 0 rc 40960/40960 00000100:00100000:3.0:1762166977.335966:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2213 00002000:00100000:3.0:1762166977.335973:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (196608->241663) req@ffff945bc7b21880 x1847765450433792/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 504/440 e 0 to 0 dl 1762166988 ref 1 fl Complete:/600/0 rc 40960/40960 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166977.335982:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc7b21880 with x1847765450433792 ext(196608->241663) 00002000:00010000:3.0:1762166977.335986:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc7b21880 00000100:00100000:0.0:1762166977.338968:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.339017:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450434048 00000100:00100000:1.0:1762166977.339024:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450434048 00000100:00100000:1.0:1762166977.339068:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11822 00000100:00100000:1.0:1762166977.339078:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+529:61766:x1847765450434048:12345-192.168.204.38@tcp:35:fsx.0 00000100:00100000:1.0:1762166977.339262:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+530:61766:x1847765450434048:12345-192.168.204.38@tcp:35:fsx.0 Request processed in 187us (300us total) trans 4294991988 rc 0/0 00000100:00100000:1.0:1762166977.339268:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11822 00000100:00100000:0.0:1762166977.348121:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.348248:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450434304 00000100:00100000:1.0:1762166977.348258:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450434304 00000100:00100000:1.0:1762166977.348333:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30405 00000100:00100000:1.0:1762166977.348343:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+530:61846:x1847765450434304:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166977.348363:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166977.348382:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221000/0x2f180c4effbaa8bc lrc: 2/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9bd9 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.348451:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220800/0x2f180c4effbaa8c3 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166977.348461:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220800/0x2f180c4effbaa8c3 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.348471:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220800/0x2f180c4effbaa8c3 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.348503:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220200/0x2f180c4effbaa8ca lrc: 3/1,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166977.348508:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220200/0x2f180c4effbaa8ca lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.348512:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220200/0x2f180c4effbaa8ca lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.348617:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaa8d1 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166977.348624:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaa8d1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.348628:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaa8d1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:1.0:1762166977.348634:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 238000 00010000:00010000:1.0:1762166977.348699:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220800/0x2f180c4effbaa8c3 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.348706:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220800/0x2f180c4effbaa8c3 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.348712:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220800/0x2f180c4effbaa8c3 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.348718:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220800/0x2f180c4effbaa8c3 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.348724:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc6220800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166977.348729:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220800/0x2f180c4effbaa8c3 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.348736:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220800/0x2f180c4effbaa8c3 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.348747:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0x0 (ffff945bc812e700) 00010000:00010000:1.0:1762166977.348750:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166977.348755:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220800/0x2f180c4effbaa8c3 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.348760:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220800/0x2f180c4effbaa8c3 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.348771:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220200/0x2f180c4effbaa8ca lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.348775:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220200/0x2f180c4effbaa8ca lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.348778:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220200/0x2f180c4effbaa8ca lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.348781:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc6220200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166977.348782:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220200/0x2f180c4effbaa8ca lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.348785:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220200/0x2f180c4effbaa8ca lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.348789:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0xdd396665 (ffff945bc812ef00) 00010000:00010000:1.0:1762166977.348790:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166977.348792:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220200/0x2f180c4effbaa8ca lrc: 2/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.348798:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220200/0x2f180c4effbaa8ca lrc: 0/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.348828:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221000/0x2f180c4effbaa8bc lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9bd9 expref: 533 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.348837:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaa8d1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9bd9 expref: 532 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.348842:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166977.348844:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166977.348845:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc6221a00, rc 0) 00000100:00100000:1.0:1762166977.348908:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+532:61846:x1847765450434304:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 564us (794us total) trans 4294991989 rc 0/0 00000100:00100000:1.0:1762166977.348916:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30405 00000100:00100000:0.0:1762166977.350694:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.350748:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450434432 00000100:00100000:1.0:1762166977.350756:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450434432 00000100:00100000:1.0:1762166977.350802:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 868 00000100:00100000:1.0:1762166977.350812:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b21c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+532:2419:x1847765450434432:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166977.350826:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166977.350841:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaa8d1 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9bd9 expref: 532 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.350854:0:7421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166977.350857:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166977.350907:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b21c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+531:2419:x1847765450434432:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 97us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166977.350919:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 868 00000100:00100000:0.0:1762166977.351176:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.351216:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450434688 00000100:00100000:1.0:1762166977.351221:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450434688 00000100:00100000:1.0:1762166977.351253:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11823 00000100:00100000:1.0:1762166977.351261:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+531:61846:x1847765450434688:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:1.0:1762166977.351397:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+532:61846:x1847765450434688:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 137us (222us total) trans 4294991990 rc 0/0 00000100:00100000:1.0:1762166977.351404:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11823 00000100:00100000:0.0:1762166977.352799:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.352842:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450434944 00000100:00100000:1.0:1762166977.352848:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450434944 00000100:00100000:1.0:1762166977.352896:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30406 00000100:00100000:1.0:1762166977.352906:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb387800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+532:61846:x1847765450434944:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166977.352920:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166977.352938:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaa8df lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9be0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.353010:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221e00/0x2f180c4effbaa8e6 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166977.353023:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221e00/0x2f180c4effbaa8e6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.353034:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221e00/0x2f180c4effbaa8e6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:1.0:1762166977.353043:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 238000 00010000:00010000:1.0:1762166977.353108:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaa8df lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9be0 expref: 535 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.353127:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221e00/0x2f180c4effbaa8e6 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9be0 expref: 534 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.353135:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166977.353138:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1762166977.353141:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc6221e00, rc 0) 00000100:00100000:1.0:1762166977.353177:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb387800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+534:61846:x1847765450434944:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 273us (379us total) trans 4294991991 rc 0/0 00000100:00100000:1.0:1762166977.353184:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30406 00000100:00100000:0.0:1762166977.354734:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.354770:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450435200 00000100:00100000:1.0:1762166977.354775:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450435200 00000100:00100000:1.0:1762166977.354804:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30407 00000100:00100000:1.0:1762166977.354809:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb387480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+534:61846:x1847765450435200:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166977.354818:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166977.354825:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221000/0x2f180c4effbaa8f4 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9be7 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.354877:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220200/0x2f180c4effbaa8fb lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166977.354896:0:6495:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa8b5 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9bd2 expref: 535 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.354903:0:6495:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220200/0x2f180c4effbaa8fb lrc: 4/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.354927:0:6495:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa8b5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9bd2 expref: 535 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.354940:0:6495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa8b5 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9bd2 expref: 535 pid: 6495 timeout: 696 lvb_type: 0 00000100:00100000:1.0:1762166977.354954:0:6495:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bba680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6495:1847765449712640:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166977.355036:0:6495:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011c7000 going to sleep for 11 seconds 00000100:00100000:1.0:1762166977.355899:0:6495:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bba680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6495:1847765449712640:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166977.355917:0:6495:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220200/0x2f180c4effbaa8fb lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000100:00100000:0.0:1762166977.356090:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.356138:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450435328 00000100:00100000:1.0:1762166977.356143:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450435328 00010000:00010000:1.0:1762166977.356161:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa8b5 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9bd2 expref: 536 pid: 6495 timeout: 696 lvb_type: 0 00000100:00100000:1.0:1762166977.356193:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9554 00000100:00100000:1.0:1762166977.356205:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb385500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+536:2419:x1847765450435328:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166977.356220:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166977.356226:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa8b5 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9bd2 expref: 536 pid: 6495 timeout: 696 lvb_type: 0 00010000:00010000:1.0:1762166977.356237:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa8b5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9bd2 expref: 536 pid: 6495 timeout: 696 lvb_type: 0 00010000:00010000:1.0:1762166977.356251:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa8b5 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9bd2 expref: 536 pid: 6495 timeout: 696 lvb_type: 0 00010000:00010000:1.0:1762166977.356266:0:7421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166977.356270:0:7421:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220200/0x2f180c4effbaa8fb lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.356277:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220200/0x2f180c4effbaa8fb lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.356283:0:7421:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220200/0x2f180c4effbaa8fb lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.356304:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166977.356328:0:6495:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220200/0x2f180c4effbaa8fb lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.356336:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220200/0x2f180c4effbaa8fb lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000100:00100000:1.0:1762166977.356338:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb385500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+535:2419:x1847765450435328:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 136us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166977.356350:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9554 00000004:00200000:0.0:1762166977.356352:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 238000 00010000:00010000:0.0:1762166977.356425:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221000/0x2f180c4effbaa8f4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9be7 expref: 536 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.356436:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220200/0x2f180c4effbaa8fb lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9be7 expref: 535 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.356443:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166977.356446:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1762166977.356450:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc6220200, rc 0) 00000100:00100000:0.0:1762166977.356525:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb387480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+535:61846:x1847765450435200:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1714us (1791us total) trans 4294991992 rc 0/0 00000100:00100000:0.0:1762166977.356534:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30407 00000100:00100000:0.0:1762166977.357823:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.357870:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450435456 00000100:00100000:1.0:1762166977.357877:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450435456 00000100:00100000:1.0:1762166977.357936:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11824 00000100:00100000:1.0:1762166977.357945:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb384a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+535:61846:x1847765450435456:12345-192.168.204.38@tcp:33:lfs.0 00000100:00100000:1.0:1762166977.358058:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb384a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+535:61846:x1847765450435456:12345-192.168.204.38@tcp:33:lfs.0 Request processed in 114us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166977.358067:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11824 00000100:00100000:2.0:1762166977.358909:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.358958:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450435712 00000100:00100000:1.0:1762166977.358964:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450435712 00000100:00100000:1.0:1762166977.359003:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11825 00000100:00100000:1.0:1762166977.359010:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+535:61846:x1847765450435712:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:1.0:1762166977.359120:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+536:61846:x1847765450435712:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 110us (211us total) trans 4294991993 rc 0/0 00000100:00100000:1.0:1762166977.359130:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11825 00000100:00100000:3.0:1762166977.360271:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.360316:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450435968 00000100:00100000:0.0:1762166977.360323:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450435968 00000100:00100000:0.0:1762166977.360364:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30408 00000100:00100000:0.0:1762166977.360372:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4530a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+536:61846:x1847765450435968:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166977.360386:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166977.360390:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:0.0:1762166977.360409:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220200/0x2f180c4effbaa8fb lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9be7 expref: 536 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.360427:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221e00/0x2f180c4effbaa8e6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9be0 expref: 535 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.360437:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166977.360441:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166977.360452:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbaa909 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9bee expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.360540:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbaa910 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166977.360553:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbaa910 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.360561:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbaa910 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:0.0:1762166977.360569:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 238000 00010000:00010000:0.0:1762166977.360623:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbaa909 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9bee expref: 537 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.360635:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbaa910 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9bee expref: 536 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.360642:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166977.360645:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166977.360648:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdf200, rc 0) 00000100:00100000:0.0:1762166977.360683:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4530a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+536:61846:x1847765450435968:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 312us (414us total) trans 4294991994 rc 0/0 00000100:00100000:0.0:1762166977.360691:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30408 00000100:00100000:0.0:1762166977.361827:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.361866:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450436224 00000100:00100000:1.0:1762166977.361871:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450436224 00000100:00100000:1.0:1762166977.361915:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11826 00000100:00100000:1.0:1762166977.361922:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7d29850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+536:61846:x1847765450436224:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:1.0:1762166977.361956:0:6497:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x240000404:0x5eb:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbaa910 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9bee expref: 536 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.361977:0:6497:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaa91e lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 00010000:00010000:1.0:1762166977.361993:0:6497:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc606fc00/0x2f180c4effbaa065 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e98ad expref: 536 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.362002:0:6497:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220000/0x2f180c4effbaa899 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9bbd expref: 536 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.362008:0:6497:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaa91e lrc: 5/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166977.362035:0:6497:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220000/0x2f180c4effbaa899 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9bbd expref: 536 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.362047:0:6497:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220000/0x2f180c4effbaa899 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9bbd expref: 536 pid: 6495 timeout: 696 lvb_type: 0 00000100:00100000:1.0:1762166977.362058:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bba680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6497:1847765449712768:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166977.362129:0:6497:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc606fc00/0x2f180c4effbaa065 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e98ad expref: 536 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.362140:0:6497:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc606fc00/0x2f180c4effbaa065 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e98ad expref: 536 pid: 6494 timeout: 696 lvb_type: 0 00000100:00100000:1.0:1762166977.362151:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bb8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6497:1847765449712896:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166977.362180:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011c7300 going to sleep for 11 seconds 00010000:00010000:3.0:1762166977.362635:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166977.363124:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bba680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6497:1847765449712768:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166977.363136:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bb8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6497:1847765449712896:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166977.363154:0:6497:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaa91e lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00000100:00100000:3.0:1762166977.363441:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.363513:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450436352 00000100:00100000:1.0:1762166977.363520:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450436352 00000100:00100000:3.0:1762166977.363534:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:1.0:1762166977.363546:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc606fc00/0x2f180c4effbaa065 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e98ad expref: 537 pid: 6494 timeout: 696 lvb_type: 0 00000100:00100000:0.0:1762166977.363569:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450436480 00000100:00100000:1.0:1762166977.363577:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9555 00000100:00100000:0.0:1762166977.363577:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450436480 00000100:00100000:1.0:1762166977.363588:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4531c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+538:2418:x1847765450436352:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166977.363599:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166977.363601:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220000/0x2f180c4effbaa899 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9bbd expref: 538 pid: 6495 timeout: 696 lvb_type: 0 00010000:00010000:1.0:1762166977.363607:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc606fc00/0x2f180c4effbaa065 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e98ad expref: 538 pid: 6494 timeout: 696 lvb_type: 0 00010000:00010000:1.0:1762166977.363624:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc606fc00/0x2f180c4effbaa065 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e98ad expref: 538 pid: 6494 timeout: 696 lvb_type: 0 00010000:00010000:1.0:1762166977.363637:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc606fc00/0x2f180c4effbaa065 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e98ad expref: 538 pid: 6494 timeout: 696 lvb_type: 0 00000100:00100000:0.0:1762166977.363652:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9556 00010000:00010000:1.0:1762166977.363657:0:7421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166977.363663:0:7421:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaa91e lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00000100:00100000:0.0:1762166977.363669:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4532a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+537:2419:x1847765450436480:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166977.363673:0:7421:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaa91e lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166977.363682:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166977.363683:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166977.363691:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220000/0x2f180c4effbaa899 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9bbd expref: 537 pid: 6495 timeout: 696 lvb_type: 0 00010000:00010000:0.0:1762166977.363705:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220000/0x2f180c4effbaa899 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9bbd expref: 537 pid: 6495 timeout: 696 lvb_type: 0 00010000:00010000:0.0:1762166977.363719:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220000/0x2f180c4effbaa899 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9bbd expref: 537 pid: 6495 timeout: 696 lvb_type: 0 00000100:00100000:1.0:1762166977.363732:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4531c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+536:2418:x1847765450436352:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 143us (292us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166977.363732:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166977.363741:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaa91e lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00000100:00100000:1.0:1762166977.363748:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9555 00010000:00010000:0.0:1762166977.363753:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaa91e lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166977.363761:0:6479:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaa91e lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166977.363791:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166977.363822:0:6497:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaa91e lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.363832:0:6497:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaa91e lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00000100:00100000:0.0:1762166977.363840:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4532a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+535:2419:x1847765450436480:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 175us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166977.363851:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9556 00010000:00010000:2.0:1762166977.364045:0:6497:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaa91e lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.364053:0:6497:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaa91e lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.364059:0:6497:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaa91e lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.364064:0:6497:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc6220e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166977.364068:0:6497:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaa91e lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.364075:0:6497:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaa91e lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.364083:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166977.364086:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1762166977.364090:0:6497:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaa91e lrc: 2/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.364100:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaa91e lrc: 0/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.364110:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166977.364113:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166977.364118:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbaa910 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9bee expref: 534 pid: 6495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166977.364213:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7d29850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+534:61846:x1847765450436224:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 2290us (2387us total) trans 4294991995 rc -22/-22 00000100:00100000:2.0:1762166977.364222:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11826 00000100:00100000:3.0:1762166977.365112:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.365163:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450436608 00000100:00100000:0.0:1762166977.365169:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450436608 00000100:00100000:0.0:1762166977.365202:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30409 00000100:00100000:0.0:1762166977.365208:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4530000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+534:61846:x1847765450436608:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166977.365224:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166977.365236:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbaa925 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9bf5 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.365273:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbaa925 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9bf5 expref: 535 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.365285:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbaa925 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9bf5 expref: 535 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.365295:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166977.365297:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166977.365299:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bde600, rc 0) 00000100:00100000:0.0:1762166977.365328:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4530000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+535:61846:x1847765450436608:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 121us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166977.365333:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30409 00000100:00100000:3.0:1762166977.366781:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.366828:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450436864 00000100:00100000:0.0:1762166977.366834:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450436864 00000100:00100000:0.0:1762166977.366867:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30410 00000100:00100000:0.0:1762166977.366874:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4530e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+535:61846:x1847765450436864:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166977.366896:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166977.366910:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbaa92c lrc: 2/0,0 mode: --/CW res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9bfc expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.367278:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbaa933 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x609:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166977.367287:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbaa933 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x609:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.367296:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbaa933 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x609:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:0.0:1762166977.367309:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x609:0x0]: returning size 0 00010000:00010000:0.0:1762166977.367346:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbaa92c lrc: 0/0,0 mode: --/CW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9bfc expref: 538 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.367361:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbaa933 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x609:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9bfc expref: 537 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.367368:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x609:0x0].0x0 (ffff945bc2e87900) 00010000:00010000:0.0:1762166977.367371:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166977.367373:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdea00, rc 0) 00000100:00100000:0.0:1762166977.367413:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4530e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+537:61846:x1847765450436864:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 539us (634us total) trans 4294991996 rc 0/0 00000100:00100000:0.0:1762166977.367420:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30410 00000100:00100000:3.0:1762166977.368582:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.368625:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450437120 00000100:00100000:0.0:1762166977.368631:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450437120 00000100:00100000:0.0:1762166977.368665:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30411 00000100:00100000:0.0:1762166977.368675:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4533b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+537:61846:x1847765450437120:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166977.368689:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166977.368699:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbaa941 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9c03 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.368754:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbaa948 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166977.368763:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbaa948 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.368771:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbaa948 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:0.0:1762166977.368779:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 238000 00010000:00010000:0.0:1762166977.368825:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbaa941 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c03 expref: 540 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.368837:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbaa948 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c03 expref: 539 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.368844:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166977.368846:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166977.368849:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bde800, rc 0) 00000100:00100000:0.0:1762166977.368896:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4533b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+539:61846:x1847765450437120:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 222us (316us total) trans 4294991997 rc 0/0 00000100:00100000:0.0:1762166977.368902:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30411 00000100:00100000:3.0:1762166977.369872:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.369925:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450437376 00000100:00100000:2.0:1762166977.369933:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450437376 00000100:00100000:2.0:1762166977.369971:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11827 00000100:00100000:2.0:1762166977.369979:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4533800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+539:61846:x1847765450437376:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:2.0:1762166977.370019:0:6497:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x240000404:0x5eb:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbaa948 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c03 expref: 539 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.370041:0:6497:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbaa956 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 00010000:00010000:2.0:1762166977.370052:0:6497:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbaa925 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9bf5 expref: 539 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.370060:0:6497:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbaa956 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.370088:0:6497:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbaa925 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9bf5 expref: 539 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.370102:0:6497:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbaa925 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9bf5 expref: 539 pid: 6495 timeout: 696 lvb_type: 0 00000100:00100000:2.0:1762166977.370114:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd2d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6497:1847765449713024:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166977.370178:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc56bff00 going to sleep for 11 seconds 00000100:00100000:2.0:1762166977.371032:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd2d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6497:1847765449713024:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166977.371047:0:6497:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbaa956 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00000100:00100000:3.0:1762166977.371246:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.371284:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450437504 00000100:00100000:0.0:1762166977.371288:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450437504 00010000:00010000:0.0:1762166977.371303:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbaa925 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9bf5 expref: 540 pid: 6495 timeout: 696 lvb_type: 0 00000100:00100000:0.0:1762166977.371330:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9557 00000100:00100000:0.0:1762166977.371335:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff1a8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+540:2418:x1847765450437504:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166977.371343:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166977.371347:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbaa925 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9bf5 expref: 540 pid: 6495 timeout: 696 lvb_type: 0 00010000:00010000:0.0:1762166977.371361:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbaa925 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9bf5 expref: 540 pid: 6495 timeout: 696 lvb_type: 0 00010000:00010000:0.0:1762166977.371375:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbaa925 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9bf5 expref: 540 pid: 6495 timeout: 696 lvb_type: 0 00010000:00010000:0.0:1762166977.371385:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166977.371390:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbaa956 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166977.371397:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbaa956 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166977.371403:0:6479:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbaa956 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166977.371426:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166977.371450:0:6497:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbaa956 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.371457:0:6497:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbaa956 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00000100:00100000:0.0:1762166977.371459:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff1a8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+539:2418:x1847765450437504:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 124us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166977.371466:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9557 00010000:00010000:2.0:1762166977.371469:0:6497:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbaa95d lrc: 3/0,1 mode: --/EX res: [0x240000404:0x609:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 00010000:00010000:2.0:1762166977.371499:0:6497:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbaa933 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x609:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9bfc expref: 538 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.371506:0:6497:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbaa95d lrc: 4/0,1 mode: --/EX res: [0x240000404:0x609:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.371525:0:6497:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbaa933 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x609:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9bfc expref: 538 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.371535:0:6497:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbaa933 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x609:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9bfc expref: 538 pid: 6495 timeout: 696 lvb_type: 0 00000100:00100000:2.0:1762166977.371551:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd2d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6497:1847765449713152:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166977.371599:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc56bff00 going to sleep for 11 seconds 00000100:00100000:2.0:1762166977.372286:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd2d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6497:1847765449713152:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166977.372296:0:6497:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbaa95d lrc: 3/0,1 mode: --/EX res: [0x240000404:0x609:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00000100:00100000:3.0:1762166977.372581:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.372642:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450437632 00000100:00100000:0.0:1762166977.372651:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450437632 00010000:00010000:0.0:1762166977.372684:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbaa933 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x609:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9bfc expref: 539 pid: 6495 timeout: 696 lvb_type: 0 00000100:00100000:0.0:1762166977.372728:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9558 00000100:00100000:0.0:1762166977.372740:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4530700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+539:2418:x1847765450437632:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166977.372753:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166977.372761:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbaa933 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x609:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9bfc expref: 539 pid: 6495 timeout: 696 lvb_type: 0 00010000:00010000:0.0:1762166977.372774:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbaa933 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x609:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9bfc expref: 539 pid: 6495 timeout: 696 lvb_type: 0 00010000:00010000:0.0:1762166977.372794:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbaa933 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x609:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9bfc expref: 539 pid: 6495 timeout: 696 lvb_type: 0 00010000:00010000:0.0:1762166977.372809:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x609:0x0].0x0 (ffff945bc2e87900) 00010000:00010000:0.0:1762166977.372815:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbaa95d lrc: 3/0,1 mode: --/EX res: [0x240000404:0x609:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166977.372824:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbaa95d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x609:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166977.372831:0:6479:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbaa95d lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x609:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166977.372861:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166977.372916:0:6497:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbaa95d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x609:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00000100:00100000:0.0:1762166977.372923:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4530700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+538:2418:x1847765450437632:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 184us (441us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166977.372929:0:6497:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbaa95d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x609:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00000100:00100000:0.0:1762166977.372938:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9558 00000100:00100000:2.0:1762166977.373335:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd2d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449713280:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762166977.373381:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166977.373411:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf3a33240 going to sleep for 11 seconds 00000100:00100000:3.0:1762166977.373431:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449713280 00000100:00100000:3.0:1762166977.373437:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449713280 00000100:00100000:3.0:1762166977.373473:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1326 00000100:00100000:3.0:1762166977.373514:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+17:6497:x1847765449713280:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166977.373599:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+17:6497:x1847765449713280:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 88us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166977.373612:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1326 00000100:00100000:2.0:1762166977.373637:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd2d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449713280:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762166977.373684:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd2d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449713408:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762166977.373709:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166977.373730:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf3a33240 going to sleep for 11 seconds 00000100:00100000:3.0:1762166977.373749:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449713408 00000100:00100000:3.0:1762166977.373754:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449713408 00000100:00100000:3.0:1762166977.373783:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1327 00000100:00100000:3.0:1762166977.373790:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+13:6497:x1847765449713408:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166977.373849:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+13:6497:x1847765449713408:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 60us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166977.373857:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1327 00000100:00100000:2.0:1762166977.373894:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd2d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449713408:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762166977.373951:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd2d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449713536:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762166977.373975:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166977.373996:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf3a33540 going to sleep for 11 seconds 00000100:00100000:3.0:1762166977.374023:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449713536 00000100:00100000:3.0:1762166977.374028:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449713536 00000100:00100000:3.0:1762166977.374060:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1328 00000100:00100000:3.0:1762166977.374066:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+13:6497:x1847765449713536:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166977.374120:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+13:6497:x1847765449713536:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 54us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166977.374129:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1328 00000100:00100000:2.0:1762166977.374159:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd2d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449713536:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762166977.374192:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd2d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449713664:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762166977.374214:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166977.374234:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf3a33540 going to sleep for 11 seconds 00000100:00100000:3.0:1762166977.374256:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449713664 00000100:00100000:3.0:1762166977.374261:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449713664 00000100:00100000:3.0:1762166977.374287:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1329 00000100:00100000:3.0:1762166977.374294:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+17:6497:x1847765449713664:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166977.374352:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+17:6497:x1847765449713664:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 58us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166977.374359:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1329 00000100:00100000:2.0:1762166977.374389:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd2d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449713664:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762166977.374450:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd2d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449713792:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762166977.374475:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166977.374519:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc56bff00 going to sleep for 11 seconds 00000100:00100000:3.0:1762166977.374605:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449713792 00000100:00100000:3.0:1762166977.374613:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449713792 00000100:00100000:3.0:1762166977.374655:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1330 00000100:00100000:3.0:1762166977.374665:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+13:6497:x1847765449713792:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166977.374772:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+13:6497:x1847765449713792:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 109us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166977.374780:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1330 00000100:00100000:2.0:1762166977.374844:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd2d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449713792:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762166977.374914:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd2d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449713920:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762166977.374946:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166977.374971:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ceffd4000 going to sleep for 11 seconds 00000100:00100000:3.0:1762166977.375014:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449713920 00000100:00100000:3.0:1762166977.375020:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449713920 00000100:00100000:3.0:1762166977.375051:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1331 00000100:00100000:3.0:1762166977.375058:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+17:6497:x1847765449713920:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166977.375120:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+17:6497:x1847765449713920:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 62us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166977.375129:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1331 00000100:00100000:2.0:1762166977.375148:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd2d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449713920:0@lo:1000:mdt_rdpg00_000.0 00000040:00080000:2.0:1762166977.375306:0:6497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x2:0x0].43, 368 off64656 00000001:00080000:2.0:1762166977.375318:0:6497:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294991998 00000100:00100000:2.0:1762166977.375362:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd2d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449714048:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762166977.375379:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166977.375406:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf3a33a80 going to sleep for 11 seconds 00000100:00100000:3.0:1762166977.375433:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449714048 00000100:00100000:3.0:1762166977.375439:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449714048 00000100:00100000:3.0:1762166977.375466:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1332 00000100:00100000:3.0:1762166977.375474:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+17:6497:x1847765449714048:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166977.375595:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+18:6497:x1847765449714048:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 122us (214us total) trans 17179876343 rc 0/0 00000100:00100000:3.0:1762166977.375603:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1332 00000100:00100000:2.0:1762166977.375635:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd2d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449714048:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762166977.375659:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7b21c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449714176:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762166977.375682:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166977.375702:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ceffd4e40 going to sleep for 11 seconds 00000100:00100000:3.0:1762166977.375714:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449714176 00000100:00100000:3.0:1762166977.375719:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449714176 00000100:00100000:3.0:1762166977.375746:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1333 00000100:00100000:3.0:1762166977.375752:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+13:6497:x1847765449714176:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166977.375835:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+14:6497:x1847765449714176:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 82us (151us total) trans 21474843289 rc 0/0 00000100:00100000:3.0:1762166977.375841:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1333 00000100:00100000:2.0:1762166977.375870:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7b21c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449714176:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1762166977.375930:0:6497:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294991999 00010000:00010000:2.0:1762166977.375952:0:6497:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbaa95d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x609:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.375960:0:6497:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbaa95d lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x609:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.375966:0:6497:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbaa95d lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x609:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.375971:0:6497:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa9800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166977.375975:0:6497:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbaa95d lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x609:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.375982:0:6497:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbaa95d lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x609:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.375995:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x609:0x0].0x0 (ffff945bc2e87900) 00010000:00010000:2.0:1762166977.375998:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1762166977.376001:0:6497:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbaa95d lrc: 2/0,0 mode: --/EX res: [0x240000404:0x609:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.376006:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbaa95d lrc: 0/0,0 mode: --/EX res: [0x240000404:0x609:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.376023:0:6497:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbaa956 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.376029:0:6497:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbaa956 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.376034:0:6497:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbaa956 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.376045:0:6497:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa9c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166977.376047:0:6497:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbaa956 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.376054:0:6497:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbaa956 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.376060:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166977.376062:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1762166977.376065:0:6497:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbaa956 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.376070:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbaa956 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.376079:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166977.376082:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166977.376087:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbaa948 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c03 expref: 540 pid: 6495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166977.376152:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4533800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+539:61846:x1847765450437376:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 6174us (6282us total) trans 4294992000 rc 0/0 00000100:00100000:2.0:1762166977.376161:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11827 00000020:00080000:2.0:1762166977.376164:0:6497:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1762166977.377056:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.377092:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450437760 00000100:00100000:0.0:1762166977.377097:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450437760 00000100:00100000:0.0:1762166977.377133:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30412 00000100:00100000:0.0:1762166977.377141:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4533480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+539:61846:x1847765450437760:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166977.377156:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166977.377169:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbaa964 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9c0a expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.377210:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbaa964 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c0a expref: 540 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.377218:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbaa964 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c0a expref: 540 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.377227:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166977.377229:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166977.377231:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bde600, rc 0) 00000100:00100000:0.0:1762166977.377262:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4533480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+540:61846:x1847765450437760:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 123us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166977.377266:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30412 00000100:00100000:3.0:1762166977.378366:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.378414:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450437888 00000100:00100000:0.0:1762166977.378420:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450437888 00002000:00100000:0.0:1762166977.378450:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (163840->188415) req@ffff945bc4531c00 x1847765450437888/t0(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 488/0 e 0 to 0 dl 1762166988 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166977.378460:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4531c00 with x1847765450437888 ext(163840->188415) 00002000:00010000:0.0:1762166977.378464:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4531c00 00000100:00100000:0.0:1762166977.378534:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2214 00000100:00100000:0.0:1762166977.378545:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4531c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+32:2418:x1847765450437888:12345-192.168.204.38@tcp:4:fsx.0 00000100:00100000:0.0:1762166977.379842:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4531c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+34:2418:x1847765450437888:12345-192.168.204.38@tcp:4:fsx.0 Request processed in 1297us (1476us total) trans 17179876344 rc 0/0 00000100:00100000:0.0:1762166977.379852:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2214 00002000:00100000:0.0:1762166977.379863:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (163840->188415) req@ffff945bc4531c00 x1847765450437888/t17179876344(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 488/448 e 0 to 0 dl 1762166988 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166977.379878:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4531c00 with x1847765450437888 ext(163840->188415) 00002000:00010000:0.0:1762166977.379894:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4531c00 00000100:00100000:3.0:1762166977.380954:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.381013:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450438144 00000100:00100000:2.0:1762166977.381019:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450438144 00000100:00100000:2.0:1762166977.381066:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11828 00000100:00100000:2.0:1762166977.381079:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4532a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+540:61846:x1847765450438144:12345-192.168.204.38@tcp:35:lfs.0 00000004:00080000:2.0:1762166977.381308:0:6497:0:(mdd_object.c:3965:mdd_close()) Object [0x240000404:0x609:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1762166977.381362:0:6497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5898, 64 off461984 00000004:00080000:2.0:1762166977.381370:0:6497:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 596529891781ns, next at 597529889568ns, rc = 0 00000040:00080000:2.0:1762166977.381393:0:6497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5899, 64 off461984 00000004:00080000:2.0:1762166977.381399:0:6497:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 596529921043ns, next at 597529919700ns, rc = 0 00000001:00080000:2.0:1762166977.381404:0:6497:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992001 00010000:00010000:2.0:1762166977.381443:0:6497:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbaa96b lrc: 3/0,1 mode: --/PW res: [0x240000404:0x609:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 00010000:00010000:2.0:1762166977.381455:0:6497:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbaa96b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x609:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.381465:0:6497:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbaa96b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x609:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.381472:0:6497:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbaa96b lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x609:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.381558:0:6497:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbaa96b lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x609:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.381565:0:6497:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbaa96b lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x609:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.381586:0:6497:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1762166977.381623:0:10257:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1762166977.381631:0:10257:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbaa96b lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x609:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166977.381639:0:10257:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa8c00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166977.381643:0:10257:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbaa96b lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x609:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166977.381651:0:10257:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbaa96b lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x609:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166977.381664:0:10257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x609:0x0].0x0 (ffff945bc809b600) 00010000:00010000:0.0:1762166977.381667:0:10257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1762166977.381671:0:10257:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbaa96b lrc: 1/0,0 mode: --/PW res: [0x240000404:0x609:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166977.381676:0:10257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbaa96b lrc: 0/0,0 mode: --/PW res: [0x240000404:0x609:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166977.381692:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166977.381694:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166977.381696:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1762166977.381745:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4532a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+542:61846:x1847765450438144:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 666us (799us total) trans 4294992002 rc 0/0 00000100:00100000:2.0:1762166977.381754:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11828 00000020:00080000:2.0:1762166977.381767:0:6497:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1762166977.382545:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.382592:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450438400 00000100:00100000:2.0:1762166977.382599:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450438400 00000100:00100000:2.0:1762166977.382636:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11829 00000100:00100000:2.0:1762166977.382645:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+542:61846:x1847765450438400:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:2.0:1762166977.382795:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+543:61846:x1847765450438400:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 150us (250us total) trans 4294992003 rc 0/0 00000100:00100000:2.0:1762166977.382805:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11829 00000100:00100000:3.0:1762166977.391224:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.391286:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450438528 00000100:00100000:0.0:1762166977.391300:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450438528 00000100:00100000:0.0:1762166977.391364:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30413 00000100:00100000:0.0:1762166977.391375:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+543:61847:x1847765450438528:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166977.391398:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166977.391419:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbaa972 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9c11 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.391513:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbaa979 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166977.391525:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbaa979 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.391537:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbaa979 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.391549:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbaa980 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166977.391556:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbaa980 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.391562:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbaa980 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.391627:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbaa987 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166977.391636:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbaa987 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.391643:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbaa987 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:0.0:1762166977.391677:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 238000 00000004:00200000:0.0:1762166977.391681:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166977.391696:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbaa987 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.391714:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbaa987 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.391726:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbaa979 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.391732:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbaa979 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.391737:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbaa979 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.391743:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbaa979 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.391747:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdec00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166977.391750:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbaa979 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.391757:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbaa979 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.391767:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0x0 (ffff945bc2e87100) 00010000:00010000:0.0:1762166977.391770:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166977.391774:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbaa979 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.391780:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbaa979 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.391791:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbaa980 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.391797:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbaa980 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.391802:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbaa980 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.391807:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdf800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166977.391809:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbaa980 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.391814:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbaa980 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.391820:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0xdd396665 (ffff945bc2e87400) 00010000:00010000:0.0:1762166977.391822:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166977.391825:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbaa980 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.391831:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbaa980 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.391856:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbaa972 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c11 expref: 545 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.391870:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbaa987 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c11 expref: 544 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.391877:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166977.391894:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166977.391897:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bde000, rc 0) 00000100:00100000:0.0:1762166977.391958:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+544:61847:x1847765450438528:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 585us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166977.391965:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30413 00000100:00100000:3.0:1762166977.393471:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.393557:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450438784 00000100:00100000:0.0:1762166977.393566:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450438784 00000100:00100000:0.0:1762166977.393619:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30414 00000100:00100000:0.0:1762166977.393628:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+544:61847:x1847765450438784:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166977.393647:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166977.393662:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbaa98e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9c18 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.393733:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbaa995 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166977.393743:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbaa995 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.393752:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbaa995 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:0.0:1762166977.393761:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 238000 00010000:00010000:0.0:1762166977.393854:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbaa98e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c18 expref: 547 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.393867:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbaa995 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c18 expref: 546 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.393874:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166977.393877:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1762166977.393896:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bde200, rc 0) 00000100:00100000:0.0:1762166977.393941:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+546:61847:x1847765450438784:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 314us (474us total) trans 4294992004 rc 0/0 00000100:00100000:0.0:1762166977.393948:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30414 00000100:00100000:3.0:1762166977.395072:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.395141:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450439040 00000100:00100000:0.0:1762166977.395152:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450439040 00000100:00100000:0.0:1762166977.395207:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30415 00000100:00100000:0.0:1762166977.395218:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+546:61847:x1847765450439040:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166977.395244:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166977.395262:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbaa9a3 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9c1f expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.395356:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbaa9aa lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166977.395370:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbaa9aa lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.395380:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbaa9aa lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:0.0:1762166977.395391:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 238000 00010000:00010000:0.0:1762166977.395515:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbaa9a3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c1f expref: 549 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.395533:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbaa9aa lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c1f expref: 548 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.395541:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166977.395544:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166977.395547:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdf400, rc 0) 00000100:00100000:0.0:1762166977.395598:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+548:61847:x1847765450439040:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 382us (529us total) trans 4294992005 rc 0/0 00000100:00100000:0.0:1762166977.395606:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30415 00000100:00100000:3.0:1762166977.396925:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.396962:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450439168 00000100:00100000:0.0:1762166977.396968:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450439168 00000100:00100000:0.0:1762166977.397007:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 869 00000100:00100000:0.0:1762166977.397016:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+548:61847:x1847765450439168:12345-192.168.204.38@tcp:103:lfs.0 00010000:00010000:0.0:1762166977.397030:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166977.397046:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbaa9aa lrc: 0/0,0 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c1f expref: 548 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.397062:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166977.397066:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166977.397097:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+547:61847:x1847765450439168:12345-192.168.204.38@tcp:103:lfs.0 Request processed in 83us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166977.397104:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 869 00000100:00100000:3.0:1762166977.397698:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.397751:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450439424 00000100:00100000:2.0:1762166977.397761:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450439424 00000100:00100000:2.0:1762166977.397820:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11830 00000100:00100000:2.0:1762166977.397831:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+547:61847:x1847765450439424:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:2.0:1762166977.398074:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+548:61847:x1847765450439424:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 245us (375us total) trans 4294992006 rc 0/0 00000100:00100000:2.0:1762166977.398083:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11830 00000100:00100000:3.0:1762166977.399556:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.399583:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450439680 00000100:00100000:0.0:1762166977.399589:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450439680 00000100:00100000:0.0:1762166977.399617:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30416 00000100:00100000:0.0:1762166977.399623:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+548:61766:x1847765450439680:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:0.0:1762166977.399636:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166977.399646:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbaa9b8 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9c26 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.399701:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbaa9bf lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166977.399710:0:6495:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbaa987 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c11 expref: 549 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.399716:0:6495:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbaa9bf lrc: 4/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.399744:0:6495:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbaa987 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c11 expref: 549 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.399755:0:6495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbaa987 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c11 expref: 549 pid: 6495 timeout: 696 lvb_type: 0 00000100:00100000:0.0:1762166977.399766:0:6495:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcb385500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6495:1847765449714304:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166977.399840:0:6495:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc4eeab40 going to sleep for 11 seconds 00000100:00100000:0.0:1762166977.400517:0:6495:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcb385500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6495:1847765449714304:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166977.400538:0:6495:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbaa9bf lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000100:00100000:3.0:1762166977.400647:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.400678:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450439808 00000100:00100000:0.0:1762166977.400683:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450439808 00010000:00010000:0.0:1762166977.400699:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbaa987 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c11 expref: 550 pid: 6495 timeout: 696 lvb_type: 0 00000100:00100000:0.0:1762166977.400725:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9559 00000100:00100000:0.0:1762166977.400733:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+550:2418:x1847765450439808:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166977.400742:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166977.400748:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbaa987 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c11 expref: 550 pid: 6495 timeout: 696 lvb_type: 0 00010000:00010000:0.0:1762166977.400761:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbaa987 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c11 expref: 550 pid: 6495 timeout: 696 lvb_type: 0 00010000:00010000:0.0:1762166977.400777:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbaa987 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c11 expref: 550 pid: 6495 timeout: 696 lvb_type: 0 00010000:00010000:0.0:1762166977.400795:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166977.400799:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbaa9bf lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.400806:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbaa9bf lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.400812:0:6479:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbaa9bf lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.400833:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166977.400861:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+549:2418:x1847765450439808:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 129us (213us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166977.400865:0:6495:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbaa9bf lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000100:00100000:0.0:1762166977.400871:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9559 00010000:00010000:1.0:1762166977.400892:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbaa9bf lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:1.0:1762166977.400910:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 238000 00010000:00010000:1.0:1762166977.400998:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbaa9b8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c26 expref: 550 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.401009:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbaa9bf lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c26 expref: 549 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.401014:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166977.401016:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1762166977.401018:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdf800, rc 0) 00000100:00100000:1.0:1762166977.401050:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+549:61766:x1847765450439680:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 1426us (1496us total) trans 4294992007 rc 0/0 00000100:00100000:1.0:1762166977.401061:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30416 00000100:00100000:3.0:1762166977.401850:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.401891:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450439936 00000100:00100000:1.0:1762166977.401897:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450439936 00000100:00100000:1.0:1762166977.401929:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30417 00000100:00100000:1.0:1762166977.401939:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+549:61766:x1847765450439936:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:1.0:1762166977.401955:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166977.401967:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa9cd lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9c2d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.402028:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaa9d4 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166977.402039:0:6495:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbaa9bf lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c26 expref: 550 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.402047:0:6495:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaa9d4 lrc: 4/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.402069:0:6495:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbaa9bf lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c26 expref: 550 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.402081:0:6495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbaa9bf lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c26 expref: 550 pid: 6495 timeout: 696 lvb_type: 0 00000100:00100000:1.0:1762166977.402091:0:6495:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bb8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6495:1847765449714432:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166977.402138:0:6495:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011c7000 going to sleep for 11 seconds 00000100:00100000:1.0:1762166977.402728:0:6495:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bb8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6495:1847765449714432:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166977.402738:0:6495:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaa9d4 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000100:00100000:3.0:1762166977.402828:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.402859:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450440064 00000100:00100000:0.0:1762166977.402864:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450440064 00010000:00010000:0.0:1762166977.402891:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbaa9bf lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c26 expref: 551 pid: 6495 timeout: 696 lvb_type: 0 00000100:00100000:0.0:1762166977.402918:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9560 00000100:00100000:0.0:1762166977.402926:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+551:2419:x1847765450440064:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166977.402936:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166977.402940:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbaa9bf lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c26 expref: 551 pid: 6495 timeout: 696 lvb_type: 0 00010000:00010000:0.0:1762166977.402947:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbaa9bf lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c26 expref: 551 pid: 6495 timeout: 696 lvb_type: 0 00010000:00010000:0.0:1762166977.402960:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbaa9bf lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c26 expref: 551 pid: 6495 timeout: 696 lvb_type: 0 00010000:00010000:0.0:1762166977.402968:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166977.402970:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaa9d4 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.402975:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaa9d4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.402979:0:6479:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaa9d4 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.402992:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166977.403003:0:6495:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaa9d4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.403009:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaa9d4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000100:00100000:0.0:1762166977.403015:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+550:2419:x1847765450440064:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 90us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166977.403026:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9560 00000004:00200000:1.0:1762166977.403031:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 238000 00000004:00200000:1.0:1762166977.403037:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166977.403051:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaa9d4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.403074:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaa9cd lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c2d expref: 550 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.403090:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaa9d4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c2d expref: 549 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.403097:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166977.403101:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166977.403103:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc6221a00, rc 0) 00000100:00100000:1.0:1762166977.403131:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+549:61766:x1847765450439936:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 1194us (1281us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166977.403136:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30417 00000100:00100000:3.0:1762166977.404251:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.404300:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450440192 00000100:00100000:0.0:1762166977.404303:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450440192 00000100:00100000:0.0:1762166977.404349:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2215 00000100:00100000:0.0:1762166977.404354:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+34:2418:x1847765450440192:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:0.0:1762166977.404510:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 238000 -> 238000 00002000:00010000:0.0:1762166977.404514:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:0.0:1762166977.404517:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166977 -> 1762166977 00002000:00010000:0.0:1762166977.404520:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:0.0:1762166977.404522:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 344 -> 360 00000100:00100000:0.0:1762166977.404559:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+35:2418:x1847765450440192:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 203us (308us total) trans 17179876345 rc 0/0 00000100:00100000:0.0:1762166977.404566:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2215 00000100:00100000:3.0:1762166977.405865:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.405909:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450440320 00000100:00100000:1.0:1762166977.405913:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450440320 00000100:00100000:1.0:1762166977.405946:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30418 00000100:00100000:1.0:1762166977.405950:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+549:61766:x1847765450440320:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:1.0:1762166977.405961:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166977.405973:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220800/0x2f180c4effbaa9db lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9c34 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.405993:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221200/0x2f180c4effbaa9e2 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166977.406002:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221200/0x2f180c4effbaa9e2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.406010:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221200/0x2f180c4effbaa9e2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.406085:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220800/0x2f180c4effbaa9db lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c34 expref: 551 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.406095:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221200/0x2f180c4effbaa9e2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c34 expref: 550 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.406100:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166977.406103:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1762166977.406104:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc6221200, rc 0) 00000100:00100000:1.0:1762166977.406132:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+550:61766:x1847765450440320:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 182us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166977.406137:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30418 00000100:00100000:3.0:1762166977.406764:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.406798:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450440576 00000100:00100000:1.0:1762166977.406803:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450440576 00000100:00100000:1.0:1762166977.406837:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30419 00000100:00100000:1.0:1762166977.406846:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+550:61766:x1847765450440576:12345-192.168.204.38@tcp:36:fsx.0 00010000:00010000:1.0:1762166977.406892:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166977.406906:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaa9d4 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c2d expref: 550 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.406919:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166977.406922:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166977.407049:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221600/0x2f180c4effbaa9e9 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166977.407056:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221600/0x2f180c4effbaa9e9 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.407061:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221600/0x2f180c4effbaa9e9 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000001:00080000:1.0:1762166977.407095:0:6495:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992008 00000004:00010000:1.0:1762166977.407111:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000ccdff447 reply state 00000000dcc55a8b transno 4294992009 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221600/0x2f180c4effbaa9e9 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.407120:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221600/0x2f180c4effbaa9e9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.407124:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166977.407126:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166977.407128:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166977.407173:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+552:61766:x1847765450440576:12345-192.168.204.38@tcp:36:fsx.0 Request processed in 328us (408us total) trans 4294992009 rc 0/0 00000100:00100000:1.0:1762166977.407180:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30419 00000020:00080000:1.0:1762166977.407184:0:6495:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1762166977.408066:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166977.408086:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166977.408104:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.408123:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450440704 00000100:00100000:1.0:1762166977.408128:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450440832 00000100:00100000:0.0:1762166977.408129:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450440704 00000100:00100000:1.0:1762166977.408132:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450440832 00002000:00010000:1.0:1762166977.408152:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00010000:0.0:1762166977.408152:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (60536->18446744073709551615) 00002000:00100000:1.0:1762166977.408157:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc47b5880 with x1847765450440832 ext(0->18446744073709551615) 00002000:00100000:0.0:1762166977.408157:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc47b7800 with x1847765450440704 ext(60536->18446744073709551615) 00002000:00010000:1.0:1762166977.408167:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc47b5880. 00002000:00010000:0.0:1762166977.408167:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc47b7800. 00000100:00100000:2.0:1762166977.408170:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450440960 00000100:00100000:2.0:1762166977.408176:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450440960 00000100:00100000:0.0:1762166977.408195:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2216 00002000:00010000:2.0:1762166977.408199:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00000100:00100000:1.0:1762166977.408206:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2217 00002000:00100000:2.0:1762166977.408207:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc47b4000 with x1847765450440960 ext(0->18446744073709551615) 00000100:00100000:0.0:1762166977.408207:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+36:2418:x1847765450440704:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:1.0:1762166977.408215:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450440832:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:2.0:1762166977.408221:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc47b4000. 00000100:00100000:2.0:1762166977.408249:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2218 00000100:00100000:2.0:1762166977.408261:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+36:2418:x1847765450440960:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:1.0:1762166977.408317:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166977.408321:0:23943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:1.0:1762166977.408324:0:23943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166977 -> 1762166977 00002000:00010000:1.0:1762166977.408326:0:23943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:1.0:1762166977.408328:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00002000:00010000:2.0:1762166977.408356:0:14623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166977.408361:0:14623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:2.0:1762166977.408364:0:14623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166977 -> 1762166977 00002000:00010000:2.0:1762166977.408367:0:14623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:2.0:1762166977.408372:0:14623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1762166977.408373:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765450440832:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 157us (282us total) trans 21474843290 rc 0/0 00000100:00100000:1.0:1762166977.408382:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2217 00002000:00010000:1.0:1762166977.408386:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:1.0:1762166977.408389:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc47b5880 with x1847765450440832 ext(0->18446744073709551615) 00002000:00010000:1.0:1762166977.408394:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc47b5880. 00000100:00100000:2.0:1762166977.408403:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+37:2418:x1847765450440960:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 143us (296us total) trans 17179876346 rc 0/0 00000100:00100000:2.0:1762166977.408411:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2218 00002000:00010000:2.0:1762166977.408415:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:2.0:1762166977.408418:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc47b4000 with x1847765450440960 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166977.408423:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc47b4000. 00002000:00010000:0.0:1762166977.408724:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 238000 -> 60536 00002000:00010000:0.0:1762166977.408728:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:0.0:1762166977.408730:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166977 -> 1762166977 00002000:00010000:0.0:1762166977.408733:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:0.0:1762166977.408735:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 360 -> 128 00000100:00100000:0.0:1762166977.408763:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+37:2418:x1847765450440704:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 561us (697us total) trans 17179876347 rc 0/0 00000100:00100000:0.0:1762166977.408768:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2216 00002000:00010000:0.0:1762166977.408770:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (60536->18446744073709551615) 00002000:00100000:0.0:1762166977.408772:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc47b7800 with x1847765450440704 ext(60536->18446744073709551615) 00002000:00010000:0.0:1762166977.408775:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc47b7800. 00000100:00100000:3.0:1762166977.409800:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.409839:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450441088 00000100:00100000:1.0:1762166977.409844:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450441088 00000100:00100000:1.0:1762166977.409870:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30420 00000100:00100000:1.0:1762166977.409875:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+552:61766:x1847765450441088:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:1.0:1762166977.409899:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166977.409912:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221800/0x2f180c4effbaa9f0 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9c3b expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.409966:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220600/0x2f180c4effbaa9f7 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166977.409974:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220600/0x2f180c4effbaa9f7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.409981:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220600/0x2f180c4effbaa9f7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:1.0:1762166977.409996:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 60536 00000004:00200000:1.0:1762166977.410000:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166977.410011:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220600/0x2f180c4effbaa9f7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.410025:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221800/0x2f180c4effbaa9f0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c3b expref: 554 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.410035:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220600/0x2f180c4effbaa9f7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c3b expref: 553 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.410040:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166977.410042:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166977.410044:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc6220600, rc 0) 00000100:00100000:1.0:1762166977.410074:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+553:61766:x1847765450441088:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 199us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166977.410078:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30420 00000100:00100000:3.0:1762166977.411812:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.411873:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450441216 00000100:00100000:0.0:1762166977.411889:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450441216 00002000:00100000:0.0:1762166977.411933:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (53248->57343) req@ffff945bc47b4700 x1847765450441216/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 488/0 e 0 to 0 dl 1762166988 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166977.411947:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc47b4700 with x1847765450441216 ext(53248->57343) 00002000:00010000:0.0:1762166977.411954:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc47b4700 00000100:00100000:0.0:1762166977.411981:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2219 00000100:00100000:0.0:1762166977.411989:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+37:2418:x1847765450441216:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:0.0:1762166977.412149:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+37:2418:x1847765450441216:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 160us (339us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1762166977.412157:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2219 00002000:00100000:0.0:1762166977.412165:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (53248->57343) req@ffff945bc47b4700 x1847765450441216/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 488/4536 e 0 to 0 dl 1762166988 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166977.412174:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc47b4700 with x1847765450441216 ext(53248->57343) 00002000:00010000:0.0:1762166977.412178:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc47b4700 00000100:00100000:3.0:1762166977.413288:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.413331:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450441344 00000100:00100000:0.0:1762166977.413336:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450441344 00002000:00100000:0.0:1762166977.413352:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (57344->61439) req@ffff945ceda2df80 x1847765450441344/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 488/0 e 0 to 0 dl 1762166988 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166977.413359:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945ceda2df80 with x1847765450441344 ext(57344->61439) 00002000:00010000:0.0:1762166977.413362:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945ceda2df80 00000100:00100000:0.0:1762166977.413378:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2220 00000100:00100000:0.0:1762166977.413383:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+37:2419:x1847765450441344:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:0.0:1762166977.413458:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+37:2419:x1847765450441344:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 75us (171us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1762166977.413463:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2220 00002000:00100000:0.0:1762166977.413467:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (57344->61439) req@ffff945ceda2df80 x1847765450441344/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 488/4536 e 0 to 0 dl 1762166988 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166977.413473:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945ceda2df80 with x1847765450441344 ext(57344->61439) 00002000:00010000:0.0:1762166977.413504:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945ceda2df80 00000100:00100000:3.0:1762166977.415001:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.415057:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450441472 00000100:00100000:0.0:1762166977.415063:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450441472 00000100:00100000:0.0:1762166977.415103:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2221 00000100:00100000:0.0:1762166977.415110:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+37:2418:x1847765450441472:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:0.0:1762166977.415525:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 60536 -> 60536 00002000:00010000:0.0:1762166977.415529:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:0.0:1762166977.415532:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166977 -> 1762166977 00002000:00010000:0.0:1762166977.415534:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:0.0:1762166977.415536:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 128 -> 104 00000100:00100000:0.0:1762166977.415581:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+38:2418:x1847765450441472:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 470us (582us total) trans 17179876348 rc 0/0 00000100:00100000:0.0:1762166977.415586:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2221 00000100:00100000:3.0:1762166977.416904:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.416952:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450441728 00000100:00100000:2.0:1762166977.416958:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450441728 00000100:00100000:2.0:1762166977.416998:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11831 00000100:00100000:2.0:1762166977.417005:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7be7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+553:61766:x1847765450441728:12345-192.168.204.38@tcp:35:fsx.0 00000100:00100000:2.0:1762166977.417258:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7be7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+554:61766:x1847765450441728:12345-192.168.204.38@tcp:35:fsx.0 Request processed in 252us (379us total) trans 4294992010 rc 0/0 00000100:00100000:2.0:1762166977.417266:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11831 00000100:00100000:3.0:1762166977.424456:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.424535:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450441984 00000100:00100000:1.0:1762166977.424546:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450441984 00000100:00100000:1.0:1762166977.424612:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30421 00000100:00100000:1.0:1762166977.424623:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+554:61848:x1847765450441984:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166977.424646:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166977.424663:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221800/0x2f180c4effbaa9fe lrc: 2/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9c42 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.424728:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaaa05 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166977.424747:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaaa05 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.424757:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaaa05 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.424767:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220800/0x2f180c4effbaaa0c lrc: 3/1,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166977.424771:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220800/0x2f180c4effbaaa0c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.424774:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220800/0x2f180c4effbaaa0c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.424857:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaaa13 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166977.424863:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaaa13 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.424867:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaaa13 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:1.0:1762166977.424874:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 60536 00010000:00010000:1.0:1762166977.424950:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaaa05 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.424958:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaaa05 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.424963:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaaa05 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.424969:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaaa05 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.424976:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc6221a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166977.424980:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaaa05 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.424987:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaaa05 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.424997:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0x0 (ffff945bc812e700) 00010000:00010000:1.0:1762166977.425000:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166977.425004:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaaa05 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.425011:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaaa05 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.425022:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220800/0x2f180c4effbaaa0c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.425027:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220800/0x2f180c4effbaaa0c lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.425032:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220800/0x2f180c4effbaaa0c lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.425036:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc6220800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166977.425039:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220800/0x2f180c4effbaaa0c lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.425045:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220800/0x2f180c4effbaaa0c lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.425052:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0xdd396665 (ffff945bc812ef00) 00010000:00010000:1.0:1762166977.425055:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166977.425058:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220800/0x2f180c4effbaaa0c lrc: 2/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.425063:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220800/0x2f180c4effbaaa0c lrc: 0/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.425100:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221800/0x2f180c4effbaa9fe lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c42 expref: 557 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.425114:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaaa13 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c42 expref: 556 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.425121:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166977.425123:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166977.425126:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc6221c00, rc 0) 00000100:00100000:1.0:1762166977.425180:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+556:61848:x1847765450441984:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 560us (731us total) trans 4294992011 rc 0/0 00000100:00100000:1.0:1762166977.425195:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30421 00000100:00100000:3.0:1762166977.426301:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166977.426338:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.426364:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450442112 00000100:00100000:0.0:1762166977.426377:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450442112 00000100:00100000:2.0:1762166977.426400:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450442368 00000100:00100000:2.0:1762166977.426407:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450442368 00000100:00100000:0.0:1762166977.426448:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 870 00000100:00100000:0.0:1762166977.426460:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+557:2418:x1847765450442112:12345-192.168.204.38@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1762166977.426471:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11832 00000100:00100000:2.0:1762166977.426516:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+557:61848:x1847765450442368:12345-192.168.204.38@tcp:35:lfs.0 00010000:00010000:0.0:1762166977.426516:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166977.426548:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaaa13 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c42 expref: 557 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.426566:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166977.426571:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166977.426627:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+556:2418:x1847765450442112:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 171us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166977.426636:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 870 00000100:00100000:2.0:1762166977.426703:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+556:61848:x1847765450442368:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 194us (364us total) trans 4294992012 rc 0/0 00000100:00100000:2.0:1762166977.426712:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11832 00000100:00100000:3.0:1762166977.428591:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.428670:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450442624 00000100:00100000:1.0:1762166977.428679:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450442624 00000100:00100000:1.0:1762166977.428722:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30422 00000100:00100000:1.0:1762166977.428732:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+556:61848:x1847765450442624:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166977.428751:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166977.428770:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220400/0x2f180c4effbaaa21 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9c49 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.428848:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaaa28 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166977.428860:0:6495:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220600/0x2f180c4effbaa9f7 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c3b expref: 557 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.428868:0:6495:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaaa28 lrc: 4/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.428912:0:6495:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220600/0x2f180c4effbaa9f7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c3b expref: 557 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.428924:0:6495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220600/0x2f180c4effbaa9f7 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c3b expref: 557 pid: 6495 timeout: 696 lvb_type: 0 00000100:00100000:1.0:1762166977.428936:0:6495:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bb8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6495:1847765449714560:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166977.429010:0:6495:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7a779c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166977.429766:0:6495:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bb8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6495:1847765449714560:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166977.429783:0:6495:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaaa28 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000100:00100000:3.0:1762166977.430047:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.430091:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450442752 00000100:00100000:0.0:1762166977.430097:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450442752 00010000:00010000:0.0:1762166977.430122:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220600/0x2f180c4effbaa9f7 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c3b expref: 558 pid: 6495 timeout: 696 lvb_type: 0 00000100:00100000:0.0:1762166977.430154:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9561 00000100:00100000:0.0:1762166977.430163:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+558:2418:x1847765450442752:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166977.430175:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166977.430181:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220600/0x2f180c4effbaa9f7 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c3b expref: 558 pid: 6495 timeout: 696 lvb_type: 0 00010000:00010000:0.0:1762166977.430193:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220600/0x2f180c4effbaa9f7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c3b expref: 558 pid: 6495 timeout: 696 lvb_type: 0 00010000:00010000:0.0:1762166977.430210:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220600/0x2f180c4effbaa9f7 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c3b expref: 558 pid: 6495 timeout: 696 lvb_type: 0 00010000:00010000:0.0:1762166977.430224:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166977.430229:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaaa28 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.430239:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaaa28 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.430247:0:6479:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaaa28 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.430276:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166977.430295:0:6495:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaaa28 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.430306:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaaa28 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000100:00100000:0.0:1762166977.430316:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+557:2418:x1847765450442752:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 153us (271us total) trans 0 rc 0/0 00000004:00200000:1.0:1762166977.430321:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 60536 00000100:00100000:0.0:1762166977.430337:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9561 00010000:00010000:1.0:1762166977.430434:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220400/0x2f180c4effbaaa21 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c49 expref: 558 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.430452:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaaa28 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c49 expref: 557 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.430461:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166977.430465:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1762166977.430468:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc6221400, rc 0) 00000100:00100000:1.0:1762166977.430559:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+557:61848:x1847765450442624:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1828us (1972us total) trans 4294992013 rc 0/0 00000100:00100000:1.0:1762166977.430566:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30422 00000100:00100000:3.0:1762166977.431543:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.431600:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450442880 00000100:00100000:2.0:1762166977.431607:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450442880 00000100:00100000:2.0:1762166977.431640:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11833 00000100:00100000:2.0:1762166977.431646:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+557:61848:x1847765450442880:12345-192.168.204.38@tcp:33:lfs.0 00000100:00100000:2.0:1762166977.431731:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+557:61848:x1847765450442880:12345-192.168.204.38@tcp:33:lfs.0 Request processed in 83us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166977.431741:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11833 00000100:00100000:3.0:1762166977.432553:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.432594:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450443136 00000100:00100000:2.0:1762166977.432598:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450443136 00000100:00100000:2.0:1762166977.432630:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11834 00000100:00100000:2.0:1762166977.432638:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+557:61848:x1847765450443136:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:2.0:1762166977.432757:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+558:61848:x1847765450443136:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 119us (203us total) trans 4294992014 rc 0/0 00000100:00100000:2.0:1762166977.432764:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11834 00000100:00100000:3.0:1762166977.433982:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.434019:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450443392 00000100:00100000:1.0:1762166977.434024:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450443392 00000100:00100000:1.0:1762166977.434052:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30423 00000100:00100000:1.0:1762166977.434057:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+558:61848:x1847765450443392:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166977.434068:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166977.434071:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:1.0:1762166977.434087:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaaa28 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c49 expref: 558 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.434102:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbaa995 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c18 expref: 557 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.434108:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166977.434111:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166977.434119:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221800/0x2f180c4effbaaa36 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9c50 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.434169:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220800/0x2f180c4effbaaa3d lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166977.434177:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220800/0x2f180c4effbaaa3d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.434183:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220800/0x2f180c4effbaaa3d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:1.0:1762166977.434192:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 60536 00010000:00010000:1.0:1762166977.434236:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221800/0x2f180c4effbaaa36 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c50 expref: 559 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.434244:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220800/0x2f180c4effbaaa3d lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c50 expref: 558 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.434248:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166977.434250:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762166977.434251:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc6220800, rc 0) 00000100:00100000:1.0:1762166977.434277:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+558:61848:x1847765450443392:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 221us (298us total) trans 4294992015 rc 0/0 00000100:00100000:1.0:1762166977.434282:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30423 00000100:00100000:3.0:1762166977.435135:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.435180:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450443648 00000100:00100000:2.0:1762166977.435185:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450443648 00000100:00100000:2.0:1762166977.435211:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11835 00000100:00100000:2.0:1762166977.435228:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+558:61848:x1847765450443648:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:2.0:1762166977.435263:0:6497:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x240000404:0x5eb:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220800/0x2f180c4effbaaa3d lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c50 expref: 558 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.435283:0:6497:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbaaa4b lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 00010000:00010000:2.0:1762166977.435292:0:6497:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbaa964 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c0a expref: 558 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.435300:0:6497:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221200/0x2f180c4effbaa9e2 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c34 expref: 558 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.435307:0:6497:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbaaa4b lrc: 5/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.435334:0:6497:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221200/0x2f180c4effbaa9e2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c34 expref: 558 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.435343:0:6497:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221200/0x2f180c4effbaa9e2 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c34 expref: 558 pid: 6495 timeout: 696 lvb_type: 0 00000100:00100000:2.0:1762166977.435353:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7b22a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6497:1847765449714688:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166977.435419:0:6497:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbaa964 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c0a expref: 558 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.435428:0:6497:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbaa964 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c0a expref: 558 pid: 6495 timeout: 696 lvb_type: 0 00000100:00100000:2.0:1762166977.435434:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4533800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6497:1847765449714816:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166977.435454:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf3a33600 going to sleep for 11 seconds 00000100:00100000:2.0:1762166977.436105:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7b22a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6497:1847765449714688:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166977.436259:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4533800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6497:1847765449714816:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166977.436277:0:6497:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbaaa4b lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00000100:00100000:3.0:1762166977.436418:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.436475:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450443776 00000100:00100000:0.0:1762166977.436512:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450443776 00010000:00010000:0.0:1762166977.436545:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221200/0x2f180c4effbaa9e2 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c34 expref: 559 pid: 6495 timeout: 696 lvb_type: 0 00000100:00100000:0.0:1762166977.436578:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9562 00000100:00100000:0.0:1762166977.436587:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff1aa450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+559:2418:x1847765450443776:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166977.436602:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166977.436609:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221200/0x2f180c4effbaa9e2 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c34 expref: 559 pid: 6495 timeout: 696 lvb_type: 0 00010000:00010000:0.0:1762166977.436622:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221200/0x2f180c4effbaa9e2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c34 expref: 559 pid: 6495 timeout: 696 lvb_type: 0 00010000:00010000:0.0:1762166977.436642:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221200/0x2f180c4effbaa9e2 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c34 expref: 559 pid: 6495 timeout: 696 lvb_type: 0 00010000:00010000:0.0:1762166977.436657:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166977.436662:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbaaa4b lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166977.436670:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbaaa4b lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166977.436676:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166977.436727:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff1aa450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+558:2418:x1847765450443776:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 142us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166977.436737:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.436738:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9562 00000100:00100000:2.0:1762166977.436799:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450443904 00000100:00100000:2.0:1762166977.436805:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450443904 00010000:00010000:2.0:1762166977.436831:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbaa964 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c0a expref: 558 pid: 6495 timeout: 696 lvb_type: 0 00000100:00100000:2.0:1762166977.436864:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9563 00000100:00100000:2.0:1762166977.436874:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+558:2418:x1847765450443904:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166977.436894:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166977.436902:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbaa964 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c0a expref: 558 pid: 6495 timeout: 696 lvb_type: 0 00010000:00010000:2.0:1762166977.436912:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbaa964 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c0a expref: 558 pid: 6495 timeout: 696 lvb_type: 0 00010000:00010000:2.0:1762166977.436926:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbaa964 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c0a expref: 558 pid: 6495 timeout: 696 lvb_type: 0 00010000:00010000:2.0:1762166977.436943:0:7421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166977.436948:0:7421:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbaaa4b lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.436956:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbaaa4b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.436962:0:7421:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbaaa4b lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.436991:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166977.437022:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+557:2418:x1847765450443904:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 148us (282us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166977.437026:0:6497:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbaaa4b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00000100:00100000:2.0:1762166977.437036:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9563 00010000:00010000:1.0:1762166977.437050:0:6497:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbaaa4b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166977.437234:0:6497:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbaaa4b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166977.437243:0:6497:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbaaa4b lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166977.437254:0:6497:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbaaa4b lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166977.437260:0:6497:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa9c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166977.437264:0:6497:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbaaa4b lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166977.437272:0:6497:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbaaa4b lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166977.437283:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166977.437286:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1762166977.437290:0:6497:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbaaa4b lrc: 2/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166977.437296:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbaaa4b lrc: 0/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166977.437307:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166977.437310:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762166977.437320:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220800/0x2f180c4effbaaa3d lrc: 0/0,0 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c50 expref: 556 pid: 6495 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166977.437428:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+556:61848:x1847765450443648:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 2209us (2292us total) trans 4294992016 rc -22/-22 00000100:00100000:1.0:1762166977.437438:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11835 00000100:00100000:3.0:1762166977.438086:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.438144:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450444032 00000100:00100000:1.0:1762166977.438151:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450444032 00000100:00100000:1.0:1762166977.438199:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30424 00000100:00100000:1.0:1762166977.438207:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+556:61848:x1847765450444032:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166977.438222:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166977.438234:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaaa52 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9c57 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.438270:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaaa52 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c57 expref: 557 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.438285:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaaa52 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c57 expref: 557 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.438299:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166977.438301:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166977.438304:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc6221a00, rc 0) 00000100:00100000:1.0:1762166977.438342:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+557:61848:x1847765450444032:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 135us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166977.438348:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30424 00000100:00100000:3.0:1762166977.439861:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.439912:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450444288 00000100:00100000:1.0:1762166977.439917:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450444288 00000100:00100000:1.0:1762166977.439948:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30425 00000100:00100000:1.0:1762166977.439955:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+557:61848:x1847765450444288:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166977.439966:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166977.439979:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220400/0x2f180c4effbaaa59 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9c5e expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.440336:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaaa60 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x60a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166977.440346:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaaa60 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x60a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.440354:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaaa60 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x60a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:1.0:1762166977.440362:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x60a:0x0]: returning size 0 00010000:00010000:1.0:1762166977.440399:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220400/0x2f180c4effbaaa59 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c5e expref: 560 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.440416:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaaa60 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x60a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c5e expref: 559 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.440423:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x60a:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:1.0:1762166977.440425:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166977.440428:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc6221c00, rc 0) 00000100:00100000:1.0:1762166977.440463:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+559:61848:x1847765450444288:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 509us (605us total) trans 4294992017 rc 0/0 00000100:00100000:1.0:1762166977.440469:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30425 00000100:00100000:3.0:1762166977.441641:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.441677:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450444544 00000100:00100000:1.0:1762166977.441682:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450444544 00000100:00100000:1.0:1762166977.441729:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30426 00000100:00100000:1.0:1762166977.441737:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+559:61848:x1847765450444544:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166977.441751:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166977.441761:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220000/0x2f180c4effbaaa6e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9c65 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.441813:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221e00/0x2f180c4effbaaa75 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166977.441822:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221e00/0x2f180c4effbaaa75 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.441830:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221e00/0x2f180c4effbaaa75 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:1.0:1762166977.441838:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 60536 00010000:00010000:1.0:1762166977.441903:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220000/0x2f180c4effbaaa6e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c65 expref: 562 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.441917:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221e00/0x2f180c4effbaaa75 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c65 expref: 561 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.441923:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166977.441926:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762166977.441929:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc6221e00, rc 0) 00000100:00100000:1.0:1762166977.441963:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+561:61848:x1847765450444544:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 227us (323us total) trans 4294992018 rc 0/0 00000100:00100000:1.0:1762166977.441971:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30426 00000100:00100000:3.0:1762166977.442930:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.442966:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450444800 00000100:00100000:1.0:1762166977.442970:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450444800 00000100:00100000:1.0:1762166977.443000:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11836 00000100:00100000:1.0:1762166977.443007:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7be6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+561:61848:x1847765450444800:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:1.0:1762166977.443044:0:6497:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x240000404:0x5eb:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221e00/0x2f180c4effbaaa75 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c65 expref: 561 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.443063:0:6497:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221800/0x2f180c4effbaaa83 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 00010000:00010000:1.0:1762166977.443072:0:6497:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaaa52 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c57 expref: 561 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.443079:0:6497:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221800/0x2f180c4effbaaa83 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166977.443105:0:6497:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaaa52 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c57 expref: 561 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.443121:0:6497:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaaa52 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c57 expref: 561 pid: 6495 timeout: 696 lvb_type: 0 00000100:00100000:1.0:1762166977.443133:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bb8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6497:1847765449714944:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166977.443188:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7a779c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166977.443918:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bb8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6497:1847765449714944:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166977.443936:0:6497:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221800/0x2f180c4effbaaa83 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00000100:00100000:3.0:1762166977.444100:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.444157:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450444928 00000100:00100000:2.0:1762166977.444162:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450444928 00010000:00010000:2.0:1762166977.444186:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaaa52 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c57 expref: 562 pid: 6495 timeout: 696 lvb_type: 0 00000100:00100000:2.0:1762166977.444217:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9564 00000100:00100000:2.0:1762166977.444224:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+562:2418:x1847765450444928:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166977.444234:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166977.444241:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaaa52 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c57 expref: 562 pid: 6495 timeout: 696 lvb_type: 0 00010000:00010000:2.0:1762166977.444252:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaaa52 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c57 expref: 562 pid: 6495 timeout: 696 lvb_type: 0 00010000:00010000:2.0:1762166977.444270:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaaa52 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c57 expref: 562 pid: 6495 timeout: 696 lvb_type: 0 00010000:00010000:2.0:1762166977.444283:0:7421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166977.444286:0:7421:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221800/0x2f180c4effbaaa83 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.444293:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221800/0x2f180c4effbaaa83 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.444299:0:7421:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221800/0x2f180c4effbaaa83 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.444321:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166977.444352:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+561:2418:x1847765450444928:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 129us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166977.444361:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9564 00010000:00010000:1.0:1762166977.444399:0:6497:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221800/0x2f180c4effbaaa83 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166977.444414:0:6497:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221800/0x2f180c4effbaaa83 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166977.444428:0:6497:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaaa8a lrc: 3/0,1 mode: --/EX res: [0x240000404:0x60a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 00010000:00010000:1.0:1762166977.444439:0:6497:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaaa60 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x60a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c5e expref: 560 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.444446:0:6497:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaaa8a lrc: 4/0,1 mode: --/EX res: [0x240000404:0x60a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166977.444467:0:6497:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaaa60 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x60a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c5e expref: 560 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.444497:0:6497:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaaa60 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x60a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c5e expref: 560 pid: 6495 timeout: 696 lvb_type: 0 00000100:00100000:1.0:1762166977.444514:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bb8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6497:1847765449715072:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166977.444555:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7a779c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166977.445578:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bb8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6497:1847765449715072:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166977.445586:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:1.0:1762166977.445617:0:6497:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaaa8a lrc: 3/0,1 mode: --/EX res: [0x240000404:0x60a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00000100:00100000:2.0:1762166977.445713:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450445056 00000100:00100000:2.0:1762166977.445718:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450445056 00010000:00010000:2.0:1762166977.445734:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaaa60 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x60a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c5e expref: 561 pid: 6495 timeout: 696 lvb_type: 0 00000100:00100000:2.0:1762166977.445762:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9565 00000100:00100000:2.0:1762166977.445768:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+561:2418:x1847765450445056:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166977.445776:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166977.445781:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaaa60 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x60a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c5e expref: 561 pid: 6495 timeout: 696 lvb_type: 0 00010000:00010000:2.0:1762166977.445797:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaaa60 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x60a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c5e expref: 561 pid: 6495 timeout: 696 lvb_type: 0 00010000:00010000:2.0:1762166977.445811:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaaa60 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x60a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c5e expref: 561 pid: 6495 timeout: 696 lvb_type: 0 00010000:00010000:2.0:1762166977.445821:0:7421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x60a:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:2.0:1762166977.445824:0:7421:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaaa8a lrc: 3/0,1 mode: --/EX res: [0x240000404:0x60a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.445830:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaaa8a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x60a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.445835:0:7421:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaaa8a lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x60a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.445853:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166977.445872:0:6497:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaaa8a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x60a:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166977.445894:0:6497:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaaa8a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x60a:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00000100:00100000:2.0:1762166977.445898:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+560:2418:x1847765450445056:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 126us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166977.445910:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9565 00000100:00100000:1.0:1762166977.446201:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bb8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449715200:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762166977.446237:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166977.446262:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7a779c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166977.446284:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449715200 00000100:00100000:3.0:1762166977.446289:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449715200 00000100:00100000:3.0:1762166977.446325:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1334 00000100:00100000:3.0:1762166977.446334:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+18:6497:x1847765449715200:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166977.446420:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+18:6497:x1847765449715200:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 78us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166977.446429:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1334 00000100:00100000:1.0:1762166977.446439:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bb8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449715200:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762166977.446506:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bb8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449715328:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762166977.446533:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166977.446553:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cee083780 going to sleep for 11 seconds 00000100:00100000:3.0:1762166977.446575:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449715328 00000100:00100000:3.0:1762166977.446586:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449715328 00000100:00100000:3.0:1762166977.446618:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1335 00000100:00100000:3.0:1762166977.446625:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+14:6497:x1847765449715328:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166977.446680:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+14:6497:x1847765449715328:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 55us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166977.446687:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1335 00000100:00100000:1.0:1762166977.446712:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bb8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449715328:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762166977.446754:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783e300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449715456:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762166977.446776:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166977.446793:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cd123b480 going to sleep for 11 seconds 00000100:00100000:3.0:1762166977.446814:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449715456 00000100:00100000:3.0:1762166977.446818:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449715456 00000100:00100000:3.0:1762166977.446842:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1336 00000100:00100000:3.0:1762166977.446847:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+14:6497:x1847765449715456:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166977.446915:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+14:6497:x1847765449715456:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 68us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166977.446922:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1336 00000100:00100000:1.0:1762166977.446941:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783e300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449715456:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762166977.446974:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783e300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449715584:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762166977.446995:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166977.447014:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cd123ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1762166977.447024:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449715584 00000100:00100000:3.0:1762166977.447028:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449715584 00000100:00100000:3.0:1762166977.447052:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1337 00000100:00100000:3.0:1762166977.447058:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+18:6497:x1847765449715584:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166977.447111:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+18:6497:x1847765449715584:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 53us (114us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166977.447118:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1337 00000100:00100000:1.0:1762166977.447141:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783e300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449715584:0@lo:1000:mdt_rdpg00_000.0 00000040:00080000:1.0:1762166977.447256:0:6497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x2:0x0].44, 280 off64936 00000001:00080000:1.0:1762166977.447262:0:6497:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992019 00000100:00100000:1.0:1762166977.447298:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783e300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449715712:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762166977.447322:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166977.447340:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1c86c00 going to sleep for 11 seconds 00000100:00100000:3.0:1762166977.447363:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449715712 00000100:00100000:3.0:1762166977.447368:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449715712 00000100:00100000:3.0:1762166977.447394:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1338 00000100:00100000:3.0:1762166977.447401:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+18:6497:x1847765449715712:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166977.447521:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+19:6497:x1847765449715712:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 120us (197us total) trans 17179876349 rc 0/0 00000100:00100000:3.0:1762166977.447531:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1338 00000100:00100000:1.0:1762166977.447547:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783e300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449715712:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762166977.447572:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bb8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449715840:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762166977.447596:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166977.447614:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cca8ae300 going to sleep for 11 seconds 00000100:00100000:3.0:1762166977.447624:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449715840 00000100:00100000:3.0:1762166977.447629:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449715840 00000100:00100000:3.0:1762166977.447654:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1339 00000100:00100000:3.0:1762166977.447661:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+14:6497:x1847765449715840:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166977.447740:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+15:6497:x1847765449715840:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 79us (141us total) trans 21474843291 rc 0/0 00000100:00100000:3.0:1762166977.447748:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1339 00000100:00100000:1.0:1762166977.447755:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bb8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449715840:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1762166977.447794:0:6497:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992020 00010000:00010000:1.0:1762166977.447813:0:6497:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaaa8a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x60a:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166977.447821:0:6497:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaaa8a lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x60a:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166977.447827:0:6497:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaaa8a lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x60a:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166977.447833:0:6497:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc6221400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166977.447837:0:6497:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaaa8a lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x60a:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166977.447848:0:6497:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaaa8a lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x60a:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166977.447858:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x60a:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:1.0:1762166977.447861:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1762166977.447864:0:6497:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaaa8a lrc: 2/0,0 mode: --/EX res: [0x240000404:0x60a:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166977.447869:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaaa8a lrc: 0/0,0 mode: --/EX res: [0x240000404:0x60a:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166977.447899:0:6497:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221800/0x2f180c4effbaaa83 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166977.447906:0:6497:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221800/0x2f180c4effbaaa83 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166977.447911:0:6497:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221800/0x2f180c4effbaaa83 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166977.447915:0:6497:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc6221800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166977.447918:0:6497:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221800/0x2f180c4effbaaa83 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166977.447923:0:6497:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221800/0x2f180c4effbaaa83 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166977.447931:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166977.447933:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1762166977.447936:0:6497:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221800/0x2f180c4effbaaa83 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166977.447941:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221800/0x2f180c4effbaaa83 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166977.447952:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166977.447954:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762166977.447960:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221e00/0x2f180c4effbaaa75 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c65 expref: 562 pid: 6495 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166977.448019:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7be6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+561:61848:x1847765450444800:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 5013us (5091us total) trans 4294992021 rc 0/0 00000100:00100000:1.0:1762166977.448028:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11836 00000020:00080000:1.0:1762166977.448033:0:6497:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1762166977.448778:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.448832:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450445184 00000100:00100000:1.0:1762166977.448841:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450445184 00000100:00100000:1.0:1762166977.448900:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30427 00000100:00100000:1.0:1762166977.448908:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+561:61848:x1847765450445184:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166977.448927:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166977.448943:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220800/0x2f180c4effbaaa91 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9c6c expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.448985:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220800/0x2f180c4effbaaa91 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c6c expref: 562 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.448993:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220800/0x2f180c4effbaaa91 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c6c expref: 562 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.449005:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166977.449007:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166977.449010:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc6220800, rc 0) 00000100:00100000:1.0:1762166977.449048:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+562:61848:x1847765450445184:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 142us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166977.449054:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30427 00000100:00100000:3.0:1762166977.450011:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.450055:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450445440 00000100:00100000:1.0:1762166977.450060:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450445440 00000100:00100000:1.0:1762166977.450093:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11837 00000100:00100000:1.0:1762166977.450102:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+562:61848:x1847765450445440:12345-192.168.204.38@tcp:35:lfs.0 00000004:00080000:1.0:1762166977.450376:0:6497:0:(mdd_object.c:3965:mdd_close()) Object [0x240000404:0x60a:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1762166977.450440:0:6497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5899, 64 off462048 00000040:00080000:1.0:1762166977.450464:0:6497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5900, 64 off462048 00000001:00080000:1.0:1762166977.450471:0:6497:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992022 00010000:00010000:1.0:1762166977.450543:0:6497:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220200/0x2f180c4effbaaa98 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x60a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 00010000:00010000:1.0:1762166977.450554:0:6497:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220200/0x2f180c4effbaaa98 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x60a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166977.450563:0:6497:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220200/0x2f180c4effbaaa98 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x60a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166977.450571:0:6497:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220200/0x2f180c4effbaaa98 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x60a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166977.450577:0:6497:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220200/0x2f180c4effbaaa98 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x60a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166977.450582:0:6497:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220200/0x2f180c4effbaaa98 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x60a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166977.450602:0:6497:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1762166977.450649:0:7420:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1762166977.450656:0:7420:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220200/0x2f180c4effbaaa98 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x60a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166977.450661:0:7420:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc6220200 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166977.450665:0:7420:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220200/0x2f180c4effbaaa98 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x60a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166977.450670:0:7420:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220200/0x2f180c4effbaaa98 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x60a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166977.450679:0:7420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x60a:0x0].0x0 (ffff945bc812e300) 00010000:00010000:0.0:1762166977.450681:0:7420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1762166977.450683:0:7420:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220200/0x2f180c4effbaaa98 lrc: 1/0,0 mode: --/PW res: [0x240000404:0x60a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166977.450687:0:7420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220200/0x2f180c4effbaaa98 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x60a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166977.450705:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166977.450708:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166977.450711:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166977.450772:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+564:61848:x1847765450445440:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 670us (760us total) trans 4294992023 rc 0/0 00000100:00100000:1.0:1762166977.450781:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11837 00000020:00080000:1.0:1762166977.450786:0:6497:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1762166977.451387:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.451422:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450445696 00000100:00100000:1.0:1762166977.451428:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450445696 00000100:00100000:1.0:1762166977.451458:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11838 00000100:00100000:1.0:1762166977.451467:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+564:61848:x1847765450445696:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:1.0:1762166977.451615:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+565:61848:x1847765450445696:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 148us (227us total) trans 4294992024 rc 0/0 00000100:00100000:1.0:1762166977.451623:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11838 00000100:00100000:3.0:1762166977.453563:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.453599:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450445952 00000100:00100000:1.0:1762166977.453606:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450445952 00000100:00100000:1.0:1762166977.453642:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30428 00000100:00100000:1.0:1762166977.453650:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+565:61766:x1847765450445952:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:1.0:1762166977.453665:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166977.453680:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220000/0x2f180c4effbaaa9f lrc: 2/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9c73 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.453747:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220400/0x2f180c4effbaaaa6 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166977.453757:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220400/0x2f180c4effbaaaa6 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.453767:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220400/0x2f180c4effbaaaa6 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.453779:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaaaad lrc: 3/1,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166977.453785:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaaaad lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.453795:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaaaad lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.453873:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221000/0x2f180c4effbaaab4 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166977.453895:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221000/0x2f180c4effbaaab4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.453902:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221000/0x2f180c4effbaaab4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:1.0:1762166977.453911:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 60536 00010000:00010000:1.0:1762166977.453966:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220400/0x2f180c4effbaaaa6 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.453973:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220400/0x2f180c4effbaaaa6 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.453979:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220400/0x2f180c4effbaaaa6 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.453984:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220400/0x2f180c4effbaaaa6 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.453988:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc6220400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166977.453992:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220400/0x2f180c4effbaaaa6 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.453997:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220400/0x2f180c4effbaaaa6 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.454006:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0x0 (ffff945bc812e700) 00010000:00010000:1.0:1762166977.454009:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166977.454013:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220400/0x2f180c4effbaaaa6 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.454019:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220400/0x2f180c4effbaaaa6 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.454028:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaaaad lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.454033:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaaaad lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.454038:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaaaad lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.454042:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc6220e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166977.454045:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaaaad lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.454049:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaaaad lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.454055:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0xdd396665 (ffff945bc812e600) 00010000:00010000:1.0:1762166977.454058:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166977.454060:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaaaad lrc: 2/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.454065:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaaaad lrc: 0/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.454097:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220000/0x2f180c4effbaaa9f lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c73 expref: 568 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.454110:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221000/0x2f180c4effbaaab4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c73 expref: 567 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.454117:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166977.454120:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166977.454122:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc6221000, rc 0) 00000100:00100000:1.0:1762166977.454163:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+567:61766:x1847765450445952:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 514us (602us total) trans 4294992025 rc 0/0 00000100:00100000:1.0:1762166977.454170:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30428 00000100:00100000:3.0:1762166977.456156:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.456199:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450446080 00000100:00100000:1.0:1762166977.456204:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450446080 00000100:00100000:1.0:1762166977.456239:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30429 00000100:00100000:1.0:1762166977.456249:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+567:61766:x1847765450446080:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:1.0:1762166977.456267:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166977.456280:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaaac2 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9c7a expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.456306:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221200/0x2f180c4effbaaac9 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166977.456317:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221200/0x2f180c4effbaaac9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.456326:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221200/0x2f180c4effbaaac9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.456407:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaaac2 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c7a expref: 569 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.456419:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221200/0x2f180c4effbaaac9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c7a expref: 568 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.456428:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166977.456430:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1762166977.456432:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc6221200, rc 0) 00000100:00100000:1.0:1762166977.456462:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+568:61766:x1847765450446080:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 216us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166977.456466:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30429 00000100:00100000:0.0:1762166977.457662:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.457690:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450446336 00000100:00100000:1.0:1762166977.457695:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450446336 00000100:00100000:1.0:1762166977.457720:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30430 00000100:00100000:1.0:1762166977.457727:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb385500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+568:61766:x1847765450446336:12345-192.168.204.38@tcp:36:fsx.0 00010000:00010000:1.0:1762166977.457763:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166977.457781:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221000/0x2f180c4effbaaab4 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c73 expref: 568 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.457794:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166977.457798:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166977.457932:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220600/0x2f180c4effbaaad0 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166977.457940:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220600/0x2f180c4effbaaad0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.457945:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220600/0x2f180c4effbaaad0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000001:00080000:1.0:1762166977.457983:0:6495:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992026 00000004:00010000:1.0:1762166977.457998:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000042f22fbe reply state 0000000018885752 transno 4294992027 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220600/0x2f180c4effbaaad0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.458011:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220600/0x2f180c4effbaaad0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.458016:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166977.458018:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166977.458020:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166977.458077:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb385500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+570:61766:x1847765450446336:12345-192.168.204.38@tcp:36:fsx.0 Request processed in 349us (414us total) trans 4294992027 rc 0/0 00000100:00100000:1.0:1762166977.458085:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30430 00000020:00080000:1.0:1762166977.458090:0:6495:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1762166977.459098:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166977.459121:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.459170:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450446464 00000100:00100000:2.0:1762166977.459175:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450446592 00000100:00100000:0.0:1762166977.459176:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450446464 00000100:00100000:3.0:1762166977.459188:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.459192:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450446592 00002000:00010000:0.0:1762166977.459215:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (156659->18446744073709551615) 00002000:00100000:0.0:1762166977.459222:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1e6ca80 with x1847765450446464 ext(156659->18446744073709551615) 00002000:00010000:2.0:1762166977.459232:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00010000:0.0:1762166977.459234:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1e6ca80. 00000100:00100000:1.0:1762166977.459235:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450446720 00002000:00100000:2.0:1762166977.459237:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1e6c700 with x1847765450446592 ext(0->18446744073709551615) 00000100:00100000:1.0:1762166977.459244:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450446720 00002000:00010000:2.0:1762166977.459251:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945cf1e6c700. 00002000:00010000:1.0:1762166977.459262:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:1.0:1762166977.459267:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1e6f480 with x1847765450446720 ext(0->18446744073709551615) 00000100:00100000:0.0:1762166977.459272:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2222 00002000:00010000:1.0:1762166977.459276:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1e6f480. 00000100:00100000:0.0:1762166977.459285:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+39:2419:x1847765450446464:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:2.0:1762166977.459294:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2223 00000100:00100000:2.0:1762166977.459320:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765450446592:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:1.0:1762166977.459320:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2224 00000100:00100000:1.0:1762166977.459340:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+39:2418:x1847765450446720:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:1.0:1762166977.459446:0:14623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166977.459449:0:14623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:1.0:1762166977.459451:0:14623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166977 -> 1762166977 00002000:00010000:1.0:1762166977.459453:0:14623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:1.0:1762166977.459455:0:14623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:2.0:1762166977.459528:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:1.0:1762166977.459535:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+40:2418:x1847765450446720:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 199us (350us total) trans 17179876350 rc 0/0 00002000:00010000:2.0:1762166977.459537:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:2.0:1762166977.459552:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166977 -> 1762166977 00002000:00010000:2.0:1762166977.459558:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00000100:00100000:1.0:1762166977.459559:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2224 00002000:00010000:0.0:1762166977.459561:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 60536 -> 156659 00002000:00010000:1.0:1762166977.459567:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00010000:2.0:1762166977.459572:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00002000:00010000:0.0:1762166977.459572:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00100000:1.0:1762166977.459575:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1e6f480 with x1847765450446720 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166977.459585:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166977 -> 1762166977 00002000:00010000:0.0:1762166977.459588:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:0.0:1762166977.459590:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 104 -> 104 00002000:00010000:1.0:1762166977.459593:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1e6f480. 00000100:00100000:0.0:1762166977.459627:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+40:2419:x1847765450446464:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 343us (526us total) trans 17179876351 rc 0/0 00000100:00100000:0.0:1762166977.459635:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2222 00002000:00010000:0.0:1762166977.459638:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (156659->18446744073709551615) 00002000:00100000:0.0:1762166977.459642:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1e6ca80 with x1847765450446464 ext(156659->18446744073709551615) 00002000:00010000:0.0:1762166977.459647:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1e6ca80. 00000100:00100000:2.0:1762166977.459649:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+24:2418:x1847765450446592:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 343us (524us total) trans 21474843292 rc 0/0 00000100:00100000:2.0:1762166977.459662:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2223 00002000:00010000:2.0:1762166977.459668:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:2.0:1762166977.459671:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1e6c700 with x1847765450446592 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166977.459676:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945cf1e6c700. 00000100:00100000:3.0:1762166977.460774:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.460832:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450446848 00000100:00100000:2.0:1762166977.460837:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450446848 00002000:00100000:2.0:1762166977.460860:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (143360->147455) req@ffff945cf1e6d880 x1847765450446848/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 488/0 e 0 to 0 dl 1762166988 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166977.460868:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1e6d880 with x1847765450446848 ext(143360->147455) 00002000:00010000:2.0:1762166977.460872:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1e6d880 00000100:00100000:2.0:1762166977.460900:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2225 00000100:00100000:2.0:1762166977.460907:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+40:2417:x1847765450446848:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:2.0:1762166977.461047:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+40:2417:x1847765450446848:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 141us (277us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1762166977.461052:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2225 00002000:00100000:2.0:1762166977.461057:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (143360->147455) req@ffff945cf1e6d880 x1847765450446848/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 488/4536 e 0 to 0 dl 1762166988 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166977.461063:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1e6d880 with x1847765450446848 ext(143360->147455) 00002000:00010000:2.0:1762166977.461066:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1e6d880 00000100:00100000:3.0:1762166977.462135:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.462182:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450446976 00000100:00100000:2.0:1762166977.462188:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450446976 00002000:00100000:2.0:1762166977.462208:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (147456->151551) req@ffff945cf1e6e300 x1847765450446976/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 488/0 e 0 to 0 dl 1762166988 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166977.462215:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1e6e300 with x1847765450446976 ext(147456->151551) 00002000:00010000:2.0:1762166977.462218:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1e6e300 00000100:00100000:2.0:1762166977.462238:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2226 00000100:00100000:2.0:1762166977.462243:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+40:2419:x1847765450446976:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:2.0:1762166977.462314:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+40:2419:x1847765450446976:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 71us (179us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1762166977.462322:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2226 00002000:00100000:2.0:1762166977.462329:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (147456->151551) req@ffff945cf1e6e300 x1847765450446976/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 488/4536 e 0 to 0 dl 1762166988 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166977.462338:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1e6e300 with x1847765450446976 ext(147456->151551) 00002000:00010000:2.0:1762166977.462342:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1e6e300 00000100:00100000:3.0:1762166977.463507:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.463553:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450447104 00000100:00100000:2.0:1762166977.463559:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450447104 00002000:00100000:2.0:1762166977.463581:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (122880->159743) req@ffff945cf1e6e680 x1847765450447104/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 504/0 e 0 to 0 dl 1762166988 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166977.463590:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1e6e680 with x1847765450447104 ext(122880->159743) 00002000:00010000:2.0:1762166977.463593:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1e6e680 00000100:00100000:2.0:1762166977.463612:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2227 00000100:00100000:2.0:1762166977.463619:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+40:2419:x1847765450447104:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:2.0:1762166977.464374:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+40:2419:x1847765450447104:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 755us (869us total) trans 0 rc 28672/28672 00000100:00100000:2.0:1762166977.464381:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2227 00002000:00100000:2.0:1762166977.464387:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (122880->159743) req@ffff945cf1e6e680 x1847765450447104/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 504/440 e 0 to 0 dl 1762166988 ref 1 fl Complete:/600/0 rc 28672/28672 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166977.464393:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1e6e680 with x1847765450447104 ext(122880->159743) 00002000:00010000:2.0:1762166977.464396:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1e6e680 00000100:00100000:3.0:1762166977.465447:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.465537:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450447232 00000100:00100000:2.0:1762166977.465542:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450447232 00002000:00100000:2.0:1762166977.465558:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (143360->156658) req@ffff945bc5765880 x1847765450447232/t0(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 13792/0 e 0 to 0 dl 1762166988 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166977.465564:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5765880 with x1847765450447232 ext(143360->156658) 00002000:00010000:2.0:1762166977.465566:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5765880 00000100:00100000:2.0:1762166977.465583:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2228 00000100:00100000:2.0:1762166977.465591:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5765880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+40:2419:x1847765450447232:12345-192.168.204.38@tcp:4:fsx.0 00000100:00100000:2.0:1762166977.466099:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5765880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+42:2419:x1847765450447232:12345-192.168.204.38@tcp:4:fsx.0 Request processed in 509us (652us total) trans 17179876352 rc 0/0 00000100:00100000:2.0:1762166977.466109:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2228 00002000:00100000:2.0:1762166977.466116:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (143360->156658) req@ffff945bc5765880 x1847765450447232/t17179876352(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 13792/448 e 0 to 0 dl 1762166988 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166977.466125:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5765880 with x1847765450447232 ext(143360->156658) 00002000:00010000:2.0:1762166977.466130:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5765880 00000100:00100000:3.0:1762166977.466765:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.466802:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450447360 00000100:00100000:1.0:1762166977.466806:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450447360 00000100:00100000:1.0:1762166977.466834:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18951 00000100:00100000:1.0:1762166977.466840:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5765c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+42:2419:x1847765450447360:12345-192.168.204.38@tcp:16:fsx.0 00000001:00080000:2.0:1762166977.467741:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876352 is committed 00000001:00080000:2.0:1762166977.467762:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876349 is committed 00000100:00100000:1.0:1762166977.467907:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5765c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450447360:12345-192.168.204.38@tcp:16:fsx.0 Request processed in 1065us (1141us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166977.467913:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18951 00000100:00100000:3.0:1762166977.468815:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.468849:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450447488 00000100:00100000:1.0:1762166977.468855:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450447488 00000100:00100000:1.0:1762166977.468894:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30431 00000100:00100000:1.0:1762166977.468901:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+570:61766:x1847765450447488:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:1.0:1762166977.468921:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166977.468951:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221e00/0x2f180c4effbaaad7 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9c81 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.469029:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221800/0x2f180c4effbaaade lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166977.469040:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221800/0x2f180c4effbaaade lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.469051:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221800/0x2f180c4effbaaade lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:1.0:1762166977.469070:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 156659 00000004:00200000:1.0:1762166977.469073:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166977.469086:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221800/0x2f180c4effbaaade lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.469116:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221e00/0x2f180c4effbaaad7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c81 expref: 572 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.469135:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221800/0x2f180c4effbaaade lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c81 expref: 571 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.469145:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166977.469148:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166977.469152:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc6221800, rc 0) 00000100:00100000:1.0:1762166977.469179:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+571:61766:x1847765450447488:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 279us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166977.469186:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30431 00000100:00100000:3.0:1762166977.471357:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.471418:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450447616 00000100:00100000:2.0:1762166977.471428:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450447616 00002000:00100000:2.0:1762166977.471471:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (61440->122879) req@ffff945bc5767b80 x1847765450447616/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 488/0 e 0 to 0 dl 1762166988 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166977.471514:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5767b80 with x1847765450447616 ext(61440->122879) 00002000:00010000:2.0:1762166977.471519:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5767b80 00000100:00100000:2.0:1762166977.471544:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2229 00000100:00100000:2.0:1762166977.471551:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5767b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450447616:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:2.0:1762166977.472582:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5767b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450447616:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 1029us (1225us total) trans 0 rc 61440/61440 00000100:00100000:2.0:1762166977.472591:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2229 00002000:00100000:2.0:1762166977.472597:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (61440->122879) req@ffff945bc5767b80 x1847765450447616/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 488/440 e 0 to 0 dl 1762166988 ref 1 fl Complete:/600/0 rc 61440/61440 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166977.472604:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5767b80 with x1847765450447616 ext(61440->122879) 00002000:00010000:2.0:1762166977.472607:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5767b80 00000100:00100000:3.0:1762166977.473962:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.474027:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450447744 00000100:00100000:2.0:1762166977.474034:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450447744 00002000:00100000:2.0:1762166977.474070:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (32768->61439) req@ffff945bc5764e00 x1847765450447744/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 488/0 e 0 to 0 dl 1762166988 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166977.474081:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5764e00 with x1847765450447744 ext(32768->61439) 00002000:00010000:2.0:1762166977.474085:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5764e00 00000100:00100000:2.0:1762166977.474113:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2230 00000100:00100000:2.0:1762166977.474123:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5764e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450447744:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:2.0:1762166977.474849:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5764e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450447744:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 726us (886us total) trans 0 rc 28672/28672 00000100:00100000:2.0:1762166977.474862:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2230 00002000:00100000:2.0:1762166977.474871:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (32768->61439) req@ffff945bc5764e00 x1847765450447744/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 488/440 e 0 to 0 dl 1762166988 ref 1 fl Complete:/600/0 rc 28672/28672 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166977.474891:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5764e00 with x1847765450447744 ext(32768->61439) 00002000:00010000:2.0:1762166977.474895:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5764e00 00000100:00100000:3.0:1762166977.476013:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.476056:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450447872 00000100:00100000:2.0:1762166977.476062:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450447872 00002000:00100000:2.0:1762166977.476083:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (90112->98303) req@ffff945bc5768e00 x1847765450447872/t0(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 8680/0 e 0 to 0 dl 1762166988 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166977.476092:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5768e00 with x1847765450447872 ext(90112->98303) 00002000:00010000:2.0:1762166977.476095:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5768e00 00000100:00100000:2.0:1762166977.476116:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2231 00000100:00100000:2.0:1762166977.476125:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5768e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450447872:12345-192.168.204.38@tcp:4:fsx.0 00000100:00100000:2.0:1762166977.476628:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5768e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450447872:12345-192.168.204.38@tcp:4:fsx.0 Request processed in 504us (613us total) trans 17179876353 rc 0/0 00000100:00100000:2.0:1762166977.476637:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2231 00002000:00100000:2.0:1762166977.476645:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (90112->98303) req@ffff945bc5768e00 x1847765450447872/t17179876353(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 8680/448 e 0 to 0 dl 1762166988 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166977.476653:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5768e00 with x1847765450447872 ext(90112->98303) 00002000:00010000:2.0:1762166977.476657:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5768e00 00000100:00100000:3.0:1762166977.477397:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.477437:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450448000 00000100:00100000:2.0:1762166977.477441:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450448000 00000100:00100000:2.0:1762166977.477467:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2232 00000100:00100000:2.0:1762166977.477472:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5769180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450448000:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:2.0:1762166977.477741:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 156659 -> 156659 00002000:00010000:2.0:1762166977.477744:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:2.0:1762166977.477746:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166977 -> 1762166977 00002000:00010000:2.0:1762166977.477748:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:2.0:1762166977.477749:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 104 -> 232 00000100:00100000:2.0:1762166977.477775:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5769180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450448000:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 302us (380us total) trans 17179876354 rc 0/0 00000100:00100000:2.0:1762166977.477779:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2232 00000100:00100000:3.0:1762166977.478976:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.479047:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450448256 00000100:00100000:1.0:1762166977.479052:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450448256 00000100:00100000:1.0:1762166977.479095:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30432 00000100:00100000:1.0:1762166977.479105:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc576a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+571:61766:x1847765450448256:12345-192.168.204.38@tcp:36:fsx.0 00010000:00010000:1.0:1762166977.479160:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166977.479186:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221800/0x2f180c4effbaaade lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c81 expref: 571 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.479202:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166977.479205:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166977.479344:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221e00/0x2f180c4effbaaae5 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166977.479356:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221e00/0x2f180c4effbaaae5 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.479367:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221e00/0x2f180c4effbaaae5 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000001:00080000:1.0:1762166977.479401:0:6495:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992028 00000004:00010000:1.0:1762166977.479417:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000002755666c reply state 000000002d1f51cb transno 4294992029 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221e00/0x2f180c4effbaaae5 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.479425:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221e00/0x2f180c4effbaaae5 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.479430:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166977.479432:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166977.479434:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166977.479522:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc576a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+573:61766:x1847765450448256:12345-192.168.204.38@tcp:36:fsx.0 Request processed in 418us (548us total) trans 4294992029 rc 0/0 00000100:00100000:1.0:1762166977.479530:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30432 00000020:00080000:1.0:1762166977.479535:0:6495:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1762166977.480423:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166977.480444:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.480462:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450448512 00000100:00100000:2.0:1762166977.480468:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450448512 00000100:00100000:3.0:1762166977.480505:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.480515:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450448384 00000100:00100000:0.0:1762166977.480520:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450448384 00002000:00010000:2.0:1762166977.480521:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:2.0:1762166977.480527:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5769c00 with x1847765450448512 ext(0->18446744073709551615) 00000100:00100000:1.0:1762166977.480534:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450448640 00002000:00010000:2.0:1762166977.480538:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc5769c00. 00002000:00010000:0.0:1762166977.480538:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (254346->18446744073709551615) 00000100:00100000:1.0:1762166977.480541:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450448640 00002000:00100000:0.0:1762166977.480545:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc576b100 with x1847765450448384 ext(254346->18446744073709551615) 00002000:00010000:0.0:1762166977.480551:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc576b100. 00002000:00010000:1.0:1762166977.480560:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:1.0:1762166977.480564:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5768380 with x1847765450448640 ext(0->18446744073709551615) 00000100:00100000:2.0:1762166977.480570:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2233 00002000:00010000:1.0:1762166977.480572:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5768380. 00000100:00100000:2.0:1762166977.480583:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5769c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+24:2418:x1847765450448512:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:0.0:1762166977.480588:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2234 00000100:00100000:3.0:1762166977.480597:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2235 00000100:00100000:0.0:1762166977.480602:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc576b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450448384:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:3.0:1762166977.480609:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5768380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450448640:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:2.0:1762166977.480678:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166977.480681:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:2.0:1762166977.480683:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166977 -> 1762166977 00002000:00010000:2.0:1762166977.480684:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:2.0:1762166977.480686:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00002000:00010000:3.0:1762166977.480699:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166977.480704:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:3.0:1762166977.480707:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166977 -> 1762166977 00002000:00010000:3.0:1762166977.480711:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:3.0:1762166977.480713:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1762166977.480721:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5769c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+25:2418:x1847765450448512:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 142us (298us total) trans 21474843293 rc 0/0 00000100:00100000:2.0:1762166977.480728:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2233 00002000:00010000:2.0:1762166977.480731:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00010000:0.0:1762166977.480733:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 156659 -> 254346 00002000:00100000:2.0:1762166977.480734:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5769c00 with x1847765450448512 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166977.480739:0:23943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00000100:00100000:3.0:1762166977.480741:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5768380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765450448640:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 133us (235us total) trans 17179876355 rc 0/0 00002000:00010000:0.0:1762166977.480742:0:23943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166977 -> 1762166977 00002000:00010000:2.0:1762166977.480743:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc5769c00. 00002000:00010000:0.0:1762166977.480750:0:23943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:0.0:1762166977.480753:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 232 -> 232 00000100:00100000:3.0:1762166977.480754:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2235 00002000:00010000:3.0:1762166977.480758:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:3.0:1762166977.480760:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5768380 with x1847765450448640 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166977.480765:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5768380. 00000100:00100000:0.0:1762166977.480780:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc576b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765450448384:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 183us (334us total) trans 17179876356 rc 0/0 00000100:00100000:0.0:1762166977.480788:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2234 00002000:00010000:0.0:1762166977.480791:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (254346->18446744073709551615) 00002000:00100000:0.0:1762166977.480793:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc576b100 with x1847765450448384 ext(254346->18446744073709551615) 00002000:00010000:0.0:1762166977.480798:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc576b100. 00000100:00100000:3.0:1762166977.481698:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.481739:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450448768 00000100:00100000:1.0:1762166977.481743:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450448768 00000100:00100000:1.0:1762166977.481774:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30433 00000100:00100000:1.0:1762166977.481783:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc576b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+573:61766:x1847765450448768:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:1.0:1762166977.481797:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166977.481809:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220000/0x2f180c4effbaaaec lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9c88 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.481872:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaaaf3 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166977.481892:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaaaf3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.481899:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaaaf3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:1.0:1762166977.481916:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 254346 00000004:00200000:1.0:1762166977.481920:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166977.481930:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaaaf3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.481947:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220000/0x2f180c4effbaaaec lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c88 expref: 575 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.481958:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaaaf3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c88 expref: 574 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.481967:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166977.481969:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166977.481971:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc6220e00, rc 0) 00000100:00100000:1.0:1762166977.481995:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc576b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+574:61766:x1847765450448768:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 215us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166977.482000:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30433 00000100:00100000:1.0:1762166977.483754:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.483816:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450448896 00000100:00100000:0.0:1762166977.483832:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450448896 00002000:00100000:0.0:1762166977.483903:0:23943:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000400:0xa77:0x0] (0->258047) req@ffff945cf79ea680 x1847765450448896/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 520/0 e 0 to 0 dl 1762166988 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166977.483916:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf79ea680 with x1847765450448896 ext(0->258047) 00002000:00010000:0.0:1762166977.483923:0:23943:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf79ea680 00000100:00100000:0.0:1762166977.483956:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2236 00000100:00100000:0.0:1762166977.483971:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765450448896:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:0.0:1762166977.485542:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765450448896:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 1573us (1788us total) trans 0 rc 188416/188416 00000100:00100000:0.0:1762166977.485555:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2236 00002000:00100000:0.0:1762166977.485564:0:23943:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000400:0xa77:0x0] (0->258047) req@ffff945cf79ea680 x1847765450448896/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 520/440 e 0 to 0 dl 1762166988 ref 1 fl Complete:/600/0 rc 188416/188416 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166977.485574:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf79ea680 with x1847765450448896 ext(0->258047) 00002000:00010000:0.0:1762166977.485578:0:23943:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf79ea680 00000100:00100000:3.0:1762166977.487441:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.487519:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450449152 00000100:00100000:1.0:1762166977.487531:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450449152 00000100:00100000:1.0:1762166977.487596:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30434 00000100:00100000:1.0:1762166977.487606:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5769500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+574:61766:x1847765450449152:12345-192.168.204.38@tcp:36:fsx.0 00010000:00010000:1.0:1762166977.487657:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166977.487689:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaaaf3 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c88 expref: 574 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.487707:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166977.487712:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166977.487873:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220400/0x2f180c4effbaaafa lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166977.487894:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220400/0x2f180c4effbaaafa lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.487901:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220400/0x2f180c4effbaaafa lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000001:00080000:1.0:1762166977.487935:0:6495:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992030 00000004:00010000:1.0:1762166977.487951:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000014696a58 reply state 0000000035ad1e4d transno 4294992031 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220400/0x2f180c4effbaaafa lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.487960:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220400/0x2f180c4effbaaafa lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.487964:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166977.487966:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166977.487968:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166977.488035:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5769500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+576:61766:x1847765450449152:12345-192.168.204.38@tcp:36:fsx.0 Request processed in 432us (600us total) trans 4294992031 rc 0/0 00000100:00100000:1.0:1762166977.488040:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30434 00000020:00080000:1.0:1762166977.488044:0:6495:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1762166977.488971:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.488993:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.489015:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.489026:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450449408 00000100:00100000:0.0:1762166977.489035:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450449408 00000100:00100000:2.0:1762166977.489055:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450449280 00000100:00100000:3.0:1762166977.489060:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450449536 00000100:00100000:2.0:1762166977.489062:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450449280 00002000:00010000:0.0:1762166977.489066:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00000100:00100000:3.0:1762166977.489070:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450449536 00002000:00100000:0.0:1762166977.489071:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf79e9880 with x1847765450449408 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166977.489084:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945cf79e9880. 00002000:00010000:2.0:1762166977.489088:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (241359->18446744073709551615) 00002000:00100000:2.0:1762166977.489092:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf79ea300 with x1847765450449280 ext(241359->18446744073709551615) 00002000:00010000:3.0:1762166977.489097:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00010000:2.0:1762166977.489100:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf79ea300. 00002000:00100000:3.0:1762166977.489104:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf79eaa00 with x1847765450449536 ext(0->18446744073709551615) 00000100:00100000:0.0:1762166977.489115:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2237 00002000:00010000:3.0:1762166977.489117:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf79eaa00. 00000100:00100000:0.0:1762166977.489132:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+25:2418:x1847765450449408:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:2.0:1762166977.489143:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2238 00000100:00100000:1.0:1762166977.489152:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2239 00000100:00100000:2.0:1762166977.489158:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765450449280:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:1.0:1762166977.489165:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765450449536:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:1.0:1762166977.489284:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166977.489287:0:23939:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:1.0:1762166977.489290:0:23939:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166977 -> 1762166977 00002000:00010000:1.0:1762166977.489292:0:23939:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:1.0:1762166977.489295:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:0.0:1762166977.489297:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166977.489300:0:23943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:0.0:1762166977.489303:0:23943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166977 -> 1762166977 00002000:00010000:0.0:1762166977.489305:0:23943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:0.0:1762166977.489307:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00000100:00100000:1.0:1762166977.489335:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765450449536:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 175us (318us total) trans 17179876357 rc 0/0 00002000:00010000:2.0:1762166977.489337:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 254346 -> 241359 00000100:00100000:0.0:1762166977.489347:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+26:2418:x1847765450449408:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 216us (367us total) trans 21474843294 rc 0/0 00002000:00010000:2.0:1762166977.489348:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:2.0:1762166977.489358:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166977 -> 1762166977 00000100:00100000:1.0:1762166977.489365:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2239 00002000:00010000:2.0:1762166977.489372:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:2.0:1762166977.489376:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 232 -> 232 00002000:00010000:1.0:1762166977.489377:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00000100:00100000:0.0:1762166977.489383:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2237 00002000:00010000:0.0:1762166977.489387:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:1.0:1762166977.489391:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf79eaa00 with x1847765450449536 ext(0->18446744073709551615) 00002000:00100000:0.0:1762166977.489392:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf79e9880 with x1847765450449408 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166977.489398:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945cf79e9880. 00002000:00010000:1.0:1762166977.489406:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf79eaa00. 00000100:00100000:2.0:1762166977.489419:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765450449280:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 265us (422us total) trans 17179876358 rc 0/0 00000100:00100000:2.0:1762166977.489426:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2238 00002000:00010000:2.0:1762166977.489430:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (241359->18446744073709551615) 00002000:00100000:2.0:1762166977.489433:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf79ea300 with x1847765450449280 ext(241359->18446744073709551615) 00002000:00010000:2.0:1762166977.489437:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf79ea300. 00000100:00100000:0.0:1762166977.490651:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.490690:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450449664 00000100:00100000:1.0:1762166977.490696:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450449664 00000100:00100000:1.0:1762166977.490727:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30435 00000100:00100000:1.0:1762166977.490732:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb385880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+576:61766:x1847765450449664:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:1.0:1762166977.490744:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166977.490753:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaab01 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9c8f expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.490807:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221800/0x2f180c4effbaab08 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166977.490817:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221800/0x2f180c4effbaab08 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.490823:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221800/0x2f180c4effbaab08 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:1.0:1762166977.490838:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 241359 00000004:00200000:1.0:1762166977.490841:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166977.490851:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221800/0x2f180c4effbaab08 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.490866:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaab01 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c8f expref: 578 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.490887:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221800/0x2f180c4effbaab08 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c8f expref: 577 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.490894:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166977.490895:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166977.490898:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc6221800, rc 0) 00000100:00100000:1.0:1762166977.490926:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb385880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+577:61766:x1847765450449664:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 194us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166977.490931:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30435 00000100:00100000:3.0:1762166977.492085:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.492114:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450449920 00000100:00100000:1.0:1762166977.492118:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450449920 00000100:00100000:1.0:1762166977.492141:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30436 00000100:00100000:1.0:1762166977.492147:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+577:61766:x1847765450449920:12345-192.168.204.38@tcp:36:fsx.0 00010000:00010000:1.0:1762166977.492166:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166977.492175:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221800/0x2f180c4effbaab08 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c8f expref: 577 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.492184:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166977.492186:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166977.492258:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaab0f lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166977.492265:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaab0f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.492270:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaab0f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000001:00080000:1.0:1762166977.492292:0:6495:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992032 00000004:00010000:1.0:1762166977.492304:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000002fa1cd6b reply state 00000000b222385b transno 4294992033 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaab0f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.492310:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaab0f lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.492314:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166977.492316:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166977.492318:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166977.492355:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+579:61766:x1847765450449920:12345-192.168.204.38@tcp:36:fsx.0 Request processed in 209us (270us total) trans 4294992033 rc 0/0 00000100:00100000:1.0:1762166977.492359:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30436 00000020:00080000:1.0:1762166977.492362:0:6495:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1762166977.493179:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166977.493201:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.493224:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450450048 00000100:00100000:2.0:1762166977.493229:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450450048 00000100:00100000:1.0:1762166977.493242:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450450176 00002000:00010000:2.0:1762166977.493247:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (262144->18446744073709551615) 00000100:00100000:1.0:1762166977.493249:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450450176 00002000:00100000:2.0:1762166977.493253:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5768700 with x1847765450450048 ext(262144->18446744073709551615) 00000100:00100000:3.0:1762166977.493259:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00002000:00010000:2.0:1762166977.493262:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5768700. 00002000:00010000:1.0:1762166977.493267:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:1.0:1762166977.493271:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bcceb6a00 with x1847765450450176 ext(0->18446744073709551615) 00002000:00010000:1.0:1762166977.493277:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bcceb6a00. 00000100:00100000:2.0:1762166977.493287:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2240 00000100:00100000:2.0:1762166977.493299:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5768700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+25:2419:x1847765450450048:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:1.0:1762166977.493304:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450450304 00000100:00100000:1.0:1762166977.493307:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450450304 00002000:00010000:1.0:1762166977.493318:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:1.0:1762166977.493320:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bcceb5880 with x1847765450450304 ext(0->18446744073709551615) 00002000:00010000:1.0:1762166977.493324:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bcceb5880. 00000100:00100000:0.0:1762166977.493349:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2241 00000100:00100000:1.0:1762166977.493360:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2242 00000100:00100000:1.0:1762166977.493374:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcceb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+26:2418:x1847765450450304:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:0.0:1762166977.493374:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcceb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765450450176:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:2.0:1762166977.493404:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 241359 -> 262144 00002000:00010000:2.0:1762166977.493409:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:2.0:1762166977.493413:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166977 -> 1762166977 00002000:00010000:2.0:1762166977.493416:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:2.0:1762166977.493419:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 232 -> 232 00002000:00010000:1.0:1762166977.493438:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166977.493441:0:23939:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:1.0:1762166977.493443:0:23939:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166977 -> 1762166977 00002000:00010000:1.0:1762166977.493445:0:23939:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:1.0:1762166977.493447:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1762166977.493460:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5768700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+28:2419:x1847765450450048:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 165us (280us total) trans 17179876359 rc 0/0 00000100:00100000:2.0:1762166977.493475:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2240 00002000:00010000:2.0:1762166977.493497:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (262144->18446744073709551615) 00000100:00100000:1.0:1762166977.493500:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcceb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+28:2418:x1847765450450304:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 101us (214us total) trans 17179876360 rc 0/0 00002000:00100000:2.0:1762166977.493501:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5768700 with x1847765450450048 ext(262144->18446744073709551615) 00002000:00010000:2.0:1762166977.493509:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5768700. 00000100:00100000:1.0:1762166977.493514:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2242 00002000:00010000:1.0:1762166977.493518:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:1.0:1762166977.493520:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bcceb5880 with x1847765450450304 ext(0->18446744073709551615) 00002000:00010000:1.0:1762166977.493525:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bcceb5880. 00002000:00010000:0.0:1762166977.493587:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166977.493590:0:23943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:0.0:1762166977.493592:0:23943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166977 -> 1762166977 00002000:00010000:0.0:1762166977.493593:0:23943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:0.0:1762166977.493595:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00000100:00100000:0.0:1762166977.493638:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcceb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+27:2419:x1847765450450176:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 278us (436us total) trans 21474843295 rc 0/0 00000100:00100000:0.0:1762166977.493644:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2241 00002000:00010000:0.0:1762166977.493647:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:0.0:1762166977.493649:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bcceb6a00 with x1847765450450176 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166977.493654:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bcceb6a00. 00000100:00100000:3.0:1762166977.495825:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.495870:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450450432 00000100:00100000:0.0:1762166977.495889:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450450432 00002000:00100000:0.0:1762166977.495923:0:23943:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000400:0xa77:0x0] (241664->262143) req@ffff945bcceb4e00 x1847765450450432/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 504/0 e 0 to 0 dl 1762166988 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166977.495933:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bcceb4e00 with x1847765450450432 ext(241664->262143) 00002000:00010000:0.0:1762166977.495938:0:23943:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bcceb4e00 00000100:00100000:0.0:1762166977.495966:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2243 00000100:00100000:0.0:1762166977.495976:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcceb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+27:2417:x1847765450450432:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:0.0:1762166977.496673:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcceb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+27:2417:x1847765450450432:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 697us (849us total) trans 0 rc 8192/8192 00000100:00100000:0.0:1762166977.496683:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2243 00002000:00100000:0.0:1762166977.496693:0:23943:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000400:0xa77:0x0] (241664->262143) req@ffff945bcceb4e00 x1847765450450432/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 504/440 e 0 to 0 dl 1762166988 ref 1 fl Complete:/600/0 rc 8192/8192 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166977.496702:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bcceb4e00 with x1847765450450432 ext(241664->262143) 00002000:00010000:0.0:1762166977.496706:0:23943:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bcceb4e00 00000100:00100000:3.0:1762166977.497610:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.497666:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450450560 00000100:00100000:0.0:1762166977.497674:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450450560 00002000:00100000:0.0:1762166977.497709:0:23943:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000400:0xa77:0x0] (245760->249855) req@ffff945bcceb5c00 x1847765450450560/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 488/0 e 0 to 0 dl 1762166988 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166977.497719:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bcceb5c00 with x1847765450450560 ext(245760->249855) 00002000:00010000:0.0:1762166977.497724:0:23943:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bcceb5c00 00000100:00100000:0.0:1762166977.497748:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2244 00000100:00100000:0.0:1762166977.497755:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcceb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+27:2416:x1847765450450560:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:0.0:1762166977.497906:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcceb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+27:2416:x1847765450450560:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 150us (296us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1762166977.497914:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2244 00002000:00100000:0.0:1762166977.497923:0:23943:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000400:0xa77:0x0] (245760->249855) req@ffff945bcceb5c00 x1847765450450560/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 488/4536 e 0 to 0 dl 1762166988 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166977.497933:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bcceb5c00 with x1847765450450560 ext(245760->249855) 00002000:00010000:0.0:1762166977.497937:0:23943:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bcceb5c00 00000100:00100000:3.0:1762166977.498914:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.498965:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450450688 00000100:00100000:0.0:1762166977.498969:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450450688 00002000:00100000:0.0:1762166977.498986:0:23943:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000400:0xa77:0x0] (249856->253951) req@ffff945bcceb7800 x1847765450450688/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 488/0 e 0 to 0 dl 1762166988 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166977.498993:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bcceb7800 with x1847765450450688 ext(249856->253951) 00002000:00010000:0.0:1762166977.498995:0:23943:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bcceb7800 00000100:00100000:0.0:1762166977.499011:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2245 00000100:00100000:0.0:1762166977.499018:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcceb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+27:2419:x1847765450450688:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:0.0:1762166977.499106:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcceb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+27:2419:x1847765450450688:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 88us (193us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1762166977.499111:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2245 00002000:00100000:0.0:1762166977.499116:0:23943:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000400:0xa77:0x0] (249856->253951) req@ffff945bcceb7800 x1847765450450688/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 488/4536 e 0 to 0 dl 1762166988 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166977.499125:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bcceb7800 with x1847765450450688 ext(249856->253951) 00002000:00010000:0.0:1762166977.499129:0:23943:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bcceb7800 00000100:00100000:3.0:1762166977.499990:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.500027:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450450816 00000100:00100000:0.0:1762166977.500031:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450450816 00002000:00100000:0.0:1762166977.500045:0:23943:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000400:0xa77:0x0] (253952->258047) req@ffff945cf3db6680 x1847765450450816/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 488/0 e 0 to 0 dl 1762166988 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166977.500051:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf3db6680 with x1847765450450816 ext(253952->258047) 00002000:00010000:0.0:1762166977.500053:0:23943:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf3db6680 00000100:00100000:0.0:1762166977.500068:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2246 00000100:00100000:0.0:1762166977.500074:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+27:2419:x1847765450450816:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:0.0:1762166977.500168:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+27:2419:x1847765450450816:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 92us (176us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1762166977.500175:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2246 00002000:00100000:0.0:1762166977.500182:0:23943:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000400:0xa77:0x0] (253952->258047) req@ffff945cf3db6680 x1847765450450816/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 488/4536 e 0 to 0 dl 1762166988 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166977.500192:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf3db6680 with x1847765450450816 ext(253952->258047) 00002000:00010000:0.0:1762166977.500195:0:23943:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf3db6680 00000100:00100000:3.0:1762166977.501257:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.501302:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450450944 00000100:00100000:0.0:1762166977.501307:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450450944 00002000:00100000:0.0:1762166977.501328:0:23943:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000400:0xa77:0x0] (204800->262143) req@ffff945cf3db5500 x1847765450450944/t0(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 488/0 e 0 to 0 dl 1762166988 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166977.501336:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf3db5500 with x1847765450450944 ext(204800->262143) 00002000:00010000:0.0:1762166977.501339:0:23943:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf3db5500 00000100:00100000:0.0:1762166977.501357:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2247 00000100:00100000:0.0:1762166977.501364:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+27:2419:x1847765450450944:12345-192.168.204.38@tcp:4:fsx.0 00000100:00100000:0.0:1762166977.502657:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+29:2419:x1847765450450944:12345-192.168.204.38@tcp:4:fsx.0 Request processed in 1292us (1399us total) trans 17179876361 rc 0/0 00000100:00100000:0.0:1762166977.502667:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2247 00002000:00100000:0.0:1762166977.502672:0:23943:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000400:0xa77:0x0] (204800->262143) req@ffff945cf3db5500 x1847765450450944/t17179876361(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 488/448 e 0 to 0 dl 1762166988 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166977.502679:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf3db5500 with x1847765450450944 ext(204800->262143) 00002000:00010000:0.0:1762166977.502682:0:23943:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf3db5500 00000100:00100000:3.0:1762166977.503392:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.503436:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450451072 00000100:00100000:1.0:1762166977.503441:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450451072 00000100:00100000:1.0:1762166977.503470:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18952 00000100:00100000:1.0:1762166977.503494:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+29:2419:x1847765450451072:12345-192.168.204.38@tcp:16:fsx.0 00000001:00080000:2.0:1762166977.504185:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876361 is committed 00000100:00100000:1.0:1762166977.504291:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450451072:12345-192.168.204.38@tcp:16:fsx.0 Request processed in 813us (898us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166977.504298:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18952 00000100:00100000:3.0:1762166977.505135:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.505173:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450451200 00000100:00100000:1.0:1762166977.505180:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450451200 00000100:00100000:1.0:1762166977.505217:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30437 00000100:00100000:1.0:1762166977.505226:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+579:61766:x1847765450451200:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:1.0:1762166977.505243:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166977.505265:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220000/0x2f180c4effbaab16 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9c96 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.505355:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221000/0x2f180c4effbaab1d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166977.505371:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221000/0x2f180c4effbaab1d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.505395:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221000/0x2f180c4effbaab1d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:1.0:1762166977.505423:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 262144 00000004:00200000:1.0:1762166977.505427:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166977.505443:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221000/0x2f180c4effbaab1d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.505467:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220000/0x2f180c4effbaab16 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c96 expref: 581 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.505513:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221000/0x2f180c4effbaab1d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c96 expref: 580 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.505523:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166977.505527:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166977.505532:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc6221000, rc 0) 00000100:00100000:1.0:1762166977.505595:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+580:61766:x1847765450451200:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 370us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166977.505603:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30437 00000100:00100000:3.0:1762166977.506847:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.506900:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450451328 00000100:00100000:0.0:1762166977.506904:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450451328 00000100:00100000:0.0:1762166977.506934:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2248 00000100:00100000:0.0:1762166977.506939:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450451328:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:0.0:1762166977.507020:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:0.0:1762166977.507023:0:23943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:0.0:1762166977.507025:0:23943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166977 -> 1762166977 00002000:00010000:0.0:1762166977.507026:0:23943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:0.0:1762166977.507028:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 232 -> 344 00000100:00100000:0.0:1762166977.507053:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450451328:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 114us (206us total) trans 17179876362 rc 0/0 00000100:00100000:0.0:1762166977.507057:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2248 00000100:00100000:3.0:1762166977.508140:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.508183:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450451456 00000100:00100000:0.0:1762166977.508187:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450451456 00000100:00100000:0.0:1762166977.508219:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2249 00000100:00100000:0.0:1762166977.508228:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450451456:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:0.0:1762166977.508413:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:0.0:1762166977.508417:0:23943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:0.0:1762166977.508419:0:23943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166977 -> 1762166977 00002000:00010000:0.0:1762166977.508422:0:23943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:0.0:1762166977.508424:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 344 -> 304 00000100:00100000:0.0:1762166977.508461:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450451456:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 235us (321us total) trans 17179876363 rc 0/0 00000100:00100000:0.0:1762166977.508469:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2249 00000100:00100000:3.0:1762166977.509545:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.509572:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450451584 00000100:00100000:0.0:1762166977.509576:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450451584 00000100:00100000:0.0:1762166977.509601:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2250 00000100:00100000:0.0:1762166977.509605:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450451584:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:0.0:1762166977.509779:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:0.0:1762166977.509783:0:23943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:0.0:1762166977.509786:0:23943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166977 -> 1762166977 00002000:00010000:0.0:1762166977.509788:0:23943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:0.0:1762166977.509791:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 304 -> 304 00000100:00100000:0.0:1762166977.509826:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450451584:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 219us (281us total) trans 17179876364 rc 0/0 00000100:00100000:0.0:1762166977.509831:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2250 00000100:00100000:3.0:1762166977.511498:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.511529:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450451712 00000100:00100000:0.0:1762166977.511534:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450451712 00002000:00100000:0.0:1762166977.511554:0:23943:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000400:0xa77:0x0] (233472->237567) req@ffff945cf3db7100 x1847765450451712/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 488/0 e 0 to 0 dl 1762166988 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166977.511561:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf3db7100 with x1847765450451712 ext(233472->237567) 00002000:00010000:0.0:1762166977.511565:0:23943:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf3db7100 00000100:00100000:0.0:1762166977.511579:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2251 00000100:00100000:0.0:1762166977.511584:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450451712:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:0.0:1762166977.511703:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450451712:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 118us (225us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1762166977.511708:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2251 00002000:00100000:0.0:1762166977.511712:0:23943:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000400:0xa77:0x0] (233472->237567) req@ffff945cf3db7100 x1847765450451712/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 488/4536 e 0 to 0 dl 1762166988 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166977.511719:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf3db7100 with x1847765450451712 ext(233472->237567) 00002000:00010000:0.0:1762166977.511722:0:23943:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf3db7100 00000100:00100000:3.0:1762166977.512618:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.512650:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450451840 00000100:00100000:0.0:1762166977.512655:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450451840 00002000:00100000:0.0:1762166977.512687:0:23943:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000400:0xa77:0x0] (258048->262143) req@ffff945cf3db4a80 x1847765450451840/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 488/0 e 0 to 0 dl 1762166988 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166977.512695:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf3db4a80 with x1847765450451840 ext(258048->262143) 00002000:00010000:0.0:1762166977.512699:0:23943:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf3db4a80 00000100:00100000:0.0:1762166977.512716:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2252 00000100:00100000:0.0:1762166977.512725:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450451840:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:0.0:1762166977.512821:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450451840:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 97us (201us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1762166977.512830:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2252 00002000:00100000:0.0:1762166977.512838:0:23943:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000400:0xa77:0x0] (258048->262143) req@ffff945cf3db4a80 x1847765450451840/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 488/4536 e 0 to 0 dl 1762166988 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166977.512846:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf3db4a80 with x1847765450451840 ext(258048->262143) 00002000:00010000:0.0:1762166977.512850:0:23943:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf3db4a80 00000100:00100000:3.0:1762166977.514347:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.514405:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450452096 00000100:00100000:1.0:1762166977.514410:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450452096 00000100:00100000:1.0:1762166977.514451:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30438 00000100:00100000:1.0:1762166977.514472:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+580:61766:x1847765450452096:12345-192.168.204.38@tcp:36:fsx.0 00010000:00010000:1.0:1762166977.514550:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166977.514578:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221000/0x2f180c4effbaab1d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c96 expref: 580 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.514596:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166977.514601:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166977.514768:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220000/0x2f180c4effbaab24 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166977.514784:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220000/0x2f180c4effbaab24 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.514795:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220000/0x2f180c4effbaab24 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000001:00080000:1.0:1762166977.514837:0:6495:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992034 00000004:00010000:1.0:1762166977.514859:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000005c558c95 reply state 000000003b825736 transno 4294992035 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220000/0x2f180c4effbaab24 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.514872:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220000/0x2f180c4effbaab24 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.514894:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166977.514897:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166977.514900:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166977.514966:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+582:61766:x1847765450452096:12345-192.168.204.38@tcp:36:fsx.0 Request processed in 496us (620us total) trans 4294992035 rc 0/0 00000100:00100000:1.0:1762166977.514973:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30438 00000020:00080000:1.0:1762166977.514979:0:6495:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1762166977.516001:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.516046:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450452224 00000100:00100000:0.0:1762166977.516052:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450452224 00000100:00100000:3.0:1762166977.516069:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00002000:00010000:0.0:1762166977.516073:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (120224->18446744073709551615) 00002000:00100000:0.0:1762166977.516077:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc558ad80 with x1847765450452224 ext(120224->18446744073709551615) 00002000:00010000:0.0:1762166977.516085:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc558ad80. 00000100:00100000:0.0:1762166977.516102:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450452352 00000100:00100000:0.0:1762166977.516104:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450452352 00002000:00010000:0.0:1762166977.516115:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00000100:00100000:1.0:1762166977.516119:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2253 00002000:00100000:0.0:1762166977.516121:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5589500 with x1847765450452352 ext(0->18446744073709551615) 00000100:00100000:3.0:1762166977.516124:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00002000:00010000:0.0:1762166977.516129:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc5589500. 00000100:00100000:1.0:1762166977.516132:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450452224:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:2.0:1762166977.516158:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450452480 00000100:00100000:2.0:1762166977.516164:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450452480 00000100:00100000:0.0:1762166977.516167:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2254 00000100:00100000:0.0:1762166977.516178:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5589500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+27:2419:x1847765450452352:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:2.0:1762166977.516187:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:2.0:1762166977.516193:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc558aa00 with x1847765450452480 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166977.516201:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc558aa00. 00000100:00100000:2.0:1762166977.516225:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2255 00000100:00100000:2.0:1762166977.516234:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765450452480:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:0.0:1762166977.516295:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166977.516300:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:0.0:1762166977.516303:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166977 -> 1762166977 00002000:00010000:0.0:1762166977.516306:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:0.0:1762166977.516309:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00002000:00010000:2.0:1762166977.516317:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166977.516321:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:2.0:1762166977.516323:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166977 -> 1762166977 00002000:00010000:2.0:1762166977.516325:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:2.0:1762166977.516326:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1762166977.516349:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+24:2418:x1847765450452480:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 119us (249us total) trans 17179876365 rc 0/0 00000100:00100000:0.0:1762166977.516355:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5589500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+28:2419:x1847765450452352:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 175us (283us total) trans 21474843296 rc 0/0 00000100:00100000:2.0:1762166977.516360:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2255 00002000:00010000:2.0:1762166977.516365:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:2.0:1762166977.516368:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc558aa00 with x1847765450452480 ext(0->18446744073709551615) 00000100:00100000:0.0:1762166977.516372:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2254 00002000:00010000:2.0:1762166977.516374:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc558aa00. 00002000:00010000:0.0:1762166977.516382:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:0.0:1762166977.516387:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5589500 with x1847765450452352 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166977.516393:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc5589500. 00002000:00010000:1.0:1762166977.516467:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 262144 -> 120224 00002000:00010000:1.0:1762166977.516472:0:23939:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:1.0:1762166977.516474:0:23939:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166977 -> 1762166977 00002000:00010000:1.0:1762166977.516505:0:23939:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:1.0:1762166977.516507:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 304 -> 160 00000100:00100000:1.0:1762166977.516540:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765450452224:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 412us (539us total) trans 17179876366 rc 0/0 00000100:00100000:1.0:1762166977.516549:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2253 00002000:00010000:1.0:1762166977.516553:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (120224->18446744073709551615) 00002000:00100000:1.0:1762166977.516556:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc558ad80 with x1847765450452224 ext(120224->18446744073709551615) 00002000:00010000:1.0:1762166977.516561:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc558ad80. 00000100:00100000:3.0:1762166977.517312:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.517351:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450452608 00000100:00100000:1.0:1762166977.517356:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450452608 00000100:00100000:1.0:1762166977.517387:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30439 00000100:00100000:1.0:1762166977.517396:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5589880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+582:61766:x1847765450452608:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:1.0:1762166977.517408:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166977.517422:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221800/0x2f180c4effbaab2b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9c9d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.517507:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaab32 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166977.517518:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaab32 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.517527:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaab32 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:1.0:1762166977.517545:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 120224 00000004:00200000:1.0:1762166977.517550:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166977.517563:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaab32 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.517583:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221800/0x2f180c4effbaab2b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c9d expref: 584 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.517597:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaab32 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c9d expref: 583 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.517604:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166977.517607:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166977.517610:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc6221400, rc 0) 00000100:00100000:1.0:1762166977.517642:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5589880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+583:61766:x1847765450452608:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 247us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166977.517648:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30439 00000100:00100000:3.0:1762166977.518988:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.519018:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450452736 00000100:00100000:1.0:1762166977.519023:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450452736 00002000:00100000:1.0:1762166977.519043:0:23939:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xa77:0x0] (73728->122879) req@ffff945bc558b100 x1847765450452736/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 488/0 e 0 to 0 dl 1762166988 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166977.519050:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc558b100 with x1847765450452736 ext(73728->122879) 00002000:00010000:1.0:1762166977.519054:0:23939:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc558b100 00000100:00100000:1.0:1762166977.519071:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2256 00000100:00100000:1.0:1762166977.519077:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765450452736:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:1.0:1762166977.519917:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765450452736:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 838us (928us total) trans 0 rc 49152/49152 00000100:00100000:1.0:1762166977.519927:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2256 00002000:00100000:1.0:1762166977.519935:0:23939:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xa77:0x0] (73728->122879) req@ffff945bc558b100 x1847765450452736/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 488/440 e 0 to 0 dl 1762166988 ref 1 fl Complete:/600/0 rc 49152/49152 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166977.519944:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc558b100 with x1847765450452736 ext(73728->122879) 00002000:00010000:1.0:1762166977.519948:0:23939:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc558b100 00000100:00100000:3.0:1762166977.523159:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.523208:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450452864 00000100:00100000:1.0:1762166977.523217:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450452864 00000100:00100000:1.0:1762166977.523273:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2257 00000100:00100000:1.0:1762166977.523283:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5588380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765450452864:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:1.0:1762166977.523577:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 120224 -> 120224 00002000:00010000:1.0:1762166977.523580:0:23939:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:1.0:1762166977.523582:0:23939:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166977 -> 1762166977 00002000:00010000:1.0:1762166977.523584:0:23939:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:1.0:1762166977.523585:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 160 -> 112 00000100:00100000:1.0:1762166977.523624:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5588380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765450452864:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 345us (473us total) trans 17179876367 rc 0/0 00000100:00100000:1.0:1762166977.523629:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2257 00000100:00100000:3.0:1762166977.525119:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.525159:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450452992 00000100:00100000:1.0:1762166977.525164:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450452992 00002000:00100000:1.0:1762166977.525186:0:23939:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xa77:0x0] (122880->128901) req@ffff945bc5589f80 x1847765450452992/t0(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 6512/0 e 0 to 0 dl 1762166988 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166977.525198:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5589f80 with x1847765450452992 ext(122880->128901) 00002000:00010000:1.0:1762166977.525202:0:23939:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5589f80 00000100:00100000:1.0:1762166977.525224:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2258 00000100:00100000:1.0:1762166977.525236:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5589f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+24:2418:x1847765450452992:12345-192.168.204.38@tcp:4:fsx.0 00000100:00100000:1.0:1762166977.525724:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5589f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+26:2418:x1847765450452992:12345-192.168.204.38@tcp:4:fsx.0 Request processed in 489us (606us total) trans 17179876368 rc 0/0 00000100:00100000:1.0:1762166977.525730:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2258 00002000:00100000:1.0:1762166977.525735:0:23939:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xa77:0x0] (122880->128901) req@ffff945bc5589f80 x1847765450452992/t17179876368(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 6512/448 e 0 to 0 dl 1762166988 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166977.525741:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5589f80 with x1847765450452992 ext(122880->128901) 00002000:00010000:1.0:1762166977.525744:0:23939:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5589f80 00000100:00100000:3.0:1762166977.526460:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.526509:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450453120 00000100:00100000:1.0:1762166977.526513:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450453120 00000100:00100000:1.0:1762166977.526554:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2259 00000100:00100000:1.0:1762166977.526562:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765450453120:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:1.0:1762166977.526749:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 120224 -> 128902 00002000:00010000:1.0:1762166977.526752:0:23939:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:1.0:1762166977.526754:0:23939:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166977 -> 1762166977 00002000:00010000:1.0:1762166977.526755:0:23939:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:1.0:1762166977.526757:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 112 -> 192 00000100:00100000:1.0:1762166977.526783:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+27:2419:x1847765450453120:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 222us (324us total) trans 17179876369 rc 0/0 00000100:00100000:1.0:1762166977.526787:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2259 00000100:00100000:3.0:1762166977.528112:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.528152:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450453248 00000100:00100000:1.0:1762166977.528156:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450453248 00000100:00100000:1.0:1762166977.528187:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2260 00000100:00100000:1.0:1762166977.528191:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5589180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+27:2418:x1847765450453248:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:1.0:1762166977.528396:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 128902 -> 128902 00002000:00010000:1.0:1762166977.528400:0:23939:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:1.0:1762166977.528402:0:23939:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166977 -> 1762166977 00002000:00010000:1.0:1762166977.528404:0:23939:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:1.0:1762166977.528406:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 192 -> 256 00000100:00100000:1.0:1762166977.528443:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5589180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+28:2418:x1847765450453248:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 250us (332us total) trans 17179876370 rc 0/0 00000100:00100000:1.0:1762166977.528450:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2260 00000100:00100000:3.0:1762166977.530532:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.530567:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450453376 00000100:00100000:1.0:1762166977.530573:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450453376 00002000:00100000:1.0:1762166977.530599:0:23939:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xa77:0x0] (53248->126975) req@ffff945bc5589c00 x1847765450453376/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 504/0 e 0 to 0 dl 1762166988 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166977.530606:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5589c00 with x1847765450453376 ext(53248->126975) 00002000:00010000:1.0:1762166977.530610:0:23939:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5589c00 00000100:00100000:1.0:1762166977.530629:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2261 00000100:00100000:1.0:1762166977.530635:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5589c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+28:2419:x1847765450453376:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:1.0:1762166977.531290:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5589c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+28:2419:x1847765450453376:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 653us (762us total) trans 0 rc 8192/8192 00000100:00100000:1.0:1762166977.531297:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2261 00002000:00100000:1.0:1762166977.531303:0:23939:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xa77:0x0] (53248->126975) req@ffff945bc5589c00 x1847765450453376/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 504/440 e 0 to 0 dl 1762166988 ref 1 fl Complete:/600/0 rc 8192/8192 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166977.531315:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5589c00 with x1847765450453376 ext(53248->126975) 00002000:00010000:1.0:1762166977.531317:0:23939:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5589c00 00000100:00100000:3.0:1762166977.532186:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.532221:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450453504 00000100:00100000:1.0:1762166977.532225:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450453504 00002000:00100000:1.0:1762166977.532239:0:23939:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xa77:0x0] (57344->61439) req@ffff945bc5588e00 x1847765450453504/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 488/0 e 0 to 0 dl 1762166988 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166977.532245:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5588e00 with x1847765450453504 ext(57344->61439) 00002000:00010000:1.0:1762166977.532248:0:23939:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5588e00 00000100:00100000:1.0:1762166977.532262:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2262 00000100:00100000:1.0:1762166977.532266:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5588e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+28:2418:x1847765450453504:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:1.0:1762166977.532345:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5588e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+28:2418:x1847765450453504:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 76us (159us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1762166977.532354:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2262 00002000:00100000:1.0:1762166977.532361:0:23939:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xa77:0x0] (57344->61439) req@ffff945bc5588e00 x1847765450453504/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 488/4536 e 0 to 0 dl 1762166988 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166977.532370:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5588e00 with x1847765450453504 ext(57344->61439) 00002000:00010000:1.0:1762166977.532374:0:23939:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5588e00 00000100:00100000:3.0:1762166977.533269:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.533332:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450453632 00000100:00100000:1.0:1762166977.533337:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450453632 00002000:00100000:1.0:1762166977.533357:0:23939:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xa77:0x0] (61440->65535) req@ffff945cf1ddce00 x1847765450453632/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 488/0 e 0 to 0 dl 1762166988 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166977.533365:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1ddce00 with x1847765450453632 ext(61440->65535) 00002000:00010000:1.0:1762166977.533368:0:23939:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1ddce00 00000100:00100000:1.0:1762166977.533389:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2263 00000100:00100000:1.0:1762166977.533397:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+28:2419:x1847765450453632:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:1.0:1762166977.533508:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+28:2419:x1847765450453632:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 111us (239us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1762166977.533515:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2263 00002000:00100000:1.0:1762166977.533520:0:23939:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xa77:0x0] (61440->65535) req@ffff945cf1ddce00 x1847765450453632/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 488/4536 e 0 to 0 dl 1762166988 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166977.533525:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1ddce00 with x1847765450453632 ext(61440->65535) 00002000:00010000:1.0:1762166977.533528:0:23939:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1ddce00 00000100:00100000:3.0:1762166977.534271:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.534301:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450453760 00000100:00100000:1.0:1762166977.534304:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450453760 00002000:00100000:1.0:1762166977.534318:0:23939:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xa77:0x0] (65536->69631) req@ffff945cf1ddd180 x1847765450453760/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 488/0 e 0 to 0 dl 1762166988 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166977.534324:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1ddd180 with x1847765450453760 ext(65536->69631) 00002000:00010000:1.0:1762166977.534327:0:23939:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1ddd180 00000100:00100000:1.0:1762166977.534341:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2264 00000100:00100000:1.0:1762166977.534345:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+28:2418:x1847765450453760:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:1.0:1762166977.534411:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+28:2418:x1847765450453760:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 65us (141us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1762166977.534415:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2264 00002000:00100000:1.0:1762166977.534420:0:23939:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xa77:0x0] (65536->69631) req@ffff945cf1ddd180 x1847765450453760/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 488/4536 e 0 to 0 dl 1762166988 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166977.534425:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1ddd180 with x1847765450453760 ext(65536->69631) 00002000:00010000:1.0:1762166977.534428:0:23939:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1ddd180 00000100:00100000:3.0:1762166977.535182:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.535248:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450453888 00000100:00100000:1.0:1762166977.535253:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450453888 00002000:00100000:1.0:1762166977.535273:0:23939:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xa77:0x0] (69632->73727) req@ffff945cf1ddc700 x1847765450453888/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 488/0 e 0 to 0 dl 1762166988 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166977.535282:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1ddc700 with x1847765450453888 ext(69632->73727) 00002000:00010000:1.0:1762166977.535286:0:23939:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1ddc700 00000100:00100000:1.0:1762166977.535308:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2265 00000100:00100000:1.0:1762166977.535317:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+28:2419:x1847765450453888:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:1.0:1762166977.535388:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+28:2419:x1847765450453888:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 73us (207us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1762166977.535393:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2265 00002000:00100000:1.0:1762166977.535397:0:23939:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xa77:0x0] (69632->73727) req@ffff945cf1ddc700 x1847765450453888/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 488/4536 e 0 to 0 dl 1762166988 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166977.535403:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1ddc700 with x1847765450453888 ext(69632->73727) 00002000:00010000:1.0:1762166977.535406:0:23939:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1ddc700 00000100:00100000:3.0:1762166977.536239:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.536267:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450454016 00000100:00100000:1.0:1762166977.536271:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450454016 00002000:00100000:1.0:1762166977.536287:0:23939:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xa77:0x0] (73728->77823) req@ffff945bc8120380 x1847765450454016/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 488/0 e 0 to 0 dl 1762166988 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166977.536293:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc8120380 with x1847765450454016 ext(73728->77823) 00002000:00010000:1.0:1762166977.536295:0:23939:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc8120380 00000100:00100000:1.0:1762166977.536310:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2266 00000100:00100000:1.0:1762166977.536315:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc8120380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+28:2419:x1847765450454016:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:1.0:1762166977.536380:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc8120380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+28:2419:x1847765450454016:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 65us (141us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1762166977.536387:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2266 00002000:00100000:1.0:1762166977.536392:0:23939:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xa77:0x0] (73728->77823) req@ffff945bc8120380 x1847765450454016/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 488/4536 e 0 to 0 dl 1762166988 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166977.536398:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc8120380 with x1847765450454016 ext(73728->77823) 00002000:00010000:1.0:1762166977.536400:0:23939:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc8120380 00000100:00100000:3.0:1762166977.537120:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.537157:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450454144 00000100:00100000:1.0:1762166977.537163:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450454144 00002000:00100000:1.0:1762166977.537183:0:23939:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xa77:0x0] (77824->81919) req@ffff945bc8120000 x1847765450454144/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 488/0 e 0 to 0 dl 1762166988 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166977.537192:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc8120000 with x1847765450454144 ext(77824->81919) 00002000:00010000:1.0:1762166977.537195:0:23939:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc8120000 00000100:00100000:1.0:1762166977.537216:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2267 00000100:00100000:1.0:1762166977.537226:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc8120000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+28:2419:x1847765450454144:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:1.0:1762166977.537300:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc8120000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+28:2419:x1847765450454144:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 76us (179us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1762166977.537308:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2267 00002000:00100000:1.0:1762166977.537313:0:23939:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xa77:0x0] (77824->81919) req@ffff945bc8120000 x1847765450454144/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 488/4536 e 0 to 0 dl 1762166988 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166977.537319:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc8120000 with x1847765450454144 ext(77824->81919) 00002000:00010000:1.0:1762166977.537321:0:23939:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc8120000 00000100:00100000:3.0:1762166977.538075:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.538105:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450454272 00000100:00100000:1.0:1762166977.538109:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450454272 00002000:00100000:1.0:1762166977.538124:0:23939:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xa77:0x0] (81920->86015) req@ffff945bc8121c00 x1847765450454272/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 488/0 e 0 to 0 dl 1762166988 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166977.538136:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc8121c00 with x1847765450454272 ext(81920->86015) 00002000:00010000:1.0:1762166977.538138:0:23939:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc8121c00 00000100:00100000:1.0:1762166977.538157:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2268 00000100:00100000:1.0:1762166977.538162:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc8121c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+28:2418:x1847765450454272:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:1.0:1762166977.538229:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc8121c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+28:2418:x1847765450454272:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 67us (154us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1762166977.538234:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2268 00002000:00100000:1.0:1762166977.538239:0:23939:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xa77:0x0] (81920->86015) req@ffff945bc8121c00 x1847765450454272/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 488/4536 e 0 to 0 dl 1762166988 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166977.538245:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc8121c00 with x1847765450454272 ext(81920->86015) 00002000:00010000:1.0:1762166977.538248:0:23939:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc8121c00 00000100:00100000:3.0:1762166977.539035:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.539075:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450454400 00000100:00100000:1.0:1762166977.539080:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450454400 00002000:00100000:1.0:1762166977.539096:0:23939:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xa77:0x0] (86016->90111) req@ffff945bcce75f80 x1847765450454400/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 488/0 e 0 to 0 dl 1762166988 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166977.539102:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bcce75f80 with x1847765450454400 ext(86016->90111) 00002000:00010000:1.0:1762166977.539105:0:23939:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bcce75f80 00000100:00100000:1.0:1762166977.539123:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2269 00000100:00100000:1.0:1762166977.539128:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+28:2416:x1847765450454400:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:1.0:1762166977.539188:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+28:2416:x1847765450454400:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 60us (154us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1762166977.539194:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2269 00002000:00100000:1.0:1762166977.539199:0:23939:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xa77:0x0] (86016->90111) req@ffff945bcce75f80 x1847765450454400/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 488/4536 e 0 to 0 dl 1762166988 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166977.539206:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bcce75f80 with x1847765450454400 ext(86016->90111) 00002000:00010000:1.0:1762166977.539208:0:23939:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bcce75f80 00000100:00100000:3.0:1762166977.540104:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.540134:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450454528 00000100:00100000:1.0:1762166977.540138:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450454528 00002000:00100000:1.0:1762166977.540163:0:23939:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xa77:0x0] (90112->94207) req@ffff945bcce77100 x1847765450454528/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 488/0 e 0 to 0 dl 1762166988 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166977.540169:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bcce77100 with x1847765450454528 ext(90112->94207) 00002000:00010000:1.0:1762166977.540172:0:23939:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bcce77100 00000100:00100000:1.0:1762166977.540187:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2270 00000100:00100000:1.0:1762166977.540192:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+28:2416:x1847765450454528:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:1.0:1762166977.540253:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+28:2416:x1847765450454528:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 61us (151us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1762166977.540258:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2270 00002000:00100000:1.0:1762166977.540263:0:23939:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xa77:0x0] (90112->94207) req@ffff945bcce77100 x1847765450454528/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 488/4536 e 0 to 0 dl 1762166988 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166977.540268:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bcce77100 with x1847765450454528 ext(90112->94207) 00002000:00010000:1.0:1762166977.540271:0:23939:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bcce77100 00000100:00100000:3.0:1762166977.542306:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.542354:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450454784 00000100:00100000:1.0:1762166977.542359:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450454784 00000100:00100000:1.0:1762166977.542388:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30440 00000100:00100000:1.0:1762166977.542394:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4492300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+583:61766:x1847765450454784:12345-192.168.204.38@tcp:36:fsx.0 00010000:00010000:1.0:1762166977.542439:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166977.542464:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaab32 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c9d expref: 583 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.542509:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166977.542515:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166977.542706:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221800/0x2f180c4effbaab39 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166977.542723:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221800/0x2f180c4effbaab39 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.542734:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221800/0x2f180c4effbaab39 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000001:00080000:1.0:1762166977.542783:0:6495:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992036 00000004:00010000:1.0:1762166977.542804:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000080b60a82 reply state 00000000dea3c28c transno 4294992037 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221800/0x2f180c4effbaab39 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.542816:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221800/0x2f180c4effbaab39 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.542822:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166977.542826:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166977.542829:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166977.542897:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4492300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+585:61766:x1847765450454784:12345-192.168.204.38@tcp:36:fsx.0 Request processed in 503us (632us total) trans 4294992037 rc 0/0 00000100:00100000:1.0:1762166977.542902:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30440 00000020:00080000:1.0:1762166977.542906:0:6495:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1762166977.543872:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166977.543917:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.543940:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450455040 00000100:00100000:1.0:1762166977.543946:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450455040 00000100:00100000:3.0:1762166977.543951:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00002000:00010000:1.0:1762166977.543971:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:1.0:1762166977.543980:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4490e00 with x1847765450455040 ext(0->18446744073709551615) 00000100:00100000:0.0:1762166977.543981:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450454912 00000100:00100000:0.0:1762166977.543988:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450454912 00002000:00010000:1.0:1762166977.543994:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc4490e00. 00002000:00010000:0.0:1762166977.544010:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (257587->18446744073709551615) 00002000:00100000:0.0:1762166977.544016:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4490a80 with x1847765450454912 ext(257587->18446744073709551615) 00000100:00100000:2.0:1762166977.544021:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450455168 00002000:00010000:0.0:1762166977.544026:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4490a80. 00000100:00100000:1.0:1762166977.544027:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2271 00000100:00100000:2.0:1762166977.544028:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450455168 00000100:00100000:1.0:1762166977.544043:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4490e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+28:2419:x1847765450455040:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:2.0:1762166977.544054:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00000100:00100000:3.0:1762166977.544059:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2272 00002000:00100000:2.0:1762166977.544061:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4491880 with x1847765450455168 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166977.544070:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4491880. 00000100:00100000:3.0:1762166977.544071:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4490a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+29:2418:x1847765450454912:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:2.0:1762166977.544099:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2273 00000100:00100000:2.0:1762166977.544110:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4491880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+29:2418:x1847765450455168:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:1.0:1762166977.544171:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166977.544175:0:23939:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:1.0:1762166977.544179:0:23939:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166977 -> 1762166977 00002000:00010000:1.0:1762166977.544181:0:23939:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:1.0:1762166977.544184:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00002000:00010000:2.0:1762166977.544195:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166977.544199:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:2.0:1762166977.544202:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166977 -> 1762166977 00002000:00010000:2.0:1762166977.544205:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:2.0:1762166977.544207:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:3.0:1762166977.544220:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 128902 -> 257587 00002000:00010000:3.0:1762166977.544223:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:3.0:1762166977.544228:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166977 -> 1762166977 00000100:00100000:1.0:1762166977.544228:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4490e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+29:2419:x1847765450455040:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 187us (354us total) trans 21474843297 rc 0/0 00002000:00010000:3.0:1762166977.544233:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:3.0:1762166977.544239:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 256 -> 256 00000100:00100000:2.0:1762166977.544242:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4491880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+31:2418:x1847765450455168:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 131us (287us total) trans 17179876371 rc 0/0 00000100:00100000:1.0:1762166977.544247:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2271 00002000:00010000:1.0:1762166977.544255:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00000100:00100000:2.0:1762166977.544258:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2273 00002000:00100000:1.0:1762166977.544262:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4490e00 with x1847765450455040 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166977.544264:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00000100:00100000:3.0:1762166977.544266:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4490a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+31:2418:x1847765450454912:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 197us (348us total) trans 17179876372 rc 0/0 00002000:00010000:1.0:1762166977.544271:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc4490e00. 00002000:00100000:2.0:1762166977.544272:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4491880 with x1847765450455168 ext(0->18446744073709551615) 00000100:00100000:3.0:1762166977.544278:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2272 00002000:00010000:2.0:1762166977.544282:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4491880. 00002000:00010000:3.0:1762166977.544284:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (257587->18446744073709551615) 00002000:00100000:3.0:1762166977.544290:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4490a80 with x1847765450454912 ext(257587->18446744073709551615) 00002000:00010000:3.0:1762166977.544296:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4490a80. 00000100:00100000:3.0:1762166977.545091:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.545118:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450455296 00000100:00100000:1.0:1762166977.545122:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450455296 00000100:00100000:1.0:1762166977.545147:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30441 00000100:00100000:1.0:1762166977.545152:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4493480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+585:61766:x1847765450455296:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:1.0:1762166977.545163:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166977.545173:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221000/0x2f180c4effbaab40 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9ca4 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.545227:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaab47 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166977.545234:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaab47 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.545240:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaab47 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:1.0:1762166977.545254:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 257587 00000004:00200000:1.0:1762166977.545258:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166977.545270:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaab47 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.545286:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221000/0x2f180c4effbaab40 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ca4 expref: 587 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.545296:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaab47 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ca4 expref: 586 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.545301:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166977.545303:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166977.545305:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc6220e00, rc 0) 00000100:00100000:1.0:1762166977.545328:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4493480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+586:61766:x1847765450455296:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 176us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166977.545332:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30441 00000100:00100000:0.0:1762166977.546857:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166977.546944:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450455424 00000100:00100000:3.0:1762166977.546949:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450455424 00002000:00100000:3.0:1762166977.546971:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (77824->86015) req@ffff945cf41a2850 x1847765450455424/t0(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 8680/0 e 0 to 0 dl 1762166988 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166977.546978:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf41a2850 with x1847765450455424 ext(77824->86015) 00002000:00010000:3.0:1762166977.546981:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf41a2850 00000100:00100000:3.0:1762166977.546998:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2274 00000100:00100000:3.0:1762166977.547004:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf41a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+30:2418:x1847765450455424:12345-192.168.204.38@tcp:4:fsx.0 00000100:00100000:3.0:1762166977.547421:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf41a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+32:2418:x1847765450455424:12345-192.168.204.38@tcp:4:fsx.0 Request processed in 415us (564us total) trans 17179876373 rc 0/0 00000100:00100000:3.0:1762166977.547428:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2274 00002000:00100000:3.0:1762166977.547435:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (77824->86015) req@ffff945cf41a2850 x1847765450455424/t17179876373(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 8680/448 e 0 to 0 dl 1762166988 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166977.547442:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf41a2850 with x1847765450455424 ext(77824->86015) 00002000:00010000:3.0:1762166977.547444:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf41a2850 00000100:00100000:0.0:1762166977.548907:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166977.548944:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450455552 00000100:00100000:3.0:1762166977.548948:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450455552 00000100:00100000:3.0:1762166977.548976:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2275 00000100:00100000:3.0:1762166977.548981:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb384e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+32:2419:x1847765450455552:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:3.0:1762166977.549206:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 257587 -> 257587 00002000:00010000:3.0:1762166977.549208:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:3.0:1762166977.549210:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166977 -> 1762166977 00002000:00010000:3.0:1762166977.549212:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:3.0:1762166977.549213:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 256 -> 264 00000100:00100000:3.0:1762166977.549241:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb384e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+33:2419:x1847765450455552:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 260us (338us total) trans 17179876374 rc 0/0 00000100:00100000:3.0:1762166977.549246:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2275 00000100:00100000:2.0:1762166977.550359:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.550402:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450455808 00000100:00100000:1.0:1762166977.550407:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450455808 00000100:00100000:1.0:1762166977.550442:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30442 00000100:00100000:1.0:1762166977.550447:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4533800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+586:61766:x1847765450455808:12345-192.168.204.38@tcp:36:fsx.0 00010000:00010000:1.0:1762166977.550503:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166977.550525:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaab47 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ca4 expref: 586 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.550538:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166977.550542:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166977.550664:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaab4e lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166977.550680:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaab4e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.550689:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaab4e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000001:00080000:1.0:1762166977.550733:0:6495:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992038 00000004:00010000:1.0:1762166977.550756:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000784f6df9 reply state 000000000dc23e65 transno 4294992039 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaab4e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.550768:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaab4e lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.550774:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166977.550777:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166977.550780:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166977.550843:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4533800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+588:61766:x1847765450455808:12345-192.168.204.38@tcp:36:fsx.0 Request processed in 393us (482us total) trans 4294992039 rc 0/0 00000100:00100000:1.0:1762166977.550850:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30442 00000020:00080000:1.0:1762166977.550854:0:6495:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1762166977.551697:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.551717:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166977.551731:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450455936 00000100:00100000:3.0:1762166977.551736:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450455936 00000100:00100000:0.0:1762166977.551745:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00002000:00010000:3.0:1762166977.551757:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (209056->18446744073709551615) 00002000:00100000:3.0:1762166977.551762:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bcb384700 with x1847765450455936 ext(209056->18446744073709551615) 00000100:00100000:2.0:1762166977.551768:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450456064 00002000:00010000:3.0:1762166977.551771:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bcb384700. 00000100:00100000:2.0:1762166977.551775:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450456064 00000100:00100000:3.0:1762166977.551793:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450456192 00000100:00100000:3.0:1762166977.551797:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450456192 00002000:00010000:2.0:1762166977.551798:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00000100:00100000:1.0:1762166977.551803:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2276 00002000:00100000:2.0:1762166977.551807:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bcb385c00 with x1847765450456064 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166977.551814:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00010000:2.0:1762166977.551816:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bcb385c00. 00000100:00100000:1.0:1762166977.551818:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb384700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+34:2418:x1847765450455936:12345-192.168.204.38@tcp:10:fsx.0 00002000:00100000:3.0:1762166977.551821:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bcb387100 with x1847765450456192 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166977.551831:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bcb387100. 00000100:00100000:2.0:1762166977.551843:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2277 00000100:00100000:2.0:1762166977.551854:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb385c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+29:2418:x1847765450456064:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:0.0:1762166977.551856:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2278 00000100:00100000:0.0:1762166977.551866:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb387100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+34:2419:x1847765450456192:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:2.0:1762166977.551948:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166977.551948:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166977.551952:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:0.0:1762166977.551952:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:2.0:1762166977.551955:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166977 -> 1762166977 00002000:00010000:0.0:1762166977.551955:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166977 -> 1762166977 00002000:00010000:2.0:1762166977.551958:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:0.0:1762166977.551958:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:2.0:1762166977.551961:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00002000:00010000:0.0:1762166977.551961:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1762166977.551998:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb385c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+30:2418:x1847765450456064:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 146us (278us total) trans 21474843298 rc 0/0 00002000:00010000:1.0:1762166977.551999:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 257587 -> 209056 00000100:00100000:0.0:1762166977.552003:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb387100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+36:2419:x1847765450456192:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 140us (257us total) trans 17179876375 rc 0/0 00002000:00010000:1.0:1762166977.552008:0:23939:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00000100:00100000:2.0:1762166977.552013:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2277 00002000:00010000:1.0:1762166977.552014:0:23939:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166977 -> 1762166977 00002000:00010000:2.0:1762166977.552018:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00010000:1.0:1762166977.552020:0:23939:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00000100:00100000:0.0:1762166977.552020:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2278 00002000:00100000:2.0:1762166977.552022:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bcb385c00 with x1847765450456064 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166977.552023:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00010000:1.0:1762166977.552026:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 264 -> 264 00002000:00100000:0.0:1762166977.552028:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bcb387100 with x1847765450456192 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166977.552029:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bcb385c00. 00002000:00010000:0.0:1762166977.552035:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bcb387100. 00000100:00100000:1.0:1762166977.552059:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb384700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+35:2418:x1847765450455936:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 246us (361us total) trans 17179876376 rc 0/0 00000100:00100000:1.0:1762166977.552066:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2276 00002000:00010000:1.0:1762166977.552070:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (209056->18446744073709551615) 00002000:00100000:1.0:1762166977.552072:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bcb384700 with x1847765450455936 ext(209056->18446744073709551615) 00002000:00010000:1.0:1762166977.552076:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bcb384700. 00000100:00100000:0.0:1762166977.552854:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.552894:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450456320 00000100:00100000:1.0:1762166977.552898:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450456320 00000100:00100000:1.0:1762166977.552929:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30443 00000100:00100000:1.0:1762166977.552936:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb385f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+588:61766:x1847765450456320:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:1.0:1762166977.552947:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166977.552958:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221000/0x2f180c4effbaab55 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9cab expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.553011:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220200/0x2f180c4effbaab5c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166977.553018:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220200/0x2f180c4effbaab5c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.553024:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220200/0x2f180c4effbaab5c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:1.0:1762166977.553037:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 209056 00000004:00200000:1.0:1762166977.553040:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166977.553049:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220200/0x2f180c4effbaab5c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.553063:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221000/0x2f180c4effbaab55 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9cab expref: 590 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.553073:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220200/0x2f180c4effbaab5c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9cab expref: 589 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.553078:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166977.553080:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166977.553082:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc6220200, rc 0) 00000100:00100000:1.0:1762166977.553108:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb385f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+589:61766:x1847765450456320:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 172us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166977.553114:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30443 00000100:00100000:3.0:1762166977.554431:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.554461:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450456448 00000100:00100000:1.0:1762166977.554465:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450456448 00000100:00100000:1.0:1762166977.554524:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2279 00000100:00100000:1.0:1762166977.554534:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4490000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+35:2417:x1847765450456448:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:1.0:1762166977.554686:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 209056 -> 209056 00002000:00010000:1.0:1762166977.554689:0:23939:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:1.0:1762166977.554691:0:23939:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166977 -> 1762166977 00002000:00010000:1.0:1762166977.554692:0:23939:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:1.0:1762166977.554694:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 264 -> 264 00000100:00100000:1.0:1762166977.554720:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4490000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+36:2417:x1847765450456448:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 188us (289us total) trans 17179876377 rc 0/0 00000100:00100000:1.0:1762166977.554727:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2279 00000100:00100000:0.0:1762166977.556302:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.556333:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450456576 00000100:00100000:1.0:1762166977.556338:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450456576 00002000:00100000:1.0:1762166977.556359:0:23939:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xa77:0x0] (0->212991) req@ffff945bcb385180 x1847765450456576/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 520/0 e 0 to 0 dl 1762166988 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166977.556365:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bcb385180 with x1847765450456576 ext(0->212991) 00002000:00010000:1.0:1762166977.556369:0:23939:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bcb385180 00000100:00100000:1.0:1762166977.556385:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2280 00000100:00100000:1.0:1762166977.556390:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb385180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+36:2418:x1847765450456576:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:1.0:1762166977.557666:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb385180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+36:2418:x1847765450456576:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 1274us (1364us total) trans 0 rc 172032/172032 00000100:00100000:1.0:1762166977.557672:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2280 00002000:00100000:1.0:1762166977.557678:0:23939:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xa77:0x0] (0->212991) req@ffff945bcb385180 x1847765450456576/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 520/440 e 0 to 0 dl 1762166988 ref 1 fl Complete:/600/0 rc 172032/172032 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166977.557685:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bcb385180 with x1847765450456576 ext(0->212991) 00002000:00010000:1.0:1762166977.557688:0:23939:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bcb385180 00000100:00100000:3.0:1762166977.559296:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.559329:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450456832 00000100:00100000:1.0:1762166977.559335:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450456832 00000100:00100000:1.0:1762166977.559361:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11839 00000100:00100000:1.0:1762166977.559367:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4491500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+589:61766:x1847765450456832:12345-192.168.204.38@tcp:35:fsx.0 00000100:00100000:1.0:1762166977.559582:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4491500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+590:61766:x1847765450456832:12345-192.168.204.38@tcp:35:fsx.0 Request processed in 214us (285us total) trans 4294992040 rc 0/0 00000100:00100000:1.0:1762166977.559589:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11839 00000100:00100000:0.0:1762166977.566814:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.566863:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450457088 00000100:00100000:1.0:1762166977.566872:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450457088 00000100:00100000:1.0:1762166977.566940:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30444 00000100:00100000:1.0:1762166977.566952:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb384000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+590:61849:x1847765450457088:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166977.566979:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166977.567001:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221000/0x2f180c4effbaab63 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9cb2 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.567069:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaab6a lrc: 3/1,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166977.567082:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaab6a lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.567090:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaab6a lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.567098:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaab71 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166977.567102:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaab71 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.567106:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaab71 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.567212:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42f6200/0x2f180c4effbaab78 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166977.567219:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42f6200/0x2f180c4effbaab78 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.567223:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42f6200/0x2f180c4effbaab78 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:1.0:1762166977.567231:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 209056 00010000:00010000:1.0:1762166977.567298:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaab6a lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.567303:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaab6a lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.567307:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaab6a lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.567311:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaab6a lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.567317:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc6220e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166977.567320:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaab6a lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.567325:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaab6a lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.567334:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0x0 (ffff945bc812e700) 00010000:00010000:1.0:1762166977.567336:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166977.567339:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaab6a lrc: 3/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.567343:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220e00/0x2f180c4effbaab6a lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.567351:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaab71 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.567355:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaab71 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.567358:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaab71 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.567361:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc6221c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166977.567362:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaab71 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.567365:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaab71 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.567368:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0xdd396665 (ffff945bc812e600) 00010000:00010000:1.0:1762166977.567370:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166977.567372:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaab71 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.567375:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221c00/0x2f180c4effbaab71 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.567405:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221000/0x2f180c4effbaab63 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9cb2 expref: 593 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.567414:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42f6200/0x2f180c4effbaab78 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9cb2 expref: 592 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.567419:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166977.567420:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166977.567422:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc42f6200, rc 0) 00000100:00100000:1.0:1762166977.567510:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb384000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+592:61849:x1847765450457088:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 528us (674us total) trans 4294992041 rc 0/0 00000100:00100000:1.0:1762166977.567517:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30444 00000100:00100000:0.0:1762166977.568462:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.568505:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450457216 00000100:00100000:2.0:1762166977.568511:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450457216 00000100:00100000:2.0:1762166977.568550:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 871 00000100:00100000:2.0:1762166977.568560:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb387b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+592:2416:x1847765450457216:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166977.568573:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166977.568587:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42f6200/0x2f180c4effbaab78 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9cb2 expref: 592 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.568600:0:7421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166977.568604:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166977.568636:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb387b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+591:2416:x1847765450457216:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 78us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166977.568643:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 871 00000100:00100000:3.0:1762166977.568781:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.568816:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450457472 00000100:00100000:1.0:1762166977.568820:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450457472 00000100:00100000:1.0:1762166977.568843:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30445 00000100:00100000:1.0:1762166977.568847:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4492d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+591:61849:x1847765450457472:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166977.568858:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166977.568898:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a400/0x2f180c4effbaab86 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9cb9 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.569196:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbaab8d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x60b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166977.569202:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbaab8d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x60b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.569208:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbaab8d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x60b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:1.0:1762166977.569213:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x60b:0x0]: returning size 0 00010000:00010000:1.0:1762166977.569233:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a400/0x2f180c4effbaab86 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9cb9 expref: 594 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.569243:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbaab8d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x60b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9cb9 expref: 593 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.569248:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x60b:0x0].0x0 (ffff945bc812e200) 00010000:00010000:1.0:1762166977.569249:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166977.569251:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355b600, rc 0) 00000100:00100000:1.0:1762166977.569275:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4492d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+593:61849:x1847765450457472:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 428us (496us total) trans 4294992042 rc 0/0 00000100:00100000:1.0:1762166977.569282:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30445 00000100:00100000:0.0:1762166977.570224:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.570265:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450457728 00000100:00100000:1.0:1762166977.570269:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450457728 00000100:00100000:1.0:1762166977.570300:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30446 00000100:00100000:1.0:1762166977.570308:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb386d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+593:61849:x1847765450457728:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166977.570320:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166977.570327:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbaab9b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x60b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9cc0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.570373:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbaaba2 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x60b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166977.570383:0:6495:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbaab8d lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x60b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9cb9 expref: 594 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.570393:0:6495:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbaaba2 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x60b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.570425:0:6495:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbaab8d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x60b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9cb9 expref: 594 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.570440:0:6495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbaab8d lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x60b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9cb9 expref: 594 pid: 6495 timeout: 696 lvb_type: 0 00000100:00100000:1.0:1762166977.570455:0:6495:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79e8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6495:1847765449715968:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166977.570551:0:6495:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011c7000 going to sleep for 11 seconds 00000100:00100000:1.0:1762166977.571201:0:6495:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79e8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6495:1847765449715968:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166977.571219:0:6495:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbaaba2 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x60b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000100:00100000:0.0:1762166977.571374:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.571412:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450457856 00000100:00100000:2.0:1762166977.571417:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450457856 00010000:00010000:2.0:1762166977.571436:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbaab8d lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x60b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9cb9 expref: 595 pid: 6495 timeout: 696 lvb_type: 0 00000100:00100000:2.0:1762166977.571462:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9566 00000100:00100000:2.0:1762166977.571474:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb386680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+595:2418:x1847765450457856:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166977.571501:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166977.571507:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbaab8d lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x60b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9cb9 expref: 595 pid: 6495 timeout: 696 lvb_type: 0 00010000:00010000:2.0:1762166977.571518:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbaab8d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x60b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9cb9 expref: 595 pid: 6495 timeout: 696 lvb_type: 0 00010000:00010000:2.0:1762166977.571531:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbaab8d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x60b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9cb9 expref: 595 pid: 6495 timeout: 696 lvb_type: 0 00010000:00010000:2.0:1762166977.571542:0:7421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x60b:0x0].0x0 (ffff945bc812e200) 00010000:00010000:2.0:1762166977.571546:0:7421:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbaaba2 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x60b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166977.571553:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbaaba2 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x60b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166977.571558:0:7421:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbaaba2 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x60b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166977.571582:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166977.571602:0:6495:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbaaba2 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x60b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.571610:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbaaba2 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x60b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000100:00100000:2.0:1762166977.571615:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb386680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+594:2418:x1847765450457856:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 143us (240us total) trans 0 rc 0/0 00000004:00200000:1.0:1762166977.571625:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x60b:0x0]: returning size 0 00000100:00100000:2.0:1762166977.571628:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9566 00000004:00080000:1.0:1762166977.571753:0:6495:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xa88:0x0], index 1: 0 00000004:00080000:1.0:1762166977.571758:0:6495:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xa89:0x0], index 0: 0 00010000:00010000:1.0:1762166977.571804:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbaaba2 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x60b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.571809:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbaaba2 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x60b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.571816:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbaaba2 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x60b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.571820:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355b800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166977.571822:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbaaba2 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x60b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.571826:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbaaba2 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x60b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.571832:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x60b:0x0].0x0 (ffff945bc812e200) 00010000:00010000:1.0:1762166977.571833:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166977.571835:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbaaba2 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x60b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.571839:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbaaba2 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x60b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.571858:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbaab9b lrc: 1/0,0 mode: --/CR res: [0x240000404:0x60b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9cc0 expref: 594 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.571863:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x60b:0x0].0x0 (ffff945bc812e200) 00010000:00010000:1.0:1762166977.571865:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1762166977.571867:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbaab9b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x60b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9cc0 expref: 594 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.571889:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355ac00, rc 0) 00000100:00100000:1.0:1762166977.571914:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb386d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+593:61849:x1847765450457728:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1608us (1690us total) trans 4294992043 rc 301/301 00000100:00100000:1.0:1762166977.571919:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30446 00000100:00100000:0.0:1762166977.572636:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.572666:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450458112 00000100:00100000:1.0:1762166977.572670:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450458112 00000100:00100000:1.0:1762166977.572694:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11840 00000100:00100000:1.0:1762166977.572699:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb384a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+593:61849:x1847765450458112:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:1.0:1762166977.572806:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb384a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+594:61849:x1847765450458112:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 107us (170us total) trans 4294992044 rc 0/0 00000100:00100000:1.0:1762166977.572811:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11840 00000100:00100000:0.0:1762166977.573602:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.573631:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450458240 00000100:00100000:1.0:1762166977.573635:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450458240 00000100:00100000:1.0:1762166977.573657:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30447 00000100:00100000:1.0:1762166977.573662:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+594:61849:x1847765450458240:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166977.573670:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166977.573678:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbaabb0 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x60b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9cc7 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.573713:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbaabb7 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x60b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166977.573719:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbaabb7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x60b:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.573725:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbaabb7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x60b:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:1.0:1762166977.573739:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x60b:0x0]: returning size 0 00000004:00200000:1.0:1762166977.573743:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166977.573751:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbaabb7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x60b:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.573764:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbaabb0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x60b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9cc7 expref: 596 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.573772:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbaabb7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x60b:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9cc7 expref: 595 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.573777:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x60b:0x0].0x0 (ffff945bc812e700) 00010000:00010000:1.0:1762166977.573779:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1762166977.573780:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355ba00, rc 0) 00000100:00100000:1.0:1762166977.573802:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+595:61849:x1847765450458240:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 140us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166977.573806:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30447 00000100:00100000:3.0:1762166977.574564:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.574605:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450458368 00000100:00100000:1.0:1762166977.574609:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450458368 00000100:00100000:3.0:1762166977.574637:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.574644:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18953 00000100:00100000:1.0:1762166977.574655:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4490700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+36:2419:x1847765450458368:12345-192.168.204.38@tcp:101:lfs.0 00000100:00100000:2.0:1762166977.574659:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450458496 00000100:00100000:2.0:1762166977.574663:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450458496 00010000:00010000:1.0:1762166977.574666:0:9165:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166977.574681:0:9165:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cc355aa00/0x2f180c4effbaabbe lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9cce expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166977.574689:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18954 00000100:00100000:2.0:1762166977.574699:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4491f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+30:2418:x1847765450458496:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166977.574707:0:35472:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:1.0:1762166977.574708:0:9165:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa88:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1762166977.574721:0:35472:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9e00/0x2f180c4effbaabc5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa89:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9cd5 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.574723:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166977.574728:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166977.574736:0:9165:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355aa00/0x2f180c4effbaabbe lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9cce expref: 37 pid: 9165 timeout: 0 lvb_type: 1 00002000:00010000:2.0:1762166977.574740:0:35472:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa89:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1762166977.574749:0:9165:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945cc355aa00/0x2f180c4effbaabbe lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9cce expref: 37 pid: 9165 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166977.574750:0:35472:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166977.574753:0:35472:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166977.574760:0:35472:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9e00/0x2f180c4effbaabc5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9cd5 expref: 31 pid: 35472 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166977.574774:0:9165:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355aa00, rc 0) 00010000:00010000:2.0:1762166977.574779:0:35472:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9e00/0x2f180c4effbaabc5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9cd5 expref: 31 pid: 35472 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166977.574790:0:35472:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa9e00, rc 0) 00000100:00100000:1.0:1762166977.574803:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4490700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+37:2419:x1847765450458368:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 151us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166977.574808:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18953 00000100:00100000:2.0:1762166977.574817:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4491f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+31:2418:x1847765450458496:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 117us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166977.574826:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18954 00000100:00100000:0.0:1762166977.575771:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.575808:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450458752 00000100:00100000:1.0:1762166977.575813:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450458752 00000100:00100000:1.0:1762166977.575844:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30448 00000100:00100000:1.0:1762166977.575853:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+595:61849:x1847765450458752:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166977.575862:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166977.575872:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbaabcc lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9cdc expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.575931:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbaabd3 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 15 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166977.575940:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbaabd3 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 15 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.575945:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbaabd3 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 15 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:1.0:1762166977.575952:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 209056 00010000:00010000:1.0:1762166977.576011:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbaabcc lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 15 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9cdc expref: 598 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.576025:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbaabd3 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9cdc expref: 597 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.576037:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166977.576040:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762166977.576043:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355b000, rc 0) 00000100:00100000:1.0:1762166977.576078:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+597:61849:x1847765450458752:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 226us (307us total) trans 4294992045 rc 0/0 00000100:00100000:1.0:1762166977.576085:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30448 00000100:00100000:0.0:1762166977.577505:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.577537:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450458880 00000100:00100000:2.0:1762166977.577546:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450458880 00000100:00100000:2.0:1762166977.577578:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18955 00000100:00100000:2.0:1762166977.577585:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+37:2417:x1847765450458880:12345-192.168.204.38@tcp:1:lfs.0 00000100:00100000:0.0:1762166977.577605:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:2.0:1762166977.577614:0:35472:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbaabe1 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.577627:0:35472:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbaa87d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 163840->188415) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9baf expref: 37 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.577633:0:35472:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166977.577635:0:35472:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166977.577637:0:35472:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbaabe1 lrc: 4/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166977.577638:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450459008 00000100:00100000:1.0:1762166977.577645:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450459008 00000100:00100000:0.0:1762166977.577658:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:2.0:1762166977.577668:0:35472:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbaa87d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 163840->188415) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9baf expref: 37 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.577681:0:35472:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbaa87d lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 163840->188415) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9baf expref: 37 pid: 9165 timeout: 696 lvb_type: 0 00000100:00100000:1.0:1762166977.577688:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450459136 00000100:00100000:1.0:1762166977.577694:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450459136 00000100:00100000:2.0:1762166977.577695:0:35472:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4532a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:35472:1847765449716096:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166977.577712:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18956 00000100:00100000:0.0:1762166977.577722:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+31:2417:x1847765450459008:12345-192.168.204.38@tcp:1:lfs.0 00000100:00100000:1.0:1762166977.577737:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18957 00010000:00010000:0.0:1762166977.577743:0:28434:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf400/0x2f180c4effbaabe8 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166977.577753:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+38:2416:x1847765450459136:12345-192.168.204.38@tcp:1:lfs.0 00000100:00100000:2.0:1762166977.577758:0:35472:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf3a33600 going to sleep for 11 seconds 00010000:00010000:0.0:1762166977.577758:0:28434:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfa00/0x2f180c4effbaa8a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9bc4 expref: 31 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.577767:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166977.577769:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166977.577771:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf400/0x2f180c4effbaabe8 lrc: 4/1,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.577780:0:9165:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945cc355a200/0x2f180c4effbaabef lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.577790:0:28434:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfa00/0x2f180c4effbaa8a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9bc4 expref: 31 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.577796:0:9165:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc6220a00/0x2f180c4effbaa8a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9bcb expref: 38 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.577801:0:28434:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfa00/0x2f180c4effbaa8a0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9bc4 expref: 31 pid: 9165 timeout: 696 lvb_type: 0 00010000:00010000:1.0:1762166977.577817:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166977.577821:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00000100:00100000:0.0:1762166977.577821:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc47b5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765449716224:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166977.577827:0:9165:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355a200/0x2f180c4effbaabef lrc: 4/1,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166977.577854:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc37313c0 going to sleep for 11 seconds 00010000:00010000:1.0:1762166977.577855:0:9165:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc6220a00/0x2f180c4effbaa8a7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9bcb expref: 38 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.577869:0:9165:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc6220a00/0x2f180c4effbaa8a7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9bcb expref: 38 pid: 9165 timeout: 696 lvb_type: 0 00000100:00100000:1.0:1762166977.577895:0:9165:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79e8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9165:1847765449716352:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166977.577925:0:9165:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1c86c00 going to sleep for 11 seconds 00000100:00100000:2.0:1762166977.578427:0:35472:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4532a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:35472:1847765449716096:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166977.578445:0:35472:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbaabe1 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166977.578780:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc47b5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765449716224:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166977.578797:0:28434:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf400/0x2f180c4effbaabe8 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166977.578960:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.578983:0:9165:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79e8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9165:1847765449716352:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166977.579002:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:1.0:1762166977.579003:0:9165:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945cc355a200/0x2f180c4effbaabef lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166977.579005:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450459264 00000100:00100000:2.0:1762166977.579010:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450459264 00010000:00010000:2.0:1762166977.579030:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfa00/0x2f180c4effbaa8a0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9bc4 expref: 32 pid: 9165 timeout: 696 lvb_type: 0 00000100:00100000:2.0:1762166977.579058:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450459392 00000100:00100000:2.0:1762166977.579062:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450459392 00000100:00100000:3.0:1762166977.579068:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.579068:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9567 00010000:00010000:2.0:1762166977.579075:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc6220a00/0x2f180c4effbaa8a7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9bcb expref: 39 pid: 9165 timeout: 696 lvb_type: 0 00000100:00100000:0.0:1762166977.579085:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4493800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+32:2417:x1847765450459264:12345-192.168.204.38@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1762166977.579086:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450459520 00000100:00100000:1.0:1762166977.579093:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450459520 00000100:00100000:2.0:1762166977.579098:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9568 00010000:00010000:0.0:1762166977.579100:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1762166977.579107:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff1a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+40:2416:x1847765450459392:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166977.579116:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166977.579123:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfa00/0x2f180c4effbaa8a0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9bc4 expref: 32 pid: 9165 timeout: 696 lvb_type: 0 00010000:00010000:1.0:1762166977.579125:0:6480:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbaa87d lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 163840->188415) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9baf expref: 40 pid: 9165 timeout: 696 lvb_type: 0 00010000:00010000:2.0:1762166977.579129:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc6220a00/0x2f180c4effbaa8a7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9bcb expref: 40 pid: 9165 timeout: 696 lvb_type: 0 00010000:00010000:0.0:1762166977.579153:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfa00/0x2f180c4effbaa8a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9bc4 expref: 32 pid: 9165 timeout: 696 lvb_type: 0 00010000:00010000:2.0:1762166977.579154:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc6220a00/0x2f180c4effbaa8a7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9bcb expref: 40 pid: 9165 timeout: 696 lvb_type: 0 00000100:00100000:1.0:1762166977.579178:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9569 00010000:00010000:2.0:1762166977.579184:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc6220a00/0x2f180c4effbaa8a7 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9bcb expref: 40 pid: 9165 timeout: 696 lvb_type: 0 00010000:00010000:0.0:1762166977.579188:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfa00/0x2f180c4effbaa8a0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9bc4 expref: 32 pid: 9165 timeout: 696 lvb_type: 0 00000100:00100000:1.0:1762166977.579194:0:6480:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4493b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+40:2419:x1847765450459520:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166977.579201:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166977.579205:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166977.579209:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945cc355a200/0x2f180c4effbaabef lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.579210:0:6480:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166977.579212:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166977.579216:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166977.579219:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf400/0x2f180c4effbaabe8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.579228:0:6480:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbaa87d lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 163840->188415) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9baf expref: 39 pid: 9165 timeout: 696 lvb_type: 0 00010000:00010000:2.0:1762166977.579235:0:7421:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355a200/0x2f180c4effbaabef lrc: 4/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.579241:0:6479:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf400/0x2f180c4effbaabe8 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.579262:0:6480:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbaa87d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 163840->188415) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9baf expref: 39 pid: 9165 timeout: 696 lvb_type: 0 00010000:00010000:2.0:1762166977.579281:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166977.579286:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbaa87d lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 163840->188415) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9baf expref: 39 pid: 9165 timeout: 696 lvb_type: 0 00010000:00010000:0.0:1762166977.579293:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166977.579299:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166977.579303:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166977.579307:0:6480:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbaabe1 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166977.579310:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff1a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+38:2416:x1847765450459392:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 204us (311us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166977.579317:0:28434:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf400/0x2f180c4effbaabe8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166977.579324:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4493800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+31:2417:x1847765450459264:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 241us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166977.579325:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9568 00010000:00010000:1.0:1762166977.579334:0:6480:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbaabe1 lrc: 4/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.579339:0:28434:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf400/0x2f180c4effbaabe8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166977.579346:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9567 00010000:00010000:2.0:1762166977.579354:0:9165:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945cc355a200/0x2f180c4effbaabef lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.579361:0:9165:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cc355a200/0x2f180c4effbaabef lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.579367:0:28434:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf400/0x2f180c4effbaabe8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.579367:0:6480:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166977.579372:0:9165:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945cc355a200/0x2f180c4effbaabef lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.579383:0:28434:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf400/0x2f180c4effbaabe8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.579385:0:9165:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355a200/0x2f180c4effbaabef lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.579402:0:28434:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf400/0x2f180c4effbaabe8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166977.579402:0:6480:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4493b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+37:2419:x1847765450459520:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 210us (336us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166977.579405:0:9165:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945cc355a200/0x2f180c4effbaabef lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166977.579423:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9569 00010000:00010000:2.0:1762166977.579427:0:9165:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355a200 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166977.579430:0:28434:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdf400 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166977.579434:0:9165:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc355a200/0x2f180c4effbaabef lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.579436:0:28434:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf400/0x2f180c4effbaabe8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.579454:0:9165:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc355a200/0x2f180c4effbaabef lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.579455:0:28434:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf400/0x2f180c4effbaabe8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.579462:0:35472:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbaabe1 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.579507:0:35472:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbaabe1 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.579510:0:28434:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf400/0x2f180c4effbaabe8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.579517:0:9165:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945cc355a200/0x2f180c4effbaabef lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.579525:0:35472:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbaabe1 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.579528:0:9165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cc355a200/0x2f180c4effbaabef lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.579548:0:35472:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbaabe1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.579563:0:28434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf400/0x2f180c4effbaabe8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.579565:0:35472:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbaabe1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.579585:0:35472:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa8800 already unused, calling callback (ffffffffc0cd9320) 00000100:00100000:2.0:1762166977.579589:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+36:2416:x1847765450459136:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 1842us (1930us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166977.579591:0:35472:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbaabe1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166977.579597:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18957 00010000:00010000:1.0:1762166977.579606:0:35472:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbaabe1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.579619:0:35472:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbaabe1 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166977.579629:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+30:2417:x1847765450459008:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 1907us (2023us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166977.579630:0:35472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbaabe1 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166977.579639:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18956 00000100:00100000:1.0:1762166977.579692:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+35:2417:x1847765450458880:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 2107us (2190us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166977.579700:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18955 00000100:00100000:0.0:1762166977.580650:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.580671:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.580688:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450459648 00000100:00100000:1.0:1762166977.580693:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450459648 00000100:00100000:3.0:1762166977.580706:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450459776 00000100:00100000:0.0:1762166977.580712:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166977.580713:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450459776 00000100:00100000:1.0:1762166977.580721:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450459904 00000100:00100000:1.0:1762166977.580725:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450459904 00000100:00100000:3.0:1762166977.580754:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18958 00000100:00100000:1.0:1762166977.580766:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18959 00000100:00100000:2.0:1762166977.580777:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18960 00000100:00100000:1.0:1762166977.580777:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+30:2416:x1847765450459776:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166977.580793:0:35472:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1762166977.580795:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+36:2416:x1847765450459904:12345-192.168.204.38@tcp:101:lfs.0 00000100:00100000:3.0:1762166977.580802:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+36:2416:x1847765450459648:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166977.580805:0:8383:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166977.580809:0:35472:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cc355a000/0x2f180c4effbaabf6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9cea expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.580815:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166977.580819:0:8383:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbaabfd lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9cf1 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.580829:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8472600/0x2f180c4effbaac04 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9ce3 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762166977.580830:0:35472:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa7a:0x0] initial LVB size: 0, mtime: 0x690888c1, atime: 0x690888c1, ctime: 0x690888c1, blocks: 0x1800 00002000:00010000:2.0:1762166977.580834:0:8383:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa79:0x0] initial LVB size: 0, mtime: 0x690888c1, atime: 0x690888c1, ctime: 0x690888c1, blocks: 0x0 00010000:00010000:2.0:1762166977.580852:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166977.580852:0:35472:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00002000:00010000:3.0:1762166977.580854:0:28434:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa77:0x0] initial LVB size: 209056, mtime: 0x690888c1, atime: 0x690888c1, ctime: 0x690888c1, blocks: 0x108 00010000:00010000:2.0:1762166977.580857:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166977.580857:0:35472:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166977.580866:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166977.580866:0:8383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbaabfd lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9cf1 expref: 38 pid: 8383 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166977.580870:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166977.580870:0:35472:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cc355a000/0x2f180c4effbaabf6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9cea expref: 31 pid: 35472 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166977.580892:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472600/0x2f180c4effbaac04 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ce3 expref: 38 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166977.580904:0:8383:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbaabfd lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9cf1 expref: 38 pid: 8383 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166977.580915:0:35472:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945cc355a000/0x2f180c4effbaabf6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9cea expref: 31 pid: 35472 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166977.580921:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc8472600/0x2f180c4effbaac04 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ce3 expref: 38 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166977.580926:0:8383:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa8200, rc 0) 00010000:00010000:1.0:1762166977.580938:0:35472:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355a000, rc 0) 00010000:00010000:3.0:1762166977.580943:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8472600, rc 0) 00000100:00100000:2.0:1762166977.580968:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+38:2416:x1847765450459904:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 178us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166977.580969:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+31:2416:x1847765450459776:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 193us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166977.580974:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+38:2416:x1847765450459648:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 209us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166977.580987:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18960 00000100:00100000:1.0:1762166977.580994:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18959 00000100:00100000:3.0:1762166977.581002:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18958 00000100:00100000:3.0:1762166977.603198:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.603273:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450460032 00000100:00100000:2.0:1762166977.603286:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450460032 00000100:00100000:2.0:1762166977.603350:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18961 00000100:00100000:2.0:1762166977.603361:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4492a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+37:2417:x1847765450460032:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:2.0:1762166977.603553:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4492a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+37:2417:x1847765450460032:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 193us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166977.603561:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18961 00000100:00100000:0.0:1762166977.604526:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.604571:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450460160 00000100:00100000:1.0:1762166977.604577:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450460160 00000100:00100000:1.0:1762166977.604620:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30449 00000100:00100000:1.0:1762166977.604629:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+597:61849:x1847765450460160:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166977.604650:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166977.604678:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbaac0b lrc: 2/0,0 mode: --/PR res: [0x240000404:0x60b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9cf8 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.604719:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbaac12 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x60b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166977.604735:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbaac12 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x60b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.604748:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbaac12 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x60b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.604868:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbaac0b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x60b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9cf8 expref: 599 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.604894:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbaac12 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x60b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9cf8 expref: 598 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.604902:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x60b:0x0].0x0 (ffff945bc812e700) 00010000:00010000:1.0:1762166977.604904:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1762166977.604907:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355a800, rc 0) 00000100:00100000:1.0:1762166977.604939:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+598:61849:x1847765450460160:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 313us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166977.604944:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30449 00000100:00100000:0.0:1762166977.605824:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.605859:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450460416 00000100:00100000:1.0:1762166977.605865:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450460416 00000100:00100000:1.0:1762166977.605913:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30450 00000100:00100000:1.0:1762166977.605921:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+598:61849:x1847765450460416:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:1.0:1762166977.605963:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166977.605979:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbaabb7 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x60b:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9cc7 expref: 598 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.605990:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x60b:0x0].0x0 (ffff945bc812e700) 00010000:00010000:1.0:1762166977.605994:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166977.606160:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbaac19 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x60b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166977.606170:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbaac19 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x60b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.606177:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbaac19 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x60b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000001:00080000:1.0:1762166977.606226:0:6495:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992046 00000004:00010000:1.0:1762166977.606247:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000028d8770d reply state 00000000eabd6ac4 transno 4294992047 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbaac19 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x60b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.606264:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbaac19 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x60b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.606270:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x60b:0x0].0x0 (ffff945bc812e700) 00010000:00010000:1.0:1762166977.606273:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166977.606275:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166977.606332:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+600:61849:x1847765450460416:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 412us (508us total) trans 4294992047 rc 0/0 00000100:00100000:1.0:1762166977.606349:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30450 00000020:00080000:1.0:1762166977.606354:0:6495:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1762166977.607038:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.607076:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450460544 00000100:00100000:1.0:1762166977.607080:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450460544 00000100:00100000:1.0:1762166977.607105:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30451 00000100:00100000:1.0:1762166977.607110:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4490e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+600:61849:x1847765450460544:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166977.607119:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166977.607126:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbaac20 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x60b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9cff expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.607149:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbaac20 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x60b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9cff expref: 601 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.607155:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbaac20 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x60b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9cff expref: 601 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.607166:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x60b:0x0].0x0 (ffff945bc812e700) 00010000:00010000:1.0:1762166977.607168:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166977.607170:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355b800, rc 0) 00000100:00100000:1.0:1762166977.607194:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4490e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+601:61849:x1847765450460544:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 84us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166977.607199:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30451 00000100:00100000:0.0:1762166977.608077:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.608117:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450460672 00000100:00100000:2.0:1762166977.608123:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450460672 00000100:00100000:2.0:1762166977.608160:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18962 00000100:00100000:2.0:1762166977.608168:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+37:61849:x1847765450460672:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166977.608180:0:8380:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166977.608194:0:8380:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbaac27 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9d06 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.608218:0:8380:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945cc355aa00/0x2f180c4effbaabbe lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9cce expref: 38 pid: 9165 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166977.608227:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166977.608229:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166977.608233:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbaac27 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d06 expref: 38 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.608267:0:8380:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945cc355aa00/0x2f180c4effbaabbe lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9cce expref: 38 pid: 9165 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166977.608282:0:8380:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945cc355aa00/0x2f180c4effbaabbe lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9cce expref: 38 pid: 9165 timeout: 696 lvb_type: 1 00000100:00100000:2.0:1762166977.608299:0:8380:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4532a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8380:1847765449716480:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166977.608377:0:8380:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf3a33600 going to sleep for 11 seconds 00000100:00100000:2.0:1762166977.609076:0:8380:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4532a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8380:1847765449716480:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166977.609095:0:8380:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbaac27 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d06 expref: 38 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.609107:0:8380:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa9000, rc 0) 00000100:00100000:2.0:1762166977.609154:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+38:61849:x1847765450460672:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 985us (1076us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166977.609161:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18962 00000100:00100000:0.0:1762166977.609232:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.609283:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450460800 00000100:00100000:1.0:1762166977.609289:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450460800 00010000:00010000:1.0:1762166977.609312:0:6480:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355aa00/0x2f180c4effbaabbe lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9cce expref: 38 pid: 9165 timeout: 696 lvb_type: 1 00000100:00100000:1.0:1762166977.609342:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9570 00000100:00100000:1.0:1762166977.609349:0:6480:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb387b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+38:2419:x1847765450460800:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166977.609364:0:6480:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166977.609370:0:6480:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945cc355aa00/0x2f180c4effbaabbe lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9cce expref: 38 pid: 9165 timeout: 696 lvb_type: 1 00010000:00010000:1.0:1762166977.609382:0:6480:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945cc355aa00/0x2f180c4effbaabbe lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9cce expref: 38 pid: 9165 timeout: 696 lvb_type: 1 00010000:00010000:1.0:1762166977.609401:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cc355aa00/0x2f180c4effbaabbe lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9cce expref: 38 pid: 9165 timeout: 696 lvb_type: 1 00010000:00010000:1.0:1762166977.609412:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166977.609414:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166977.609419:0:6480:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbaac27 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d06 expref: 37 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.609428:0:6480:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbaac27 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d06 expref: 37 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.609460:0:6480:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbaac27 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d06 expref: 37 pid: 8380 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166977.609470:0:6480:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79e8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6480:1847765449716608:192.168.204.38@tcp:105: 00000100:00100000:1.0:1762166977.609547:0:6480:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011c7000 going to sleep for 11 seconds 00000100:00100000:1.0:1762166977.610248:0:6480:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79e8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6480:1847765449716608:192.168.204.38@tcp:105: 00010000:00010000:1.0:1762166977.610256:0:6480:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166977.610279:0:6480:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb387b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+37:2419:x1847765450460800:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 932us (1051us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166977.610284:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9570 00000100:00100000:3.0:1762166977.610402:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.610435:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450460928 00000100:00100000:2.0:1762166977.610440:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450460928 00000100:00100000:2.0:1762166977.610511:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18963 00000100:00100000:2.0:1762166977.610523:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4491880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+31:61849:x1847765450460928:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166977.610537:0:8380:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166977.610551:0:8380:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9a00/0x2f180c4effbaac2e lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa89:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9d0d expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.610570:0:8380:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9e00/0x2f180c4effbaabc5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9cd5 expref: 32 pid: 35472 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166977.610583:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166977.610585:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166977.610589:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9a00/0x2f180c4effbaac2e lrc: 4/0,0 mode: --/PW res: [0x280000400:0xa89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d0d expref: 32 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.610608:0:8380:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9e00/0x2f180c4effbaabc5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9cd5 expref: 32 pid: 35472 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166977.610619:0:8380:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9e00/0x2f180c4effbaabc5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9cd5 expref: 32 pid: 35472 timeout: 696 lvb_type: 1 00000100:00100000:2.0:1762166977.610630:0:8380:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4532a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8380:1847765449716736:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166977.610670:0:8380:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf3a33600 going to sleep for 11 seconds 00000100:00100000:2.0:1762166977.611320:0:8380:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4532a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8380:1847765449716736:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166977.611337:0:8380:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9a00/0x2f180c4effbaac2e lrc: 3/0,0 mode: --/PW res: [0x280000400:0xa89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d0d expref: 32 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.611350:0:8380:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa9a00, rc 0) 00000100:00100000:2.0:1762166977.611381:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4491880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+32:61849:x1847765450460928:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 862us (980us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166977.611386:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18963 00000100:00100000:3.0:1762166977.611444:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.611506:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450461056 00000100:00100000:1.0:1762166977.611511:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450461056 00010000:00010000:1.0:1762166977.611528:0:6480:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9e00/0x2f180c4effbaabc5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9cd5 expref: 32 pid: 35472 timeout: 696 lvb_type: 1 00000100:00100000:1.0:1762166977.611555:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9571 00000100:00100000:1.0:1762166977.611562:0:6480:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4490a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+32:2419:x1847765450461056:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166977.611571:0:6480:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166977.611576:0:6480:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9e00/0x2f180c4effbaabc5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa89:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9cd5 expref: 32 pid: 35472 timeout: 696 lvb_type: 1 00010000:00010000:1.0:1762166977.611586:0:6480:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9e00/0x2f180c4effbaabc5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa89:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9cd5 expref: 32 pid: 35472 timeout: 696 lvb_type: 1 00010000:00010000:1.0:1762166977.611608:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9e00/0x2f180c4effbaabc5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa89:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9cd5 expref: 32 pid: 35472 timeout: 696 lvb_type: 1 00010000:00010000:1.0:1762166977.611619:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166977.611621:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166977.611625:0:6480:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9a00/0x2f180c4effbaac2e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d0d expref: 31 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.611634:0:6480:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9a00/0x2f180c4effbaac2e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d0d expref: 31 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.611654:0:6480:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9a00/0x2f180c4effbaac2e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d0d expref: 31 pid: 8380 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166977.611664:0:6480:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79e8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6480:1847765449716864:192.168.204.38@tcp:105: 00000100:00100000:1.0:1762166977.611704:0:6480:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011c7000 going to sleep for 11 seconds 00000100:00100000:1.0:1762166977.612359:0:6480:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79e8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6480:1847765449716864:192.168.204.38@tcp:105: 00010000:00010000:1.0:1762166977.612366:0:6480:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166977.612390:0:6480:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4490a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+31:2419:x1847765450461056:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 830us (949us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166977.612401:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9571 00000100:00100000:3.0:1762166977.612566:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.612605:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450461184 00000100:00100000:1.0:1762166977.612610:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450461184 00000100:00100000:3.0:1762166977.612628:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00002000:00010000:1.0:1762166977.612635:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2696 (0->18446744073709551615) 00002000:00100000:1.0:1762166977.612639:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4493100 with x1847765450461184 ext(0->18446744073709551615) 00002000:00010000:1.0:1762166977.612647:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4493100. 00000100:00100000:0.0:1762166977.612652:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450461312 00000100:00100000:0.0:1762166977.612657:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450461312 00002000:00010000:0.0:1762166977.612672:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2697 (0->18446744073709551615) 00000100:00100000:1.0:1762166977.612675:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2281 00002000:00100000:0.0:1762166977.612677:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4490380 with x1847765450461312 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166977.612684:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc4490380. 00000100:00100000:1.0:1762166977.612689:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4493100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+37:2418:x1847765450461184:12345-192.168.204.38@tcp:10:lfs.0 00000100:00100000:0.0:1762166977.612709:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2282 00000100:00100000:0.0:1762166977.612720:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4490380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+31:2419:x1847765450461312:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:1.0:1762166977.612867:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa88:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166977.612868:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa89:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166977.612870:0:23939:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa88:0x0] updating lvb mtime from disk: 0 -> 1762166977 00002000:00010000:0.0:1762166977.612887:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa89:0x0] updating lvb mtime from disk: 0 -> 1762166977 00002000:00010000:1.0:1762166977.612888:0:23939:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa88:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1762166977.612893:0:23939:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa88:0x0] updating lvb ctime from disk: 0 -> 1762166977 00002000:00010000:0.0:1762166977.612895:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa89:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1762166977.612896:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa88:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:0.0:1762166977.612900:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa89:0x0] updating lvb ctime from disk: 0 -> 1762166977 00002000:00010000:0.0:1762166977.612904:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa89:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1762166977.612927:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4493100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+38:2418:x1847765450461184:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 242us (360us total) trans 17179876378 rc 0/0 00000100:00100000:0.0:1762166977.612935:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4490380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+32:2419:x1847765450461312:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 215us (304us total) trans 21474843299 rc 0/0 00000100:00100000:1.0:1762166977.612940:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2281 00002000:00010000:1.0:1762166977.612947:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2696 (0->18446744073709551615) 00000100:00100000:0.0:1762166977.612950:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2282 00002000:00100000:1.0:1762166977.612952:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4493100 with x1847765450461184 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166977.612957:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2697 (0->18446744073709551615) 00002000:00010000:1.0:1762166977.612959:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4493100. 00002000:00100000:0.0:1762166977.612963:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4490380 with x1847765450461312 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166977.612970:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc4490380. 00000100:00100000:0.0:1762166977.613916:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.613961:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450461440 00000100:00100000:2.0:1762166977.613967:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450461440 00000100:00100000:2.0:1762166977.613993:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18964 00000100:00100000:2.0:1762166977.613998:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb386680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+38:2419:x1847765450461440:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:2.0:1762166977.614055:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb386680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+38:2419:x1847765450461440:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 57us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166977.614060:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18964 00000100:00100000:3.0:1762166977.614864:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.614904:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450461568 00000100:00100000:2.0:1762166977.614908:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450461568 00000100:00100000:2.0:1762166977.614930:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18965 00000100:00100000:2.0:1762166977.614934:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4491c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+38:2418:x1847765450461568:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:2.0:1762166977.614976:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4491c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+38:2418:x1847765450461568:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 42us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166977.614981:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18965 00000100:00100000:3.0:1762166977.615890:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.615931:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450461696 00000100:00100000:0.0:1762166977.615936:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450461696 00000100:00100000:0.0:1762166977.615966:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2283 00000100:00100000:0.0:1762166977.615971:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4493800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+38:2419:x1847765450461696:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:0.0:1762166977.616009:0:8388:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbaac35 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.616019:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166977.616021:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166977.616024:0:8388:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbaac35 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.616037:0:8388:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbaac35 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.616144:0:8388:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbaac35 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.616153:0:8388:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbaac35 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.616162:0:8388:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbaac35 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.616168:0:8388:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdf600 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166977.616173:0:8388:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbaac35 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.616183:0:8388:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbaac35 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.616201:0:8388:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbaac35 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.616206:0:8388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbaac35 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166977.616239:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4493800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+38:2419:x1847765450461696:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 268us (350us total) trans 0 rc 12288/12288 00000100:00100000:0.0:1762166977.616244:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2283 00000100:00100000:0.0:1762166977.617253:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166977.617287:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450461824 00000100:00100000:3.0:1762166977.617292:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450461824 00000100:00100000:3.0:1762166977.617322:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2284 00000100:00100000:3.0:1762166977.617327:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+38:2418:x1847765450461824:12345-192.168.204.38@tcp:4:lfs.0 00010000:00010000:3.0:1762166977.617343:0:8388:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effbaac3c lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.617353:0:8388:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbaac27 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d06 expref: 38 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.617357:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166977.617359:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166977.617361:0:8388:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effbaac3c lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.617388:0:8388:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbaac27 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d06 expref: 38 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.617398:0:8388:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbaac27 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d06 expref: 38 pid: 8380 timeout: 696 lvb_type: 0 00000100:00100000:3.0:1762166977.617408:0:8388:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc6225f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:8388:1847765449716992:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166977.617460:0:8388:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc2c72600 going to sleep for 11 seconds 00000100:00100000:0.0:1762166977.618131:0:8388:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc6225f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:8388:1847765449716992:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166977.618146:0:8388:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effbaac3c lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166977.618350:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.618396:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450461952 00000100:00100000:1.0:1762166977.618402:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450461952 00010000:00010000:1.0:1762166977.618425:0:6480:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbaac27 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d06 expref: 39 pid: 8380 timeout: 696 lvb_type: 0 00000100:00100000:1.0:1762166977.618457:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9572 00000100:00100000:1.0:1762166977.618465:0:6480:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+39:2418:x1847765450461952:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166977.618518:0:6480:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166977.618546:0:6480:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbaac27 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d06 expref: 39 pid: 8380 timeout: 696 lvb_type: 0 00010000:00010000:1.0:1762166977.618561:0:6480:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbaac27 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d06 expref: 39 pid: 8380 timeout: 696 lvb_type: 0 00010000:00010000:1.0:1762166977.618583:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbaac27 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d06 expref: 39 pid: 8380 timeout: 696 lvb_type: 0 00010000:00010000:1.0:1762166977.618595:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166977.618597:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166977.618601:0:6480:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effbaac3c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.618609:0:6480:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effbaac3c lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.618633:0:6480:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166977.618652:0:8388:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effbaac3c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.618663:0:8388:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effbaac3c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166977.618670:0:6480:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+38:2418:x1847765450461952:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 204us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166977.618682:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9572 00000001:00080000:2.0:1762166977.619720:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876379 is committed 00002000:00010000:0.0:1762166977.619815:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa88:0x0] updating lvb size from disk: 0 -> 12288 00002000:00010000:0.0:1762166977.619820:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa88:0x0] updating lvb blocks from disk: 0 -> 24 00010000:00010000:0.0:1762166977.619826:0:8388:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effbaac3c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.619836:0:8388:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effbaac3c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.619846:0:8388:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effbaac3c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.619853:0:8388:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8472c00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166977.619858:0:8388:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effbaac3c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.619867:0:8388:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effbaac3c lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.619892:0:8388:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effbaac3c lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.619900:0:8388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effbaac3c lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166977.619946:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450461824:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 2618us (2695us total) trans 17179876379 rc 0/0 00000100:00100000:0.0:1762166977.619954:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2284 00000100:00100000:0.0:1762166977.620857:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.620903:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450462080 00000100:00100000:2.0:1762166977.620907:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450462080 00000100:00100000:2.0:1762166977.620936:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18966 00000100:00100000:2.0:1762166977.620942:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450462080:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:2.0:1762166977.621006:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450462080:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 64us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166977.621011:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18966 00000100:00100000:3.0:1762166977.621871:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.621909:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450462208 00000100:00100000:2.0:1762166977.621913:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450462208 00000100:00100000:2.0:1762166977.621936:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18967 00000100:00100000:2.0:1762166977.621941:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6225500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450462208:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:2.0:1762166977.621982:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6225500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450462208:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 41us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166977.621987:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18967 00000100:00100000:3.0:1762166977.622824:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.622850:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450462336 00000100:00100000:0.0:1762166977.622854:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450462336 00000100:00100000:0.0:1762166977.622891:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2285 00000100:00100000:0.0:1762166977.622897:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6224380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+18:2417:x1847765450462336:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:0.0:1762166977.622929:0:8388:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbaac43 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.622946:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166977.622948:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166977.622953:0:8388:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbaac43 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [122880->131071] (req 122880->131071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.622964:0:8388:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbaac43 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [122880->131071] (req 122880->131071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.623045:0:8388:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbaac43 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [122880->131071] (req 122880->131071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.623054:0:8388:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbaac43 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [122880->131071] (req 122880->131071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.623062:0:8388:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbaac43 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [122880->131071] (req 122880->131071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.623069:0:8388:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdf800 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166977.623072:0:8388:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbaac43 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [122880->131071] (req 122880->131071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.623080:0:8388:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbaac43 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [122880->131071] (req 122880->131071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.623092:0:8388:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbaac43 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [122880->131071] (req 122880->131071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.623099:0:8388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbaac43 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [122880->131071] (req 122880->131071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166977.623140:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6224380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+18:2417:x1847765450462336:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 242us (315us total) trans 0 rc 8192/8192 00000100:00100000:0.0:1762166977.623148:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2285 00000100:00100000:0.0:1762166977.624097:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166977.624131:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450462464 00000100:00100000:3.0:1762166977.624135:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450462464 00000100:00100000:3.0:1762166977.624210:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2286 00000100:00100000:3.0:1762166977.624220:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+18:2416:x1847765450462464:12345-192.168.204.38@tcp:4:lfs.0 00002000:00010000:3.0:1762166977.624250:0:8388:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa88:0x0] initial LVB size: 12288, mtime: 0x690888c1, atime: 0x0, ctime: 0x690888c1, blocks: 0x18 00010000:00010000:3.0:1762166977.624257:0:8388:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc8472400/0x2f180c4effbaac4a lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.624267:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166977.624269:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166977.624272:0:8388:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472400/0x2f180c4effbaac4a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa88:0x0].0x0 rrc: 2 type: EXT [122880->131071] (req 122880->131071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.624282:0:8388:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8472400/0x2f180c4effbaac4a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa88:0x0].0x0 rrc: 2 type: EXT [122880->131071] (req 122880->131071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000001:00080000:2.0:1762166977.625115:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876380 is committed 00002000:00010000:3.0:1762166977.625178:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa88:0x0] updating lvb size from disk: 12288 -> 131072 00002000:00010000:3.0:1762166977.625183:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa88:0x0] updating lvb blocks from disk: 24 -> 40 00010000:00010000:3.0:1762166977.625189:0:8388:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc8472400/0x2f180c4effbaac4a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa88:0x0].0x0 rrc: 2 type: EXT [122880->131071] (req 122880->131071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.625198:0:8388:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472400/0x2f180c4effbaac4a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa88:0x0].0x0 rrc: 2 type: EXT [122880->131071] (req 122880->131071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.625203:0:8388:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc8472400/0x2f180c4effbaac4a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa88:0x0].0x0 rrc: 2 type: EXT [122880->131071] (req 122880->131071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.625207:0:8388:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8472400 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166977.625210:0:8388:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8472400/0x2f180c4effbaac4a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa88:0x0].0x0 rrc: 2 type: EXT [122880->131071] (req 122880->131071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.625214:0:8388:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8472400/0x2f180c4effbaac4a lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa88:0x0].0x0 rrc: 2 type: EXT [122880->131071] (req 122880->131071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.625221:0:8388:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc8472400/0x2f180c4effbaac4a lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa88:0x0].0x0 rrc: 2 type: EXT [122880->131071] (req 122880->131071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.625225:0:8388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8472400/0x2f180c4effbaac4a lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa88:0x0].0x0 rrc: 2 type: EXT [122880->131071] (req 122880->131071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166977.625270:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+18:2416:x1847765450462464:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 1053us (1175us total) trans 17179876380 rc 0/0 00000100:00100000:3.0:1762166977.625275:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2286 00000100:00100000:3.0:1762166977.626231:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.626270:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450462592 00000100:00100000:2.0:1762166977.626276:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450462592 00000100:00100000:2.0:1762166977.626307:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18968 00000100:00100000:2.0:1762166977.626315:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6227100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+18:2417:x1847765450462592:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:2.0:1762166977.626383:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6227100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+18:2417:x1847765450462592:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 68us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166977.626392:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18968 00000100:00100000:0.0:1762166977.627306:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.627350:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450462848 00000100:00100000:1.0:1762166977.627354:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450462848 00000100:00100000:1.0:1762166977.627389:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30452 00000100:00100000:1.0:1762166977.627395:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+601:61849:x1847765450462848:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:1.0:1762166977.627608:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbaac51 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x60b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166977.627624:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbaac51 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x60b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.627635:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbaac51 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x60b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000001:00080000:1.0:1762166977.627686:0:6495:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992048 00000004:00010000:1.0:1762166977.627712:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000011844d28 reply state 000000007fba9c45 transno 4294992049 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbaac51 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x60b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.627724:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbaac51 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x60b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.627731:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x60b:0x0].0x0 (ffff945bc812e700) 00010000:00010000:1.0:1762166977.627734:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166977.627738:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166977.627811:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+604:61849:x1847765450462848:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 415us (505us total) trans 4294992049 rc 0/0 00000100:00100000:1.0:1762166977.627817:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30452 00000020:00080000:1.0:1762166977.627822:0:6495:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1762166977.628743:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.628797:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450462976 00000100:00100000:2.0:1762166977.628803:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450462976 00000100:00100000:2.0:1762166977.628835:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18969 00000100:00100000:2.0:1762166977.628844:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+18:61849:x1847765450462976:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166977.628856:0:8380:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166977.628870:0:8380:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9400/0x2f180c4effbaac58 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9d14 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166977.628900:0:8380:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa88:0x0] initial LVB size: 131072, mtime: 0x690888c1, atime: 0x0, ctime: 0x690888c1, blocks: 0x28 00010000:00010000:2.0:1762166977.628916:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166977.628919:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166977.628925:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9400/0x2f180c4effbaac58 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d14 expref: 19 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.628940:0:8380:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9400/0x2f180c4effbaac58 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d14 expref: 19 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.628952:0:8380:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa9400, rc 0) 00000100:00100000:2.0:1762166977.628987:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+19:61849:x1847765450462976:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 144us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166977.628995:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18969 00000100:00100000:3.0:1762166977.629815:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.629859:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450463104 00000100:00100000:0.0:1762166977.629865:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450463104 00002000:00010000:0.0:1762166977.629899:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2696 (209056->18446744073709551615) 00002000:00100000:0.0:1762166977.629904:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc6227480 with x1847765450463104 ext(209056->18446744073709551615) 00002000:00010000:0.0:1762166977.629912:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc6227480. 00000100:00100000:0.0:1762166977.629939:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2287 00000100:00100000:0.0:1762166977.629952:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6227480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:2416:x1847765450463104:12345-192.168.204.38@tcp:10:lfs.0 00000100:00100000:3.0:1762166977.629959:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.629996:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450463232 00000100:00100000:1.0:1762166977.630000:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450463232 00002000:00010000:1.0:1762166977.630017:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2697 (0->18446744073709551615) 00002000:00100000:1.0:1762166977.630020:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc6226a00 with x1847765450463232 ext(0->18446744073709551615) 00002000:00010000:1.0:1762166977.630028:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc6226a00. 00000100:00100000:1.0:1762166977.630048:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2288 00000100:00100000:1.0:1762166977.630054:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6226a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+32:2416:x1847765450463232:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:0.0:1762166977.630120:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa88:0x0] updating lvb size from disk: 131072 -> 209056 00002000:00010000:0.0:1762166977.630124:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa88:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:0.0:1762166977.630127:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa88:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1762166977.630130:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa88:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:0.0:1762166977.630132:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa88:0x0] updating lvb blocks from disk: 40 -> 40 00002000:00010000:1.0:1762166977.630150:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa89:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166977.630153:0:23939:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa89:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:1.0:1762166977.630155:0:23939:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa89:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1762166977.630157:0:23939:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa89:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:1.0:1762166977.630158:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa89:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1762166977.630175:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6227480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:2416:x1847765450463104:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 227us (365us total) trans 17179876381 rc 0/0 00000100:00100000:1.0:1762166977.630181:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6226a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+33:2416:x1847765450463232:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 126us (235us total) trans 21474843300 rc 0/0 00000100:00100000:0.0:1762166977.630187:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2287 00002000:00010000:0.0:1762166977.630192:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2696 (209056->18446744073709551615) 00002000:00100000:0.0:1762166977.630195:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc6227480 with x1847765450463104 ext(209056->18446744073709551615) 00000100:00100000:1.0:1762166977.630197:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2288 00002000:00010000:1.0:1762166977.630203:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2697 (0->18446744073709551615) 00002000:00010000:0.0:1762166977.630203:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc6227480. 00002000:00100000:1.0:1762166977.630209:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc6226a00 with x1847765450463232 ext(0->18446744073709551615) 00002000:00010000:1.0:1762166977.630215:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc6226a00. 00000100:00100000:0.0:1762166977.631508:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.631561:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450463360 00000100:00100000:1.0:1762166977.631566:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450463360 00000100:00100000:1.0:1762166977.631595:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2289 00000100:00100000:1.0:1762166977.631601:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450463360:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:1.0:1762166977.631623:0:23939:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945cc355ba00/0x2f180c4effbaac5f lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.631634:0:23939:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166977.631636:0:23939:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166977.631640:0:23939:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355ba00/0x2f180c4effbaac5f lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [208896->212991] (req 208896->212991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.631652:0:23939:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cc355ba00/0x2f180c4effbaac5f lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [208896->212991] (req 208896->212991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.631736:0:23939:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945cc355ba00/0x2f180c4effbaac5f lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [208896->212991] (req 208896->212991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.631742:0:23939:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355ba00/0x2f180c4effbaac5f lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [208896->212991] (req 208896->212991) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.631748:0:23939:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945cc355ba00/0x2f180c4effbaac5f lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [208896->212991] (req 208896->212991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.631754:0:23939:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355ba00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166977.631759:0:23939:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc355ba00/0x2f180c4effbaac5f lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [208896->212991] (req 208896->212991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.631772:0:23939:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc355ba00/0x2f180c4effbaac5f lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [208896->212991] (req 208896->212991) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.631786:0:23939:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945cc355ba00/0x2f180c4effbaac5f lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [208896->212991] (req 208896->212991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.631795:0:23939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cc355ba00/0x2f180c4effbaac5f lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [208896->212991] (req 208896->212991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166977.631836:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450463360:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 235us (330us total) trans 0 rc 160/160 00000100:00100000:1.0:1762166977.631844:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2289 00000100:00100000:2.0:1762166977.632966:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.633014:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450463488 00000100:00100000:1.0:1762166977.633025:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450463488 00000100:00100000:1.0:1762166977.633086:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2290 00000100:00100000:1.0:1762166977.633097:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4532a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450463488:12345-192.168.204.38@tcp:4:lfs.0 00010000:00010000:1.0:1762166977.633132:0:23939:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945cc355bc00/0x2f180c4effbaac66 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.633150:0:23939:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9400/0x2f180c4effbaac58 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d14 expref: 20 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.633159:0:23939:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166977.633161:0:23939:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166977.633165:0:23939:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355bc00/0x2f180c4effbaac66 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0xa88:0x0].0x0 rrc: 3 type: EXT [208896->212991] (req 208896->212991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.633198:0:23939:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9400/0x2f180c4effbaac58 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d14 expref: 20 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.633209:0:23939:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9400/0x2f180c4effbaac58 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d14 expref: 20 pid: 8380 timeout: 696 lvb_type: 0 00000100:00100000:1.0:1762166977.633221:0:23939:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79e8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:23939:1847765449717120:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166977.633287:0:23939:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011c7000 going to sleep for 11 seconds 00000100:00100000:1.0:1762166977.634072:0:23939:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79e8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:23939:1847765449717120:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166977.634090:0:23939:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945cc355bc00/0x2f180c4effbaac66 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa88:0x0].0x0 rrc: 3 type: EXT [208896->212991] (req 208896->212991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166977.634630:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.634671:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450463616 00000100:00100000:1.0:1762166977.634678:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450463616 00010000:00010000:1.0:1762166977.634700:0:6480:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9400/0x2f180c4effbaac58 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d14 expref: 21 pid: 8380 timeout: 696 lvb_type: 0 00000100:00100000:1.0:1762166977.634738:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9573 00000100:00100000:1.0:1762166977.634746:0:6480:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4531880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450463616:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166977.634760:0:6480:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166977.634779:0:6480:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9400/0x2f180c4effbaac58 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d14 expref: 21 pid: 8380 timeout: 696 lvb_type: 0 00010000:00010000:1.0:1762166977.634792:0:6480:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9400/0x2f180c4effbaac58 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d14 expref: 21 pid: 8380 timeout: 696 lvb_type: 0 00010000:00010000:1.0:1762166977.634810:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9400/0x2f180c4effbaac58 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d14 expref: 21 pid: 8380 timeout: 696 lvb_type: 0 00010000:00010000:1.0:1762166977.634823:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166977.634825:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166977.634830:0:6480:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945cc355bc00/0x2f180c4effbaac66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa88:0x0].0x0 rrc: 3 type: EXT [208896->212991] (req 208896->212991) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.634838:0:6480:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355bc00/0x2f180c4effbaac66 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xa88:0x0].0x0 rrc: 3 type: EXT [208896->212991] (req 208896->212991) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.634864:0:6480:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166977.634902:0:23939:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945cc355bc00/0x2f180c4effbaac66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa88:0x0].0x0 rrc: 2 type: EXT [208896->212991] (req 208896->212991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.634912:0:23939:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cc355bc00/0x2f180c4effbaac66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa88:0x0].0x0 rrc: 2 type: EXT [208896->212991] (req 208896->212991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166977.634922:0:6480:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4531880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450463616:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 173us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166977.634933:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9573 00000001:00080000:2.0:1762166977.636028:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876382 is committed 00002000:00010000:0.0:1762166977.636100:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa88:0x0] updating lvb blocks from disk: 40 -> 48 00010000:00010000:0.0:1762166977.636111:0:23939:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945cc355bc00/0x2f180c4effbaac66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa88:0x0].0x0 rrc: 2 type: EXT [208896->212991] (req 208896->212991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.636119:0:23939:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355bc00/0x2f180c4effbaac66 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa88:0x0].0x0 rrc: 2 type: EXT [208896->212991] (req 208896->212991) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.636127:0:23939:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945cc355bc00/0x2f180c4effbaac66 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa88:0x0].0x0 rrc: 2 type: EXT [208896->212991] (req 208896->212991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.636134:0:23939:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355bc00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166977.636138:0:23939:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc355bc00/0x2f180c4effbaac66 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa88:0x0].0x0 rrc: 2 type: EXT [208896->212991] (req 208896->212991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.636146:0:23939:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc355bc00/0x2f180c4effbaac66 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa88:0x0].0x0 rrc: 2 type: EXT [208896->212991] (req 208896->212991) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.636160:0:23939:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945cc355bc00/0x2f180c4effbaac66 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa88:0x0].0x0 rrc: 2 type: EXT [208896->212991] (req 208896->212991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.636174:0:23939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cc355bc00/0x2f180c4effbaac66 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa88:0x0].0x0 rrc: 2 type: EXT [208896->212991] (req 208896->212991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166977.636240:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4532a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450463488:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 3144us (3273us total) trans 17179876382 rc 0/0 00000100:00100000:0.0:1762166977.636251:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2290 00000100:00100000:2.0:1762166977.637154:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.637197:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450463744 00000100:00100000:1.0:1762166977.637205:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450463744 00000100:00100000:1.0:1762166977.637241:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30453 00000100:00100000:1.0:1762166977.637247:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4530380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+604:61849:x1847765450463744:12345-192.168.204.38@tcp:44:lfs.0 00000001:00080000:3.0:1762166977.638291:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294992049 is committed 00010000:00010000:1.0:1762166977.638324:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220c00/0x2f180c4effbaa892 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.638333:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220c00/0x2f180c4effbaa892 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.638337:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220c00/0x2f180c4effbaa892 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.638345:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc6220c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166977.638348:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220c00/0x2f180c4effbaa892 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.638353:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220c00/0x2f180c4effbaa892 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.638365:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166977.638367:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000020:00080000:3.0:1762166977.638369:0:7412:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff945cee083000 refcount 2 committed 0 result 0 batchid 46 00010000:00010000:1.0:1762166977.638370:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220c00/0x2f180c4effbaa892 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000020:00080000:3.0:1762166977.638375:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cf1d0e000 obd lustre-OST0001-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff945cc7a779c0 00010000:00010000:1.0:1762166977.638378:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220c00/0x2f180c4effbaa892 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000020:00080000:3.0:1762166977.638380:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cf1d0ee00 obd lustre-OST0000-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff945cf1c86000 00000020:00080000:3.0:1762166977.638386:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cc7ab5700 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff945cf3a40a00 00000020:00080000:3.0:1762166977.638393:0:7412:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000400:0x2:0x0].44 00010000:00010000:1.0:1762166977.638406:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221600/0x2f180c4effbaa9e9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.638414:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221600/0x2f180c4effbaa9e9 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.638421:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221600/0x2f180c4effbaa9e9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.638426:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc6221600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166977.638429:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221600/0x2f180c4effbaa9e9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.638436:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221600/0x2f180c4effbaa9e9 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00000020:00080000:2.0:1762166977.638446:0:7435:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 44 00010000:00010000:1.0:1762166977.638448:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00000004:00080000:3.0:1762166977.638450:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3263 committed 00010000:00010000:1.0:1762166977.638453:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166977.638457:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221600/0x2f180c4effbaa9e9 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000004:00080000:3.0:1762166977.638461:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3266 committed 00010000:00010000:1.0:1762166977.638470:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221600/0x2f180c4effbaa9e9 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.638515:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220600/0x2f180c4effbaaad0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00000020:00080000:3.0:1762166977.638517:0:7412:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff945cf3a33240 refcount 2 committed 0 result 0 batchid 45 00000020:00080000:3.0:1762166977.638523:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945bc2d82c00 obd lustre-OST0001-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff945cf3a33e40 00000020:00080000:3.0:1762166977.638529:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945bc2d82600 obd lustre-OST0000-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff945cf3a33780 00010000:00010000:1.0:1762166977.638530:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220600/0x2f180c4effbaaad0 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00000020:00080000:3.0:1762166977.638532:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945bc2d82700 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff945cf1c41400 00000020:00080000:3.0:1762166977.638538:0:7412:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000400:0x2:0x0].43 00010000:00010000:1.0:1762166977.638546:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220600/0x2f180c4effbaaad0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.638553:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc6220600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166977.638557:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220600/0x2f180c4effbaaad0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.638565:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220600/0x2f180c4effbaaad0 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.638577:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166977.638581:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166977.638584:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220600/0x2f180c4effbaaad0 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000100:00100000:2.0:1762166977.638590:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:1.0:1762166977.638591:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220600/0x2f180c4effbaaad0 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000020:00080000:3.0:1762166977.638595:0:7435:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 46 committed batchid 44 00010000:00010000:1.0:1762166977.638609:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221e00/0x2f180c4effbaaae5 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00000100:00100000:2.0:1762166977.638612:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4533100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449717248:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1762166977.638618:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc48a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449717376:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1762166977.638623:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221e00/0x2f180c4effbaaae5 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.638631:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221e00/0x2f180c4effbaaae5 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.638637:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc6221e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166977.638640:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221e00/0x2f180c4effbaaae5 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00000020:00080000:3.0:1762166977.638644:0:7435:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 44 00010000:00010000:1.0:1762166977.638649:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221e00/0x2f180c4effbaaae5 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.638659:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166977.638662:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166977.638666:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221e00/0x2f180c4effbaaae5 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.638673:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221e00/0x2f180c4effbaaae5 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000100:00100000:2.0:1762166977.638676:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1762166977.638693:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220400/0x2f180c4effbaaafa lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.638701:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220400/0x2f180c4effbaaafa lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.638710:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220400/0x2f180c4effbaaafa lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00000100:00100000:0.0:1762166977.638711:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1762166977.638719:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc6220400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166977.638724:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220400/0x2f180c4effbaaafa lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.638731:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220400/0x2f180c4effbaaafa lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00000100:00100000:2.0:1762166977.638733:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449717248 00000100:00100000:2.0:1762166977.638740:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449717248 00010000:00010000:1.0:1762166977.638745:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00000100:00100000:3.0:1762166977.638747:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4530380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+536:61849:x1847765450463744:12345-192.168.204.38@tcp:44:lfs.0 Request processed in 1496us (1590us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166977.638751:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166977.638757:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220400/0x2f180c4effbaaafa lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000100:00100000:0.0:1762166977.638760:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449717376 00000100:00100000:3.0:1762166977.638764:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30453 00000100:00100000:0.0:1762166977.638766:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449717376 00010000:00010000:1.0:1762166977.638771:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220400/0x2f180c4effbaaafa lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000100:00100000:2.0:1762166977.638782:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18970 00010000:00010000:1.0:1762166977.638787:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaab0f lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00000100:00100000:2.0:1762166977.638793:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4531180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1847765449717248:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1762166977.638800:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaab0f lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00000100:00100000:0.0:1762166977.638807:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18971 00010000:00010000:1.0:1762166977.638813:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaab0f lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00002000:00080000:2.0:1762166977.638819:0:8380:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:2693 count 1 00000100:00100000:0.0:1762166977.638821:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+15:3633:x1847765449717376:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1762166977.638827:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc6221a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166977.638831:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaab0f lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.638838:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaab0f lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00002000:00080000:0.0:1762166977.638840:0:28434:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:2694 count 1 00010000:00010000:2.0:1762166977.638842:0:8380:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbaac6d lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa85:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.638856:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166977.638861:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166977.638864:0:8380:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc5db9200/0x2f180c4effba8ae0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa85:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e90cd expref: 17 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.638866:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaab0f lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00002000:00010000:0.0:1762166977.638870:0:28434:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa86:0x0] initial LVB size: 177340, mtime: 0x690888c1, atime: 0x690888bd, ctime: 0x690888c1, blocks: 0x110 00010000:00010000:2.0:1762166977.638896:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166977.638897:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221a00/0x2f180c4effbaab0f lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.638897:0:28434:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbaac74 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.638900:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166977.638907:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbaac6d lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0xa85:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.638920:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166977.638922:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220000/0x2f180c4effbaab24 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.638924:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166977.638932:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbaac74 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.638934:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220000/0x2f180c4effbaab24 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166977.638943:0:8380:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc5db9200/0x2f180c4effba8ae0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa85:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e90cd expref: 17 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.638954:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220000/0x2f180c4effbaab24 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.638959:0:28434:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbaac74 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.638974:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc6220000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166977.638982:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220000/0x2f180c4effbaab24 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.638983:0:28434:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbaac74 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.638986:0:8380:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc5db9200/0x2f180c4effba8ae0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa85:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e90cd expref: 17 pid: 28874 timeout: 696 lvb_type: 0 00010000:00010000:1.0:1762166977.639001:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220000/0x2f180c4effbaab24 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.639008:0:28434:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbaac74 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166977.639016:0:8380:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4531500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8380:1847765449717504:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166977.639021:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166977.639026:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166977.639029:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220000/0x2f180c4effbaab24 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.639038:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220000/0x2f180c4effbaab24 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.639051:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221800/0x2f180c4effbaab39 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.639054:0:28434:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762166977.639062:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221800/0x2f180c4effbaab39 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00000100:00100000:2.0:1762166977.639066:0:8380:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf3a33600 going to sleep for 11 seconds 00010000:00010000:1.0:1762166977.639070:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221800/0x2f180c4effbaab39 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.639078:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc6221800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166977.639082:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221800/0x2f180c4effbaab39 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166977.639093:0:6483:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166977.639094:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221800/0x2f180c4effbaab39 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166977.639102:0:6483:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbaac74 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.639106:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166977.639112:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166977.639115:0:6483:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdfe00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166977.639121:0:6483:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbaac74 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.639126:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221800/0x2f180c4effbaab39 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166977.639131:0:6483:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbaac74 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.639143:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221800/0x2f180c4effbaab39 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166977.639153:0:6483:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbaac74 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.639158:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaab4e lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166977.639165:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbaac74 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.639171:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaab4e lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.639182:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaab4e lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.639188:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc6221400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166977.639190:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166977.639192:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaab4e lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166977.639195:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166977.639199:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166977.639202:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaab4e lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.639213:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166977.639215:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166977.639218:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaab4e lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.639224:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221400/0x2f180c4effbaab4e lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.639238:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbaac19 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x60b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.639244:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbaac19 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x60b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.639249:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbaac19 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x60b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.639254:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355ac00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166977.639258:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbaac19 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x60b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.639263:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbaac19 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x60b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.639271:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x60b:0x0].0x0 (ffff945bc812e700) 00010000:00010000:1.0:1762166977.639274:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166977.639277:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbaac19 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x60b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.639283:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbaac19 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x60b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.639295:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbaac51 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x60b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.639302:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbaac51 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x60b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.639308:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbaac51 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x60b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.639314:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355aa00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166977.639318:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbaac51 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x60b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.639324:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbaac51 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x60b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.639334:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x60b:0x0].0x0 (ffff945bc812e700) 00010000:00010000:1.0:1762166977.639336:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166977.639339:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbaac51 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x60b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.639345:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbaac51 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x60b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000100:00100000:0.0:1762166977.639581:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+16:3633:x1847765449717376:12345-0@lo:6:osp-syn-0-1.0 Request processed in 763us (872us total) trans 21474843301 rc 0/0 00000100:00100000:0.0:1762166977.639590:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18971 00000004:00080000:2.0:1762166977.639617:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc48a8380/2, rc 0, transno 21474843301 00000100:00100000:2.0:1762166977.639634:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc48a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449717376:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1762166977.639798:0:8380:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4531500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8380:1847765449717504:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166977.639810:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:0.0:1762166977.639819:0:8380:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbaac6d lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa85:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166977.639850:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450463872 00000100:00100000:1.0:1762166977.639856:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450463872 00000100:00100000:1.0:1762166977.639898:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18972 00000100:00100000:1.0:1762166977.639906:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4532d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450463872:12345-192.168.204.38@tcp:16:lfs.0 00000100:00100000:1.0:1762166977.639964:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4532d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450463872:12345-192.168.204.38@tcp:16:lfs.0 Request processed in 57us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166977.639973:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.639976:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18972 00000100:00100000:1.0:1762166977.639995:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450464000 00000100:00100000:1.0:1762166977.639999:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450464000 00000100:00100000:1.0:1762166977.640030:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18973 00000100:00100000:1.0:1762166977.640039:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+33:2418:x1847765450464000:12345-192.168.204.38@tcp:16:lfs.0 00000100:00100000:2.0:1762166977.640137:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.640171:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450464128 00000100:00100000:1.0:1762166977.640176:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450464128 00010000:00010000:1.0:1762166977.640196:0:6480:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc5db9200/0x2f180c4effba8ae0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa85:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e90cd expref: 18 pid: 28874 timeout: 696 lvb_type: 0 00000100:00100000:1.0:1762166977.640231:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9574 00000100:00100000:1.0:1762166977.640241:0:6480:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4531f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450464128:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166977.640252:0:6480:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166977.640258:0:6480:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc5db9200/0x2f180c4effba8ae0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa85:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e90cd expref: 18 pid: 28874 timeout: 696 lvb_type: 0 00010000:00010000:1.0:1762166977.640267:0:6480:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc5db9200/0x2f180c4effba8ae0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa85:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e90cd expref: 18 pid: 28874 timeout: 696 lvb_type: 0 00010000:00010000:1.0:1762166977.640281:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc5db9200/0x2f180c4effba8ae0 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa85:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e90cd expref: 18 pid: 28874 timeout: 696 lvb_type: 0 00010000:00010000:1.0:1762166977.640289:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166977.640291:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166977.640294:0:6480:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbaac6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa85:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.640299:0:6480:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbaac6d lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xa85:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.640317:0:6480:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166977.640338:0:8380:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbaac6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166977.640339:0:6480:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4531f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450464128:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 102us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166977.640353:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9574 00010000:00010000:0.0:1762166977.640357:0:8380:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbaac6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.640366:0:8380:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbaac6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.640375:0:8380:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbaac6d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.640399:0:8380:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166977.640470:0:10256:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166977.640499:0:10256:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbaac6d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.640508:0:10256:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa8600 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166977.640513:0:10256:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbaac6d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.640522:0:10256:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbaac6d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.640537:0:10256:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbaac6d lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xa85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.640544:0:10256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbaac6d lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.640564:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166977.640566:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166977.640569:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166977.640585:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4531180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3635:x1847765449717248:12345-0@lo:6:osp-syn-1-1.0 Request processed in 1794us (1909us total) trans 17179876383 rc 0/0 00000100:00100000:0.0:1762166977.640595:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18970 00000100:00100000:1.0:1762166977.640612:0:3635:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 17179876349 gen 2 00000004:00080000:1.0:1762166977.640620:0:3635:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc5805880, transno 17179876317 00000004:00080000:1.0:1762166977.640634:0:3635:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf1e6fb80, transno 17179876318 00000004:00080000:1.0:1762166977.640638:0:3635:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf1e6ed80, transno 17179876319 00000004:00080000:1.0:1762166977.640641:0:3635:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf1e6df80, transno 17179876320 00000004:00080000:1.0:1762166977.640645:0:3635:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc7b23b80, transno 17179876331 00000004:00080000:1.0:1762166977.640652:0:3635:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc7b20e00, transno 17179876332 00000004:00080000:1.0:1762166977.640656:0:3635:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc7b22680, transno 17179876333 00000004:00080000:1.0:1762166977.640660:0:3635:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc7b20380, transno 17179876334 00000004:00080000:1.0:1762166977.640664:0:3635:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc5bc0380, transno 17179876335 00000004:00080000:1.0:1762166977.640667:0:3635:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf1cd0700, transno 17179876336 00000004:00080000:1.0:1762166977.640669:0:3635:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc5bc3800, transno 17179876337 00000004:00080000:1.0:1762166977.640672:0:3635:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf1cd2300, transno 17179876338 00000004:00080000:1.0:1762166977.640677:0:3635:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 17179876343 committed transno 17179876349 00000004:00080000:1.0:1762166977.640693:0:3635:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 17179876349 committed transno 17179876349 00000100:00100000:1.0:1762166977.640709:0:3635:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff945bc4533100 x1847765449717248/t17179876383(17179876383) o6->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 544/432 e 0 to 0 dl 1762166993 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1762166977.640719:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc4533100/2, rc 0, transno 17179876383 00000100:00100000:1.0:1762166977.640725:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4533100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449717248:0@lo:6:osp-syn-1-1.0 00000004:00080000:2.0:1762166977.640796:0:9994:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0001: 1 changes, 8 in progress, 0 in flight, 5 done 00000004:00080000:2.0:1762166977.640844:0:9994:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0001: 1 changes, 1 in progress, 0 in flight, 7 done 00000001:00080000:3.0:1762166977.641239:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843301 is committed 00000001:00080000:3.0:1762166977.641247:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843300 is committed 00000100:00100000:1.0:1762166977.641360:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+15:2418:x1847765450464000:12345-192.168.204.38@tcp:16:lfs.0 Request processed in 1321us (1388us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166977.641370:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18973 00000100:00100000:2.0:1762166977.647449:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.647540:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450464256 00000100:00100000:1.0:1762166977.647553:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450464256 00000100:00100000:2.0:1762166977.647580:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.647623:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450464512 00000100:00100000:2.0:1762166977.647630:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.647630:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450464512 00000100:00100000:1.0:1762166977.647641:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18974 00000100:00100000:1.0:1762166977.647662:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4531c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+18:2416:x1847765450464256:12345-192.168.204.38@tcp:1:lfs.0 00000100:00100000:0.0:1762166977.647676:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450464384 00000100:00100000:0.0:1762166977.647681:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450464384 00000100:00100000:2.0:1762166977.647715:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18975 00010000:00010000:1.0:1762166977.647726:0:28434:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945cc355aa00/0x2f180c4effbaac7b lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166977.647727:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18976 00000100:00100000:2.0:1762166977.647736:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4530700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+18:2416:x1847765450464512:12345-192.168.204.38@tcp:1:lfs.0 00000100:00100000:3.0:1762166977.647758:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4531500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+15:2416:x1847765450464384:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:2.0:1762166977.647796:0:35472:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbaac82 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.647797:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166977.647804:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166977.647813:0:9165:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc8472800/0x2f180c4effbaac89 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.647814:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355aa00/0x2f180c4effbaac7b lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.647820:0:35472:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166977.647830:0:35472:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166977.647842:0:35472:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbaac82 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.647862:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166977.647866:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166977.647870:0:35472:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbaac82 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.647883:0:9165:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8472800/0x2f180c4effbaac89 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.647885:0:28434:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cc355aa00/0x2f180c4effbaac7b lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.647931:0:35472:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbaac82 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.647937:0:9165:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc8472800/0x2f180c4effbaac89 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.647940:0:35472:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbaac82 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.647950:0:28434:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945cc355aa00/0x2f180c4effbaac7b lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.647969:0:35472:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbaac82 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.647983:0:9165:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc8472800/0x2f180c4effbaac89 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.648000:0:28434:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355aa00/0x2f180c4effbaac7b lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.648011:0:35472:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa9000 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166977.648022:0:35472:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbaac82 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.648032:0:9165:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8472800/0x2f180c4effbaac89 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.648052:0:28434:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945cc355aa00/0x2f180c4effbaac7b lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.648056:0:35472:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbaac82 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.648079:0:9165:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc8472800/0x2f180c4effbaac89 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.648102:0:28434:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355aa00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166977.648116:0:28434:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc355aa00/0x2f180c4effbaac7b lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.648120:0:9165:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8472800 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166977.648128:0:9165:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc8472800/0x2f180c4effbaac89 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.648143:0:35472:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbaac82 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.648166:0:28434:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc355aa00/0x2f180c4effbaac7b lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.648173:0:9165:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc8472800/0x2f180c4effbaac89 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.648195:0:35472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbaac82 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.648216:0:28434:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945cc355aa00/0x2f180c4effbaac7b lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.648220:0:9165:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc8472800/0x2f180c4effbaac89 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.648266:0:9165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc8472800/0x2f180c4effbaac89 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.648270:0:28434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cc355aa00/0x2f180c4effbaac7b lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166977.648282:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4530700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+18:2416:x1847765450464512:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 554us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166977.648308:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18975 00000100:00100000:3.0:1762166977.648337:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4531500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+15:2416:x1847765450464384:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 588us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166977.648347:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18976 00000100:00100000:1.0:1762166977.648375:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4531c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+17:2416:x1847765450464256:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 717us (927us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166977.648384:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18974 00000100:00100000:3.0:1762166977.649359:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.649415:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450464768 00000100:00100000:1.0:1762166977.649423:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450464768 00000100:00100000:1.0:1762166977.649496:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30454 00000100:00100000:1.0:1762166977.649507:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6227b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+529:61849:x1847765450464768:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:1.0:1762166977.649562:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbaac90 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x60b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166977.649572:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbaac90 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x60b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.649586:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbaac90 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x60b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00010000:1.0:1762166977.649681:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000067be5997 reply state 00000000834379a2 transno 4294992050 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbaac90 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x60b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.649689:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbaac90 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x60b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.649693:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x60b:0x0].0x0 (ffff945bc812e700) 00010000:00010000:1.0:1762166977.649695:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166977.649697:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166977.649754:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6227b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+531:61849:x1847765450464768:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 250us (398us total) trans 4294992050 rc 0/0 00000100:00100000:1.0:1762166977.649759:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30454 00000100:00100000:0.0:1762166977.650623:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.650669:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450464896 00000100:00100000:1.0:1762166977.650676:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450464896 00000100:00100000:0.0:1762166977.650702:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.650743:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450465024 00000100:00100000:1.0:1762166977.650748:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450465024 00000100:00100000:2.0:1762166977.650767:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18977 00000100:00100000:2.0:1762166977.650783:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450464896:12345-192.168.204.38@tcp:2:lfs.0 00000100:00100000:1.0:1762166977.650783:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18978 00000100:00100000:1.0:1762166977.650799:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+15:2418:x1847765450465024:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:1.0:1762166977.650905:0:28434:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa89:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166977.650909:0:28434:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa89:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:1.0:1762166977.650911:0:28434:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa89:0x0] updating lvb atime from disk: 0 -> 1762166977 00002000:00010000:1.0:1762166977.650914:0:28434:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa89:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00000100:00100000:2.0:1762166977.650923:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450464896:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 142us (298us total) trans 17179876384 rc 0/0 00002000:00010000:1.0:1762166977.650925:0:28434:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa89:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1762166977.650937:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18977 00000100:00100000:1.0:1762166977.650965:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+16:2418:x1847765450465024:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 170us (263us total) trans 21474843302 rc 0/0 00000100:00100000:1.0:1762166977.650973:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18978 00000100:00100000:2.0:1762166977.651892:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.651936:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450465280 00000100:00100000:1.0:1762166977.651940:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450465280 00000100:00100000:1.0:1762166977.651966:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30455 00000100:00100000:1.0:1762166977.651971:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+531:61849:x1847765450465280:12345-192.168.204.38@tcp:55:lfs.0 00010000:00010000:1.0:1762166977.652007:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbaac97 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x60b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166977.652020:0:6495:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbaac12 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x60b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9cf8 expref: 531 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.652027:0:6495:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbaac97 lrc: 4/0,1 mode: --/PW res: [0x240000404:0x60b:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.652063:0:6495:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbaac12 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x60b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9cf8 expref: 531 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.652077:0:6495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbaac12 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x60b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9cf8 expref: 531 pid: 6495 timeout: 696 lvb_type: 0 00000100:00100000:1.0:1762166977.652090:0:6495:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79e8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6495:1847765449717632:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166977.652151:0:6495:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1c86c00 going to sleep for 11 seconds 00000100:00100000:1.0:1762166977.652955:0:6495:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79e8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6495:1847765449717632:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166977.652972:0:6495:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbaac97 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x60b:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000100:00100000:2.0:1762166977.653185:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.653219:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450465408 00000100:00100000:1.0:1762166977.653224:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450465408 00010000:00010000:1.0:1762166977.653243:0:6480:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbaac12 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x60b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9cf8 expref: 532 pid: 6495 timeout: 696 lvb_type: 0 00000100:00100000:1.0:1762166977.653265:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9575 00000100:00100000:1.0:1762166977.653271:0:6480:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff1a8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+532:2418:x1847765450465408:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166977.653282:0:6480:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166977.653289:0:6480:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbaac12 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x60b:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9cf8 expref: 532 pid: 6495 timeout: 696 lvb_type: 0 00010000:00010000:1.0:1762166977.653296:0:6480:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbaac12 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x60b:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9cf8 expref: 532 pid: 6495 timeout: 696 lvb_type: 0 00010000:00010000:1.0:1762166977.653311:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbaac12 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x60b:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9cf8 expref: 532 pid: 6495 timeout: 696 lvb_type: 0 00010000:00010000:1.0:1762166977.653324:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x60b:0x0].0x0 (ffff945bc812e700) 00010000:00010000:1.0:1762166977.653328:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbaac97 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x60b:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.653335:0:6480:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbaac97 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x60b:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.653340:0:6480:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbaac97 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x60b:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.653364:0:6480:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166977.653387:0:6495:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbaac97 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x60b:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000100:00100000:1.0:1762166977.653401:0:6480:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff1a8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+531:2418:x1847765450465408:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 125us (211us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166977.653406:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbaac97 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x60b:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000100:00100000:1.0:1762166977.653413:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9575 00010000:00010000:3.0:1762166977.653454:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbaac97 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x60b:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.653462:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbaac97 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x60b:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.653469:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbaac97 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x60b:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.653553:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355ba00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166977.653559:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbaac97 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x60b:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.653567:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbaac97 lrc: 4/0,0 mode: PW/PW res: [0x240000404:0x60b:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.653581:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x60b:0x0].0x0 (ffff945bc812e700) 00010000:00010000:3.0:1762166977.653585:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1762166977.653589:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbaac97 lrc: 2/0,0 mode: --/PW res: [0x240000404:0x60b:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.653596:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbaac97 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x60b:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000100:00100000:3.0:1762166977.653662:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+530:61849:x1847765450465280:12345-192.168.204.38@tcp:55:lfs.0 Request processed in 1688us (1769us total) trans 0 rc -22/-22 00000100:00100000:3.0:1762166977.653673:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30455 00000100:00100000:2.0:1762166977.654646:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166977.654678:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450465664 00000100:00100000:3.0:1762166977.654685:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450465664 00000100:00100000:3.0:1762166977.654722:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30456 00000100:00100000:3.0:1762166977.654731:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+530:61849:x1847765450465664:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:3.0:1762166977.654781:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166977.654798:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220200/0x2f180c4effbaab5c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9cab expref: 530 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.654810:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166977.654813:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166977.654850:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effbaac9e lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166977.654859:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effbaac9e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.654865:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effbaac9e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00010000:3.0:1762166977.654985:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000650a5577 reply state 00000000ecc39869 transno 4294992051 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effbaac9e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.655004:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effbaac9e lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.655010:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166977.655012:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1762166977.655015:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166977.655083:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+531:61849:x1847765450465664:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 353us (438us total) trans 4294992051 rc 0/0 00000100:00100000:3.0:1762166977.655090:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30456 00000100:00100000:0.0:1762166977.655913:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.655982:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450465792 00000100:00100000:0.0:1762166977.655984:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.655994:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450465792 00000100:00100000:0.0:1762166977.656027:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.656031:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450465920 00000100:00100000:2.0:1762166977.656043:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450465920 00000100:00100000:1.0:1762166977.656051:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450466048 00000100:00100000:1.0:1762166977.656056:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450466048 00000100:00100000:0.0:1762166977.656080:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18979 00000100:00100000:0.0:1762166977.656101:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3d58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:2416:x1847765450465792:12345-192.168.204.38@tcp:2:lfs.0 00000100:00100000:3.0:1762166977.656105:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18980 00000100:00100000:2.0:1762166977.656117:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18981 00000100:00100000:3.0:1762166977.656124:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+16:2416:x1847765450465920:12345-192.168.204.38@tcp:2:lfs.0 00000100:00100000:2.0:1762166977.656131:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+19:2416:x1847765450466048:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:3.0:1762166977.656247:0:9165:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166977.656251:0:9165:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:0.0:1762166977.656252:0:8383:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 209056 -> 209056 00002000:00010000:3.0:1762166977.656255:0:9165:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166977 -> 1762166977 00002000:00010000:0.0:1762166977.656257:0:8383:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:2.0:1762166977.656258:0:35472:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166977.656259:0:9165:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:0.0:1762166977.656274:0:8383:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166977 -> 1762166977 00002000:00010000:3.0:1762166977.656277:0:9165:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00002000:00010000:2.0:1762166977.656277:0:35472:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:0.0:1762166977.656278:0:8383:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:2.0:1762166977.656298:0:35472:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166977 -> 1762166977 00002000:00010000:0.0:1762166977.656299:0:8383:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 264 -> 264 00002000:00010000:2.0:1762166977.656315:0:35472:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:2.0:1762166977.656320:0:35472:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166977.656335:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+17:2416:x1847765450465920:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 217us (351us total) trans 21474843303 rc 0/0 00000100:00100000:3.0:1762166977.656346:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18980 00000100:00100000:0.0:1762166977.656347:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3d58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:2416:x1847765450465792:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 253us (430us total) trans 17179876385 rc 0/0 00000100:00100000:0.0:1762166977.656359:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18979 00000100:00100000:2.0:1762166977.656367:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+21:2416:x1847765450466048:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 237us (338us total) trans 17179876386 rc 0/0 00000100:00100000:2.0:1762166977.656375:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18981 00000100:00100000:0.0:1762166977.657595:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.657644:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450466304 00000100:00100000:1.0:1762166977.657649:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450466304 00000100:00100000:1.0:1762166977.657682:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11841 00000100:00100000:1.0:1762166977.657688:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7be6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+531:61849:x1847765450466304:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:1.0:1762166977.657737:0:6497:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x240000404:0x5eb:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbaabd3 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9cdc expref: 531 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.657766:0:6497:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbaaca5 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 00010000:00010000:1.0:1762166977.657777:0:6497:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220800/0x2f180c4effbaaa91 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c6c expref: 531 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.657783:0:6497:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221200/0x2f180c4effbaaac9 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c7a expref: 531 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.657787:0:6497:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbaaca5 lrc: 5/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166977.657808:0:6497:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221200/0x2f180c4effbaaac9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c7a expref: 531 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.657815:0:6497:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221200/0x2f180c4effbaaac9 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c7a expref: 531 pid: 6495 timeout: 696 lvb_type: 0 00000100:00100000:1.0:1762166977.657824:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79e8a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6497:1847765449717760:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166977.657891:0:6497:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220800/0x2f180c4effbaaa91 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c6c expref: 531 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.657898:0:6497:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220800/0x2f180c4effbaaa91 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c6c expref: 531 pid: 6495 timeout: 696 lvb_type: 0 00000100:00100000:1.0:1762166977.657905:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79eb480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6497:1847765449717888:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166977.657931:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1c86e40 going to sleep for 11 seconds 00000100:00100000:2.0:1762166977.658602:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79e8a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6497:1847765449717760:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166977.658797:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79eb480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6497:1847765449717888:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166977.658816:0:6497:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbaaca5 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00000100:00100000:3.0:1762166977.658957:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.658991:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450466432 00000100:00100000:1.0:1762166977.658996:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450466432 00000100:00100000:3.0:1762166977.659006:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:1.0:1762166977.659013:0:6480:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221200/0x2f180c4effbaaac9 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c7a expref: 532 pid: 6495 timeout: 696 lvb_type: 0 00000100:00100000:1.0:1762166977.659040:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450466560 00000100:00100000:1.0:1762166977.659042:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450466560 00000100:00100000:0.0:1762166977.659051:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9576 00010000:00010000:1.0:1762166977.659052:0:6480:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220800/0x2f180c4effbaaa91 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c6c expref: 533 pid: 6495 timeout: 696 lvb_type: 0 00000100:00100000:0.0:1762166977.659066:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6227800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+533:2419:x1847765450466432:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166977.659079:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1762166977.659084:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9577 00010000:00010000:0.0:1762166977.659089:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221200/0x2f180c4effbaaac9 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c7a expref: 533 pid: 6495 timeout: 696 lvb_type: 0 00000100:00100000:1.0:1762166977.659098:0:6480:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6225180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+533:2418:x1847765450466560:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166977.659106:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221200/0x2f180c4effbaaac9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c7a expref: 533 pid: 6495 timeout: 696 lvb_type: 0 00010000:00010000:1.0:1762166977.659111:0:6480:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166977.659120:0:6480:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220800/0x2f180c4effbaaa91 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c6c expref: 533 pid: 6495 timeout: 696 lvb_type: 0 00010000:00010000:0.0:1762166977.659128:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6221200/0x2f180c4effbaaac9 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c7a expref: 533 pid: 6495 timeout: 696 lvb_type: 0 00010000:00010000:1.0:1762166977.659136:0:6480:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220800/0x2f180c4effbaaa91 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c6c expref: 533 pid: 6495 timeout: 696 lvb_type: 0 00010000:00010000:0.0:1762166977.659147:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166977.659153:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbaaca5 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166977.659160:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbaaca5 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166977.659166:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166977.659175:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6220800/0x2f180c4effbaaa91 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9c6c expref: 532 pid: 6495 timeout: 696 lvb_type: 0 00010000:00010000:1.0:1762166977.659184:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166977.659187:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbaaca5 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166977.659192:0:6480:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbaaca5 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166977.659199:0:6480:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbaaca5 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT1 00000100:00100000:0.0:1762166977.659201:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6227800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+531:2419:x1847765450466432:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 140us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166977.659213:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9576 00010000:00010000:1.0:1762166977.659230:0:6480:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166977.659244:0:6497:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbaaca5 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00000100:00100000:1.0:1762166977.659253:0:6480:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6225180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+530:2418:x1847765450466560:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 160us (246us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166977.659255:0:6497:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbaaca5 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00000100:00100000:1.0:1762166977.659264:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9577 00010000:00010000:3.0:1762166977.659284:0:6497:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472c00/0x2f180c4effbaacac lrc: 3/0,1 mode: --/EX res: [0x240000404:0x60b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 00010000:00010000:3.0:1762166977.659294:0:6497:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbaac20 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x60b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9cff expref: 529 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.659364:0:6497:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472c00/0x2f180c4effbaacac lrc: 4/0,1 mode: --/EX res: [0x240000404:0x60b:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT1 00010000:00010000:3.0:1762166977.659384:0:6497:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbaac20 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x60b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9cff expref: 529 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.659429:0:6497:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbaac20 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x60b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9cff expref: 529 pid: 6495 timeout: 696 lvb_type: 0 00000100:00100000:3.0:1762166977.659440:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc6224e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6497:1847765449718016:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166977.659497:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc2c72600 going to sleep for 11 seconds 00000100:00100000:2.0:1762166977.660227:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc6224e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6497:1847765449718016:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166977.660239:0:6497:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472c00/0x2f180c4effbaacac lrc: 3/0,1 mode: --/EX res: [0x240000404:0x60b:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00000100:00100000:2.0:1762166977.660470:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.660527:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450466688 00000100:00100000:1.0:1762166977.660532:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450466688 00010000:00010000:1.0:1762166977.660550:0:6480:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbaac20 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x60b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9cff expref: 530 pid: 6495 timeout: 696 lvb_type: 0 00000100:00100000:1.0:1762166977.660576:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9578 00000100:00100000:1.0:1762166977.660584:0:6480:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b20380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+530:2419:x1847765450466688:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166977.660594:0:6480:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166977.660599:0:6480:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbaac20 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x60b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9cff expref: 530 pid: 6495 timeout: 696 lvb_type: 0 00010000:00010000:1.0:1762166977.660610:0:6480:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbaac20 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x60b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9cff expref: 530 pid: 6495 timeout: 696 lvb_type: 0 00010000:00010000:1.0:1762166977.660622:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbaac20 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x60b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9cff expref: 530 pid: 6495 timeout: 696 lvb_type: 0 00010000:00010000:1.0:1762166977.660632:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x60b:0x0].0x0 (ffff945bc812e700) 00010000:00010000:1.0:1762166977.660636:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472c00/0x2f180c4effbaacac lrc: 3/0,1 mode: --/EX res: [0x240000404:0x60b:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166977.660642:0:6480:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472c00/0x2f180c4effbaacac lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x60b:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166977.660653:0:6480:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472c00/0x2f180c4effbaacac lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x60b:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166977.660673:0:6480:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166977.660696:0:6480:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b20380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+529:2419:x1847765450466688:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 114us (227us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166977.660703:0:6497:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472c00/0x2f180c4effbaacac lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x60b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00000100:00100000:1.0:1762166977.660705:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9578 00010000:00010000:2.0:1762166977.660722:0:6497:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472c00/0x2f180c4effbaacac lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x60b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00000100:00100000:2.0:1762166977.660981:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7b23b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449718144:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762166977.661009:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166977.661027:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf3a33600 going to sleep for 11 seconds 00000100:00100000:3.0:1762166977.661043:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449718144 00000100:00100000:3.0:1762166977.661049:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449718144 00000100:00100000:3.0:1762166977.661081:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1340 00000100:00100000:3.0:1762166977.661088:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:6497:x1847765449718144:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166977.661158:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:6497:x1847765449718144:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 70us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166977.661167:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1340 00000100:00100000:2.0:1762166977.661187:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7b23b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449718144:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762166977.661225:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7b23b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449718272:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762166977.661246:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166977.661261:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf3a33e40 going to sleep for 11 seconds 00000100:00100000:3.0:1762166977.661266:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449718272 00000100:00100000:3.0:1762166977.661272:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449718272 00000100:00100000:3.0:1762166977.661299:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1341 00000100:00100000:3.0:1762166977.661307:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:6497:x1847765449718272:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166977.661365:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:6497:x1847765449718272:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 60us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166977.661373:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1341 00000100:00100000:2.0:1762166977.661389:0:6497:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 21474843301 gen 2 00000004:00080000:2.0:1762166977.661395:0:6497:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bcce77480, transno 21474843280 00000004:00080000:2.0:1762166977.661405:0:6497:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bcce75c00, transno 21474843281 00000004:00080000:2.0:1762166977.661407:0:6497:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bcce74e00, transno 21474843282 00000004:00080000:2.0:1762166977.661409:0:6497:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bcce75500, transno 21474843283 00000004:00080000:2.0:1762166977.661411:0:6497:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc6226d80, transno 21474843284 00000004:00080000:2.0:1762166977.661412:0:6497:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc6224000, transno 21474843285 00000004:00080000:2.0:1762166977.661414:0:6497:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc6224700, transno 21474843286 00000004:00080000:2.0:1762166977.661415:0:6497:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc6224a80, transno 21474843287 00000004:00080000:2.0:1762166977.661418:0:6497:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 21474843289 committed transno 21474843301 00000004:00080000:2.0:1762166977.661427:0:6497:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 21474843291 committed transno 21474843301 00000004:00080000:2.0:1762166977.661436:0:6497:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc48a8380, transno 21474843301 00000100:00100000:2.0:1762166977.661440:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7b23b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449718272:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762166977.661499:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7b23b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449718400:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762166977.661521:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166977.661536:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1fe2d80 going to sleep for 11 seconds 00000100:00100000:3.0:1762166977.661542:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449718400 00000100:00100000:3.0:1762166977.661547:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449718400 00000004:00080000:0.0:1762166977.661565:0:9158:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0001: 1 changes, 0 in progress, 0 in flight, 9 done 00000100:00100000:3.0:1762166977.661580:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1342 00000100:00100000:3.0:1762166977.661588:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc6359050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:6497:x1847765449718400:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166977.661643:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc6359050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:6497:x1847765449718400:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 54us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166977.661650:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7b23b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449718400:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166977.661651:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1342 00000100:00100000:2.0:1762166977.661676:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7b23b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449718528:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762166977.661695:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166977.661720:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf3a33600 going to sleep for 11 seconds 00000100:00100000:1.0:1762166977.661728:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449718528 00000100:00100000:1.0:1762166977.661732:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449718528 00000100:00100000:1.0:1762166977.661760:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1343 00000100:00100000:1.0:1762166977.661769:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:6497:x1847765449718528:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762166977.661823:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:6497:x1847765449718528:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 57us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166977.661831:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1343 00000100:00100000:2.0:1762166977.661837:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7b23b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449718528:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762166977.661902:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7b23b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449718656:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762166977.661927:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166977.661951:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ceffd4e40 going to sleep for 11 seconds 00000100:00100000:3.0:1762166977.661980:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449718656 00000100:00100000:3.0:1762166977.661985:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449718656 00000100:00100000:3.0:1762166977.662014:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1344 00000100:00100000:3.0:1762166977.662022:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:6497:x1847765449718656:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166977.662078:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:6497:x1847765449718656:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 57us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166977.662085:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1344 00000100:00100000:2.0:1762166977.662119:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7b23b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449718656:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762166977.662153:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7b23b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449718784:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762166977.662174:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166977.662193:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ceffd4000 going to sleep for 11 seconds 00000100:00100000:3.0:1762166977.662195:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449718784 00000100:00100000:3.0:1762166977.662200:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449718784 00000100:00100000:3.0:1762166977.662225:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1345 00000100:00100000:3.0:1762166977.662232:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:6497:x1847765449718784:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166977.662281:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:6497:x1847765449718784:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 49us (105us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166977.662289:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1345 00000100:00100000:2.0:1762166977.662299:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7b23b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449718784:0@lo:1000:mdt_rdpg00_000.0 00000040:00080000:2.0:1762166977.662409:0:6497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x2:0x0].45, 456 off65392 00000001:00080000:2.0:1762166977.662416:0:6497:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992052 00000100:00100000:2.0:1762166977.662452:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7b23b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449718912:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762166977.662496:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166977.662515:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf3a33540 going to sleep for 11 seconds 00000100:00100000:3.0:1762166977.662526:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449718912 00000100:00100000:3.0:1762166977.662531:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449718912 00000100:00100000:3.0:1762166977.662558:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1346 00000100:00100000:3.0:1762166977.662564:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:6497:x1847765449718912:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166977.662653:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:6497:x1847765449718912:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 88us (175us total) trans 17179876387 rc 0/0 00000100:00100000:3.0:1762166977.662661:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1346 00000100:00100000:2.0:1762166977.662674:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7b23b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449718912:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762166977.662699:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7b22a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449719040:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762166977.662722:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166977.662742:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449719040 00000100:00100000:2.0:1762166977.662744:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ceffd4e40 going to sleep for 11 seconds 00000100:00100000:3.0:1762166977.662748:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449719040 00000100:00100000:3.0:1762166977.662781:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1347 00000100:00100000:3.0:1762166977.662788:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:6497:x1847765449719040:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166977.662864:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:6497:x1847765449719040:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 75us (140us total) trans 21474843304 rc 0/0 00000100:00100000:3.0:1762166977.662871:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1347 00000100:00100000:2.0:1762166977.662894:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7b22a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449719040:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1762166977.662937:0:6497:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992053 00010000:00010000:2.0:1762166977.662959:0:6497:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472c00/0x2f180c4effbaacac lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x60b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.662968:0:6497:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472c00/0x2f180c4effbaacac lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x60b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.662975:0:6497:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472c00/0x2f180c4effbaacac lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x60b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.662981:0:6497:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8472c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166977.662985:0:6497:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472c00/0x2f180c4effbaacac lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x60b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.662996:0:6497:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472c00/0x2f180c4effbaacac lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x60b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.663008:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x60b:0x0].0x0 (ffff945bc812e700) 00010000:00010000:2.0:1762166977.663011:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1762166977.663015:0:6497:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472c00/0x2f180c4effbaacac lrc: 2/0,0 mode: --/EX res: [0x240000404:0x60b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.663022:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472c00/0x2f180c4effbaacac lrc: 0/0,0 mode: --/EX res: [0x240000404:0x60b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.663034:0:6497:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbaaca5 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.663039:0:6497:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbaaca5 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.663045:0:6497:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbaaca5 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.663050:0:6497:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355aa00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166977.663052:0:6497:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbaaca5 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.663058:0:6497:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbaaca5 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.663066:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166977.663068:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1762166977.663072:0:6497:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbaaca5 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.663077:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbaaca5 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.663094:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166977.663097:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166977.663102:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbaabd3 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9cdc expref: 531 pid: 6495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166977.663183:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7be6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+530:61849:x1847765450466304:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 5494us (5590us total) trans 4294992054 rc 0/0 00000100:00100000:2.0:1762166977.663192:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11841 00000020:00080000:2.0:1762166977.663196:0:6497:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1762166977.664240:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166977.664285:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450466816 00000100:00100000:3.0:1762166977.664291:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450466816 00000100:00100000:3.0:1762166977.664326:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30457 00000100:00100000:3.0:1762166977.664335:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+530:61849:x1847765450466816:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166977.664350:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166977.664363:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472800/0x2f180c4effbaacb3 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9d1b expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.664404:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472800/0x2f180c4effbaacb3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d1b expref: 531 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.664417:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472800/0x2f180c4effbaacb3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d1b expref: 531 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.664431:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166977.664434:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166977.664437:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8472800, rc 0) 00000100:00100000:3.0:1762166977.664504:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+531:61849:x1847765450466816:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 141us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166977.664513:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30457 00000100:00100000:3.0:1762166977.666205:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.666259:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450467072 00000100:00100000:2.0:1762166977.666267:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450467072 00000100:00100000:2.0:1762166977.666315:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11842 00000100:00100000:2.0:1762166977.666328:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6226680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+531:61849:x1847765450467072:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:2.0:1762166977.666540:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6226680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+532:61849:x1847765450467072:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 216us (346us total) trans 4294992055 rc 0/0 00000100:00100000:2.0:1762166977.666547:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11842 00000100:00100000:0.0:1762166977.667717:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.667766:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450467328 00000100:00100000:2.0:1762166977.667771:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450467328 00000100:00100000:2.0:1762166977.667803:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11843 00000100:00100000:2.0:1762166977.667808:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+532:61849:x1847765450467328:12345-192.168.204.38@tcp:35:lfs.0 00000004:00080000:2.0:1762166977.667940:0:6497:0:(mdd_object.c:3965:mdd_close()) Object [0x240000404:0x60b:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:2.0:1762166977.668008:0:6497:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbaacba lrc: 3/0,1 mode: --/PW res: [0x240000404:0x60b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 00010000:00010000:2.0:1762166977.668022:0:6497:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbaacba lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x60b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.668031:0:6497:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbaacba lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x60b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.668037:0:6497:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbaacba lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x60b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.668041:0:6497:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbaacba lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x60b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.668044:0:6497:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbaacba lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x60b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.668063:0:6497:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1762166977.668149:0:6482:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1762166977.668162:0:6482:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbaacba lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x60b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6497 initiator: MDT1 00010000:00010000:3.0:1762166977.668173:0:6482:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa8800 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166977.668178:0:6482:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbaacba lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x60b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6497 initiator: MDT1 00010000:00010000:3.0:1762166977.668188:0:6482:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbaacba lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x60b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6497 initiator: MDT1 00000100:00100000:2.0:1762166977.668190:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+533:61849:x1847765450467328:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 378us (476us total) trans 4294992056 rc 0/0 00000100:00100000:2.0:1762166977.668215:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11843 00010000:00010000:3.0:1762166977.668239:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x60b:0x0].0x0 (ffff945bc812e700) 00010000:00010000:3.0:1762166977.668246:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1762166977.668251:0:6482:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbaacba lrc: 1/0,0 mode: --/PW res: [0x240000404:0x60b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6497 initiator: MDT1 00010000:00010000:3.0:1762166977.668259:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbaacba lrc: 0/0,0 mode: --/PW res: [0x240000404:0x60b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6497 initiator: MDT1 00010000:00010000:3.0:1762166977.668278:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166977.668280:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166977.668285:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166977.677535:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166977.677607:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450467456 00000100:00100000:3.0:1762166977.677622:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450467456 00000100:00100000:3.0:1762166977.677682:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30458 00000100:00100000:3.0:1762166977.677692:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+533:61850:x1847765450467456:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166977.677723:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166977.677746:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473600/0x2f180c4effbaacc1 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9d22 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.677815:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472a00/0x2f180c4effbaacc8 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166977.677827:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472a00/0x2f180c4effbaacc8 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.677835:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472a00/0x2f180c4effbaacc8 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.677846:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473a00/0x2f180c4effbaaccf lrc: 3/1,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166977.677850:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473a00/0x2f180c4effbaaccf lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.677853:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473a00/0x2f180c4effbaaccf lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.677944:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effbaacd6 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166977.677949:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effbaacd6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.677953:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effbaacd6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:3.0:1762166977.677989:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 209056 00000004:00200000:3.0:1762166977.677993:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166977.678012:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effbaacd6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.678022:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effbaacd6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.678029:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472a00/0x2f180c4effbaacc8 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.678033:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472a00/0x2f180c4effbaacc8 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.678038:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472a00/0x2f180c4effbaacc8 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.678042:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472a00/0x2f180c4effbaacc8 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.678046:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8472a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166977.678049:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472a00/0x2f180c4effbaacc8 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.678053:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472a00/0x2f180c4effbaacc8 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.678063:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0x0 (ffff945cc3c7f200) 00010000:00010000:3.0:1762166977.678065:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166977.678068:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472a00/0x2f180c4effbaacc8 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.678072:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472a00/0x2f180c4effbaacc8 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.678082:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473a00/0x2f180c4effbaaccf lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.678085:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473a00/0x2f180c4effbaaccf lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.678089:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473a00/0x2f180c4effbaaccf lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.678092:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8473a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166977.678093:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473a00/0x2f180c4effbaaccf lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.678096:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473a00/0x2f180c4effbaaccf lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.678100:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0xdd396665 (ffff945cf1ee9000) 00010000:00010000:3.0:1762166977.678101:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166977.678102:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473a00/0x2f180c4effbaaccf lrc: 2/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.678105:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473a00/0x2f180c4effbaaccf lrc: 0/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.678126:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473600/0x2f180c4effbaacc1 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d22 expref: 535 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.678136:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effbaacd6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d22 expref: 534 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.678140:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166977.678142:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166977.678143:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8472000, rc 0) 00000100:00100000:3.0:1762166977.678208:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+534:61850:x1847765450467456:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 518us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166977.678213:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30458 00000100:00100000:1.0:1762166977.680070:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166977.680107:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450467712 00000100:00100000:3.0:1762166977.680113:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450467712 00000100:00100000:3.0:1762166977.680149:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30459 00000100:00100000:3.0:1762166977.680157:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+534:61850:x1847765450467712:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166977.680222:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166977.680236:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473000/0x2f180c4effbaacdd lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9d29 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.680311:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472c00/0x2f180c4effbaace4 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166977.680321:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472c00/0x2f180c4effbaace4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.680330:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472c00/0x2f180c4effbaace4 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:3.0:1762166977.680340:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 209056 00010000:00010000:3.0:1762166977.680447:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473000/0x2f180c4effbaacdd lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d29 expref: 537 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.680461:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472c00/0x2f180c4effbaace4 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d29 expref: 536 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.680469:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166977.680472:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1762166977.680510:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8472c00, rc 0) 00000100:00100000:3.0:1762166977.680552:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+536:61850:x1847765450467712:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 394us (485us total) trans 4294992057 rc 0/0 00000100:00100000:3.0:1762166977.680560:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30459 00000100:00100000:3.0:1762166977.681644:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.681707:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450467968 00000100:00100000:1.0:1762166977.681713:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450467968 00000100:00100000:1.0:1762166977.681747:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30460 00000100:00100000:1.0:1762166977.681755:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6225880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+536:61850:x1847765450467968:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166977.681770:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166977.681781:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355be00/0x2f180c4effbaacf2 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9d30 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.681839:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbaacf9 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166977.681850:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbaacf9 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.681858:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbaacf9 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:1.0:1762166977.681868:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 209056 00010000:00010000:1.0:1762166977.681945:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355be00/0x2f180c4effbaacf2 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d30 expref: 539 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.681968:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbaacf9 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d30 expref: 538 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.681976:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166977.681979:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762166977.681982:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355ae00, rc 0) 00000100:00100000:1.0:1762166977.682021:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6225880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+538:61850:x1847765450467968:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 267us (379us total) trans 4294992058 rc 0/0 00000100:00100000:1.0:1762166977.682028:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30460 00000100:00100000:1.0:1762166977.705953:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.706050:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450468096 00000100:00100000:0.0:1762166977.706066:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450468096 00000100:00100000:0.0:1762166977.706151:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2291 00000100:00100000:0.0:1762166977.706160:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+20:2416:x1847765450468096:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:0.0:1762166977.706202:0:23939:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde600/0x2f180c4effbaad07 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.706219:0:23939:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166977.706222:0:23939:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166977.706228:0:23939:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde600/0x2f180c4effbaad07 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->212991] (req 0->212991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.706251:0:23939:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde600/0x2f180c4effbaad07 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->212991] (req 0->212991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.707780:0:23939:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde600/0x2f180c4effbaad07 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->212991] (req 0->212991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.707793:0:23939:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde600/0x2f180c4effbaad07 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->212991] (req 0->212991) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.707801:0:23939:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde600/0x2f180c4effbaad07 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->212991] (req 0->212991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.707808:0:23939:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bde600 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166977.707813:0:23939:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde600/0x2f180c4effbaad07 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->212991] (req 0->212991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.707822:0:23939:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde600/0x2f180c4effbaad07 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->212991] (req 0->212991) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.707839:0:23939:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde600/0x2f180c4effbaad07 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->212991] (req 0->212991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.707847:0:23939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde600/0x2f180c4effbaad07 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->212991] (req 0->212991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166977.707926:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+20:2416:x1847765450468096:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 1762us (1984us total) trans 0 rc 209056/209056 00000100:00100000:0.0:1762166977.707934:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2291 00000100:00100000:3.0:1762166977.709904:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.709950:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450468224 00000100:00100000:0.0:1762166977.709959:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450468224 00000100:00100000:0.0:1762166977.710011:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2292 00000100:00100000:0.0:1762166977.710018:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6226d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450468224:12345-192.168.204.38@tcp:3:lfs.0 00002000:00010000:0.0:1762166977.710055:0:23939:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa88:0x0] initial LVB size: 209056, mtime: 0x690888c1, atime: 0x690888c1, ctime: 0x690888c1, blocks: 0x30 00010000:00010000:0.0:1762166977.710065:0:23939:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbaad0e lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.710077:0:23939:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166977.710079:0:23939:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166977.710085:0:23939:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbaad0e lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->212991] (req 0->212991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.710096:0:23939:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbaad0e lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->212991] (req 0->212991) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.711542:0:23939:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbaad0e lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->212991] (req 0->212991) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.711557:0:23939:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbaad0e lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->212991] (req 0->212991) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.711565:0:23939:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbaad0e lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->212991] (req 0->212991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.711572:0:23939:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdf400 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166977.711576:0:23939:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbaad0e lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->212991] (req 0->212991) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.711590:0:23939:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbaad0e lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->212991] (req 0->212991) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.711607:0:23939:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbaad0e lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->212991] (req 0->212991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.711615:0:23939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbaad0e lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->212991] (req 0->212991) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166977.711678:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6226d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450468224:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 1659us (1779us total) trans 0 rc 209056/209056 00000100:00100000:0.0:1762166977.711688:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2292 00000100:00100000:3.0:1762166977.718114:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.718189:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450468352 00000100:00100000:1.0:1762166977.718200:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450468352 00000100:00100000:1.0:1762166977.718273:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 872 00000100:00100000:1.0:1762166977.718285:0:6480:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6224000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+538:61850:x1847765450468352:12345-192.168.204.38@tcp:103:lfs.0 00010000:00010000:1.0:1762166977.718304:0:6480:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166977.718334:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbaacf9 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d30 expref: 538 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.718354:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166977.718360:0:6480:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166977.718434:0:6480:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6224000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+537:61850:x1847765450468352:12345-192.168.204.38@tcp:103:lfs.0 Request processed in 151us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166977.718443:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 872 00000100:00100000:3.0:1762166977.719264:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.719316:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450468608 00000100:00100000:2.0:1762166977.719322:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450468608 00000100:00100000:2.0:1762166977.719360:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11844 00000100:00100000:2.0:1762166977.719371:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6224700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+537:61850:x1847765450468608:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:2.0:1762166977.719602:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6224700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+538:61850:x1847765450468608:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 234us (340us total) trans 4294992059 rc 0/0 00000100:00100000:2.0:1762166977.719607:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11844 00000100:00100000:2.0:1762166977.721267:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.721315:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450468864 00000100:00100000:1.0:1762166977.721322:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450468864 00000100:00100000:1.0:1762166977.721366:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30461 00000100:00100000:1.0:1762166977.721376:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+538:61766:x1847765450468864:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:1.0:1762166977.721393:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166977.721414:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbaad15 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9d37 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.721543:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbaad1c lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166977.721561:0:6495:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effbaacd6 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d22 expref: 539 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.721571:0:6495:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbaad1c lrc: 4/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.721610:0:6495:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effbaacd6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d22 expref: 539 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.721626:0:6495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effbaacd6 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d22 expref: 539 pid: 6495 timeout: 696 lvb_type: 0 00000100:00100000:1.0:1762166977.721642:0:6495:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79e8380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6495:1847765449719168:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166977.721742:0:6495:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1c86e40 going to sleep for 11 seconds 00000100:00100000:1.0:1762166977.722422:0:6495:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79e8380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6495:1847765449719168:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166977.722437:0:6495:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbaad1c lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000100:00100000:2.0:1762166977.722585:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.722612:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450468992 00000100:00100000:1.0:1762166977.722616:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450468992 00010000:00010000:1.0:1762166977.722631:0:6480:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effbaacd6 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d22 expref: 540 pid: 6495 timeout: 696 lvb_type: 0 00000100:00100000:1.0:1762166977.722652:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9579 00000100:00100000:1.0:1762166977.722657:0:6480:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b23800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+540:2419:x1847765450468992:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166977.722665:0:6480:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166977.722669:0:6480:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effbaacd6 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d22 expref: 540 pid: 6495 timeout: 696 lvb_type: 0 00010000:00010000:1.0:1762166977.722678:0:6480:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effbaacd6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d22 expref: 540 pid: 6495 timeout: 696 lvb_type: 0 00010000:00010000:1.0:1762166977.722693:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effbaacd6 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d22 expref: 540 pid: 6495 timeout: 696 lvb_type: 0 00010000:00010000:1.0:1762166977.722703:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166977.722706:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbaad1c lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.722712:0:6480:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbaad1c lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.722716:0:6480:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbaad1c lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.722732:0:6480:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166977.722748:0:6495:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbaad1c lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.722756:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbaad1c lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000100:00100000:1.0:1762166977.722760:0:6480:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b23800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+539:2419:x1847765450468992:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 101us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166977.722769:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9579 00000004:00200000:3.0:1762166977.722776:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 209056 00010000:00010000:3.0:1762166977.722916:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbaad15 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d37 expref: 540 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.722926:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbaad1c lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d37 expref: 539 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.722932:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166977.722934:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1762166977.722936:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355a600, rc 0) 00000100:00100000:3.0:1762166977.722969:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+539:61766:x1847765450468864:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 1596us (1705us total) trans 4294992060 rc 0/0 00000100:00100000:3.0:1762166977.722977:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30461 00000100:00100000:2.0:1762166977.723786:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166977.723809:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450469120 00000100:00100000:3.0:1762166977.723813:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450469120 00000100:00100000:3.0:1762166977.723838:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30462 00000100:00100000:3.0:1762166977.723843:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+539:61766:x1847765450469120:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:3.0:1762166977.723855:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166977.723863:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473600/0x2f180c4effbaad2a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9d3e expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.723927:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473000/0x2f180c4effbaad31 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166977.723935:0:6495:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbaad1c lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d37 expref: 540 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.723940:0:6495:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473000/0x2f180c4effbaad31 lrc: 4/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.723957:0:6495:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbaad1c lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d37 expref: 540 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.723964:0:6495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbaad1c lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d37 expref: 540 pid: 6495 timeout: 696 lvb_type: 0 00000100:00100000:3.0:1762166977.723971:0:6495:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc6224a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6495:1847765449719296:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166977.724012:0:6495:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc2c72240 going to sleep for 11 seconds 00000100:00100000:3.0:1762166977.724641:0:6495:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc6224a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6495:1847765449719296:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166977.724653:0:6495:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473000/0x2f180c4effbaad31 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000100:00100000:2.0:1762166977.724789:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.724824:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450469248 00000100:00100000:1.0:1762166977.724828:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450469248 00010000:00010000:1.0:1762166977.724843:0:6480:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbaad1c lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d37 expref: 541 pid: 6495 timeout: 696 lvb_type: 0 00000100:00100000:1.0:1762166977.724863:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9580 00000100:00100000:1.0:1762166977.724868:0:6480:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+541:2418:x1847765450469248:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166977.724884:0:6480:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166977.724889:0:6480:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbaad1c lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d37 expref: 541 pid: 6495 timeout: 696 lvb_type: 0 00010000:00010000:1.0:1762166977.724898:0:6480:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbaad1c lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d37 expref: 541 pid: 6495 timeout: 696 lvb_type: 0 00010000:00010000:1.0:1762166977.724909:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbaad1c lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d37 expref: 541 pid: 6495 timeout: 696 lvb_type: 0 00010000:00010000:1.0:1762166977.724917:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166977.724920:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473000/0x2f180c4effbaad31 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.724925:0:6480:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473000/0x2f180c4effbaad31 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.724929:0:6480:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473000/0x2f180c4effbaad31 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166977.724942:0:6480:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166977.724958:0:6495:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473000/0x2f180c4effbaad31 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.724966:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473000/0x2f180c4effbaad31 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000100:00100000:1.0:1762166977.724966:0:6480:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+540:2418:x1847765450469248:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 96us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166977.724980:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9580 00000004:00200000:3.0:1762166977.724997:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 209056 00000004:00200000:3.0:1762166977.725002:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166977.725014:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473000/0x2f180c4effbaad31 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.725032:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473600/0x2f180c4effbaad2a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d3e expref: 540 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.725042:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473000/0x2f180c4effbaad31 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d3e expref: 539 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.725047:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166977.725049:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166977.725051:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8473000, rc 0) 00000100:00100000:3.0:1762166977.725077:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+539:61766:x1847765450469120:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 1233us (1292us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166977.725081:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30462 00000100:00100000:2.0:1762166977.725955:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.725984:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.726007:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450469376 00000100:00100000:0.0:1762166977.726012:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450469376 00000100:00100000:3.0:1762166977.726020:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450469504 00000100:00100000:3.0:1762166977.726025:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450469504 00000100:00100000:0.0:1762166977.726045:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18982 00000100:00100000:0.0:1762166977.726053:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450469376:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:0.0:1762166977.726064:0:8383:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1762166977.726065:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18983 00000100:00100000:3.0:1762166977.726077:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450469504:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:0.0:1762166977.726079:0:8383:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbaad38 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9d45 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.726088:0:35472:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:0.0:1762166977.726101:0:8383:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa88:0x0] initial LVB size: 209056, mtime: 0x690888c1, atime: 0x690888c1, ctime: 0x690888c1, blocks: 0x30 00010000:00010000:3.0:1762166977.726103:0:35472:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc8473a00/0x2f180c4effbaad3f lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa89:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9d4c expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.726116:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166977.726119:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166977.726126:0:8383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbaad38 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d45 expref: 21 pid: 8383 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166977.726136:0:8383:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbaad38 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d45 expref: 21 pid: 8383 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1762166977.726145:0:35472:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc6224a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:35472:1847765449719424:192.168.204.38@tcp:106: 00010000:00010000:0.0:1762166977.726146:0:8383:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdfa00, rc 0) 00000100:00100000:0.0:1762166977.726178:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450469376:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 127us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166977.726184:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18982 00000100:00100000:3.0:1762166977.726192:0:35472:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc2c72240 going to sleep for 11 seconds 00000100:00100000:3.0:1762166977.726919:0:35472:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc6224a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:35472:1847765449719424:192.168.204.38@tcp:106: 00010000:00010000:3.0:1762166977.726936:0:35472:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc8473a00/0x2f180c4effbaad3f lrc: 1/0,0 mode: --/PR res: [0x280000400:0xa89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d4c expref: 18 pid: 35472 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166977.726957:0:35472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc8473a00/0x2f180c4effbaad3f lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d4c expref: 18 pid: 35472 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166977.726967:0:35472:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8473a00, rc 0) 00000100:00100000:3.0:1762166977.726997:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450469504:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 924us (1013us total) trans 0 rc 301/301 00000100:00100000:3.0:1762166977.727005:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18983 00000100:00100000:1.0:1762166977.727938:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.727987:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450469760 00000100:00100000:2.0:1762166977.727995:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450469760 00000100:00100000:2.0:1762166977.728028:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11845 00000100:00100000:2.0:1762166977.728038:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+539:61766:x1847765450469760:12345-192.168.204.38@tcp:35:fsx.0 00000100:00100000:2.0:1762166977.728194:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+540:61766:x1847765450469760:12345-192.168.204.38@tcp:35:fsx.0 Request processed in 159us (258us total) trans 4294992061 rc 0/0 00000100:00100000:2.0:1762166977.728200:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11845 00000100:00100000:2.0:1762166977.737781:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166977.737829:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450470016 00000100:00100000:3.0:1762166977.737839:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450470016 00000100:00100000:3.0:1762166977.737907:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30463 00000100:00100000:3.0:1762166977.737918:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+540:61851:x1847765450470016:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166977.737941:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166977.737965:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472a00/0x2f180c4effbaad46 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9d53 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.738036:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effbaad4d lrc: 3/1,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166977.738048:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effbaad4d lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.738058:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effbaad4d lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.738072:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf185ca00/0x2f180c4effbaad54 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166977.738079:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf185ca00/0x2f180c4effbaad54 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.738086:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf185ca00/0x2f180c4effbaad54 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.738192:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9200/0x2f180c4effbaad5b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166977.738198:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9200/0x2f180c4effbaad5b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.738203:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9200/0x2f180c4effbaad5b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:3.0:1762166977.738210:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 209056 00010000:00010000:3.0:1762166977.738283:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effbaad4d lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.738290:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effbaad4d lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.738296:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effbaad4d lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.738301:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effbaad4d lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.738307:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8472000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166977.738311:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effbaad4d lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.738318:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effbaad4d lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.738329:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0x0 (ffff945cf1ee9000) 00010000:00010000:3.0:1762166977.738332:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166977.738336:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effbaad4d lrc: 3/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.738342:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effbaad4d lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.738356:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf185ca00/0x2f180c4effbaad54 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.738362:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf185ca00/0x2f180c4effbaad54 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.738367:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cf185ca00/0x2f180c4effbaad54 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.738371:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf185ca00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166977.738374:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf185ca00/0x2f180c4effbaad54 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.738380:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf185ca00/0x2f180c4effbaad54 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.738387:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0xdd396665 (ffff945cf1ee9d00) 00010000:00010000:3.0:1762166977.738389:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166977.738391:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cf185ca00/0x2f180c4effbaad54 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.738395:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf185ca00/0x2f180c4effbaad54 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.738431:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472a00/0x2f180c4effbaad46 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d53 expref: 543 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.738445:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9200/0x2f180c4effbaad5b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d53 expref: 542 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.738453:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166977.738455:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166977.738458:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc5db9200, rc 0) 00000100:00100000:3.0:1762166977.738581:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+542:61851:x1847765450470016:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 661us (806us total) trans 4294992062 rc 0/0 00000100:00100000:3.0:1762166977.738592:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30463 00000100:00100000:1.0:1762166977.739956:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.740004:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.740009:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450470400 00000100:00100000:2.0:1762166977.740016:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450470400 00000100:00100000:3.0:1762166977.740053:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450470144 00000100:00100000:2.0:1762166977.740064:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11846 00000100:00100000:3.0:1762166977.740065:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450470144 00000100:00100000:2.0:1762166977.740077:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+543:61851:x1847765450470400:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:3.0:1762166977.740122:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 873 00000100:00100000:3.0:1762166977.740134:0:6480:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff1ab450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+543:2418:x1847765450470144:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166977.740150:0:6480:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166977.740173:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9200/0x2f180c4effbaad5b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d53 expref: 544 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.740188:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166977.740191:0:6480:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166977.740235:0:6480:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff1ab450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+543:2418:x1847765450470144:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 105us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166977.740244:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+543:61851:x1847765450470400:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 164us (288us total) trans 4294992063 rc 0/0 00000100:00100000:3.0:1762166977.740249:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 873 00000100:00100000:2.0:1762166977.740265:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11846 00000100:00100000:1.0:1762166977.741685:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166977.741722:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450470656 00000100:00100000:3.0:1762166977.741729:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450470656 00000100:00100000:3.0:1762166977.741768:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30464 00000100:00100000:3.0:1762166977.741779:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+542:61851:x1847765450470656:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166977.741796:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166977.741817:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8200/0x2f180c4effbaad69 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9d5a expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.741929:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbaad70 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166977.741944:0:6495:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473000/0x2f180c4effbaad31 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d3e expref: 543 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.741954:0:6495:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbaad70 lrc: 4/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.741988:0:6495:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473000/0x2f180c4effbaad31 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d3e expref: 543 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.741999:0:6495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473000/0x2f180c4effbaad31 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d3e expref: 543 pid: 6495 timeout: 696 lvb_type: 0 00000100:00100000:3.0:1762166977.742011:0:6495:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc6227800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6495:1847765449719552:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166977.742098:0:6495:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc2c72cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166977.742963:0:6495:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc6227800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6495:1847765449719552:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166977.742979:0:6495:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbaad70 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000100:00100000:1.0:1762166977.743305:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166977.743331:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450470784 00000100:00100000:3.0:1762166977.743337:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450470784 00010000:00010000:3.0:1762166977.743396:0:6480:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473000/0x2f180c4effbaad31 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d3e expref: 544 pid: 6495 timeout: 696 lvb_type: 0 00000100:00100000:3.0:1762166977.743425:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9581 00000100:00100000:3.0:1762166977.743434:0:6480:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+544:2418:x1847765450470784:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166977.743444:0:6480:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166977.743449:0:6480:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473000/0x2f180c4effbaad31 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d3e expref: 544 pid: 6495 timeout: 696 lvb_type: 0 00010000:00010000:3.0:1762166977.743468:0:6480:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473000/0x2f180c4effbaad31 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d3e expref: 544 pid: 6495 timeout: 696 lvb_type: 0 00010000:00010000:3.0:1762166977.743514:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473000/0x2f180c4effbaad31 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d3e expref: 544 pid: 6495 timeout: 696 lvb_type: 0 00010000:00010000:3.0:1762166977.743524:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166977.743527:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbaad70 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.743533:0:6480:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbaad70 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.743539:0:6480:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbaad70 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.743561:0:6480:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166977.743589:0:6480:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+543:2418:x1847765450470784:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 157us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166977.743595:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9581 00010000:00010000:0.0:1762166977.743599:0:6495:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbaad70 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.743610:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbaad70 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:0.0:1762166977.743629:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 209056 00010000:00010000:0.0:1762166977.743737:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8200/0x2f180c4effbaad69 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d5a expref: 544 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.743748:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbaad70 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d5a expref: 543 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.743754:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166977.743756:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1762166977.743758:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc5db8e00, rc 0) 00000100:00100000:0.0:1762166977.743788:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+543:61851:x1847765450470656:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2014us (2107us total) trans 4294992064 rc 0/0 00000100:00100000:0.0:1762166977.743793:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30464 00000100:00100000:1.0:1762166977.744779:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.744813:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450470912 00000100:00100000:2.0:1762166977.744820:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450470912 00000100:00100000:2.0:1762166977.744857:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11847 00000100:00100000:2.0:1762166977.744863:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7be6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+543:61851:x1847765450470912:12345-192.168.204.38@tcp:33:lfs.0 00000100:00100000:2.0:1762166977.744980:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7be6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+543:61851:x1847765450470912:12345-192.168.204.38@tcp:33:lfs.0 Request processed in 116us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166977.744988:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11847 00000100:00100000:1.0:1762166977.745789:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.745837:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450471168 00000100:00100000:2.0:1762166977.745843:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450471168 00000100:00100000:2.0:1762166977.745888:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11848 00000100:00100000:2.0:1762166977.745897:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+543:61851:x1847765450471168:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:2.0:1762166977.746026:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+544:61851:x1847765450471168:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 129us (238us total) trans 4294992065 rc 0/0 00000100:00100000:2.0:1762166977.746033:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11848 00000100:00100000:1.0:1762166977.746795:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.746842:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450471424 00000100:00100000:0.0:1762166977.746848:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450471424 00000100:00100000:0.0:1762166977.746898:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30465 00000100:00100000:0.0:1762166977.746909:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+544:61851:x1847765450471424:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166977.746922:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166977.746924:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:0.0:1762166977.746945:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbaad70 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d5a expref: 544 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.746959:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472c00/0x2f180c4effbaace4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d29 expref: 543 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.746966:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166977.746969:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166977.746978:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbaad7e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9d61 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.747030:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbaad85 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166977.747040:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbaad85 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.747049:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbaad85 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:0.0:1762166977.747058:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 209056 00010000:00010000:0.0:1762166977.747117:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbaad7e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d61 expref: 545 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.747130:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbaad85 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d61 expref: 544 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.747137:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166977.747140:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166977.747143:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bde800, rc 0) 00000100:00100000:0.0:1762166977.747174:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+544:61851:x1847765450471424:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 269us (381us total) trans 4294992066 rc 0/0 00000100:00100000:0.0:1762166977.747179:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30465 00000100:00100000:1.0:1762166977.748029:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.748072:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450471680 00000100:00100000:2.0:1762166977.748078:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450471680 00000100:00100000:2.0:1762166977.748110:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11849 00000100:00100000:2.0:1762166977.748118:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+544:61851:x1847765450471680:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:2.0:1762166977.748147:0:6497:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x240000404:0x5eb:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbaad85 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d61 expref: 544 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.748167:0:6497:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbaad93 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 00010000:00010000:2.0:1762166977.748176:0:6497:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472800/0x2f180c4effbaacb3 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d1b expref: 544 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.748183:0:6497:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbaad93 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.748222:0:6497:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472800/0x2f180c4effbaacb3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d1b expref: 544 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.748234:0:6497:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472800/0x2f180c4effbaacb3 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d1b expref: 544 pid: 6495 timeout: 696 lvb_type: 0 00000100:00100000:2.0:1762166977.748246:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bccb7f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6497:1847765449719680:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166977.748309:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc56bf0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166977.749122:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bccb7f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6497:1847765449719680:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166977.749139:0:6497:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbaad93 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00000100:00100000:1.0:1762166977.749340:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166977.749378:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450471808 00000100:00100000:3.0:1762166977.749418:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450471808 00010000:00010000:3.0:1762166977.749448:0:6480:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472800/0x2f180c4effbaacb3 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d1b expref: 545 pid: 6495 timeout: 696 lvb_type: 0 00000100:00100000:3.0:1762166977.749509:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9582 00000100:00100000:3.0:1762166977.749526:0:6480:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+545:2419:x1847765450471808:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166977.749540:0:6480:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166977.749546:0:6480:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472800/0x2f180c4effbaacb3 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d1b expref: 545 pid: 6495 timeout: 696 lvb_type: 0 00010000:00010000:3.0:1762166977.749559:0:6480:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472800/0x2f180c4effbaacb3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d1b expref: 545 pid: 6495 timeout: 696 lvb_type: 0 00010000:00010000:3.0:1762166977.749578:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472800/0x2f180c4effbaacb3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d1b expref: 545 pid: 6495 timeout: 696 lvb_type: 0 00010000:00010000:3.0:1762166977.749592:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166977.749597:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbaad93 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00010000:00010000:3.0:1762166977.749606:0:6480:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbaad93 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT1 00010000:00010000:3.0:1762166977.749635:0:6480:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbaad93 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT1 00010000:00010000:3.0:1762166977.749662:0:6480:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166977.749701:0:6497:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbaad93 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00000100:00100000:3.0:1762166977.749704:0:6480:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+544:2419:x1847765450471808:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 184us (366us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166977.749720:0:6497:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbaad93 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00000100:00100000:3.0:1762166977.749723:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9582 00010000:00010000:2.0:1762166977.749935:0:6497:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbaad93 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.749947:0:6497:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbaad93 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.749955:0:6497:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbaad93 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.749960:0:6497:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa8c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166977.749965:0:6497:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbaad93 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.749973:0:6497:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbaad93 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.749982:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166977.749984:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1762166977.749987:0:6497:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbaad93 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.749992:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbaad93 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.750009:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166977.750011:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166977.750016:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbaad85 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d61 expref: 543 pid: 6495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166977.750115:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+543:61851:x1847765450471680:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 1997us (2088us total) trans 4294992067 rc -22/-22 00000100:00100000:2.0:1762166977.750134:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11849 00000100:00100000:1.0:1762166977.750924:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166977.750976:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450471936 00000100:00100000:3.0:1762166977.750981:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450471936 00000100:00100000:3.0:1762166977.751017:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30466 00000100:00100000:3.0:1762166977.751025:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+543:61851:x1847765450471936:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166977.751045:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166977.751057:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9200/0x2f180c4effbaad9a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9d68 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.751093:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9200/0x2f180c4effbaad9a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d68 expref: 544 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.751104:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9200/0x2f180c4effbaad9a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d68 expref: 544 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.751120:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166977.751122:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166977.751125:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc5db9200, rc 0) 00000100:00100000:3.0:1762166977.751156:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+544:61851:x1847765450471936:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 131us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166977.751162:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30466 00000100:00100000:1.0:1762166977.752362:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166977.752395:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450472192 00000100:00100000:3.0:1762166977.752400:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450472192 00000100:00100000:3.0:1762166977.752432:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30467 00000100:00100000:3.0:1762166977.752440:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+544:61851:x1847765450472192:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166977.752451:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166977.752465:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9a00/0x2f180c4effbaada1 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9d6f expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.752870:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8400/0x2f180c4effbaada8 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x60c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166977.752892:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8400/0x2f180c4effbaada8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x60c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.752899:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8400/0x2f180c4effbaada8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x60c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:3.0:1762166977.752906:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x60c:0x0]: returning size 0 00010000:00010000:3.0:1762166977.752941:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9a00/0x2f180c4effbaada1 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d6f expref: 547 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.752959:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8400/0x2f180c4effbaada8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x60c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d6f expref: 546 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.752967:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x60c:0x0].0x0 (ffff945cf1ee9d00) 00010000:00010000:3.0:1762166977.752970:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166977.752972:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc5db8400, rc 0) 00000100:00100000:3.0:1762166977.753005:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+546:61851:x1847765450472192:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 566us (644us total) trans 4294992068 rc 0/0 00000100:00100000:3.0:1762166977.753010:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30467 00000100:00100000:1.0:1762166977.754107:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166977.754137:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450472448 00000100:00100000:3.0:1762166977.754143:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450472448 00000100:00100000:3.0:1762166977.754176:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30468 00000100:00100000:3.0:1762166977.754184:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+546:61851:x1847765450472448:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166977.754199:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166977.754208:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9800/0x2f180c4effbaadb6 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9d76 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.754262:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbaadbd lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166977.754271:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbaadbd lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.754279:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbaadbd lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:3.0:1762166977.754288:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 209056 00010000:00010000:3.0:1762166977.754337:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9800/0x2f180c4effbaadb6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d76 expref: 549 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.754346:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbaadbd lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d76 expref: 548 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.754351:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166977.754353:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166977.754354:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc5db9c00, rc 0) 00000100:00100000:3.0:1762166977.754380:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+548:61851:x1847765450472448:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 199us (275us total) trans 4294992069 rc 0/0 00000100:00100000:3.0:1762166977.754384:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30468 00000100:00100000:1.0:1762166977.755130:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.755183:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450472704 00000100:00100000:2.0:1762166977.755189:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450472704 00000100:00100000:2.0:1762166977.755224:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11850 00000100:00100000:2.0:1762166977.755234:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+548:61851:x1847765450472704:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:2.0:1762166977.755276:0:6497:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x240000404:0x5eb:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbaadbd lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d76 expref: 548 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.755299:0:6497:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbaadcb lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 00010000:00010000:2.0:1762166977.755309:0:6497:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9200/0x2f180c4effbaad9a lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d68 expref: 548 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.755317:0:6497:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbaadcb lrc: 4/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.755351:0:6497:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9200/0x2f180c4effbaad9a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d68 expref: 548 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.755364:0:6497:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9200/0x2f180c4effbaad9a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d68 expref: 548 pid: 6495 timeout: 696 lvb_type: 0 00000100:00100000:2.0:1762166977.755379:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bccb7f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6497:1847765449719808:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166977.755447:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc56bf6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166977.756183:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bccb7f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6497:1847765449719808:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166977.756203:0:6497:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbaadcb lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00000100:00100000:1.0:1762166977.756377:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166977.756416:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450472832 00000100:00100000:3.0:1762166977.756460:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450472832 00010000:00010000:3.0:1762166977.756504:0:6480:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9200/0x2f180c4effbaad9a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d68 expref: 549 pid: 6495 timeout: 696 lvb_type: 0 00000100:00100000:3.0:1762166977.756535:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9583 00000100:00100000:3.0:1762166977.756545:0:6480:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+549:2419:x1847765450472832:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166977.756557:0:6480:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166977.756563:0:6480:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9200/0x2f180c4effbaad9a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d68 expref: 549 pid: 6495 timeout: 696 lvb_type: 0 00010000:00010000:3.0:1762166977.756580:0:6480:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9200/0x2f180c4effbaad9a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d68 expref: 549 pid: 6495 timeout: 696 lvb_type: 0 00010000:00010000:3.0:1762166977.756594:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9200/0x2f180c4effbaad9a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d68 expref: 549 pid: 6495 timeout: 696 lvb_type: 0 00010000:00010000:3.0:1762166977.756605:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166977.756614:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbaadcb lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00010000:00010000:3.0:1762166977.756622:0:6480:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbaadcb lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT1 00010000:00010000:3.0:1762166977.756628:0:6480:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbaadcb lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT1 00010000:00010000:3.0:1762166977.756646:0:6480:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166977.756677:0:6480:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+548:2419:x1847765450472832:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 134us (298us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166977.756680:0:6497:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbaadcb lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00000100:00100000:3.0:1762166977.756690:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9583 00010000:00010000:2.0:1762166977.756693:0:6497:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbaadcb lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.756710:0:6497:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbaadd2 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x60c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 00010000:00010000:2.0:1762166977.756720:0:6497:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8400/0x2f180c4effbaada8 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x60c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d6f expref: 547 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.756727:0:6497:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbaadd2 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x60c:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.756748:0:6497:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8400/0x2f180c4effbaada8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x60c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d6f expref: 547 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.756759:0:6497:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8400/0x2f180c4effbaada8 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x60c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d6f expref: 547 pid: 6495 timeout: 696 lvb_type: 0 00000100:00100000:2.0:1762166977.756769:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bccb7f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6497:1847765449719936:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166977.756818:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc56bf6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166977.757520:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bccb7f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6497:1847765449719936:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166977.757533:0:6497:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbaadd2 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x60c:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00000100:00100000:1.0:1762166977.757708:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166977.757730:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450472960 00000100:00100000:3.0:1762166977.757736:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450472960 00010000:00010000:3.0:1762166977.757783:0:6480:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8400/0x2f180c4effbaada8 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x60c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d6f expref: 548 pid: 6495 timeout: 696 lvb_type: 0 00000100:00100000:3.0:1762166977.757807:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9584 00000100:00100000:3.0:1762166977.757814:0:6480:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+548:2418:x1847765450472960:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166977.757823:0:6480:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166977.757829:0:6480:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8400/0x2f180c4effbaada8 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x60c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d6f expref: 548 pid: 6495 timeout: 696 lvb_type: 0 00010000:00010000:3.0:1762166977.757839:0:6480:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8400/0x2f180c4effbaada8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x60c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d6f expref: 548 pid: 6495 timeout: 696 lvb_type: 0 00010000:00010000:3.0:1762166977.757851:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8400/0x2f180c4effbaada8 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x60c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d6f expref: 548 pid: 6495 timeout: 696 lvb_type: 0 00010000:00010000:3.0:1762166977.757861:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x60c:0x0].0x0 (ffff945cf1ee9d00) 00010000:00010000:3.0:1762166977.757865:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbaadd2 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x60c:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00010000:00010000:3.0:1762166977.757884:0:6480:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbaadd2 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x60c:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT1 00010000:00010000:3.0:1762166977.757890:0:6480:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbaadd2 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x60c:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT1 00010000:00010000:3.0:1762166977.757908:0:6480:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166977.757944:0:6497:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbaadd2 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x60c:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00000100:00100000:3.0:1762166977.757948:0:6480:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+547:2418:x1847765450472960:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 132us (239us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166977.757959:0:6497:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbaadd2 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x60c:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00000100:00100000:3.0:1762166977.757964:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9584 00000100:00100000:2.0:1762166977.758293:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bccb7f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449720064:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762166977.758350:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166977.758376:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccba916c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166977.758405:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449720064 00000100:00100000:1.0:1762166977.758411:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449720064 00000100:00100000:1.0:1762166977.758452:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1348 00000100:00100000:1.0:1762166977.758462:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:6497:x1847765449720064:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762166977.758580:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:6497:x1847765449720064:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 120us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166977.758588:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1348 00000100:00100000:2.0:1762166977.758616:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bccb7f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449720064:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762166977.758661:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bccb7f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449720192:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762166977.758684:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166977.758701:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc56bf6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166977.758728:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449720192 00000100:00100000:1.0:1762166977.758733:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449720192 00000100:00100000:1.0:1762166977.758764:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1349 00000100:00100000:1.0:1762166977.758770:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:6497:x1847765449720192:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762166977.758838:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:6497:x1847765449720192:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 67us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166977.758847:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1349 00000100:00100000:2.0:1762166977.758853:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bccb7f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449720192:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762166977.758905:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bccb7f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449720320:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762166977.758922:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166977.758938:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc11cad80 going to sleep for 11 seconds 00000100:00100000:1.0:1762166977.758958:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449720320 00000100:00100000:1.0:1762166977.758962:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449720320 00000100:00100000:1.0:1762166977.758985:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1350 00000100:00100000:1.0:1762166977.758992:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:6497:x1847765449720320:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762166977.759044:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:6497:x1847765449720320:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 52us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166977.759051:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1350 00000100:00100000:2.0:1762166977.759062:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bccb7f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449720320:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762166977.759086:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bccb7f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449720448:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762166977.759101:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166977.759115:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d0116c540 going to sleep for 11 seconds 00000100:00100000:1.0:1762166977.759133:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449720448 00000100:00100000:1.0:1762166977.759137:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449720448 00000100:00100000:1.0:1762166977.759159:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1351 00000100:00100000:1.0:1762166977.759165:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:6497:x1847765449720448:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762166977.759213:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:6497:x1847765449720448:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 48us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166977.759220:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1351 00000100:00100000:2.0:1762166977.759231:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bccb7f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449720448:0@lo:1000:mdt_rdpg00_000.0 00000040:00080000:2.0:1762166977.759542:0:6497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x2:0x0].47, 280 off65816 00000001:00080000:2.0:1762166977.759552:0:6497:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992070 00000100:00100000:2.0:1762166977.759594:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bccb7f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449720576:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762166977.759618:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166977.759637:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d0116cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1762166977.759658:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449720576 00000100:00100000:1.0:1762166977.759663:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449720576 00000100:00100000:1.0:1762166977.759690:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1352 00000100:00100000:1.0:1762166977.759698:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:6497:x1847765449720576:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762166977.759790:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:6497:x1847765449720576:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 93us (171us total) trans 17179876388 rc 0/0 00000100:00100000:1.0:1762166977.759798:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1352 00000100:00100000:2.0:1762166977.759822:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bccb7f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449720576:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762166977.759845:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bccb7ea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449720704:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762166977.759885:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166977.759903:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc56bf0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166977.759922:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449720704 00000100:00100000:1.0:1762166977.759927:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449720704 00000100:00100000:1.0:1762166977.759948:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1353 00000100:00100000:1.0:1762166977.759955:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:6497:x1847765449720704:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762166977.760031:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:6497:x1847765449720704:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 76us (158us total) trans 21474843305 rc 0/0 00000100:00100000:1.0:1762166977.760038:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1353 00000100:00100000:2.0:1762166977.760051:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bccb7ea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449720704:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1762166977.760094:0:6497:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992071 00010000:00010000:2.0:1762166977.760116:0:6497:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbaadd2 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x60c:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.760125:0:6497:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbaadd2 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x60c:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.760132:0:6497:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbaadd2 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x60c:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.760139:0:6497:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa8000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166977.760143:0:6497:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbaadd2 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x60c:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.760150:0:6497:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbaadd2 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x60c:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.760161:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x60c:0x0].0x0 (ffff945cf1ee9d00) 00010000:00010000:2.0:1762166977.760165:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1762166977.760169:0:6497:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbaadd2 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x60c:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.760175:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbaadd2 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x60c:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.760192:0:6497:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbaadcb lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.760198:0:6497:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbaadcb lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.760204:0:6497:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbaadcb lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.760209:0:6497:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa8c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166977.760212:0:6497:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbaadcb lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.760218:0:6497:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbaadcb lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.760226:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166977.760229:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1762166977.760232:0:6497:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbaadcb lrc: 2/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.760238:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbaadcb lrc: 0/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.760248:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166977.760250:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166977.760256:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbaadbd lrc: 0/0,0 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d76 expref: 549 pid: 6495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166977.760325:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+548:61851:x1847765450472704:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 5093us (5196us total) trans 4294992072 rc 0/0 00000100:00100000:2.0:1762166977.760334:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11850 00000020:00080000:2.0:1762166977.760339:0:6497:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1762166977.761193:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166977.761232:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450473088 00000100:00100000:3.0:1762166977.761236:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450473088 00000100:00100000:3.0:1762166977.761268:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30469 00000100:00100000:3.0:1762166977.761276:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+548:61851:x1847765450473088:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166977.761291:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166977.761305:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9a00/0x2f180c4effbaadd9 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9d7d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.761345:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9a00/0x2f180c4effbaadd9 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d7d expref: 549 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.761354:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9a00/0x2f180c4effbaadd9 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d7d expref: 549 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.761365:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166977.761367:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166977.761369:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc5db9a00, rc 0) 00000100:00100000:3.0:1762166977.761395:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+549:61851:x1847765450473088:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 121us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166977.761400:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30469 00000100:00100000:1.0:1762166977.762633:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.762680:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450473344 00000100:00100000:2.0:1762166977.762685:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450473344 00000100:00100000:2.0:1762166977.762720:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11851 00000100:00100000:2.0:1762166977.762728:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+549:61851:x1847765450473344:12345-192.168.204.38@tcp:35:lfs.0 00000004:00080000:2.0:1762166977.762965:0:6497:0:(mdd_object.c:3965:mdd_close()) Object [0x240000404:0x60c:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1762166977.763026:0:6497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5901, 64 off462112 00000040:00080000:2.0:1762166977.763054:0:6497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5900, 64 off462112 00000001:00080000:2.0:1762166977.763060:0:6497:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992073 00010000:00010000:2.0:1762166977.763091:0:6497:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbaade0 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x60c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 00010000:00010000:2.0:1762166977.763101:0:6497:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbaade0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x60c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.763110:0:6497:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbaade0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x60c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.763119:0:6497:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbaade0 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x60c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.763125:0:6497:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbaade0 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x60c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.763131:0:6497:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbaade0 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x60c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166977.763171:0:6497:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1762166977.763319:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+551:61851:x1847765450473344:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 591us (687us total) trans 4294992074 rc 0/0 00000100:00100000:2.0:1762166977.763327:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11851 00000020:00080000:2.0:1762166977.763331:0:6497:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1762166977.763402:0:10257:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1762166977.763410:0:10257:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbaade0 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x60c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166977.763417:0:10257:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa8e00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166977.763422:0:10257:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbaade0 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x60c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166977.763429:0:10257:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbaade0 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x60c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166977.763439:0:10257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x60c:0x0].0x0 (ffff945bc809bd00) 00010000:00010000:0.0:1762166977.763441:0:10257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1762166977.763445:0:10257:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbaade0 lrc: 1/0,0 mode: --/PW res: [0x240000404:0x60c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166977.763450:0:10257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbaade0 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x60c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166977.763464:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166977.763466:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166977.763468:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166977.764129:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.764175:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450473600 00000100:00100000:2.0:1762166977.764181:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450473600 00000100:00100000:2.0:1762166977.764216:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11852 00000100:00100000:2.0:1762166977.764225:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7be7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+551:61851:x1847765450473600:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:2.0:1762166977.764371:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7be7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+552:61851:x1847765450473600:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 147us (242us total) trans 4294992075 rc 0/0 00000100:00100000:2.0:1762166977.764378:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11852 00000100:00100000:1.0:1762166977.766206:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166977.766244:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450473856 00000100:00100000:3.0:1762166977.766249:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450473856 00000100:00100000:3.0:1762166977.766280:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30470 00000100:00100000:3.0:1762166977.766285:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+552:61766:x1847765450473856:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:3.0:1762166977.766300:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166977.766315:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9800/0x2f180c4effbaade7 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9d84 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.766380:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbaadee lrc: 3/1,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166977.766391:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbaadee lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.766402:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbaadee lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.766419:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8200/0x2f180c4effbaadf5 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166977.766425:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8200/0x2f180c4effbaadf5 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.766431:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8200/0x2f180c4effbaadf5 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.766530:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf185ca00/0x2f180c4effbaadfc lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166977.766537:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf185ca00/0x2f180c4effbaadfc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.766542:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf185ca00/0x2f180c4effbaadfc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:3.0:1762166977.766550:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 209056 00010000:00010000:3.0:1762166977.766601:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbaadee lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.766605:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbaadee lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.766609:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbaadee lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.766613:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbaadee lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.766616:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc5db8e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166977.766619:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbaadee lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.766624:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbaadee lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.766631:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0x0 (ffff945cf1ee9000) 00010000:00010000:3.0:1762166977.766632:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166977.766635:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbaadee lrc: 3/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.766639:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbaadee lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.766646:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8200/0x2f180c4effbaadf5 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.766649:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8200/0x2f180c4effbaadf5 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.766653:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8200/0x2f180c4effbaadf5 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.766656:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc5db8200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166977.766657:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8200/0x2f180c4effbaadf5 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.766660:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8200/0x2f180c4effbaadf5 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.766663:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0xdd396665 (ffff945cf1ee9c00) 00010000:00010000:3.0:1762166977.766665:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166977.766666:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8200/0x2f180c4effbaadf5 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.766669:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8200/0x2f180c4effbaadf5 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.766698:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9800/0x2f180c4effbaade7 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d84 expref: 555 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.766707:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf185ca00/0x2f180c4effbaadfc lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d84 expref: 554 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.766712:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166977.766713:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166977.766715:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf185ca00, rc 0) 00000100:00100000:3.0:1762166977.766748:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+554:61766:x1847765450473856:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 464us (547us total) trans 4294992076 rc 0/0 00000100:00100000:3.0:1762166977.766753:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30470 00000100:00100000:1.0:1762166977.768433:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166977.768468:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450473984 00000100:00100000:3.0:1762166977.768517:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450473984 00000100:00100000:3.0:1762166977.768559:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30471 00000100:00100000:3.0:1762166977.768568:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+554:61766:x1847765450473984:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:3.0:1762166977.768585:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166977.768598:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbaae0a lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9d8b expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.768622:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8400/0x2f180c4effbaae11 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166977.768632:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8400/0x2f180c4effbaae11 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.768641:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8400/0x2f180c4effbaae11 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.768733:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbaae0a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d8b expref: 556 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.768746:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8400/0x2f180c4effbaae11 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d8b expref: 555 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.768754:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166977.768757:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1762166977.768759:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc5db8400, rc 0) 00000100:00100000:3.0:1762166977.768799:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+555:61766:x1847765450473984:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 232us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166977.768806:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30471 00000100:00100000:1.0:1762166977.769812:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166977.769912:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450474240 00000100:00100000:3.0:1762166977.769923:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450474240 00000100:00100000:3.0:1762166977.769976:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30472 00000100:00100000:3.0:1762166977.769987:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+555:61766:x1847765450474240:12345-192.168.204.38@tcp:36:fsx.0 00010000:00010000:3.0:1762166977.770037:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166977.770062:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf185ca00/0x2f180c4effbaadfc lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d84 expref: 555 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.770081:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166977.770085:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166977.770235:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9200/0x2f180c4effbaae18 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166977.770249:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9200/0x2f180c4effbaae18 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.770259:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9200/0x2f180c4effbaae18 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000001:00080000:3.0:1762166977.770291:0:6495:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992077 00000004:00010000:3.0:1762166977.770306:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000081dc3ab reply state 00000000458ffbf1 transno 4294992078 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9200/0x2f180c4effbaae18 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.770314:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9200/0x2f180c4effbaae18 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.770318:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166977.770320:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1762166977.770322:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166977.770407:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+557:61766:x1847765450474240:12345-192.168.204.38@tcp:36:fsx.0 Request processed in 424us (603us total) trans 4294992078 rc 0/0 00000100:00100000:3.0:1762166977.770413:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30472 00000020:00080000:3.0:1762166977.770417:0:6495:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1762166977.771272:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166977.771311:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450474368 00000100:00100000:3.0:1762166977.771316:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450474368 00000100:00100000:3.0:1762166977.771349:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18984 00000100:00100000:3.0:1762166977.771357:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+21:61766:x1847765450474368:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:3.0:1762166977.771369:0:35472:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166977.771383:0:35472:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8472800/0x2f180c4effbaae1f lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9d92 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.771404:0:35472:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc8472600/0x2f180c4effbaac04 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ce3 expref: 22 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166977.771413:0:35472:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166977.771415:0:35472:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166977.771419:0:35472:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472800/0x2f180c4effbaae1f lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d92 expref: 22 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.771449:0:35472:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc8472600/0x2f180c4effbaac04 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ce3 expref: 22 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166977.771463:0:35472:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc8472600/0x2f180c4effbaac04 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ce3 expref: 22 pid: 28434 timeout: 696 lvb_type: 1 00000100:00100000:3.0:1762166977.771501:0:35472:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc6227800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:35472:1847765449720832:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166977.771576:0:35472:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc2c72480 going to sleep for 11 seconds 00000100:00100000:3.0:1762166977.772316:0:35472:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc6227800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:35472:1847765449720832:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166977.772335:0:35472:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc8472800/0x2f180c4effbaae1f lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d92 expref: 22 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.772344:0:35472:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8472800, rc 0) 00000100:00100000:3.0:1762166977.772370:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+22:61766:x1847765450474368:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 1015us (1100us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166977.772375:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18984 00000100:00100000:1.0:1762166977.772599:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166977.772638:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450474496 00000100:00100000:3.0:1762166977.772642:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450474496 00010000:00010000:3.0:1762166977.772659:0:6480:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472600/0x2f180c4effbaac04 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ce3 expref: 22 pid: 28434 timeout: 696 lvb_type: 1 00000100:00100000:3.0:1762166977.772686:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9585 00000100:00100000:3.0:1762166977.772695:0:6480:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb384a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765450474496:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166977.772705:0:6480:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166977.772722:0:6480:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc8472600/0x2f180c4effbaac04 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ce3 expref: 22 pid: 28434 timeout: 696 lvb_type: 1 00010000:00010000:3.0:1762166977.772733:0:6480:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc8472600/0x2f180c4effbaac04 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ce3 expref: 22 pid: 28434 timeout: 696 lvb_type: 1 00010000:00010000:3.0:1762166977.772749:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8472600/0x2f180c4effbaac04 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ce3 expref: 22 pid: 28434 timeout: 696 lvb_type: 1 00010000:00010000:3.0:1762166977.772759:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166977.772761:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166977.772766:0:6480:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc8472800/0x2f180c4effbaae1f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d92 expref: 21 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.772775:0:6480:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472800/0x2f180c4effbaae1f lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d92 expref: 21 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.772796:0:6480:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff945bc8472800/0x2f180c4effbaae1f lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d92 expref: 21 pid: 35472 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166977.772807:0:6480:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc6227800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6480:1847765449720960:192.168.204.38@tcp:105: 00000100:00100000:3.0:1762166977.772844:0:6480:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc2c72480 going to sleep for 11 seconds 00000100:00100000:3.0:1762166977.773936:0:6480:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc6227800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6480:1847765449720960:192.168.204.38@tcp:105: 00000100:00100000:1.0:1762166977.773944:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:3.0:1762166977.773949:0:6480:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166977.773971:0:6480:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb384a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450474496:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1278us (1374us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166977.773981:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9585 00000100:00100000:2.0:1762166977.773996:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450474624 00000100:00100000:2.0:1762166977.774002:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450474624 00000100:00100000:2.0:1762166977.774042:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18985 00000100:00100000:2.0:1762166977.774052:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb386680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+17:61766:x1847765450474624:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:2.0:1762166977.774063:0:35472:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166977.774075:0:35472:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8c00/0x2f180c4effbaae26 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9d99 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.774093:0:35472:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945cc355a000/0x2f180c4effbaabf6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9cea expref: 18 pid: 35472 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166977.774099:0:35472:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166977.774100:0:35472:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166977.774103:0:35472:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8c00/0x2f180c4effbaae26 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d99 expref: 18 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.774117:0:35472:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945cc355a000/0x2f180c4effbaabf6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9cea expref: 18 pid: 35472 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166977.774124:0:35472:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945cc355a000/0x2f180c4effbaabf6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9cea expref: 18 pid: 35472 timeout: 696 lvb_type: 1 00000100:00100000:2.0:1762166977.774131:0:35472:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bccb7f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:35472:1847765449721088:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166977.774166:0:35472:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d0116cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1762166977.774947:0:35472:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bccb7f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:35472:1847765449721088:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166977.774963:0:35472:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8c00/0x2f180c4effbaae26 lrc: 3/0,0 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d99 expref: 18 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.774975:0:35472:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa8c00, rc 0) 00000100:00100000:2.0:1762166977.775006:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb386680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+18:61766:x1847765450474624:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 957us (1065us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166977.775012:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18985 00000100:00100000:1.0:1762166977.775215:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166977.775248:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450474752 00000100:00100000:3.0:1762166977.775253:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450474752 00010000:00010000:3.0:1762166977.775270:0:6480:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945cc355a000/0x2f180c4effbaabf6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9cea expref: 18 pid: 35472 timeout: 696 lvb_type: 1 00000100:00100000:3.0:1762166977.775295:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9586 00000100:00100000:3.0:1762166977.775302:0:6480:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb387b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450474752:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166977.775319:0:6480:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166977.775338:0:6480:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945cc355a000/0x2f180c4effbaabf6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9cea expref: 18 pid: 35472 timeout: 696 lvb_type: 1 00010000:00010000:3.0:1762166977.775349:0:6480:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945cc355a000/0x2f180c4effbaabf6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9cea expref: 18 pid: 35472 timeout: 696 lvb_type: 1 00010000:00010000:3.0:1762166977.775366:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cc355a000/0x2f180c4effbaabf6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9cea expref: 18 pid: 35472 timeout: 696 lvb_type: 1 00010000:00010000:3.0:1762166977.775377:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166977.775379:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166977.775383:0:6480:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8c00/0x2f180c4effbaae26 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d99 expref: 17 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.775392:0:6480:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8c00/0x2f180c4effbaae26 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d99 expref: 17 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.775412:0:6480:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8c00/0x2f180c4effbaae26 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d99 expref: 17 pid: 35472 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166977.775419:0:6480:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc6227800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6480:1847765449721216:192.168.204.38@tcp:105: 00000100:00100000:3.0:1762166977.775451:0:6480:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc2c72480 going to sleep for 11 seconds 00000100:00100000:3.0:1762166977.776413:0:6480:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc6227800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6480:1847765449721216:192.168.204.38@tcp:105: 00010000:00010000:3.0:1762166977.776425:0:6480:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166977.776461:0:6480:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb387b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450474752:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1159us (1247us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166977.776469:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9586 00000100:00100000:2.0:1762166977.776540:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166977.776572:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450474880 00000100:00100000:3.0:1762166977.776585:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450474880 00000100:00100000:3.0:1762166977.776621:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18986 00000100:00100000:3.0:1762166977.776697:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+21:61766:x1847765450474880:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:3.0:1762166977.776707:0:35472:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166977.776716:0:35472:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effbaae2d lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9da0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.776730:0:35472:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbaabfd lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9cf1 expref: 22 pid: 8383 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166977.776734:0:35472:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166977.776736:0:35472:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166977.776738:0:35472:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effbaae2d lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9da0 expref: 22 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.776755:0:35472:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbaabfd lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9cf1 expref: 22 pid: 8383 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166977.776763:0:35472:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbaabfd lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9cf1 expref: 22 pid: 8383 timeout: 696 lvb_type: 1 00000100:00100000:3.0:1762166977.776771:0:35472:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc6227800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:35472:1847765449721344:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166977.776800:0:35472:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc2c72480 going to sleep for 11 seconds 00000100:00100000:3.0:1762166977.777719:0:35472:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc6227800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:35472:1847765449721344:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166977.777732:0:35472:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effbaae2d lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9da0 expref: 22 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.777742:0:35472:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8472c00, rc 0) 00000100:00100000:3.0:1762166977.777769:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+22:61766:x1847765450474880:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 1142us (1230us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166977.777773:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18986 00000100:00100000:1.0:1762166977.777946:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166977.777981:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450475008 00000100:00100000:3.0:1762166977.777986:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450475008 00010000:00010000:3.0:1762166977.778003:0:6480:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbaabfd lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9cf1 expref: 22 pid: 8383 timeout: 696 lvb_type: 1 00000100:00100000:3.0:1762166977.778028:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9587 00000100:00100000:3.0:1762166977.778035:0:6480:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff1aac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450475008:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166977.778044:0:6480:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166977.778060:0:6480:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbaabfd lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9cf1 expref: 22 pid: 8383 timeout: 696 lvb_type: 1 00010000:00010000:3.0:1762166977.778071:0:6480:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbaabfd lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9cf1 expref: 22 pid: 8383 timeout: 696 lvb_type: 1 00010000:00010000:3.0:1762166977.778086:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbaabfd lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9cf1 expref: 22 pid: 8383 timeout: 696 lvb_type: 1 00010000:00010000:3.0:1762166977.778096:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166977.778098:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166977.778101:0:6480:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effbaae2d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9da0 expref: 21 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.778106:0:6480:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effbaae2d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9da0 expref: 21 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.778122:0:6480:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effbaae2d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9da0 expref: 21 pid: 35472 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166977.778129:0:6480:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc6227800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6480:1847765449721472:192.168.204.38@tcp:105: 00000100:00100000:3.0:1762166977.778163:0:6480:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc2c72480 going to sleep for 11 seconds 00000100:00100000:3.0:1762166977.779048:0:6480:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc6227800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6480:1847765449721472:192.168.204.38@tcp:105: 00010000:00010000:3.0:1762166977.779058:0:6480:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166977.779156:0:6480:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff1aac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450475008:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1120us (1209us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166977.779165:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9587 00000100:00100000:1.0:1762166977.779191:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.779305:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166977.779337:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450475136 00000100:00100000:0.0:1762166977.779340:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450475264 00000100:00100000:3.0:1762166977.779343:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450475136 00000100:00100000:0.0:1762166977.779357:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450475264 00002000:00010000:0.0:1762166977.779408:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:0.0:1762166977.779414:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4491500 with x1847765450475264 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166977.779432:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc4491500. 00000100:00100000:0.0:1762166977.779528:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2293 00002000:00010000:3.0:1762166977.779532:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (178083->18446744073709551615) 00002000:00100000:3.0:1762166977.779539:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4492680 with x1847765450475136 ext(178083->18446744073709551615) 00000100:00100000:0.0:1762166977.779547:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4491500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450475264:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:3.0:1762166977.779552:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4492680. 00000100:00100000:3.0:1762166977.779583:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2294 00000100:00100000:3.0:1762166977.779595:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4492680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450475136:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:1.0:1762166977.779606:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.779633:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450475392 00000100:00100000:1.0:1762166977.779638:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450475392 00002000:00010000:1.0:1762166977.779658:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:1.0:1762166977.779663:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4491180 with x1847765450475392 ext(0->18446744073709551615) 00002000:00010000:1.0:1762166977.779669:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4491180. 00000100:00100000:1.0:1762166977.779690:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2295 00000100:00100000:1.0:1762166977.779700:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4491180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450475392:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:0.0:1762166977.779777:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166977.779781:0:23939:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:0.0:1762166977.779783:0:23939:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166977 -> 1762166977 00002000:00010000:0.0:1762166977.779785:0:23939:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:0.0:1762166977.779787:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00002000:00010000:1.0:1762166977.779821:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166977.779827:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:1.0:1762166977.779831:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166977 -> 1762166977 00002000:00010000:1.0:1762166977.779834:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:1.0:1762166977.779838:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:3.0:1762166977.779842:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 209056 -> 178083 00002000:00010000:3.0:1762166977.779848:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:3.0:1762166977.779855:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166977 -> 1762166977 00000100:00100000:0.0:1762166977.779855:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4491500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450475264:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 312us (661us total) trans 21474843306 rc 0/0 00002000:00010000:3.0:1762166977.779862:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:3.0:1762166977.779869:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 264 -> 264 00000100:00100000:0.0:1762166977.779885:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2293 00000100:00100000:1.0:1762166977.779894:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4491180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765450475392:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 176us (273us total) trans 17179876389 rc 0/0 00002000:00010000:0.0:1762166977.779894:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:0.0:1762166977.779904:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4491500 with x1847765450475264 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166977.779915:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc4491500. 00000100:00100000:1.0:1762166977.779923:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2295 00002000:00010000:1.0:1762166977.779931:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:1.0:1762166977.779938:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4491180 with x1847765450475392 ext(0->18446744073709551615) 00002000:00010000:1.0:1762166977.779946:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4491180. 00000100:00100000:2.0:1762166977.779958:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4492680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765450475136:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 364us (649us total) trans 17179876390 rc 0/0 00000100:00100000:2.0:1762166977.779968:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2294 00002000:00010000:2.0:1762166977.779975:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (178083->18446744073709551615) 00002000:00100000:2.0:1762166977.779978:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4492680 with x1847765450475136 ext(178083->18446744073709551615) 00002000:00010000:2.0:1762166977.779984:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4492680. 00000100:00100000:1.0:1762166977.781095:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166977.781141:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450475520 00000100:00100000:3.0:1762166977.781147:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450475520 00000100:00100000:3.0:1762166977.781193:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30473 00000100:00100000:3.0:1762166977.781202:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4490700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+557:61766:x1847765450475520:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:3.0:1762166977.781220:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166977.781236:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473000/0x2f180c4effbaae34 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9da7 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.781330:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472a00/0x2f180c4effbaae3b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166977.781344:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472a00/0x2f180c4effbaae3b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.781356:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472a00/0x2f180c4effbaae3b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:3.0:1762166977.781399:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 178083 00000004:00200000:3.0:1762166977.781404:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166977.781429:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472a00/0x2f180c4effbaae3b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.781457:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473000/0x2f180c4effbaae34 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9da7 expref: 559 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.781472:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472a00/0x2f180c4effbaae3b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9da7 expref: 558 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.781520:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166977.781522:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166977.781525:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8472a00, rc 0) 00000100:00100000:3.0:1762166977.781572:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4490700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+558:61766:x1847765450475520:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 371us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166977.781582:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30473 00000100:00100000:3.0:1762166977.784039:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.784098:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450475648 00000100:00100000:2.0:1762166977.784105:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450475648 00000100:00100000:2.0:1762166977.784153:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2296 00000100:00100000:2.0:1762166977.784159:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6227800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765450475648:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:2.0:1762166977.784567:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 178083 -> 178083 00002000:00010000:2.0:1762166977.784571:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:2.0:1762166977.784574:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166977 -> 1762166977 00002000:00010000:2.0:1762166977.784576:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:2.0:1762166977.784578:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 264 -> 328 00000100:00100000:2.0:1762166977.784636:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6227800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+24:2418:x1847765450475648:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 475us (602us total) trans 17179876391 rc 0/0 00000100:00100000:2.0:1762166977.784644:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2296 00000100:00100000:1.0:1762166977.787067:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.787118:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450475776 00000100:00100000:2.0:1762166977.787125:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450475776 00002000:00100000:2.0:1762166977.787163:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (77824->143359) req@ffff945bc4491f80 x1847765450475776/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 488/0 e 0 to 0 dl 1762166988 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166977.787173:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4491f80 with x1847765450475776 ext(77824->143359) 00002000:00010000:2.0:1762166977.787178:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4491f80 00000100:00100000:2.0:1762166977.787203:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2297 00000100:00100000:2.0:1762166977.787212:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4491f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+24:2418:x1847765450475776:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:2.0:1762166977.788592:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4491f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+24:2418:x1847765450475776:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 1367us (1518us total) trans 0 rc 65536/65536 00000100:00100000:2.0:1762166977.788601:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2297 00002000:00100000:2.0:1762166977.788611:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (77824->143359) req@ffff945bc4491f80 x1847765450475776/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 488/440 e 0 to 0 dl 1762166988 ref 1 fl Complete:/600/0 rc 65536/65536 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166977.788627:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4491f80 with x1847765450475776 ext(77824->143359) 00002000:00010000:2.0:1762166977.788631:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4491f80 00000100:00100000:2.0:1762166977.790931:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.790986:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450475904 00000100:00100000:0.0:1762166977.791000:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450475904 00002000:00100000:0.0:1762166977.791047:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (0->180223) req@ffff945bccb7fb80 x1847765450475904/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 504/0 e 0 to 0 dl 1762166988 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166977.791055:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bccb7fb80 with x1847765450475904 ext(0->180223) 00002000:00010000:0.0:1762166977.791060:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bccb7fb80 00000100:00100000:0.0:1762166977.791086:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2298 00000100:00100000:0.0:1762166977.791093:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+24:2418:x1847765450475904:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:0.0:1762166977.792686:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+24:2418:x1847765450475904:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 1586us (1754us total) trans 0 rc 114688/114688 00000100:00100000:0.0:1762166977.792699:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2298 00002000:00100000:0.0:1762166977.792710:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (0->180223) req@ffff945bccb7fb80 x1847765450475904/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 504/440 e 0 to 0 dl 1762166988 ref 1 fl Complete:/600/0 rc 114688/114688 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166977.792721:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bccb7fb80 with x1847765450475904 ext(0->180223) 00002000:00010000:0.0:1762166977.792725:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bccb7fb80 00000100:00100000:1.0:1762166977.794582:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.794643:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450476032 00000100:00100000:0.0:1762166977.794653:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450476032 00000100:00100000:0.0:1762166977.794711:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2299 00000100:00100000:0.0:1762166977.794721:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4492a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+24:2418:x1847765450476032:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:0.0:1762166977.795101:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 178083 -> 178083 00002000:00010000:0.0:1762166977.795106:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166977 -> 1762166977 00002000:00010000:0.0:1762166977.795109:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166977 -> 1762166977 00002000:00010000:0.0:1762166977.795111:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166977 -> 1762166977 00002000:00010000:0.0:1762166977.795114:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 328 -> 240 00000100:00100000:0.0:1762166977.795178:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4492a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+25:2418:x1847765450476032:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 458us (603us total) trans 17179876392 rc 0/0 00000100:00100000:0.0:1762166977.795186:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2299 00000100:00100000:2.0:1762166977.797074:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.797119:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450476160 00000100:00100000:0.0:1762166977.797126:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450476160 00002000:00100000:0.0:1762166977.797157:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (114688->167935) req@ffff945bccb7df80 x1847765450476160/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 488/0 e 0 to 0 dl 1762166988 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166977.797165:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bccb7df80 with x1847765450476160 ext(114688->167935) 00002000:00010000:0.0:1762166977.797171:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bccb7df80 00000100:00100000:0.0:1762166977.797194:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2300 00000100:00100000:0.0:1762166977.797200:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+25:2419:x1847765450476160:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:0.0:1762166977.798545:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+25:2419:x1847765450476160:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 1341us (1478us total) trans 0 rc 53248/53248 00000100:00100000:0.0:1762166977.798559:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2300 00002000:00100000:0.0:1762166977.798568:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (114688->167935) req@ffff945bccb7df80 x1847765450476160/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 488/440 e 0 to 0 dl 1762166988 ref 1 fl Complete:/600/0 rc 53248/53248 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166977.798577:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bccb7df80 with x1847765450476160 ext(114688->167935) 00002000:00010000:0.0:1762166977.798581:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bccb7df80 00000100:00100000:1.0:1762166977.800913:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.800992:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450476416 00000100:00100000:2.0:1762166977.801005:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450476416 00000100:00100000:2.0:1762166977.801082:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30474 00000100:00100000:2.0:1762166977.801094:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4491880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+558:61766:x1847765450476416:12345-192.168.204.38@tcp:36:fsx.0 00010000:00010000:2.0:1762166977.801148:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166977.801170:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472a00/0x2f180c4effbaae3b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9da7 expref: 558 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.801186:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166977.801192:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166977.801365:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbaae42 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166977.801379:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbaae42 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166977.801389:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbaae42 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000001:00080000:2.0:1762166977.801431:0:6495:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992079 00000004:00010000:2.0:1762166977.801458:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000001e1f7d3c reply state 000000005a2f1040 transno 4294992080 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbaae42 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166977.801470:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbaae42 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166977.801520:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166977.801525:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166977.801528:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166977.801625:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4491880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+560:61766:x1847765450476416:12345-192.168.204.38@tcp:36:fsx.0 Request processed in 533us (715us total) trans 4294992080 rc 0/0 00000100:00100000:2.0:1762166977.801632:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30474 00000020:00080000:2.0:1762166977.801637:0:6495:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1762166977.802834:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.802869:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.802909:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450476544 00000100:00100000:0.0:1762166977.802921:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450476544 00000100:00100000:1.0:1762166977.802923:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450476672 00000100:00100000:1.0:1762166977.802930:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450476672 00000100:00100000:2.0:1762166977.802949:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00002000:00010000:1.0:1762166977.802961:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:1.0:1762166977.802965:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4a28e00 with x1847765450476672 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166977.802966:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (71602->18446744073709551615) 00002000:00010000:1.0:1762166977.802974:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc4a28e00. 00002000:00100000:0.0:1762166977.802974:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bccb7d500 with x1847765450476544 ext(71602->18446744073709551615) 00002000:00010000:0.0:1762166977.802990:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bccb7d500. 00000100:00100000:1.0:1762166977.803002:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450476800 00000100:00100000:1.0:1762166977.803005:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450476800 00002000:00010000:1.0:1762166977.803016:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:1.0:1762166977.803020:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4a28700 with x1847765450476800 ext(0->18446744073709551615) 00002000:00010000:1.0:1762166977.803026:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4a28700. 00000100:00100000:2.0:1762166977.803037:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2301 00000100:00100000:3.0:1762166977.803048:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2302 00000100:00100000:2.0:1762166977.803052:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450476672:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:0.0:1762166977.803076:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2303 00000100:00100000:3.0:1762166977.803087:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765450476544:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:0.0:1762166977.803099:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765450476800:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:2.0:1762166977.803173:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166977.803177:0:23939:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166977 -> 1762166978 00002000:00010000:2.0:1762166977.803179:0:23939:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166977 -> 1762166977 00002000:00010000:2.0:1762166977.803181:0:23939:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166977 -> 1762166978 00002000:00010000:2.0:1762166977.803183:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00000100:00100000:2.0:1762166977.803222:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450476672:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 174us (350us total) trans 21474843307 rc 0/0 00000100:00100000:2.0:1762166977.803229:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2301 00002000:00010000:2.0:1762166977.803231:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:2.0:1762166977.803234:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4a28e00 with x1847765450476672 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166977.803240:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc4a28e00. 00002000:00010000:0.0:1762166977.803254:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166977.803259:0:23943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166977 -> 1762166978 00002000:00010000:0.0:1762166977.803262:0:23943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166977 -> 1762166977 00002000:00010000:0.0:1762166977.803266:0:23943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166977 -> 1762166978 00002000:00010000:0.0:1762166977.803268:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1762166977.803321:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+28:2419:x1847765450476800:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 225us (369us total) trans 17179876393 rc 0/0 00000100:00100000:0.0:1762166977.803331:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2303 00002000:00010000:0.0:1762166977.803336:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:0.0:1762166977.803339:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4a28700 with x1847765450476800 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166977.803346:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4a28700. 00002000:00010000:3.0:1762166977.803571:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 178083 -> 71602 00002000:00010000:3.0:1762166977.803577:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166977 -> 1762166978 00002000:00010000:3.0:1762166977.803580:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166977 -> 1762166977 00002000:00010000:3.0:1762166977.803582:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166977 -> 1762166978 00002000:00010000:3.0:1762166977.803585:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 240 -> 152 00000100:00100000:3.0:1762166977.803634:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+27:2419:x1847765450476544:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 571us (799us total) trans 17179876394 rc 0/0 00000100:00100000:3.0:1762166977.803643:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2302 00002000:00010000:3.0:1762166977.803648:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (71602->18446744073709551615) 00002000:00100000:3.0:1762166977.803651:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bccb7d500 with x1847765450476544 ext(71602->18446744073709551615) 00002000:00010000:3.0:1762166977.803659:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bccb7d500. 00000100:00100000:2.0:1762166977.805325:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.805408:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450476928 00000100:00100000:0.0:1762166977.805418:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450476928 00000100:00100000:0.0:1762166977.805473:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30475 00000100:00100000:0.0:1762166977.805515:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+560:61766:x1847765450476928:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:0.0:1762166977.805541:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166977.805562:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbaae49 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9dae expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.805657:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbaae50 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166977.805669:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbaae50 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.805677:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbaae50 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:0.0:1762166977.805698:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 71602 00000004:00200000:0.0:1762166977.805702:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166977.805717:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbaae50 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.805737:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbaae49 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9dae expref: 562 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.805749:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbaae50 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9dae expref: 561 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.805756:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166977.805758:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166977.805761:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdf200, rc 0) 00000100:00100000:0.0:1762166977.805802:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+561:61766:x1847765450476928:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 294us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166977.805807:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30475 00000100:00100000:1.0:1762166977.808187:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166977.808231:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450477056 00000100:00100000:3.0:1762166977.808237:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450477056 00000100:00100000:3.0:1762166977.808288:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2304 00000100:00100000:3.0:1762166977.808298:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4491c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+27:2419:x1847765450477056:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:3.0:1762166977.808597:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 71602 -> 71602 00002000:00010000:3.0:1762166977.808600:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:3.0:1762166977.808602:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166977 -> 1762166977 00002000:00010000:3.0:1762166977.808603:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:3.0:1762166977.808604:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 152 -> 72 00000100:00100000:3.0:1762166977.808644:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4491c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+28:2419:x1847765450477056:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 349us (461us total) trans 17179876395 rc 0/0 00000100:00100000:3.0:1762166977.808651:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2304 00000100:00100000:1.0:1762166977.809906:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.809959:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450477312 00000100:00100000:0.0:1762166977.809971:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450477312 00000100:00100000:0.0:1762166977.810037:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30476 00000100:00100000:0.0:1762166977.810047:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4493b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+561:61766:x1847765450477312:12345-192.168.204.38@tcp:36:fsx.0 00010000:00010000:0.0:1762166977.810111:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166977.810152:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbaae50 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9dae expref: 561 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.810172:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166977.810177:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166977.810366:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbaae57 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166977.810381:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbaae57 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.810390:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbaae57 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000001:00080000:0.0:1762166977.810434:0:6495:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992081 00000004:00010000:0.0:1762166977.810458:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000b80ceac2 reply state 0000000058b8ceb3 transno 4294992082 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbaae57 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.810469:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbaae57 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.810539:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166977.810544:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762166977.810548:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166977.810674:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4493b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+563:61766:x1847765450477312:12345-192.168.204.38@tcp:36:fsx.0 Request processed in 628us (768us total) trans 4294992082 rc 0/0 00000100:00100000:0.0:1762166977.810684:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30476 00000020:00080000:0.0:1762166977.810691:0:6495:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1762166977.812089:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.812122:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.812151:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.812186:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450477440 00000100:00100000:0.0:1762166977.812198:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450477440 00000100:00100000:1.0:1762166977.812214:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450477568 00000100:00100000:2.0:1762166977.812215:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450477696 00000100:00100000:2.0:1762166977.812225:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450477696 00000100:00100000:1.0:1762166977.812225:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450477568 00002000:00010000:0.0:1762166977.812243:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (93249->18446744073709551615) 00002000:00100000:0.0:1762166977.812250:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4a28380 with x1847765450477440 ext(93249->18446744073709551615) 00002000:00010000:0.0:1762166977.812264:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4a28380. 00002000:00010000:2.0:1762166977.812265:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00010000:1.0:1762166977.812265:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:2.0:1762166977.812275:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4a2aa00 with x1847765450477696 ext(0->18446744073709551615) 00002000:00100000:1.0:1762166977.812278:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4a29180 with x1847765450477568 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166977.812289:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4a2aa00. 00002000:00010000:1.0:1762166977.812289:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc4a29180. 00000100:00100000:0.0:1762166977.812316:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2305 00000100:00100000:0.0:1762166977.812337:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+29:2418:x1847765450477440:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:2.0:1762166977.812346:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2306 00000100:00100000:1.0:1762166977.812359:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2307 00000100:00100000:2.0:1762166977.812364:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+29:2419:x1847765450477696:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:1.0:1762166977.812372:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450477568:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:1.0:1762166977.812539:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166977.812541:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166977.812543:0:23939:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:1.0:1762166977.812548:0:23939:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166977 -> 1762166977 00002000:00010000:2.0:1762166977.812549:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:1.0:1762166977.812551:0:23939:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166977.812555:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166977 -> 1762166977 00002000:00010000:1.0:1762166977.812556:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00002000:00010000:2.0:1762166977.812563:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166977.812566:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1762166977.812616:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450477568:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 248us (492us total) trans 21474843308 rc 0/0 00000100:00100000:2.0:1762166977.812618:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+31:2419:x1847765450477696:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 258us (465us total) trans 17179876396 rc 0/0 00000100:00100000:1.0:1762166977.812630:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2307 00002000:00010000:0.0:1762166977.812631:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 71602 -> 93249 00002000:00010000:1.0:1762166977.812635:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00010000:0.0:1762166977.812639:0:23943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00000100:00100000:2.0:1762166977.812641:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2306 00002000:00100000:1.0:1762166977.812643:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4a29180 with x1847765450477568 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166977.812654:0:23943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166977 -> 1762166977 00002000:00010000:2.0:1762166977.812657:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00010000:1.0:1762166977.812658:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc4a29180. 00002000:00010000:0.0:1762166977.812662:0:23943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00100000:2.0:1762166977.812667:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4a2aa00 with x1847765450477696 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166977.812669:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 72 -> 72 00000020:00080000:3.0:1762166977.812672:0:32215:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 4294969063 batchid updated 00002000:00010000:2.0:1762166977.812677:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4a2aa00. 00000100:00100000:0.0:1762166977.812727:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+30:2418:x1847765450477440:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 398us (640us total) trans 17179876397 rc 0/0 00000100:00100000:0.0:1762166977.812739:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2305 00002000:00010000:0.0:1762166977.812744:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (93249->18446744073709551615) 00002000:00100000:0.0:1762166977.812748:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4a28380 with x1847765450477440 ext(93249->18446744073709551615) 00002000:00010000:0.0:1762166977.812754:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4a28380. 00000020:00080000:0.0:1762166977.812799:0:32243:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969063 00000004:00080000:0.0:1762166977.812868:0:32243:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff945cc7c0fc00 with version 16 00000020:00080000:0.0:1762166977.812901:0:32243:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 4294969063 cancel update log [0x240000405:0x2:0x0].5: rc = 0 00000020:00080000:0.0:1762166977.812966:0:32243:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 4294969063 cancel update log [0x200000bd0:0x2:0x0].8: rc = 0 00000020:00080000:0.0:1762166977.812974:0:32243:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969063 00000004:00080000:3.0:1762166977.813006:0:32229:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff945cc6399300 version 16 rpc_version 16 00000020:00100000:3.0:1762166977.813038:0:32229:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1762166977.813046:0:32229:0:(client.c:796:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff945bc6225180 x1847765449721728/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1762166977.813068:0:32229:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc6225180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:32229:1847765449721728:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1762166977.813125:0:32229:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166977.813199:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449721728 00000100:00100000:3.0:1762166977.813207:0:32229:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc2c72900 going to sleep for 11 seconds 00000100:00100000:1.0:1762166977.813208:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449721728 00000100:00100000:1.0:1762166977.813258:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1354 00000100:00100000:1.0:1762166977.813268:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6224000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:32229:x1847765449721728:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1762166977.813374:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6224000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:32229:x1847765449721728:12345-0@lo:1000:osp_up1-0.0 Request processed in 109us (249us total) trans 4294992083 rc 0/0 00000100:00100000:1.0:1762166977.813384:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1354 00000100:00100000:3.0:1762166977.813432:0:32229:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc6225180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:32229:1847765449721728:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1762166977.814074:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.814129:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450477824 00000100:00100000:0.0:1762166977.814136:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450477824 00000100:00100000:0.0:1762166977.814178:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30477 00000100:00100000:0.0:1762166977.814184:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4490a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+563:61766:x1847765450477824:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:0.0:1762166977.814200:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166977.814219:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbaae5e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9db5 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.814302:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbaae65 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166977.814318:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbaae65 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.814331:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbaae65 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:0.0:1762166977.814359:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 93249 00000004:00200000:0.0:1762166977.814364:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166977.814383:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbaae65 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.814410:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbaae5e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9db5 expref: 565 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.814425:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbaae65 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9db5 expref: 564 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.814434:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166977.814437:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166977.814441:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bde800, rc 0) 00000100:00100000:0.0:1762166977.814520:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4490a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+564:61766:x1847765450477824:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 334us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166977.814541:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30477 00000100:00100000:2.0:1762166977.816593:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.816661:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450477952 00000100:00100000:0.0:1762166977.816669:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450477952 00000100:00100000:0.0:1762166977.816739:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2308 00000100:00100000:0.0:1762166977.816750:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+30:2418:x1847765450477952:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:0.0:1762166977.816992:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 93249 -> 93249 00002000:00010000:0.0:1762166977.816997:0:23943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:0.0:1762166977.816999:0:23943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166977 -> 1762166977 00002000:00010000:0.0:1762166977.817002:0:23943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:0.0:1762166977.817004:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 72 -> 176 00000100:00100000:0.0:1762166977.817063:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+31:2418:x1847765450477952:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 315us (485us total) trans 17179876398 rc 0/0 00000100:00100000:0.0:1762166977.817071:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2308 00000100:00100000:2.0:1762166977.818869:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.818931:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450478208 00000100:00100000:0.0:1762166977.818937:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450478208 00000100:00100000:0.0:1762166977.818976:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30478 00000100:00100000:0.0:1762166977.818982:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+564:61766:x1847765450478208:12345-192.168.204.38@tcp:36:fsx.0 00010000:00010000:0.0:1762166977.819022:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166977.819042:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbaae65 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9db5 expref: 564 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.819058:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166977.819061:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166977.819182:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbaae6c lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166977.819197:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbaae6c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.819206:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbaae6c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000001:00080000:0.0:1762166977.819251:0:6495:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992084 00000004:00010000:0.0:1762166977.819268:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000cfae6173 reply state 000000008d6e56a5 transno 4294992085 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbaae6c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.819277:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbaae6c lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.819280:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166977.819282:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762166977.819284:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166977.819342:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+566:61766:x1847765450478208:12345-192.168.204.38@tcp:36:fsx.0 Request processed in 359us (478us total) trans 4294992085 rc 0/0 00000100:00100000:0.0:1762166977.819349:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30478 00000020:00080000:0.0:1762166977.819353:0:6495:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1762166977.820630:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.820656:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.820690:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.820729:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450478336 00000100:00100000:0.0:1762166977.820744:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450478336 00000100:00100000:2.0:1762166977.820759:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450478464 00000100:00100000:2.0:1762166977.820768:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450478464 00000100:00100000:3.0:1762166977.820777:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450478592 00000100:00100000:3.0:1762166977.820783:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450478592 00002000:00010000:0.0:1762166977.820787:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (83749->18446744073709551615) 00002000:00010000:2.0:1762166977.820793:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:0.0:1762166977.820795:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4532d80 with x1847765450478336 ext(83749->18446744073709551615) 00002000:00100000:2.0:1762166977.820799:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4531180 with x1847765450478464 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166977.820806:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:3.0:1762166977.820811:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4530700 with x1847765450478592 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166977.820812:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc4531180. 00002000:00010000:0.0:1762166977.820813:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4532d80. 00002000:00010000:3.0:1762166977.820822:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4530700. 00000100:00100000:2.0:1762166977.820851:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2309 00000100:00100000:2.0:1762166977.820862:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4531180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450478464:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:0.0:1762166977.820896:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2310 00000100:00100000:3.0:1762166977.820906:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2311 00000100:00100000:0.0:1762166977.820913:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4532d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+32:2418:x1847765450478336:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:3.0:1762166977.820917:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4530700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+32:2418:x1847765450478592:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:2.0:1762166977.820988:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166977.820993:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166977.820997:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166977 -> 1762166977 00002000:00010000:2.0:1762166977.821000:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166977.821003:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00002000:00010000:3.0:1762166977.821039:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166977.821046:0:23939:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00000100:00100000:2.0:1762166977.821048:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4531180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450478464:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 182us (383us total) trans 21474843309 rc 0/0 00002000:00010000:3.0:1762166977.821050:0:23939:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166977 -> 1762166977 00000100:00100000:2.0:1762166977.821063:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2309 00002000:00010000:3.0:1762166977.821070:0:23939:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166977.821074:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00010000:3.0:1762166977.821076:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00100000:2.0:1762166977.821082:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4531180 with x1847765450478464 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166977.821090:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc4531180. 00000100:00100000:3.0:1762166977.821151:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4530700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+34:2418:x1847765450478592:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 237us (460us total) trans 17179876399 rc 0/0 00000100:00100000:3.0:1762166977.821159:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2311 00002000:00010000:3.0:1762166977.821163:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00010000:0.0:1762166977.821200:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 93249 -> 83749 00002000:00010000:0.0:1762166977.821205:0:23943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00100000:3.0:1762166977.821207:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4530700 with x1847765450478592 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166977.821211:0:23943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166977 -> 1762166977 00002000:00010000:3.0:1762166977.821213:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4530700. 00002000:00010000:0.0:1762166977.821214:0:23943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:0.0:1762166977.821219:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 176 -> 112 00000100:00100000:0.0:1762166977.821260:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4532d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+33:2418:x1847765450478336:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 353us (630us total) trans 17179876400 rc 0/0 00000100:00100000:0.0:1762166977.821268:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2310 00002000:00010000:0.0:1762166977.821273:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (83749->18446744073709551615) 00002000:00100000:0.0:1762166977.821277:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4532d80 with x1847765450478336 ext(83749->18446744073709551615) 00002000:00010000:0.0:1762166977.821283:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4532d80. 00000100:00100000:1.0:1762166977.822306:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.822347:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450478720 00000100:00100000:0.0:1762166977.822354:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450478720 00000100:00100000:0.0:1762166977.822394:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30479 00000100:00100000:0.0:1762166977.822403:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4531500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+566:61766:x1847765450478720:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:0.0:1762166977.822422:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166977.822441:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbaae73 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9dbc expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.822574:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbaae7a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166977.822588:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbaae7a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.822599:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbaae7a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:0.0:1762166977.822623:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 83749 00000004:00200000:0.0:1762166977.822627:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166977.822646:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbaae7a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.822670:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbaae73 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9dbc expref: 568 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.822687:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbaae7a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9dbc expref: 567 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.822695:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166977.822698:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166977.822702:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bde600, rc 0) 00000100:00100000:0.0:1762166977.822740:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4531500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+567:61766:x1847765450478720:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 338us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166977.822747:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30479 00000100:00100000:1.0:1762166977.824710:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.824758:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450478976 00000100:00100000:0.0:1762166977.824767:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450478976 00000100:00100000:0.0:1762166977.824814:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30480 00000100:00100000:0.0:1762166977.824827:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4531c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+567:61766:x1847765450478976:12345-192.168.204.38@tcp:36:fsx.0 00010000:00010000:0.0:1762166977.824889:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166977.824912:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbaae7a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9dbc expref: 567 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.824928:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166977.824933:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166977.825093:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbaae81 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166977.825106:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbaae81 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.825126:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbaae81 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000001:00080000:0.0:1762166977.825179:0:6495:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992086 00000004:00010000:0.0:1762166977.825204:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000cd6777a2 reply state 000000001d9917be transno 4294992087 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbaae81 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.825217:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbaae81 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.825223:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166977.825226:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762166977.825229:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166977.825304:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4531c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+569:61766:x1847765450478976:12345-192.168.204.38@tcp:36:fsx.0 Request processed in 480us (598us total) trans 4294992087 rc 0/0 00000100:00100000:0.0:1762166977.825312:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30480 00000020:00080000:0.0:1762166977.825319:0:6495:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1762166977.826398:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.826431:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.826474:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450479104 00000100:00100000:0.0:1762166977.826526:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450479104 00000100:00100000:2.0:1762166977.826550:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450479232 00000100:00100000:2.0:1762166977.826558:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450479232 00002000:00010000:0.0:1762166977.826563:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (250659->18446744073709551615) 00002000:00100000:0.0:1762166977.826570:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4531880 with x1847765450479104 ext(250659->18446744073709551615) 00002000:00010000:0.0:1762166977.826583:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4531880. 00000100:00100000:1.0:1762166977.826584:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00002000:00010000:2.0:1762166977.826587:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:2.0:1762166977.826592:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4531f80 with x1847765450479232 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166977.826599:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc4531f80. 00000100:00100000:0.0:1762166977.826623:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450479360 00000100:00100000:0.0:1762166977.826631:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450479360 00000100:00100000:2.0:1762166977.826641:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2312 00002000:00010000:0.0:1762166977.826652:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00000100:00100000:2.0:1762166977.826659:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4531880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+34:2419:x1847765450479104:12345-192.168.204.38@tcp:10:fsx.0 00002000:00100000:0.0:1762166977.826662:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945ceda2fb80 with x1847765450479360 ext(0->18446744073709551615) 00000100:00100000:3.0:1762166977.826672:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2313 00002000:00010000:0.0:1762166977.826675:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945ceda2fb80. 00000100:00100000:3.0:1762166977.826692:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4531f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450479232:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:1.0:1762166977.826695:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2314 00000100:00100000:0.0:1762166977.826725:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+34:2419:x1847765450479360:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:0.0:1762166977.826842:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166977.826844:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166977.826847:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:3.0:1762166977.826850:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:0.0:1762166977.826852:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166977 -> 1762166977 00002000:00010000:3.0:1762166977.826856:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166977 -> 1762166977 00002000:00010000:0.0:1762166977.826857:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:0.0:1762166977.826863:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:3.0:1762166977.826864:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:3.0:1762166977.826868:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00002000:00010000:2.0:1762166977.826884:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 83749 -> 250659 00002000:00010000:2.0:1762166977.826890:0:23939:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166977.826893:0:23939:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166977 -> 1762166977 00002000:00010000:2.0:1762166977.826896:0:23939:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166977.826898:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 112 -> 112 00000100:00100000:0.0:1762166977.826926:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+36:2419:x1847765450479360:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 218us (343us total) trans 17179876401 rc 0/0 00000100:00100000:3.0:1762166977.826930:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4531f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765450479232:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 245us (495us total) trans 21474843310 rc 0/0 00000100:00100000:0.0:1762166977.826945:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2314 00000100:00100000:2.0:1762166977.826948:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4531880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+36:2419:x1847765450479104:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 290us (546us total) trans 17179876402 rc 0/0 00002000:00010000:0.0:1762166977.826951:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00000100:00100000:3.0:1762166977.826961:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2313 00002000:00100000:0.0:1762166977.826961:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945ceda2fb80 with x1847765450479360 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166977.826969:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00010000:0.0:1762166977.826971:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945ceda2fb80. 00002000:00100000:3.0:1762166977.826978:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4531f80 with x1847765450479232 ext(0->18446744073709551615) 00000100:00100000:2.0:1762166977.826980:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2312 00002000:00010000:2.0:1762166977.826990:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (250659->18446744073709551615) 00002000:00010000:3.0:1762166977.826991:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc4531f80. 00002000:00100000:2.0:1762166977.826997:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4531880 with x1847765450479104 ext(250659->18446744073709551615) 00002000:00010000:2.0:1762166977.827007:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4531880. 00000100:00100000:1.0:1762166977.829394:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.829450:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450479488 00000100:00100000:2.0:1762166977.829456:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450479488 00002000:00100000:2.0:1762166977.829510:0:23939:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xa77:0x0] (24576->253951) req@ffff945ceda2f480 x1847765450479488/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 488/0 e 0 to 0 dl 1762166988 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166977.829518:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945ceda2f480 with x1847765450479488 ext(24576->253951) 00002000:00010000:2.0:1762166977.829522:0:23939:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945ceda2f480 00000100:00100000:2.0:1762166977.829536:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2315 00000100:00100000:2.0:1762166977.829542:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+35:2417:x1847765450479488:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:2.0:1762166977.831123:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+35:2417:x1847765450479488:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 1575us (1726us total) trans 0 rc 229376/229376 00000100:00100000:2.0:1762166977.831134:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2315 00002000:00100000:2.0:1762166977.831142:0:23939:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xa77:0x0] (24576->253951) req@ffff945ceda2f480 x1847765450479488/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 488/440 e 0 to 0 dl 1762166988 ref 1 fl Complete:/600/0 rc 229376/229376 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166977.831152:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945ceda2f480 with x1847765450479488 ext(24576->253951) 00002000:00010000:2.0:1762166977.831156:0:23939:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945ceda2f480 00000100:00100000:1.0:1762166977.833927:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.833996:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450479616 00000100:00100000:2.0:1762166977.834005:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450479616 00002000:00100000:2.0:1762166977.834046:0:23939:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xa77:0x0] (229376->250658) req@ffff945ceda2ea00 x1847765450479616/t0(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 488/0 e 0 to 0 dl 1762166988 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166977.834062:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945ceda2ea00 with x1847765450479616 ext(229376->250658) 00002000:00010000:2.0:1762166977.834066:0:23939:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945ceda2ea00 00000100:00100000:2.0:1762166977.834098:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2316 00000100:00100000:2.0:1762166977.834107:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+35:2418:x1847765450479616:12345-192.168.204.38@tcp:4:fsx.0 00000100:00100000:2.0:1762166977.835701:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+37:2418:x1847765450479616:12345-192.168.204.38@tcp:4:fsx.0 Request processed in 1588us (1772us total) trans 17179876403 rc 0/0 00000100:00100000:2.0:1762166977.835712:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2316 00002000:00100000:2.0:1762166977.835721:0:23939:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xa77:0x0] (229376->250658) req@ffff945ceda2ea00 x1847765450479616/t17179876403(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 488/448 e 0 to 0 dl 1762166988 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166977.835730:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945ceda2ea00 with x1847765450479616 ext(229376->250658) 00002000:00010000:2.0:1762166977.835734:0:23939:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945ceda2ea00 00000100:00100000:1.0:1762166977.836796:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166977.836846:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450479744 00000100:00100000:3.0:1762166977.836853:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450479744 00000100:00100000:3.0:1762166977.836900:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18987 00000100:00100000:3.0:1762166977.836908:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+37:2417:x1847765450479744:12345-192.168.204.38@tcp:16:fsx.0 00000001:00080000:2.0:1762166977.837945:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876403 is committed 00000001:00080000:2.0:1762166977.837976:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876388 is committed 00000100:00100000:3.0:1762166977.838081:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+18:2417:x1847765450479744:12345-192.168.204.38@tcp:16:fsx.0 Request processed in 1172us (1284us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166977.838089:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18987 00000100:00100000:1.0:1762166977.839265:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.839312:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450479872 00000100:00100000:0.0:1762166977.839317:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450479872 00000100:00100000:0.0:1762166977.839347:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30481 00000100:00100000:0.0:1762166977.839352:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+569:61766:x1847765450479872:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:0.0:1762166977.839366:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166977.839381:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbaae88 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9dc3 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.839451:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbaae8f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166977.839462:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbaae8f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.839470:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbaae8f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:0.0:1762166977.839504:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 250659 00000004:00200000:0.0:1762166977.839509:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166977.839527:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbaae8f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.839552:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbaae88 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9dc3 expref: 571 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.839567:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbaae8f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9dc3 expref: 570 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.839573:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166977.839576:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166977.839578:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdf200, rc 0) 00000100:00100000:0.0:1762166977.839612:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+570:61766:x1847765450479872:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 260us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166977.839619:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30481 00000100:00100000:1.0:1762166977.841540:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.841599:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450480000 00000100:00100000:2.0:1762166977.841605:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450480000 00000100:00100000:2.0:1762166977.841648:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2317 00000100:00100000:2.0:1762166977.841656:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450480000:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:2.0:1762166977.841827:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 250659 -> 250659 00002000:00010000:2.0:1762166977.841831:0:23939:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166977.841833:0:23939:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166977 -> 1762166978 00002000:00010000:2.0:1762166977.841836:0:23939:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166977.841838:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 112 -> 176 00000100:00100000:2.0:1762166977.841888:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450480000:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 231us (350us total) trans 17179876404 rc 0/0 00000100:00100000:2.0:1762166977.841898:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2317 00000100:00100000:1.0:1762166977.844023:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.844095:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450480256 00000100:00100000:0.0:1762166977.844113:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450480256 00000100:00100000:0.0:1762166977.844207:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30482 00000100:00100000:0.0:1762166977.844220:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+570:61766:x1847765450480256:12345-192.168.204.38@tcp:36:fsx.0 00010000:00010000:0.0:1762166977.844288:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166977.844320:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbaae8f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9dc3 expref: 570 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.844344:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166977.844349:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166977.844606:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbaae96 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166977.844624:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbaae96 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.844637:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbaae96 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000001:00080000:0.0:1762166977.844685:0:6495:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992088 00000004:00010000:0.0:1762166977.844707:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000020759268 reply state 0000000011dc52c4 transno 4294992089 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbaae96 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.844720:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbaae96 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.844727:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166977.844730:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762166977.844733:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166977.844838:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+572:61766:x1847765450480256:12345-192.168.204.38@tcp:36:fsx.0 Request processed in 621us (819us total) trans 4294992089 rc 0/0 00000100:00100000:0.0:1762166977.844846:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30482 00000020:00080000:0.0:1762166977.844852:0:6495:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1762166977.846896:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.846939:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.846978:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166977.847018:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450480384 00000100:00100000:2.0:1762166977.847018:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450480512 00000100:00100000:3.0:1762166977.847033:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450480384 00000100:00100000:2.0:1762166977.847033:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450480512 00000100:00100000:0.0:1762166977.847036:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450480640 00000100:00100000:0.0:1762166977.847046:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450480640 00002000:00010000:0.0:1762166977.847089:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00010000:3.0:1762166977.847090:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (255207->18446744073709551615) 00002000:00010000:2.0:1762166977.847090:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:0.0:1762166977.847107:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945ceda2ca80 with x1847765450480640 ext(0->18446744073709551615) 00002000:00100000:3.0:1762166977.847108:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945ceda2d880 with x1847765450480384 ext(255207->18446744073709551615) 00002000:00100000:2.0:1762166977.847108:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945ceda2c000 with x1847765450480512 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166977.847130:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945ceda2c000. 00002000:00010000:3.0:1762166977.847131:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945ceda2d880. 00002000:00010000:0.0:1762166977.847139:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945ceda2ca80. 00000100:00100000:2.0:1762166977.847173:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2318 00000100:00100000:2.0:1762166977.847184:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765450480512:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:3.0:1762166977.847188:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2319 00000100:00100000:3.0:1762166977.847201:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450480384:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:0.0:1762166977.847235:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2320 00000100:00100000:0.0:1762166977.847254:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450480640:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:2.0:1762166977.847344:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166977.847349:0:23939:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166977.847353:0:23939:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166977 -> 1762166977 00002000:00010000:2.0:1762166977.847355:0:23939:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166977.847357:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00002000:00010000:0.0:1762166977.847397:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166977.847404:0:23943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:0.0:1762166977.847407:0:23943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166977 -> 1762166977 00002000:00010000:0.0:1762166977.847410:0:23943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:0.0:1762166977.847413:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:3.0:1762166977.847419:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 250659 -> 255207 00002000:00010000:3.0:1762166977.847425:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:3.0:1762166977.847434:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:3.0:1762166977.847439:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:3.0:1762166977.847444:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 176 -> 176 00000100:00100000:2.0:1762166977.847445:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765450480512:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 259us (567us total) trans 21474843311 rc 0/0 00000100:00100000:0.0:1762166977.847462:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765450480640:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 212us (479us total) trans 17179876405 rc 0/0 00000100:00100000:2.0:1762166977.847463:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2318 00000100:00100000:0.0:1762166977.847514:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2320 00002000:00010000:2.0:1762166977.847515:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00000100:00100000:3.0:1762166977.847525:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765450480384:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 322us (579us total) trans 17179876406 rc 0/0 00002000:00010000:0.0:1762166977.847526:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:2.0:1762166977.847527:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945ceda2c000 with x1847765450480512 ext(0->18446744073709551615) 00002000:00100000:0.0:1762166977.847541:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945ceda2ca80 with x1847765450480640 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166977.847544:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945ceda2c000. 00000100:00100000:3.0:1762166977.847554:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2319 00002000:00010000:0.0:1762166977.847557:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945ceda2ca80. 00002000:00010000:3.0:1762166977.847561:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (255207->18446744073709551615) 00002000:00100000:3.0:1762166977.847568:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945ceda2d880 with x1847765450480384 ext(255207->18446744073709551615) 00002000:00010000:3.0:1762166977.847577:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945ceda2d880. 00000100:00100000:1.0:1762166977.849244:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.849305:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450480768 00000100:00100000:0.0:1762166977.849314:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450480768 00000100:00100000:0.0:1762166977.849369:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30483 00000100:00100000:0.0:1762166977.849378:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+572:61766:x1847765450480768:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:0.0:1762166977.849399:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166977.849420:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbaae9d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9dca expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.849559:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbaaea4 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166977.849574:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbaaea4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.849586:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbaaea4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:0.0:1762166977.849612:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 255207 00000004:00200000:0.0:1762166977.849617:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166977.849635:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbaaea4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.849672:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbaae9d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9dca expref: 574 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.849692:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbaaea4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9dca expref: 573 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.849701:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166977.849704:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166977.849708:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdea00, rc 0) 00000100:00100000:0.0:1762166977.849762:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+573:61766:x1847765450480768:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 385us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166977.849770:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30483 00000100:00100000:1.0:1762166977.852177:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166977.852246:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450480896 00000100:00100000:3.0:1762166977.852255:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450480896 00000100:00100000:3.0:1762166977.852315:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2321 00000100:00100000:3.0:1762166977.852327:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450480896:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:3.0:1762166977.852542:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 255207 -> 255207 00002000:00010000:3.0:1762166977.852546:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:3.0:1762166977.852548:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:3.0:1762166977.852551:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:3.0:1762166977.852553:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 176 -> 208 00000100:00100000:3.0:1762166977.852622:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450480896:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 298us (448us total) trans 17179876407 rc 0/0 00000100:00100000:3.0:1762166977.852631:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2321 00000100:00100000:1.0:1762166977.855735:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.855866:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450481024 00000100:00100000:2.0:1762166977.855893:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450481024 00000100:00100000:2.0:1762166977.855984:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2322 00000100:00100000:2.0:1762166977.855996:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765450481024:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:2.0:1762166977.856317:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 255207 -> 255207 00002000:00010000:2.0:1762166977.856322:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166977.856325:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166977.856327:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166977.856329:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 208 -> 224 00000100:00100000:2.0:1762166977.856403:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765450481024:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 410us (679us total) trans 17179876408 rc 0/0 00000100:00100000:2.0:1762166977.856411:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2322 00000100:00100000:1.0:1762166977.858949:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.858988:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450481152 00000100:00100000:2.0:1762166977.858995:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450481152 00000100:00100000:2.0:1762166977.859043:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2323 00000100:00100000:2.0:1762166977.859054:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765450481152:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:2.0:1762166977.859246:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 255207 -> 255207 00002000:00010000:2.0:1762166977.859251:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166977.859253:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166977.859255:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166977.859257:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 224 -> 248 00000100:00100000:2.0:1762166977.859304:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765450481152:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 253us (363us total) trans 17179876409 rc 0/0 00000100:00100000:2.0:1762166977.859311:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2323 00000100:00100000:1.0:1762166977.861766:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.861811:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450481280 00000100:00100000:2.0:1762166977.861820:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450481280 00002000:00100000:2.0:1762166977.861855:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (0->4095) req@ffff945bc7d22a00 x1847765450481280/t0(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 4584/0 e 0 to 0 dl 1762166988 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166977.861863:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc7d22a00 with x1847765450481280 ext(0->4095) 00002000:00010000:2.0:1762166977.861868:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc7d22a00 00000100:00100000:2.0:1762166977.861903:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2324 00000100:00100000:2.0:1762166977.861913:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+24:2418:x1847765450481280:12345-192.168.204.38@tcp:4:fsx.0 00000100:00100000:2.0:1762166977.862357:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+26:2418:x1847765450481280:12345-192.168.204.38@tcp:4:fsx.0 Request processed in 444us (597us total) trans 17179876410 rc 0/0 00000100:00100000:2.0:1762166977.862364:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2324 00002000:00100000:2.0:1762166977.862371:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (0->4095) req@ffff945bc7d22a00 x1847765450481280/t17179876410(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 4584/448 e 0 to 0 dl 1762166988 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166977.862379:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc7d22a00 with x1847765450481280 ext(0->4095) 00002000:00010000:2.0:1762166977.862383:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc7d22a00 00000100:00100000:1.0:1762166977.863556:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166977.863606:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450481408 00000100:00100000:3.0:1762166977.863613:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450481408 00000100:00100000:3.0:1762166977.863646:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18988 00000100:00100000:3.0:1762166977.863655:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+26:2418:x1847765450481408:12345-192.168.204.38@tcp:16:fsx.0 00000001:00080000:2.0:1762166977.864628:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876410 is committed 00000100:00100000:3.0:1762166977.864771:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450481408:12345-192.168.204.38@tcp:16:fsx.0 Request processed in 1113us (1215us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166977.864780:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18988 00000100:00100000:1.0:1762166977.866786:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.866834:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450481536 00000100:00100000:2.0:1762166977.866845:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450481536 00000100:00100000:2.0:1762166977.866926:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2325 00000100:00100000:2.0:1762166977.866936:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+18:2416:x1847765450481536:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:2.0:1762166977.867200:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 255207 -> 255207 00002000:00010000:2.0:1762166977.867205:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166977.867207:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166977.867210:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166977.867212:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 248 -> 248 00000100:00100000:2.0:1762166977.867283:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+19:2416:x1847765450481536:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 350us (500us total) trans 17179876411 rc 0/0 00000100:00100000:2.0:1762166977.867290:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2325 00000100:00100000:1.0:1762166977.869183:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.869241:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450481792 00000100:00100000:0.0:1762166977.869250:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450481792 00000100:00100000:0.0:1762166977.869298:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30484 00000100:00100000:0.0:1762166977.869309:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+573:61766:x1847765450481792:12345-192.168.204.38@tcp:36:fsx.0 00010000:00010000:0.0:1762166977.869361:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166977.869386:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbaaea4 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9dca expref: 573 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.869400:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166977.869403:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166977.869605:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbaaeab lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166977.869621:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbaaeab lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.869630:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbaaeab lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000001:00080000:0.0:1762166977.869669:0:6495:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992090 00000004:00010000:0.0:1762166977.869686:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000015601b5f reply state 00000000d63fb5dd transno 4294992091 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbaaeab lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.869693:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbaaeab lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.869697:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166977.869699:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762166977.869701:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166977.869769:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+575:61766:x1847765450481792:12345-192.168.204.38@tcp:36:fsx.0 Request processed in 464us (592us total) trans 4294992091 rc 0/0 00000100:00100000:0.0:1762166977.869774:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30484 00000020:00080000:0.0:1762166977.869778:0:6495:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1762166977.871045:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.871080:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.871105:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.871240:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450481920 00000100:00100000:3.0:1762166977.871241:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450482048 00000100:00100000:3.0:1762166977.871246:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450482048 00000100:00100000:0.0:1762166977.871251:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450481920 00002000:00010000:3.0:1762166977.871270:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00010000:0.0:1762166977.871271:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (22892->18446744073709551615) 00000100:00100000:2.0:1762166977.871272:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450482176 00002000:00100000:3.0:1762166977.871275:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc7d20380 with x1847765450482048 ext(0->18446744073709551615) 00002000:00100000:0.0:1762166977.871279:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc7d21c00 with x1847765450481920 ext(22892->18446744073709551615) 00000100:00100000:2.0:1762166977.871280:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450482176 00002000:00010000:3.0:1762166977.871285:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc7d20380. 00002000:00010000:0.0:1762166977.871289:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc7d21c00. 00000100:00100000:3.0:1762166977.871309:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2326 00002000:00010000:2.0:1762166977.871309:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:2.0:1762166977.871315:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc7d20000 with x1847765450482176 ext(0->18446744073709551615) 00000100:00100000:0.0:1762166977.871323:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2327 00002000:00010000:2.0:1762166977.871325:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc7d20000. 00000100:00100000:3.0:1762166977.871331:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765450482048:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:0.0:1762166977.871338:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450481920:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:1.0:1762166977.871343:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2328 00000100:00100000:1.0:1762166977.871360:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450482176:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:3.0:1762166977.871466:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166977.871467:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166977.871473:0:23939:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:1.0:1762166977.871474:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:3.0:1762166977.871505:0:23939:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166977 -> 1762166977 00002000:00010000:1.0:1762166977.871509:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166977 -> 1762166977 00002000:00010000:3.0:1762166977.871510:0:23939:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:1.0:1762166977.871515:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:3.0:1762166977.871517:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00002000:00010000:1.0:1762166977.871522:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166977.871569:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+24:2418:x1847765450482048:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 244us (486us total) trans 21474843312 rc 0/0 00000100:00100000:1.0:1762166977.871570:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450482176:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 215us (462us total) trans 17179876412 rc 0/0 00000100:00100000:3.0:1762166977.871581:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2326 00002000:00010000:3.0:1762166977.871585:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:3.0:1762166977.871588:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc7d20380 with x1847765450482048 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166977.871594:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc7d20380. 00000100:00100000:1.0:1762166977.871603:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2328 00002000:00010000:1.0:1762166977.871608:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:1.0:1762166977.871612:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc7d20000 with x1847765450482176 ext(0->18446744073709551615) 00002000:00010000:1.0:1762166977.871618:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc7d20000. 00002000:00010000:0.0:1762166977.871759:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 255207 -> 22892 00002000:00010000:0.0:1762166977.871764:0:23943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:0.0:1762166977.871766:0:23943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:0.0:1762166977.871768:0:23943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:0.0:1762166977.871770:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 248 -> 56 00000100:00100000:0.0:1762166977.871802:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450481920:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 472us (760us total) trans 17179876413 rc 0/0 00000100:00100000:0.0:1762166977.871808:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2327 00002000:00010000:0.0:1762166977.871810:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (22892->18446744073709551615) 00002000:00100000:0.0:1762166977.871812:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc7d21c00 with x1847765450481920 ext(22892->18446744073709551615) 00002000:00010000:0.0:1762166977.871816:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc7d21c00. 00000100:00100000:1.0:1762166977.873358:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.873400:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450482304 00000100:00100000:0.0:1762166977.873406:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450482304 00000100:00100000:0.0:1762166977.873445:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30485 00000100:00100000:0.0:1762166977.873454:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+575:61766:x1847765450482304:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:0.0:1762166977.873470:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166977.873506:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbaaeb2 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9dd1 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.873584:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbaaeb9 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166977.873597:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbaaeb9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.873607:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbaaeb9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:0.0:1762166977.873636:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 22892 00000004:00200000:0.0:1762166977.873640:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166977.873655:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbaaeb9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.873676:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbaaeb2 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9dd1 expref: 577 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.873691:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbaaeb9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9dd1 expref: 576 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.873700:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166977.873703:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166977.873706:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdf600, rc 0) 00000100:00100000:0.0:1762166977.873748:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+576:61766:x1847765450482304:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 295us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166977.873755:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30485 00000100:00100000:1.0:1762166977.876906:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.877023:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450482432 00000100:00100000:0.0:1762166977.877040:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450482432 00000100:00100000:0.0:1762166977.877135:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2329 00000100:00100000:0.0:1762166977.877150:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+21:2417:x1847765450482432:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:0.0:1762166977.877358:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 22892 -> 22892 00002000:00010000:0.0:1762166977.877363:0:23943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:0.0:1762166977.877366:0:23943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:0.0:1762166977.877368:0:23943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:0.0:1762166977.877370:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 56 -> 56 00000100:00100000:0.0:1762166977.877456:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+22:2417:x1847765450482432:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 310us (556us total) trans 17179876414 rc 0/0 00000100:00100000:0.0:1762166977.877466:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2329 00000100:00100000:2.0:1762166977.879839:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.879905:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450482560 00000100:00100000:0.0:1762166977.879915:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450482560 00002000:00100000:0.0:1762166977.879958:0:23943:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000400:0xa77:0x0] (16384->24575) req@ffff945bc4a2b800 x1847765450482560/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 488/0 e 0 to 0 dl 1762166988 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166977.879971:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4a2b800 with x1847765450482560 ext(16384->24575) 00002000:00010000:0.0:1762166977.879978:0:23943:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4a2b800 00000100:00100000:0.0:1762166977.880013:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2330 00000100:00100000:0.0:1762166977.880022:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+22:2416:x1847765450482560:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:0.0:1762166977.880251:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+22:2416:x1847765450482560:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 230us (420us total) trans 0 rc 8192/8192 00000100:00100000:0.0:1762166977.880259:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2330 00002000:00100000:0.0:1762166977.880267:0:23943:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000400:0xa77:0x0] (16384->24575) req@ffff945bc4a2b800 x1847765450482560/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 488/8632 e 0 to 0 dl 1762166988 ref 1 fl Complete:/600/0 rc 8192/8192 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166977.880275:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4a2b800 with x1847765450482560 ext(16384->24575) 00002000:00010000:0.0:1762166977.880278:0:23943:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4a2b800 00000100:00100000:1.0:1762166977.882733:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.882837:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450482688 00000100:00100000:0.0:1762166977.882847:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450482688 00000100:00100000:0.0:1762166977.882925:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2331 00000100:00100000:0.0:1762166977.882936:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450482688:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:0.0:1762166977.883316:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 22892 -> 22892 00002000:00010000:0.0:1762166977.883321:0:23943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:0.0:1762166977.883323:0:23943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:0.0:1762166977.883325:0:23943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:0.0:1762166977.883327:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 56 -> 48 00000100:00100000:0.0:1762166977.883394:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765450482688:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 459us (666us total) trans 17179876415 rc 0/0 00000100:00100000:0.0:1762166977.883401:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2331 00000100:00100000:1.0:1762166977.885340:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.885383:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450482816 00000100:00100000:0.0:1762166977.885390:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450482816 00000100:00100000:0.0:1762166977.885434:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2332 00000100:00100000:0.0:1762166977.885443:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765450482816:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:0.0:1762166977.885636:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 22892 -> 22892 00002000:00010000:0.0:1762166977.885640:0:23943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:0.0:1762166977.885642:0:23943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:0.0:1762166977.885644:0:23943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:0.0:1762166977.885647:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 48 -> 24 00000100:00100000:0.0:1762166977.885691:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+24:2418:x1847765450482816:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 248us (354us total) trans 17179876416 rc 0/0 00000100:00100000:0.0:1762166977.885698:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2332 00000100:00100000:2.0:1762166977.887345:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.887394:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450482944 00000100:00100000:0.0:1762166977.887400:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450482944 00000100:00100000:0.0:1762166977.887444:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2333 00000100:00100000:0.0:1762166977.887452:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765450482944:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:0.0:1762166977.887628:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 22892 -> 22892 00002000:00010000:0.0:1762166977.887631:0:23943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:0.0:1762166977.887634:0:23943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:0.0:1762166977.887636:0:23943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:0.0:1762166977.887638:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 24 -> 24 00000100:00100000:0.0:1762166977.887680:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+25:2419:x1847765450482944:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 229us (339us total) trans 17179876417 rc 0/0 00000100:00100000:0.0:1762166977.887685:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2333 00000100:00100000:1.0:1762166977.889784:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.889834:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450483072 00000100:00100000:0.0:1762166977.889844:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450483072 00002000:00100000:0.0:1762166977.889904:0:23943:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000400:0xa77:0x0] (16384->20479) req@ffff945bc7d22300 x1847765450483072/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 488/0 e 0 to 0 dl 1762166988 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166977.889915:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc7d22300 with x1847765450483072 ext(16384->20479) 00002000:00010000:0.0:1762166977.889923:0:23943:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc7d22300 00000100:00100000:0.0:1762166977.889954:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2334 00000100:00100000:0.0:1762166977.889963:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+25:2418:x1847765450483072:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:0.0:1762166977.890195:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+25:2418:x1847765450483072:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 231us (420us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1762166977.890204:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2334 00002000:00100000:0.0:1762166977.890214:0:23943:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000400:0xa77:0x0] (16384->20479) req@ffff945bc7d22300 x1847765450483072/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 488/4536 e 0 to 0 dl 1762166988 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166977.890222:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc7d22300 with x1847765450483072 ext(16384->20479) 00002000:00010000:0.0:1762166977.890227:0:23943:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc7d22300 00000100:00100000:1.0:1762166977.891827:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.891883:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450483200 00000100:00100000:0.0:1762166977.891890:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450483200 00002000:00100000:0.0:1762166977.891922:0:23943:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000400:0xa77:0x0] (20480->24575) req@ffff945bc7d23480 x1847765450483200/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 488/0 e 0 to 0 dl 1762166988 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166977.891946:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc7d23480 with x1847765450483200 ext(20480->24575) 00002000:00010000:0.0:1762166977.891951:0:23943:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc7d23480 00000100:00100000:0.0:1762166977.891983:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2335 00000100:00100000:0.0:1762166977.891992:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+25:2419:x1847765450483200:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:0.0:1762166977.892119:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+25:2419:x1847765450483200:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 129us (298us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1762166977.892129:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2335 00002000:00100000:0.0:1762166977.892136:0:23943:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000400:0xa77:0x0] (20480->24575) req@ffff945bc7d23480 x1847765450483200/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 488/4536 e 0 to 0 dl 1762166988 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166977.892145:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc7d23480 with x1847765450483200 ext(20480->24575) 00002000:00010000:0.0:1762166977.892150:0:23943:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc7d23480 00000100:00100000:2.0:1762166977.894938:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.895049:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450483328 00000100:00100000:0.0:1762166977.895063:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450483328 00002000:00100000:0.0:1762166977.895117:0:23943:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000400:0xa77:0x0] (0->16383) req@ffff945bc4a2ad80 x1847765450483328/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 488/0 e 0 to 0 dl 1762166988 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166977.895128:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4a2ad80 with x1847765450483328 ext(0->16383) 00002000:00010000:0.0:1762166977.895133:0:23943:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4a2ad80 00000100:00100000:0.0:1762166977.895169:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2336 00000100:00100000:0.0:1762166977.895179:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+25:2418:x1847765450483328:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:0.0:1762166977.895435:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+25:2418:x1847765450483328:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 257us (505us total) trans 0 rc 16384/16384 00000100:00100000:0.0:1762166977.895444:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2336 00002000:00100000:0.0:1762166977.895451:0:23943:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000400:0xa77:0x0] (0->16383) req@ffff945bc4a2ad80 x1847765450483328/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 488/16824 e 0 to 0 dl 1762166988 ref 1 fl Complete:/600/0 rc 16384/16384 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166977.895459:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4a2ad80 with x1847765450483328 ext(0->16383) 00002000:00010000:0.0:1762166977.895464:0:23943:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4a2ad80 00000100:00100000:1.0:1762166977.897275:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.897341:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450483584 00000100:00100000:0.0:1762166977.897349:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450483584 00000100:00100000:0.0:1762166977.897400:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30486 00000100:00100000:0.0:1762166977.897408:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+576:61766:x1847765450483584:12345-192.168.204.38@tcp:36:fsx.0 00010000:00010000:0.0:1762166977.897496:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166977.897531:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbaaeb9 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9dd1 expref: 576 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.897557:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166977.897563:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166977.897766:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbaaec0 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166977.897784:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbaaec0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.897795:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbaaec0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000001:00080000:0.0:1762166977.897840:0:6495:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992092 00000004:00010000:0.0:1762166977.897861:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000b265a38a reply state 0000000057521867 transno 4294992093 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbaaec0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.897890:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbaaec0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.897897:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166977.897900:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762166977.897903:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166977.897985:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+578:61766:x1847765450483584:12345-192.168.204.38@tcp:36:fsx.0 Request processed in 576us (714us total) trans 4294992093 rc 0/0 00000100:00100000:0.0:1762166977.897994:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30486 00000020:00080000:0.0:1762166977.898000:0:6495:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1762166977.899044:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.899072:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.899108:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450483712 00000100:00100000:1.0:1762166977.899115:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.899115:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450483712 00002000:00010000:0.0:1762166977.899145:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (185102->18446744073709551615) 00002000:00100000:0.0:1762166977.899150:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf783a300 with x1847765450483712 ext(185102->18446744073709551615) 00000100:00100000:2.0:1762166977.899152:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450483840 00000100:00100000:2.0:1762166977.899161:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450483840 00002000:00010000:0.0:1762166977.899162:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf783a300. 00002000:00010000:2.0:1762166977.899186:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00000100:00100000:0.0:1762166977.899190:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450483968 00002000:00100000:2.0:1762166977.899191:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf7838000 with x1847765450483840 ext(0->18446744073709551615) 00000100:00100000:0.0:1762166977.899194:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450483968 00000100:00100000:3.0:1762166977.899199:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2337 00002000:00010000:2.0:1762166977.899203:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945cf7838000. 00002000:00010000:0.0:1762166977.899209:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:0.0:1762166977.899214:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf7839c00 with x1847765450483968 ext(0->18446744073709551615) 00000100:00100000:3.0:1762166977.899216:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+26:2417:x1847765450483712:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:0.0:1762166977.899221:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf7839c00. 00000100:00100000:2.0:1762166977.899229:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2338 00000100:00100000:2.0:1762166977.899241:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf7838000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+24:2416:x1847765450483840:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:1.0:1762166977.899248:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2339 00000100:00100000:1.0:1762166977.899267:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf7839c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+26:2416:x1847765450483968:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:2.0:1762166977.899369:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166977.899369:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166977.899376:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166977.899377:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:1.0:1762166977.899381:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166977 -> 1762166977 00002000:00010000:2.0:1762166977.899383:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166977 -> 1762166977 00002000:00010000:1.0:1762166977.899385:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166977.899388:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:1.0:1762166977.899391:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:2.0:1762166977.899392:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00002000:00010000:3.0:1762166977.899440:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 22892 -> 185102 00002000:00010000:3.0:1762166977.899446:0:23939:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00000100:00100000:2.0:1762166977.899447:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf7838000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+25:2416:x1847765450483840:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 207us (370us total) trans 21474843313 rc 0/0 00000100:00100000:1.0:1762166977.899447:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf7839c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+28:2416:x1847765450483968:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 187us (330us total) trans 17179876418 rc 0/0 00002000:00010000:3.0:1762166977.899451:0:23939:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:3.0:1762166977.899457:0:23939:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:3.0:1762166977.899463:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 24 -> 24 00000100:00100000:1.0:1762166977.899467:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2339 00002000:00010000:1.0:1762166977.899472:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:1.0:1762166977.899502:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf7839c00 with x1847765450483968 ext(0->18446744073709551615) 00002000:00010000:1.0:1762166977.899507:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf7839c00. 00000100:00100000:2.0:1762166977.899508:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2338 00002000:00010000:2.0:1762166977.899515:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:2.0:1762166977.899519:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf7838000 with x1847765450483840 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166977.899526:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945cf7838000. 00000100:00100000:3.0:1762166977.899532:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+27:2417:x1847765450483712:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 320us (486us total) trans 17179876419 rc 0/0 00000100:00100000:3.0:1762166977.899544:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2337 00002000:00010000:3.0:1762166977.899548:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (185102->18446744073709551615) 00002000:00100000:3.0:1762166977.899552:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf783a300 with x1847765450483712 ext(185102->18446744073709551615) 00002000:00010000:3.0:1762166977.899558:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf783a300. 00000100:00100000:2.0:1762166977.900452:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.900507:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450484096 00000100:00100000:0.0:1762166977.900512:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450484096 00000100:00100000:0.0:1762166977.900539:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30487 00000100:00100000:0.0:1762166977.900545:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+578:61766:x1847765450484096:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:0.0:1762166977.900561:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166977.900578:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbaaec7 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9dd8 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.900661:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbaaece lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166977.900672:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbaaece lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.900680:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbaaece lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:0.0:1762166977.900707:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 185102 00000004:00200000:0.0:1762166977.900712:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166977.900729:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbaaece lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.900755:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbaaec7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9dd8 expref: 580 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.900772:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbaaece lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9dd8 expref: 579 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.900780:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166977.900783:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166977.900787:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdf800, rc 0) 00000100:00100000:0.0:1762166977.900825:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+579:61766:x1847765450484096:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 279us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166977.900832:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30487 00000100:00100000:0.0:1762166977.902297:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166977.902355:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450484224 00000100:00100000:3.0:1762166977.902361:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450484224 00000100:00100000:3.0:1762166977.902407:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2340 00000100:00100000:3.0:1762166977.902417:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+27:2418:x1847765450484224:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:3.0:1762166977.902646:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 185102 -> 262144 00002000:00010000:3.0:1762166977.902649:0:23939:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:3.0:1762166977.902651:0:23939:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:3.0:1762166977.902652:0:23939:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:3.0:1762166977.902654:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 24 -> 112 00000100:00100000:3.0:1762166977.902687:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+28:2418:x1847765450484224:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 273us (394us total) trans 17179876420 rc 0/0 00000100:00100000:3.0:1762166977.902692:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2340 00000100:00100000:1.0:1762166977.905170:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166977.905211:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450484352 00000100:00100000:3.0:1762166977.905218:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450484352 00002000:00100000:3.0:1762166977.905255:0:23939:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xa77:0x0] (24576->262143) req@ffff945cf7838e00 x1847765450484352/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 488/0 e 0 to 0 dl 1762166988 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166977.905267:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf7838e00 with x1847765450484352 ext(24576->262143) 00002000:00010000:3.0:1762166977.905274:0:23939:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf7838e00 00000100:00100000:3.0:1762166977.905302:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2341 00000100:00100000:3.0:1762166977.905311:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf7838e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+28:2418:x1847765450484352:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:3.0:1762166977.907086:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf7838e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+28:2418:x1847765450484352:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 1773us (1920us total) trans 0 rc 237568/237568 00000100:00100000:3.0:1762166977.907094:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2341 00002000:00100000:3.0:1762166977.907103:0:23939:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xa77:0x0] (24576->262143) req@ffff945cf7838e00 x1847765450484352/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 488/440 e 0 to 0 dl 1762166988 ref 1 fl Complete:/600/0 rc 237568/237568 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166977.907109:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf7838e00 with x1847765450484352 ext(24576->262143) 00002000:00010000:3.0:1762166977.907113:0:23939:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf7838e00 00000100:00100000:0.0:1762166977.908902:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166977.908957:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450484480 00000100:00100000:3.0:1762166977.908966:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450484480 00000100:00100000:3.0:1762166977.909015:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2342 00000100:00100000:3.0:1762166977.909022:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+28:2419:x1847765450484480:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:3.0:1762166977.909449:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:3.0:1762166977.909452:0:23939:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:3.0:1762166977.909454:0:23939:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:3.0:1762166977.909456:0:23939:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:3.0:1762166977.909458:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 112 -> 96 00000100:00100000:3.0:1762166977.909531:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+29:2419:x1847765450484480:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 508us (635us total) trans 17179876421 rc 0/0 00000100:00100000:3.0:1762166977.909539:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2342 00000100:00100000:1.0:1762166977.911021:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.911073:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450484736 00000100:00100000:0.0:1762166977.911079:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450484736 00000100:00100000:0.0:1762166977.911118:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30488 00000100:00100000:0.0:1762166977.911127:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf7838a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+579:61766:x1847765450484736:12345-192.168.204.38@tcp:36:fsx.0 00010000:00010000:0.0:1762166977.911189:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166977.911220:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbaaece lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9dd8 expref: 579 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.911238:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166977.911243:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166977.911415:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbaaed5 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166977.911436:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbaaed5 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.911447:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbaaed5 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000001:00080000:0.0:1762166977.911543:0:6495:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992094 00000004:00010000:0.0:1762166977.911568:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000004c868433 reply state 000000005849baf9 transno 4294992095 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbaaed5 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.911588:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbaaed5 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.911594:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166977.911597:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762166977.911599:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166977.911675:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf7838a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+581:61766:x1847765450484736:12345-192.168.204.38@tcp:36:fsx.0 Request processed in 548us (656us total) trans 4294992095 rc 0/0 00000100:00100000:0.0:1762166977.911683:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30488 00000020:00080000:0.0:1762166977.911688:0:6495:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1762166977.912673:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.912699:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166977.912712:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450484864 00000100:00100000:3.0:1762166977.912720:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450484864 00000100:00100000:2.0:1762166977.912744:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00002000:00010000:3.0:1762166977.912751:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (140069->18446744073709551615) 00002000:00100000:3.0:1762166977.912758:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4a2a300 with x1847765450484864 ext(140069->18446744073709551615) 00000100:00100000:1.0:1762166977.912764:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450484992 00002000:00010000:3.0:1762166977.912768:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4a2a300. 00000100:00100000:1.0:1762166977.912771:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450484992 00002000:00010000:1.0:1762166977.912795:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00000100:00100000:0.0:1762166977.912799:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450485120 00002000:00100000:1.0:1762166977.912800:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4a29f80 with x1847765450484992 ext(0->18446744073709551615) 00000100:00100000:0.0:1762166977.912806:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450485120 00002000:00010000:1.0:1762166977.912811:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc4a29f80. 00000100:00100000:2.0:1762166977.912818:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2343 00002000:00010000:0.0:1762166977.912823:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:0.0:1762166977.912828:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4a29c00 with x1847765450485120 ext(0->18446744073709551615) 00000100:00100000:2.0:1762166977.912830:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+30:2418:x1847765450484864:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:0.0:1762166977.912835:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4a29c00. 00000100:00100000:3.0:1762166977.912845:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2344 00000100:00100000:1.0:1762166977.912854:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2345 00000100:00100000:3.0:1762166977.912860:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+25:2419:x1847765450484992:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:1.0:1762166977.912879:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+30:2418:x1847765450485120:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:1.0:1762166977.912990:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166977.912991:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166977.912997:0:23939:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:1.0:1762166977.912997:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:3.0:1762166977.913005:0:23939:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166977 -> 1762166977 00002000:00010000:1.0:1762166977.913005:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166977 -> 1762166977 00002000:00010000:3.0:1762166977.913013:0:23939:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:1.0:1762166977.913013:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:3.0:1762166977.913020:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00002000:00010000:1.0:1762166977.913021:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166977.913066:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765450484992:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 212us (364us total) trans 21474843314 rc 0/0 00000100:00100000:1.0:1762166977.913074:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+32:2418:x1847765450485120:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 207us (326us total) trans 17179876422 rc 0/0 00000100:00100000:3.0:1762166977.913081:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2344 00002000:00010000:3.0:1762166977.913088:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:3.0:1762166977.913093:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4a29f80 with x1847765450484992 ext(0->18446744073709551615) 00000100:00100000:1.0:1762166977.913094:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2345 00002000:00010000:3.0:1762166977.913100:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc4a29f80. 00002000:00010000:1.0:1762166977.913101:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:1.0:1762166977.913107:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4a29c00 with x1847765450485120 ext(0->18446744073709551615) 00002000:00010000:1.0:1762166977.913113:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4a29c00. 00002000:00010000:2.0:1762166977.913124:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 262144 -> 140069 00002000:00010000:2.0:1762166977.913129:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166977.913132:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166977.913135:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166977.913138:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 96 -> 8 00000100:00100000:2.0:1762166977.913170:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+31:2418:x1847765450484864:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 344us (497us total) trans 17179876423 rc 0/0 00000100:00100000:2.0:1762166977.913177:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2343 00002000:00010000:2.0:1762166977.913180:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (140069->18446744073709551615) 00002000:00100000:2.0:1762166977.913183:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4a2a300 with x1847765450484864 ext(140069->18446744073709551615) 00002000:00010000:2.0:1762166977.913187:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4a2a300. 00000100:00100000:2.0:1762166977.914298:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.914339:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450485248 00000100:00100000:0.0:1762166977.914345:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450485248 00000100:00100000:0.0:1762166977.914382:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30489 00000100:00100000:0.0:1762166977.914391:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+581:61766:x1847765450485248:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:0.0:1762166977.914415:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166977.914434:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbaaedc lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9ddf expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.914548:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbaaee3 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 15 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166977.914560:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbaaee3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.914573:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbaaee3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:0.0:1762166977.914595:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 140069 00000004:00200000:0.0:1762166977.914600:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166977.914615:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbaaee3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.914638:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbaaedc lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ddf expref: 583 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.914652:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbaaee3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ddf expref: 582 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.914661:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166977.914664:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166977.914667:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdf000, rc 0) 00000100:00100000:0.0:1762166977.914708:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+582:61766:x1847765450485248:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 318us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166977.914715:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30489 00000100:00100000:1.0:1762166977.916691:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.916759:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450485376 00000100:00100000:2.0:1762166977.916768:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450485376 00000100:00100000:2.0:1762166977.916823:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2346 00000100:00100000:2.0:1762166977.916830:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+31:2418:x1847765450485376:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:2.0:1762166977.917063:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 140069 -> 140069 00002000:00010000:2.0:1762166977.917066:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166977.917068:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166977.917069:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166977.917071:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 8 -> 88 00000100:00100000:2.0:1762166977.917117:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+32:2418:x1847765450485376:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 288us (435us total) trans 17179876424 rc 0/0 00000100:00100000:2.0:1762166977.917126:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2346 00000100:00100000:1.0:1762166977.920046:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.920095:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450485504 00000100:00100000:2.0:1762166977.920102:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450485504 00002000:00100000:2.0:1762166977.920132:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (192512->259345) req@ffff945cf783a680 x1847765450485504/t0(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 504/0 e 0 to 0 dl 1762166988 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166977.920143:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf783a680 with x1847765450485504 ext(192512->259345) 00002000:00010000:2.0:1762166977.920148:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf783a680 00000100:00100000:2.0:1762166977.920176:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2347 00000100:00100000:2.0:1762166977.920185:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+32:2419:x1847765450485504:12345-192.168.204.38@tcp:4:fsx.0 00000100:00100000:2.0:1762166977.921778:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+34:2419:x1847765450485504:12345-192.168.204.38@tcp:4:fsx.0 Request processed in 1589us (1730us total) trans 17179876425 rc 0/0 00000100:00100000:2.0:1762166977.921788:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2347 00002000:00100000:2.0:1762166977.921796:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (192512->259345) req@ffff945cf783a680 x1847765450485504/t17179876425(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 504/448 e 0 to 0 dl 1762166988 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166977.921805:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf783a680 with x1847765450485504 ext(192512->259345) 00002000:00010000:2.0:1762166977.921810:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf783a680 00000100:00100000:1.0:1762166977.922818:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.922858:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450485632 00000100:00100000:2.0:1762166977.922863:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450485632 00000100:00100000:2.0:1762166977.922912:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2348 00000100:00100000:2.0:1762166977.922918:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf7838700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+34:2419:x1847765450485632:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:2.0:1762166977.923197:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 140069 -> 259346 00002000:00010000:2.0:1762166977.923202:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166977.923204:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166977.923207:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166977.923209:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 88 -> 136 00000100:00100000:2.0:1762166977.923246:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf7838700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+35:2419:x1847765450485632:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 327us (429us total) trans 17179876426 rc 0/0 00000100:00100000:2.0:1762166977.923298:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2348 00000100:00100000:1.0:1762166977.925822:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.925858:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450485760 00000100:00100000:2.0:1762166977.925864:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450485760 00002000:00100000:2.0:1762166977.925900:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (0->253951) req@ffff945cf7839180 x1847765450485760/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 536/0 e 0 to 0 dl 1762166988 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166977.925910:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf7839180 with x1847765450485760 ext(0->253951) 00002000:00010000:2.0:1762166977.925914:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf7839180 00000100:00100000:2.0:1762166977.925932:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2349 00000100:00100000:2.0:1762166977.925940:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf7839180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+35:2418:x1847765450485760:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:2.0:1762166977.927176:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf7839180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+35:2418:x1847765450485760:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 1236us (1356us total) trans 0 rc 180224/180224 00000100:00100000:2.0:1762166977.927184:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2349 00002000:00100000:2.0:1762166977.927190:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (0->253951) req@ffff945cf7839180 x1847765450485760/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 536/440 e 0 to 0 dl 1762166988 ref 1 fl Complete:/600/0 rc 180224/180224 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166977.927196:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf7839180 with x1847765450485760 ext(0->253951) 00002000:00010000:2.0:1762166977.927199:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf7839180 00000100:00100000:1.0:1762166977.928940:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.928978:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450485888 00000100:00100000:2.0:1762166977.928984:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450485888 00000100:00100000:2.0:1762166977.929026:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2350 00000100:00100000:2.0:1762166977.929035:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+35:2419:x1847765450485888:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:2.0:1762166977.929177:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 259346 -> 259346 00002000:00010000:2.0:1762166977.929181:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166977.929184:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166977.929187:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166977.929189:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 136 -> 240 00000100:00100000:2.0:1762166977.929231:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+36:2419:x1847765450485888:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 197us (291us total) trans 17179876427 rc 0/0 00000100:00100000:2.0:1762166977.929239:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2350 00000100:00100000:1.0:1762166977.932828:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.932897:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450486016 00000100:00100000:2.0:1762166977.932905:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450486016 00000100:00100000:2.0:1762166977.932971:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2351 00000100:00100000:2.0:1762166977.932982:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+36:2418:x1847765450486016:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:2.0:1762166977.933195:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 259346 -> 259346 00002000:00010000:2.0:1762166977.933198:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166977.933201:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166977.933203:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166977.933205:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 240 -> 224 00000100:00100000:2.0:1762166977.933258:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+37:2418:x1847765450486016:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 277us (433us total) trans 17179876428 rc 0/0 00000100:00100000:2.0:1762166977.933266:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2351 00000100:00100000:1.0:1762166977.934630:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.934669:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450486144 00000100:00100000:2.0:1762166977.934674:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450486144 00000100:00100000:2.0:1762166977.934709:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2352 00000100:00100000:2.0:1762166977.934719:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf7839f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+37:2419:x1847765450486144:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:2.0:1762166977.934992:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 259346 -> 259346 00002000:00010000:2.0:1762166977.934996:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166977.934999:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166977.935001:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166977.935003:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 224 -> 320 00000100:00100000:2.0:1762166977.935039:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf7839f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+38:2419:x1847765450486144:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 322us (409us total) trans 17179876429 rc 0/0 00000100:00100000:2.0:1762166977.935046:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2352 00000100:00100000:1.0:1762166977.936703:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.936739:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450486272 00000100:00100000:2.0:1762166977.936745:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450486272 00000100:00100000:2.0:1762166977.936783:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2353 00000100:00100000:2.0:1762166977.936792:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+38:2416:x1847765450486272:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:2.0:1762166977.936933:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 259346 -> 259346 00002000:00010000:2.0:1762166977.936936:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166977.936939:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166977.936941:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166977.936943:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 320 -> 328 00000100:00100000:2.0:1762166977.936983:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+39:2416:x1847765450486272:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 193us (282us total) trans 17179876430 rc 0/0 00000100:00100000:2.0:1762166977.936991:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2353 00000100:00100000:1.0:1762166977.938700:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.938735:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450486400 00000100:00100000:2.0:1762166977.938740:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450486400 00000100:00100000:2.0:1762166977.938769:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2354 00000100:00100000:2.0:1762166977.938775:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5804380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+39:2418:x1847765450486400:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:2.0:1762166977.938887:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 259346 -> 259346 00002000:00010000:2.0:1762166977.938893:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166977.938894:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166977.938896:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166977.938897:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 328 -> 328 00000100:00100000:2.0:1762166977.938927:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5804380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+40:2418:x1847765450486400:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 153us (231us total) trans 17179876431 rc 0/0 00000100:00100000:2.0:1762166977.938932:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2354 00000100:00100000:1.0:1762166977.940390:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.940524:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450486528 00000100:00100000:2.0:1762166977.940529:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450486528 00000100:00100000:2.0:1762166977.940562:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2355 00000100:00100000:2.0:1762166977.940571:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5805880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+40:2419:x1847765450486528:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:2.0:1762166977.940711:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 259346 -> 259346 00002000:00010000:2.0:1762166977.940715:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166977.940717:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166977.940719:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166977.940721:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 328 -> 328 00000100:00100000:2.0:1762166977.940753:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5805880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+41:2419:x1847765450486528:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 184us (364us total) trans 17179876432 rc 0/0 00000100:00100000:2.0:1762166977.940760:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2355 00000100:00100000:1.0:1762166977.942543:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.942579:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450486656 00000100:00100000:2.0:1762166977.942584:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450486656 00002000:00100000:2.0:1762166977.942610:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (0->217087) req@ffff945bc5806d80 x1847765450486656/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 536/0 e 0 to 0 dl 1762166988 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166977.942620:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5806d80 with x1847765450486656 ext(0->217087) 00002000:00010000:2.0:1762166977.942626:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5806d80 00000100:00100000:2.0:1762166977.942648:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2356 00000100:00100000:2.0:1762166977.942656:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5806d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+41:2419:x1847765450486656:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:2.0:1762166977.943958:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5806d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+41:2419:x1847765450486656:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 1302us (1415us total) trans 0 rc 122880/122880 00000100:00100000:2.0:1762166977.943966:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2356 00002000:00100000:2.0:1762166977.943975:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (0->217087) req@ffff945bc5806d80 x1847765450486656/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 536/440 e 0 to 0 dl 1762166988 ref 1 fl Complete:/600/0 rc 122880/122880 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166977.943983:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5806d80 with x1847765450486656 ext(0->217087) 00002000:00010000:2.0:1762166977.943987:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5806d80 00000100:00100000:1.0:1762166977.946288:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.946339:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450486784 00000100:00100000:2.0:1762166977.946347:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450486784 00000100:00100000:2.0:1762166977.946399:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2357 00000100:00100000:2.0:1762166977.946409:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5805f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+41:2418:x1847765450486784:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:2.0:1762166977.946656:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 259346 -> 259346 00002000:00010000:2.0:1762166977.946660:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166977.946662:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166977.946665:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166977.946667:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 328 -> 296 00000100:00100000:2.0:1762166977.946711:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5805f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+42:2418:x1847765450486784:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 303us (434us total) trans 17179876433 rc 0/0 00000100:00100000:2.0:1762166977.946719:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2357 00000100:00100000:1.0:1762166977.950646:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.950687:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450486912 00000100:00100000:2.0:1762166977.950695:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450486912 00002000:00100000:2.0:1762166977.950741:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (192512->253951) req@ffff945bc5804700 x1847765450486912/t0(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 488/0 e 0 to 0 dl 1762166988 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166977.950751:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5804700 with x1847765450486912 ext(192512->253951) 00002000:00010000:2.0:1762166977.950756:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5804700 00000100:00100000:2.0:1762166977.950783:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2358 00000100:00100000:2.0:1762166977.950793:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5804700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+42:2418:x1847765450486912:12345-192.168.204.38@tcp:4:fsx.0 00000100:00100000:2.0:1762166977.952593:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5804700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+44:2418:x1847765450486912:12345-192.168.204.38@tcp:4:fsx.0 Request processed in 1799us (1948us total) trans 17179876434 rc 0/0 00000100:00100000:2.0:1762166977.952604:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2358 00002000:00100000:2.0:1762166977.952613:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (192512->253951) req@ffff945bc5804700 x1847765450486912/t17179876434(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 488/448 e 0 to 0 dl 1762166988 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166977.952622:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5804700 with x1847765450486912 ext(192512->253951) 00002000:00010000:2.0:1762166977.952625:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5804700 00000100:00100000:1.0:1762166977.953610:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166977.953701:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450487040 00000100:00100000:3.0:1762166977.953707:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450487040 00000100:00100000:3.0:1762166977.953749:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18989 00000100:00100000:3.0:1762166977.953757:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5805c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+44:2418:x1847765450487040:12345-192.168.204.38@tcp:16:fsx.0 00000001:00080000:2.0:1762166977.954827:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876434 is committed 00000100:00100000:3.0:1762166977.954975:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5805c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450487040:12345-192.168.204.38@tcp:16:fsx.0 Request processed in 1214us (1361us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166977.954983:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18989 00000100:00100000:1.0:1762166977.956906:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.956977:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450487168 00000100:00100000:2.0:1762166977.956989:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450487168 00000100:00100000:2.0:1762166977.957059:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2359 00000100:00100000:2.0:1762166977.957072:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5806300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450487168:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:2.0:1762166977.957411:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 259346 -> 259346 00002000:00010000:2.0:1762166977.957416:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166977.957419:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166977.957421:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166977.957424:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 296 -> 464 00000100:00100000:2.0:1762166977.957513:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5806300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450487168:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 441us (605us total) trans 17179876435 rc 0/0 00000100:00100000:2.0:1762166977.957525:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2359 00000100:00100000:1.0:1762166977.960931:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.960983:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450487296 00000100:00100000:2.0:1762166977.960991:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450487296 00000100:00100000:2.0:1762166977.961043:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2360 00000100:00100000:2.0:1762166977.961050:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5805180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450487296:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:2.0:1762166977.961247:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 259346 -> 259346 00002000:00010000:2.0:1762166977.961250:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166977.961252:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166977.961254:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166977.961256:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 464 -> 352 00000100:00100000:2.0:1762166977.961298:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5805180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450487296:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 249us (374us total) trans 17179876436 rc 0/0 00000100:00100000:2.0:1762166977.961304:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2360 00000100:00100000:1.0:1762166977.963749:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.963784:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450487424 00000100:00100000:2.0:1762166977.963789:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450487424 00002000:00100000:2.0:1762166977.963817:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (77824->155647) req@ffff945bc5807800 x1847765450487424/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 488/0 e 0 to 0 dl 1762166988 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166977.963824:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5807800 with x1847765450487424 ext(77824->155647) 00002000:00010000:2.0:1762166977.963829:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5807800 00000100:00100000:2.0:1762166977.963847:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2361 00000100:00100000:2.0:1762166977.963853:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5807800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450487424:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:2.0:1762166977.964994:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5807800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450487424:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 1138us (1246us total) trans 0 rc 77824/77824 00000100:00100000:2.0:1762166977.965006:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2361 00002000:00100000:2.0:1762166977.965016:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (77824->155647) req@ffff945bc5807800 x1847765450487424/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:8/0 lens 488/440 e 0 to 0 dl 1762166988 ref 1 fl Complete:/600/0 rc 77824/77824 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166977.965025:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5807800 with x1847765450487424 ext(77824->155647) 00002000:00010000:2.0:1762166977.965029:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5807800 00000100:00100000:1.0:1762166977.966693:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.966744:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450487680 00000100:00100000:2.0:1762166977.966754:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450487680 00000100:00100000:2.0:1762166977.966810:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11853 00000100:00100000:2.0:1762166977.966819:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5807100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+582:61766:x1847765450487680:12345-192.168.204.38@tcp:35:fsx.0 00000100:00100000:2.0:1762166977.967091:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5807100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+583:61766:x1847765450487680:12345-192.168.204.38@tcp:35:fsx.0 Request processed in 272us (404us total) trans 4294992096 rc 0/0 00000100:00100000:2.0:1762166977.967101:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11853 00000100:00100000:1.0:1762166977.975942:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.976073:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450487936 00000100:00100000:0.0:1762166977.976087:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450487936 00000100:00100000:0.0:1762166977.976157:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30490 00000100:00100000:0.0:1762166977.976171:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5806680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+583:61852:x1847765450487936:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166977.976203:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166977.976233:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbaaeea lrc: 2/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9de6 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.976338:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbaaef1 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166977.976355:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbaaef1 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.976369:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbaaef1 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.976383:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbaaef8 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166977.976390:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbaaef8 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.976397:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbaaef8 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.976559:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbaaeff lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 15 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166977.976570:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbaaeff lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.976577:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbaaeff lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:0.0:1762166977.976589:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 259346 00010000:00010000:0.0:1762166977.976672:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbaaef1 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.976678:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbaaef1 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.976686:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbaaef1 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.976690:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbaaef1 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.976694:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdf800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166977.976697:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbaaef1 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.976703:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbaaef1 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.976712:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0x0 (ffff945bc2e87100) 00010000:00010000:0.0:1762166977.976714:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166977.976718:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbaaef1 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.976721:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbaaef1 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.976731:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbaaef8 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.976735:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbaaef8 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.976738:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbaaef8 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.976741:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdec00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166977.976742:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbaaef8 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.976749:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbaaef8 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.976753:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0xdd396665 (ffff945bc2e87400) 00010000:00010000:0.0:1762166977.976754:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166977.976755:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbaaef8 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.976758:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbaaef8 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.976798:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbaaeea lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9de6 expref: 586 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.976812:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbaaeff lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9de6 expref: 585 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.976819:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166977.976821:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166977.976822:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdfe00, rc 0) 00000100:00100000:0.0:1762166977.976895:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5806680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+585:61852:x1847765450487936:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 725us (969us total) trans 4294992097 rc 0/0 00000100:00100000:0.0:1762166977.976903:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30490 00000100:00100000:1.0:1762166977.978071:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166977.978130:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450488064 00000100:00100000:3.0:1762166977.978138:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450488064 00000100:00100000:3.0:1762166977.978192:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 874 00000100:00100000:3.0:1762166977.978200:0:6480:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5804a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+585:2418:x1847765450488064:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166977.978228:0:6480:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166977.978250:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbaaeff lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 16 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9de6 expref: 585 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.978266:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166977.978270:0:6480:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166977.978415:0:6480:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5804a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+584:2418:x1847765450488064:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 205us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166977.978427:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 874 00000100:00100000:1.0:1762166977.978543:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.978644:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450488320 00000100:00100000:0.0:1762166977.978649:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450488320 00000100:00100000:0.0:1762166977.978681:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30491 00000100:00100000:0.0:1762166977.978689:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5807480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+584:61852:x1847765450488320:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166977.978708:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166977.978725:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbaaf0d lrc: 2/0,0 mode: --/CW res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9ded expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.979176:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbaaf14 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x60d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166977.979187:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbaaf14 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x60d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166977.979194:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbaaf14 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x60d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:0.0:1762166977.979203:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x60d:0x0]: returning size 0 00010000:00010000:0.0:1762166977.979235:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbaaf0d lrc: 0/0,0 mode: --/CW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ded expref: 587 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.979251:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbaaf14 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x60d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ded expref: 586 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.979258:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x60d:0x0].0x0 (ffff945bc2e87c00) 00010000:00010000:0.0:1762166977.979261:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166977.979263:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdea00, rc 0) 00000100:00100000:0.0:1762166977.979303:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5807480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+586:61852:x1847765450488320:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 611us (760us total) trans 4294992098 rc 0/0 00000100:00100000:0.0:1762166977.979310:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30491 00000100:00100000:0.0:1762166977.980702:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.980756:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450488576 00000100:00100000:2.0:1762166977.980762:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450488576 00000100:00100000:2.0:1762166977.980797:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30492 00000100:00100000:2.0:1762166977.980803:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+586:61852:x1847765450488576:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166977.980817:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166977.980827:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbaaf22 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x60d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9df4 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.980899:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbaaf29 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x60d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166977.980908:0:6495:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbaaf14 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x60d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ded expref: 587 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.980914:0:6495:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbaaf29 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x60d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166977.980952:0:6495:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbaaf14 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x60d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ded expref: 587 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.980962:0:6495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbaaf14 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x60d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ded expref: 587 pid: 6495 timeout: 697 lvb_type: 0 00000100:00100000:2.0:1762166977.980973:0:6495:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a2b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6495:1847765449721856:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166977.981053:0:6495:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc56bff00 going to sleep for 11 seconds 00000100:00100000:1.0:1762166977.982179:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.982221:0:6495:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a2b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6495:1847765449721856:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166977.982247:0:6495:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbaaf29 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x60d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000100:00100000:3.0:1762166977.982393:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450488704 00000100:00100000:3.0:1762166977.982403:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450488704 00010000:00010000:3.0:1762166977.982439:0:6480:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbaaf14 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x60d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ded expref: 588 pid: 6495 timeout: 697 lvb_type: 0 00000100:00100000:3.0:1762166977.982475:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9588 00000100:00100000:3.0:1762166977.982597:0:6480:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5804000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+588:2419:x1847765450488704:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166977.982612:0:6480:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166977.982619:0:6480:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbaaf14 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x60d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ded expref: 588 pid: 6495 timeout: 697 lvb_type: 0 00010000:00010000:3.0:1762166977.982633:0:6480:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbaaf14 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x60d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ded expref: 588 pid: 6495 timeout: 697 lvb_type: 0 00010000:00010000:3.0:1762166977.982654:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbaaf14 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x60d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ded expref: 588 pid: 6495 timeout: 697 lvb_type: 0 00010000:00010000:3.0:1762166977.982669:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x60d:0x0].0x0 (ffff945bc2e87c00) 00010000:00010000:3.0:1762166977.982674:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbaaf29 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x60d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.982683:0:6480:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbaaf29 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x60d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.982691:0:6480:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbaaf29 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x60d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166977.982718:0:6480:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166977.982755:0:6495:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbaaf29 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x60d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166977.982766:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbaaf29 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x60d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000100:00100000:3.0:1762166977.982777:0:6480:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5804000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+587:2419:x1847765450488704:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 247us (602us total) trans 0 rc 0/0 00000004:00200000:2.0:1762166977.982789:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x60d:0x0]: returning size 0 00000100:00100000:3.0:1762166977.982790:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9588 00000004:00080000:2.0:1762166977.982999:0:6495:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xa8a:0x0], index 0: 0 00000004:00080000:2.0:1762166977.983007:0:6495:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xa89:0x0], index 1: 0 00010000:00010000:2.0:1762166977.983114:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbaaf29 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x60d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166977.983123:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbaaf29 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x60d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166977.983130:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbaaf29 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x60d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166977.983136:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa8e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166977.983141:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbaaf29 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x60d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166977.983149:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbaaf29 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x60d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166977.983162:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x60d:0x0].0x0 (ffff945bc2e87c00) 00010000:00010000:2.0:1762166977.983165:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166977.983169:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbaaf29 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x60d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166977.983178:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbaaf29 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x60d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166977.983222:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbaaf22 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x60d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9df4 expref: 587 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.983231:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x60d:0x0].0x0 (ffff945bc2e87c00) 00010000:00010000:2.0:1762166977.983234:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1762166977.983238:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbaaf22 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x60d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9df4 expref: 587 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.983253:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa8000, rc 0) 00000100:00100000:2.0:1762166977.983304:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+586:61852:x1847765450488576:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2500us (2606us total) trans 4294992099 rc 301/301 00000100:00100000:2.0:1762166977.983313:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30492 00000100:00100000:1.0:1762166977.984534:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.984583:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450488960 00000100:00100000:2.0:1762166977.984592:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450488960 00000100:00100000:2.0:1762166977.984637:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11854 00000100:00100000:2.0:1762166977.984646:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5806a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+586:61852:x1847765450488960:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:2.0:1762166977.984839:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5806a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+587:61852:x1847765450488960:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 193us (361us total) trans 4294992100 rc 0/0 00000100:00100000:2.0:1762166977.984847:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11854 00000100:00100000:1.0:1762166977.986439:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.986597:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450489088 00000100:00100000:2.0:1762166977.986606:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450489088 00000100:00100000:2.0:1762166977.986654:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30493 00000100:00100000:2.0:1762166977.986664:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5805500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+587:61852:x1847765450489088:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166977.986691:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166977.986711:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbaaf37 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x60d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9dfb expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.986779:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbaaf3e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x60d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166977.986790:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbaaf3e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x60d:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166977.986799:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbaaf3e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x60d:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:2.0:1762166977.986837:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x60d:0x0]: returning size 0 00000004:00200000:2.0:1762166977.986841:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166977.986856:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbaaf3e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x60d:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166977.986894:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbaaf37 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x60d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9dfb expref: 589 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.986913:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbaaf3e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x60d:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9dfb expref: 588 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.986921:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x60d:0x0].0x0 (ffff945bc809b500) 00010000:00010000:2.0:1762166977.986924:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1762166977.986928:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa8200, rc 0) 00000100:00100000:2.0:1762166977.986974:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5805500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+588:61852:x1847765450489088:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 312us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166977.986979:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30493 00000100:00100000:0.0:1762166977.988136:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.988178:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166977.988208:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450489216 00000100:00100000:3.0:1762166977.988217:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450489216 00000100:00100000:3.0:1762166977.988264:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450489344 00000100:00100000:3.0:1762166977.988269:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450489344 00000100:00100000:1.0:1762166977.988284:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18990 00000100:00100000:0.0:1762166977.988299:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18991 00000100:00100000:1.0:1762166977.988305:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+26:2416:x1847765450489216:12345-192.168.204.38@tcp:101:lfs.0 00000100:00100000:0.0:1762166977.988315:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+20:2416:x1847765450489344:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166977.988336:0:8380:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166977.988339:0:8383:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166977.988356:0:8380:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbaaf45 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa89:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9e09 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.988363:0:8383:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cc355aa00/0x2f180c4effbaaf4c lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa8a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9e02 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762166977.988385:0:8383:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa8a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:0.0:1762166977.988385:0:8380:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa89:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1762166977.988413:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166977.988414:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166977.988417:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166977.988418:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166977.988431:0:8383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cc355aa00/0x2f180c4effbaaf4c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e02 expref: 27 pid: 8383 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166977.988431:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbaaf45 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e09 expref: 21 pid: 8380 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166977.988466:0:8380:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbaaf45 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e09 expref: 21 pid: 8380 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166977.988468:0:8383:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945cc355aa00/0x2f180c4effbaaf4c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e02 expref: 27 pid: 8383 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166977.988510:0:8380:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdee00, rc 0) 00010000:00010000:1.0:1762166977.988512:0:8383:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355aa00, rc 0) 00000100:00100000:0.0:1762166977.988574:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+21:2416:x1847765450489344:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 263us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166977.988575:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+27:2416:x1847765450489216:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 276us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166977.988594:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18991 00000100:00100000:1.0:1762166977.988602:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18990 00000100:00100000:1.0:1762166977.989859:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.989911:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450489600 00000100:00100000:2.0:1762166977.989919:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450489600 00000100:00100000:2.0:1762166977.989960:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30494 00000100:00100000:2.0:1762166977.989970:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5807b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+588:61852:x1847765450489600:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166977.989987:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166977.990002:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbaaf53 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 15 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9e10 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.990093:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbaaf5a lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166977.990106:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbaaf5a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 16 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166977.990116:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbaaf5a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 16 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:2.0:1762166977.990127:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 259346 00010000:00010000:2.0:1762166977.990230:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbaaf53 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 16 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e10 expref: 591 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.990246:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbaaf5a lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 15 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e10 expref: 590 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.990254:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166977.990257:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166977.990260:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa9000, rc 0) 00000100:00100000:2.0:1762166977.990309:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5807b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+590:61852:x1847765450489600:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 341us (453us total) trans 4294992101 rc 0/0 00000100:00100000:2.0:1762166977.990316:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30494 00000100:00100000:2.0:1762166977.992092:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.992127:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.992157:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450489728 00000100:00100000:1.0:1762166977.992164:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450489728 00000100:00100000:2.0:1762166977.992169:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.992190:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450489856 00000100:00100000:0.0:1762166977.992195:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450489856 00000100:00100000:1.0:1762166977.992212:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450489984 00000100:00100000:1.0:1762166977.992215:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450489984 00000100:00100000:3.0:1762166977.992220:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18992 00000100:00100000:0.0:1762166977.992230:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18993 00000100:00100000:3.0:1762166977.992237:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450489728:12345-192.168.204.38@tcp:1:lfs.0 00000100:00100000:2.0:1762166977.992245:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18994 00000100:00100000:0.0:1762166977.992246:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+27:2418:x1847765450489856:12345-192.168.204.38@tcp:1:lfs.0 00000100:00100000:2.0:1762166977.992258:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765450489984:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:0.0:1762166977.992274:0:8380:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf800/0x2f180c4effbaaf68 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.992275:0:9165:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effbaaf6f lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.992281:0:35472:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbaaf76 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.992308:0:8380:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8c00/0x2f180c4effbaae26 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d99 expref: 27 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.992309:0:35472:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effbaae2d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9da0 expref: 22 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.992311:0:9165:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc8472800/0x2f180c4effbaae1f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d92 expref: 22 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.992333:0:35472:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166977.992336:0:35472:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166977.992341:0:35472:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbaaf76 lrc: 4/1,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.992346:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166977.992349:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166977.992352:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166977.992354:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166977.992358:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf800/0x2f180c4effbaaf68 lrc: 4/1,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.992360:0:9165:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effbaaf6f lrc: 4/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.992382:0:35472:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effbaae2d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9da0 expref: 22 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.992397:0:35472:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effbaae2d lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9da0 expref: 22 pid: 35472 timeout: 697 lvb_type: 0 00010000:00010000:3.0:1762166977.992402:0:9165:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc8472800/0x2f180c4effbaae1f lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d92 expref: 22 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.992406:0:8380:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8c00/0x2f180c4effbaae26 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d99 expref: 27 pid: 35472 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166977.992421:0:35472:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55ddc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:35472:1847765449721984:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166977.992431:0:9165:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc8472800/0x2f180c4effbaae1f lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d92 expref: 22 pid: 35472 timeout: 697 lvb_type: 0 00010000:00010000:0.0:1762166977.992433:0:8380:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8c00/0x2f180c4effbaae26 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d99 expref: 27 pid: 35472 timeout: 697 lvb_type: 0 00000100:00100000:3.0:1762166977.992458:0:9165:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc6224a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9165:1847765449722112:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166977.992462:0:8380:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc48a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8380:1847765449722240:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166977.992518:0:35472:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d0116cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1762166977.992529:0:8380:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7c0f240 going to sleep for 11 seconds 00000100:00100000:3.0:1762166977.992535:0:9165:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc2c72900 going to sleep for 11 seconds 00000100:00100000:2.0:1762166977.993897:0:35472:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55ddc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:35472:1847765449721984:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166977.993922:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:2.0:1762166977.993928:0:35472:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbaaf76 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166977.993945:0:8380:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc48a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8380:1847765449722240:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166977.993960:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:1.0:1762166977.993968:0:8380:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf800/0x2f180c4effbaaf68 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166977.993981:0:9165:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc6224a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9165:1847765449722112:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166977.993989:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450490112 00000100:00100000:0.0:1762166977.993993:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450490240 00000100:00100000:2.0:1762166977.993996:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450490112 00010000:00010000:3.0:1762166977.994000:0:9165:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effbaaf6f lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166977.994000:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450490240 00010000:00010000:0.0:1762166977.994030:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8c00/0x2f180c4effbaae26 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d99 expref: 28 pid: 35472 timeout: 697 lvb_type: 0 00010000:00010000:2.0:1762166977.994032:0:6480:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effbaae2d lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9da0 expref: 23 pid: 35472 timeout: 697 lvb_type: 0 00000100:00100000:0.0:1762166977.994076:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9589 00000100:00100000:0.0:1762166977.994086:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+28:2419:x1847765450490240:12345-192.168.204.38@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1762166977.994097:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9590 00010000:00010000:0.0:1762166977.994100:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1762166977.994109:0:6480:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+23:2416:x1847765450490112:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166977.994118:0:6480:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166977.994123:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8c00/0x2f180c4effbaae26 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d99 expref: 28 pid: 35472 timeout: 697 lvb_type: 0 00010000:00010000:2.0:1762166977.994132:0:6480:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effbaae2d lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9da0 expref: 23 pid: 35472 timeout: 697 lvb_type: 0 00010000:00010000:2.0:1762166977.994159:0:6480:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effbaae2d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9da0 expref: 23 pid: 35472 timeout: 697 lvb_type: 0 00010000:00010000:0.0:1762166977.994161:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8c00/0x2f180c4effbaae26 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d99 expref: 28 pid: 35472 timeout: 697 lvb_type: 0 00010000:00010000:2.0:1762166977.994195:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effbaae2d lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9da0 expref: 23 pid: 35472 timeout: 697 lvb_type: 0 00010000:00010000:0.0:1762166977.994196:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8c00/0x2f180c4effbaae26 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d99 expref: 28 pid: 35472 timeout: 697 lvb_type: 0 00010000:00010000:0.0:1762166977.994220:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166977.994221:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166977.994224:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166977.994225:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166977.994229:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf800/0x2f180c4effbaaf68 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.994231:0:6480:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbaaf76 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.994248:0:6479:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf800/0x2f180c4effbaaf68 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.994252:0:6480:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbaaf76 lrc: 4/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166977.994253:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:0.0:1762166977.994282:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166977.994288:0:6480:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166977.994303:0:8380:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf800/0x2f180c4effbaaf68 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166977.994306:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450490368 00000100:00100000:3.0:1762166977.994313:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450490368 00010000:00010000:1.0:1762166977.994325:0:8380:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf800/0x2f180c4effbaaf68 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.994333:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472800/0x2f180c4effbaae1f lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d92 expref: 23 pid: 35472 timeout: 697 lvb_type: 0 00000100:00100000:2.0:1762166977.994340:0:6480:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+23:2416:x1847765450490112:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 232us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166977.994340:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+27:2419:x1847765450490240:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 251us (378us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166977.994347:0:8380:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf800/0x2f180c4effbaaf68 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166977.994362:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9589 00010000:00010000:1.0:1762166977.994364:0:8380:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf800/0x2f180c4effbaaf68 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166977.994372:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9590 00010000:00010000:1.0:1762166977.994378:0:8380:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf800/0x2f180c4effbaaf68 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166977.994384:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9591 00010000:00010000:1.0:1762166977.994392:0:8380:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdf800 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166977.994398:0:8380:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf800/0x2f180c4effbaaf68 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166977.994402:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450490368:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166977.994409:0:35472:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbaaf76 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.994416:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166977.994416:0:8380:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf800/0x2f180c4effbaaf68 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.994421:0:35472:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbaaf76 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.994433:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc8472800/0x2f180c4effbaae1f lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d92 expref: 22 pid: 35472 timeout: 697 lvb_type: 0 00010000:00010000:1.0:1762166977.994437:0:8380:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf800/0x2f180c4effbaaf68 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.994444:0:35472:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbaaf76 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.994454:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc8472800/0x2f180c4effbaae1f lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d92 expref: 22 pid: 35472 timeout: 697 lvb_type: 0 00010000:00010000:2.0:1762166977.994466:0:35472:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbaaf76 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.994503:0:35472:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbaaf76 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.994504:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf800/0x2f180c4effbaaf68 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.994514:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8472800/0x2f180c4effbaae1f lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d92 expref: 22 pid: 35472 timeout: 697 lvb_type: 0 00010000:00010000:2.0:1762166977.994528:0:35472:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa8600 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166977.994533:0:35472:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbaaf76 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.994541:0:35472:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbaaf76 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.994554:0:35472:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbaaf76 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166977.994566:0:35472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbaaf76 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166977.994576:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+26:2418:x1847765450489856:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 2332us (2445us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166977.994578:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166977.994584:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1762166977.994589:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18993 00010000:00010000:3.0:1762166977.994591:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effbaaf6f lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.994601:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effbaaf6f lrc: 4/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166977.994628:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166977.994630:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450489984:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 2374us (2460us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166977.994638:0:9165:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effbaaf6f lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166977.994639:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18994 00010000:00010000:1.0:1762166977.994650:0:9165:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effbaaf6f lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166977.994658:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450490368:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 260us (407us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166977.994666:0:9165:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effbaaf6f lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166977.994670:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9591 00010000:00010000:1.0:1762166977.994680:0:9165:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effbaaf6f lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.994687:0:9165:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effbaaf6f lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.994693:0:9165:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8473000 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166977.994697:0:9165:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effbaaf6f lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.994702:0:9165:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effbaaf6f lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.994714:0:9165:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effbaaf6f lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.994720:0:9165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effbaaf6f lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166977.994772:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450489728:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 2542us (2683us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166977.994779:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18992 00000100:00100000:0.0:1762166977.996226:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166977.996293:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450490496 00000100:00100000:1.0:1762166977.996303:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450490496 00000100:00100000:0.0:1762166977.996309:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166977.996382:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450490624 00000100:00100000:2.0:1762166977.996390:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450490624 00000100:00100000:1.0:1762166977.996392:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18995 00000100:00100000:1.0:1762166977.996414:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+19:2416:x1847765450490496:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166977.996436:0:9165:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1762166977.996452:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18996 00010000:00010000:1.0:1762166977.996462:0:9165:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cc355b800/0x2f180c4effbaaf7d lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9e17 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166977.996463:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166977.996512:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450490752 00000100:00100000:0.0:1762166977.996518:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450490752 00002000:00010000:1.0:1762166977.996524:0:9165:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa77:0x0] initial LVB size: 259346, mtime: 0x690888c2, atime: 0x690888c2, ctime: 0x690888c2, blocks: 0x160 00000100:00100000:2.0:1762166977.996546:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+26:2416:x1847765450490624:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166977.996546:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166977.996551:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1762166977.996565:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18997 00010000:00010000:1.0:1762166977.996566:0:9165:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355b800/0x2f180c4effbaaf7d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e17 expref: 21 pid: 9165 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166977.996569:0:35472:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1762166977.996578:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6224a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+21:2416:x1847765450490752:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166977.996587:0:8380:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166977.996588:0:9165:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945cc355b800/0x2f180c4effbaaf7d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e17 expref: 21 pid: 9165 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166977.996591:0:35472:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8800/0x2f180c4effbaaf84 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9e1e expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166977.996601:0:8380:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbaaf8b lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9e25 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166977.996640:0:9165:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355b800, rc 0) 00002000:00010000:0.0:1762166977.996647:0:8380:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa79:0x0] initial LVB size: 0, mtime: 0x690888c2, atime: 0x690888c1, ctime: 0x690888c2, blocks: 0x0 00002000:00010000:2.0:1762166977.996653:0:35472:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa7a:0x0] initial LVB size: 0, mtime: 0x690888c2, atime: 0x690888c1, ctime: 0x690888c2, blocks: 0x1800 00010000:00010000:0.0:1762166977.996657:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166977.996661:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166977.996666:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbaaf8b lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e25 expref: 22 pid: 8380 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166977.996670:0:35472:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166977.996676:0:35472:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166977.996685:0:8380:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbaaf8b lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e25 expref: 22 pid: 8380 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166977.996690:0:35472:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8800/0x2f180c4effbaaf84 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e1e expref: 27 pid: 35472 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1762166977.996708:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+22:2416:x1847765450490496:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 301us (489us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166977.996708:0:8380:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdec00, rc 0) 00000100:00100000:1.0:1762166977.996727:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18995 00010000:00010000:2.0:1762166977.996735:0:35472:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8800/0x2f180c4effbaaf84 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e1e expref: 27 pid: 35472 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1762166977.996736:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6224a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+22:2416:x1847765450490752:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 160us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166977.996767:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18997 00010000:00010000:2.0:1762166977.996775:0:35472:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa8800, rc 0) 00000100:00100000:2.0:1762166977.996814:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+27:2416:x1847765450490624:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 348us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166977.996821:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18996 00000100:00100000:0.0:1762166978.031144:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.031222:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450490880 00000100:00100000:2.0:1762166978.031238:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450490880 00000100:00080000:0.0:1762166978.031308:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1762166978.031321:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18998 00000100:00100000:2.0:1762166978.031337:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+21:2417:x1847765450490880:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:2.0:1762166978.031466:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+21:2417:x1847765450490880:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 134us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166978.031474:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18998 00000100:00100000:3.0:1762166978.032432:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.032470:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450491008 00000100:00100000:2.0:1762166978.032475:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450491008 00000100:00100000:2.0:1762166978.032545:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30495 00000100:00100000:2.0:1762166978.032552:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6224e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+590:61852:x1847765450491008:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166978.032570:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166978.032591:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbaaf92 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x60d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9e2c expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.032624:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbaaf99 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x60d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166978.032634:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbaaf99 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x60d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.032643:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbaaf99 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x60d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.032727:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbaaf92 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x60d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e2c expref: 592 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.032742:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbaaf99 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x60d:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e2c expref: 591 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.032748:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x60d:0x0].0x0 (ffff945bc809b500) 00010000:00010000:2.0:1762166978.032750:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1762166978.032752:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa9c00, rc 0) 00000100:00100000:2.0:1762166978.032777:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6224e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+591:61852:x1847765450491008:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 227us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166978.032782:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30495 00000100:00100000:3.0:1762166978.033767:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.033794:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450491264 00000100:00100000:2.0:1762166978.033799:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450491264 00000100:00100000:2.0:1762166978.033827:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30496 00000100:00100000:2.0:1762166978.033833:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6225c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+591:61852:x1847765450491264:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:2.0:1762166978.033859:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166978.033884:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbaaf3e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x60d:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9dfb expref: 591 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.033896:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x60d:0x0].0x0 (ffff945bc809b500) 00010000:00010000:2.0:1762166978.033900:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166978.034034:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbaafa0 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x60d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166978.034041:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbaafa0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x60d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.034045:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbaafa0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x60d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000001:00080000:2.0:1762166978.034079:0:6495:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992102 00000004:00010000:2.0:1762166978.034093:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000054f2041f reply state 00000000e05c2c9a transno 4294992103 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbaafa0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x60d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.034100:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbaafa0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x60d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.034104:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x60d:0x0].0x0 (ffff945bc809b500) 00010000:00010000:2.0:1762166978.034105:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166978.034107:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166978.034149:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6225c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+593:61852:x1847765450491264:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 317us (383us total) trans 4294992103 rc 0/0 00000100:00100000:2.0:1762166978.034154:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30496 00000020:00080000:2.0:1762166978.034157:0:6495:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1762166978.034856:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.034896:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450491392 00000100:00100000:2.0:1762166978.034900:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450491392 00000100:00100000:2.0:1762166978.034922:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30497 00000100:00100000:2.0:1762166978.034927:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+593:61852:x1847765450491392:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166978.034936:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166978.034946:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9400/0x2f180c4effbaafa7 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x60d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9e33 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.034972:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9400/0x2f180c4effbaafa7 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x60d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e33 expref: 594 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.034982:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9400/0x2f180c4effbaafa7 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x60d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e33 expref: 594 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.034996:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x60d:0x0].0x0 (ffff945bc809b500) 00010000:00010000:2.0:1762166978.034999:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166978.035003:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa9400, rc 0) 00000100:00100000:2.0:1762166978.035035:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+594:61852:x1847765450491392:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 107us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166978.035042:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30497 00000100:00100000:3.0:1762166978.035863:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.035911:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450491520 00000100:00100000:2.0:1762166978.035917:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450491520 00000100:00080000:0.0:1762166978.035965:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1762166978.035969:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18999 00000100:00100000:2.0:1762166978.035980:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6225500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+27:61852:x1847765450491520:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166978.035990:0:35472:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166978.036003:0:35472:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8c00/0x2f180c4effbaafae lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9e3a expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.036026:0:35472:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945cc355aa00/0x2f180c4effbaaf4c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e02 expref: 28 pid: 8383 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166978.036035:0:35472:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166978.036037:0:35472:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166978.036041:0:35472:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8c00/0x2f180c4effbaafae lrc: 4/0,0 mode: --/PW res: [0x280000400:0xa8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e3a expref: 28 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.036071:0:35472:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945cc355aa00/0x2f180c4effbaaf4c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e02 expref: 28 pid: 8383 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166978.036083:0:35472:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945cc355aa00/0x2f180c4effbaaf4c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e02 expref: 28 pid: 8383 timeout: 697 lvb_type: 1 00000100:00100000:2.0:1762166978.036096:0:35472:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55ddc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:35472:1847765449722368:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166978.036183:0:35472:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc56bf0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166978.036815:0:35472:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55ddc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:35472:1847765449722368:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166978.036829:0:35472:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8c00/0x2f180c4effbaafae lrc: 3/0,0 mode: --/PW res: [0x280000400:0xa8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e3a expref: 28 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.036839:0:35472:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa8c00, rc 0) 00000100:00100000:2.0:1762166978.036865:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6225500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+28:61852:x1847765450491520:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 888us (1004us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166978.036880:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18999 00000100:00100000:0.0:1762166978.037072:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166978.037112:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450491648 00000100:00100000:3.0:1762166978.037118:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450491648 00010000:00010000:3.0:1762166978.037139:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945cc355aa00/0x2f180c4effbaaf4c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e02 expref: 28 pid: 8383 timeout: 697 lvb_type: 1 00000100:00100000:3.0:1762166978.037166:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9592 00000100:00100000:3.0:1762166978.037177:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+28:2419:x1847765450491648:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166978.037186:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166978.037190:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945cc355aa00/0x2f180c4effbaaf4c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e02 expref: 28 pid: 8383 timeout: 697 lvb_type: 1 00010000:00010000:3.0:1762166978.037200:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945cc355aa00/0x2f180c4effbaaf4c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e02 expref: 28 pid: 8383 timeout: 697 lvb_type: 1 00010000:00010000:3.0:1762166978.037231:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cc355aa00/0x2f180c4effbaaf4c lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e02 expref: 28 pid: 8383 timeout: 697 lvb_type: 1 00010000:00010000:3.0:1762166978.037241:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166978.037243:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166978.037247:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8c00/0x2f180c4effbaafae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e3a expref: 27 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.037255:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8c00/0x2f180c4effbaafae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e3a expref: 27 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.037278:0:8398:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8c00/0x2f180c4effbaafae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e3a expref: 27 pid: 35472 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166978.037285:0:8398:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc6227100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8398:1847765449722496:192.168.204.38@tcp:105: 00000100:00100000:3.0:1762166978.037319:0:8398:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc2c72900 going to sleep for 11 seconds 00000100:00100000:0.0:1762166978.038028:0:8398:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc6227100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8398:1847765449722496:192.168.204.38@tcp:105: 00010000:00010000:0.0:1762166978.038040:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166978.038070:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+27:2419:x1847765450491648:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 897us (997us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166978.038078:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9592 00000100:00100000:1.0:1762166978.038187:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.038228:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450491776 00000100:00100000:2.0:1762166978.038233:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450491776 00000100:00100000:2.0:1762166978.038261:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19000 00000100:00100000:2.0:1762166978.038269:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+21:61852:x1847765450491776:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166978.038280:0:35472:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166978.038291:0:35472:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbaafb5 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa89:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9e41 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.038311:0:35472:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbaaf45 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e09 expref: 22 pid: 8380 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166978.038324:0:35472:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166978.038326:0:35472:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166978.038330:0:35472:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbaafb5 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xa89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e41 expref: 22 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.038349:0:35472:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbaaf45 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e09 expref: 22 pid: 8380 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166978.038366:0:35472:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbaaf45 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e09 expref: 22 pid: 8380 timeout: 697 lvb_type: 1 00000100:00100000:2.0:1762166978.038376:0:35472:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55ddc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:35472:1847765449722624:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166978.038411:0:35472:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc56bf0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166978.039000:0:35472:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55ddc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:35472:1847765449722624:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166978.039011:0:35472:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbaafb5 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xa89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e41 expref: 22 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.039019:0:35472:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa8000, rc 0) 00000100:00100000:2.0:1762166978.039043:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+22:61852:x1847765450491776:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 775us (856us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166978.039050:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19000 00000100:00100000:3.0:1762166978.039196:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.039239:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450491904 00000100:00100000:0.0:1762166978.039246:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450491904 00010000:00010000:0.0:1762166978.039260:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbaaf45 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e09 expref: 22 pid: 8380 timeout: 697 lvb_type: 1 00000100:00100000:0.0:1762166978.039281:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9593 00000100:00100000:0.0:1762166978.039286:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff1aa850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765450491904:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166978.039294:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166978.039299:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbaaf45 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa89:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e09 expref: 22 pid: 8380 timeout: 697 lvb_type: 1 00010000:00010000:0.0:1762166978.039314:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbaaf45 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa89:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e09 expref: 22 pid: 8380 timeout: 697 lvb_type: 1 00010000:00010000:0.0:1762166978.039329:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbaaf45 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa89:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e09 expref: 22 pid: 8380 timeout: 697 lvb_type: 1 00010000:00010000:0.0:1762166978.039339:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166978.039341:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166978.039345:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbaafb5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e41 expref: 21 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.039353:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbaafb5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e41 expref: 21 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.039375:0:8398:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbaafb5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e41 expref: 21 pid: 35472 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166978.039384:0:8398:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc47b6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8398:1847765449722752:192.168.204.38@tcp:105: 00000100:00100000:0.0:1762166978.039426:0:8398:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7c0f300 going to sleep for 11 seconds 00000100:00100000:0.0:1762166978.040197:0:8398:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc47b6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8398:1847765449722752:192.168.204.38@tcp:105: 00010000:00010000:0.0:1762166978.040208:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166978.040238:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff1aa850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450491904:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 951us (1042us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166978.040246:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9593 00000100:00100000:3.0:1762166978.040352:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.040397:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450492032 00000100:00100000:2.0:1762166978.040402:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450492032 00000100:00100000:3.0:1762166978.040414:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00002000:00010000:2.0:1762166978.040424:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2698 (0->18446744073709551615) 00002000:00100000:2.0:1762166978.040428:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc6225f80 with x1847765450492032 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166978.040435:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc6225f80. 00000100:00100000:2.0:1762166978.040456:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450492160 00000100:00100000:2.0:1762166978.040459:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450492160 00000100:00100000:1.0:1762166978.040466:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2362 00002000:00010000:2.0:1762166978.040471:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2697 (0->18446744073709551615) 00002000:00100000:2.0:1762166978.040475:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc6227100 with x1847765450492160 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166978.040496:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc6227100. 00000100:00100000:1.0:1762166978.040504:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6225f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+27:2418:x1847765450492032:12345-192.168.204.38@tcp:10:lfs.0 00000100:00100000:2.0:1762166978.040516:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2363 00000100:00100000:2.0:1762166978.040526:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6227100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450492160:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:2.0:1762166978.040664:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa89:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166978.040664:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa8a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166978.040668:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa89:0x0] updating lvb mtime from disk: 0 -> 1762166978 00002000:00010000:1.0:1762166978.040670:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa8a:0x0] updating lvb mtime from disk: 0 -> 1762166978 00002000:00010000:2.0:1762166978.040671:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa89:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1762166978.040675:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa8a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1762166978.040676:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa89:0x0] updating lvb ctime from disk: 0 -> 1762166978 00002000:00010000:2.0:1762166978.040682:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa89:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:1.0:1762166978.040682:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa8a:0x0] updating lvb ctime from disk: 0 -> 1762166978 00002000:00010000:1.0:1762166978.040689:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa8a:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1762166978.040720:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6227100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450492160:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 192us (301us total) trans 17179876437 rc 0/0 00000100:00100000:1.0:1762166978.040721:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6225f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+28:2418:x1847765450492032:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 241us (364us total) trans 21474843315 rc 0/0 00000100:00100000:2.0:1762166978.040739:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2363 00002000:00010000:2.0:1762166978.040743:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2697 (0->18446744073709551615) 00002000:00100000:2.0:1762166978.040748:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc6227100 with x1847765450492160 ext(0->18446744073709551615) 00000100:00100000:1.0:1762166978.040748:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2362 00002000:00010000:1.0:1762166978.040754:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2698 (0->18446744073709551615) 00002000:00010000:2.0:1762166978.040757:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc6227100. 00002000:00100000:1.0:1762166978.040759:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc6225f80 with x1847765450492032 ext(0->18446744073709551615) 00002000:00010000:1.0:1762166978.040766:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc6225f80. 00000100:00100000:1.0:1762166978.041997:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.042044:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450492288 00000100:00100000:2.0:1762166978.042050:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450492288 00000100:00100000:2.0:1762166978.042081:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19001 00000100:00100000:2.0:1762166978.042088:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450492288:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:2.0:1762166978.042158:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450492288:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 70us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166978.042165:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19001 00000100:00100000:3.0:1762166978.043495:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.043562:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450492416 00000100:00100000:2.0:1762166978.043567:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450492416 00000100:00100000:2.0:1762166978.043591:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19002 00000100:00100000:2.0:1762166978.043596:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6226680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450492416:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:2.0:1762166978.043653:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6226680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450492416:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 57us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166978.043660:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19002 00000100:00100000:3.0:1762166978.044682:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.044729:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450492544 00000100:00100000:1.0:1762166978.044734:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450492544 00000100:00100000:1.0:1762166978.044769:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2364 00000100:00100000:1.0:1762166978.044777:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6224700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765450492544:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:1.0:1762166978.044806:0:8388:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945cc355a000/0x2f180c4effbaafbc lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.044817:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166978.044820:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166978.044824:0:8388:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355a000/0x2f180c4effbaafbc lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.044838:0:8388:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cc355a000/0x2f180c4effbaafbc lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.044944:0:8388:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945cc355a000/0x2f180c4effbaafbc lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.044952:0:8388:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355a000/0x2f180c4effbaafbc lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.044960:0:8388:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945cc355a000/0x2f180c4effbaafbc lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.044967:0:8388:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355a000 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166978.044972:0:8388:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc355a000/0x2f180c4effbaafbc lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.044980:0:8388:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc355a000/0x2f180c4effbaafbc lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.044992:0:8388:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945cc355a000/0x2f180c4effbaafbc lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.044996:0:8388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cc355a000/0x2f180c4effbaafbc lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166978.045035:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6224700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765450492544:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 258us (353us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1762166978.045043:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2364 00000100:00100000:1.0:1762166978.046361:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.046427:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450492672 00000100:00100000:2.0:1762166978.046431:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450492672 00000100:00100000:2.0:1762166978.046470:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2365 00000100:00100000:2.0:1762166978.046508:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+28:2416:x1847765450492672:12345-192.168.204.38@tcp:4:lfs.0 00010000:00010000:2.0:1762166978.046532:0:8388:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8200/0x2f180c4effbaafc3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.046545:0:8388:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8c00/0x2f180c4effbaafae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e3a expref: 28 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.046552:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166978.046553:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166978.046556:0:8388:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8200/0x2f180c4effbaafc3 lrc: 4/0,1 mode: --/PW res: [0x280000400:0xa8a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.046595:0:8388:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8c00/0x2f180c4effbaafae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e3a expref: 28 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.046609:0:8388:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8c00/0x2f180c4effbaafae lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e3a expref: 28 pid: 35472 timeout: 697 lvb_type: 0 00000100:00100000:2.0:1762166978.046622:0:8388:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55ddc00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0000_UUID:8388:1847765449722880:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166978.046678:0:8388:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc56bf0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166978.047407:0:8388:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55ddc00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0000_UUID:8388:1847765449722880:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166978.047426:0:8388:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8200/0x2f180c4effbaafc3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa8a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166978.047777:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.047862:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450492800 00000100:00100000:0.0:1762166978.048005:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450492800 00010000:00010000:0.0:1762166978.048044:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8c00/0x2f180c4effbaafae lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e3a expref: 29 pid: 35472 timeout: 697 lvb_type: 0 00000100:00100000:0.0:1762166978.048080:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9594 00000100:00100000:0.0:1762166978.048088:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+29:2419:x1847765450492800:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166978.048101:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166978.048120:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8c00/0x2f180c4effbaafae lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e3a expref: 29 pid: 35472 timeout: 697 lvb_type: 0 00010000:00010000:0.0:1762166978.048135:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8c00/0x2f180c4effbaafae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e3a expref: 29 pid: 35472 timeout: 697 lvb_type: 0 00010000:00010000:0.0:1762166978.048162:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8c00/0x2f180c4effbaafae lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e3a expref: 29 pid: 35472 timeout: 697 lvb_type: 0 00010000:00010000:0.0:1762166978.048178:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166978.048181:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166978.048186:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8200/0x2f180c4effbaafc3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa8a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.048201:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8200/0x2f180c4effbaafc3 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa8a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.048236:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166978.048270:0:8388:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8200/0x2f180c4effbaafc3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa8a:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.048279:0:8388:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8200/0x2f180c4effbaafc3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa8a:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166978.048299:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+28:2419:x1847765450492800:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 210us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166978.048308:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9594 00000001:00080000:3.0:1762166978.049615:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843316 is committed 00000001:00080000:3.0:1762166978.049639:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843305 is committed 00002000:00010000:2.0:1762166978.049701:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa8a:0x0] updating lvb size from disk: 0 -> 4096 00002000:00010000:2.0:1762166978.049707:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa8a:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1762166978.049716:0:8388:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8200/0x2f180c4effbaafc3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa8a:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.049726:0:8388:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8200/0x2f180c4effbaafc3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa8a:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.049734:0:8388:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8200/0x2f180c4effbaafc3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa8a:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.049741:0:8388:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa8200 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166978.049746:0:8388:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8200/0x2f180c4effbaafc3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa8a:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.049755:0:8388:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8200/0x2f180c4effbaafc3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa8a:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.049769:0:8388:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8200/0x2f180c4effbaafc3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa8a:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.049775:0:8388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8200/0x2f180c4effbaafc3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa8a:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166978.049837:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+15:2416:x1847765450492672:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 3358us (3476us total) trans 21474843316 rc 0/0 00000100:00100000:2.0:1762166978.049847:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2365 00000100:00100000:1.0:1762166978.051112:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.051160:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450492928 00000100:00100000:2.0:1762166978.051166:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450492928 00000100:00100000:2.0:1762166978.051199:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19003 00000100:00100000:2.0:1762166978.051206:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765450492928:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:2.0:1762166978.051285:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765450492928:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 81us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166978.051289:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19003 00000100:00100000:3.0:1762166978.052542:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.052569:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450493056 00000100:00100000:2.0:1762166978.052573:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450493056 00000100:00100000:2.0:1762166978.052599:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19004 00000100:00100000:2.0:1762166978.052603:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450493056:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:2.0:1762166978.052646:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450493056:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 43us (107us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166978.052651:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19004 00000100:00100000:3.0:1762166978.053963:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.054010:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450493184 00000100:00100000:2.0:1762166978.054013:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450493184 00000100:00100000:2.0:1762166978.054045:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2366 00000100:00100000:2.0:1762166978.054050:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765450493184:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:2.0:1762166978.054071:0:8388:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbaafca lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.054084:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166978.054092:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166978.054097:0:8388:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbaafca lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [192512->262143] (req 192512->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.054110:0:8388:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbaafca lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [192512->262143] (req 192512->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.055098:0:8388:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbaafca lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [192512->262143] (req 192512->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.055105:0:8388:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbaafca lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [192512->262143] (req 192512->262143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.055110:0:8388:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbaafca lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [192512->262143] (req 192512->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.055113:0:8388:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa8600 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166978.055116:0:8388:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbaafca lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [192512->262143] (req 192512->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.055121:0:8388:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbaafca lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [192512->262143] (req 192512->262143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.055132:0:8388:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbaafca lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [192512->262143] (req 192512->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.055136:0:8388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbaafca lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [192512->262143] (req 192512->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166978.055174:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765450493184:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 1124us (1213us total) trans 0 rc 66834/66834 00000100:00100000:2.0:1762166978.055180:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2366 00000100:00100000:3.0:1762166978.056471:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.056540:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450493312 00000100:00100000:2.0:1762166978.056546:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450493312 00000100:00100000:2.0:1762166978.056601:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2367 00000100:00100000:2.0:1762166978.056612:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+15:2419:x1847765450493312:12345-192.168.204.38@tcp:4:lfs.0 00002000:00010000:2.0:1762166978.056648:0:8388:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa8a:0x0] initial LVB size: 4096, mtime: 0x690888c2, atime: 0x0, ctime: 0x690888c2, blocks: 0x8 00010000:00010000:2.0:1762166978.056654:0:8388:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9800/0x2f180c4effbaafd1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa8a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.056661:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166978.056662:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166978.056665:0:8388:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9800/0x2f180c4effbaafd1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa8a:0x0].0x0 rrc: 2 type: EXT [192512->262143] (req 192512->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.056673:0:8388:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9800/0x2f180c4effbaafd1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa8a:0x0].0x0 rrc: 2 type: EXT [192512->262143] (req 192512->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000001:00080000:3.0:1762166978.058790:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843317 is committed 00002000:00010000:2.0:1762166978.058900:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa8a:0x0] updating lvb size from disk: 4096 -> 259346 00002000:00010000:2.0:1762166978.058906:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa8a:0x0] updating lvb blocks from disk: 8 -> 144 00010000:00010000:2.0:1762166978.058912:0:8388:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9800/0x2f180c4effbaafd1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa8a:0x0].0x0 rrc: 2 type: EXT [192512->262143] (req 192512->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.058919:0:8388:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9800/0x2f180c4effbaafd1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa8a:0x0].0x0 rrc: 2 type: EXT [192512->262143] (req 192512->262143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.058924:0:8388:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9800/0x2f180c4effbaafd1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa8a:0x0].0x0 rrc: 2 type: EXT [192512->262143] (req 192512->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.058932:0:8388:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa9800 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166978.058934:0:8388:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9800/0x2f180c4effbaafd1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa8a:0x0].0x0 rrc: 2 type: EXT [192512->262143] (req 192512->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.058939:0:8388:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9800/0x2f180c4effbaafd1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa8a:0x0].0x0 rrc: 2 type: EXT [192512->262143] (req 192512->262143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.058947:0:8388:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9800/0x2f180c4effbaafd1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa8a:0x0].0x0 rrc: 2 type: EXT [192512->262143] (req 192512->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.058951:0:8388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9800/0x2f180c4effbaafd1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa8a:0x0].0x0 rrc: 2 type: EXT [192512->262143] (req 192512->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166978.059003:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+15:2419:x1847765450493312:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 2393us (2533us total) trans 21474843317 rc 0/0 00000100:00100000:2.0:1762166978.059008:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2367 00000100:00100000:1.0:1762166978.060056:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.060109:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450493440 00000100:00100000:2.0:1762166978.060117:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450493440 00000100:00100000:2.0:1762166978.060163:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30498 00000100:00100000:2.0:1762166978.060173:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+594:61852:x1847765450493440:12345-192.168.204.38@tcp:44:lfs.0 00000001:00080000:3.0:1762166978.061179:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294992103 is committed 00000001:00080000:3.0:1762166978.061206:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294992083 is committed 00010000:00010000:2.0:1762166978.061218:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbaac90 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x60b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00000020:00080000:3.0:1762166978.061230:0:7412:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff945cc9a5e0c0 refcount 2 committed 0 result 0 batchid 48 00010000:00010000:2.0:1762166978.061231:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbaac90 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x60b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00000020:00080000:3.0:1762166978.061238:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cc9241400 obd lustre-OST0001-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff945d0116c480 00000020:00080000:3.0:1762166978.061245:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cf3a53600 obd lustre-OST0000-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff945ccba916c0 00010000:00010000:2.0:1762166978.061245:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbaac90 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x60b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00000020:00080000:3.0:1762166978.061251:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945bc2d82800 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff945cff20f600 00000020:00080000:3.0:1762166978.061258:0:7412:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000400:0x2:0x0].47 00010000:00010000:2.0:1762166978.061262:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355ac00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166978.061267:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbaac90 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x60b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.061273:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbaac90 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x60b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.061288:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x60b:0x0].0x0 (ffff945bc812e700) 00010000:00010000:2.0:1762166978.061292:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166978.061296:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbaac90 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x60b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.061303:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbaac90 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x60b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000020:00080000:3.0:1762166978.061304:0:7412:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff945cf3a33780 refcount 2 committed 0 result 0 batchid 47 00000020:00080000:3.0:1762166978.061309:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945bc2d82f00 obd lustre-OST0001-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff945cf1fe2d80 00000020:00080000:3.0:1762166978.061315:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945bc2d82000 obd lustre-OST0000-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff945cf3a33e40 00000020:00080000:0.0:1762166978.061316:0:7435:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 44 00000020:00080000:3.0:1762166978.061317:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945bc2d82a00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff945bc5dbca00 00000020:00080000:3.0:1762166978.061322:0:7412:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000400:0x2:0x0].45 00000020:00080000:0.0:1762166978.061332:0:7435:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 48 committed batchid 44 00000020:00080000:3.0:1762166978.061337:0:7412:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0001: 46 batchid updated 00010000:00010000:2.0:1762166978.061339:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effbaac9e lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.061347:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effbaac9e lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.061353:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effbaac9e lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.061359:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8472400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166978.061363:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effbaac9e lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.061370:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effbaac9e lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.061390:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166978.061394:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166978.061398:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effbaac9e lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.061405:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effbaac9e lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.061419:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9200/0x2f180c4effbaae18 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.061425:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9200/0x2f180c4effbaae18 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00000020:00080000:0.0:1762166978.061426:0:7435:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 45 cancel update log [0x240000400:0x2:0x0].43: rc = 0 00010000:00010000:2.0:1762166978.061437:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9200/0x2f180c4effbaae18 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.061443:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc5db9200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166978.061446:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9200/0x2f180c4effbaae18 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.061455:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9200/0x2f180c4effbaae18 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00000020:00080000:0.0:1762166978.061463:0:7435:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 46 cancel update log [0x240000400:0x2:0x0].44: rc = 0 00010000:00010000:2.0:1762166978.061465:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166978.061470:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000020:00080000:0.0:1762166978.061473:0:7435:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 46 00010000:00010000:2.0:1762166978.061474:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9200/0x2f180c4effbaae18 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.061506:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9200/0x2f180c4effbaae18 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.061521:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbaae42 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.061527:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbaae42 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00000100:00100000:1.0:1762166978.061533:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+538:61852:x1847765450493440:12345-192.168.204.38@tcp:44:lfs.0 Request processed in 1358us (1476us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166978.061550:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbaae42 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00000100:00100000:1.0:1762166978.061551:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30498 00010000:00010000:2.0:1762166978.061560:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa9e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166978.061564:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbaae42 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.061571:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbaae42 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.061580:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166978.061583:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166978.061585:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbaae42 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.061592:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbaae42 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.061604:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbaae57 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.061610:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbaae57 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.061615:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbaae57 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.061620:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bde400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166978.061623:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbaae57 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.061629:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbaae57 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.061639:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166978.061641:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166978.061644:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbaae57 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.061650:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbaae57 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.061661:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbaae6c lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.061665:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbaae6c lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.061670:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbaae6c lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.061674:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bde200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166978.061677:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbaae6c lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.061682:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbaae6c lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.061689:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166978.061691:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166978.061694:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbaae6c lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.061699:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbaae6c lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.061709:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbaae81 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.061716:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbaae81 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.061721:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbaae81 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.061726:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdf400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166978.061729:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbaae81 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.061734:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbaae81 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.061741:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166978.061743:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166978.061744:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbaae81 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.061748:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbaae81 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.061754:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbaae96 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.061757:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbaae96 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.061760:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbaae96 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.061763:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bde800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166978.061764:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbaae96 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.061770:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbaae96 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.061774:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166978.061775:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166978.061777:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbaae96 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.061782:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbaae96 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.061790:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbaaeab lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.061795:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbaaeab lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.061801:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbaaeab lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.061805:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bde600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166978.061808:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbaaeab lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.061813:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbaaeab lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.061821:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166978.061824:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166978.061827:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbaaeab lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.061832:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbaaeab lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.061844:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbaaec0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.061849:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbaaec0 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.061854:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbaaec0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.061859:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdf200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166978.061861:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbaaec0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.061879:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbaaec0 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.061886:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166978.061889:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166978.061891:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbaaec0 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.061897:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbaaec0 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.061906:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbaaed5 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.061920:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbaaed5 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.061929:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbaaed5 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.061934:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bde000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166978.061936:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbaaed5 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.061940:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbaaed5 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.061944:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166978.061946:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166978.061947:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbaaed5 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.061950:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbaaed5 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.061957:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbaafa0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x60d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.061961:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbaafa0 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x60d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.061964:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbaafa0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x60d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.061967:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa8e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166978.061968:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbaafa0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x60d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.061971:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbaafa0 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x60d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.061975:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x60d:0x0].0x0 (ffff945bc809b500) 00010000:00010000:2.0:1762166978.061977:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166978.061979:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbaafa0 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x60d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.061988:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbaafa0 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x60d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000100:00100000:3.0:1762166978.062728:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.062758:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450493696 00000100:00100000:3.0:1762166978.062762:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.062765:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450493696 00000100:00100000:2.0:1762166978.062806:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450493568 00000100:00100000:2.0:1762166978.062810:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450493568 00000100:00100000:1.0:1762166978.062814:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19005 00000100:00100000:1.0:1762166978.062827:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+22:2417:x1847765450493696:12345-192.168.204.38@tcp:16:lfs.0 00000100:00100000:2.0:1762166978.062844:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19006 00000100:00100000:2.0:1762166978.062856:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb384a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+15:2417:x1847765450493568:12345-192.168.204.38@tcp:16:lfs.0 00000100:00100000:2.0:1762166978.062922:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb384a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+15:2417:x1847765450493568:12345-192.168.204.38@tcp:16:lfs.0 Request processed in 71us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166978.062928:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19006 00000001:00080000:0.0:1762166978.063620:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876437 is committed 00000100:00100000:1.0:1762166978.063697:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+19:2417:x1847765450493696:12345-192.168.204.38@tcp:16:lfs.0 Request processed in 874us (970us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166978.063702:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19005 00000100:00100000:3.0:1762166978.070465:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166978.070512:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.070534:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450493824 00000100:00100000:3.0:1762166978.070539:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.070545:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450493824 00000100:00100000:2.0:1762166978.070567:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450494080 00000100:00100000:2.0:1762166978.070574:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450494080 00000100:00100000:1.0:1762166978.070589:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450493952 00000100:00100000:1.0:1762166978.070594:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450493952 00000100:00100000:0.0:1762166978.070601:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19007 00000100:00100000:0.0:1762166978.070617:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb387b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450493824:12345-192.168.204.38@tcp:1:lfs.0 00000100:00100000:3.0:1762166978.070618:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19008 00000100:00100000:3.0:1762166978.070634:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450494080:12345-192.168.204.38@tcp:1:lfs.0 00000100:00100000:1.0:1762166978.070634:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19009 00000100:00100000:1.0:1762166978.070649:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+15:2419:x1847765450493952:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:0.0:1762166978.070661:0:9165:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbaafd8 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.070675:0:8383:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8472000/0x2f180c4effbaafdf lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.070675:0:8380:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945cc355bc00/0x2f180c4effbaafe6 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.070675:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166978.070680:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166978.070685:0:9165:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbaafd8 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.070702:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166978.070702:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166978.070707:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166978.070707:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166978.070707:0:9165:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbaafd8 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.070713:0:8383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472000/0x2f180c4effbaafdf lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.070714:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cc355bc00/0x2f180c4effbaafe6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.070735:0:8383:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8472000/0x2f180c4effbaafdf lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.070742:0:8380:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cc355bc00/0x2f180c4effbaafe6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.070754:0:8383:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8472000/0x2f180c4effbaafdf lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.070755:0:9165:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbaafd8 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.070760:0:8380:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945cc355bc00/0x2f180c4effbaafe6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.070777:0:8383:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472000/0x2f180c4effbaafdf lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.070780:0:9165:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbaafd8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.070782:0:8380:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945cc355bc00/0x2f180c4effbaafe6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.070798:0:8383:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc8472000/0x2f180c4effbaafdf lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.070800:0:9165:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbaafd8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.070809:0:8380:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945cc355bc00/0x2f180c4effbaafe6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.070819:0:8383:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8472000 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166978.070820:0:9165:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdfe00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166978.070826:0:8383:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8472000/0x2f180c4effbaafdf lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.070827:0:9165:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbaafd8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.070828:0:8380:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355bc00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166978.070836:0:8380:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945cc355bc00/0x2f180c4effbaafe6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.070854:0:9165:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbaafd8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.070856:0:8383:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8472000/0x2f180c4effbaafdf lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.070856:0:8380:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945cc355bc00/0x2f180c4effbaafe6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.070892:0:9165:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbaafd8 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.070893:0:8380:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945cc355bc00/0x2f180c4effbaafe6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.070895:0:8383:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc8472000/0x2f180c4effbaafdf lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.070913:0:9165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbaafd8 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.070917:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cc355bc00/0x2f180c4effbaafe6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.070921:0:8383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8472000/0x2f180c4effbaafdf lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166978.070986:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb387b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450493824:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 375us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166978.070992:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450494080:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 362us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166978.071000:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19007 00000100:00100000:1.0:1762166978.071001:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+15:2419:x1847765450493952:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 352us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166978.071007:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19008 00000100:00100000:1.0:1762166978.071016:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19009 00000100:00100000:0.0:1762166978.072309:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.072344:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450494336 00000100:00100000:1.0:1762166978.072348:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450494336 00000100:00100000:1.0:1762166978.072378:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30499 00000100:00100000:1.0:1762166978.072383:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+529:61852:x1847765450494336:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:1.0:1762166978.072438:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbaafed lrc: 3/0,1 mode: --/PW res: [0x240000404:0x60d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166978.072447:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbaafed lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x60d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.072455:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbaafed lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x60d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00010000:1.0:1762166978.072595:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000e1747f33 reply state 00000000f618ff5b transno 4294992104 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbaafed lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x60d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.072607:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbaafed lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x60d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.072614:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x60d:0x0].0x0 (ffff945bc809b500) 00010000:00010000:1.0:1762166978.072617:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166978.072620:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166978.072688:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+531:61852:x1847765450494336:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 304us (379us total) trans 4294992104 rc 0/0 00000100:00100000:1.0:1762166978.072695:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30499 00000100:00100000:2.0:1762166978.073822:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.073847:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.073863:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450494592 00000100:00100000:1.0:1762166978.073881:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450494592 00000100:00100000:3.0:1762166978.073887:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450494464 00000100:00100000:3.0:1762166978.073892:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450494464 00000100:00100000:1.0:1762166978.073921:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19010 00000100:00100000:1.0:1762166978.073933:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450494592:12345-192.168.204.38@tcp:2:lfs.0 00000100:00100000:3.0:1762166978.073939:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19011 00000100:00100000:3.0:1762166978.073951:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+15:2419:x1847765450494464:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:1.0:1762166978.074032:0:8380:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa89:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166978.074036:0:8380:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa89:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:1.0:1762166978.074039:0:8380:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa89:0x0] updating lvb atime from disk: 0 -> 1762166978 00002000:00010000:1.0:1762166978.074042:0:8380:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa89:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:1.0:1762166978.074045:0:8380:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa89:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166978.074064:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+16:2419:x1847765450494464:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 116us (214us total) trans 21474843318 rc 0/0 00000100:00100000:1.0:1762166978.074073:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450494592:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 142us (249us total) trans 17179876438 rc 0/0 00000100:00100000:3.0:1762166978.074075:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19011 00000100:00100000:1.0:1762166978.074087:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19010 00000100:00100000:3.0:1762166978.074894:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.074957:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450494848 00000100:00100000:1.0:1762166978.074967:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450494848 00000100:00100000:1.0:1762166978.075021:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30500 00000100:00100000:1.0:1762166978.075030:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+531:61852:x1847765450494848:12345-192.168.204.38@tcp:55:lfs.0 00010000:00010000:1.0:1762166978.075086:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbaaff4 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x60d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166978.075098:0:6495:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbaaf99 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x60d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e2c expref: 531 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.075106:0:6495:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbaaff4 lrc: 4/0,1 mode: --/PW res: [0x240000404:0x60d:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.075139:0:6495:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbaaf99 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x60d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e2c expref: 531 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.075149:0:6495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbaaf99 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x60d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e2c expref: 531 pid: 6495 timeout: 697 lvb_type: 0 00000100:00100000:1.0:1762166978.075162:0:6495:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6495:1847765449723008:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166978.075246:0:6495:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cee083000 going to sleep for 11 seconds 00000100:00100000:1.0:1762166978.076159:0:6495:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6495:1847765449723008:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166978.076180:0:6495:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbaaff4 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x60d:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000100:00100000:3.0:1762166978.076269:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.076315:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450494976 00000100:00100000:0.0:1762166978.076320:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450494976 00010000:00010000:0.0:1762166978.076340:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbaaf99 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x60d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e2c expref: 532 pid: 6495 timeout: 697 lvb_type: 0 00000100:00100000:0.0:1762166978.076365:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9595 00000100:00100000:0.0:1762166978.076370:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+532:2419:x1847765450494976:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166978.076379:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166978.076384:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbaaf99 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x60d:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e2c expref: 532 pid: 6495 timeout: 697 lvb_type: 0 00010000:00010000:0.0:1762166978.076393:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbaaf99 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x60d:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e2c expref: 532 pid: 6495 timeout: 697 lvb_type: 0 00010000:00010000:0.0:1762166978.076409:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbaaf99 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x60d:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e2c expref: 532 pid: 6495 timeout: 697 lvb_type: 0 00010000:00010000:0.0:1762166978.076428:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x60d:0x0].0x0 (ffff945bc809b500) 00010000:00010000:0.0:1762166978.076433:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbaaff4 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x60d:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.076441:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbaaff4 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x60d:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.076449:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbaaff4 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x60d:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.076470:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166978.076522:0:6495:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbaaff4 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x60d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000100:00100000:0.0:1762166978.076532:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+531:2419:x1847765450494976:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 158us (260us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166978.076534:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbaaff4 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x60d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000100:00100000:0.0:1762166978.076552:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9595 00010000:00010000:1.0:1762166978.076580:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbaaff4 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x60d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.076589:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbaaff4 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x60d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.076596:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbaaff4 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x60d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.076602:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355ba00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166978.076607:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbaaff4 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x60d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.076615:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbaaff4 lrc: 4/0,0 mode: PW/PW res: [0x240000404:0x60d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.076624:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x60d:0x0].0x0 (ffff945bc809b500) 00010000:00010000:1.0:1762166978.076628:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1762166978.076632:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbaaff4 lrc: 2/0,0 mode: --/PW res: [0x240000404:0x60d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.076639:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbaaff4 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x60d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000100:00100000:1.0:1762166978.076686:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+530:61852:x1847765450494848:12345-192.168.204.38@tcp:55:lfs.0 Request processed in 1657us (1800us total) trans 0 rc -22/-22 00000100:00100000:1.0:1762166978.076696:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30500 00000100:00100000:3.0:1762166978.077500:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.077550:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450495232 00000100:00100000:1.0:1762166978.077556:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450495232 00000100:00100000:1.0:1762166978.077587:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30501 00000100:00100000:1.0:1762166978.077595:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+530:61852:x1847765450495232:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:1.0:1762166978.077631:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166978.077646:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbaaee3 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ddf expref: 530 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.077657:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166978.077660:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166978.077694:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbaaffb lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166978.077704:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbaaffb lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.077711:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbaaffb lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00010000:1.0:1762166978.077843:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000d8e24d40 reply state 00000000d747861a transno 4294992105 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbaaffb lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.077855:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbaaffb lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.077861:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166978.077864:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166978.077879:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166978.077944:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+531:61852:x1847765450495232:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 349us (444us total) trans 4294992105 rc 0/0 00000100:00100000:1.0:1762166978.077951:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30501 00000100:00100000:0.0:1762166978.078803:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.078839:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.078881:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450495360 00000100:00100000:1.0:1762166978.078894:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450495360 00000100:00100000:3.0:1762166978.078906:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450495488 00000100:00100000:0.0:1762166978.078913:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166978.078915:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450495488 00000100:00100000:1.0:1762166978.078962:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450495616 00000100:00100000:1.0:1762166978.078969:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450495616 00000100:00100000:2.0:1762166978.078992:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19012 00000100:00100000:0.0:1762166978.079007:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19013 00000100:00100000:2.0:1762166978.079016:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450495360:12345-192.168.204.38@tcp:2:lfs.0 00000100:00100000:3.0:1762166978.079018:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19014 00000100:00100000:0.0:1762166978.079027:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+16:2419:x1847765450495488:12345-192.168.204.38@tcp:2:lfs.0 00000100:00100000:3.0:1762166978.079040:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450495616:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:3.0:1762166978.079190:0:8383:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166978.079190:0:9165:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166978.079196:0:8383:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:0.0:1762166978.079197:0:9165:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:3.0:1762166978.079202:0:8383:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166977 -> 1762166978 00002000:00010000:0.0:1762166978.079204:0:9165:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166977 -> 1762166978 00002000:00010000:3.0:1762166978.079205:0:8383:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:3.0:1762166978.079211:0:8383:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:0.0:1762166978.079212:0:9165:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166978.079213:0:28434:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 259346 -> 259346 00002000:00010000:0.0:1762166978.079219:0:9165:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00002000:00010000:2.0:1762166978.079223:0:28434:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166978.079229:0:28434:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166978.079234:0:28434:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166978.079237:0:28434:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 352 -> 352 00000100:00100000:0.0:1762166978.079259:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450495488:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 238us (414us total) trans 21474843319 rc 0/0 00000100:00100000:3.0:1762166978.079260:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765450495616:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 223us (344us total) trans 17179876439 rc 0/0 00000100:00100000:0.0:1762166978.079278:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19013 00000100:00100000:3.0:1762166978.079286:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19014 00000100:00100000:2.0:1762166978.079296:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765450495360:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 287us (485us total) trans 17179876440 rc 0/0 00000100:00100000:2.0:1762166978.079309:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19012 00000100:00100000:2.0:1762166978.080363:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166978.080408:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450495872 00000100:00100000:3.0:1762166978.080414:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450495872 00000100:00100000:3.0:1762166978.080454:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11855 00000100:00100000:3.0:1762166978.080463:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+531:61852:x1847765450495872:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:3.0:1762166978.080575:0:6497:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x240000404:0x5eb:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbaaf5a lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e10 expref: 531 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.080602:0:6497:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effbab002 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 00010000:00010000:3.0:1762166978.080610:0:6497:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9a00/0x2f180c4effbaadd9 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d7d expref: 531 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.080615:0:6497:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8400/0x2f180c4effbaae11 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d8b expref: 531 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.080621:0:6497:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effbab002 lrc: 5/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT1 00010000:00010000:3.0:1762166978.080648:0:6497:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8400/0x2f180c4effbaae11 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d8b expref: 531 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.080657:0:6497:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8400/0x2f180c4effbaae11 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d8b expref: 531 pid: 6495 timeout: 697 lvb_type: 0 00000100:00100000:3.0:1762166978.080668:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6497:1847765449723136:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166978.080727:0:6497:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9a00/0x2f180c4effbaadd9 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d7d expref: 531 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.080734:0:6497:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9a00/0x2f180c4effbaadd9 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d7d expref: 531 pid: 6495 timeout: 697 lvb_type: 0 00000100:00100000:3.0:1762166978.080741:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6497:1847765449723264:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166978.080761:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc2c72840 going to sleep for 11 seconds 00000100:00100000:1.0:1762166978.081860:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.081913:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.081949:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450496128 00000100:00100000:0.0:1762166978.081956:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450496128 00000100:00100000:3.0:1762166978.081967:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6497:1847765449723136:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166978.081983:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6497:1847765449723264:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166978.081990:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8400/0x2f180c4effbaae11 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d8b expref: 532 pid: 6495 timeout: 697 lvb_type: 0 00010000:00010000:3.0:1762166978.082012:0:6497:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effbab002 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00000100:00100000:0.0:1762166978.082022:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450496000 00000100:00100000:0.0:1762166978.082026:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450496000 00010000:00010000:0.0:1762166978.082038:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9a00/0x2f180c4effbaadd9 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d7d expref: 533 pid: 6495 timeout: 697 lvb_type: 0 00000100:00100000:2.0:1762166978.082055:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9596 00000100:00100000:1.0:1762166978.082068:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9597 00000100:00100000:2.0:1762166978.082071:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+533:2419:x1847765450496128:12345-192.168.204.38@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1762166978.082083:0:6480:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+533:2418:x1847765450496000:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166978.082092:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166978.082093:0:6480:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166978.082104:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8400/0x2f180c4effbaae11 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d8b expref: 533 pid: 6495 timeout: 697 lvb_type: 0 00010000:00010000:1.0:1762166978.082109:0:6480:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9a00/0x2f180c4effbaadd9 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d7d expref: 533 pid: 6495 timeout: 697 lvb_type: 0 00010000:00010000:2.0:1762166978.082125:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8400/0x2f180c4effbaae11 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d8b expref: 533 pid: 6495 timeout: 697 lvb_type: 0 00010000:00010000:1.0:1762166978.082140:0:6480:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9a00/0x2f180c4effbaadd9 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d7d expref: 533 pid: 6495 timeout: 697 lvb_type: 0 00010000:00010000:2.0:1762166978.082164:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8400/0x2f180c4effbaae11 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d8b expref: 533 pid: 6495 timeout: 697 lvb_type: 0 00010000:00010000:1.0:1762166978.082172:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9a00/0x2f180c4effbaadd9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d7d expref: 533 pid: 6495 timeout: 697 lvb_type: 0 00010000:00010000:2.0:1762166978.082184:0:7421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166978.082191:0:7421:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effbab002 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166978.082200:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effbab002 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166978.082207:0:7421:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effbab002 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166978.082216:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166978.082222:0:6480:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166978.082235:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166978.082274:0:6480:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+531:2418:x1847765450496000:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 196us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166978.082283:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+531:2419:x1847765450496128:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 216us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166978.082292:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9597 00010000:00010000:3.0:1762166978.082295:0:6497:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effbab002 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00000100:00100000:2.0:1762166978.082301:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9596 00010000:00010000:3.0:1762166978.082309:0:6497:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effbab002 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00010000:00010000:3.0:1762166978.082331:0:6497:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472800/0x2f180c4effbab009 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x60d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 00010000:00010000:3.0:1762166978.082344:0:6497:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9400/0x2f180c4effbaafa7 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x60d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e33 expref: 529 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.082352:0:6497:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472800/0x2f180c4effbab009 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x60d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT1 00010000:00010000:3.0:1762166978.082382:0:6497:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9400/0x2f180c4effbaafa7 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x60d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e33 expref: 529 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.082395:0:6497:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9400/0x2f180c4effbaafa7 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x60d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e33 expref: 529 pid: 6495 timeout: 697 lvb_type: 0 00000100:00100000:3.0:1762166978.082416:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6497:1847765449723392:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166978.082532:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc2c72840 going to sleep for 11 seconds 00000100:00100000:3.0:1762166978.083340:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6497:1847765449723392:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166978.083362:0:6497:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472800/0x2f180c4effbab009 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x60d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00000100:00100000:0.0:1762166978.083452:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.083535:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450496256 00000100:00100000:2.0:1762166978.083542:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450496256 00010000:00010000:2.0:1762166978.083590:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9400/0x2f180c4effbaafa7 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x60d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e33 expref: 530 pid: 6495 timeout: 697 lvb_type: 0 00000100:00100000:2.0:1762166978.083626:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9598 00000100:00100000:2.0:1762166978.083636:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+530:2419:x1847765450496256:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166978.083646:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166978.083651:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9400/0x2f180c4effbaafa7 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x60d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e33 expref: 530 pid: 6495 timeout: 697 lvb_type: 0 00010000:00010000:2.0:1762166978.083661:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9400/0x2f180c4effbaafa7 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x60d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e33 expref: 530 pid: 6495 timeout: 697 lvb_type: 0 00010000:00010000:2.0:1762166978.083676:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9400/0x2f180c4effbaafa7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x60d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e33 expref: 530 pid: 6495 timeout: 697 lvb_type: 0 00010000:00010000:2.0:1762166978.083690:0:7421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x60d:0x0].0x0 (ffff945bc809b500) 00010000:00010000:2.0:1762166978.083695:0:7421:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472800/0x2f180c4effbab009 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x60d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166978.083702:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472800/0x2f180c4effbab009 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x60d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166978.083708:0:7421:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472800/0x2f180c4effbab009 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x60d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166978.083736:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166978.083759:0:6497:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472800/0x2f180c4effbab009 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x60d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00010000:00010000:3.0:1762166978.083770:0:6497:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472800/0x2f180c4effbab009 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x60d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00000100:00100000:2.0:1762166978.083782:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+529:2419:x1847765450496256:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 146us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166978.083796:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9598 00000100:00100000:3.0:1762166978.084172:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449723520:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166978.084221:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166978.084255:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc2c72900 going to sleep for 11 seconds 00000100:00100000:1.0:1762166978.084275:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449723520 00000100:00100000:1.0:1762166978.084282:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449723520 00000100:00100000:1.0:1762166978.084329:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1355 00000100:00100000:1.0:1762166978.084339:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:6497:x1847765449723520:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762166978.084443:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:6497:x1847765449723520:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 106us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166978.084450:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1355 00000100:00100000:3.0:1762166978.084530:0:6497:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 17179876388 gen 2 00000004:00080000:3.0:1762166978.084538:0:6497:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc4533100, transno 17179876383 00000004:00080000:3.0:1762166978.084552:0:6497:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 17179876387 committed transno 17179876388 00000004:00080000:3.0:1762166978.084572:0:6497:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 17179876388 committed transno 17179876388 00000100:00100000:3.0:1762166978.084602:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449723520:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166978.084663:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449723648:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166978.084695:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166978.084719:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc2c72900 going to sleep for 11 seconds 00000100:00100000:1.0:1762166978.084730:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449723648 00000100:00100000:1.0:1762166978.084735:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449723648 00000100:00100000:1.0:1762166978.084764:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1356 00000100:00100000:1.0:1762166978.084771:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:6497:x1847765449723648:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762166978.084836:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:6497:x1847765449723648:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 65us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166978.084843:0:6497:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 21474843305 gen 2 00000100:00100000:1.0:1762166978.084845:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1356 00000004:00080000:3.0:1762166978.084847:0:6497:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 21474843304 committed transno 21474843305 00000004:00080000:3.0:1762166978.084861:0:6497:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 21474843305 committed transno 21474843305 00000100:00100000:3.0:1762166978.084887:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449723648:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166978.084932:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449723776:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166978.084954:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166978.084973:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccba916c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166978.084992:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449723776 00000100:00100000:1.0:1762166978.084997:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449723776 00000100:00100000:1.0:1762166978.085025:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1357 00000100:00100000:1.0:1762166978.085032:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:6497:x1847765449723776:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762166978.085085:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:6497:x1847765449723776:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 53us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166978.085095:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1357 00000100:00100000:3.0:1762166978.085104:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449723776:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166978.085138:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449723904:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166978.085162:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166978.085182:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc2c72cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166978.085201:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449723904 00000100:00100000:1.0:1762166978.085206:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449723904 00000100:00100000:1.0:1762166978.085230:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1358 00000100:00100000:1.0:1762166978.085237:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:6497:x1847765449723904:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762166978.085344:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:6497:x1847765449723904:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 108us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166978.085352:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1358 00000100:00100000:3.0:1762166978.085363:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449723904:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166978.085403:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449724032:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166978.085425:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166978.085446:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1c86e40 going to sleep for 11 seconds 00000100:00100000:1.0:1762166978.085446:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449724032 00000100:00100000:1.0:1762166978.085453:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449724032 00000100:00100000:1.0:1762166978.085502:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1359 00000100:00100000:1.0:1762166978.085510:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:6497:x1847765449724032:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762166978.085562:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:6497:x1847765449724032:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 53us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166978.085568:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1359 00000100:00100000:3.0:1762166978.085582:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449724032:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166978.085617:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449724160:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166978.085638:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166978.085657:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf3a33cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166978.085659:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449724160 00000100:00100000:1.0:1762166978.085664:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449724160 00000100:00100000:1.0:1762166978.085687:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1360 00000100:00100000:1.0:1762166978.085694:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:6497:x1847765449724160:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762166978.085744:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:6497:x1847765449724160:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 50us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166978.085751:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1360 00000100:00100000:3.0:1762166978.085761:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449724160:0@lo:1000:mdt_rdpg00_000.0 00000040:00080000:3.0:1762166978.085911:0:6497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x2:0x0].48, 456 off66272 00000001:00080000:3.0:1762166978.085923:0:6497:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992106 00000100:00100000:3.0:1762166978.085970:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449724288:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166978.085991:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166978.086009:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf3a33cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166978.086026:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449724288 00000100:00100000:1.0:1762166978.086031:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449724288 00000100:00100000:1.0:1762166978.086058:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1361 00000100:00100000:1.0:1762166978.086064:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:6497:x1847765449724288:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762166978.086152:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:6497:x1847765449724288:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 88us (160us total) trans 17179876441 rc 0/0 00000100:00100000:1.0:1762166978.086159:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1361 00000100:00100000:3.0:1762166978.086171:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449724288:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166978.086198:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449724416:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166978.086218:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166978.086237:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf3a33cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166978.086258:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449724416 00000100:00100000:1.0:1762166978.086262:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449724416 00000100:00100000:1.0:1762166978.086293:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1362 00000100:00100000:1.0:1762166978.086300:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:6497:x1847765449724416:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762166978.086394:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:6497:x1847765449724416:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 94us (174us total) trans 21474843320 rc 0/0 00000100:00100000:1.0:1762166978.086402:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1362 00000100:00100000:3.0:1762166978.086405:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449724416:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1762166978.086453:0:6497:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992107 00010000:00010000:3.0:1762166978.086473:0:6497:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472800/0x2f180c4effbab009 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x60d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT1 00010000:00010000:3.0:1762166978.086500:0:6497:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472800/0x2f180c4effbab009 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x60d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT1 00010000:00010000:3.0:1762166978.086508:0:6497:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472800/0x2f180c4effbab009 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x60d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT1 00010000:00010000:3.0:1762166978.086515:0:6497:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8472800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166978.086520:0:6497:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472800/0x2f180c4effbab009 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x60d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT1 00010000:00010000:3.0:1762166978.086527:0:6497:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472800/0x2f180c4effbab009 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x60d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT1 00010000:00010000:3.0:1762166978.086541:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x60d:0x0].0x0 (ffff945bc809b500) 00010000:00010000:3.0:1762166978.086544:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166978.086548:0:6497:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472800/0x2f180c4effbab009 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x60d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT1 00010000:00010000:3.0:1762166978.086554:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472800/0x2f180c4effbab009 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x60d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT1 00010000:00010000:3.0:1762166978.086566:0:6497:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effbab002 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT1 00010000:00010000:3.0:1762166978.086577:0:6497:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effbab002 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT1 00010000:00010000:3.0:1762166978.086584:0:6497:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effbab002 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT1 00010000:00010000:3.0:1762166978.086589:0:6497:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8472000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166978.086594:0:6497:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effbab002 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT1 00010000:00010000:3.0:1762166978.086599:0:6497:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effbab002 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT1 00010000:00010000:3.0:1762166978.086612:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166978.086615:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166978.086618:0:6497:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effbab002 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT1 00010000:00010000:3.0:1762166978.086624:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effbab002 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT1 00010000:00010000:3.0:1762166978.086635:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:3.0:1762166978.086637:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166978.086643:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbaaf5a lrc: 0/0,0 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e10 expref: 531 pid: 6495 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166978.086719:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+530:61852:x1847765450495872:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 6257us (6359us total) trans 4294992108 rc 0/0 00000100:00100000:3.0:1762166978.086728:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11855 00000020:00080000:3.0:1762166978.086731:0:6497:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1762166978.087996:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.088055:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450496384 00000100:00100000:1.0:1762166978.088060:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450496384 00000100:00100000:1.0:1762166978.088096:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30502 00000100:00100000:1.0:1762166978.088105:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+530:61852:x1847765450496384:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166978.088119:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166978.088135:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbab010 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9e48 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.088179:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbab010 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e48 expref: 531 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.088192:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbab010 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e48 expref: 531 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.088209:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166978.088212:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166978.088215:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355ba00, rc 0) 00000100:00100000:1.0:1762166978.088251:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+531:61852:x1847765450496384:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 148us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166978.088259:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30502 00000100:00100000:1.0:1762166978.089841:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166978.089878:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450496640 00000100:00100000:3.0:1762166978.089883:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450496640 00000100:00100000:3.0:1762166978.089912:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11856 00000100:00100000:3.0:1762166978.089920:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+531:61852:x1847765450496640:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:3.0:1762166978.090057:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+532:61852:x1847765450496640:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 138us (217us total) trans 4294992109 rc 0/0 00000100:00100000:3.0:1762166978.090065:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11856 00000100:00100000:0.0:1762166978.091132:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166978.091196:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450496896 00000100:00100000:3.0:1762166978.091209:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450496896 00000100:00100000:3.0:1762166978.091269:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11857 00000100:00100000:3.0:1762166978.091280:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7be7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+532:61852:x1847765450496896:12345-192.168.204.38@tcp:35:lfs.0 00000004:00080000:3.0:1762166978.091539:0:6497:0:(mdd_object.c:3965:mdd_close()) Object [0x240000404:0x60d:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:3.0:1762166978.091631:0:6497:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472600/0x2f180c4effbab017 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x60d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 00010000:00010000:3.0:1762166978.091649:0:6497:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472600/0x2f180c4effbab017 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x60d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6497 initiator: MDT1 00010000:00010000:3.0:1762166978.091662:0:6497:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472600/0x2f180c4effbab017 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x60d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6497 initiator: MDT1 00010000:00010000:3.0:1762166978.091670:0:6497:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472600/0x2f180c4effbab017 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x60d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6497 initiator: MDT1 00010000:00010000:3.0:1762166978.091676:0:6497:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472600/0x2f180c4effbab017 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x60d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6497 initiator: MDT1 00010000:00010000:3.0:1762166978.091682:0:6497:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472600/0x2f180c4effbab017 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x60d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6497 initiator: MDT1 00010000:00010000:3.0:1762166978.091704:0:6497:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1762166978.091737:0:7420:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1762166978.091748:0:7420:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472600/0x2f180c4effbab017 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x60d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166978.091758:0:7420:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8472600 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166978.091763:0:7420:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472600/0x2f180c4effbab017 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x60d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166978.091772:0:7420:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472600/0x2f180c4effbab017 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x60d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166978.091789:0:7420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x60d:0x0].0x0 (ffff945bc809b500) 00010000:00010000:0.0:1762166978.091792:0:7420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1762166978.091797:0:7420:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472600/0x2f180c4effbab017 lrc: 1/0,0 mode: --/PW res: [0x240000404:0x60d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166978.091804:0:7420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472600/0x2f180c4effbab017 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x60d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166978.091822:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166978.091824:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166978.091829:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166978.091927:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7be7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+533:61852:x1847765450496896:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 648us (793us total) trans 4294992110 rc 0/0 00000100:00100000:3.0:1762166978.091937:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11857 00000100:00100000:0.0:1762166978.103174:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.103263:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450497024 00000100:00100000:1.0:1762166978.103277:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450497024 00000100:00100000:1.0:1762166978.103343:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30503 00000100:00100000:1.0:1762166978.103355:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+533:61853:x1847765450497024:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166978.103388:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166978.103413:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbab01e lrc: 2/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9e4f expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.103522:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbab025 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166978.103544:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbab025 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.103555:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbab025 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.103567:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbab02c lrc: 3/1,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166978.103571:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbab02c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.103575:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbab02c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.103662:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355be00/0x2f180c4effbab033 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166978.103670:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355be00/0x2f180c4effbab033 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.103677:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355be00/0x2f180c4effbab033 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:1.0:1762166978.103725:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 259346 00000004:00200000:1.0:1762166978.103730:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166978.103751:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355be00/0x2f180c4effbab033 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.103761:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355be00/0x2f180c4effbab033 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.103768:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbab025 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.103773:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbab025 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.103777:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbab025 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.103781:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbab025 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.103785:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355a800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166978.103787:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbab025 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.103792:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbab025 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.103801:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0x0 (ffff945bc812ee00) 00010000:00010000:1.0:1762166978.103803:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166978.103807:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbab025 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.103810:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbab025 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.103820:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbab02c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.103824:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbab02c lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.103827:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbab02c lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.103830:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355b400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166978.103831:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbab02c lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.103834:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbab02c lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.103838:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0xdd396665 (ffff945bc812e700) 00010000:00010000:1.0:1762166978.103839:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166978.103840:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbab02c lrc: 2/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.103843:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbab02c lrc: 0/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.103879:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbab01e lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e4f expref: 535 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.103890:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355be00/0x2f180c4effbab033 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e4f expref: 534 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.103895:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166978.103897:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166978.103899:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355be00, rc 0) 00000100:00100000:1.0:1762166978.103965:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+534:61853:x1847765450497024:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 611us (806us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166978.103973:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30503 00000100:00100000:1.0:1762166978.105857:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.105961:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450497280 00000100:00100000:2.0:1762166978.105976:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450497280 00000100:00100000:2.0:1762166978.106044:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30504 00000100:00100000:2.0:1762166978.106055:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+534:61853:x1847765450497280:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166978.106086:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166978.106106:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9400/0x2f180c4effbab03a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9e56 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.106206:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbab041 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166978.106220:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbab041 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.106230:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbab041 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:2.0:1762166978.106240:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 259346 00010000:00010000:2.0:1762166978.106351:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9400/0x2f180c4effbab03a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e56 expref: 537 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.106372:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbab041 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e56 expref: 536 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.106379:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166978.106383:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1762166978.106386:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa8200, rc 0) 00000100:00100000:2.0:1762166978.106455:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+536:61853:x1847765450497280:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 403us (604us total) trans 4294992111 rc 0/0 00000100:00100000:2.0:1762166978.106462:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30504 00000100:00100000:0.0:1762166978.107936:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.107979:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450497536 00000100:00100000:2.0:1762166978.107986:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450497536 00000100:00100000:2.0:1762166978.108026:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30505 00000100:00100000:2.0:1762166978.108033:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5807100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+536:61853:x1847765450497536:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166978.108050:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166978.108062:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbab04f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9e5d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.108126:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbab056 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166978.108137:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbab056 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.108145:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbab056 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:2.0:1762166978.108154:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 259346 00010000:00010000:2.0:1762166978.108222:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbab04f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e5d expref: 539 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.108237:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbab056 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e5d expref: 538 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.108245:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166978.108247:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166978.108250:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa9c00, rc 0) 00000100:00100000:2.0:1762166978.108281:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5807100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+538:61853:x1847765450497536:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 250us (350us total) trans 4294992112 rc 0/0 00000100:00100000:2.0:1762166978.108286:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30505 00000100:00100000:0.0:1762166978.142922:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.143006:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450497664 00000100:00100000:2.0:1762166978.143016:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450497664 00000100:00100000:2.0:1762166978.143094:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2368 00000100:00100000:2.0:1762166978.143104:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5806a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+22:2417:x1847765450497664:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:2.0:1762166978.143140:0:8388:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbab064 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.143155:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166978.143157:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166978.143163:0:8388:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbab064 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.143181:0:8388:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbab064 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.144793:0:8388:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbab064 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.144805:0:8388:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbab064 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.144813:0:8388:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbab064 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.144819:0:8388:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa9000 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166978.144824:0:8388:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbab064 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.144831:0:8388:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbab064 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.144848:0:8388:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbab064 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.144855:0:8388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbab064 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166978.144935:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5806a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+22:2417:x1847765450497664:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 1829us (2024us total) trans 0 rc 259346/259346 00000100:00100000:2.0:1762166978.144944:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2368 00000100:00100000:0.0:1762166978.147410:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.147472:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450497792 00000100:00100000:2.0:1762166978.147504:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450497792 00000100:00100000:2.0:1762166978.147565:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2369 00000100:00100000:2.0:1762166978.147577:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5804a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450497792:12345-192.168.204.38@tcp:3:lfs.0 00002000:00010000:2.0:1762166978.147623:0:8388:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa8a:0x0] initial LVB size: 259346, mtime: 0x690888c2, atime: 0x690888c2, ctime: 0x690888c2, blocks: 0x90 00010000:00010000:2.0:1762166978.147631:0:8388:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9400/0x2f180c4effbab06b lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa8a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.147655:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166978.147657:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166978.147662:0:8388:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9400/0x2f180c4effbab06b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa8a:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.147675:0:8388:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9400/0x2f180c4effbab06b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa8a:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.149753:0:8388:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9400/0x2f180c4effbab06b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa8a:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.149764:0:8388:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9400/0x2f180c4effbab06b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa8a:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.149774:0:8388:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9400/0x2f180c4effbab06b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa8a:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.149780:0:8388:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa9400 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166978.149783:0:8388:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9400/0x2f180c4effbab06b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa8a:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.149788:0:8388:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9400/0x2f180c4effbab06b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa8a:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.149805:0:8388:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9400/0x2f180c4effbab06b lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa8a:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.149812:0:8388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9400/0x2f180c4effbab06b lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa8a:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166978.149898:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5804a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450497792:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 2322us (2498us total) trans 0 rc 259346/259346 00000100:00100000:2.0:1762166978.149909:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2369 00000100:00100000:1.0:1762166978.158244:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.158324:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450497920 00000100:00100000:2.0:1762166978.158340:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450497920 00000100:00100000:2.0:1762166978.158423:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 875 00000100:00100000:2.0:1762166978.158435:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+538:61853:x1847765450497920:12345-192.168.204.38@tcp:103:lfs.0 00010000:00010000:2.0:1762166978.158454:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166978.158503:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbab056 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e5d expref: 538 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.158532:0:7421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166978.158537:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166978.158621:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+537:61853:x1847765450497920:12345-192.168.204.38@tcp:103:lfs.0 Request processed in 188us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166978.158629:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 875 00000100:00100000:0.0:1762166978.159712:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166978.159751:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450498176 00000100:00100000:3.0:1762166978.159756:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450498176 00000100:00100000:3.0:1762166978.159792:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11858 00000100:00100000:3.0:1762166978.159802:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5804000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+537:61853:x1847765450498176:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:3.0:1762166978.159989:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5804000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+538:61853:x1847765450498176:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 185us (275us total) trans 4294992113 rc 0/0 00000100:00100000:3.0:1762166978.159994:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11858 00000100:00100000:0.0:1762166978.161969:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.162025:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450498432 00000100:00100000:2.0:1762166978.162032:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450498432 00000100:00100000:2.0:1762166978.162073:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30506 00000100:00100000:2.0:1762166978.162082:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+538:61766:x1847765450498432:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:2.0:1762166978.162096:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166978.162112:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9400/0x2f180c4effbab072 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9e64 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.162192:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbab079 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166978.162205:0:6495:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355be00/0x2f180c4effbab033 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e4f expref: 539 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.162213:0:6495:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbab079 lrc: 4/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.162243:0:6495:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355be00/0x2f180c4effbab033 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e4f expref: 539 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.162255:0:6495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355be00/0x2f180c4effbab033 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e4f expref: 539 pid: 6495 timeout: 697 lvb_type: 0 00000100:00100000:2.0:1762166978.162272:0:6495:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55de680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6495:1847765449724544:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166978.162360:0:6495:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc56bf6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166978.163172:0:6495:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55de680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6495:1847765449724544:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166978.163188:0:6495:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbab079 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000100:00100000:0.0:1762166978.163342:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.163386:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450498560 00000100:00100000:2.0:1762166978.163390:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450498560 00010000:00010000:2.0:1762166978.163404:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355be00/0x2f180c4effbab033 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e4f expref: 540 pid: 6495 timeout: 697 lvb_type: 0 00000100:00100000:2.0:1762166978.163429:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9599 00000100:00100000:2.0:1762166978.163439:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff1aa050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+540:2418:x1847765450498560:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166978.163449:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166978.163456:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355be00/0x2f180c4effbab033 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e4f expref: 540 pid: 6495 timeout: 697 lvb_type: 0 00010000:00010000:2.0:1762166978.163468:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355be00/0x2f180c4effbab033 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e4f expref: 540 pid: 6495 timeout: 697 lvb_type: 0 00010000:00010000:2.0:1762166978.163505:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355be00/0x2f180c4effbab033 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e4f expref: 540 pid: 6495 timeout: 697 lvb_type: 0 00010000:00010000:2.0:1762166978.163520:0:7421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166978.163525:0:7421:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbab079 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.163538:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbab079 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.163543:0:7421:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbab079 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.163563:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166978.163590:0:6495:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbab079 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000100:00100000:2.0:1762166978.163591:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff1aa050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+539:2418:x1847765450498560:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 153us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166978.163603:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9599 00010000:00010000:1.0:1762166978.163608:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbab079 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:1.0:1762166978.163626:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 259346 00010000:00010000:1.0:1762166978.163735:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9400/0x2f180c4effbab072 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e64 expref: 540 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.163752:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbab079 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e64 expref: 539 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.163760:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166978.163763:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1762166978.163766:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa9000, rc 0) 00000100:00100000:1.0:1762166978.163799:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+539:61766:x1847765450498432:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 1718us (1832us total) trans 4294992114 rc 0/0 00000100:00100000:1.0:1762166978.163807:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30506 00000100:00100000:0.0:1762166978.164838:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.164888:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450498688 00000100:00100000:1.0:1762166978.164892:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450498688 00000100:00100000:1.0:1762166978.164923:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30507 00000100:00100000:1.0:1762166978.164933:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+539:61766:x1847765450498688:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:1.0:1762166978.164948:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166978.164958:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbab087 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9e6b expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.165012:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbab08e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166978.165019:0:6495:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbab079 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e64 expref: 540 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.165024:0:6495:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbab08e lrc: 4/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.165040:0:6495:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbab079 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e64 expref: 540 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.165047:0:6495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbab079 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e64 expref: 540 pid: 6495 timeout: 697 lvb_type: 0 00000100:00100000:1.0:1762166978.165055:0:6495:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6495:1847765449724672:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166978.165094:0:6495:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cee083e40 going to sleep for 11 seconds 00000100:00100000:1.0:1762166978.165727:0:6495:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6495:1847765449724672:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166978.165738:0:6495:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbab08e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000100:00100000:0.0:1762166978.166019:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.166050:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450498816 00000100:00100000:2.0:1762166978.166055:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450498816 00010000:00010000:2.0:1762166978.166069:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbab079 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e64 expref: 541 pid: 6495 timeout: 697 lvb_type: 0 00000100:00100000:2.0:1762166978.166093:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9600 00000100:00100000:2.0:1762166978.166105:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4011f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+541:2419:x1847765450498816:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166978.166114:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166978.166119:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbab079 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e64 expref: 541 pid: 6495 timeout: 697 lvb_type: 0 00010000:00010000:2.0:1762166978.166129:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbab079 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e64 expref: 541 pid: 6495 timeout: 697 lvb_type: 0 00010000:00010000:2.0:1762166978.166143:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbab079 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e64 expref: 541 pid: 6495 timeout: 697 lvb_type: 0 00010000:00010000:2.0:1762166978.166156:0:7421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166978.166160:0:7421:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbab08e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.166165:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbab08e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.166169:0:7421:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbab08e lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.166186:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166978.166199:0:6495:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbab08e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.166206:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbab08e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000100:00100000:2.0:1762166978.166224:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4011f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+540:2419:x1847765450498816:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 120us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166978.166233:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9600 00000004:00200000:1.0:1762166978.166235:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 259346 00000004:00200000:1.0:1762166978.166241:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166978.166257:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbab08e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.166279:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbab087 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e6b expref: 540 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.166292:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbab08e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e6b expref: 539 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.166300:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166978.166302:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166978.166305:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355ac00, rc 0) 00000100:00100000:1.0:1762166978.166341:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+539:61766:x1847765450498688:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 1410us (1505us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166978.166348:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30507 00000100:00100000:0.0:1762166978.167548:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.167583:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.167597:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450498944 00000100:00100000:2.0:1762166978.167603:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450498944 00000100:00100000:2.0:1762166978.167637:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450499072 00000100:00100000:2.0:1762166978.167641:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450499072 00000100:00100000:3.0:1762166978.167645:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19015 00000100:00100000:3.0:1762166978.167658:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4011500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450498944:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:3.0:1762166978.167671:0:8383:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1762166978.167673:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19016 00000100:00100000:2.0:1762166978.167686:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4013100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450499072:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:3.0:1762166978.167688:0:8383:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc8472000/0x2f180c4effbab095 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa8a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9e72 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.167697:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:3.0:1762166978.167709:0:8383:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa8a:0x0] initial LVB size: 259346, mtime: 0x690888c2, atime: 0x690888c2, ctime: 0x690888c2, blocks: 0x90 00010000:00010000:2.0:1762166978.167711:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbab09c lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa89:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9e79 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.167725:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166978.167729:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166978.167736:0:8383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8472000/0x2f180c4effbab095 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e72 expref: 18 pid: 8383 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166978.167750:0:8383:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc8472000/0x2f180c4effbab095 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e72 expref: 18 pid: 8383 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1762166978.167755:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55de680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765449724800:192.168.204.38@tcp:106: 00010000:00010000:3.0:1762166978.167769:0:8383:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8472000, rc 0) 00000100:00100000:3.0:1762166978.167811:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4011500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450498944:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 156us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166978.167814:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc56bff00 going to sleep for 11 seconds 00000100:00100000:3.0:1762166978.167819:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19015 00000100:00100000:2.0:1762166978.168646:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55de680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765449724800:192.168.204.38@tcp:106: 00010000:00010000:2.0:1762166978.168665:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbab09c lrc: 1/0,0 mode: --/PR res: [0x2c0000400:0xa89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e79 expref: 23 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166978.168685:0:28434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbab09c lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e79 expref: 23 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166978.168696:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa9c00, rc 0) 00000100:00100000:2.0:1762166978.168726:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4013100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450499072:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 1044us (1142us total) trans 0 rc 301/301 00000100:00100000:2.0:1762166978.168733:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19016 00000100:00100000:0.0:1762166978.169772:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.169803:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450499200 00000100:00100000:2.0:1762166978.169807:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450499200 00000100:00100000:2.0:1762166978.169836:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19017 00000100:00100000:2.0:1762166978.169843:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4013480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450499200:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:2.0:1762166978.169853:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166978.169862:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbab0a3 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa89:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9e80 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166978.169902:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55de680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765449724928:192.168.204.38@tcp:106: 00000100:00100000:2.0:1762166978.169942:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc56bff00 going to sleep for 11 seconds 00000100:00100000:2.0:1762166978.170920:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55de680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765449724928:192.168.204.38@tcp:106: 00010000:00010000:2.0:1762166978.170938:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbab0a3 lrc: 1/0,0 mode: --/PR res: [0x2c0000400:0xa89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e80 expref: 23 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166978.170951:0:28434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbab0a3 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e80 expref: 23 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166978.170966:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa8600, rc 0) 00000100:00100000:2.0:1762166978.171000:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4013480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450499200:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 1157us (1229us total) trans 0 rc 301/301 00000100:00100000:2.0:1762166978.171008:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19017 00000100:00100000:3.0:1762166978.172072:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.172108:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450499456 00000100:00100000:2.0:1762166978.172113:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450499456 00000100:00100000:2.0:1762166978.172150:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11859 00000100:00100000:2.0:1762166978.172158:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+539:61766:x1847765450499456:12345-192.168.204.38@tcp:35:fsx.0 00000100:00100000:2.0:1762166978.172342:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+540:61766:x1847765450499456:12345-192.168.204.38@tcp:35:fsx.0 Request processed in 185us (269us total) trans 4294992115 rc 0/0 00000100:00100000:2.0:1762166978.172349:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11859 00000100:00100000:0.0:1762166978.173098:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.173141:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450499712 00000100:00100000:1.0:1762166978.173146:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450499712 00000100:00100000:1.0:1762166978.173185:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30508 00000100:00100000:1.0:1762166978.173193:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4010000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+540:61766:x1847765450499712:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:1.0:1762166978.173204:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166978.173207:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 1 00010000:00010000:1.0:1762166978.173225:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbab08e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e6b expref: 540 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.173244:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbab041 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e56 expref: 539 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.173257:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbab010 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e48 expref: 538 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.173266:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166978.173270:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166978.173280:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbab0aa lrc: 2/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9e87 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.173315:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbab0b1 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166978.173326:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbab0b1 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.173335:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbab0b1 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000040:00080000:1.0:1762166978.173558:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5902, 88 off462200 00000004:00080000:1.0:1762166978.173567:0:6495:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 597322088731ns, next at 597529919700ns, rc = 0 00000040:00080000:1.0:1762166978.173613:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5901, 88 off462200 00000004:00080000:1.0:1762166978.173620:0:6495:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 597322142680ns, next at 597529889568ns, rc = 0 00000040:00080000:1.0:1762166978.173641:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5902, 88 off462288 00000004:00080000:1.0:1762166978.173647:0:6495:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 597322168844ns, next at 597529889568ns, rc = 0 00000040:00080000:1.0:1762166978.173660:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5903, 88 off462288 00000004:00080000:1.0:1762166978.173665:0:6495:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 597322186648ns, next at 597529919700ns, rc = 0 00000040:00080000:1.0:1762166978.173689:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5903, 88 off462376 00000004:00080000:1.0:1762166978.173694:0:6495:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 597322216349ns, next at 597529889568ns, rc = 0 00000040:00080000:1.0:1762166978.173714:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5904, 88 off462376 00000004:00080000:1.0:1762166978.173720:0:6495:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 597322242390ns, next at 597529919700ns, rc = 0 00000001:00080000:3.0:1762166978.174823:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294992116 is committed 00000004:00080000:3.0:1762166978.174831:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3266 committed 00000004:00080000:3.0:1762166978.174843:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3269 committed 00000004:00080000:3.0:1762166978.174851:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3265 committed 00000004:00080000:3.0:1762166978.174853:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3268 committed 00010000:00010000:1.0:1762166978.174854:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbaafed lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x60d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00000004:00080000:3.0:1762166978.174856:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3267 committed 00000004:00080000:3.0:1762166978.174860:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3264 committed 00010000:00010000:1.0:1762166978.174877:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbaafed lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x60d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.174886:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbaafed lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x60d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.174894:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355a200 already unused, calling callback (ffffffffc18e2310) 00000020:00080000:3.0:1762166978.174898:0:7412:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff945cc2c72900 refcount 2 committed 0 result 0 batchid 49 00010000:00010000:1.0:1762166978.174900:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbaafed lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x60d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00000020:00080000:3.0:1762166978.174905:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cf3bd1400 obd lustre-OST0001-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff945ccba916c0 00000020:00080000:3.0:1762166978.174914:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cf3bd1300 obd lustre-OST0000-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff945cc2c72840 00010000:00010000:1.0:1762166978.174914:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbaafed lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x60d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00000020:00080000:3.0:1762166978.174920:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cf3bd1500 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff945bc5c45800 00000020:00080000:3.0:1762166978.174926:0:7412:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000400:0x2:0x0].48 00010000:00010000:1.0:1762166978.174931:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x60d:0x0].0x0 (ffff945bc809b500) 00010000:00010000:1.0:1762166978.174936:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166978.174940:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbaafed lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x60d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.174947:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbaafed lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x60d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000020:00080000:3.0:1762166978.174950:0:7412:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0001: 48 batchid updated 00010000:00010000:1.0:1762166978.174972:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbaaffb lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.174982:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbaaffb lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.174988:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbaaffb lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00000100:00100000:2.0:1762166978.174994:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449725056:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1762166978.174996:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355b200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166978.175002:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbaaffb lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.175010:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbaaffb lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.175021:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00000020:00080000:0.0:1762166978.175022:0:7435:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 49 committed batchid 48 00010000:00010000:1.0:1762166978.175024:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166978.175037:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1762166978.175043:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbaaffb lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.175051:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbaaffb lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000100:00100000:2.0:1762166978.175063:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449725568:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166978.175073:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449725056 00000100:00100000:3.0:1762166978.175080:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449725056 00000100:00100000:1.0:1762166978.175080:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4012a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449725184:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1762166978.175087:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166978.175110:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4011880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449726080:0@lo:2:osp-syn-0-1.0 00000020:00080000:0.0:1762166978.175115:0:7435:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 47 cancel update log [0x240000400:0x2:0x0].45: rc = 0 00000100:00100000:1.0:1762166978.175131:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166978.175132:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449725568 00000100:00100000:3.0:1762166978.175137:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449725568 00000020:00080000:0.0:1762166978.175151:0:7435:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 48 cancel update log [0x240000400:0x2:0x0].47: rc = 0 00000100:00100000:2.0:1762166978.175160:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166978.175164:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4010380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449725696:0@lo:6:osp-syn-0-1.0 00000020:00080000:0.0:1762166978.175167:0:7435:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 48 00000100:00100000:3.0:1762166978.175173:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449725184 00000100:00100000:3.0:1762166978.175177:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449725184 00000100:00100000:0.0:1762166978.175185:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449725312:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1762166978.175190:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1762166978.175197:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166978.175200:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449725440:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166978.175212:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449726080 00000100:00100000:3.0:1762166978.175216:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449726080 00000100:00100000:0.0:1762166978.175227:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166978.175231:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4011c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449726208:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166978.175255:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449725696 00000100:00100000:3.0:1762166978.175260:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449725696 00000100:00100000:2.0:1762166978.175261:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449725312 00000100:00100000:2.0:1762166978.175267:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449725312 00000100:00100000:0.0:1762166978.175271:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449725824:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1762166978.175279:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166978.175283:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19018 00000100:00100000:3.0:1762166978.175295:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3d58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+8:3634:x1847765449725056:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1762166978.175296:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449726208 00000100:00100000:2.0:1762166978.175300:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449726208 00000100:00100000:0.0:1762166978.175309:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:3.0:1762166978.175318:0:28434:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:2695 count 1 00000100:00100000:1.0:1762166978.175321:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449725824 00000100:00100000:1.0:1762166978.175328:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449725824 00000100:00100000:2.0:1762166978.175332:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19019 00010000:00010000:3.0:1762166978.175337:0:28434:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc8472800/0x2f180c4effbab0b8 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa87:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166978.175347:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+9:3634:x1847765449725568:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1762166978.175350:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166978.175358:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19020 00010000:00010000:3.0:1762166978.175362:0:28434:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effbaa192 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e991d expref: 21 pid: 35247 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166978.175367:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4011180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449725952:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1762166978.175372:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+9:3635:x1847765449725184:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1762166978.175379:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166978.175382:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166978.175386:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472800/0x2f180c4effbab0b8 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0xa87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1762166978.175392:0:28874:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:2696 count 1 00000100:00100000:0.0:1762166978.175400:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1762166978.175416:0:28434:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effbaa192 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e991d expref: 21 pid: 35247 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762166978.175419:0:28874:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa88:0x0] initial LVB size: 177340, mtime: 0x690888c1, atime: 0x690888bf, ctime: 0x690888c1, blocks: 0x110 00010000:00010000:1.0:1762166978.175431:0:28874:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945cc355b000/0x2f180c4effbab0bf lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166978.175436:0:8382:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:0.0:1762166978.175439:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449725440 00010000:00010000:3.0:1762166978.175440:0:28434:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effbaa192 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e991d expref: 21 pid: 35247 timeout: 697 lvb_type: 0 00002000:00010000:2.0:1762166978.175441:0:8382:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00010000:00010000:1.0:1762166978.175446:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1762166978.175446:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449725440 00002000:00010000:2.0:1762166978.175447:0:8382:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00010000:00010000:1.0:1762166978.175452:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00002000:00010000:2.0:1762166978.175453:0:8382:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166978.175458:0:8382:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00010000:1.0:1762166978.175459:0:28874:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cc355b000/0x2f180c4effbab0bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166978.175468:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bccb7ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765449726336:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166978.175471:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449725952 00000100:00100000:0.0:1762166978.175502:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449725952 00010000:00010000:1.0:1762166978.175503:0:28874:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cc355b000/0x2f180c4effbab0bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166978.175511:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+11:3634:x1847765449725568:12345-0@lo:2:osp-syn-1-1.0 Request processed in 170us (426us total) trans 17179876442 rc 0/0 00010000:00010000:1.0:1762166978.175518:0:28874:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945cc355b000/0x2f180c4effbab0bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166978.175521:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19019 00000100:00100000:0.0:1762166978.175531:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19021 00010000:00010000:1.0:1762166978.175532:0:28874:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945cc355b000/0x2f180c4effbab0bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166978.175541:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19022 00000100:00100000:0.0:1762166978.175547:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+10:3634:x1847765449726080:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1762166978.175553:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+10:3635:x1847765449725696:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1762166978.175557:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf3a33780 going to sleep for 11 seconds 00010000:00010000:1.0:1762166978.175559:0:28874:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1762166978.175565:0:8382:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:2697 count 1 00010000:00010000:2.0:1762166978.175575:0:8382:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9000/0x2f180c4effbab0c6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa89:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166978.175580:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19023 00010000:00010000:2.0:1762166978.175592:0:8382:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9a00/0x2f180c4effbaac2e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d0d expref: 17 pid: 8380 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166978.175594:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4010e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+10:3636:x1847765449725312:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1762166978.175606:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166978.175609:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166978.175612:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9000/0x2f180c4effbab0c6 lrc: 4/0,1 mode: --/PW res: [0x280000400:0xa89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1762166978.175614:0:35248:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:2696 count 1 00002000:00010000:0.0:1762166978.175621:0:9165:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166978.175626:0:9165:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:0.0:1762166978.175629:0:9165:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00010000:00010000:3.0:1762166978.175630:0:35248:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc8473a00/0x2f180c4effbab0cd lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166978.175632:0:9165:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:0.0:1762166978.175639:0:9165:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00010000:00010000:2.0:1762166978.175641:0:8382:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9a00/0x2f180c4effbaac2e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d0d expref: 17 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.175654:0:35248:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbaad38 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d45 expref: 21 pid: 8383 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166978.175657:0:8382:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9a00/0x2f180c4effbaac2e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d0d expref: 17 pid: 8380 timeout: 697 lvb_type: 0 00000100:00100000:0.0:1762166978.175676:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+12:3634:x1847765449726080:12345-0@lo:2:osp-syn-0-1.0 Request processed in 133us (517us total) trans 21474843321 rc 0/0 00000100:00100000:2.0:1762166978.175679:0:8382:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55dfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8382:1847765449726464:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166978.175684:0:35248:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166978.175688:0:35248:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166978.175693:0:35248:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8473a00/0x2f180c4effbab0cd lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166978.175694:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19021 00000100:00100000:2.0:1762166978.175705:0:8382:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc56bf480 going to sleep for 11 seconds 00000100:00100000:0.0:1762166978.175719:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19024 00010000:00010000:3.0:1762166978.175721:0:35248:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbaad38 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d45 expref: 21 pid: 8383 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1762166978.175728:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19025 00000100:00100000:0.0:1762166978.175734:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+11:3635:x1847765449726208:12345-0@lo:2:osp-syn-0-1.0 00010000:00010000:3.0:1762166978.175741:0:35248:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbaad38 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d45 expref: 21 pid: 8383 timeout: 697 lvb_type: 1 00000100:00100000:2.0:1762166978.175741:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4013800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+10:3636:x1847765449725824:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166978.175758:0:35248:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bccb7f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:35248:1847765449726592:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166978.175788:0:35248:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf3a33600 going to sleep for 11 seconds 00002000:00010000:0.0:1762166978.175800:0:9165:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa8a:0x0] updating lvb size from disk: 259346 -> 259346 00002000:00010000:0.0:1762166978.175804:0:9165:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa8a:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:0.0:1762166978.175807:0:9165:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa8a:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:0.0:1762166978.175810:0:9165:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa8a:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:0.0:1762166978.175813:0:9165:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa8a:0x0] updating lvb blocks from disk: 144 -> 144 00002000:00010000:2.0:1762166978.175826:0:35247:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa89:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166978.175831:0:35247:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa89:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166978.175833:0:35247:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa89:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166978.175835:0:35247:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa89:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166978.175837:0:35247:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa89:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1762166978.175860:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+12:3635:x1847765449726208:12345-0@lo:2:osp-syn-0-1.0 Request processed in 130us (585us total) trans 21474843323 rc 0/0 00000100:00100000:0.0:1762166978.175886:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19024 00000100:00100000:2.0:1762166978.175887:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4013800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+11:3636:x1847765449725824:12345-0@lo:2:osp-syn-1-1.0 Request processed in 147us (576us total) trans 17179876443 rc 0/0 00000100:00100000:2.0:1762166978.175896:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19025 00000100:00100000:0.0:1762166978.175912:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19026 00000100:00100000:2.0:1762166978.175919:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19027 00000100:00100000:0.0:1762166978.175925:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4010a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+10:3634:x1847765449725440:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1762166978.175931:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4012680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+11:3634:x1847765449725952:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:0.0:1762166978.175998:0:9165:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 259346 -> 259346 00002000:00010000:0.0:1762166978.176001:0:9165:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:0.0:1762166978.176004:0:9165:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:0.0:1762166978.176006:0:9165:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166978.176008:0:35247:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166978.176009:0:9165:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 352 -> 352 00002000:00010000:2.0:1762166978.176015:0:35247:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb mtime from disk: 1762166966 -> 1762166966 00002000:00010000:2.0:1762166978.176019:0:35247:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1762166978.176022:0:35247:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb ctime from disk: 1762166966 -> 1762166966 00002000:00010000:2.0:1762166978.176024:0:35247:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1762166978.176047:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4010a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+11:3634:x1847765449725440:12345-0@lo:2:osp-syn-1-1.0 Request processed in 127us (702us total) trans 17179876444 rc 0/0 00000100:00100000:0.0:1762166978.176056:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19026 00000100:00100000:2.0:1762166978.176060:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4012680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+12:3634:x1847765449725952:12345-0@lo:2:osp-syn-0-1.0 Request processed in 133us (661us total) trans 21474843324 rc 0/0 00000100:00100000:2.0:1762166978.176066:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19027 00000100:00100000:1.0:1762166978.176104:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+11:3635:x1847765449725184:12345-0@lo:6:osp-syn-0-1.0 Request processed in 735us (973us total) trans 21474843322 rc 0/0 00000004:00080000:2.0:1762166978.176107:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc55de300/2, rc 0, transno 17179876443 00000100:00100000:2.0:1762166978.176116:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449725824:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1762166978.176118:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19020 00010000:00010000:0.0:1762166978.176123:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbab0b1 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e87 expref: 525 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.176135:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166978.176139:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000004:00080000:2.0:1762166978.176141:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc55dc380/2, rc 0, transno 17179876444 00000100:00100000:2.0:1762166978.176148:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449725440:0@lo:2:osp-syn-1-1.0 00010000:00010000:1.0:1762166978.176153:0:6483:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1762166978.176153:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbab0aa lrc: 0/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e87 expref: 525 pid: 6495 timeout: 0 lvb_type: 3 00000004:00080000:2.0:1762166978.176160:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc4011180/2, rc 0, transno 21474843324 00010000:00010000:1.0:1762166978.176162:0:6483:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945cc355b000/0x2f180c4effbab0bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166978.176169:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4011180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449725952:0@lo:2:osp-syn-0-1.0 00010000:00010000:0.0:1762166978.176175:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbab0b1 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e87 expref: 524 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.176177:0:6483:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355b000 already unused, calling callback (ffffffffc0cd9320) 00000004:00080000:2.0:1762166978.176182:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc4011880/2, rc 0, transno 21474843321 00010000:00010000:1.0:1762166978.176183:0:6483:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945cc355b000/0x2f180c4effbab0bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166978.176190:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4011880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449726080:0@lo:2:osp-syn-0-1.0 00010000:00010000:1.0:1762166978.176201:0:6483:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945cc355b000/0x2f180c4effbab0bf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1762166978.176204:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc55dd500/2, rc 0, transno 17179876442 00010000:00010000:0.0:1762166978.176206:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00000100:00100000:2.0:1762166978.176214:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449725568:0@lo:2:osp-syn-1-1.0 00010000:00010000:0.0:1762166978.176214:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1762166978.176219:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355aa00, rc 0) 00010000:00010000:1.0:1762166978.176222:0:6483:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945cc355b000/0x2f180c4effbab0bf lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.176231:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cc355b000/0x2f180c4effbab0bf lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.176250:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166978.176252:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166978.176255:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1762166978.176257:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc4012a00/2, rc 0, transno 21474843322 00000100:00100000:2.0:1762166978.176261:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4012a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449725184:0@lo:6:osp-syn-0-1.0 00000004:00080000:2.0:1762166978.176269:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc4011c00/2, rc 0, transno 21474843323 00000100:00100000:0.0:1762166978.176270:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4010000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+524:61766:x1847765450499712:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 3076us (3171us total) trans 4294992116 rc 0/0 00000100:00100000:2.0:1762166978.176273:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4011c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449726208:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1762166978.176285:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30508 00000100:00100000:2.0:1762166978.177359:0:8382:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55dfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8382:1847765449726464:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166978.177375:0:8382:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9000/0x2f180c4effbab0c6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166978.177441:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bccb7ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765449726336:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166978.177469:0:28434:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc8472800/0x2f180c4effbab0b8 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166978.177565:0:35248:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bccb7f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:35248:1847765449726592:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166978.177567:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:1.0:1762166978.177588:0:35248:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc8473a00/0x2f180c4effbab0cd lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166978.177617:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.177637:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450499840 00000100:00100000:2.0:1762166978.177644:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450499840 00000100:00100000:0.0:1762166978.177649:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166978.177696:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450500096 00000100:00100000:3.0:1762166978.177703:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450500096 00000100:00100000:1.0:1762166978.177703:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450499968 00000100:00100000:1.0:1762166978.177719:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450499968 00010000:00010000:2.0:1762166978.177722:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effbaa192 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e991d expref: 23 pid: 35247 timeout: 697 lvb_type: 0 00010000:00010000:3.0:1762166978.177738:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbaad38 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d45 expref: 23 pid: 8383 timeout: 697 lvb_type: 1 00010000:00010000:1.0:1762166978.177741:0:6480:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9a00/0x2f180c4effbaac2e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d0d expref: 18 pid: 8380 timeout: 697 lvb_type: 0 00000100:00100000:2.0:1762166978.177766:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9601 00000100:00100000:2.0:1762166978.177792:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4012300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765450499840:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166978.177805:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1762166978.177808:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9602 00010000:00010000:2.0:1762166978.177816:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effbaa192 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa87:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e991d expref: 23 pid: 35247 timeout: 697 lvb_type: 0 00000100:00100000:1.0:1762166978.177822:0:6480:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450499968:12345-192.168.204.38@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1762166978.177824:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9603 00010000:00010000:1.0:1762166978.177835:0:6480:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166978.177844:0:6480:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9a00/0x2f180c4effbaac2e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa89:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d0d expref: 18 pid: 8380 timeout: 697 lvb_type: 0 00010000:00010000:2.0:1762166978.177848:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effbaa192 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa87:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e991d expref: 23 pid: 35247 timeout: 697 lvb_type: 0 00000100:00100000:0.0:1762166978.177850:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+23:2417:x1847765450500096:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166978.177878:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166978.177881:0:6480:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9a00/0x2f180c4effbaac2e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa89:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d0d expref: 18 pid: 8380 timeout: 697 lvb_type: 0 00010000:00010000:0.0:1762166978.177887:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbaad38 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d45 expref: 23 pid: 8383 timeout: 697 lvb_type: 1 00010000:00010000:2.0:1762166978.177895:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effbaa192 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa87:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e991d expref: 23 pid: 35247 timeout: 697 lvb_type: 0 00010000:00010000:1.0:1762166978.177907:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9a00/0x2f180c4effbaac2e lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa89:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d0d expref: 18 pid: 8380 timeout: 697 lvb_type: 0 00010000:00010000:0.0:1762166978.177911:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbaad38 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d45 expref: 22 pid: 8383 timeout: 697 lvb_type: 1 00010000:00010000:2.0:1762166978.177914:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166978.177918:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166978.177925:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc8472800/0x2f180c4effbab0b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.177926:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166978.177931:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166978.177936:0:6480:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9000/0x2f180c4effbab0c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.177937:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbaad38 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa88:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9d45 expref: 22 pid: 8383 timeout: 697 lvb_type: 1 00010000:00010000:2.0:1762166978.177941:0:7421:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472800/0x2f180c4effbab0b8 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xa87:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.177959:0:6480:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9000/0x2f180c4effbab0c6 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.177984:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166978.177987:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166978.177988:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166978.177991:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc8473a00/0x2f180c4effbab0cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.177995:0:6480:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166978.178003:0:6479:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8473a00/0x2f180c4effbab0cd lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xa88:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.178025:0:28434:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc8472800/0x2f180c4effbab0b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166978.178029:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4012300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450499840:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 245us (465us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166978.178032:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166978.178039:0:6480:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450499968:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 216us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166978.178069:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9601 00000100:00100000:0.0:1762166978.178069:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+21:2417:x1847765450500096:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 223us (443us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166978.178071:0:28434:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8472800/0x2f180c4effbab0b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166978.178096:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9602 00010000:00010000:3.0:1762166978.178106:0:28434:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc8472800/0x2f180c4effbab0b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166978.178109:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9603 00010000:00010000:2.0:1762166978.178113:0:8382:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9000/0x2f180c4effbab0c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.178125:0:28434:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472800/0x2f180c4effbab0b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.178137:0:35248:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc8473a00/0x2f180c4effbab0cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.178147:0:8382:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9000/0x2f180c4effbab0c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.178173:0:35248:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8473a00/0x2f180c4effbab0cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.178179:0:28434:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166978.178185:0:8382:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9000/0x2f180c4effbab0c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.178195:0:35248:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc8473a00/0x2f180c4effbab0cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.178199:0:8382:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9000/0x2f180c4effbab0c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.178202:0:35248:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8473a00/0x2f180c4effbab0cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.178228:0:35248:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1762166978.178239:0:8382:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1762166978.178265:0:6482:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1762166978.178276:0:6482:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc8472800/0x2f180c4effbab0b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.178286:0:6482:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8472800 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166978.178290:0:6482:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8472800/0x2f180c4effbab0b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.178300:0:6482:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8472800/0x2f180c4effbab0b8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.178318:0:6482:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc8472800/0x2f180c4effbab0b8 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xa87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.178335:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8472800/0x2f180c4effbab0b8 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.178360:0:6482:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1762166978.178365:0:6482:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc8473a00/0x2f180c4effbab0cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.178372:0:6482:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8473a00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166978.178376:0:6482:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8473a00/0x2f180c4effbab0cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.178384:0:6482:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8473a00/0x2f180c4effbab0cd lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.178398:0:6482:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc8473a00/0x2f180c4effbab0cd lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.178407:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8473a00/0x2f180c4effbab0cd lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.178428:0:6482:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1762166978.178429:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+11:3635:x1847765449725696:12345-0@lo:6:osp-syn-0-1.0 Request processed in 2877us (3230us total) trans 21474843325 rc 0/0 00010000:00010000:0.0:1762166978.178433:0:6482:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9000/0x2f180c4effbab0c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166978.178445:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19022 00010000:00010000:0.0:1762166978.178446:0:6482:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa9000 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166978.178451:0:6482:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9000/0x2f180c4effbab0c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.178460:0:6482:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9000/0x2f180c4effbab0c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.178527:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166978.178534:0:6482:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9000/0x2f180c4effbab0c6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.178541:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166978.178545:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9000/0x2f180c4effbab0c6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.178583:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1762166978.178588:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc4010380/2, rc 0, transno 21474843325 00010000:00010000:0.0:1762166978.178590:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166978.178596:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1762166978.178598:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4010380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449725696:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1762166978.178660:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3d58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+12:3634:x1847765449725056:12345-0@lo:6:osp-syn-1-1.0 Request processed in 3366us (3618us total) trans 17179876445 rc 0/0 00000100:00100000:3.0:1762166978.178668:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19018 00000004:00080000:2.0:1762166978.178679:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc55de680/2, rc 0, transno 17179876445 00000100:00100000:2.0:1762166978.178687:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449725056:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1762166978.178735:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.178790:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450500224 00000100:00100000:0.0:1762166978.178795:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450500224 00000100:00100000:0.0:1762166978.178851:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19028 00000100:00100000:0.0:1762166978.178883:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+20:61766:x1847765450500224:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:0.0:1762166978.178899:0:8382:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1762166978.178905:0:35248:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4010e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+11:3636:x1847765449725312:12345-0@lo:6:osp-syn-1-1.0 Request processed in 3313us (3677us total) trans 17179876446 rc 0/0 00000100:00100000:1.0:1762166978.178913:0:35248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19023 00010000:00010000:0.0:1762166978.178913:0:8382:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbab0d4 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9e8e expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1762166978.178927:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc55dc700/2, rc 0, transno 17179876446 00000100:00100000:2.0:1762166978.178936:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449725312:0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1762166978.178937:0:8382:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945cc355b800/0x2f180c4effbaaf7d lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e17 expref: 21 pid: 9165 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166978.178948:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166978.178950:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166978.178954:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbab0d4 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [180224->212991] (req 180224->212991) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e8e expref: 21 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.178978:0:8382:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945cc355b800/0x2f180c4effbaaf7d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e17 expref: 21 pid: 9165 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166978.178996:0:8382:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945cc355b800/0x2f180c4effbaaf7d lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e17 expref: 21 pid: 9165 timeout: 697 lvb_type: 1 00000100:00100000:0.0:1762166978.179008:0:8382:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bc0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8382:1847765449726720:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166978.179059:0:8382:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7c0f600 going to sleep for 11 seconds 00000100:00100000:2.0:1762166978.179892:0:8382:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bc0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8382:1847765449726720:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166978.179912:0:8382:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbab0d4 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [180224->212991] (req 180224->212991) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e8e expref: 21 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.179924:0:8382:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdf600, rc 0) 00000100:00100000:2.0:1762166978.179963:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+21:61766:x1847765450500224:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 1103us (1228us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166978.179970:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19028 00000100:00100000:0.0:1762166978.180062:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.180106:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450500352 00000100:00100000:1.0:1762166978.180112:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450500352 00010000:00010000:1.0:1762166978.180138:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355b800/0x2f180c4effbaaf7d lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e17 expref: 21 pid: 9165 timeout: 697 lvb_type: 1 00000100:00100000:1.0:1762166978.180168:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9604 00000100:00100000:1.0:1762166978.180181:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450500352:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166978.180190:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166978.180204:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945cc355b800/0x2f180c4effbaaf7d lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e17 expref: 21 pid: 9165 timeout: 697 lvb_type: 1 00010000:00010000:1.0:1762166978.180214:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945cc355b800/0x2f180c4effbaaf7d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e17 expref: 21 pid: 9165 timeout: 697 lvb_type: 1 00010000:00010000:1.0:1762166978.180229:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cc355b800/0x2f180c4effbaaf7d lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e17 expref: 21 pid: 9165 timeout: 697 lvb_type: 1 00010000:00010000:1.0:1762166978.180237:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166978.180238:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166978.180242:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbab0d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 180224->212991) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e8e expref: 20 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.180248:0:6479:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbab0d4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 180224->212991) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e8e expref: 20 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.180265:0:6479:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbab0d4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 180224->212991) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e8e expref: 20 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166978.180272:0:6479:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6479:1847765449726848:192.168.204.38@tcp:105: 00000100:00100000:1.0:1762166978.180306:0:6479:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cee083540 going to sleep for 11 seconds 00000100:00100000:1.0:1762166978.181072:0:6479:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6479:1847765449726848:192.168.204.38@tcp:105: 00010000:00010000:1.0:1762166978.181083:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166978.181118:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450500352:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 943us (1056us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166978.181126:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9604 00000100:00100000:3.0:1762166978.181312:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.181377:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450500480 00000100:00100000:2.0:1762166978.181384:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450500480 00000100:00100000:2.0:1762166978.181445:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2370 00000100:00100000:2.0:1762166978.181457:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450500480:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:2.0:1762166978.181953:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 259346 -> 259346 00002000:00010000:2.0:1762166978.181958:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166978.181961:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166978.181963:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166978.181965:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 352 -> 312 00000100:00100000:2.0:1762166978.182009:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450500480:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 556us (701us total) trans 17179876447 rc 0/0 00000100:00100000:2.0:1762166978.182015:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2370 00000100:00100000:0.0:1762166978.182778:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.182820:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450500608 00000100:00100000:1.0:1762166978.182827:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450500608 00000100:00100000:1.0:1762166978.182875:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30509 00000100:00100000:1.0:1762166978.182887:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+524:61766:x1847765450500608:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:1.0:1762166978.182905:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166978.182920:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbab0db lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9e95 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.183005:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbab0e2 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166978.183017:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbab0e2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.183026:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbab0e2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:1.0:1762166978.183053:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 259346 00000004:00200000:1.0:1762166978.183057:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166978.183074:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbab0e2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.183095:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbab0db lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e95 expref: 526 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.183108:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbab0e2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e95 expref: 525 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.183115:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166978.183118:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166978.183121:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355b200, rc 0) 00000100:00100000:1.0:1762166978.183160:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+525:61766:x1847765450500608:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 276us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166978.183168:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30509 00000100:00100000:0.0:1762166978.184890:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.184935:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450500736 00000100:00100000:2.0:1762166978.184945:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450500736 00002000:00100000:2.0:1762166978.184989:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (122880->192511) req@ffff945bc5bc2300 x1847765450500736/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:9/0 lens 488/0 e 0 to 0 dl 1762166989 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166978.185001:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5bc2300 with x1847765450500736 ext(122880->192511) 00002000:00010000:2.0:1762166978.185007:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5bc2300 00000100:00100000:2.0:1762166978.185034:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2371 00000100:00100000:2.0:1762166978.185044:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450500736:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:2.0:1762166978.186066:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450500736:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 1023us (1174us total) trans 0 rc 69632/69632 00000100:00100000:2.0:1762166978.186080:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2371 00002000:00100000:2.0:1762166978.186089:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (122880->192511) req@ffff945bc5bc2300 x1847765450500736/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:9/0 lens 488/440 e 0 to 0 dl 1762166989 ref 1 fl Complete:/600/0 rc 69632/69632 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166978.186099:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5bc2300 with x1847765450500736 ext(122880->192511) 00002000:00010000:2.0:1762166978.186103:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5bc2300 00000100:00100000:0.0:1762166978.187851:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.187901:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450500992 00000100:00100000:2.0:1762166978.187908:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450500992 00000100:00100000:2.0:1762166978.187956:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11860 00000100:00100000:2.0:1762166978.187966:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+525:61766:x1847765450500992:12345-192.168.204.38@tcp:35:fsx.0 00000100:00100000:2.0:1762166978.188175:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+526:61766:x1847765450500992:12345-192.168.204.38@tcp:35:fsx.0 Request processed in 211us (328us total) trans 4294992117 rc 0/0 00000100:00100000:2.0:1762166978.188180:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11860 00000100:00100000:0.0:1762166978.196142:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.196218:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450501248 00000100:00100000:1.0:1762166978.196230:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450501248 00000100:00100000:1.0:1762166978.196292:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30510 00000100:00100000:1.0:1762166978.196303:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+526:61854:x1847765450501248:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166978.196332:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166978.196359:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbab0e9 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9e9c expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.196449:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbab0f0 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166978.196465:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbab0f0 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.196496:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbab0f0 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.196515:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbab0f7 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166978.196522:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbab0f7 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.196545:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbab0f7 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.196679:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbab0fe lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166978.196688:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbab0fe lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.196695:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbab0fe lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:1.0:1762166978.196707:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 259346 00010000:00010000:1.0:1762166978.196806:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbab0f0 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.196814:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbab0f0 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.196820:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbab0f0 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.196827:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbab0f0 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.196833:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355b800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166978.196838:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbab0f0 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.196846:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbab0f0 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.196859:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0x0 (ffff945bc812ee00) 00010000:00010000:1.0:1762166978.196876:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166978.196882:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbab0f0 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.196889:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbab0f0 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.196902:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbab0f7 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.196908:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbab0f7 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.196914:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbab0f7 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.196919:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355a200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166978.196922:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbab0f7 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.196928:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbab0f7 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.196935:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0xdd396665 (ffff945bc812e700) 00010000:00010000:1.0:1762166978.196937:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166978.196940:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbab0f7 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.196946:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbab0f7 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.196992:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbab0e9 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e9c expref: 529 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.197008:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbab0fe lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e9c expref: 528 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.197015:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166978.197018:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166978.197021:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355ba00, rc 0) 00000100:00100000:1.0:1762166978.197092:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+528:61854:x1847765450501248:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 791us (966us total) trans 4294992118 rc 0/0 00000100:00100000:1.0:1762166978.197100:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30510 00000100:00100000:3.0:1762166978.198326:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.198378:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450501376 00000100:00100000:1.0:1762166978.198385:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450501376 00000100:00100000:1.0:1762166978.198427:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 876 00000100:00100000:1.0:1762166978.198435:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+528:2417:x1847765450501376:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166978.198450:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166978.198465:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbab0fe lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e9c expref: 528 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.198499:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166978.198503:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166978.198535:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+527:2417:x1847765450501376:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 101us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166978.198542:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 876 00000100:00100000:0.0:1762166978.198930:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.198995:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450501632 00000100:00100000:2.0:1762166978.199010:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450501632 00000100:00100000:2.0:1762166978.199086:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11861 00000100:00100000:2.0:1762166978.199103:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+527:61854:x1847765450501632:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:2.0:1762166978.199333:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+528:61854:x1847765450501632:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 238us (403us total) trans 4294992119 rc 0/0 00000100:00100000:2.0:1762166978.199343:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11861 00000100:00100000:0.0:1762166978.200459:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.200548:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450501888 00000100:00100000:1.0:1762166978.200556:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450501888 00000100:00100000:1.0:1762166978.200598:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30511 00000100:00100000:1.0:1762166978.200607:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+528:61854:x1847765450501888:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166978.200623:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166978.200643:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbab10c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9ea3 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.200719:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a000/0x2f180c4effbab113 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166978.200730:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a000/0x2f180c4effbab113 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.200738:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a000/0x2f180c4effbab113 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:1.0:1762166978.200745:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 259346 00010000:00010000:1.0:1762166978.200802:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbab10c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ea3 expref: 531 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.200812:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a000/0x2f180c4effbab113 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ea3 expref: 530 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.200818:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166978.200820:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1762166978.200823:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355a000, rc 0) 00000100:00100000:1.0:1762166978.200876:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+530:61854:x1847765450501888:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 259us (410us total) trans 4294992120 rc 0/0 00000100:00100000:1.0:1762166978.200883:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30511 00000100:00100000:3.0:1762166978.202283:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.202344:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450502144 00000100:00100000:1.0:1762166978.202354:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450502144 00000100:00100000:1.0:1762166978.202401:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30512 00000100:00100000:1.0:1762166978.202411:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+530:61854:x1847765450502144:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166978.202434:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166978.202451:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbab121 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9eaa expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.202582:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355be00/0x2f180c4effbab128 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166978.202599:0:6495:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbab0e2 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e95 expref: 531 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.202608:0:6495:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355be00/0x2f180c4effbab128 lrc: 4/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.202644:0:6495:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbab0e2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e95 expref: 531 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.202660:0:6495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbab0e2 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e95 expref: 531 pid: 6495 timeout: 697 lvb_type: 0 00000100:00100000:1.0:1762166978.202675:0:6495:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6495:1847765449726976:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166978.202766:0:6495:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cee083540 going to sleep for 11 seconds 00000100:00100000:1.0:1762166978.203526:0:6495:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6495:1847765449726976:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166978.203554:0:6495:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355be00/0x2f180c4effbab128 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000100:00100000:3.0:1762166978.203781:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.203830:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450502272 00000100:00100000:1.0:1762166978.203838:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450502272 00010000:00010000:1.0:1762166978.203873:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbab0e2 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e95 expref: 532 pid: 6495 timeout: 697 lvb_type: 0 00000100:00100000:1.0:1762166978.203901:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9605 00000100:00100000:1.0:1762166978.203907:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff1ab050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+532:2418:x1847765450502272:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166978.203917:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166978.203922:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbab0e2 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e95 expref: 532 pid: 6495 timeout: 697 lvb_type: 0 00010000:00010000:1.0:1762166978.203932:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbab0e2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e95 expref: 532 pid: 6495 timeout: 697 lvb_type: 0 00010000:00010000:1.0:1762166978.203946:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbab0e2 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e95 expref: 532 pid: 6495 timeout: 697 lvb_type: 0 00010000:00010000:1.0:1762166978.203956:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166978.203959:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355be00/0x2f180c4effbab128 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.203965:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355be00/0x2f180c4effbab128 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.203970:0:6479:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355be00/0x2f180c4effbab128 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.203993:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166978.204027:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff1ab050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+531:2418:x1847765450502272:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 120us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166978.204033:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9605 00010000:00010000:0.0:1762166978.204049:0:6495:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355be00/0x2f180c4effbab128 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.204059:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355be00/0x2f180c4effbab128 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:0.0:1762166978.204078:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 259346 00010000:00010000:0.0:1762166978.204180:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbab121 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9eaa expref: 532 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.204194:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355be00/0x2f180c4effbab128 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9eaa expref: 531 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.204202:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:0.0:1762166978.204205:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1762166978.204209:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355be00, rc 0) 00000100:00100000:0.0:1762166978.204246:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+531:61854:x1847765450502144:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1837us (1967us total) trans 4294992121 rc 0/0 00000100:00100000:0.0:1762166978.204254:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30512 00000100:00100000:3.0:1762166978.205173:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.205233:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450502400 00000100:00100000:2.0:1762166978.205238:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450502400 00000100:00100000:2.0:1762166978.205272:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11862 00000100:00100000:2.0:1762166978.205281:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+531:61854:x1847765450502400:12345-192.168.204.38@tcp:33:lfs.0 00000100:00100000:2.0:1762166978.205371:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+531:61854:x1847765450502400:12345-192.168.204.38@tcp:33:lfs.0 Request processed in 93us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166978.205377:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11862 00000100:00100000:3.0:1762166978.206028:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.206078:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450502656 00000100:00100000:2.0:1762166978.206084:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450502656 00000100:00100000:2.0:1762166978.206111:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11863 00000100:00100000:2.0:1762166978.206117:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7be7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+531:61854:x1847765450502656:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:2.0:1762166978.206228:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7be7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+532:61854:x1847765450502656:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 110us (201us total) trans 4294992122 rc 0/0 00000100:00100000:2.0:1762166978.206235:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11863 00000100:00100000:0.0:1762166978.206974:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.207016:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450502912 00000100:00100000:1.0:1762166978.207022:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450502912 00000100:00100000:1.0:1762166978.207059:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30513 00000100:00100000:1.0:1762166978.207070:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+532:61854:x1847765450502912:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166978.207080:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166978.207082:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:1.0:1762166978.207097:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355be00/0x2f180c4effbab128 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9eaa expref: 532 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.207116:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a000/0x2f180c4effbab113 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ea3 expref: 531 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.207126:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166978.207130:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166978.207141:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbab136 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9eb1 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.207201:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbab13d lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166978.207212:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbab13d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.207222:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbab13d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:1.0:1762166978.207230:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 259346 00010000:00010000:1.0:1762166978.207288:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbab136 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9eb1 expref: 533 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.207300:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbab13d lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9eb1 expref: 532 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.207313:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166978.207316:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762166978.207319:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355ae00, rc 0) 00000100:00100000:1.0:1762166978.207358:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+532:61854:x1847765450502912:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 292us (384us total) trans 4294992123 rc 0/0 00000100:00100000:1.0:1762166978.207367:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30513 00000100:00100000:3.0:1762166978.208066:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.208119:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450503168 00000100:00100000:2.0:1762166978.208126:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450503168 00000100:00100000:2.0:1762166978.208160:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11864 00000100:00100000:2.0:1762166978.208170:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+532:61854:x1847765450503168:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:2.0:1762166978.208226:0:6497:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x240000404:0x5eb:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbab13d lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9eb1 expref: 532 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.208258:0:6497:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbab14b lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 00010000:00010000:2.0:1762166978.208269:0:6497:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbab0b1 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e87 expref: 532 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.208277:0:6497:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbab14b lrc: 4/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166978.208302:0:6497:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbab0b1 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e87 expref: 532 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.208311:0:6497:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbab0b1 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e87 expref: 532 pid: 6495 timeout: 697 lvb_type: 0 00000100:00100000:2.0:1762166978.208322:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55ded80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6497:1847765449727104:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166978.208399:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc56bf0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166978.209015:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55ded80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6497:1847765449727104:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166978.209033:0:6497:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbab14b lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00000100:00100000:3.0:1762166978.209179:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.209235:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450503296 00000100:00100000:1.0:1762166978.209243:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450503296 00010000:00010000:1.0:1762166978.209271:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbab0b1 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e87 expref: 533 pid: 6495 timeout: 697 lvb_type: 0 00000100:00100000:1.0:1762166978.209308:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9606 00000100:00100000:1.0:1762166978.209333:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+533:2418:x1847765450503296:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166978.209344:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166978.209349:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbab0b1 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e87 expref: 533 pid: 6495 timeout: 697 lvb_type: 0 00010000:00010000:1.0:1762166978.209357:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbab0b1 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e87 expref: 533 pid: 6495 timeout: 697 lvb_type: 0 00010000:00010000:1.0:1762166978.209369:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbab0b1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e87 expref: 533 pid: 6495 timeout: 697 lvb_type: 0 00010000:00010000:1.0:1762166978.209378:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166978.209381:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbab14b lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166978.209390:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbab14b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166978.209395:0:6479:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbab14b lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166978.209421:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166978.209458:0:6497:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbab14b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00000100:00100000:1.0:1762166978.209465:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+532:2418:x1847765450503296:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 139us (284us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166978.209503:0:6497:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbab14b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00000100:00100000:1.0:1762166978.209514:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9606 00010000:00010000:2.0:1762166978.209731:0:6497:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbab14b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166978.209742:0:6497:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbab14b lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166978.209749:0:6497:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbab14b lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166978.209754:0:6497:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa9c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166978.209759:0:6497:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbab14b lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166978.209768:0:6497:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbab14b lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166978.209778:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166978.209781:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1762166978.209786:0:6497:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbab14b lrc: 2/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166978.209793:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbab14b lrc: 0/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166978.209805:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812e100) 00010000:00010000:2.0:1762166978.209808:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166978.209812:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbab13d lrc: 0/0,0 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9eb1 expref: 531 pid: 6495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166978.209936:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+531:61854:x1847765450503168:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 1767us (1870us total) trans 4294992124 rc -22/-22 00000100:00100000:2.0:1762166978.209946:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11864 00000100:00100000:3.0:1762166978.210639:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.210672:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450503424 00000100:00100000:1.0:1762166978.210677:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450503424 00000100:00100000:1.0:1762166978.210707:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30514 00000100:00100000:1.0:1762166978.210719:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+531:61854:x1847765450503424:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166978.210733:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166978.210744:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbab152 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9eb8 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.210780:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbab152 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9eb8 expref: 532 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.210792:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbab152 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9eb8 expref: 532 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.210808:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ee00) 00010000:00010000:1.0:1762166978.210810:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166978.210813:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355b000, rc 0) 00000100:00100000:1.0:1762166978.210843:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+532:61854:x1847765450503424:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 129us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166978.210848:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30514 00000100:00100000:3.0:1762166978.211951:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.211987:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450503680 00000100:00100000:1.0:1762166978.211991:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450503680 00000100:00100000:1.0:1762166978.212017:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30515 00000100:00100000:1.0:1762166978.212022:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+532:61854:x1847765450503680:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166978.212030:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166978.212041:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbab159 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9ebf expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.212386:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbab160 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x60e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166978.212395:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbab160 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x60e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.212400:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbab160 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x60e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:1.0:1762166978.212407:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x60e:0x0]: returning size 0 00010000:00010000:1.0:1762166978.212436:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbab159 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ebf expref: 535 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.212449:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbab160 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x60e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ebf expref: 534 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.212454:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x60e:0x0].0x0 (ffff945bc812e200) 00010000:00010000:1.0:1762166978.212455:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166978.212457:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355b800, rc 0) 00000100:00100000:1.0:1762166978.212523:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+534:61854:x1847765450503680:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 499us (580us total) trans 4294992125 rc 0/0 00000100:00100000:1.0:1762166978.212528:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30515 00000100:00100000:0.0:1762166978.213622:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.213666:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450503936 00000100:00100000:1.0:1762166978.213672:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450503936 00000100:00100000:1.0:1762166978.213705:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30516 00000100:00100000:1.0:1762166978.213714:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+534:61854:x1847765450503936:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166978.213728:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166978.213738:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbab16e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9ec6 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.213789:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbab175 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166978.213798:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbab175 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.213805:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbab175 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:1.0:1762166978.213814:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 259346 00010000:00010000:1.0:1762166978.213878:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbab16e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ec6 expref: 537 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.213892:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbab175 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ec6 expref: 536 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.213900:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ee00) 00010000:00010000:1.0:1762166978.213902:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762166978.213904:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355ac00, rc 0) 00000100:00100000:1.0:1762166978.213939:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+536:61854:x1847765450503936:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 227us (319us total) trans 4294992126 rc 0/0 00000100:00100000:1.0:1762166978.213947:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30516 00000100:00100000:3.0:1762166978.214771:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.214807:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450504192 00000100:00100000:2.0:1762166978.214814:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450504192 00000100:00100000:2.0:1762166978.214850:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11865 00000100:00100000:2.0:1762166978.214856:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+536:61854:x1847765450504192:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:2.0:1762166978.214919:0:6497:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x240000404:0x5eb:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbab175 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ec6 expref: 536 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.214951:0:6497:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbab183 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 00010000:00010000:2.0:1762166978.214963:0:6497:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbab152 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9eb8 expref: 536 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.214972:0:6497:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbab183 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166978.215002:0:6497:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbab152 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9eb8 expref: 536 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.215014:0:6497:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbab152 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9eb8 expref: 536 pid: 6495 timeout: 697 lvb_type: 0 00000100:00100000:2.0:1762166978.215026:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55ded80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6497:1847765449727232:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166978.215086:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc56bff00 going to sleep for 11 seconds 00000100:00100000:2.0:1762166978.215724:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55ded80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6497:1847765449727232:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166978.215743:0:6497:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbab183 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00000100:00100000:3.0:1762166978.215931:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.215976:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450504320 00000100:00100000:1.0:1762166978.215984:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450504320 00010000:00010000:1.0:1762166978.216008:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbab152 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9eb8 expref: 537 pid: 6495 timeout: 697 lvb_type: 0 00000100:00100000:1.0:1762166978.216042:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9607 00000100:00100000:1.0:1762166978.216053:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5804000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+537:2419:x1847765450504320:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166978.216063:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166978.216069:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbab152 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9eb8 expref: 537 pid: 6495 timeout: 697 lvb_type: 0 00010000:00010000:1.0:1762166978.216081:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbab152 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9eb8 expref: 537 pid: 6495 timeout: 697 lvb_type: 0 00010000:00010000:1.0:1762166978.216097:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbab152 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9eb8 expref: 537 pid: 6495 timeout: 697 lvb_type: 0 00010000:00010000:1.0:1762166978.216107:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ee00) 00010000:00010000:1.0:1762166978.216112:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbab183 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166978.216120:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbab183 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166978.216126:0:6479:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbab183 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166978.216150:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166978.216162:0:6497:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbab183 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166978.216169:0:6497:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbab183 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166978.216181:0:6497:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbab18a lrc: 3/0,1 mode: --/EX res: [0x240000404:0x60e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 00000100:00100000:1.0:1762166978.216189:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5804000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+536:2419:x1847765450504320:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 138us (256us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166978.216190:0:6497:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbab160 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x60e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ebf expref: 536 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.216217:0:6497:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbab18a lrc: 4/0,1 mode: --/EX res: [0x240000404:0x60e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT1 00000100:00100000:1.0:1762166978.216227:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9607 00010000:00010000:2.0:1762166978.216244:0:6497:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbab160 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x60e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ebf expref: 535 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.216254:0:6497:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbab160 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x60e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ebf expref: 535 pid: 6495 timeout: 697 lvb_type: 0 00000100:00100000:2.0:1762166978.216266:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55ded80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6497:1847765449727360:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166978.216302:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc56bff00 going to sleep for 11 seconds 00000100:00100000:2.0:1762166978.216905:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55ded80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6497:1847765449727360:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166978.216918:0:6497:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbab18a lrc: 3/0,1 mode: --/EX res: [0x240000404:0x60e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00000100:00100000:0.0:1762166978.217120:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.217165:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450504448 00000100:00100000:1.0:1762166978.217171:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450504448 00010000:00010000:1.0:1762166978.217191:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbab160 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x60e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ebf expref: 536 pid: 6495 timeout: 697 lvb_type: 0 00000100:00100000:1.0:1762166978.217224:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9608 00000100:00100000:1.0:1762166978.217233:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+536:2419:x1847765450504448:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166978.217242:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166978.217247:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbab160 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x60e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ebf expref: 536 pid: 6495 timeout: 697 lvb_type: 0 00010000:00010000:1.0:1762166978.217259:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbab160 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x60e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ebf expref: 536 pid: 6495 timeout: 697 lvb_type: 0 00010000:00010000:1.0:1762166978.217272:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbab160 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x60e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ebf expref: 536 pid: 6495 timeout: 697 lvb_type: 0 00010000:00010000:1.0:1762166978.217284:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x60e:0x0].0x0 (ffff945bc812e200) 00010000:00010000:1.0:1762166978.217288:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbab18a lrc: 3/0,1 mode: --/EX res: [0x240000404:0x60e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166978.217294:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbab18a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x60e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166978.217300:0:6479:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbab18a lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x60e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166978.217325:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166978.217352:0:6497:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbab18a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x60e:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00000100:00100000:1.0:1762166978.217361:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+535:2419:x1847765450504448:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 126us (239us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166978.217363:0:6497:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbab18a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x60e:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00000100:00100000:1.0:1762166978.217381:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9608 00000100:00100000:2.0:1762166978.217690:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55ded80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449727488:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762166978.217733:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166978.217760:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d0116cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1762166978.217776:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449727488 00000100:00100000:1.0:1762166978.217781:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449727488 00000100:00100000:1.0:1762166978.217812:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1363 00000100:00100000:1.0:1762166978.217819:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:6497:x1847765449727488:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762166978.217900:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:6497:x1847765449727488:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 82us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166978.217909:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1363 00000100:00100000:2.0:1762166978.217934:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55ded80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449727488:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762166978.217974:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55ded80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449727616:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762166978.217995:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166978.218015:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d0116c540 going to sleep for 11 seconds 00000100:00100000:1.0:1762166978.218029:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449727616 00000100:00100000:1.0:1762166978.218034:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449727616 00000100:00100000:1.0:1762166978.218060:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1364 00000100:00100000:1.0:1762166978.218067:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:6497:x1847765449727616:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762166978.218127:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:6497:x1847765449727616:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 60us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166978.218135:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1364 00000100:00100000:2.0:1762166978.218138:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55ded80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449727616:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762166978.218180:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55ded80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449727744:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762166978.218201:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166978.218217:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc11cad80 going to sleep for 11 seconds 00000100:00100000:1.0:1762166978.218232:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449727744 00000100:00100000:1.0:1762166978.218237:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449727744 00000100:00100000:1.0:1762166978.218261:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1365 00000100:00100000:1.0:1762166978.218268:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:6497:x1847765449727744:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762166978.218318:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:6497:x1847765449727744:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 50us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166978.218325:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1365 00000100:00100000:2.0:1762166978.218330:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55ded80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449727744:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762166978.218365:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55ded80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449727872:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762166978.218384:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166978.218401:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccac36180 going to sleep for 11 seconds 00000100:00100000:1.0:1762166978.218416:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449727872 00000100:00100000:1.0:1762166978.218421:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449727872 00000100:00100000:1.0:1762166978.218447:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1366 00000100:00100000:1.0:1762166978.218455:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:6497:x1847765449727872:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762166978.218536:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:6497:x1847765449727872:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 82us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166978.218543:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1366 00000100:00100000:2.0:1762166978.218546:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55ded80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449727872:0@lo:1000:mdt_rdpg00_000.0 00000040:00080000:2.0:1762166978.218649:0:6497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x2:0x0].49, 280 off66552 00000001:00080000:2.0:1762166978.218655:0:6497:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992127 00000100:00100000:2.0:1762166978.218685:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55ded80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449728000:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762166978.218704:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166978.218720:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d0116c480 going to sleep for 11 seconds 00000100:00100000:1.0:1762166978.218738:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449728000 00000100:00100000:1.0:1762166978.218743:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449728000 00000100:00100000:1.0:1762166978.218772:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1367 00000100:00100000:1.0:1762166978.218779:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:6497:x1847765449728000:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762166978.218877:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+12:6497:x1847765449728000:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 87us (160us total) trans 17179876448 rc 0/0 00000100:00100000:1.0:1762166978.218885:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1367 00000100:00100000:2.0:1762166978.218888:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55ded80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449728000:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762166978.218910:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55dd880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449728128:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762166978.218930:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166978.218945:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc11ca180 going to sleep for 11 seconds 00000100:00100000:1.0:1762166978.218950:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449728128 00000100:00100000:1.0:1762166978.218955:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449728128 00000100:00100000:1.0:1762166978.218982:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1368 00000100:00100000:1.0:1762166978.218990:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:6497:x1847765449728128:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762166978.219069:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+12:6497:x1847765449728128:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 78us (136us total) trans 21474843326 rc 0/0 00000100:00100000:2.0:1762166978.219076:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55dd880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449728128:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762166978.219078:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1368 00000001:00080000:2.0:1762166978.219115:0:6497:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992128 00010000:00010000:2.0:1762166978.219133:0:6497:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbab18a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x60e:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166978.219141:0:6497:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbab18a lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x60e:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166978.219147:0:6497:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbab18a lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x60e:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166978.219153:0:6497:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa9e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166978.219157:0:6497:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbab18a lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x60e:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166978.219168:0:6497:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbab18a lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x60e:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166978.219178:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x60e:0x0].0x0 (ffff945bc812e200) 00010000:00010000:2.0:1762166978.219180:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1762166978.219184:0:6497:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbab18a lrc: 2/0,0 mode: --/EX res: [0x240000404:0x60e:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166978.219190:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbab18a lrc: 0/0,0 mode: --/EX res: [0x240000404:0x60e:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166978.219205:0:6497:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbab183 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166978.219211:0:6497:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbab183 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166978.219217:0:6497:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbab183 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166978.219221:0:6497:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa9800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166978.219224:0:6497:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbab183 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166978.219229:0:6497:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbab183 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166978.219235:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ee00) 00010000:00010000:2.0:1762166978.219237:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1762166978.219240:0:6497:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbab183 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166978.219245:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbab183 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166978.219254:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ee00) 00010000:00010000:2.0:1762166978.219256:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166978.219261:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbab175 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ec6 expref: 537 pid: 6495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166978.219320:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+536:61854:x1847765450504192:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 4463us (4554us total) trans 4294992129 rc 0/0 00000100:00100000:2.0:1762166978.219327:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11865 00000020:00080000:2.0:1762166978.219332:0:6497:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1762166978.220203:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.220250:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450504576 00000100:00100000:1.0:1762166978.220256:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450504576 00000100:00100000:1.0:1762166978.220290:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30517 00000100:00100000:1.0:1762166978.220299:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+536:61854:x1847765450504576:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166978.220311:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166978.220325:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbab191 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9ecd expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.220365:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbab191 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ecd expref: 537 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.220376:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbab191 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ecd expref: 537 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.220390:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:1.0:1762166978.220392:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166978.220395:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355aa00, rc 0) 00000100:00100000:1.0:1762166978.220431:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+537:61854:x1847765450504576:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 134us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166978.220439:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30517 00000100:00100000:3.0:1762166978.221613:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.221661:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450504832 00000100:00100000:2.0:1762166978.221666:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450504832 00000100:00100000:2.0:1762166978.221695:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11866 00000100:00100000:2.0:1762166978.221700:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5805c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+537:61854:x1847765450504832:12345-192.168.204.38@tcp:35:lfs.0 00000004:00080000:2.0:1762166978.221844:0:6497:0:(mdd_object.c:3965:mdd_close()) Object [0x240000404:0x60e:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1762166978.221898:0:6497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5904, 64 off462440 00000040:00080000:2.0:1762166978.221912:0:6497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5905, 64 off462440 00000001:00080000:2.0:1762166978.221916:0:6497:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992130 00010000:00010000:2.0:1762166978.221938:0:6497:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbab198 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x60e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 00010000:00010000:2.0:1762166978.221946:0:6497:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbab198 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x60e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166978.221952:0:6497:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbab198 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x60e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166978.221958:0:6497:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbab198 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x60e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166978.221963:0:6497:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbab198 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x60e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166978.221974:0:6497:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbab198 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x60e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166978.221993:0:6497:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1762166978.222026:0:7420:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1762166978.222034:0:7420:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbab198 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x60e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166978.222042:0:7420:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa9c00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166978.222045:0:7420:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbab198 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x60e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166978.222052:0:7420:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbab198 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x60e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166978.222066:0:7420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x60e:0x0].0x0 (ffff945bc809be00) 00010000:00010000:0.0:1762166978.222068:0:7420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1762166978.222071:0:7420:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbab198 lrc: 1/0,0 mode: --/PW res: [0x240000404:0x60e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166978.222075:0:7420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbab198 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x60e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166978.222103:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166978.222105:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166978.222106:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1762166978.222145:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5805c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+539:61854:x1847765450504832:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 444us (536us total) trans 4294992131 rc 0/0 00000100:00100000:2.0:1762166978.222151:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11866 00000020:00080000:2.0:1762166978.222154:0:6497:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1762166978.222844:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.222890:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450505088 00000100:00100000:2.0:1762166978.222895:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450505088 00000100:00100000:2.0:1762166978.222920:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11867 00000100:00100000:2.0:1762166978.222924:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+539:61854:x1847765450505088:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:2.0:1762166978.223034:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+540:61854:x1847765450505088:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 109us (193us total) trans 4294992132 rc 0/0 00000100:00100000:2.0:1762166978.223039:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11867 00000100:00100000:0.0:1762166978.224895:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.224935:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450505344 00000100:00100000:1.0:1762166978.224942:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450505344 00000100:00100000:1.0:1762166978.224978:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30518 00000100:00100000:1.0:1762166978.224989:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+540:61766:x1847765450505344:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:1.0:1762166978.225001:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166978.225015:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbab19f lrc: 2/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9ed4 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.225066:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbab1a6 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166978.225077:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbab1a6 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.225086:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbab1a6 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.225101:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a000/0x2f180c4effbab1ad lrc: 3/1,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166978.225108:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a000/0x2f180c4effbab1ad lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.225114:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a000/0x2f180c4effbab1ad lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.225177:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355be00/0x2f180c4effbab1b4 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166978.225185:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355be00/0x2f180c4effbab1b4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.225192:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355be00/0x2f180c4effbab1b4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:1.0:1762166978.225201:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 259346 00010000:00010000:1.0:1762166978.225245:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbab1a6 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.225252:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbab1a6 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.225258:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbab1a6 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.225264:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbab1a6 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.225269:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355bc00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166978.225273:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbab1a6 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.225280:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbab1a6 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.225290:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0x0 (ffff945bc812e700) 00010000:00010000:1.0:1762166978.225293:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166978.225296:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbab1a6 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.225303:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbab1a6 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.225313:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a000/0x2f180c4effbab1ad lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.225319:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a000/0x2f180c4effbab1ad lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.225325:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a000/0x2f180c4effbab1ad lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.225329:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355a000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166978.225332:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a000/0x2f180c4effbab1ad lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.225338:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a000/0x2f180c4effbab1ad lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.225345:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0xdd396665 (ffff945bc812e600) 00010000:00010000:1.0:1762166978.225347:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166978.225350:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a000/0x2f180c4effbab1ad lrc: 2/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.225355:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a000/0x2f180c4effbab1ad lrc: 0/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.225384:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbab19f lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ed4 expref: 543 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.225398:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355be00/0x2f180c4effbab1b4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ed4 expref: 542 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.225405:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:1.0:1762166978.225408:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166978.225410:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355be00, rc 0) 00000100:00100000:1.0:1762166978.225446:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+542:61766:x1847765450505344:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 461us (551us total) trans 4294992133 rc 0/0 00000100:00100000:1.0:1762166978.225454:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30518 00000100:00100000:3.0:1762166978.227139:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.227184:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450505472 00000100:00100000:1.0:1762166978.227190:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450505472 00000100:00100000:1.0:1762166978.227228:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30519 00000100:00100000:1.0:1762166978.227236:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+542:61766:x1847765450505472:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:1.0:1762166978.227249:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166978.227259:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbab1c2 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9edb expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.227279:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a400/0x2f180c4effbab1c9 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166978.227287:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a400/0x2f180c4effbab1c9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.227295:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a400/0x2f180c4effbab1c9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.227365:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbab1c2 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9edb expref: 544 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.227379:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a400/0x2f180c4effbab1c9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9edb expref: 543 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.227386:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:1.0:1762166978.227389:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1762166978.227391:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355a400, rc 0) 00000100:00100000:1.0:1762166978.227427:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+543:61766:x1847765450505472:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 192us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166978.227435:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30519 00000100:00100000:3.0:1762166978.228307:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.228364:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450505600 00000100:00100000:2.0:1762166978.228371:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450505600 00002000:00100000:2.0:1762166978.228404:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (0->4095) req@ffff945bc48abb80 x1847765450505600/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:9/0 lens 488/0 e 0 to 0 dl 1762166989 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166978.228414:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc48abb80 with x1847765450505600 ext(0->4095) 00002000:00010000:2.0:1762166978.228418:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc48abb80 00000100:00100000:2.0:1762166978.228441:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2372 00000100:00100000:2.0:1762166978.228449:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450505600:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:2.0:1762166978.228606:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450505600:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 157us (299us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1762166978.228620:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2372 00002000:00100000:2.0:1762166978.228628:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (0->4095) req@ffff945bc48abb80 x1847765450505600/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:9/0 lens 488/4536 e 0 to 0 dl 1762166989 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166978.228637:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc48abb80 with x1847765450505600 ext(0->4095) 00002000:00010000:2.0:1762166978.228652:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc48abb80 00000100:00100000:0.0:1762166978.229629:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.229662:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450505728 00000100:00100000:2.0:1762166978.229667:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450505728 00002000:00100000:2.0:1762166978.229685:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (16384->20479) req@ffff945bc5bc1500 x1847765450505728/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:9/0 lens 488/0 e 0 to 0 dl 1762166989 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166978.229694:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5bc1500 with x1847765450505728 ext(16384->20479) 00002000:00010000:2.0:1762166978.229697:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5bc1500 00000100:00100000:2.0:1762166978.229717:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2373 00000100:00100000:2.0:1762166978.229726:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:2417:x1847765450505728:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:2.0:1762166978.229799:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:2417:x1847765450505728:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 76us (172us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1762166978.229803:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2373 00002000:00100000:2.0:1762166978.229807:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (16384->20479) req@ffff945bc5bc1500 x1847765450505728/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:9/0 lens 488/4536 e 0 to 0 dl 1762166989 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166978.229813:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5bc1500 with x1847765450505728 ext(16384->20479) 00002000:00010000:2.0:1762166978.229815:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5bc1500 00000100:00100000:3.0:1762166978.231152:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.231192:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450505984 00000100:00100000:1.0:1762166978.231199:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450505984 00000100:00100000:1.0:1762166978.231234:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30520 00000100:00100000:1.0:1762166978.231244:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+543:61766:x1847765450505984:12345-192.168.204.38@tcp:36:fsx.0 00010000:00010000:1.0:1762166978.231277:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166978.231295:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355be00/0x2f180c4effbab1b4 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ed4 expref: 543 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.231309:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:1.0:1762166978.231313:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166978.231424:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbab1d0 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166978.231435:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbab1d0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.231447:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbab1d0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000001:00080000:1.0:1762166978.231506:0:6495:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992134 00000004:00010000:1.0:1762166978.231531:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000001b6594fb reply state 0000000046f9a693 transno 4294992135 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbab1d0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.231543:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbab1d0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.231550:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:1.0:1762166978.231553:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166978.231556:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166978.231616:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+545:61766:x1847765450505984:12345-192.168.204.38@tcp:36:fsx.0 Request processed in 374us (464us total) trans 4294992135 rc 0/0 00000100:00100000:1.0:1762166978.231623:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30520 00000020:00080000:1.0:1762166978.231627:0:6495:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1762166978.232348:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.232387:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450506112 00000100:00100000:2.0:1762166978.232392:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450506112 00000100:00100000:2.0:1762166978.232424:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19029 00000100:00100000:2.0:1762166978.232433:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+17:61766:x1847765450506112:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:2.0:1762166978.232444:0:8382:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166978.232455:0:8382:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9800/0x2f180c4effbab1d7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9ee2 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.232489:0:8382:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8800/0x2f180c4effbaaf84 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e1e expref: 18 pid: 35472 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166978.232496:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166978.232498:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166978.232501:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9800/0x2f180c4effbab1d7 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ee2 expref: 18 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.232524:0:8382:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8800/0x2f180c4effbaaf84 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e1e expref: 18 pid: 35472 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166978.232532:0:8382:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8800/0x2f180c4effbaaf84 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e1e expref: 18 pid: 35472 timeout: 697 lvb_type: 1 00000100:00100000:2.0:1762166978.232541:0:8382:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55df480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8382:1847765449728256:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166978.232589:0:8382:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc11cad80 going to sleep for 11 seconds 00000100:00100000:2.0:1762166978.233295:0:8382:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55df480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8382:1847765449728256:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166978.233310:0:8382:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9800/0x2f180c4effbab1d7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ee2 expref: 18 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.233320:0:8382:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa9800, rc 0) 00000100:00100000:2.0:1762166978.233345:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+18:61766:x1847765450506112:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 914us (998us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166978.233352:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19029 00000100:00100000:3.0:1762166978.233528:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.233561:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450506240 00000100:00100000:1.0:1762166978.233566:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450506240 00010000:00010000:1.0:1762166978.233585:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8800/0x2f180c4effbaaf84 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e1e expref: 18 pid: 35472 timeout: 697 lvb_type: 1 00000100:00100000:1.0:1762166978.233616:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9609 00000100:00100000:1.0:1762166978.233625:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450506240:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166978.233641:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166978.233654:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8800/0x2f180c4effbaaf84 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e1e expref: 18 pid: 35472 timeout: 697 lvb_type: 1 00010000:00010000:1.0:1762166978.233662:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8800/0x2f180c4effbaaf84 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e1e expref: 18 pid: 35472 timeout: 697 lvb_type: 1 00010000:00010000:1.0:1762166978.233674:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8800/0x2f180c4effbaaf84 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e1e expref: 18 pid: 35472 timeout: 697 lvb_type: 1 00010000:00010000:1.0:1762166978.233681:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166978.233683:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166978.233687:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9800/0x2f180c4effbab1d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ee2 expref: 17 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.233693:0:6479:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9800/0x2f180c4effbab1d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ee2 expref: 17 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.233709:0:6479:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9800/0x2f180c4effbab1d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ee2 expref: 17 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166978.233716:0:6479:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6479:1847765449728384:192.168.204.38@tcp:105: 00000100:00100000:1.0:1762166978.233747:0:6479:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cee083e40 going to sleep for 11 seconds 00000100:00100000:1.0:1762166978.234544:0:6479:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6479:1847765449728384:192.168.204.38@tcp:105: 00010000:00010000:1.0:1762166978.234557:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166978.234590:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450506240:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 966us (1115us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166978.234598:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9609 00000100:00100000:3.0:1762166978.234695:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.234753:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450506368 00000100:00100000:2.0:1762166978.234768:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450506368 00000100:00100000:2.0:1762166978.234807:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19030 00000100:00100000:2.0:1762166978.234815:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+21:61766:x1847765450506368:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:2.0:1762166978.234827:0:8382:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166978.234838:0:8382:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbab1de lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9ee9 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.234856:0:8382:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbaaf8b lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e25 expref: 22 pid: 8380 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166978.234861:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166978.234875:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166978.234879:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbab1de lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ee9 expref: 22 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.234895:0:8382:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbaaf8b lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e25 expref: 22 pid: 8380 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166978.234903:0:8382:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbaaf8b lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e25 expref: 22 pid: 8380 timeout: 697 lvb_type: 1 00000100:00100000:2.0:1762166978.234910:0:8382:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55df480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8382:1847765449728512:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166978.234943:0:8382:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc11cad80 going to sleep for 11 seconds 00000100:00100000:2.0:1762166978.235600:0:8382:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55df480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8382:1847765449728512:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166978.235616:0:8382:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbab1de lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ee9 expref: 22 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.235628:0:8382:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa9e00, rc 0) 00000100:00100000:2.0:1762166978.235656:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+22:61766:x1847765450506368:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 843us (961us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166978.235661:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19030 00000100:00100000:3.0:1762166978.235917:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.235974:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450506496 00000100:00100000:1.0:1762166978.235983:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450506496 00010000:00010000:1.0:1762166978.236016:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbaaf8b lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e25 expref: 22 pid: 8380 timeout: 697 lvb_type: 1 00000100:00100000:1.0:1762166978.236061:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9610 00000100:00100000:1.0:1762166978.236071:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765450506496:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166978.236085:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166978.236105:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbaaf8b lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e25 expref: 22 pid: 8380 timeout: 697 lvb_type: 1 00010000:00010000:1.0:1762166978.236119:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbaaf8b lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e25 expref: 22 pid: 8380 timeout: 697 lvb_type: 1 00010000:00010000:1.0:1762166978.236142:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbaaf8b lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e25 expref: 22 pid: 8380 timeout: 697 lvb_type: 1 00010000:00010000:1.0:1762166978.236158:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166978.236160:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166978.236166:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbab1de lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ee9 expref: 21 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.236176:0:6479:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbab1de lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ee9 expref: 21 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.236208:0:6479:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbab1de lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ee9 expref: 21 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166978.236221:0:6479:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6479:1847765449728640:192.168.204.38@tcp:105: 00000100:00100000:1.0:1762166978.236294:0:6479:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cee083e40 going to sleep for 11 seconds 00000100:00100000:1.0:1762166978.236965:0:6479:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6479:1847765449728640:192.168.204.38@tcp:105: 00010000:00010000:1.0:1762166978.236978:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166978.237016:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450506496:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 947us (1104us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166978.237026:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9610 00000100:00100000:0.0:1762166978.237161:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.237199:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.237221:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450506624 00000100:00100000:2.0:1762166978.237227:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450506624 00000100:00100000:0.0:1762166978.237238:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.237251:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450506752 00000100:00100000:1.0:1762166978.237258:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450506752 00002000:00010000:2.0:1762166978.237262:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (252073->18446744073709551615) 00002000:00100000:2.0:1762166978.237269:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5bc1c00 with x1847765450506624 ext(252073->18446744073709551615) 00000100:00100000:3.0:1762166978.237271:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450506880 00000100:00100000:3.0:1762166978.237277:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450506880 00002000:00010000:2.0:1762166978.237281:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5bc1c00. 00002000:00010000:1.0:1762166978.237284:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:1.0:1762166978.237290:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5bc0000 with x1847765450506752 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166978.237291:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:3.0:1762166978.237295:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5bc3800 with x1847765450506880 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166978.237299:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5bc3800. 00002000:00010000:1.0:1762166978.237299:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc5bc0000. 00000100:00100000:2.0:1762166978.237316:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2374 00000100:00100000:2.0:1762166978.237326:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450506624:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:3.0:1762166978.237333:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2375 00000100:00100000:1.0:1762166978.237340:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2376 00000100:00100000:3.0:1762166978.237346:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450506880:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:1.0:1762166978.237349:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450506752:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:3.0:1762166978.237472:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166978.237472:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166978.237506:0:23939:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:3.0:1762166978.237509:0:23939:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:1.0:1762166978.237509:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:3.0:1762166978.237512:0:23939:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:1.0:1762166978.237512:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:3.0:1762166978.237516:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:1.0:1762166978.237516:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:1.0:1762166978.237518:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00000100:00100000:1.0:1762166978.237554:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450506752:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 207us (355us total) trans 21474843327 rc 0/0 00000100:00100000:3.0:1762166978.237555:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765450506880:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 214us (322us total) trans 17179876449 rc 0/0 00000100:00100000:1.0:1762166978.237563:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2376 00002000:00010000:1.0:1762166978.237567:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00000100:00100000:3.0:1762166978.237568:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2375 00002000:00100000:1.0:1762166978.237570:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5bc0000 with x1847765450506752 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166978.237571:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:3.0:1762166978.237574:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5bc3800 with x1847765450506880 ext(0->18446744073709551615) 00002000:00010000:1.0:1762166978.237575:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc5bc0000. 00002000:00010000:3.0:1762166978.237579:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5bc3800. 00002000:00010000:2.0:1762166978.237710:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 259346 -> 252073 00002000:00010000:2.0:1762166978.237713:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166978.237715:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166978.237717:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166978.237718:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 312 -> 296 00000100:00100000:2.0:1762166978.237752:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765450506624:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 428us (592us total) trans 17179876450 rc 0/0 00000100:00100000:2.0:1762166978.237759:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2374 00002000:00010000:2.0:1762166978.237762:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (252073->18446744073709551615) 00002000:00100000:2.0:1762166978.237764:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5bc1c00 with x1847765450506624 ext(252073->18446744073709551615) 00002000:00010000:2.0:1762166978.237769:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5bc1c00. 00000100:00100000:0.0:1762166978.238535:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.238573:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450507008 00000100:00100000:1.0:1762166978.238578:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450507008 00000100:00100000:1.0:1762166978.238605:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30521 00000100:00100000:1.0:1762166978.238611:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+545:61766:x1847765450507008:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:1.0:1762166978.238622:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166978.238634:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbab1e5 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9ef0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.238701:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbab1ec lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166978.238713:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbab1ec lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.238724:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbab1ec lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:1.0:1762166978.238749:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 252073 00000004:00200000:1.0:1762166978.238753:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166978.238768:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbab1ec lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.238789:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbab1e5 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ef0 expref: 547 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.238799:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbab1ec lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ef0 expref: 546 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.238805:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:1.0:1762166978.238807:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166978.238809:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355a200, rc 0) 00000100:00100000:1.0:1762166978.238836:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+546:61766:x1847765450507008:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 226us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166978.238842:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30521 00000100:00100000:3.0:1762166978.240110:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.240168:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450507264 00000100:00100000:2.0:1762166978.240176:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450507264 00000100:00100000:2.0:1762166978.240228:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11868 00000100:00100000:2.0:1762166978.240240:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7be5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+546:61766:x1847765450507264:12345-192.168.204.38@tcp:35:fsx.0 00000100:00100000:2.0:1762166978.240463:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7be5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+547:61766:x1847765450507264:12345-192.168.204.38@tcp:35:fsx.0 Request processed in 226us (353us total) trans 4294992136 rc 0/0 00000100:00100000:2.0:1762166978.240471:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11868 00000100:00100000:0.0:1762166978.249212:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.249262:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450507520 00000100:00100000:1.0:1762166978.249272:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450507520 00000100:00100000:1.0:1762166978.249328:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30522 00000100:00100000:1.0:1762166978.249340:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+547:61855:x1847765450507520:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166978.249364:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166978.249385:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355be00/0x2f180c4effbab1f3 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9ef7 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.249456:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a000/0x2f180c4effbab1fa lrc: 3/1,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166978.249469:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a000/0x2f180c4effbab1fa lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.249500:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a000/0x2f180c4effbab1fa lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.249515:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbab201 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166978.249523:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbab201 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.249531:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbab201 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.249624:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbab208 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166978.249629:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbab208 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.249635:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbab208 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:1.0:1762166978.249642:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 252073 00010000:00010000:1.0:1762166978.249699:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a000/0x2f180c4effbab1fa lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.249703:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a000/0x2f180c4effbab1fa lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.249707:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a000/0x2f180c4effbab1fa lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.249710:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a000/0x2f180c4effbab1fa lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.249714:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355a000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166978.249716:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a000/0x2f180c4effbab1fa lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.249720:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a000/0x2f180c4effbab1fa lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.249728:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0x0 (ffff945bc812e700) 00010000:00010000:1.0:1762166978.249730:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166978.249733:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a000/0x2f180c4effbab1fa lrc: 3/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.249737:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a000/0x2f180c4effbab1fa lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.249746:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbab201 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.249752:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbab201 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.249755:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbab201 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.249757:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355bc00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166978.249759:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbab201 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.249762:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbab201 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.249765:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0xdd396665 (ffff945bc812e600) 00010000:00010000:1.0:1762166978.249766:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166978.249768:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbab201 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.249770:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbab201 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.249802:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355be00/0x2f180c4effbab1f3 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ef7 expref: 550 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.249811:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbab208 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ef7 expref: 549 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.249815:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:1.0:1762166978.249816:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166978.249818:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355b000, rc 0) 00000100:00100000:1.0:1762166978.249877:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+549:61855:x1847765450507520:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 539us (673us total) trans 4294992137 rc 0/0 00000100:00100000:1.0:1762166978.249885:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30522 00000100:00100000:0.0:1762166978.251048:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.251089:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450507648 00000100:00100000:1.0:1762166978.251094:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450507648 00000100:00100000:1.0:1762166978.251125:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 877 00000100:00100000:1.0:1762166978.251129:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b23b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+549:2416:x1847765450507648:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166978.251138:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166978.251150:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbab208 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ef7 expref: 549 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.251159:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:1.0:1762166978.251161:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166978.251184:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b23b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+548:2416:x1847765450507648:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 55us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166978.251189:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 877 00000100:00100000:3.0:1762166978.251397:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.251428:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450507904 00000100:00100000:1.0:1762166978.251432:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450507904 00000100:00100000:1.0:1762166978.251457:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30523 00000100:00100000:1.0:1762166978.251463:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6224a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+548:61855:x1847765450507904:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166978.251475:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166978.251504:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbab216 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9efe expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.251799:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbab21d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x60f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166978.251809:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbab21d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x60f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.251820:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbab21d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x60f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:1.0:1762166978.251828:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x60f:0x0]: returning size 0 00010000:00010000:1.0:1762166978.251857:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbab216 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9efe expref: 551 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.251884:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbab21d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x60f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9efe expref: 550 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.251891:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x60f:0x0].0x0 (ffff945bc812e300) 00010000:00010000:1.0:1762166978.251894:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166978.251896:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355b200, rc 0) 00000100:00100000:1.0:1762166978.251927:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6224a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+550:61855:x1847765450507904:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 463us (529us total) trans 4294992138 rc 0/0 00000100:00100000:1.0:1762166978.251934:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30523 00000100:00100000:0.0:1762166978.253063:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.253099:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450508160 00000100:00100000:1.0:1762166978.253104:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450508160 00000100:00100000:1.0:1762166978.253133:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30524 00000100:00100000:1.0:1762166978.253141:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+550:61855:x1847765450508160:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166978.253151:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166978.253160:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbab22b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x60f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9f05 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.253201:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbab232 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x60f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166978.253208:0:6495:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbab21d lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x60f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9efe expref: 551 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.253222:0:6495:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbab232 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x60f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.253249:0:6495:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbab21d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x60f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9efe expref: 551 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.253259:0:6495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbab21d lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x60f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9efe expref: 551 pid: 6495 timeout: 697 lvb_type: 0 00000100:00100000:1.0:1762166978.253269:0:6495:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6495:1847765449728768:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166978.253324:0:6495:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cee083000 going to sleep for 11 seconds 00000100:00100000:1.0:1762166978.254047:0:6495:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6495:1847765449728768:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166978.254062:0:6495:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbab232 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x60f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000100:00100000:0.0:1762166978.254106:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.254132:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450508288 00000100:00100000:1.0:1762166978.254135:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450508288 00010000:00010000:1.0:1762166978.254147:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbab21d lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x60f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9efe expref: 552 pid: 6495 timeout: 697 lvb_type: 0 00000100:00100000:1.0:1762166978.254165:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9611 00000100:00100000:1.0:1762166978.254170:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff1abc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+552:2419:x1847765450508288:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166978.254175:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166978.254179:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbab21d lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x60f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9efe expref: 552 pid: 6495 timeout: 697 lvb_type: 0 00010000:00010000:1.0:1762166978.254187:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbab21d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x60f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9efe expref: 552 pid: 6495 timeout: 697 lvb_type: 0 00010000:00010000:1.0:1762166978.254200:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbab21d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x60f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9efe expref: 552 pid: 6495 timeout: 697 lvb_type: 0 00010000:00010000:1.0:1762166978.254209:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x60f:0x0].0x0 (ffff945bc812e300) 00010000:00010000:1.0:1762166978.254212:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbab232 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x60f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.254217:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbab232 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x60f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.254222:0:6479:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbab232 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x60f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.254243:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166978.254272:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff1abc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+551:2419:x1847765450508288:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 100us (166us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166978.254274:0:6495:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbab232 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x60f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000100:00100000:1.0:1762166978.254281:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9611 00010000:00010000:0.0:1762166978.254285:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbab232 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x60f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:0.0:1762166978.254294:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x60f:0x0]: returning size 0 00000004:00080000:0.0:1762166978.254397:0:6495:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xa8a:0x0], index 1: 0 00000004:00080000:0.0:1762166978.254404:0:6495:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xa8b:0x0], index 0: 0 00010000:00010000:0.0:1762166978.254475:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbab232 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x60f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.254509:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbab232 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x60f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.254514:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbab232 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x60f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.254520:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355b400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166978.254523:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbab232 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x60f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.254527:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbab232 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x60f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.254539:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x60f:0x0].0x0 (ffff945bc812e300) 00010000:00010000:0.0:1762166978.254541:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166978.254544:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbab232 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x60f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.254548:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbab232 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x60f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.254572:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbab22b lrc: 1/0,0 mode: --/CR res: [0x240000404:0x60f:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f05 expref: 551 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.254578:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x60f:0x0].0x0 (ffff945bc812e300) 00010000:00010000:0.0:1762166978.254579:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1762166978.254582:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbab22b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x60f:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f05 expref: 551 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.254590:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355a800, rc 0) 00000100:00100000:0.0:1762166978.254617:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+550:61855:x1847765450508160:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1479us (1557us total) trans 4294992139 rc 301/301 00000100:00100000:0.0:1762166978.254624:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30524 00000100:00100000:0.0:1762166978.255687:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.255757:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450508544 00000100:00100000:2.0:1762166978.255768:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450508544 00000100:00100000:2.0:1762166978.255827:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11869 00000100:00100000:2.0:1762166978.255843:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+550:61855:x1847765450508544:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:2.0:1762166978.256125:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+551:61855:x1847765450508544:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 288us (439us total) trans 4294992140 rc 0/0 00000100:00100000:2.0:1762166978.256135:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11869 00000100:00100000:2.0:1762166978.257239:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.257300:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450508672 00000100:00100000:0.0:1762166978.257306:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450508672 00000100:00100000:0.0:1762166978.257344:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30525 00000100:00100000:0.0:1762166978.257352:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+551:61855:x1847765450508672:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166978.257368:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166978.257392:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbab240 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x60f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9f0c expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.257460:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbab247 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x60f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166978.257473:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbab247 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x60f:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.257517:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbab247 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x60f:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:0.0:1762166978.257548:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x60f:0x0]: returning size 0 00000004:00200000:0.0:1762166978.257553:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166978.257568:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbab247 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x60f:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.257604:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbab240 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x60f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f0c expref: 553 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.257622:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbab247 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x60f:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f0c expref: 552 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.257632:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x60f:0x0].0x0 (ffff945bc6ab7200) 00010000:00010000:0.0:1762166978.257635:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1762166978.257638:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdea00, rc 0) 00000100:00100000:0.0:1762166978.257678:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+552:61855:x1847765450508672:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 326us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166978.257685:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30525 00000100:00100000:3.0:1762166978.258598:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166978.258654:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.258656:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450508800 00000100:00100000:2.0:1762166978.258663:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450508800 00000100:00100000:2.0:1762166978.258699:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450508928 00000100:00100000:2.0:1762166978.258704:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450508928 00000100:00100000:1.0:1762166978.258721:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19031 00000100:00100000:2.0:1762166978.258744:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19032 00000100:00100000:1.0:1762166978.258747:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6225500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765450508800:12345-192.168.204.38@tcp:101:lfs.0 00000100:00100000:2.0:1762166978.258761:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6226680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450508928:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166978.258768:0:35248:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166978.258775:0:8382:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166978.258790:0:35248:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cc355be00/0x2f180c4effbab24e lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9f13 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.258795:0:8382:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8c00/0x2f180c4effbab255 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa8b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9f1a expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762166978.258827:0:35248:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa8a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:2.0:1762166978.258829:0:8382:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa8b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1762166978.258853:0:35248:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166978.258854:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166978.258859:0:35248:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166978.258860:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166978.258884:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8c00/0x2f180c4effbab255 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f1a expref: 19 pid: 8382 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166978.258886:0:35248:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355be00/0x2f180c4effbab24e lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f13 expref: 24 pid: 35248 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166978.258926:0:8382:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8c00/0x2f180c4effbab255 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f1a expref: 19 pid: 8382 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166978.258937:0:35248:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945cc355be00/0x2f180c4effbab24e lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f13 expref: 24 pid: 35248 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166978.258945:0:8382:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa8c00, rc 0) 00010000:00010000:1.0:1762166978.258953:0:35248:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355be00, rc 0) 00000100:00100000:2.0:1762166978.258989:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6226680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450508928:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 232us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166978.258997:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19032 00000100:00100000:1.0:1762166978.259009:0:35248:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6225500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765450508800:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 272us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166978.259024:0:35248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19031 00000100:00100000:3.0:1762166978.260011:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.260098:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450509184 00000100:00100000:0.0:1762166978.260103:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450509184 00000100:00100000:0.0:1762166978.260141:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30526 00000100:00100000:0.0:1762166978.260150:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+552:61855:x1847765450509184:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166978.260162:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166978.260176:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbab25c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9f21 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.260266:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbab263 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166978.260278:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbab263 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.260287:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbab263 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:0.0:1762166978.260298:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 252073 00010000:00010000:0.0:1762166978.260397:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbab25c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f21 expref: 555 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.260415:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbab263 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f21 expref: 554 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.260424:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:0.0:1762166978.260426:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166978.260429:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdec00, rc 0) 00000100:00100000:0.0:1762166978.260469:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+554:61855:x1847765450509184:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 320us (460us total) trans 4294992141 rc 0/0 00000100:00100000:0.0:1762166978.260525:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30526 00000100:00100000:2.0:1762166978.262014:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.262051:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.262085:0:35248:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450509312 00000100:00100000:1.0:1762166978.262093:0:35248:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450509312 00000100:00100000:0.0:1762166978.262096:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450509440 00000100:00100000:0.0:1762166978.262103:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450509440 00000100:00100000:1.0:1762166978.262140:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19033 00000100:00100000:0.0:1762166978.262151:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19034 00000100:00100000:1.0:1762166978.262154:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+24:2418:x1847765450509312:12345-192.168.204.38@tcp:1:lfs.0 00000100:00100000:0.0:1762166978.262164:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450509440:12345-192.168.204.38@tcp:1:lfs.0 00000100:00100000:3.0:1762166978.262186:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:0.0:1762166978.262196:0:8382:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde000/0x2f180c4effbab278 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.262197:0:35248:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945cc355ba00/0x2f180c4effbab271 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166978.262215:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450509568 00000100:00100000:2.0:1762166978.262222:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450509568 00010000:00010000:0.0:1762166978.262229:0:8382:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9800/0x2f180c4effbab1d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ee2 expref: 19 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.262230:0:35248:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbab0d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 180224->212991) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e8e expref: 25 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.262247:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166978.262249:0:35248:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166978.262251:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166978.262253:0:35248:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00000100:00100000:2.0:1762166978.262257:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19035 00010000:00010000:0.0:1762166978.262258:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde000/0x2f180c4effbab278 lrc: 4/1,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.262259:0:35248:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355ba00/0x2f180c4effbab271 lrc: 4/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166978.262272:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+25:2418:x1847765450509568:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:2.0:1762166978.262300:0:8383:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbab27f lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.262310:0:35248:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbab0d4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 180224->212991) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e8e expref: 25 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.262311:0:8382:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9800/0x2f180c4effbab1d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ee2 expref: 19 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.262318:0:8383:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbab1de lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ee9 expref: 25 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.262338:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166978.262340:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166978.262344:0:8383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbab27f lrc: 4/1,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.262345:0:35248:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbab0d4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 180224->212991) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e8e expref: 25 pid: 8382 timeout: 697 lvb_type: 0 00010000:00010000:0.0:1762166978.262354:0:8382:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9800/0x2f180c4effbab1d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ee2 expref: 19 pid: 8382 timeout: 697 lvb_type: 0 00000100:00100000:1.0:1762166978.262388:0:35248:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:35248:1847765449728896:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166978.262390:0:8382:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7b23b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8382:1847765449729024:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166978.262398:0:8383:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbab1de lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ee9 expref: 25 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.262411:0:8383:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbab1de lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ee9 expref: 25 pid: 8382 timeout: 697 lvb_type: 0 00000100:00100000:2.0:1762166978.262424:0:8383:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7d23800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8383:1847765449729152:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166978.262471:0:8382:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cca8b6540 going to sleep for 11 seconds 00000100:00100000:2.0:1762166978.262472:0:8383:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc56bf0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166978.262472:0:35248:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cee083e40 going to sleep for 11 seconds 00000100:00100000:0.0:1762166978.263376:0:8382:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7b23b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8382:1847765449729024:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166978.263399:0:8382:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde000/0x2f180c4effbab278 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166978.263407:0:35248:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:35248:1847765449728896:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166978.263428:0:35248:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945cc355ba00/0x2f180c4effbab271 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166978.263801:0:8383:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7d23800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8383:1847765449729152:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166978.263842:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.263899:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450509696 00000100:00100000:1.0:1762166978.263906:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450509696 00000100:00100000:3.0:1762166978.263913:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:1.0:1762166978.263938:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9800/0x2f180c4effbab1d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ee2 expref: 20 pid: 8382 timeout: 697 lvb_type: 0 00010000:00010000:2.0:1762166978.263940:0:8383:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbab27f lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166978.264044:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450509824 00000100:00100000:0.0:1762166978.264051:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450509824 00000100:00100000:1.0:1762166978.264059:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9612 00010000:00010000:0.0:1762166978.264080:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbab1de lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ee9 expref: 26 pid: 8382 timeout: 697 lvb_type: 0 00000100:00100000:1.0:1762166978.264082:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450509696:12345-192.168.204.38@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1762166978.264087:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:1.0:1762166978.264106:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166978.264135:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9800/0x2f180c4effbab1d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ee2 expref: 20 pid: 8382 timeout: 697 lvb_type: 0 00000100:00100000:0.0:1762166978.264140:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9613 00000100:00100000:0.0:1762166978.264152:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb386680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+26:2417:x1847765450509824:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166978.264164:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166978.264171:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9800/0x2f180c4effbab1d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ee2 expref: 20 pid: 8382 timeout: 697 lvb_type: 0 00010000:00010000:0.0:1762166978.264181:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbab1de lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ee9 expref: 26 pid: 8382 timeout: 697 lvb_type: 0 00000100:00100000:2.0:1762166978.264186:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450509952 00000100:00100000:2.0:1762166978.264196:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450509952 00010000:00010000:0.0:1762166978.264200:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbab1de lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ee9 expref: 26 pid: 8382 timeout: 697 lvb_type: 0 00010000:00010000:1.0:1762166978.264202:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9800/0x2f180c4effbab1d7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ee2 expref: 20 pid: 8382 timeout: 697 lvb_type: 0 00010000:00010000:1.0:1762166978.264232:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166978.264234:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbab1de lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ee9 expref: 27 pid: 8382 timeout: 697 lvb_type: 0 00010000:00010000:1.0:1762166978.264238:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166978.264244:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde000/0x2f180c4effbab278 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.264250:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166978.264255:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166978.264258:0:6479:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde000/0x2f180c4effbab278 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.264259:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbab27f lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.264282:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbab27f lrc: 4/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.264305:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:2.0:1762166978.264307:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (0->20479) req@ffff945bcb384a80 x1847765450509952/t0(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:9/0 lens 488/0 e 0 to 0 dl 1762166989 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1762166978.264307:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166978.264341:0:8382:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde000/0x2f180c4effbab278 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1762166978.264342:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bcb384a80 with x1847765450509952 ext(0->20479) 00000100:00100000:1.0:1762166978.264358:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450509696:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 279us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166978.264358:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb386680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+26:2417:x1847765450509824:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 196us (436us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166978.264362:0:8382:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde000/0x2f180c4effbab278 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.264377:0:8388:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbab0d4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 180224->212991) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e8e expref: 26 pid: 8382 timeout: 697 lvb_type: 0 00000100:00100000:0.0:1762166978.264385:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9613 00000100:00100000:1.0:1762166978.264405:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9612 00010000:00010000:3.0:1762166978.264412:0:8382:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde000/0x2f180c4effbab278 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.264424:0:8382:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde000/0x2f180c4effbab278 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.264434:0:8382:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde000/0x2f180c4effbab278 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.264438:0:8388:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbab0d4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 180224->212991) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e8e expref: 25 pid: 8382 timeout: 697 lvb_type: 0 00010000:00010000:3.0:1762166978.264449:0:8382:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bde000 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166978.264456:0:8382:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde000/0x2f180c4effbab278 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.264466:0:8382:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde000/0x2f180c4effbab278 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.264516:0:8382:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde000/0x2f180c4effbab278 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.264525:0:8382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde000/0x2f180c4effbab278 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166978.264562:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff945bcb384a80 00000100:00100000:3.0:1762166978.264596:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450509440:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 2433us (2541us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166978.264606:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19034 00000100:00100000:2.0:1762166978.264625:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 28 00010000:00010000:0.0:1762166978.264662:0:8383:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbab27f lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166978.264666:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb384a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+25:2418:x1847765450509952:12345-192.168.204.38@tcp:4:fsx.0 00010000:00010000:0.0:1762166978.264689:0:8383:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbab27f lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.264704:0:8383:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbab27f lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.264712:0:8383:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbab27f lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.264720:0:8383:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbab27f lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.264727:0:8383:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa8e00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166978.264731:0:8383:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbab27f lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.264739:0:8383:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbab27f lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.264750:0:8383:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbab27f lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.264758:0:8383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbab27f lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166978.264810:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+25:2418:x1847765450509568:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 2541us (2625us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166978.264819:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19035 00000100:00100000:2.0:1762166978.266279:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb384a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+26:2418:x1847765450509952:12345-192.168.204.38@tcp:4:fsx.0 Request processed in 1636us (2189us total) trans 17179876451 rc 0/0 00000100:00100000:2.0:1762166978.266290:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 28 00002000:00100000:2.0:1762166978.266302:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (0->20479) req@ffff945bcb384a80 x1847765450509952/t17179876451(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:9/0 lens 488/448 e 0 to 0 dl 1762166989 ref 1 fl Complete:H/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166978.266313:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bcb384a80 with x1847765450509952 ext(0->20479) 00010000:00010000:2.0:1762166978.266320:0:8388:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbab0d4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 180224->212991) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e8e expref: 26 pid: 8382 timeout: 697 lvb_type: 0 00010000:00010000:2.0:1762166978.266335:0:8388:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbab0d4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 180224->212991) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e8e expref: 26 pid: 8382 timeout: 697 lvb_type: 0 00002000:00010000:2.0:1762166978.266343:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff945bcb384a80 00000100:00100000:3.0:1762166978.267138:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.267188:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450510080 00000100:00100000:1.0:1762166978.267197:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450510080 00010000:00010000:1.0:1762166978.267229:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbab0d4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 180224->212991) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e8e expref: 26 pid: 8382 timeout: 697 lvb_type: 0 00000100:00100000:1.0:1762166978.267269:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9614 00000100:00100000:1.0:1762166978.267278:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb387b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+26:2418:x1847765450510080:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166978.267289:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166978.267302:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbab0d4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 180224->212991) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e8e expref: 26 pid: 8382 timeout: 697 lvb_type: 0 00010000:00010000:1.0:1762166978.267311:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbab0d4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 180224->212991) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e8e expref: 26 pid: 8382 timeout: 697 lvb_type: 0 00010000:00010000:1.0:1762166978.267343:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbab0d4 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 180224->212991) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e8e expref: 26 pid: 8382 timeout: 697 lvb_type: 0 00010000:00010000:1.0:1762166978.267363:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166978.267366:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166978.267370:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945cc355ba00/0x2f180c4effbab271 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.267380:0:6479:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355ba00/0x2f180c4effbab271 lrc: 4/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.267407:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166978.267449:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb387b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+25:2418:x1847765450510080:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 172us (312us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166978.267451:0:35248:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945cc355ba00/0x2f180c4effbab271 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166978.267466:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9614 00010000:00010000:2.0:1762166978.267521:0:35248:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cc355ba00/0x2f180c4effbab271 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.267546:0:35248:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945cc355ba00/0x2f180c4effbab271 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.267555:0:35248:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355ba00/0x2f180c4effbab271 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.267570:0:35248:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945cc355ba00/0x2f180c4effbab271 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.267589:0:35248:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355ba00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166978.267593:0:35248:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc355ba00/0x2f180c4effbab271 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.267602:0:35248:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc355ba00/0x2f180c4effbab271 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.267616:0:35248:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945cc355ba00/0x2f180c4effbab271 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.267624:0:35248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cc355ba00/0x2f180c4effbab271 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166978.267686:0:35248:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+24:2418:x1847765450509312:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 5536us (5676us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166978.267695:0:35248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19033 00000100:00100000:3.0:1762166978.268844:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.268884:0:35248:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450510208 00000100:00100000:2.0:1762166978.268891:0:35248:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450510208 00000100:00100000:3.0:1762166978.268914:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.268949:0:35248:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450510336 00000100:00100000:2.0:1762166978.268954:0:35248:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450510336 00000100:00100000:0.0:1762166978.268967:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19036 00000100:00100000:0.0:1762166978.268980:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+24:2417:x1847765450510208:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166978.268999:0:8383:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1762166978.269006:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.269013:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19037 00010000:00010000:0.0:1762166978.269020:0:8383:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbab286 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9f28 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166978.269026:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+18:2417:x1847765450510336:12345-192.168.204.38@tcp:101:lfs.0 00000100:00100000:3.0:1762166978.269034:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450510464 00000100:00100000:3.0:1762166978.269039:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450510464 00010000:00010000:2.0:1762166978.269042:0:35248:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:0.0:1762166978.269046:0:8383:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa77:0x0] initial LVB size: 252073, mtime: 0x690888c2, atime: 0x690888c2, ctime: 0x690888c2, blocks: 0x128 00010000:00010000:0.0:1762166978.269066:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166978.269067:0:35248:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8800/0x2f180c4effbab28d lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9f2f expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.269069:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166978.269081:0:8383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbab286 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f28 expref: 26 pid: 8383 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1762166978.269086:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19038 00002000:00010000:2.0:1762166978.269090:0:35248:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa7a:0x0] initial LVB size: 0, mtime: 0x690888c2, atime: 0x690888c2, ctime: 0x690888c2, blocks: 0x1800 00000100:00100000:3.0:1762166978.269102:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+26:2416:x1847765450510464:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166978.269108:0:35248:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166978.269110:0:8383:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbab286 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f28 expref: 26 pid: 8383 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166978.269112:0:35248:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166978.269118:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166978.269123:0:35248:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8800/0x2f180c4effbab28d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f2f expref: 19 pid: 35248 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166978.269128:0:8383:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdf000, rc 0) 00010000:00010000:3.0:1762166978.269134:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effbab294 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9f36 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.269142:0:35248:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8800/0x2f180c4effbab28d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f2f expref: 19 pid: 35248 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166978.269156:0:35248:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa8800, rc 0) 00002000:00010000:3.0:1762166978.269164:0:28434:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa79:0x0] initial LVB size: 0, mtime: 0x690888c2, atime: 0x690888c2, ctime: 0x690888c2, blocks: 0x0 00000100:00100000:0.0:1762166978.269175:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+27:2417:x1847765450510208:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 197us (379us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166978.269176:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166978.269181:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1762166978.269188:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19036 00000100:00100000:2.0:1762166978.269189:0:35248:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+19:2417:x1847765450510336:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 163us (271us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166978.269190:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effbab294 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f36 expref: 27 pid: 28434 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1762166978.269208:0:35248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19037 00010000:00010000:3.0:1762166978.269228:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effbab294 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f36 expref: 26 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166978.269241:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8473000, rc 0) 00000100:00100000:3.0:1762166978.269272:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+26:2416:x1847765450510464:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 175us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166978.269278:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19038 00000100:00100000:3.0:1762166978.293155:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.293256:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450510592 00000100:00100000:0.0:1762166978.293269:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450510592 00000100:00100000:0.0:1762166978.293339:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19039 00000100:00100000:0.0:1762166978.293351:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4011f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+26:2418:x1847765450510592:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:0.0:1762166978.293550:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4011f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+26:2418:x1847765450510592:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 200us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166978.293559:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19039 00000100:00100000:1.0:1762166978.294610:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.294659:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450510720 00000100:00100000:0.0:1762166978.294666:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450510720 00000100:00100000:0.0:1762166978.294709:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30527 00000100:00100000:0.0:1762166978.294718:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+554:61855:x1847765450510720:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166978.294745:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166978.294769:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbab29b lrc: 2/0,0 mode: --/PR res: [0x240000404:0x60f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9f3d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.294809:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbab2a2 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x60f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166978.294823:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbab2a2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x60f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.294835:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbab2a2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x60f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.294968:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbab29b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x60f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f3d expref: 556 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.294980:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbab2a2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x60f:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f3d expref: 555 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.294987:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x60f:0x0].0x0 (ffff945bc6ab7200) 00010000:00010000:0.0:1762166978.294989:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1762166978.294992:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bde600, rc 0) 00000100:00100000:0.0:1762166978.295030:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+555:61855:x1847765450510720:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 314us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166978.295040:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30527 00000100:00100000:2.0:1762166978.295950:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.296001:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450510976 00000100:00100000:0.0:1762166978.296007:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450510976 00000100:00100000:0.0:1762166978.296041:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30528 00000100:00100000:0.0:1762166978.296049:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+555:61855:x1847765450510976:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:0.0:1762166978.296085:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166978.296102:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbab247 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x60f:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f0c expref: 555 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.296114:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x60f:0x0].0x0 (ffff945bc6ab7200) 00010000:00010000:0.0:1762166978.296118:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166978.296287:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbab2a9 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x60f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166978.296295:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbab2a9 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x60f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.296299:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbab2a9 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x60f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000001:00080000:0.0:1762166978.296336:0:6495:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992142 00000004:00010000:0.0:1762166978.296351:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000659d728d reply state 000000002dfcaccc transno 4294992143 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbab2a9 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x60f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.296360:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbab2a9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x60f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.296364:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x60f:0x0].0x0 (ffff945bc6ab7200) 00010000:00010000:0.0:1762166978.296366:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762166978.296368:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166978.296424:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+557:61855:x1847765450510976:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 376us (476us total) trans 4294992143 rc 0/0 00000100:00100000:0.0:1762166978.296430:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30528 00000020:00080000:0.0:1762166978.296435:0:6495:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1762166978.297225:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.297267:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450511104 00000100:00100000:0.0:1762166978.297272:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450511104 00000100:00100000:0.0:1762166978.297306:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30529 00000100:00100000:0.0:1762166978.297313:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4012300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+557:61855:x1847765450511104:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166978.297328:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166978.297343:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbab2b0 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x60f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9f44 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.297378:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbab2b0 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x60f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f44 expref: 558 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.297392:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbab2b0 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x60f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f44 expref: 558 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.297409:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x60f:0x0].0x0 (ffff945bc6ab7200) 00010000:00010000:0.0:1762166978.297412:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166978.297414:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bde800, rc 0) 00000100:00100000:0.0:1762166978.297448:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4012300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+558:61855:x1847765450511104:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 136us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166978.297452:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30529 00000100:00100000:1.0:1762166978.298304:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.298342:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450511232 00000100:00100000:0.0:1762166978.298347:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450511232 00000100:00100000:0.0:1762166978.298381:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19040 00000100:00100000:0.0:1762166978.298389:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+26:61855:x1847765450511232:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166978.298403:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166978.298416:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbab2b7 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9f4b expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.298441:0:28434:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945cc355be00/0x2f180c4effbab24e lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f13 expref: 27 pid: 35248 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166978.298449:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166978.298451:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166978.298455:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbab2b7 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f4b expref: 27 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.298511:0:28434:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945cc355be00/0x2f180c4effbab24e lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f13 expref: 27 pid: 35248 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166978.298525:0:28434:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945cc355be00/0x2f180c4effbab24e lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f13 expref: 27 pid: 35248 timeout: 697 lvb_type: 1 00000100:00100000:0.0:1762166978.298540:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7b23b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765449729280:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166978.298641:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7c0f600 going to sleep for 11 seconds 00000100:00100000:0.0:1762166978.299325:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7b23b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765449729280:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166978.299348:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbab2b7 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f4b expref: 27 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.299360:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdf400, rc 0) 00000100:00100000:0.0:1762166978.299394:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+27:61855:x1847765450511232:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1006us (1090us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166978.299402:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19040 00000100:00100000:3.0:1762166978.299625:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.299674:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450511360 00000100:00100000:1.0:1762166978.299679:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450511360 00010000:00010000:1.0:1762166978.299699:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355be00/0x2f180c4effbab24e lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f13 expref: 27 pid: 35248 timeout: 697 lvb_type: 1 00000100:00100000:1.0:1762166978.299723:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9615 00000100:00100000:1.0:1762166978.299729:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4011500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+27:2418:x1847765450511360:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166978.299737:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166978.299741:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945cc355be00/0x2f180c4effbab24e lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f13 expref: 27 pid: 35248 timeout: 697 lvb_type: 1 00010000:00010000:1.0:1762166978.299750:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945cc355be00/0x2f180c4effbab24e lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f13 expref: 27 pid: 35248 timeout: 697 lvb_type: 1 00010000:00010000:1.0:1762166978.299765:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cc355be00/0x2f180c4effbab24e lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f13 expref: 27 pid: 35248 timeout: 697 lvb_type: 1 00010000:00010000:1.0:1762166978.299774:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166978.299776:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166978.299779:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbab2b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f4b expref: 26 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.299786:0:6479:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbab2b7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f4b expref: 26 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.299805:0:6479:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbab2b7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f4b expref: 26 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166978.299812:0:6479:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6479:1847765449729408:192.168.204.38@tcp:105: 00000100:00100000:1.0:1762166978.299859:0:6479:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cee083e40 going to sleep for 11 seconds 00000100:00100000:0.0:1762166978.300608:0:6479:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6479:1847765449729408:192.168.204.38@tcp:105: 00010000:00010000:0.0:1762166978.300626:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166978.300650:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4011500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+26:2418:x1847765450511360:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 922us (1027us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166978.300656:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9615 00000100:00100000:3.0:1762166978.300747:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.300797:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450511488 00000100:00100000:0.0:1762166978.300802:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450511488 00000100:00100000:0.0:1762166978.300836:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19041 00000100:00100000:0.0:1762166978.300850:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4013100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+19:61855:x1847765450511488:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166978.300875:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166978.300890:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde200/0x2f180c4effbab2be lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa8b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9f52 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.300908:0:28434:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8c00/0x2f180c4effbab255 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f1a expref: 20 pid: 8382 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166978.300913:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166978.300914:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166978.300916:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde200/0x2f180c4effbab2be lrc: 4/0,0 mode: --/PW res: [0x280000400:0xa8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f52 expref: 20 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.300930:0:28434:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8c00/0x2f180c4effbab255 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f1a expref: 20 pid: 8382 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166978.300937:0:28434:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8c00/0x2f180c4effbab255 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f1a expref: 20 pid: 8382 timeout: 697 lvb_type: 1 00000100:00100000:0.0:1762166978.300944:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7b23b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765449729536:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166978.300980:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7c0f600 going to sleep for 11 seconds 00000100:00100000:0.0:1762166978.301731:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7b23b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765449729536:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166978.301746:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde200/0x2f180c4effbab2be lrc: 3/0,0 mode: --/PW res: [0x280000400:0xa8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f52 expref: 20 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.301761:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bde200, rc 0) 00000100:00100000:0.0:1762166978.301793:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4013100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+20:61855:x1847765450511488:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 943us (1044us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166978.301800:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19041 00000100:00100000:3.0:1762166978.301925:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.301961:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450511616 00000100:00100000:0.0:1762166978.301966:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450511616 00010000:00010000:0.0:1762166978.301985:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8c00/0x2f180c4effbab255 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f1a expref: 20 pid: 8382 timeout: 697 lvb_type: 1 00000100:00100000:0.0:1762166978.302023:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9616 00000100:00100000:0.0:1762166978.302034:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4013480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450511616:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166978.302045:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166978.302051:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8c00/0x2f180c4effbab255 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa8b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f1a expref: 20 pid: 8382 timeout: 697 lvb_type: 1 00010000:00010000:0.0:1762166978.302064:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8c00/0x2f180c4effbab255 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa8b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f1a expref: 20 pid: 8382 timeout: 697 lvb_type: 1 00010000:00010000:0.0:1762166978.302089:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8c00/0x2f180c4effbab255 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa8b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f1a expref: 20 pid: 8382 timeout: 697 lvb_type: 1 00010000:00010000:0.0:1762166978.302101:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166978.302103:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166978.302108:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde200/0x2f180c4effbab2be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f52 expref: 19 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.302117:0:6479:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde200/0x2f180c4effbab2be lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f52 expref: 19 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.302139:0:6479:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde200/0x2f180c4effbab2be lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f52 expref: 19 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166978.302148:0:6479:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7b23b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6479:1847765449729664:192.168.204.38@tcp:105: 00000100:00100000:0.0:1762166978.302185:0:6479:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7c0f600 going to sleep for 11 seconds 00000100:00100000:0.0:1762166978.302931:0:6479:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7b23b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6479:1847765449729664:192.168.204.38@tcp:105: 00010000:00010000:0.0:1762166978.302942:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166978.302983:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4013480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450511616:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 952us (1058us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166978.302991:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9616 00000100:00100000:2.0:1762166978.303087:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166978.303132:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450511744 00000100:00100000:3.0:1762166978.303138:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450511744 00002000:00010000:3.0:1762166978.303168:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2698 (0->18446744073709551615) 00002000:00100000:3.0:1762166978.303174:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5804000 with x1847765450511744 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166978.303182:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5804000. 00000100:00100000:0.0:1762166978.303251:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2377 00000100:00100000:0.0:1762166978.303260:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5804000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+26:2418:x1847765450511744:12345-192.168.204.38@tcp:10:lfs.0 00000100:00100000:2.0:1762166978.303411:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00002000:00010000:0.0:1762166978.303454:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa8a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166978.303460:0:23939:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa8a:0x0] updating lvb mtime from disk: 0 -> 1762166978 00002000:00010000:0.0:1762166978.303464:0:23939:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa8a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1762166978.303466:0:23939:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa8a:0x0] updating lvb ctime from disk: 0 -> 1762166978 00000100:00100000:3.0:1762166978.303470:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450511872 00002000:00010000:0.0:1762166978.303470:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa8a:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166978.303500:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450511872 00002000:00010000:3.0:1762166978.303519:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2699 (0->18446744073709551615) 00002000:00100000:3.0:1762166978.303523:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5805c00 with x1847765450511872 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166978.303532:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc5805c00. 00000100:00100000:3.0:1762166978.303560:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2378 00000100:00100000:0.0:1762166978.303568:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5804000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+27:2418:x1847765450511744:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 307us (481us total) trans 17179876452 rc 0/0 00000100:00100000:3.0:1762166978.303574:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5805c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450511872:12345-192.168.204.38@tcp:10:lfs.0 00000100:00100000:0.0:1762166978.303584:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2377 00002000:00010000:0.0:1762166978.303589:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2698 (0->18446744073709551615) 00002000:00100000:0.0:1762166978.303592:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5804000 with x1847765450511744 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166978.303598:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5804000. 00002000:00010000:3.0:1762166978.303680:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa8b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166978.303684:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa8b:0x0] updating lvb mtime from disk: 0 -> 1762166978 00002000:00010000:3.0:1762166978.303687:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa8b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1762166978.303689:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa8b:0x0] updating lvb ctime from disk: 0 -> 1762166978 00002000:00010000:3.0:1762166978.303691:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa8b:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166978.303734:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5805c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450511872:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 165us (323us total) trans 21474843328 rc 0/0 00000100:00100000:3.0:1762166978.303741:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2378 00002000:00010000:3.0:1762166978.303745:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2699 (0->18446744073709551615) 00002000:00100000:3.0:1762166978.303747:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5805c00 with x1847765450511872 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166978.303793:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc5805c00. 00000100:00100000:2.0:1762166978.305159:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.305245:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450512000 00000100:00100000:0.0:1762166978.305256:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450512000 00000100:00100000:0.0:1762166978.305295:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19042 00000100:00100000:0.0:1762166978.305304:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+27:2416:x1847765450512000:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:0.0:1762166978.305393:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+27:2416:x1847765450512000:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 90us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166978.305401:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19042 00000100:00100000:2.0:1762166978.306434:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.306520:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450512128 00000100:00100000:0.0:1762166978.306525:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450512128 00000100:00100000:0.0:1762166978.306558:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19043 00000100:00100000:0.0:1762166978.306566:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+27:2419:x1847765450512128:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:0.0:1762166978.306641:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+27:2419:x1847765450512128:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 75us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166978.306648:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19043 00000100:00100000:1.0:1762166978.307923:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166978.307975:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450512256 00000100:00100000:3.0:1762166978.307981:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450512256 00000100:00100000:3.0:1762166978.308027:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2379 00000100:00100000:3.0:1762166978.308037:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+27:2419:x1847765450512256:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:3.0:1762166978.308066:0:8388:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8472600/0x2f180c4effbab2c5 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.308081:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166978.308084:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166978.308090:0:8388:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472600/0x2f180c4effbab2c5 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->20479] (req 0->20479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.308104:0:8388:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8472600/0x2f180c4effbab2c5 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->20479] (req 0->20479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.309301:0:8388:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8472600/0x2f180c4effbab2c5 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->20479] (req 0->20479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.309316:0:8388:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472600/0x2f180c4effbab2c5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->20479] (req 0->20479) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.309325:0:8388:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc8472600/0x2f180c4effbab2c5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->20479] (req 0->20479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.309332:0:8388:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8472600 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166978.309337:0:8388:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8472600/0x2f180c4effbab2c5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->20479] (req 0->20479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.309347:0:8388:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8472600/0x2f180c4effbab2c5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->20479] (req 0->20479) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.309364:0:8388:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc8472600/0x2f180c4effbab2c5 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->20479] (req 0->20479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.309372:0:8388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8472600/0x2f180c4effbab2c5 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->20479] (req 0->20479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166978.309438:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+27:2419:x1847765450512256:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 1402us (1518us total) trans 0 rc 20480/20480 00000100:00100000:2.0:1762166978.309447:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2379 00000100:00100000:2.0:1762166978.310705:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166978.310777:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450512384 00000100:00100000:3.0:1762166978.310789:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450512384 00000100:00100000:3.0:1762166978.310844:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2380 00000100:00100000:3.0:1762166978.310853:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+27:2418:x1847765450512384:12345-192.168.204.38@tcp:4:lfs.0 00010000:00010000:3.0:1762166978.310897:0:8388:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc8472400/0x2f180c4effbab2cc lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.310917:0:8388:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbab2b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f4b expref: 27 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.310925:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166978.310927:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166978.310930:0:8388:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472400/0x2f180c4effbab2cc lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 3 type: EXT [0->20479] (req 0->20479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.310969:0:8388:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbab2b7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f4b expref: 27 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.310984:0:8388:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbab2b7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f4b expref: 27 pid: 28434 timeout: 697 lvb_type: 0 00000100:00100000:3.0:1762166978.310996:0:8388:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:8388:1847765449729792:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166978.311079:0:8388:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf3a33cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166978.311923:0:8388:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:8388:1847765449729792:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166978.312020:0:8388:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc8472400/0x2f180c4effbab2cc lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 3 type: EXT [0->20479] (req 0->20479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166978.312071:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.312133:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450512512 00000100:00100000:0.0:1762166978.312139:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450512512 00010000:00010000:0.0:1762166978.312162:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbab2b7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f4b expref: 28 pid: 28434 timeout: 697 lvb_type: 0 00000100:00100000:0.0:1762166978.312199:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9617 00000100:00100000:0.0:1762166978.312209:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+28:2418:x1847765450512512:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166978.312219:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166978.312238:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbab2b7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f4b expref: 28 pid: 28434 timeout: 697 lvb_type: 0 00010000:00010000:0.0:1762166978.312251:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbab2b7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f4b expref: 28 pid: 28434 timeout: 697 lvb_type: 0 00010000:00010000:0.0:1762166978.312271:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbab2b7 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f4b expref: 28 pid: 28434 timeout: 697 lvb_type: 0 00010000:00010000:0.0:1762166978.312286:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166978.312287:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166978.312291:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc8472400/0x2f180c4effbab2cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 3 type: EXT [0->20479] (req 0->20479) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.312300:0:6479:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472400/0x2f180c4effbab2cc lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 3 type: EXT [0->20479] (req 0->20479) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.312332:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166978.312355:0:8388:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc8472400/0x2f180c4effbab2cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 2 type: EXT [0->20479] (req 0->20479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.312365:0:8388:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8472400/0x2f180c4effbab2cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 2 type: EXT [0->20479] (req 0->20479) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166978.312373:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+27:2418:x1847765450512512:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 164us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166978.312383:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9617 00000001:00080000:0.0:1762166978.314882:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876453 is committed 00000001:00080000:0.0:1762166978.314915:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876448 is committed 00002000:00010000:3.0:1762166978.314999:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa8a:0x0] updating lvb size from disk: 0 -> 20480 00002000:00010000:3.0:1762166978.315005:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa8a:0x0] updating lvb blocks from disk: 0 -> 40 00010000:00010000:3.0:1762166978.315015:0:8388:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc8472400/0x2f180c4effbab2cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 2 type: EXT [0->20479] (req 0->20479) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.315023:0:8388:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472400/0x2f180c4effbab2cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 2 type: EXT [0->20479] (req 0->20479) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.315029:0:8388:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc8472400/0x2f180c4effbab2cc lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 2 type: EXT [0->20479] (req 0->20479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.315033:0:8388:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8472400 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166978.315036:0:8388:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8472400/0x2f180c4effbab2cc lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 2 type: EXT [0->20479] (req 0->20479) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.315044:0:8388:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8472400/0x2f180c4effbab2cc lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 2 type: EXT [0->20479] (req 0->20479) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.315058:0:8388:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc8472400/0x2f180c4effbab2cc lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 2 type: EXT [0->20479] (req 0->20479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.315066:0:8388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8472400/0x2f180c4effbab2cc lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 2 type: EXT [0->20479] (req 0->20479) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166978.315142:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450512384:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 4286us (4437us total) trans 17179876453 rc 0/0 00000100:00100000:3.0:1762166978.315152:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2380 00000100:00100000:1.0:1762166978.316364:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.316416:0:35248:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450512640 00000100:00100000:2.0:1762166978.316422:0:35248:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450512640 00000100:00100000:2.0:1762166978.316461:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19044 00000100:00100000:2.0:1762166978.316467:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450512640:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:2.0:1762166978.316560:0:35248:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450512640:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 92us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166978.316568:0:35248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19044 00000100:00100000:2.0:1762166978.317586:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.317623:0:35248:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450512768 00000100:00100000:1.0:1762166978.317627:0:35248:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450512768 00000100:00100000:1.0:1762166978.317653:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19045 00000100:00100000:1.0:1762166978.317658:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450512768:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:1.0:1762166978.317700:0:35248:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450512768:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 41us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166978.317705:0:35248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19045 00000100:00100000:0.0:1762166978.318785:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166978.318824:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450512896 00000100:00100000:3.0:1762166978.318828:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450512896 00000100:00100000:3.0:1762166978.318869:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2381 00000100:00100000:3.0:1762166978.318877:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450512896:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:3.0:1762166978.318897:0:8388:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effbab2d3 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.318906:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166978.318907:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166978.318912:0:8388:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effbab2d3 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [208896->253951] (req 208896->253951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.318920:0:8388:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effbab2d3 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [208896->253951] (req 208896->253951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.319728:0:8388:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effbab2d3 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [208896->253951] (req 208896->253951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.319735:0:8388:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effbab2d3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [208896->253951] (req 208896->253951) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.319740:0:8388:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effbab2d3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [208896->253951] (req 208896->253951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.319743:0:8388:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8473600 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166978.319746:0:8388:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effbab2d3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [208896->253951] (req 208896->253951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.319751:0:8388:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effbab2d3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [208896->253951] (req 208896->253951) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.319761:0:8388:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effbab2d3 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [208896->253951] (req 208896->253951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.319765:0:8388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effbab2d3 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [208896->253951] (req 208896->253951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166978.319797:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450512896:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 921us (1012us total) trans 0 rc 43177/43177 00000100:00100000:3.0:1762166978.319801:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2381 00000100:00100000:2.0:1762166978.320841:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166978.320875:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450513024 00000100:00100000:3.0:1762166978.320879:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450513024 00000100:00100000:3.0:1762166978.320906:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2382 00000100:00100000:3.0:1762166978.320910:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4533100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+17:2417:x1847765450513024:12345-192.168.204.38@tcp:4:lfs.0 00002000:00010000:3.0:1762166978.320933:0:8388:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa8a:0x0] initial LVB size: 20480, mtime: 0x690888c2, atime: 0x0, ctime: 0x690888c2, blocks: 0x28 00010000:00010000:3.0:1762166978.320939:0:8388:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effbab2da lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.320948:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166978.320950:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166978.320953:0:8388:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effbab2da lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 2 type: EXT [208896->253951] (req 208896->253951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.320962:0:8388:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effbab2da lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 2 type: EXT [208896->253951] (req 208896->253951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1762166978.322966:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876454 is committed 00002000:00010000:3.0:1762166978.323057:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa8a:0x0] updating lvb size from disk: 20480 -> 252073 00002000:00010000:3.0:1762166978.323066:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa8a:0x0] updating lvb blocks from disk: 40 -> 128 00010000:00010000:3.0:1762166978.323079:0:8388:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effbab2da lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 2 type: EXT [208896->253951] (req 208896->253951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.323090:0:8388:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effbab2da lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 2 type: EXT [208896->253951] (req 208896->253951) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.323100:0:8388:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effbab2da lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 2 type: EXT [208896->253951] (req 208896->253951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.323108:0:8388:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8472c00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166978.323113:0:8388:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effbab2da lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 2 type: EXT [208896->253951] (req 208896->253951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.323122:0:8388:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effbab2da lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 2 type: EXT [208896->253951] (req 208896->253951) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.323140:0:8388:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effbab2da lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 2 type: EXT [208896->253951] (req 208896->253951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.323148:0:8388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effbab2da lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 2 type: EXT [208896->253951] (req 208896->253951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166978.323238:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4533100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+17:2417:x1847765450513024:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 2322us (2393us total) trans 17179876454 rc 0/0 00000100:00100000:3.0:1762166978.323250:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2382 00000100:00100000:2.0:1762166978.324306:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.324376:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450513152 00000100:00100000:0.0:1762166978.324383:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450513152 00000100:00100000:0.0:1762166978.324435:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30530 00000100:00100000:0.0:1762166978.324445:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc59d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+558:61855:x1847765450513152:12345-192.168.204.38@tcp:44:lfs.0 00000001:00080000:3.0:1762166978.325376:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294992143 is committed 00010000:00010000:2.0:1762166978.325409:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbab1d0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00000020:00080000:3.0:1762166978.325419:0:7412:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff945d0116cb40 refcount 2 committed 0 result 0 batchid 50 00010000:00010000:2.0:1762166978.325422:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbab1d0 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00000020:00080000:3.0:1762166978.325424:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945bc2d82a00 obd lustre-OST0001-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff945ccac369c0 00000020:00080000:3.0:1762166978.325432:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945bc2d82800 obd lustre-OST0000-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff945d0116c540 00000020:00080000:3.0:1762166978.325438:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cf1e99f00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff945bc5dbc200 00010000:00010000:2.0:1762166978.325438:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbab1d0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00000020:00080000:3.0:1762166978.325445:0:7412:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000400:0x2:0x0].49 00010000:00010000:2.0:1762166978.325453:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355b800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166978.325458:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbab1d0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.325467:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbab1d0 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00000020:00080000:3.0:1762166978.325471:0:7412:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0001: 49 batchid updated 00010000:00010000:2.0:1762166978.325509:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:2.0:1762166978.325513:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166978.325518:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbab1d0 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.325523:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbab1d0 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000020:00080000:0.0:1762166978.325524:0:7435:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 50 committed batchid 49 00010000:00010000:2.0:1762166978.325551:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbab2a9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x60f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.325556:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbab2a9 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x60f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.325561:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbab2a9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x60f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.325567:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdf200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166978.325569:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbab2a9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x60f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.325573:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbab2a9 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x60f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.325582:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x60f:0x0].0x0 (ffff945bc6ab7200) 00010000:00010000:2.0:1762166978.325585:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166978.325589:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbab2a9 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x60f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.325592:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbab2a9 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x60f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000100:00100000:1.0:1762166978.325664:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc59d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+529:61855:x1847765450513152:12345-192.168.204.38@tcp:44:lfs.0 Request processed in 1218us (1356us total) trans 0 rc 0/0 00000020:00080000:0.0:1762166978.325668:0:7435:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 49 cancel update log [0x240000400:0x2:0x0].48: rc = 0 00000100:00100000:1.0:1762166978.325678:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30530 00000020:00080000:0.0:1762166978.325681:0:7435:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 49 00000100:00100000:2.0:1762166978.326784:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.326832:0:35248:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450513280 00000100:00100000:1.0:1762166978.326839:0:35248:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450513280 00000100:00100000:1.0:1762166978.326894:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19046 00000100:00100000:1.0:1762166978.326902:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc59d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450513280:12345-192.168.204.38@tcp:16:lfs.0 00000100:00100000:2.0:1762166978.326916:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.326952:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450513408 00000100:00100000:0.0:1762166978.326959:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450513408 00000100:00100000:1.0:1762166978.326981:0:35248:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc59d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450513280:12345-192.168.204.38@tcp:16:lfs.0 Request processed in 79us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166978.326987:0:35248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19046 00000100:00100000:1.0:1762166978.327005:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19047 00000100:00100000:1.0:1762166978.327018:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc59d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450513408:12345-192.168.204.38@tcp:16:lfs.0 00000001:00080000:3.0:1762166978.327921:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843328 is committed 00000001:00080000:3.0:1762166978.327930:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843326 is committed 00000100:00100000:1.0:1762166978.328036:0:35248:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc59d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+16:2419:x1847765450513408:12345-192.168.204.38@tcp:16:lfs.0 Request processed in 1022us (1122us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166978.328046:0:35248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19047 00000100:00100000:2.0:1762166978.334065:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.334107:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.334137:0:35248:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450513536 00000100:00100000:2.0:1762166978.334145:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.334151:0:35248:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450513536 00000100:00100000:3.0:1762166978.334169:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450513664 00000100:00100000:3.0:1762166978.334183:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450513664 00000100:00100000:1.0:1762166978.334221:0:35248:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450513792 00000100:00100000:1.0:1762166978.334228:0:35248:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450513792 00000100:00100000:0.0:1762166978.334229:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19048 00000100:00100000:0.0:1762166978.334250:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc59d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450513536:12345-192.168.204.38@tcp:1:lfs.0 00000100:00100000:3.0:1762166978.334260:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19049 00000100:00100000:2.0:1762166978.334282:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19050 00000100:00100000:3.0:1762166978.334283:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc59d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+16:2418:x1847765450513664:12345-192.168.204.38@tcp:1:lfs.0 00000100:00100000:2.0:1762166978.334302:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc59d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450513792:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:0.0:1762166978.334309:0:28434:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbab2e1 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.334325:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166978.334328:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166978.334332:0:8382:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbab2e8 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.334334:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbab2e1 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.334338:0:8383:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc8472c00/0x2f180c4effbab2ef lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.334380:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166978.334381:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166978.334385:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166978.334385:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166978.334395:0:8383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8472c00/0x2f180c4effbab2ef lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.334397:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbab2e8 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.334402:0:28434:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbab2e1 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.334438:0:8383:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc8472c00/0x2f180c4effbab2ef lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.334461:0:28434:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbab2e1 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.334516:0:8383:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc8472c00/0x2f180c4effbab2ef lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.334520:0:8382:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbab2e8 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.334537:0:28434:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbab2e1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.334562:0:8383:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8472c00/0x2f180c4effbab2ef lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.334576:0:8382:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbab2e8 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.334578:0:28434:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbab2e1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.334594:0:8383:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc8472c00/0x2f180c4effbab2ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.334615:0:28434:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdfa00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166978.334617:0:8382:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbab2e8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.334624:0:8383:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8472c00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166978.334627:0:28434:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbab2e1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.334636:0:8383:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc8472c00/0x2f180c4effbab2ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.334655:0:8382:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbab2e8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.334670:0:28434:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbab2e1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.334680:0:8383:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc8472c00/0x2f180c4effbab2ef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.334712:0:8382:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa9e00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166978.334722:0:8382:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbab2e8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.334727:0:28434:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbab2e1 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.334728:0:8383:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc8472c00/0x2f180c4effbab2ef lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.334739:0:8382:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbab2e8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.334762:0:8383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc8472c00/0x2f180c4effbab2ef lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.334771:0:28434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbab2e1 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.334810:0:8382:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbab2e8 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.334820:0:8382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbab2e8 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166978.334909:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc59d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+16:2418:x1847765450513664:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 629us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166978.334910:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc59d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450513792:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 608us (757us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166978.334910:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc59d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450513536:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 657us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166978.334939:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19049 00000100:00100000:0.0:1762166978.334950:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19048 00000100:00100000:2.0:1762166978.334963:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19050 00000100:00100000:2.0:1762166978.335830:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.335890:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450514048 00000100:00100000:1.0:1762166978.335895:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450514048 00000100:00100000:1.0:1762166978.335935:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30531 00000100:00100000:1.0:1762166978.335941:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc59d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+529:61855:x1847765450514048:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:1.0:1762166978.336024:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbab2f6 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x60f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166978.336038:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbab2f6 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x60f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.336046:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbab2f6 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x60f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00010000:1.0:1762166978.336199:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000eb77b688 reply state 000000008ef08642 transno 4294992144 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbab2f6 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x60f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.336213:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbab2f6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x60f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.336221:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x60f:0x0].0x0 (ffff945bc6ab7200) 00010000:00010000:1.0:1762166978.336225:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166978.336228:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166978.336299:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc59d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+531:61855:x1847765450514048:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 358us (474us total) trans 4294992144 rc 0/0 00000100:00100000:1.0:1762166978.336304:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30531 00000100:00100000:1.0:1762166978.337261:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.337303:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.337307:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450514176 00000100:00100000:2.0:1762166978.337314:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450514176 00000100:00100000:2.0:1762166978.337361:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450514304 00000100:00100000:2.0:1762166978.337365:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450514304 00000100:00100000:0.0:1762166978.337381:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19051 00000100:00100000:0.0:1762166978.337401:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+17:2416:x1847765450514176:12345-192.168.204.38@tcp:2:lfs.0 00000100:00100000:2.0:1762166978.337412:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19052 00000100:00100000:2.0:1762166978.337426:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+16:2416:x1847765450514304:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:2.0:1762166978.337607:0:8382:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa8b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166978.337612:0:8382:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa8b:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166978.337614:0:8382:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa8b:0x0] updating lvb atime from disk: 0 -> 1762166978 00002000:00010000:2.0:1762166978.337616:0:8382:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa8b:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166978.337619:0:8382:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa8b:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1762166978.337664:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+18:2416:x1847765450514176:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 270us (403us total) trans 17179876455 rc 0/0 00000100:00100000:2.0:1762166978.337671:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+17:2416:x1847765450514304:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 246us (363us total) trans 21474843329 rc 0/0 00000100:00100000:0.0:1762166978.337685:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19051 00000100:00100000:2.0:1762166978.337696:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19052 00000100:00100000:2.0:1762166978.338444:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.338512:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450514560 00000100:00100000:1.0:1762166978.338522:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450514560 00000100:00100000:1.0:1762166978.338571:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30532 00000100:00100000:1.0:1762166978.338585:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc59d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+531:61855:x1847765450514560:12345-192.168.204.38@tcp:55:lfs.0 00010000:00010000:1.0:1762166978.338641:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbab2fd lrc: 3/0,1 mode: --/PW res: [0x240000404:0x60f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166978.338656:0:6495:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbab2a2 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x60f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f3d expref: 531 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.338663:0:6495:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbab2fd lrc: 4/0,1 mode: --/PW res: [0x240000404:0x60f:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.338698:0:6495:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbab2a2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x60f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f3d expref: 531 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.338713:0:6495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbab2a2 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x60f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f3d expref: 531 pid: 6495 timeout: 697 lvb_type: 0 00000100:00100000:1.0:1762166978.338729:0:6495:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6495:1847765449729920:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166978.338827:0:6495:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cee083e40 going to sleep for 11 seconds 00000100:00100000:1.0:1762166978.339469:0:6495:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6495:1847765449729920:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166978.339513:0:6495:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbab2fd lrc: 3/0,1 mode: --/PW res: [0x240000404:0x60f:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000100:00100000:2.0:1762166978.339697:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.339743:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450514688 00000100:00100000:0.0:1762166978.339750:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450514688 00010000:00010000:0.0:1762166978.339771:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbab2a2 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x60f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f3d expref: 532 pid: 6495 timeout: 697 lvb_type: 0 00000100:00100000:0.0:1762166978.339805:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9618 00000100:00100000:0.0:1762166978.339812:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff1ab850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+532:2418:x1847765450514688:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166978.339826:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166978.339833:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbab2a2 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x60f:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f3d expref: 532 pid: 6495 timeout: 697 lvb_type: 0 00010000:00010000:0.0:1762166978.339844:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbab2a2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x60f:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f3d expref: 532 pid: 6495 timeout: 697 lvb_type: 0 00010000:00010000:0.0:1762166978.339874:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbab2a2 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x60f:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f3d expref: 532 pid: 6495 timeout: 697 lvb_type: 0 00010000:00010000:0.0:1762166978.339888:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x60f:0x0].0x0 (ffff945bc6ab7200) 00010000:00010000:0.0:1762166978.339893:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbab2fd lrc: 3/0,1 mode: --/PW res: [0x240000404:0x60f:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.339900:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbab2fd lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x60f:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.339907:0:6479:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbab2fd lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x60f:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.339935:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166978.339970:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff1ab850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+531:2418:x1847765450514688:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 159us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166978.339978:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9618 00010000:00010000:1.0:1762166978.340048:0:6495:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbab2fd lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x60f:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.340057:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbab2fd lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x60f:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.340086:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbab2fd lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x60f:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.340092:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbab2fd lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x60f:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.340099:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbab2fd lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x60f:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.340104:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355b400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166978.340108:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbab2fd lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x60f:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.340119:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbab2fd lrc: 4/0,0 mode: PW/PW res: [0x240000404:0x60f:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.340129:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x60f:0x0].0x0 (ffff945bc6ab7200) 00010000:00010000:1.0:1762166978.340132:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1762166978.340135:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbab2fd lrc: 2/0,0 mode: --/PW res: [0x240000404:0x60f:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.340141:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbab2fd lrc: 0/0,0 mode: --/PW res: [0x240000404:0x60f:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000100:00100000:1.0:1762166978.340188:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc59d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+530:61855:x1847765450514560:12345-192.168.204.38@tcp:55:lfs.0 Request processed in 1609us (1745us total) trans 0 rc -22/-22 00000100:00100000:1.0:1762166978.340197:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30532 00000100:00100000:2.0:1762166978.341114:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.341154:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450514944 00000100:00100000:1.0:1762166978.341159:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450514944 00000100:00100000:1.0:1762166978.341202:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30533 00000100:00100000:1.0:1762166978.341211:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc59d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+530:61855:x1847765450514944:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:1.0:1762166978.341245:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166978.341257:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbab1ec lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ef0 expref: 530 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.341266:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:1.0:1762166978.341268:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166978.341292:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbab304 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166978.341299:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbab304 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.341306:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbab304 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00010000:1.0:1762166978.341393:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000086fc15cf reply state 000000003e49afdc transno 4294992145 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbab304 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.341401:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbab304 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.341405:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:1.0:1762166978.341407:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166978.341408:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166978.341457:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc59d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+531:61855:x1847765450514944:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 249us (348us total) trans 4294992145 rc 0/0 00000100:00100000:1.0:1762166978.341463:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30533 00000100:00100000:3.0:1762166978.342342:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.342391:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450515072 00000100:00100000:3.0:1762166978.342398:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.342400:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450515072 00000100:00100000:0.0:1762166978.342442:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450515200 00000100:00100000:0.0:1762166978.342447:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450515200 00000100:00100000:2.0:1762166978.342470:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19053 00000100:00100000:2.0:1762166978.342525:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450515072:12345-192.168.204.38@tcp:2:lfs.0 00000100:00100000:3.0:1762166978.342534:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.342543:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19054 00000100:00100000:1.0:1762166978.342558:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450515328 00000100:00100000:1.0:1762166978.342566:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450515328 00000100:00100000:0.0:1762166978.342574:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450515200:12345-192.168.204.38@tcp:2:lfs.0 00000100:00100000:3.0:1762166978.342607:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19055 00000100:00100000:3.0:1762166978.342622:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3d5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450515328:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:2.0:1762166978.342696:0:8382:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 252073 -> 252073 00002000:00010000:0.0:1762166978.342697:0:28434:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166978.342711:0:8382:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:0.0:1762166978.342711:0:28434:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:3.0:1762166978.342715:0:8383:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166978.342727:0:8382:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:0.0:1762166978.342727:0:28434:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:3.0:1762166978.342728:0:8383:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:3.0:1762166978.342752:0:8383:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166978.342755:0:8382:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:0.0:1762166978.342755:0:28434:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:3.0:1762166978.342757:0:8383:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:0.0:1762166978.342776:0:28434:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00002000:00010000:3.0:1762166978.342777:0:8383:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:2.0:1762166978.342782:0:8382:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 296 -> 296 00000100:00100000:0.0:1762166978.342824:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450515200:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 266us (426us total) trans 21474843330 rc 0/0 00000100:00100000:3.0:1762166978.342835:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3d5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450515328:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 216us (301us total) trans 17179876457 rc 0/0 00000100:00100000:2.0:1762166978.342842:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450515072:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 350us (489us total) trans 17179876456 rc 0/0 00000100:00100000:0.0:1762166978.342843:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19054 00000100:00100000:3.0:1762166978.342880:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19055 00000100:00100000:2.0:1762166978.342890:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19053 00000100:00100000:3.0:1762166978.343638:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.343682:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450515584 00000100:00100000:2.0:1762166978.343686:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450515584 00000100:00100000:2.0:1762166978.343713:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11870 00000100:00100000:2.0:1762166978.343719:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+531:61855:x1847765450515584:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:2.0:1762166978.343769:0:6497:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x240000404:0x5eb:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbab263 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f21 expref: 531 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.343802:0:6497:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbab30b lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 00010000:00010000:2.0:1762166978.343815:0:6497:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbab191 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ecd expref: 531 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.343822:0:6497:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a400/0x2f180c4effbab1c9 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9edb expref: 531 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.343828:0:6497:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbab30b lrc: 5/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166978.343855:0:6497:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a400/0x2f180c4effbab1c9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9edb expref: 531 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.343876:0:6497:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a400/0x2f180c4effbab1c9 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9edb expref: 531 pid: 6495 timeout: 697 lvb_type: 0 00000100:00100000:2.0:1762166978.343891:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc59d4a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6497:1847765449730048:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166978.343945:0:6497:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbab191 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ecd expref: 531 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.343952:0:6497:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbab191 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ecd expref: 531 pid: 6495 timeout: 697 lvb_type: 0 00000100:00100000:2.0:1762166978.343959:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc59d5500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6497:1847765449730176:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166978.343976:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc56bf0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166978.344760:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc59d4a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6497:1847765449730048:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166978.344768:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc59d5500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6497:1847765449730176:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166978.344782:0:6497:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbab30b lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00000100:00100000:3.0:1762166978.344956:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166978.344995:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.345010:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450515712 00000100:00100000:0.0:1762166978.345016:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450515712 00010000:00010000:0.0:1762166978.345037:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a400/0x2f180c4effbab1c9 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9edb expref: 532 pid: 6495 timeout: 697 lvb_type: 0 00000100:00100000:2.0:1762166978.345042:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450515840 00000100:00100000:2.0:1762166978.345047:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450515840 00010000:00010000:2.0:1762166978.345065:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbab191 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ecd expref: 533 pid: 6495 timeout: 697 lvb_type: 0 00000100:00100000:0.0:1762166978.345082:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9619 00000100:00100000:0.0:1762166978.345097:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+533:2418:x1847765450515712:12345-192.168.204.38@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1762166978.345104:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9620 00010000:00010000:0.0:1762166978.345110:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166978.345120:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a400/0x2f180c4effbab1c9 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9edb expref: 533 pid: 6495 timeout: 697 lvb_type: 0 00000100:00100000:2.0:1762166978.345122:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+533:2418:x1847765450515840:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166978.345137:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a400/0x2f180c4effbab1c9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9edb expref: 533 pid: 6495 timeout: 697 lvb_type: 0 00010000:00010000:2.0:1762166978.345139:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166978.345150:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbab191 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ecd expref: 533 pid: 6495 timeout: 697 lvb_type: 0 00010000:00010000:0.0:1762166978.345156:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a400/0x2f180c4effbab1c9 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9edb expref: 533 pid: 6495 timeout: 697 lvb_type: 0 00010000:00010000:2.0:1762166978.345176:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbab191 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ecd expref: 533 pid: 6495 timeout: 697 lvb_type: 0 00010000:00010000:2.0:1762166978.345190:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbab191 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ecd expref: 532 pid: 6495 timeout: 697 lvb_type: 0 00010000:00010000:0.0:1762166978.345190:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:0.0:1762166978.345199:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbab30b lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166978.345209:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbab30b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166978.345215:0:6479:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbab30b lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166978.345221:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:2.0:1762166978.345225:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166978.345238:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166978.345264:0:6497:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbab30b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00000100:00100000:2.0:1762166978.345266:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+531:2418:x1847765450515840:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 152us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166978.345277:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+531:2418:x1847765450515712:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 180us (316us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166978.345301:0:6497:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbab30b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00000100:00100000:2.0:1762166978.345302:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9620 00000100:00100000:0.0:1762166978.345318:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9619 00010000:00010000:3.0:1762166978.345332:0:6497:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473600/0x2f180c4effbab312 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x60f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 00010000:00010000:3.0:1762166978.345347:0:6497:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbab2b0 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x60f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f44 expref: 529 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.345354:0:6497:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473600/0x2f180c4effbab312 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x60f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT1 00010000:00010000:3.0:1762166978.345379:0:6497:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbab2b0 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x60f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f44 expref: 529 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.345392:0:6497:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbab2b0 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x60f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f44 expref: 529 pid: 6495 timeout: 697 lvb_type: 0 00000100:00100000:3.0:1762166978.345403:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783f480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6497:1847765449730304:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166978.345534:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf3a33cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166978.346183:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783f480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6497:1847765449730304:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166978.346193:0:6497:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473600/0x2f180c4effbab312 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x60f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00000100:00100000:1.0:1762166978.347442:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.347505:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450515968 00000100:00100000:0.0:1762166978.347510:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450515968 00010000:00010000:0.0:1762166978.347530:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbab2b0 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x60f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f44 expref: 530 pid: 6495 timeout: 697 lvb_type: 0 00000100:00100000:0.0:1762166978.347562:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9621 00000100:00100000:0.0:1762166978.347570:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+530:2418:x1847765450515968:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166978.347578:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166978.347584:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbab2b0 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x60f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f44 expref: 530 pid: 6495 timeout: 697 lvb_type: 0 00010000:00010000:0.0:1762166978.347600:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbab2b0 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x60f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f44 expref: 530 pid: 6495 timeout: 697 lvb_type: 0 00010000:00010000:0.0:1762166978.347615:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbab2b0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x60f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f44 expref: 530 pid: 6495 timeout: 697 lvb_type: 0 00010000:00010000:0.0:1762166978.347626:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x60f:0x0].0x0 (ffff945bc6ab7200) 00010000:00010000:0.0:1762166978.347630:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473600/0x2f180c4effbab312 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x60f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166978.347637:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473600/0x2f180c4effbab312 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x60f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166978.347643:0:6479:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473600/0x2f180c4effbab312 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x60f:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166978.347664:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166978.347674:0:6497:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473600/0x2f180c4effbab312 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x60f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166978.347680:0:6497:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473600/0x2f180c4effbab312 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x60f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00000100:00100000:0.0:1762166978.347701:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+529:2418:x1847765450515968:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 131us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166978.347710:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9621 00000100:00100000:2.0:1762166978.347939:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc59d5500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449730432:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762166978.347977:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166978.348004:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d0116c480 going to sleep for 11 seconds 00000100:00100000:1.0:1762166978.348015:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449730432 00000100:00100000:1.0:1762166978.348020:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449730432 00000100:00100000:1.0:1762166978.348045:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1369 00000100:00100000:1.0:1762166978.348052:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc59d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:6497:x1847765449730432:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762166978.348107:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc59d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:6497:x1847765449730432:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 56us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166978.348113:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1369 00000100:00100000:2.0:1762166978.348128:0:6497:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 17179876448 gen 2 00000004:00080000:2.0:1762166978.348132:0:6497:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 17179876441 committed transno 17179876448 00000004:00080000:2.0:1762166978.348146:0:6497:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc55dd500, transno 17179876442 00000004:00080000:2.0:1762166978.348158:0:6497:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc55de300, transno 17179876443 00000004:00080000:2.0:1762166978.348160:0:6497:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc55dc380, transno 17179876444 00000004:00080000:2.0:1762166978.348161:0:6497:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc55de680, transno 17179876445 00000004:00080000:2.0:1762166978.348163:0:6497:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc55dc700, transno 17179876446 00000004:00080000:2.0:1762166978.348165:0:6497:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 17179876448 committed transno 17179876448 00000100:00100000:2.0:1762166978.348176:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc59d5500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449730432:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762166978.348204:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc59d5500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449730560:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762166978.348222:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166978.348240:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7c77cc0 going to sleep for 11 seconds 00000004:00080000:0.0:1762166978.348257:0:9994:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0001: 1 changes, 0 in progress, 0 in flight, 5 done 00000100:00100000:1.0:1762166978.348260:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449730560 00000100:00100000:1.0:1762166978.348265:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449730560 00000100:00100000:1.0:1762166978.348292:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1370 00000100:00100000:1.0:1762166978.348298:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc59d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:6497:x1847765449730560:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762166978.348352:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc59d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:6497:x1847765449730560:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 54us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166978.348358:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1370 00000100:00100000:2.0:1762166978.348360:0:6497:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 21474843326 gen 2 00000004:00080000:2.0:1762166978.348364:0:6497:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 21474843320 committed transno 21474843326 00000004:00080000:2.0:1762166978.348374:0:6497:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc4011880, transno 21474843321 00000004:00080000:2.0:1762166978.348385:0:6497:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc4012a00, transno 21474843322 00000004:00080000:2.0:1762166978.348388:0:6497:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc4011c00, transno 21474843323 00000004:00080000:2.0:1762166978.348390:0:6497:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc4011180, transno 21474843324 00000004:00080000:2.0:1762166978.348394:0:6497:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc4010380, transno 21474843325 00000004:00080000:2.0:1762166978.348398:0:6497:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 21474843326 committed transno 21474843326 00000100:00100000:2.0:1762166978.348409:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc59d5500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449730560:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762166978.348450:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc59d5500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449730688:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762166978.348469:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1762166978.348472:0:9158:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0001: 1 changes, 0 in progress, 0 in flight, 5 done 00000100:00100000:2.0:1762166978.348504:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc56bff00 going to sleep for 11 seconds 00000100:00100000:1.0:1762166978.348526:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449730688 00000100:00100000:1.0:1762166978.348530:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449730688 00000100:00100000:1.0:1762166978.348552:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1371 00000100:00100000:1.0:1762166978.348558:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc59d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:6497:x1847765449730688:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762166978.348603:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc59d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:6497:x1847765449730688:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 45us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166978.348610:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1371 00000100:00100000:2.0:1762166978.348612:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc59d5500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449730688:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762166978.348638:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc59d5500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449730816:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762166978.348657:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166978.348675:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc56bf0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166978.348683:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449730816 00000100:00100000:1.0:1762166978.348686:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449730816 00000100:00100000:1.0:1762166978.348708:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1372 00000100:00100000:1.0:1762166978.348714:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc59d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:6497:x1847765449730816:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762166978.348758:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc59d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:6497:x1847765449730816:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 44us (99us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166978.348764:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1372 00000100:00100000:2.0:1762166978.348767:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc59d5500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449730816:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762166978.348800:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc59d5500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449730944:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762166978.348818:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166978.348839:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d0116c540 going to sleep for 11 seconds 00000100:00100000:1.0:1762166978.348847:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449730944 00000100:00100000:1.0:1762166978.348851:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449730944 00000100:00100000:1.0:1762166978.348891:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1373 00000100:00100000:1.0:1762166978.348898:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc59d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:6497:x1847765449730944:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762166978.348965:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc59d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:6497:x1847765449730944:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 67us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166978.348971:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1373 00000100:00100000:2.0:1762166978.348982:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc59d5500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449730944:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762166978.349010:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc59d5500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449731072:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762166978.349029:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166978.349045:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d0116c480 going to sleep for 11 seconds 00000100:00100000:1.0:1762166978.349047:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449731072 00000100:00100000:1.0:1762166978.349050:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449731072 00000100:00100000:1.0:1762166978.349072:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1374 00000100:00100000:1.0:1762166978.349077:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc59d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:6497:x1847765449731072:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762166978.349124:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc59d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:6497:x1847765449731072:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 47us (93us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166978.349130:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1374 00000100:00100000:2.0:1762166978.349133:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc59d5500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449731072:0@lo:1000:mdt_rdpg00_000.0 00000040:00080000:2.0:1762166978.349231:0:6497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x2:0x0].50, 456 off67008 00000001:00080000:2.0:1762166978.349237:0:6497:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992146 00000100:00100000:2.0:1762166978.349267:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc59d5500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449731200:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762166978.349285:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166978.349304:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7c0f240 going to sleep for 11 seconds 00000100:00100000:1.0:1762166978.349322:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449731200 00000100:00100000:1.0:1762166978.349326:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449731200 00000100:00100000:1.0:1762166978.349353:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1375 00000100:00100000:1.0:1762166978.349362:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc59d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:6497:x1847765449731200:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762166978.349451:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc59d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:6497:x1847765449731200:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 90us (164us total) trans 17179876458 rc 0/0 00000100:00100000:1.0:1762166978.349459:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1375 00000100:00100000:2.0:1762166978.349463:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc59d5500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449731200:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762166978.349514:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc59d6300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449731328:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762166978.349535:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166978.349548:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d0116c540 going to sleep for 11 seconds 00000100:00100000:1.0:1762166978.349557:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449731328 00000100:00100000:1.0:1762166978.349560:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449731328 00000100:00100000:2.0:1762166978.349586:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1376 00000100:00100000:2.0:1762166978.349593:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc59d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:6497:x1847765449731328:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762166978.349665:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc59d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:6497:x1847765449731328:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 72us (128us total) trans 21474843331 rc 0/0 00000100:00100000:2.0:1762166978.349673:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1376 00000100:00100000:3.0:1762166978.349710:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc59d6300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449731328:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1762166978.349756:0:6497:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992147 00010000:00010000:3.0:1762166978.349779:0:6497:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473600/0x2f180c4effbab312 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x60f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT1 00010000:00010000:3.0:1762166978.349785:0:6497:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473600/0x2f180c4effbab312 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x60f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT1 00010000:00010000:3.0:1762166978.349789:0:6497:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473600/0x2f180c4effbab312 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x60f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT1 00010000:00010000:3.0:1762166978.349793:0:6497:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8473600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166978.349796:0:6497:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473600/0x2f180c4effbab312 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x60f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT1 00010000:00010000:3.0:1762166978.349801:0:6497:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473600/0x2f180c4effbab312 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x60f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT1 00010000:00010000:3.0:1762166978.349809:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x60f:0x0].0x0 (ffff945bc6ab7200) 00010000:00010000:3.0:1762166978.349811:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166978.349814:0:6497:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473600/0x2f180c4effbab312 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x60f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT1 00010000:00010000:3.0:1762166978.349818:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473600/0x2f180c4effbab312 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x60f:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT1 00010000:00010000:3.0:1762166978.349825:0:6497:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbab30b lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT1 00010000:00010000:3.0:1762166978.349828:0:6497:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbab30b lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT1 00010000:00010000:3.0:1762166978.349831:0:6497:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbab30b lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT1 00010000:00010000:3.0:1762166978.349837:0:6497:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa9e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166978.349839:0:6497:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbab30b lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT1 00010000:00010000:3.0:1762166978.349842:0:6497:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbab30b lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT1 00010000:00010000:3.0:1762166978.349846:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:3.0:1762166978.349847:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166978.349848:0:6497:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbab30b lrc: 2/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT1 00010000:00010000:3.0:1762166978.349851:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbab30b lrc: 0/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT1 00010000:00010000:3.0:1762166978.349859:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:3.0:1762166978.349874:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166978.349880:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbab263 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f21 expref: 531 pid: 6495 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166978.349937:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+530:61855:x1847765450515584:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 6218us (6300us total) trans 4294992148 rc 0/0 00000100:00100000:3.0:1762166978.349942:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11870 00000020:00080000:3.0:1762166978.349945:0:6497:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1762166978.350859:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.350909:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450516096 00000100:00100000:0.0:1762166978.350914:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450516096 00000100:00100000:0.0:1762166978.350946:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30534 00000100:00100000:0.0:1762166978.350954:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+530:61855:x1847765450516096:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166978.350968:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166978.350981:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbab319 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9f59 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.351016:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbab319 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f59 expref: 531 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.351024:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbab319 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f59 expref: 531 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.351034:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:0.0:1762166978.351036:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166978.351038:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bde600, rc 0) 00000100:00100000:0.0:1762166978.351063:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+531:61855:x1847765450516096:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 111us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166978.351067:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30534 00000100:00100000:1.0:1762166978.352202:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166978.352235:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450516352 00000100:00100000:3.0:1762166978.352240:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450516352 00000100:00100000:3.0:1762166978.352273:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11871 00000100:00100000:3.0:1762166978.352281:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+531:61855:x1847765450516352:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:3.0:1762166978.352382:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+532:61855:x1847765450516352:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 102us (180us total) trans 4294992149 rc 0/0 00000100:00100000:3.0:1762166978.352387:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11871 00000100:00100000:1.0:1762166978.353083:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166978.353118:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450516608 00000100:00100000:3.0:1762166978.353122:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450516608 00000100:00100000:3.0:1762166978.353148:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11872 00000100:00100000:3.0:1762166978.353153:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+532:61855:x1847765450516608:12345-192.168.204.38@tcp:35:lfs.0 00000004:00080000:3.0:1762166978.353252:0:6497:0:(mdd_object.c:3965:mdd_close()) Object [0x240000404:0x60f:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:3.0:1762166978.353301:0:6497:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effbab320 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x60f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 00010000:00010000:3.0:1762166978.353309:0:6497:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effbab320 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x60f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6497 initiator: MDT1 00010000:00010000:3.0:1762166978.353315:0:6497:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effbab320 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x60f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6497 initiator: MDT1 00010000:00010000:3.0:1762166978.353320:0:6497:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effbab320 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x60f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6497 initiator: MDT1 00010000:00010000:3.0:1762166978.353324:0:6497:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effbab320 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x60f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6497 initiator: MDT1 00010000:00010000:3.0:1762166978.353327:0:6497:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effbab320 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x60f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6497 initiator: MDT1 00010000:00010000:3.0:1762166978.353342:0:6497:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762166978.353363:0:6483:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166978.353369:0:6483:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effbab320 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x60f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166978.353377:0:6483:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8472400 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166978.353382:0:6483:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effbab320 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x60f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166978.353390:0:6483:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effbab320 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x60f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166978.353402:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x60f:0x0].0x0 (ffff945bc6ab7200) 00010000:00010000:1.0:1762166978.353405:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1762166978.353409:0:6483:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effbab320 lrc: 1/0,0 mode: --/PW res: [0x240000404:0x60f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166978.353414:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effbab320 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x60f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166978.353432:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166978.353434:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166978.353435:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166978.353472:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+533:61855:x1847765450516608:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 316us (387us total) trans 4294992150 rc 0/0 00000100:00100000:3.0:1762166978.353499:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11872 00000100:00100000:1.0:1762166978.362158:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.362229:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450516736 00000100:00100000:0.0:1762166978.362239:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450516736 00000100:00100000:0.0:1762166978.362295:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30535 00000100:00100000:0.0:1762166978.362308:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+533:61856:x1847765450516736:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166978.362330:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166978.362348:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbab327 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9f60 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.362398:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbab32e lrc: 3/1,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166978.362408:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbab32e lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.362416:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbab32e lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.362427:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbab335 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166978.362431:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbab335 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.362435:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbab335 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.362519:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbab33c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166978.362524:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbab33c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.362529:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbab33c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:0.0:1762166978.362561:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 252073 00000004:00200000:0.0:1762166978.362564:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166978.362577:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbab33c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.362587:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbab33c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.362596:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbab32e lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.362602:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbab32e lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.362608:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbab32e lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.362618:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbab32e lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.362623:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdfa00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166978.362627:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbab32e lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.362634:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbab32e lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.362646:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:0.0:1762166978.362649:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166978.362653:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbab32e lrc: 3/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.362659:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbab32e lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.362671:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbab335 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.362677:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbab335 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.362683:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbab335 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.362689:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bde400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166978.362692:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbab335 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.362697:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbab335 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.362706:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0xdd396665 (ffff945bc4afe900) 00010000:00010000:0.0:1762166978.362708:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166978.362709:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbab335 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.362713:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbab335 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.362737:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbab327 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f60 expref: 535 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.362746:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbab33c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f60 expref: 534 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.362750:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:0.0:1762166978.362752:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166978.362753:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdf800, rc 0) 00000100:00100000:0.0:1762166978.362798:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+534:61856:x1847765450516736:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 495us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166978.362803:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30535 00000100:00100000:1.0:1762166978.364224:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.364268:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450516992 00000100:00100000:0.0:1762166978.364274:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450516992 00000100:00100000:0.0:1762166978.364308:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30536 00000100:00100000:0.0:1762166978.364317:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+534:61856:x1847765450516992:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166978.364330:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166978.364340:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbab343 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9f67 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.364422:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbab34a lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166978.364433:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbab34a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.364442:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbab34a lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:0.0:1762166978.364451:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 252073 00010000:00010000:0.0:1762166978.364550:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbab343 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f67 expref: 537 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.364564:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbab34a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f67 expref: 536 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.364571:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:0.0:1762166978.364574:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1762166978.364583:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdfc00, rc 0) 00000100:00100000:0.0:1762166978.364619:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+536:61856:x1847765450516992:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 303us (397us total) trans 4294992151 rc 0/0 00000100:00100000:0.0:1762166978.364625:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30536 00000100:00100000:1.0:1762166978.365890:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.365932:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450517248 00000100:00100000:0.0:1762166978.365938:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450517248 00000100:00100000:0.0:1762166978.365975:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30537 00000100:00100000:0.0:1762166978.365984:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+536:61856:x1847765450517248:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166978.365997:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166978.366006:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbab358 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9f6e expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.366049:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbab35f lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166978.366057:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbab35f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.366063:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbab35f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:0.0:1762166978.366070:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 252073 00010000:00010000:0.0:1762166978.366126:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbab358 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f6e expref: 539 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.366141:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbab35f lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f6e expref: 538 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.366148:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:0.0:1762166978.366151:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166978.366154:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdf200, rc 0) 00000100:00100000:0.0:1762166978.366194:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+538:61856:x1847765450517248:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 212us (305us total) trans 4294992152 rc 0/0 00000100:00100000:0.0:1762166978.366202:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30537 00010000:00010000:2.0:1762166978.386759:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166978.395146:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166978.395199:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450517376 00000100:00100000:3.0:1762166978.395209:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450517376 00000100:00100000:3.0:1762166978.395271:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2383 00000100:00100000:3.0:1762166978.395278:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:2416:x1847765450517376:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:3.0:1762166978.395305:0:8388:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effbab36d lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.395316:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166978.395318:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166978.395322:0:8388:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effbab36d lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.395334:0:8388:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effbab36d lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.396957:0:8388:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effbab36d lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.396971:0:8388:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effbab36d lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.396979:0:8388:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effbab36d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.396986:0:8388:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8473600 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166978.396989:0:8388:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effbab36d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.396998:0:8388:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effbab36d lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.397014:0:8388:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effbab36d lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.397022:0:8388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effbab36d lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166978.397084:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:2416:x1847765450517376:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 1803us (1947us total) trans 0 rc 252073/252073 00000100:00100000:3.0:1762166978.397094:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2383 00000100:00100000:1.0:1762166978.399155:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166978.399221:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450517504 00000100:00100000:3.0:1762166978.399237:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450517504 00000100:00100000:3.0:1762166978.399317:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2384 00000100:00100000:3.0:1762166978.399329:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450517504:12345-192.168.204.38@tcp:3:lfs.0 00002000:00010000:3.0:1762166978.399386:0:8388:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa8a:0x0] initial LVB size: 252073, mtime: 0x690888c2, atime: 0x690888c2, ctime: 0x690888c2, blocks: 0x80 00010000:00010000:3.0:1762166978.399396:0:8388:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effbab374 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.399411:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166978.399414:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166978.399420:0:8388:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effbab374 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 2 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.399434:0:8388:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effbab374 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 2 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.401101:0:8388:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effbab374 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 2 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.401115:0:8388:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effbab374 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 2 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.401126:0:8388:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effbab374 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 2 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.401131:0:8388:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8472c00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166978.401134:0:8388:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effbab374 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 2 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.401139:0:8388:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effbab374 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 2 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.401151:0:8388:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effbab374 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 2 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.401156:0:8388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effbab374 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 2 type: EXT [0->253951] (req 0->253951) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166978.401216:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450517504:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 1889us (2062us total) trans 0 rc 252073/252073 00000100:00100000:3.0:1762166978.401223:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2384 00000100:00100000:1.0:1762166978.407977:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.408045:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450517632 00000100:00100000:0.0:1762166978.408057:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450517632 00000100:00100000:0.0:1762166978.408123:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 878 00000100:00100000:0.0:1762166978.408135:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+538:61856:x1847765450517632:12345-192.168.204.38@tcp:103:lfs.0 00010000:00010000:0.0:1762166978.408160:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166978.408186:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbab35f lrc: 0/0,0 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f6e expref: 538 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.408204:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:0.0:1762166978.408209:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166978.408265:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+537:61856:x1847765450517632:12345-192.168.204.38@tcp:103:lfs.0 Request processed in 133us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166978.408273:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 878 00000100:00100000:1.0:1762166978.409049:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166978.409126:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450517888 00000100:00100000:3.0:1762166978.409142:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450517888 00000100:00100000:3.0:1762166978.409205:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11873 00000100:00100000:3.0:1762166978.409222:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7be5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+537:61856:x1847765450517888:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:3.0:1762166978.409526:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7be5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+538:61856:x1847765450517888:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 312us (478us total) trans 4294992153 rc 0/0 00000100:00100000:3.0:1762166978.409535:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11873 00000100:00100000:1.0:1762166978.411560:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.411615:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450518144 00000100:00100000:0.0:1762166978.411624:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450518144 00000100:00100000:0.0:1762166978.411672:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30538 00000100:00100000:0.0:1762166978.411684:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+538:61766:x1847765450518144:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:0.0:1762166978.411708:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166978.411726:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbab37b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9f75 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.411828:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbab382 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166978.411844:0:6495:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbab33c lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f60 expref: 539 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.411853:0:6495:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbab382 lrc: 4/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.411905:0:6495:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbab33c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f60 expref: 539 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.411920:0:6495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbab33c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f60 expref: 539 pid: 6495 timeout: 697 lvb_type: 0 00000100:00100000:0.0:1762166978.411939:0:6495:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7b23800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6495:1847765449731456:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166978.412026:0:6495:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc9a5e600 going to sleep for 11 seconds 00000100:00100000:0.0:1762166978.413015:0:6495:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7b23800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6495:1847765449731456:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166978.413049:0:6495:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbab382 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000100:00100000:1.0:1762166978.413123:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.413172:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450518272 00000100:00100000:0.0:1762166978.413179:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450518272 00010000:00010000:0.0:1762166978.413207:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbab33c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f60 expref: 540 pid: 6495 timeout: 697 lvb_type: 0 00000100:00100000:0.0:1762166978.413254:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9622 00000100:00100000:0.0:1762166978.413265:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+540:2419:x1847765450518272:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166978.413280:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166978.413287:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbab33c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f60 expref: 540 pid: 6495 timeout: 697 lvb_type: 0 00010000:00010000:0.0:1762166978.413300:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbab33c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f60 expref: 540 pid: 6495 timeout: 697 lvb_type: 0 00010000:00010000:0.0:1762166978.413324:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbab33c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f60 expref: 540 pid: 6495 timeout: 697 lvb_type: 0 00010000:00010000:0.0:1762166978.413342:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:0.0:1762166978.413347:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbab382 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.413361:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbab382 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.413369:0:6479:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbab382 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.413399:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166978.413426:0:6495:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbab382 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.413433:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbab382 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000100:00100000:0.0:1762166978.413454:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+539:2419:x1847765450518272:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 191us (331us total) trans 0 rc 0/0 00000004:00200000:1.0:1762166978.413455:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 252073 00000100:00100000:0.0:1762166978.413466:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9622 00010000:00010000:1.0:1762166978.413616:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbab37b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f75 expref: 540 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.413629:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbab382 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f75 expref: 539 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.413641:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:1.0:1762166978.413644:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1762166978.413647:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdee00, rc 0) 00000100:00100000:1.0:1762166978.413685:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+539:61766:x1847765450518144:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 2004us (2130us total) trans 4294992154 rc 0/0 00000100:00100000:1.0:1762166978.413694:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30538 00000100:00100000:1.0:1762166978.414761:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.414794:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450518400 00000100:00100000:0.0:1762166978.414799:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450518400 00000100:00100000:0.0:1762166978.414837:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30539 00000100:00100000:0.0:1762166978.414846:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+539:61766:x1847765450518400:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:0.0:1762166978.414875:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166978.414892:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbab390 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9f7c expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.414976:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbab397 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166978.414989:0:6495:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbab382 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f75 expref: 540 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.415003:0:6495:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbab397 lrc: 4/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.415033:0:6495:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbab382 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f75 expref: 540 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.415053:0:6495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbab382 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f75 expref: 540 pid: 6495 timeout: 697 lvb_type: 0 00000100:00100000:0.0:1762166978.415069:0:6495:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7b23800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6495:1847765449731584:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166978.415136:0:6495:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc9a5e600 going to sleep for 11 seconds 00000100:00100000:0.0:1762166978.415882:0:6495:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7b23800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6495:1847765449731584:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166978.415899:0:6495:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbab397 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000100:00100000:1.0:1762166978.416100:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.416144:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450518528 00000100:00100000:0.0:1762166978.416150:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450518528 00010000:00010000:0.0:1762166978.416169:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbab382 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f75 expref: 541 pid: 6495 timeout: 697 lvb_type: 0 00000100:00100000:0.0:1762166978.416202:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9623 00000100:00100000:0.0:1762166978.416210:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+541:2419:x1847765450518528:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166978.416221:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166978.416227:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbab382 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f75 expref: 541 pid: 6495 timeout: 697 lvb_type: 0 00010000:00010000:0.0:1762166978.416239:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbab382 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f75 expref: 541 pid: 6495 timeout: 697 lvb_type: 0 00010000:00010000:0.0:1762166978.416257:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbab382 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f75 expref: 541 pid: 6495 timeout: 697 lvb_type: 0 00010000:00010000:0.0:1762166978.416275:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:0.0:1762166978.416279:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbab397 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.416287:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbab397 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.416294:0:6479:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbab397 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.416315:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166978.416337:0:6495:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbab397 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.416346:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbab397 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000100:00100000:0.0:1762166978.416351:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+540:2419:x1847765450518528:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 140us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166978.416362:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9623 00000004:00200000:1.0:1762166978.416388:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 252073 00000004:00200000:1.0:1762166978.416394:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166978.416413:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbab397 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.416438:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbab390 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f7c expref: 540 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.416452:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbab397 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f7c expref: 539 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.416458:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:1.0:1762166978.416460:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166978.416461:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bde800, rc 0) 00000100:00100000:1.0:1762166978.416510:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+539:61766:x1847765450518400:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 1665us (1754us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166978.416517:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30539 00000100:00100000:1.0:1762166978.417770:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.417858:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450518656 00000100:00100000:1.0:1762166978.417878:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.417881:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450518656 00000100:00100000:2.0:1762166978.417945:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450518784 00000100:00100000:2.0:1762166978.417948:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450518784 00000100:00100000:2.0:1762166978.417981:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19056 00000100:00100000:0.0:1762166978.417991:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19057 00000100:00100000:2.0:1762166978.417995:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450518656:12345-192.168.204.38@tcp:101:fsx.0 00000100:00100000:0.0:1762166978.418011:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450518784:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:2.0:1762166978.418016:0:8382:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166978.418034:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166978.418038:0:8382:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbab39e lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9f83 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.418052:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde400/0x2f180c4effbab3a5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa8b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9f8a expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166978.418062:0:8382:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa8a:0x0] initial LVB size: 252073, mtime: 0x690888c2, atime: 0x690888c2, ctime: 0x690888c2, blocks: 0x80 00010000:00010000:2.0:1762166978.418077:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166978.418079:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166978.418087:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbab39e lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f83 expref: 21 pid: 8382 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166978.418103:0:8382:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbab39e lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f83 expref: 21 pid: 8382 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1762166978.418109:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7b23800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765449731712:192.168.204.38@tcp:106: 00010000:00010000:2.0:1762166978.418119:0:8382:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa9000, rc 0) 00000100:00100000:2.0:1762166978.418179:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450518656:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 188us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166978.418187:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19056 00000100:00100000:0.0:1762166978.418188:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc9a5e600 going to sleep for 11 seconds 00000100:00100000:0.0:1762166978.419070:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7b23800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765449731712:192.168.204.38@tcp:106: 00010000:00010000:0.0:1762166978.419095:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde400/0x2f180c4effbab3a5 lrc: 1/0,0 mode: --/PR res: [0x280000400:0xa8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f8a expref: 19 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166978.419118:0:28434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde400/0x2f180c4effbab3a5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f8a expref: 19 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166978.419131:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bde400, rc 0) 00000100:00100000:0.0:1762166978.419172:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450518784:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 1170us (1293us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166978.419178:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19057 00000100:00100000:1.0:1762166978.420292:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.420364:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450518912 00000100:00100000:0.0:1762166978.420374:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450518912 00000100:00100000:0.0:1762166978.420416:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19058 00000100:00100000:0.0:1762166978.420422:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450518912:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:0.0:1762166978.420438:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166978.420453:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf800/0x2f180c4effbab3ac lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa8b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9f91 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166978.420539:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7b23800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765449731840:192.168.204.38@tcp:106: 00000100:00100000:0.0:1762166978.420617:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc9a5e600 going to sleep for 11 seconds 00000100:00100000:0.0:1762166978.421324:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7b23800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765449731840:192.168.204.38@tcp:106: 00010000:00010000:0.0:1762166978.421347:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf800/0x2f180c4effbab3ac lrc: 1/0,0 mode: --/PR res: [0x280000400:0xa8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f91 expref: 19 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166978.421364:0:28434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf800/0x2f180c4effbab3ac lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f91 expref: 19 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166978.421380:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdf800, rc 0) 00000100:00100000:0.0:1762166978.421419:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450518912:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 997us (1132us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166978.421425:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19058 00000100:00100000:3.0:1762166978.422304:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.422351:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450519040 00000100:00100000:0.0:1762166978.422357:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450519040 00000100:00100000:0.0:1762166978.422398:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19059 00000100:00100000:0.0:1762166978.422406:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+21:61766:x1847765450519040:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:0.0:1762166978.422420:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166978.422435:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbab3b3 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9f98 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.422457:0:28434:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbab39e lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f83 expref: 22 pid: 8382 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166978.422466:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166978.422468:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166978.422472:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbab3b3 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 3 type: EXT [102400->106495] (req 102400->106495) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f98 expref: 22 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.422529:0:28434:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbab39e lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f83 expref: 22 pid: 8382 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166978.422546:0:28434:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbab39e lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f83 expref: 22 pid: 8382 timeout: 697 lvb_type: 1 00000100:00100000:0.0:1762166978.422565:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7b23800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765449731968:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166978.422623:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc9a5e600 going to sleep for 11 seconds 00000100:00100000:0.0:1762166978.423432:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7b23800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765449731968:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166978.423458:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbab3b3 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 3 type: EXT [102400->106495] (req 102400->106495) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f98 expref: 22 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.423474:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdfa00, rc 0) 00000100:00100000:0.0:1762166978.423544:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+22:61766:x1847765450519040:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 1140us (1243us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166978.423551:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19059 00000100:00100000:1.0:1762166978.423746:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.423782:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450519168 00000100:00100000:0.0:1762166978.423788:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450519168 00010000:00010000:0.0:1762166978.423808:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbab39e lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f83 expref: 22 pid: 8382 timeout: 697 lvb_type: 1 00000100:00100000:0.0:1762166978.423839:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9624 00000100:00100000:0.0:1762166978.423848:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff1a9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450519168:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166978.423873:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166978.423901:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbab39e lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f83 expref: 22 pid: 8382 timeout: 697 lvb_type: 1 00010000:00010000:0.0:1762166978.423917:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbab39e lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f83 expref: 22 pid: 8382 timeout: 697 lvb_type: 1 00010000:00010000:0.0:1762166978.423941:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbab39e lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f83 expref: 22 pid: 8382 timeout: 697 lvb_type: 1 00010000:00010000:0.0:1762166978.423952:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166978.423953:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166978.423958:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbab3b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 102400->106495) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f98 expref: 21 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.423965:0:6479:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbab3b3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 102400->106495) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f98 expref: 21 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.423988:0:6479:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbab3b3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 102400->106495) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f98 expref: 21 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166978.424001:0:6479:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7b23800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6479:1847765449732096:192.168.204.38@tcp:105: 00000100:00100000:0.0:1762166978.424066:0:6479:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc9a5e600 going to sleep for 11 seconds 00000100:00100000:0.0:1762166978.424953:0:6479:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7b23800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6479:1847765449732096:192.168.204.38@tcp:105: 00010000:00010000:0.0:1762166978.424972:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166978.425003:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff1a9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450519168:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1157us (1259us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166978.425013:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9624 00000100:00100000:1.0:1762166978.425242:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166978.425280:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450519296 00000100:00100000:3.0:1762166978.425287:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450519296 00002000:00100000:3.0:1762166978.425330:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa8a:0x0] (102400->106495) req@ffff945bc48a9500 x1847765450519296/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:9/0 lens 488/0 e 0 to 0 dl 1762166989 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166978.425341:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc48a9500 with x1847765450519296 ext(102400->106495) 00002000:00010000:3.0:1762166978.425345:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc48a9500 00000100:00100000:3.0:1762166978.425379:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2385 00000100:00100000:3.0:1762166978.425388:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450519296:12345-192.168.204.38@tcp:3:lfs.0 00000100:00100000:3.0:1762166978.425569:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450519296:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 182us (327us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1762166978.425577:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2385 00002000:00100000:3.0:1762166978.425585:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa8a:0x0] (102400->106495) req@ffff945bc48a9500 x1847765450519296/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:9/0 lens 488/4536 e 0 to 0 dl 1762166989 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166978.425598:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc48a9500 with x1847765450519296 ext(102400->106495) 00002000:00010000:3.0:1762166978.425602:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc48a9500 00000100:00100000:1.0:1762166978.426844:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166978.426954:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450519552 00000100:00100000:3.0:1762166978.426960:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450519552 00000100:00100000:3.0:1762166978.427002:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11874 00000100:00100000:3.0:1762166978.427012:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+539:61766:x1847765450519552:12345-192.168.204.38@tcp:35:fsx.0 00000100:00100000:3.0:1762166978.427208:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+540:61766:x1847765450519552:12345-192.168.204.38@tcp:35:fsx.0 Request processed in 197us (369us total) trans 4294992155 rc 0/0 00000100:00100000:3.0:1762166978.427215:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11874 00000100:00100000:1.0:1762166978.428014:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.428074:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450519808 00000100:00100000:0.0:1762166978.428081:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450519808 00000100:00100000:0.0:1762166978.428118:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30540 00000100:00100000:0.0:1762166978.428127:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+540:61766:x1847765450519808:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:0.0:1762166978.428143:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166978.428146:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 1 00010000:00010000:0.0:1762166978.428169:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbab397 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f7c expref: 540 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.428189:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbab34a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f67 expref: 539 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.428202:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbab319 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f59 expref: 538 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.428211:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:0.0:1762166978.428216:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166978.428226:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbab3ba lrc: 2/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9f9f expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.428264:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbab3c1 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166978.428277:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbab3c1 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.428286:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbab3c1 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000040:00080000:0.0:1762166978.428535:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5906, 88 off462528 00000004:00080000:0.0:1762166978.428543:0:6495:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 597577065110ns, next at 597529919700ns, rc = 0 00000040:00080000:0.0:1762166978.428577:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5905, 88 off462528 00000004:00080000:0.0:1762166978.428583:0:6495:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 597577105321ns, next at 597529889568ns, rc = 0 00000040:00080000:0.0:1762166978.428608:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5906, 88 off462616 00000004:00080000:0.0:1762166978.428613:0:6495:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 597577135576ns, next at 597529889568ns, rc = 0 00000040:00080000:0.0:1762166978.428626:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5907, 88 off462616 00000004:00080000:0.0:1762166978.428631:0:6495:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 597577152921ns, next at 597529919700ns, rc = 0 00000040:00080000:0.0:1762166978.428653:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5908, 88 off462704 00000004:00080000:0.0:1762166978.428657:0:6495:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 597577179747ns, next at 597529919700ns, rc = 0 00000040:00080000:0.0:1762166978.428667:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5907, 88 off462704 00000004:00080000:0.0:1762166978.428671:0:6495:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 597577193607ns, next at 597529889568ns, rc = 0 00000001:00080000:3.0:1762166978.429660:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294992156 is committed 00000004:00080000:3.0:1762166978.429666:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3272 committed 00000004:00080000:3.0:1762166978.429673:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3269 committed 00000004:00080000:3.0:1762166978.429680:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3268 committed 00000004:00080000:3.0:1762166978.429682:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3271 committed 00000004:00080000:3.0:1762166978.429685:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3270 committed 00000004:00080000:3.0:1762166978.429689:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3267 committed 00010000:00010000:1.0:1762166978.429705:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbab2f6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x60f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00000020:00080000:3.0:1762166978.429711:0:7412:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff945cc7c77cc0 refcount 2 committed 0 result 0 batchid 51 00010000:00010000:1.0:1762166978.429714:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbab2f6 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x60f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00000020:00080000:3.0:1762166978.429717:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945bc2d82600 obd lustre-OST0001-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff945cc7c77f00 00010000:00010000:1.0:1762166978.429725:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbab2f6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x60f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00000020:00080000:3.0:1762166978.429726:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945bc2d82100 obd lustre-OST0000-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff945cc7c77840 00000020:00080000:3.0:1762166978.429735:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945bc2d82c00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff945bc55f9c00 00010000:00010000:1.0:1762166978.429736:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355a800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166978.429742:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbab2f6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x60f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00000020:00080000:3.0:1762166978.429743:0:7412:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000400:0x2:0x0].50 00010000:00010000:1.0:1762166978.429752:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbab2f6 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x60f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.429763:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x60f:0x0].0x0 (ffff945bc6ab7200) 00010000:00010000:1.0:1762166978.429766:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000020:00080000:3.0:1762166978.429767:0:7412:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0001: 50 batchid updated 00010000:00010000:1.0:1762166978.429771:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbab2f6 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x60f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.429777:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbab2f6 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x60f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000020:00080000:3.0:1762166978.429786:0:7435:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 51 committed batchid 50 00010000:00010000:1.0:1762166978.429798:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbab304 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.429802:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbab304 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.429807:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbab304 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.429811:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355ac00 already unused, calling callback (ffffffffc18e2310) 00000100:00100000:2.0:1762166978.429813:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7b23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449732224:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1762166978.429814:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbab304 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.429826:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbab304 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.429836:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:1.0:1762166978.429839:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166978.429843:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbab304 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.429849:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbab304 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.429852:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbab3c1 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f9f expref: 526 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.429876:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:0.0:1762166978.429878:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000100:00100000:2.0:1762166978.429883:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1762166978.429886:0:7435:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 50 cancel update log [0x240000400:0x2:0x0].49: rc = 0 00010000:00010000:0.0:1762166978.429891:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbab3ba lrc: 0/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f9f expref: 525 pid: 6495 timeout: 0 lvb_type: 3 00000020:00080000:3.0:1762166978.429899:0:7435:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 50 00000100:00100000:1.0:1762166978.429907:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449732608:0@lo:2:osp-syn-0-1.0 00010000:00010000:0.0:1762166978.429914:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbab3c1 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f9f expref: 524 pid: 6495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166978.429921:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449732736:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1762166978.429944:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166978.429959:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449732480:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1762166978.429968:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449732224 00000100:00100000:0.0:1762166978.429973:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449732224 00000100:00100000:3.0:1762166978.429975:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449732608 00000100:00100000:3.0:1762166978.429980:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449732608 00000100:00100000:1.0:1762166978.429984:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449733120:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1762166978.429993:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166978.430017:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166978.430020:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449732992:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1762166978.430020:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449732480 00000100:00100000:0.0:1762166978.430026:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449732480 00000100:00100000:3.0:1762166978.430027:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449733120 00000100:00100000:3.0:1762166978.430032:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449733120 00000100:00100000:2.0:1762166978.430050:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166978.430054:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449732352:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1762166978.430057:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449732992 00000100:00100000:3.0:1762166978.430062:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449732992 00000100:00100000:0.0:1762166978.430077:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19060 00000100:00100000:2.0:1762166978.430092:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19061 00000100:00100000:0.0:1762166978.430093:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+8:3636:x1847765449732224:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1762166978.430094:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166978.430101:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19062 00000100:00100000:2.0:1762166978.430107:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+8:3635:x1847765449732608:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166978.430111:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+8:3635:x1847765449733120:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1762166978.430115:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449732864:0@lo:2:osp-syn-0-1.0 00002000:00080000:0.0:1762166978.430127:0:28434:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:2698 count 1 00000100:00100000:1.0:1762166978.430140:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1762166978.430145:0:28434:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde400/0x2f180c4effbab3c8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.430162:0:28434:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc8472000/0x2f180c4effbab095 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e72 expref: 17 pid: 8383 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1762166978.430167:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449732352 00000100:00100000:1.0:1762166978.430172:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449732352 00010000:00010000:0.0:1762166978.430183:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166978.430187:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166978.430191:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde400/0x2f180c4effbab3c8 lrc: 4/0,1 mode: --/PW res: [0x280000400:0xa8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166978.430195:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449732864 00002000:00010000:3.0:1762166978.430196:0:8382:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa8b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166978.430196:0:8383:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:1.0:1762166978.430200:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449732864 00002000:00010000:3.0:1762166978.430204:0:8382:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa8b:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166978.430204:0:8383:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb mtime from disk: 1762166966 -> 1762166966 00002000:00010000:3.0:1762166978.430209:0:8382:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa8b:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166978.430209:0:8383:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1762166978.430212:0:8382:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa8b:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166978.430212:0:8383:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb ctime from disk: 1762166966 -> 1762166966 00002000:00010000:3.0:1762166978.430215:0:8382:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa8b:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:2.0:1762166978.430215:0:8383:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1762166978.430223:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19063 00010000:00010000:0.0:1762166978.430228:0:28434:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc8472000/0x2f180c4effbab095 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e72 expref: 17 pid: 8383 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1762166978.430236:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+8:3634:x1847765449732480:12345-0@lo:2:osp-syn-1-1.0 00010000:00010000:0.0:1762166978.430249:0:28434:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc8472000/0x2f180c4effbab095 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e72 expref: 17 pid: 8383 timeout: 697 lvb_type: 1 00000100:00100000:3.0:1762166978.430255:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+11:3635:x1847765449733120:12345-0@lo:2:osp-syn-0-1.0 Request processed in 142us (236us total) trans 21474843333 rc 0/0 00000100:00100000:2.0:1762166978.430255:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+11:3635:x1847765449732608:12345-0@lo:2:osp-syn-0-1.0 Request processed in 150us (309us total) trans 21474843332 rc 0/0 00000100:00100000:2.0:1762166978.430269:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19061 00000100:00100000:0.0:1762166978.430272:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765449733248:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166978.430275:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19062 00000100:00100000:2.0:1762166978.430286:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19064 00000100:00100000:3.0:1762166978.430290:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19065 00000100:00100000:2.0:1762166978.430294:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+8:3634:x1847765449732992:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166978.430297:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+9:3633:x1847765449732352:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1762166978.430308:0:8382:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:2697 count 1 00002000:00010000:1.0:1762166978.430318:0:9168:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 252073 -> 252073 00010000:00010000:3.0:1762166978.430321:0:8382:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effbab3cf lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa89:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762166978.430323:0:9168:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:1.0:1762166978.430330:0:9168:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00000100:00100000:0.0:1762166978.430337:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc9a5e0c0 going to sleep for 11 seconds 00002000:00010000:1.0:1762166978.430338:0:9168:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00010000:00010000:3.0:1762166978.430343:0:8382:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbaafb5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e41 expref: 20 pid: 35472 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762166978.430344:0:9168:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 296 -> 296 00002000:00010000:2.0:1762166978.430354:0:8383:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa8a:0x0] updating lvb size from disk: 252073 -> 252073 00010000:00010000:3.0:1762166978.430355:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166978.430358:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00002000:00010000:2.0:1762166978.430358:0:8383:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa8a:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00010000:00010000:3.0:1762166978.430361:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effbab3cf lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0xa89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166978.430362:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19066 00002000:00010000:2.0:1762166978.430363:0:8383:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa8a:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166978.430369:0:8383:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa8a:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166978.430371:0:8383:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa8a:0x0] updating lvb blocks from disk: 128 -> 128 00000100:00100000:0.0:1762166978.430376:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+9:3633:x1847765449732864:12345-0@lo:2:osp-syn-0-1.0 00010000:00010000:3.0:1762166978.430386:0:8382:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbaafb5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e41 expref: 20 pid: 35472 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166978.430386:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+10:3634:x1847765449732480:12345-0@lo:2:osp-syn-1-1.0 Request processed in 153us (395us total) trans 17179876459 rc 0/0 00000100:00100000:2.0:1762166978.430401:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+10:3634:x1847765449732992:12345-0@lo:2:osp-syn-1-1.0 Request processed in 109us (350us total) trans 17179876460 rc 0/0 00000100:00100000:1.0:1762166978.430402:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19063 00010000:00010000:3.0:1762166978.430406:0:8382:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbaafb5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e41 expref: 20 pid: 35472 timeout: 697 lvb_type: 0 00000100:00100000:2.0:1762166978.430412:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19064 00000100:00100000:3.0:1762166978.430418:0:8382:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8382:1847765449733376:192.168.204.38@tcp:104: 00002000:00010000:0.0:1762166978.430437:0:35472:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166978.430441:0:35472:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:0.0:1762166978.430443:0:35472:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00000100:00100000:3.0:1762166978.430444:0:8382:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf3a33240 going to sleep for 11 seconds 00002000:00010000:0.0:1762166978.430446:0:35472:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:0.0:1762166978.430450:0:35472:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00000004:00080000:2.0:1762166978.430461:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc55dd500/2, rc 0, transno 17179876459 00000100:00100000:2.0:1762166978.430467:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449732480:0@lo:2:osp-syn-1-1.0 00000004:00080000:2.0:1762166978.430510:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc55dc380/2, rc 0, transno 17179876460 00000100:00100000:2.0:1762166978.430515:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449732992:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1762166978.430521:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+10:3633:x1847765449732864:12345-0@lo:2:osp-syn-0-1.0 Request processed in 146us (378us total) trans 21474843334 rc 0/0 00000100:00100000:0.0:1762166978.430530:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19066 00000004:00080000:3.0:1762166978.430533:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc406ea00/2, rc 0, transno 21474843334 00000004:00080000:2.0:1762166978.430535:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc406e680/2, rc 0, transno 21474843332 00000100:00100000:3.0:1762166978.430540:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449732864:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1762166978.430540:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449732608:0@lo:2:osp-syn-0-1.0 00000004:00080000:2.0:1762166978.430551:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc406c700/2, rc 0, transno 21474843333 00000100:00100000:2.0:1762166978.430566:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449733120:0@lo:2:osp-syn-0-1.0 00010000:00010000:0.0:1762166978.430571:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:0.0:1762166978.430578:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1762166978.430582:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdea00, rc 0) 00000100:00100000:2.0:1762166978.430586:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166978.430622:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+524:61766:x1847765450519808:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 2495us (2608us total) trans 4294992156 rc 0/0 00000100:00100000:1.0:1762166978.430623:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449732736 00000100:00100000:1.0:1762166978.430629:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449732736 00000100:00100000:0.0:1762166978.430633:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30540 00000100:00100000:1.0:1762166978.430662:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19067 00000100:00100000:1.0:1762166978.430668:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+9:3636:x1847765449732736:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:1.0:1762166978.430713:0:9165:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166978.430716:0:9165:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:1.0:1762166978.430718:0:9165:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:1.0:1762166978.430719:0:9165:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:1.0:1762166978.430721:0:9165:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1762166978.430748:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+10:3636:x1847765449732736:12345-0@lo:2:osp-syn-1-1.0 Request processed in 80us (162us total) trans 17179876461 rc 0/0 00000100:00100000:1.0:1762166978.430755:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19067 00000004:00080000:2.0:1762166978.430779:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc55de300/2, rc 0, transno 17179876461 00000100:00100000:2.0:1762166978.430786:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449732736:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166978.431553:0:8382:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8382:1847765449733376:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166978.431554:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765449733248:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166978.431581:0:8382:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effbab3cf lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.431582:0:28434:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde400/0x2f180c4effbab3c8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166978.431856:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.431920:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450520064 00000100:00100000:0.0:1762166978.431925:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450520064 00010000:00010000:0.0:1762166978.431950:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8472000/0x2f180c4effbab095 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e72 expref: 18 pid: 8383 timeout: 697 lvb_type: 1 00000100:00100000:0.0:1762166978.431990:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9625 00000100:00100000:0.0:1762166978.431997:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bbb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450520064:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166978.432008:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166978.432014:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc8472000/0x2f180c4effbab095 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e72 expref: 18 pid: 8383 timeout: 697 lvb_type: 1 00010000:00010000:0.0:1762166978.432026:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc8472000/0x2f180c4effbab095 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e72 expref: 18 pid: 8383 timeout: 697 lvb_type: 1 00010000:00010000:0.0:1762166978.432044:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc8472000/0x2f180c4effbab095 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e72 expref: 18 pid: 8383 timeout: 697 lvb_type: 1 00010000:00010000:0.0:1762166978.432056:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166978.432059:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166978.432063:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde400/0x2f180c4effbab3c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.432072:0:6479:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde400/0x2f180c4effbab3c8 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.432099:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166978.432107:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.432130:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450519936 00000100:00100000:0.0:1762166978.432132:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bbb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450520064:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 134us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166978.432137:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450519936 00000100:00100000:0.0:1762166978.432143:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9625 00010000:00010000:1.0:1762166978.432158:0:6480:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbaafb5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e41 expref: 21 pid: 35472 timeout: 697 lvb_type: 0 00010000:00010000:0.0:1762166978.432177:0:28434:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde400/0x2f180c4effbab3c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.432187:0:28434:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde400/0x2f180c4effbab3c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166978.432191:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9626 00010000:00010000:0.0:1762166978.432201:0:28434:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde400/0x2f180c4effbab3c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166978.432202:0:6480:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450519936:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166978.432215:0:6480:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166978.432216:0:28434:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde400/0x2f180c4effbab3c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.432223:0:6480:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbaafb5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa89:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e41 expref: 21 pid: 35472 timeout: 697 lvb_type: 0 00010000:00010000:1.0:1762166978.432237:0:6480:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbaafb5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa89:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e41 expref: 21 pid: 35472 timeout: 697 lvb_type: 0 00010000:00010000:0.0:1762166978.432241:0:28434:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1762166978.432253:0:10257:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166978.432255:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbaafb5 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa89:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9e41 expref: 21 pid: 35472 timeout: 697 lvb_type: 0 00010000:00010000:3.0:1762166978.432262:0:10257:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde400/0x2f180c4effbab3c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.432267:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166978.432272:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166978.432277:0:10257:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bde400 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166978.432278:0:6480:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effbab3cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.432289:0:6480:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effbab3cf lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xa89:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.432315:0:6480:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166978.432341:0:6480:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450519936:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 141us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166978.432349:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9626 00010000:00010000:1.0:1762166978.432372:0:8382:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effbab3cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.432381:0:8382:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effbab3cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.432389:0:8382:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effbab3cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.432396:0:8382:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effbab3cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.432412:0:8382:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1762166978.432582:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+10:3633:x1847765449732352:12345-0@lo:6:osp-syn-1-1.0 Request processed in 2286us (2493us total) trans 17179876462 rc 0/0 00000100:00100000:1.0:1762166978.432590:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19065 00010000:00010000:3.0:1762166978.432613:0:10257:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde400/0x2f180c4effbab3c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.432613:0:6482:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166978.432620:0:6482:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effbab3cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.432628:0:10257:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde400/0x2f180c4effbab3c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.432630:0:6482:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8472c00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166978.432637:0:6482:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effbab3cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.432646:0:10257:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde400/0x2f180c4effbab3c8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.432655:0:10257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde400/0x2f180c4effbab3c8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.432668:0:6482:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effbab3cf lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.432684:0:6482:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effbab3cf lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xa89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.432686:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166978.432690:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166978.432693:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8472c00/0x2f180c4effbab3cf lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.432694:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166978.432712:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166978.432715:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166978.432718:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166978.432731:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000004:00080000:1.0:1762166978.432752:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc55dd880/2, rc 0, transno 17179876462 00000100:00100000:1.0:1762166978.432759:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449732352:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1762166978.432768:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+10:3636:x1847765449732224:12345-0@lo:6:osp-syn-0-1.0 Request processed in 2681us (2884us total) trans 21474843335 rc 0/0 00000100:00100000:0.0:1762166978.432778:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19060 00000100:00100000:1.0:1762166978.432780:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450520192 00000100:00100000:1.0:1762166978.432786:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450520192 00000004:00080000:2.0:1762166978.432819:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc7b23800/2, rc 0, transno 21474843335 00000100:00100000:1.0:1762166978.432821:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19068 00000100:00100000:2.0:1762166978.432829:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7b23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449732224:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1762166978.432837:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+20:61766:x1847765450520192:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:1.0:1762166978.432849:0:8382:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166978.432870:0:8382:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cc355bc00/0x2f180c4effbab3d6 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9fa6 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.432887:0:8382:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbab286 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f28 expref: 21 pid: 8383 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166978.432895:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166978.432897:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166978.432900:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355bc00/0x2f180c4effbab3d6 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [102400->106495] (req 102400->106495) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9fa6 expref: 21 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.432925:0:8382:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbab286 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f28 expref: 21 pid: 8383 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166978.432936:0:8382:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbab286 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f28 expref: 21 pid: 8383 timeout: 697 lvb_type: 1 00000100:00100000:1.0:1762166978.432947:0:8382:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bbaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8382:1847765449733504:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166978.432992:0:8382:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cee083780 going to sleep for 11 seconds 00000100:00100000:1.0:1762166978.433650:0:8382:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bbaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8382:1847765449733504:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166978.433662:0:8382:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945cc355bc00/0x2f180c4effbab3d6 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [102400->106495] (req 102400->106495) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9fa6 expref: 21 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.433670:0:8382:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355bc00, rc 0) 00000100:00100000:1.0:1762166978.433693:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+21:61766:x1847765450520192:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 863us (965us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166978.433698:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19068 00000100:00100000:3.0:1762166978.433900:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.433948:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450520320 00000100:00100000:2.0:1762166978.433953:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450520320 00010000:00010000:2.0:1762166978.433969:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbab286 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f28 expref: 21 pid: 8383 timeout: 697 lvb_type: 1 00000100:00100000:2.0:1762166978.434001:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9627 00000100:00100000:2.0:1762166978.434009:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450520320:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166978.434019:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166978.434034:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbab286 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f28 expref: 21 pid: 8383 timeout: 697 lvb_type: 1 00010000:00010000:2.0:1762166978.434044:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbab286 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f28 expref: 21 pid: 8383 timeout: 697 lvb_type: 1 00010000:00010000:2.0:1762166978.434062:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbab286 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f28 expref: 21 pid: 8383 timeout: 697 lvb_type: 1 00010000:00010000:2.0:1762166978.434072:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166978.434074:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166978.434080:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945cc355bc00/0x2f180c4effbab3d6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 102400->106495) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9fa6 expref: 20 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.434088:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355bc00/0x2f180c4effbab3d6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 102400->106495) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9fa6 expref: 20 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.434110:0:6481:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff945cc355bc00/0x2f180c4effbab3d6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 102400->106495) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9fa6 expref: 20 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166978.434117:0:6481:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55ddf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6481:1847765449733632:192.168.204.38@tcp:105: 00000100:00100000:2.0:1762166978.434150:0:6481:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7c0f240 going to sleep for 11 seconds 00000100:00100000:2.0:1762166978.435072:0:6481:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55ddf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6481:1847765449733632:192.168.204.38@tcp:105: 00010000:00010000:2.0:1762166978.435124:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166978.435160:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450520320:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1152us (1260us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166978.435176:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9627 00000100:00100000:0.0:1762166978.447226:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166978.447286:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450520448 00000100:00100000:3.0:1762166978.447298:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450520448 00002000:00100000:3.0:1762166978.447347:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (102400->106495) req@ffff945bc406d500 x1847765450520448/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:9/0 lens 488/0 e 0 to 0 dl 1762166989 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166978.447359:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc406d500 with x1847765450520448 ext(102400->106495) 00002000:00010000:3.0:1762166978.447364:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc406d500 00000100:00100000:3.0:1762166978.447398:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2386 00000100:00100000:3.0:1762166978.447408:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450520448:12345-192.168.204.38@tcp:3:lfs.0 00000100:00100000:3.0:1762166978.447600:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450520448:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 193us (384us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1762166978.447611:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2386 00002000:00100000:3.0:1762166978.447617:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (102400->106495) req@ffff945bc406d500 x1847765450520448/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:9/0 lens 488/4536 e 0 to 0 dl 1762166989 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166978.447625:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc406d500 with x1847765450520448 ext(102400->106495) 00002000:00010000:3.0:1762166978.447628:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc406d500 00000100:00100000:3.0:1762166978.449262:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.449315:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450520576 00000100:00100000:2.0:1762166978.449322:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450520576 00002000:00100000:2.0:1762166978.449359:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (77824->143359) req@ffff945cf783d880 x1847765450520576/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:9/0 lens 504/0 e 0 to 0 dl 1762166989 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166978.449375:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf783d880 with x1847765450520576 ext(77824->143359) 00002000:00010000:2.0:1762166978.449380:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf783d880 00000100:00100000:2.0:1762166978.449403:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2387 00000100:00100000:2.0:1762166978.449410:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450520576:12345-192.168.204.38@tcp:3:lfs.0 00000100:00100000:2.0:1762166978.450459:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450520576:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 1047us (1200us total) trans 0 rc 61440/61440 00000100:00100000:2.0:1762166978.450467:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2387 00002000:00100000:2.0:1762166978.450473:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (77824->143359) req@ffff945cf783d880 x1847765450520576/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:9/0 lens 504/440 e 0 to 0 dl 1762166989 ref 1 fl Complete:/600/0 rc 61440/61440 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166978.450506:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf783d880 with x1847765450520576 ext(77824->143359) 00002000:00010000:2.0:1762166978.450509:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf783d880 00000100:00100000:0.0:1762166978.452843:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.452924:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450520704 00000100:00100000:2.0:1762166978.452936:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450520704 00002000:00100000:2.0:1762166978.452995:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (143360->180223) req@ffff945cf79e9500 x1847765450520704/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:9/0 lens 488/0 e 0 to 0 dl 1762166989 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166978.453004:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf79e9500 with x1847765450520704 ext(143360->180223) 00002000:00010000:2.0:1762166978.453009:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf79e9500 00000100:00100000:2.0:1762166978.453044:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2388 00000100:00100000:2.0:1762166978.453063:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450520704:12345-192.168.204.38@tcp:3:lfs.0 00000100:00100000:2.0:1762166978.454040:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450520704:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 985us (1206us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1762166978.454049:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2388 00002000:00100000:2.0:1762166978.454058:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (143360->180223) req@ffff945cf79e9500 x1847765450520704/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:9/0 lens 488/440 e 0 to 0 dl 1762166989 ref 1 fl Complete:/600/0 rc 36864/36864 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166978.454068:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf79e9500 with x1847765450520704 ext(143360->180223) 00002000:00010000:2.0:1762166978.454072:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf79e9500 00000100:00100000:0.0:1762166978.455459:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.455515:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450520832 00000100:00100000:2.0:1762166978.455522:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450520832 00002000:00100000:2.0:1762166978.455557:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (102400->155647) req@ffff945cf79ea300 x1847765450520832/t0(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:9/0 lens 488/0 e 0 to 0 dl 1762166989 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166978.455566:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf79ea300 with x1847765450520832 ext(102400->155647) 00002000:00010000:2.0:1762166978.455570:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf79ea300 00000100:00100000:2.0:1762166978.455595:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2389 00000100:00100000:2.0:1762166978.455604:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:2417:x1847765450520832:12345-192.168.204.38@tcp:4:lfs.0 00000100:00100000:2.0:1762166978.457080:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+22:2417:x1847765450520832:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 1469us (1618us total) trans 17179876463 rc 0/0 00000100:00100000:2.0:1762166978.457091:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2389 00002000:00100000:2.0:1762166978.457100:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (102400->155647) req@ffff945cf79ea300 x1847765450520832/t17179876463(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:9/0 lens 488/448 e 0 to 0 dl 1762166989 ref 1 fl Complete:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166978.457106:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf79ea300 with x1847765450520832 ext(102400->155647) 00002000:00010000:2.0:1762166978.457110:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf79ea300 00000100:00100000:3.0:1762166978.458173:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.458246:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450520960 00000100:00100000:1.0:1762166978.458254:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450520960 00000100:00100000:1.0:1762166978.458301:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19069 00000100:00100000:1.0:1762166978.458311:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765450520960:12345-192.168.204.38@tcp:16:fsx.0 00000001:00080000:0.0:1762166978.459390:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876463 is committed 00000001:00080000:0.0:1762166978.459400:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876462 is committed 00000100:00100000:1.0:1762166978.459517:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450520960:12345-192.168.204.38@tcp:16:fsx.0 Request processed in 1205us (1345us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166978.459529:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19069 00000100:00100000:0.0:1762166978.460583:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.460663:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450521088 00000100:00100000:2.0:1762166978.460670:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450521088 00000100:00100000:2.0:1762166978.460713:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30541 00000100:00100000:2.0:1762166978.460720:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb386680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+524:61766:x1847765450521088:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:2.0:1762166978.460744:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166978.460771:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbab3dd lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9fad expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.460921:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbab3e4 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166978.460937:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbab3e4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.460950:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbab3e4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:2.0:1762166978.460983:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 252073 00000004:00200000:2.0:1762166978.460989:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166978.461007:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbab3e4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.461036:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbab3dd lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9fad expref: 526 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.461056:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbab3e4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9fad expref: 525 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.461066:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:2.0:1762166978.461070:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166978.461074:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa8200, rc 0) 00000100:00100000:2.0:1762166978.461123:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb386680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+525:61766:x1847765450521088:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 402us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166978.461130:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30541 00000100:00100000:0.0:1762166978.463722:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.463834:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450521216 00000100:00100000:2.0:1762166978.463850:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450521216 00002000:00100000:2.0:1762166978.463935:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (180224->225279) req@ffff945bcb387b80 x1847765450521216/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:9/0 lens 488/0 e 0 to 0 dl 1762166989 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166978.463948:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bcb387b80 with x1847765450521216 ext(180224->225279) 00002000:00010000:2.0:1762166978.463956:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bcb387b80 00000100:00100000:2.0:1762166978.464008:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2390 00000100:00100000:2.0:1762166978.464020:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb387b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450521216:12345-192.168.204.38@tcp:3:lfs.0 00000100:00100000:2.0:1762166978.465672:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb387b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450521216:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 1645us (1957us total) trans 0 rc 45056/45056 00000100:00100000:2.0:1762166978.465687:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2390 00002000:00100000:2.0:1762166978.465698:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (180224->225279) req@ffff945bcb387b80 x1847765450521216/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:9/0 lens 488/440 e 0 to 0 dl 1762166989 ref 1 fl Complete:/600/0 rc 45056/45056 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166978.465709:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bcb387b80 with x1847765450521216 ext(180224->225279) 00002000:00010000:2.0:1762166978.465715:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bcb387b80 00000100:00100000:1.0:1762166978.467543:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.467689:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450521344 00000100:00100000:2.0:1762166978.467705:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450521344 00002000:00100000:2.0:1762166978.467769:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (225280->253951) req@ffff945bc5bbaa00 x1847765450521344/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:9/0 lens 488/0 e 0 to 0 dl 1762166989 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166978.467780:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5bbaa00 with x1847765450521344 ext(225280->253951) 00002000:00010000:2.0:1762166978.467786:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5bbaa00 00000100:00100000:2.0:1762166978.467824:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2391 00000100:00100000:2.0:1762166978.467836:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450521344:12345-192.168.204.38@tcp:3:lfs.0 00000100:00100000:2.0:1762166978.469103:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450521344:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 1265us (1572us total) trans 0 rc 28672/28672 00000100:00100000:2.0:1762166978.469113:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2391 00002000:00100000:2.0:1762166978.469121:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (225280->253951) req@ffff945bc5bbaa00 x1847765450521344/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:9/0 lens 488/440 e 0 to 0 dl 1762166989 ref 1 fl Complete:/600/0 rc 28672/28672 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166978.469128:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5bbaa00 with x1847765450521344 ext(225280->253951) 00002000:00010000:2.0:1762166978.469131:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5bbaa00 00000100:00100000:3.0:1762166978.470924:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.470996:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450521472 00000100:00100000:2.0:1762166978.471004:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450521472 00000100:00100000:2.0:1762166978.471057:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30542 00000100:00100000:2.0:1762166978.471067:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+525:61766:x1847765450521472:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:2.0:1762166978.471085:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166978.471104:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbab3eb lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9fb4 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.471135:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbab3f2 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166978.471149:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbab3f2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.471160:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbab3f2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.471282:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbab3eb lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9fb4 expref: 527 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.471303:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbab3f2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9fb4 expref: 526 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.471311:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:2.0:1762166978.471314:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1762166978.471318:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa8c00, rc 0) 00000100:00100000:2.0:1762166978.471373:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+526:61766:x1847765450521472:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 308us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166978.471380:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30542 00000100:00100000:1.0:1762166978.472710:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.472759:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450521728 00000100:00100000:2.0:1762166978.472766:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450521728 00000100:00100000:2.0:1762166978.472804:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30543 00000100:00100000:2.0:1762166978.472815:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+526:61766:x1847765450521728:12345-192.168.204.38@tcp:36:fsx.0 00010000:00010000:2.0:1762166978.472844:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1762166978.472871:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbab3e4 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9fad expref: 526 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.472888:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbab3c1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f9f expref: 525 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.472897:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:2.0:1762166978.472900:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166978.473051:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9400/0x2f180c4effbab3f9 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166978.473060:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9400/0x2f180c4effbab3f9 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.473068:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9400/0x2f180c4effbab3f9 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000001:00080000:2.0:1762166978.473103:0:6495:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992157 00000004:00010000:2.0:1762166978.473125:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000baa70dc1 reply state 000000005043f21d transno 4294992158 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9400/0x2f180c4effbab3f9 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.473136:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9400/0x2f180c4effbab3f9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.473143:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:2.0:1762166978.473145:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166978.473147:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166978.473228:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+527:61766:x1847765450521728:12345-192.168.204.38@tcp:36:fsx.0 Request processed in 415us (524us total) trans 4294992158 rc 0/0 00000100:00100000:2.0:1762166978.473236:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30543 00000020:00080000:2.0:1762166978.473240:0:6495:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1762166978.474316:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.474364:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450521856 00000100:00100000:2.0:1762166978.474370:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450521856 00000100:00100000:2.0:1762166978.474405:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30544 00000100:00100000:2.0:1762166978.474413:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4011880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+527:61766:x1847765450521856:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:2.0:1762166978.474427:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166978.474439:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbab400 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9fbb expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.474470:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbab400 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9fbb expref: 528 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.474503:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbab400 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9fbb expref: 528 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.474518:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:2.0:1762166978.474521:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166978.474524:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa8000, rc 0) 00000100:00100000:2.0:1762166978.474560:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4011880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+528:61766:x1847765450521856:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 148us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166978.474567:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30544 00000100:00100000:3.0:1762166978.476024:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.476075:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450521984 00000100:00100000:1.0:1762166978.476081:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450521984 00000100:00100000:1.0:1762166978.476124:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19070 00000100:00100000:1.0:1762166978.476133:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+17:61766:x1847765450521984:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:1.0:1762166978.476145:0:8382:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166978.476157:0:8382:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cc355be00/0x2f180c4effbab407 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9fc2 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.476181:0:8382:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8800/0x2f180c4effbab28d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f2f expref: 18 pid: 35248 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166978.476190:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166978.476192:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166978.476196:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cc355be00/0x2f180c4effbab407 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9fc2 expref: 18 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.476226:0:8382:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8800/0x2f180c4effbab28d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f2f expref: 18 pid: 35248 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166978.476236:0:8382:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8800/0x2f180c4effbab28d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f2f expref: 18 pid: 35248 timeout: 697 lvb_type: 1 00000100:00100000:1.0:1762166978.476246:0:8382:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bb8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8382:1847765449733760:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166978.476324:0:8382:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cee083780 going to sleep for 11 seconds 00000100:00100000:2.0:1762166978.477505:0:8382:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bb8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8382:1847765449733760:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166978.477527:0:8382:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945cc355be00/0x2f180c4effbab407 lrc: 3/0,0 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9fc2 expref: 18 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.477542:0:8382:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355be00, rc 0) 00000100:00100000:2.0:1762166978.477586:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+18:61766:x1847765450521984:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 1454us (1564us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166978.477593:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19070 00000100:00100000:3.0:1762166978.477729:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.477805:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450522112 00000100:00100000:2.0:1762166978.477811:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450522112 00010000:00010000:2.0:1762166978.477834:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8800/0x2f180c4effbab28d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f2f expref: 18 pid: 35248 timeout: 697 lvb_type: 1 00000100:00100000:2.0:1762166978.477883:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9628 00000100:00100000:2.0:1762166978.477893:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450522112:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166978.477904:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166978.477921:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8800/0x2f180c4effbab28d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f2f expref: 18 pid: 35248 timeout: 697 lvb_type: 1 00010000:00010000:2.0:1762166978.477933:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8800/0x2f180c4effbab28d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f2f expref: 18 pid: 35248 timeout: 697 lvb_type: 1 00010000:00010000:2.0:1762166978.477950:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8800/0x2f180c4effbab28d lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f2f expref: 18 pid: 35248 timeout: 697 lvb_type: 1 00010000:00010000:2.0:1762166978.477962:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166978.477964:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166978.477970:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945cc355be00/0x2f180c4effbab407 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9fc2 expref: 17 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.477978:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cc355be00/0x2f180c4effbab407 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9fc2 expref: 17 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.478009:0:6481:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff945cc355be00/0x2f180c4effbab407 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9fc2 expref: 17 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166978.478022:0:6481:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55ddf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6481:1847765449733888:192.168.204.38@tcp:105: 00000100:00100000:2.0:1762166978.478080:0:6481:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7c0f240 going to sleep for 11 seconds 00000100:00100000:2.0:1762166978.479237:0:6481:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55ddf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6481:1847765449733888:192.168.204.38@tcp:105: 00010000:00010000:2.0:1762166978.479265:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166978.479315:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450522112:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1423us (1586us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166978.479325:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9628 00000100:00100000:3.0:1762166978.479656:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.479733:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450522240 00000100:00100000:2.0:1762166978.479740:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450522240 00000100:00100000:2.0:1762166978.479788:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19071 00000100:00100000:2.0:1762166978.479798:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+17:61766:x1847765450522240:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:2.0:1762166978.479829:0:8382:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166978.479848:0:8382:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbab40e lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9fc9 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.479887:0:8382:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effbab294 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f36 expref: 18 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166978.479903:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166978.479905:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166978.479910:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbab40e lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9fc9 expref: 18 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.479944:0:8382:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effbab294 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f36 expref: 18 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166978.479958:0:8382:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effbab294 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f36 expref: 18 pid: 28434 timeout: 697 lvb_type: 1 00000100:00100000:2.0:1762166978.479974:0:8382:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55ddf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8382:1847765449734016:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166978.480046:0:8382:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7c0f240 going to sleep for 11 seconds 00000100:00100000:2.0:1762166978.481203:0:8382:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55ddf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8382:1847765449734016:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166978.481224:0:8382:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbab40e lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9fc9 expref: 18 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.481239:0:8382:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa9a00, rc 0) 00000100:00100000:2.0:1762166978.481280:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+18:61766:x1847765450522240:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 1483us (1624us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166978.481289:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19071 00000100:00100000:3.0:1762166978.481412:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.481466:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450522368 00000100:00100000:2.0:1762166978.481474:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450522368 00010000:00010000:2.0:1762166978.481521:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effbab294 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f36 expref: 18 pid: 28434 timeout: 697 lvb_type: 1 00000100:00100000:2.0:1762166978.481564:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9629 00000100:00100000:2.0:1762166978.481584:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450522368:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166978.481597:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166978.481618:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effbab294 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f36 expref: 18 pid: 28434 timeout: 697 lvb_type: 1 00010000:00010000:2.0:1762166978.481632:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effbab294 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f36 expref: 18 pid: 28434 timeout: 697 lvb_type: 1 00010000:00010000:2.0:1762166978.481657:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effbab294 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f36 expref: 18 pid: 28434 timeout: 697 lvb_type: 1 00010000:00010000:2.0:1762166978.481671:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166978.481673:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166978.481678:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbab40e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9fc9 expref: 17 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.481688:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbab40e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9fc9 expref: 17 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.481713:0:6481:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbab40e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9fc9 expref: 17 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166978.481722:0:6481:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55ddf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6481:1847765449734144:192.168.204.38@tcp:105: 00000100:00100000:2.0:1762166978.481765:0:6481:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7c0f240 going to sleep for 11 seconds 00000100:00100000:2.0:1762166978.482896:0:6481:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55ddf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6481:1847765449734144:192.168.204.38@tcp:105: 00010000:00010000:2.0:1762166978.482918:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166978.482966:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450522368:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1394us (1568us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166978.482977:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9629 00000100:00100000:3.0:1762166978.483077:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.483123:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450522496 00000100:00100000:2.0:1762166978.483130:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450522496 00002000:00010000:2.0:1762166978.483164:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (42514->18446744073709551615) 00002000:00100000:2.0:1762166978.483169:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf783c380 with x1847765450522496 ext(42514->18446744073709551615) 00002000:00010000:2.0:1762166978.483179:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf783c380. 00000100:00100000:2.0:1762166978.483204:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2392 00000100:00100000:2.0:1762166978.483217:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450522496:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:3.0:1762166978.483220:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.483315:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450522624 00000100:00100000:1.0:1762166978.483325:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450522624 00000100:00100000:3.0:1762166978.483354:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00002000:00010000:1.0:1762166978.483359:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:1.0:1762166978.483364:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf783dc00 with x1847765450522624 ext(0->18446744073709551615) 00002000:00010000:1.0:1762166978.483372:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945cf783dc00. 00000100:00100000:1.0:1762166978.483402:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450522752 00000100:00100000:1.0:1762166978.483405:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450522752 00002000:00010000:1.0:1762166978.483417:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:1.0:1762166978.483420:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1e6c380 with x1847765450522752 ext(0->18446744073709551615) 00002000:00010000:1.0:1762166978.483423:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1e6c380. 00000100:00100000:1.0:1762166978.483456:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2393 00000100:00100000:1.0:1762166978.483469:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450522624:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:3.0:1762166978.483534:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2394 00000100:00100000:3.0:1762166978.483547:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450522752:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:1.0:1762166978.483694:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166978.483700:0:23939:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:1.0:1762166978.483703:0:23939:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:1.0:1762166978.483706:0:23939:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:1.0:1762166978.483709:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00002000:00010000:3.0:1762166978.483715:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166978.483721:0:23943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:3.0:1762166978.483724:0:23943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:3.0:1762166978.483727:0:23943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:3.0:1762166978.483729:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1762166978.483766:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450522624:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 297us (546us total) trans 21474843336 rc 0/0 00000100:00100000:1.0:1762166978.483785:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2393 00000100:00100000:3.0:1762166978.483787:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450522752:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 233us (423us total) trans 17179876465 rc 0/0 00002000:00010000:1.0:1762166978.483794:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:1.0:1762166978.483800:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf783dc00 with x1847765450522624 ext(0->18446744073709551615) 00000100:00100000:3.0:1762166978.483806:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2394 00002000:00010000:1.0:1762166978.483808:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945cf783dc00. 00002000:00010000:3.0:1762166978.483812:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:3.0:1762166978.483819:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1e6c380 with x1847765450522752 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166978.483828:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1e6c380. 00002000:00010000:2.0:1762166978.483989:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 252073 -> 42514 00002000:00010000:2.0:1762166978.483994:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166978.483997:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166978.483999:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166978.484002:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 296 -> 96 00000100:00100000:2.0:1762166978.484042:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450522496:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 829us (965us total) trans 17179876464 rc 0/0 00000100:00100000:2.0:1762166978.484721:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2392 00002000:00010000:2.0:1762166978.484731:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (42514->18446744073709551615) 00002000:00100000:2.0:1762166978.484735:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf783c380 with x1847765450522496 ext(42514->18446744073709551615) 00002000:00010000:2.0:1762166978.484742:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf783c380. 00000100:00100000:3.0:1762166978.485818:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.485878:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450522880 00000100:00100000:2.0:1762166978.485887:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450522880 00000100:00100000:2.0:1762166978.485942:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30545 00000100:00100000:2.0:1762166978.485951:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+528:61766:x1847765450522880:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:2.0:1762166978.485972:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166978.485994:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbab415 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9fd0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.486129:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbab41c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166978.486146:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbab41c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.486159:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbab41c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:2.0:1762166978.486190:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 42514 00000004:00200000:2.0:1762166978.486195:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166978.486216:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbab41c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.486243:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbab415 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9fd0 expref: 530 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.486266:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbab41c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9fd0 expref: 529 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.486276:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:2.0:1762166978.486280:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166978.486283:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa9000, rc 0) 00000100:00100000:2.0:1762166978.486340:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+529:61766:x1847765450522880:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 390us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166978.486348:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30545 00000100:00100000:0.0:1762166978.490460:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.491375:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450523008 00000100:00100000:2.0:1762166978.491392:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450523008 00000100:00100000:2.0:1762166978.491528:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2395 00000100:00100000:2.0:1762166978.491539:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4012a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450523008:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:2.0:1762166978.491819:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 42514 -> 201690 00002000:00010000:2.0:1762166978.491823:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166978.491826:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166978.491828:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166978.491830:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 96 -> 136 00000100:00100000:2.0:1762166978.491917:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4012a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450523008:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 380us (1474us total) trans 17179876466 rc 0/0 00000100:00100000:2.0:1762166978.491925:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2395 00000100:00100000:0.0:1762166978.494325:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166978.494414:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450523264 00000100:00100000:3.0:1762166978.494426:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450523264 00000100:00100000:3.0:1762166978.494536:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11875 00000100:00100000:3.0:1762166978.494557:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4011c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+529:61766:x1847765450523264:12345-192.168.204.38@tcp:35:fsx.0 00000100:00100000:3.0:1762166978.494949:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4011c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+530:61766:x1847765450523264:12345-192.168.204.38@tcp:35:fsx.0 Request processed in 403us (631us total) trans 4294992159 rc 0/0 00000100:00100000:3.0:1762166978.494958:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11875 00000100:00100000:3.0:1762166978.504237:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.504318:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450523520 00000100:00100000:2.0:1762166978.504334:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450523520 00000100:00100000:2.0:1762166978.504399:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30546 00000100:00100000:2.0:1762166978.504414:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+530:61857:x1847765450523520:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166978.504449:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166978.504502:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbab423 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9fd7 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.504586:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbab42a lrc: 3/1,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166978.504601:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbab42a lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.504618:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbab42a lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.504632:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbab431 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166978.504639:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbab431 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.504645:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbab431 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.504760:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbab438 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166978.504770:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbab438 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.504778:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbab438 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:2.0:1762166978.504788:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 201690 00010000:00010000:2.0:1762166978.504885:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbab42a lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.504892:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbab42a lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.504898:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbab42a lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.504904:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbab42a lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.504910:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa8800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166978.504914:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbab42a lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.504921:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbab42a lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.504933:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0x0 (ffff945bc809bc00) 00010000:00010000:2.0:1762166978.504936:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166978.504940:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbab42a lrc: 3/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.504946:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbab42a lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.504962:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbab431 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.504967:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbab431 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.504973:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbab431 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.504978:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa8600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166978.504981:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbab431 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.504986:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbab431 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.504994:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0xdd396665 (ffff945bc809b100) 00010000:00010000:2.0:1762166978.504997:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166978.505000:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbab431 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.505010:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbab431 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.505050:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbab423 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9fd7 expref: 533 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.505067:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbab438 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9fd7 expref: 532 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.505075:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:2.0:1762166978.505077:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166978.505080:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa9c00, rc 0) 00000100:00100000:2.0:1762166978.505147:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+532:61857:x1847765450523520:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 737us (922us total) trans 4294992160 rc 0/0 00000100:00100000:2.0:1762166978.505155:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30546 00000100:00100000:0.0:1762166978.506784:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.506854:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450523648 00000100:00100000:2.0:1762166978.506875:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450523648 00000100:00100000:2.0:1762166978.506953:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 879 00000100:00100000:2.0:1762166978.506964:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4011180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+532:2418:x1847765450523648:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166978.506982:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166978.507009:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbab438 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9fd7 expref: 532 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.507032:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:2.0:1762166978.507037:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166978.507090:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4011180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+531:2418:x1847765450523648:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 128us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166978.507102:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 879 00000100:00100000:3.0:1762166978.507238:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.507291:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450523904 00000100:00100000:2.0:1762166978.507296:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450523904 00000100:00100000:2.0:1762166978.507326:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11876 00000100:00100000:2.0:1762166978.507335:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+531:61857:x1847765450523904:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:2.0:1762166978.507590:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+532:61857:x1847765450523904:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 256us (353us total) trans 4294992161 rc 0/0 00000100:00100000:2.0:1762166978.507598:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11876 00000100:00100000:0.0:1762166978.509026:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.509076:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450524160 00000100:00100000:2.0:1762166978.509083:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450524160 00000100:00100000:2.0:1762166978.509132:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30547 00000100:00100000:2.0:1762166978.509141:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4010380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+532:61857:x1847765450524160:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166978.509173:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166978.509192:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbab446 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9fde expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.509292:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbab44d lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166978.509308:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbab44d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.509320:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbab44d lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:2.0:1762166978.509330:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 201690 00010000:00010000:2.0:1762166978.509437:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbab446 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9fde expref: 535 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.509468:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbab44d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9fde expref: 534 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.509503:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:2.0:1762166978.509507:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1762166978.509511:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa9e00, rc 0) 00000100:00100000:2.0:1762166978.509556:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4010380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+534:61857:x1847765450524160:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 418us (538us total) trans 4294992162 rc 0/0 00000100:00100000:2.0:1762166978.509561:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30547 00000100:00100000:0.0:1762166978.511281:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.511317:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450524416 00000100:00100000:2.0:1762166978.511326:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450524416 00000100:00100000:2.0:1762166978.511377:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30548 00000100:00100000:2.0:1762166978.511387:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4013800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+534:61857:x1847765450524416:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166978.511410:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166978.511426:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbab45b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9fe5 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.511559:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42f6200/0x2f180c4effbab462 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166978.511575:0:6495:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbab41c lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9fd0 expref: 535 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.511585:0:6495:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42f6200/0x2f180c4effbab462 lrc: 4/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.511624:0:6495:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbab41c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9fd0 expref: 535 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.511636:0:6495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbab41c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9fd0 expref: 535 pid: 6495 timeout: 697 lvb_type: 0 00000100:00100000:2.0:1762166978.511648:0:6495:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55ddf80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6495:1847765449734272:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166978.511747:0:6495:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccba916c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166978.512628:0:6495:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55ddf80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6495:1847765449734272:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166978.512660:0:6495:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42f6200/0x2f180c4effbab462 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000100:00100000:0.0:1762166978.512853:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.512910:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450524544 00000100:00100000:2.0:1762166978.512918:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450524544 00010000:00010000:2.0:1762166978.512959:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbab41c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9fd0 expref: 536 pid: 6495 timeout: 697 lvb_type: 0 00000100:00100000:2.0:1762166978.513001:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9630 00000100:00100000:2.0:1762166978.513014:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff1a9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+536:2419:x1847765450524544:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166978.513029:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166978.513036:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbab41c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9fd0 expref: 536 pid: 6495 timeout: 697 lvb_type: 0 00010000:00010000:2.0:1762166978.513048:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbab41c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9fd0 expref: 536 pid: 6495 timeout: 697 lvb_type: 0 00010000:00010000:2.0:1762166978.513070:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbab41c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9fd0 expref: 536 pid: 6495 timeout: 697 lvb_type: 0 00010000:00010000:2.0:1762166978.513093:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:2.0:1762166978.513098:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42f6200/0x2f180c4effbab462 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.513108:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42f6200/0x2f180c4effbab462 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.513116:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42f6200/0x2f180c4effbab462 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.513147:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166978.513194:0:6495:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42f6200/0x2f180c4effbab462 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.513203:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42f6200/0x2f180c4effbab462 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000100:00100000:2.0:1762166978.513208:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff1a9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+535:2419:x1847765450524544:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 195us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166978.513219:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9630 00000004:00200000:0.0:1762166978.513228:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 201690 00010000:00010000:0.0:1762166978.513372:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbab45b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9fe5 expref: 536 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.513386:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42f6200/0x2f180c4effbab462 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9fe5 expref: 535 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.513391:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:0.0:1762166978.513393:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1762166978.513395:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc42f6200, rc 0) 00000100:00100000:0.0:1762166978.513430:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4013800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+535:61857:x1847765450524416:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2045us (2152us total) trans 4294992163 rc 0/0 00000100:00100000:0.0:1762166978.513441:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30548 00000100:00100000:0.0:1762166978.514523:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.514620:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450524672 00000100:00100000:1.0:1762166978.514625:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450524672 00000100:00100000:1.0:1762166978.514664:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11877 00000100:00100000:1.0:1762166978.514672:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4010a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+535:61857:x1847765450524672:12345-192.168.204.38@tcp:33:lfs.0 00000100:00100000:1.0:1762166978.514789:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4010a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+535:61857:x1847765450524672:12345-192.168.204.38@tcp:33:lfs.0 Request processed in 118us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166978.514796:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11877 00000100:00100000:3.0:1762166978.515870:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.515922:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450524928 00000100:00100000:1.0:1762166978.515928:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450524928 00000100:00100000:1.0:1762166978.515960:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11878 00000100:00100000:1.0:1762166978.515968:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+535:61857:x1847765450524928:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:1.0:1762166978.516115:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+536:61857:x1847765450524928:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 146us (255us total) trans 4294992164 rc 0/0 00000100:00100000:1.0:1762166978.516123:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11878 00000100:00100000:0.0:1762166978.517054:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.517091:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450525184 00000100:00100000:2.0:1762166978.517096:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450525184 00000100:00100000:2.0:1762166978.517135:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30549 00000100:00100000:2.0:1762166978.517143:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4012680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+536:61857:x1847765450525184:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166978.517161:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166978.517165:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:2.0:1762166978.517188:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42f6200/0x2f180c4effbab462 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9fe5 expref: 536 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.517208:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbab44d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9fde expref: 535 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.517219:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:2.0:1762166978.517224:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166978.517238:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbab470 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9fec expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.517313:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbab477 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166978.517325:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbab477 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.517334:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbab477 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:2.0:1762166978.517343:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 201690 00010000:00010000:2.0:1762166978.517410:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbab470 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9fec expref: 537 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.517422:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbab477 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9fec expref: 536 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.517429:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:2.0:1762166978.517431:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166978.517433:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa8600, rc 0) 00000100:00100000:2.0:1762166978.517471:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4012680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+536:61857:x1847765450525184:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 330us (418us total) trans 4294992165 rc 0/0 00000100:00100000:2.0:1762166978.517506:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30549 00000100:00100000:0.0:1762166978.518707:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.518807:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450525440 00000100:00100000:1.0:1762166978.518814:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450525440 00000100:00100000:1.0:1762166978.518871:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11879 00000100:00100000:1.0:1762166978.518880:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7be4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+536:61857:x1847765450525440:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:1.0:1762166978.518929:0:6497:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x240000404:0x5eb:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbab477 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9fec expref: 536 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.518953:0:6497:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbab485 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 00010000:00010000:1.0:1762166978.518964:0:6497:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbab3f2 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9fb4 expref: 536 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.518972:0:6497:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbab400 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9fbb expref: 536 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.518984:0:6497:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbab485 lrc: 5/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166978.519013:0:6497:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbab400 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9fbb expref: 536 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.519025:0:6497:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbab400 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9fbb expref: 536 pid: 6495 timeout: 697 lvb_type: 0 00000100:00100000:1.0:1762166978.519038:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bbad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6497:1847765449734400:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166978.519112:0:6497:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbab3f2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9fb4 expref: 536 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.519122:0:6497:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbab3f2 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9fb4 expref: 536 pid: 6495 timeout: 697 lvb_type: 0 00000100:00100000:1.0:1762166978.519132:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bb8700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6497:1847765449734528:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166978.519196:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cee083e40 going to sleep for 11 seconds 00000100:00100000:1.0:1762166978.520231:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bbad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6497:1847765449734400:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166978.520244:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bb8700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6497:1847765449734528:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166978.520263:0:6497:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbab485 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00000100:00100000:0.0:1762166978.520560:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.520598:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.520644:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450525568 00000100:00100000:1.0:1762166978.520651:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450525696 00000100:00100000:2.0:1762166978.520656:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450525568 00000100:00100000:1.0:1762166978.520658:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450525696 00010000:00010000:1.0:1762166978.520700:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbab3f2 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9fb4 expref: 538 pid: 6495 timeout: 697 lvb_type: 0 00010000:00010000:2.0:1762166978.520701:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbab400 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9fbb expref: 538 pid: 6495 timeout: 697 lvb_type: 0 00000100:00100000:1.0:1762166978.520750:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9631 00000100:00100000:1.0:1762166978.520769:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4011f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+538:2418:x1847765450525696:12345-192.168.204.38@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1762166978.520776:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9632 00010000:00010000:1.0:1762166978.520788:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1762166978.520791:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4010e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+538:2419:x1847765450525568:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166978.520801:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbab3f2 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9fb4 expref: 538 pid: 6495 timeout: 697 lvb_type: 0 00010000:00010000:2.0:1762166978.520804:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166978.520813:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbab400 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9fbb expref: 538 pid: 6495 timeout: 697 lvb_type: 0 00010000:00010000:1.0:1762166978.520820:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbab3f2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9fb4 expref: 538 pid: 6495 timeout: 697 lvb_type: 0 00010000:00010000:2.0:1762166978.520838:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbab400 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9fbb expref: 538 pid: 6495 timeout: 697 lvb_type: 0 00010000:00010000:1.0:1762166978.520869:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbab3f2 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9fb4 expref: 538 pid: 6495 timeout: 697 lvb_type: 0 00010000:00010000:2.0:1762166978.520878:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbab400 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9fbb expref: 538 pid: 6495 timeout: 697 lvb_type: 0 00010000:00010000:1.0:1762166978.520889:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:1.0:1762166978.520894:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbab485 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166978.520902:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbab485 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166978.520908:0:6479:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbab485 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166978.520916:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:2.0:1762166978.520921:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166978.520938:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166978.520979:0:6497:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbab485 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00000100:00100000:2.0:1762166978.520987:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4010e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+536:2419:x1847765450525568:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 196us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166978.520988:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4011f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+536:2418:x1847765450525696:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 223us (383us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166978.520993:0:6497:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbab485 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00000100:00100000:1.0:1762166978.521008:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9631 00000100:00100000:2.0:1762166978.521015:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9632 00010000:00010000:0.0:1762166978.521256:0:6497:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbab485 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166978.521265:0:6497:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbab485 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166978.521272:0:6497:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbab485 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166978.521279:0:6497:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355a800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166978.521284:0:6497:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbab485 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166978.521292:0:6497:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbab485 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166978.521303:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:0.0:1762166978.521306:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166978.521310:0:6497:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbab485 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166978.521317:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbab485 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166978.521329:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:0.0:1762166978.521331:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166978.521343:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbab477 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9fec expref: 534 pid: 6495 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166978.521514:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7be4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+534:61857:x1847765450525440:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 2633us (2808us total) trans 4294992166 rc -22/-22 00000100:00100000:0.0:1762166978.521526:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11879 00000100:00100000:0.0:1762166978.522912:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.522965:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450525824 00000100:00100000:2.0:1762166978.522978:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450525824 00000100:00100000:2.0:1762166978.523034:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30550 00000100:00100000:2.0:1762166978.523045:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4011c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+534:61857:x1847765450525824:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166978.523066:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166978.523084:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbab48c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9ff3 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.523136:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbab48c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ff3 expref: 535 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.523148:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbab48c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ff3 expref: 535 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.523162:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:2.0:1762166978.523164:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166978.523166:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa9000, rc 0) 00000100:00100000:2.0:1762166978.523208:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4011c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+535:61857:x1847765450525824:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 167us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166978.523213:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30550 00000100:00100000:1.0:1762166978.525219:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.525295:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450526080 00000100:00100000:2.0:1762166978.525306:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450526080 00000100:00100000:2.0:1762166978.525355:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30551 00000100:00100000:2.0:1762166978.525365:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+535:61857:x1847765450526080:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166978.525379:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166978.525398:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbab493 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028e9ffa expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.525963:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbab49a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x610:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166978.525976:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbab49a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x610:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.525986:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbab49a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x610:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:2.0:1762166978.525996:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x610:0x0]: returning size 0 00010000:00010000:2.0:1762166978.526039:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbab493 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ffa expref: 538 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.526061:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbab49a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x610:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ffa expref: 537 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.526069:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x610:0x0].0x0 (ffff945bc809b100) 00010000:00010000:2.0:1762166978.526072:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166978.526075:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa9e00, rc 0) 00000100:00100000:2.0:1762166978.526128:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+537:61857:x1847765450526080:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 764us (919us total) trans 4294992167 rc 0/0 00000100:00100000:2.0:1762166978.526136:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30551 00000100:00100000:3.0:1762166978.527622:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.527712:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450526336 00000100:00100000:2.0:1762166978.527726:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450526336 00000100:00100000:2.0:1762166978.527798:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30552 00000100:00100000:2.0:1762166978.527809:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+537:61857:x1847765450526336:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166978.527838:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166978.527871:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbab4a8 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea001 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.527995:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbab4af lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166978.528010:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbab4af lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.528022:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbab4af lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:2.0:1762166978.528036:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 201690 00010000:00010000:2.0:1762166978.528159:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbab4a8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea001 expref: 540 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.528179:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbab4af lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea001 expref: 539 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.528189:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:2.0:1762166978.528192:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166978.528196:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa9800, rc 0) 00000100:00100000:2.0:1762166978.528265:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+539:61857:x1847765450526336:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 457us (648us total) trans 4294992168 rc 0/0 00000100:00100000:2.0:1762166978.528273:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30552 00000100:00100000:0.0:1762166978.529575:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.529628:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450526592 00000100:00100000:1.0:1762166978.529637:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450526592 00000100:00100000:1.0:1762166978.529686:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11880 00000100:00100000:1.0:1762166978.529696:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4010a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+539:61857:x1847765450526592:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:1.0:1762166978.529764:0:6497:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x240000404:0x5eb:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbab4af lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea001 expref: 539 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.529796:0:6497:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbab4bd lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 00010000:00010000:1.0:1762166978.529809:0:6497:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbab48c lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ff3 expref: 539 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.529817:0:6497:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbab4bd lrc: 4/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166978.529867:0:6497:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbab48c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ff3 expref: 539 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.529882:0:6497:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbab48c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ff3 expref: 539 pid: 6495 timeout: 697 lvb_type: 0 00000100:00100000:1.0:1762166978.529897:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bbad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6497:1847765449734656:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166978.529995:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cee083e40 going to sleep for 11 seconds 00000100:00100000:0.0:1762166978.530901:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bbad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6497:1847765449734656:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166978.530923:0:6497:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbab4bd lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00000100:00100000:0.0:1762166978.531055:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.531116:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450526720 00000100:00100000:2.0:1762166978.531121:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450526720 00010000:00010000:2.0:1762166978.531147:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbab48c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ff3 expref: 540 pid: 6495 timeout: 697 lvb_type: 0 00000100:00100000:2.0:1762166978.531183:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9633 00000100:00100000:2.0:1762166978.531193:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4013100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+540:2418:x1847765450526720:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166978.531207:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166978.531214:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbab48c lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ff3 expref: 540 pid: 6495 timeout: 697 lvb_type: 0 00010000:00010000:2.0:1762166978.531225:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbab48c lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ff3 expref: 540 pid: 6495 timeout: 697 lvb_type: 0 00010000:00010000:2.0:1762166978.531240:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbab48c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ff3 expref: 540 pid: 6495 timeout: 697 lvb_type: 0 00010000:00010000:2.0:1762166978.531257:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:2.0:1762166978.531262:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbab4bd lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166978.531275:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbab4bd lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166978.531282:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbab4bd lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166978.531303:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166978.531324:0:6497:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbab4bd lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166978.531334:0:6497:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbab4bd lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00000100:00100000:2.0:1762166978.531343:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4013100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+539:2418:x1847765450526720:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 151us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166978.531352:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9633 00010000:00010000:0.0:1762166978.531353:0:6497:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbab4c4 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x610:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 00010000:00010000:0.0:1762166978.531367:0:6497:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbab49a lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x610:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ffa expref: 538 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.531380:0:6497:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbab4c4 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x610:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166978.531406:0:6497:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbab49a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x610:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ffa expref: 538 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.531417:0:6497:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbab49a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x610:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ffa expref: 538 pid: 6495 timeout: 697 lvb_type: 0 00000100:00100000:0.0:1762166978.531427:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4011500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6497:1847765449734784:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166978.531551:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc9a5e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166978.532523:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4011500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6497:1847765449734784:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166978.532545:0:6497:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbab4c4 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x610:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00000100:00100000:3.0:1762166978.532668:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.532708:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450526848 00000100:00100000:2.0:1762166978.532715:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450526848 00010000:00010000:2.0:1762166978.532740:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbab49a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x610:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ffa expref: 539 pid: 6495 timeout: 697 lvb_type: 0 00000100:00100000:2.0:1762166978.532774:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9634 00000100:00100000:2.0:1762166978.532784:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+539:2418:x1847765450526848:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166978.532795:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166978.532802:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbab49a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x610:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ffa expref: 539 pid: 6495 timeout: 697 lvb_type: 0 00010000:00010000:2.0:1762166978.532814:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbab49a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x610:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ffa expref: 539 pid: 6495 timeout: 697 lvb_type: 0 00010000:00010000:2.0:1762166978.532832:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbab49a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x610:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9ffa expref: 539 pid: 6495 timeout: 697 lvb_type: 0 00010000:00010000:2.0:1762166978.532846:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x610:0x0].0x0 (ffff945bc809b100) 00010000:00010000:2.0:1762166978.532851:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbab4c4 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x610:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166978.532873:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbab4c4 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x610:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166978.532879:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbab4c4 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x610:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166978.532903:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166978.532927:0:6497:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbab4c4 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x610:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166978.532938:0:6497:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbab4c4 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x610:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00000100:00100000:2.0:1762166978.532946:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+538:2418:x1847765450526848:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 162us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166978.532957:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9634 00000100:00100000:1.0:1762166978.533379:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bb9f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449734912:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762166978.533418:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166978.533441:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7c0f240 going to sleep for 11 seconds 00000100:00100000:2.0:1762166978.533464:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449734912 00000100:00100000:2.0:1762166978.533469:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449734912 00000100:00100000:2.0:1762166978.533529:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1377 00000100:00100000:2.0:1762166978.533537:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:6497:x1847765449734912:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762166978.533659:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:6497:x1847765449734912:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 123us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166978.533667:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1377 00000100:00100000:1.0:1762166978.533698:0:6497:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 17179876462 gen 2 00000004:00080000:1.0:1762166978.533706:0:6497:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 17179876458 committed transno 17179876462 00000004:00080000:1.0:1762166978.533727:0:6497:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc55dd500, transno 17179876459 00000004:00080000:1.0:1762166978.533738:0:6497:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc55dc380, transno 17179876460 00000004:00080000:1.0:1762166978.533740:0:6497:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc55de300, transno 17179876461 00000004:00080000:1.0:1762166978.533742:0:6497:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc55dd880, transno 17179876462 00000100:00100000:1.0:1762166978.533747:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bb9f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449734912:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762166978.533799:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bb9f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449735040:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762166978.533827:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166978.533865:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cee083e40 going to sleep for 11 seconds 00000004:00080000:2.0:1762166978.533877:0:9994:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0001: 0 changes, 0 in progress, 0 in flight, 4 done 00000100:00100000:3.0:1762166978.533898:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449735040 00000100:00100000:3.0:1762166978.533903:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449735040 00000100:00100000:3.0:1762166978.533933:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1378 00000100:00100000:3.0:1762166978.533940:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:6497:x1847765449735040:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166978.534011:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:6497:x1847765449735040:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 72us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166978.534018:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1378 00000100:00100000:1.0:1762166978.534024:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bb9f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449735040:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762166978.534069:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bb9f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449735168:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762166978.534092:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166978.534113:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc11cad80 going to sleep for 11 seconds 00000100:00100000:3.0:1762166978.534141:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449735168 00000100:00100000:3.0:1762166978.534147:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449735168 00000100:00100000:3.0:1762166978.534175:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1379 00000100:00100000:3.0:1762166978.534181:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:6497:x1847765449735168:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166978.534238:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:6497:x1847765449735168:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 56us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166978.534246:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1379 00000100:00100000:1.0:1762166978.534254:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bb9f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449735168:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762166978.534288:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bb9f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449735296:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762166978.534310:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166978.534331:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccac36180 going to sleep for 11 seconds 00000100:00100000:3.0:1762166978.534346:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449735296 00000100:00100000:3.0:1762166978.534352:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449735296 00000100:00100000:3.0:1762166978.534383:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1380 00000100:00100000:3.0:1762166978.534390:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:6497:x1847765449735296:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166978.534453:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:6497:x1847765449735296:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 62us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166978.534461:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1380 00000100:00100000:0.0:1762166978.534524:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bb9f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449735296:0@lo:1000:mdt_rdpg00_000.0 00000040:00080000:0.0:1762166978.534685:0:6497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x2:0x0].51, 280 off67288 00000001:00080000:0.0:1762166978.534693:0:6497:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992169 00000100:00100000:0.0:1762166978.534741:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4013480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449735424:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762166978.534781:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166978.534808:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1c8d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166978.534829:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449735424 00000100:00100000:3.0:1762166978.534833:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449735424 00000100:00100000:3.0:1762166978.534866:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1381 00000100:00100000:3.0:1762166978.534873:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4011500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:6497:x1847765449735424:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166978.534956:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4011500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:6497:x1847765449735424:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 84us (174us total) trans 17179876467 rc 0/0 00000100:00100000:3.0:1762166978.534961:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1381 00000100:00100000:0.0:1762166978.534992:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4013480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449735424:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762166978.535015:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4011180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449735552:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762166978.535040:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166978.535060:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1c8d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166978.535071:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449735552 00000100:00100000:3.0:1762166978.535075:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449735552 00000100:00100000:3.0:1762166978.535092:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1382 00000100:00100000:3.0:1762166978.535096:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:6497:x1847765449735552:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166978.535181:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:6497:x1847765449735552:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 83us (140us total) trans 21474843337 rc 0/0 00000100:00100000:3.0:1762166978.535188:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1382 00000100:00100000:0.0:1762166978.535249:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4011180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449735552:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1762166978.535297:0:6497:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992170 00010000:00010000:0.0:1762166978.535320:0:6497:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbab4c4 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x610:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166978.535345:0:6497:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbab4c4 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x610:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166978.535353:0:6497:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbab4c4 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x610:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166978.535359:0:6497:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdfc00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166978.535363:0:6497:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbab4c4 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x610:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166978.535372:0:6497:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbab4c4 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x610:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166978.535386:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x610:0x0].0x0 (ffff945bc809b100) 00010000:00010000:0.0:1762166978.535389:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166978.535393:0:6497:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbab4c4 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x610:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166978.535399:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbab4c4 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x610:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166978.535420:0:6497:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbab4bd lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166978.535431:0:6497:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbab4bd lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166978.535437:0:6497:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbab4bd lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166978.535442:0:6497:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355a600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166978.535445:0:6497:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbab4bd lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166978.535455:0:6497:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbab4bd lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166978.535463:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:0.0:1762166978.535466:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166978.535469:0:6497:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbab4bd lrc: 2/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166978.535473:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbab4bd lrc: 0/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166978.535515:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:0.0:1762166978.535518:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166978.535525:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbab4af lrc: 0/0,0 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea001 expref: 540 pid: 6495 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166978.535610:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4010a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+539:61857:x1847765450526592:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 5917us (6041us total) trans 4294992171 rc 0/0 00000100:00100000:0.0:1762166978.535615:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11880 00000020:00080000:0.0:1762166978.535618:0:6497:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1762166978.536656:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.537108:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450526976 00000100:00100000:2.0:1762166978.537126:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450526976 00000100:00100000:2.0:1762166978.537217:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30553 00000100:00100000:2.0:1762166978.537231:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+539:61857:x1847765450526976:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166978.537261:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166978.537283:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbab4cb lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea008 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.537348:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbab4cb lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea008 expref: 540 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.537364:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbab4cb lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea008 expref: 540 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.537384:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:2.0:1762166978.537387:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166978.537390:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa8200, rc 0) 00000100:00100000:2.0:1762166978.537470:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+540:61857:x1847765450526976:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 242us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166978.537513:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30553 00000100:00100000:1.0:1762166978.538916:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.538969:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450527232 00000100:00100000:0.0:1762166978.538975:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450527232 00000100:00100000:0.0:1762166978.539020:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11881 00000100:00100000:0.0:1762166978.539027:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+540:61857:x1847765450527232:12345-192.168.204.38@tcp:35:lfs.0 00000004:00080000:0.0:1762166978.539369:0:6497:0:(mdd_object.c:3965:mdd_close()) Object [0x240000404:0x610:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1762166978.539448:0:6497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5909, 64 off462768 00000004:00080000:0.0:1762166978.539458:0:6497:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 597687979488ns, next at 598687976533ns, rc = 0 00000040:00080000:0.0:1762166978.539523:0:6497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5908, 64 off462768 00000004:00080000:0.0:1762166978.539532:0:6497:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 597688053870ns, next at 598688050423ns, rc = 0 00000001:00080000:0.0:1762166978.539540:0:6497:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992172 00010000:00010000:0.0:1762166978.539584:0:6497:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbab4d2 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x610:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 00010000:00010000:0.0:1762166978.539597:0:6497:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbab4d2 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x610:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166978.539605:0:6497:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbab4d2 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x610:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166978.539612:0:6497:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbab4d2 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x610:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166978.539617:0:6497:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbab4d2 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x610:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166978.539622:0:6497:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbab4d2 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x610:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166978.539646:0:6497:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1762166978.539734:0:7420:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1762166978.539743:0:7420:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbab4d2 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x610:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6497 initiator: MDT1 00010000:00010000:3.0:1762166978.539751:0:7420:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bde000 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166978.539757:0:7420:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbab4d2 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x610:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6497 initiator: MDT1 00010000:00010000:3.0:1762166978.539764:0:7420:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbab4d2 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x610:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6497 initiator: MDT1 00010000:00010000:3.0:1762166978.539778:0:7420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x610:0x0].0x0 (ffff945bc4afea00) 00010000:00010000:3.0:1762166978.539781:0:7420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1762166978.539787:0:7420:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbab4d2 lrc: 1/0,0 mode: --/PW res: [0x240000404:0x610:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6497 initiator: MDT1 00010000:00010000:3.0:1762166978.539794:0:7420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbab4d2 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x610:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6497 initiator: MDT1 00010000:00010000:3.0:1762166978.539814:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166978.539816:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166978.539819:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166978.539853:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+542:61857:x1847765450527232:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 824us (940us total) trans 4294992173 rc 0/0 00000100:00100000:0.0:1762166978.539876:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11881 00000020:00080000:0.0:1762166978.539882:0:6497:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1762166978.540797:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.540836:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450527488 00000100:00100000:1.0:1762166978.540842:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450527488 00000100:00100000:1.0:1762166978.540886:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11882 00000100:00100000:1.0:1762166978.540892:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+542:61857:x1847765450527488:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:1.0:1762166978.541044:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+543:61857:x1847765450527488:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 152us (248us total) trans 4294992174 rc 0/0 00000100:00100000:1.0:1762166978.541051:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11882 00000100:00100000:3.0:1762166978.542933:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.543013:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450527744 00000100:00100000:2.0:1762166978.543026:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450527744 00000100:00100000:2.0:1762166978.543095:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30554 00000100:00100000:2.0:1762166978.543106:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+543:61766:x1847765450527744:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:2.0:1762166978.543128:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166978.543151:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbab4d9 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea00f expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.543226:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbab4e0 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166978.543240:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbab4e0 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.543250:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbab4e0 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.543273:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbab4e7 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166978.543279:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbab4e7 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.543286:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbab4e7 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.543401:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbab4ee lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166978.543410:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbab4ee lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.543417:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbab4ee lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:2.0:1762166978.543427:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 201690 00010000:00010000:2.0:1762166978.543568:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbab4e0 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.543583:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbab4e0 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.543590:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbab4e0 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.543597:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbab4e0 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.543603:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa9000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166978.543609:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbab4e0 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.543617:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbab4e0 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.543628:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0x0 (ffff945bc809bc00) 00010000:00010000:2.0:1762166978.543631:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166978.543635:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbab4e0 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.543641:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbab4e0 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.543656:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbab4e7 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.543662:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbab4e7 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.543667:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbab4e7 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.543672:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa8000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166978.543675:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbab4e7 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.543680:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbab4e7 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.543687:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0xdd396665 (ffff945bc809b800) 00010000:00010000:2.0:1762166978.543689:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166978.543692:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbab4e7 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.543698:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbab4e7 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.543740:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbab4d9 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea00f expref: 546 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.543756:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbab4ee lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea00f expref: 545 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.543763:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:2.0:1762166978.543765:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166978.543768:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa9c00, rc 0) 00000100:00100000:2.0:1762166978.543839:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+545:61766:x1847765450527744:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 735us (911us total) trans 4294992175 rc 0/0 00000100:00100000:2.0:1762166978.543846:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30554 00000100:00100000:0.0:1762166978.545780:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.545829:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450527872 00000100:00100000:2.0:1762166978.545838:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450527872 00000100:00100000:2.0:1762166978.545902:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30555 00000100:00100000:2.0:1762166978.545916:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+545:61766:x1847765450527872:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:2.0:1762166978.545929:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166978.545943:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbab4fc lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea016 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.545969:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbab503 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166978.545980:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbab503 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.545988:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbab503 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.546084:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbab4fc lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea016 expref: 547 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.546097:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbab503 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea016 expref: 546 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.546102:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:2.0:1762166978.546104:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1762166978.546106:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa9800, rc 0) 00000100:00100000:2.0:1762166978.546145:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+546:61766:x1847765450527872:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 233us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166978.546152:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30555 00000100:00100000:0.0:1762166978.547172:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.547236:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450528128 00000100:00100000:2.0:1762166978.547245:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450528128 00000100:00100000:2.0:1762166978.547307:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30556 00000100:00100000:2.0:1762166978.547315:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+546:61766:x1847765450528128:12345-192.168.204.38@tcp:36:fsx.0 00010000:00010000:2.0:1762166978.547363:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166978.547387:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbab4ee lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea00f expref: 546 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.547407:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:2.0:1762166978.547410:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166978.547631:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbab50a lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166978.547645:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbab50a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.547658:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbab50a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000001:00080000:2.0:1762166978.547707:0:6495:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992176 00000004:00010000:2.0:1762166978.547731:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000029712fdc reply state 0000000054c23301 transno 4294992177 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbab50a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.547744:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbab50a lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.547751:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:2.0:1762166978.547753:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166978.547756:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166978.547837:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+548:61766:x1847765450528128:12345-192.168.204.38@tcp:36:fsx.0 Request processed in 521us (669us total) trans 4294992177 rc 0/0 00000100:00100000:2.0:1762166978.547844:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30556 00000020:00080000:2.0:1762166978.547850:0:6495:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1762166978.548938:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.549013:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450528256 00000100:00100000:3.0:1762166978.549015:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.549023:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450528256 00002000:00010000:2.0:1762166978.549060:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (8651->18446744073709551615) 00002000:00100000:2.0:1762166978.549066:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1e6ca80 with x1847765450528256 ext(8651->18446744073709551615) 00000100:00100000:0.0:1762166978.549073:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450528384 00000100:00100000:3.0:1762166978.549076:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00002000:00010000:2.0:1762166978.549077:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1e6ca80. 00000100:00100000:0.0:1762166978.549080:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450528384 00002000:00010000:0.0:1762166978.549102:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:0.0:1762166978.549108:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1e6c700 with x1847765450528384 ext(0->18446744073709551615) 00000100:00100000:2.0:1762166978.549111:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450528512 00000100:00100000:2.0:1762166978.549116:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450528512 00002000:00010000:0.0:1762166978.549117:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945cf1e6c700. 00002000:00010000:2.0:1762166978.549132:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:2.0:1762166978.549136:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1e6d880 with x1847765450528512 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166978.549144:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1e6d880. 00000100:00100000:0.0:1762166978.549157:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2396 00000100:00100000:0.0:1762166978.549174:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450528256:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:2.0:1762166978.549182:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2397 00000100:00100000:1.0:1762166978.549198:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2398 00000100:00100000:2.0:1762166978.549200:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450528384:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:1.0:1762166978.549221:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450528512:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:1.0:1762166978.549355:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166978.549357:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166978.549361:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166978.549366:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:1.0:1762166978.549367:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166978.549374:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:1.0:1762166978.549376:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166978.549383:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:1.0:1762166978.549385:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:2.0:1762166978.549394:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00000100:00100000:1.0:1762166978.549443:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765450528512:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 230us (367us total) trans 17179876468 rc 0/0 00000100:00100000:2.0:1762166978.549454:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450528384:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 254us (430us total) trans 21474843338 rc 0/0 00000100:00100000:1.0:1762166978.549464:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2398 00002000:00010000:1.0:1762166978.549473:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:1.0:1762166978.549504:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1e6d880 with x1847765450528512 ext(0->18446744073709551615) 00000100:00100000:2.0:1762166978.549511:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2397 00002000:00010000:1.0:1762166978.549513:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1e6d880. 00002000:00010000:2.0:1762166978.549518:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:2.0:1762166978.549525:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1e6c700 with x1847765450528384 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166978.549533:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945cf1e6c700. 00002000:00010000:0.0:1762166978.549627:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 201690 -> 8651 00002000:00010000:0.0:1762166978.549632:0:23943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:0.0:1762166978.549635:0:23943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:0.0:1762166978.549636:0:23943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:0.0:1762166978.549640:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 136 -> 24 00000100:00100000:0.0:1762166978.549675:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765450528256:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 509us (794us total) trans 17179876469 rc 0/0 00000100:00100000:0.0:1762166978.549682:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2396 00002000:00010000:0.0:1762166978.549686:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (8651->18446744073709551615) 00002000:00100000:0.0:1762166978.549689:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1e6ca80 with x1847765450528256 ext(8651->18446744073709551615) 00002000:00010000:0.0:1762166978.549695:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1e6ca80. 00000100:00100000:3.0:1762166978.550677:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.550724:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450528640 00000100:00100000:2.0:1762166978.550730:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450528640 00000100:00100000:2.0:1762166978.550766:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30557 00000100:00100000:2.0:1762166978.550774:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+548:61766:x1847765450528640:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:2.0:1762166978.550792:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166978.550811:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbab511 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea01d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.550913:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbab518 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166978.550929:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbab518 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.550941:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbab518 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:2.0:1762166978.550971:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 8651 00000004:00200000:2.0:1762166978.550975:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166978.550992:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbab518 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.551015:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbab511 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea01d expref: 550 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.551032:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbab518 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea01d expref: 549 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.551041:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:2.0:1762166978.551044:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166978.551047:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa8e00, rc 0) 00000100:00100000:2.0:1762166978.551084:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+549:61766:x1847765450528640:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 310us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166978.551091:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30557 00000100:00100000:1.0:1762166978.553533:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.553610:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450528896 00000100:00100000:2.0:1762166978.553616:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450528896 00000100:00100000:2.0:1762166978.553664:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30558 00000100:00100000:2.0:1762166978.553673:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+549:61766:x1847765450528896:12345-192.168.204.38@tcp:36:fsx.0 00010000:00010000:2.0:1762166978.553713:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166978.553731:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbab518 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea01d expref: 549 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.553745:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:2.0:1762166978.553748:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166978.553921:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbab51f lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166978.553933:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbab51f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.553942:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbab51f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000001:00080000:2.0:1762166978.553983:0:6495:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992178 00000004:00010000:2.0:1762166978.554003:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000012e188f9 reply state 000000004150cb26 transno 4294992179 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbab51f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.554014:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbab51f lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.554020:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:2.0:1762166978.554023:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166978.554026:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166978.554093:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+551:61766:x1847765450528896:12345-192.168.204.38@tcp:36:fsx.0 Request processed in 421us (563us total) trans 4294992179 rc 0/0 00000100:00100000:2.0:1762166978.554100:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30558 00000020:00080000:2.0:1762166978.554105:0:6495:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1762166978.555245:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166978.555283:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.555306:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450529024 00000100:00100000:3.0:1762166978.555312:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.555313:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450529024 00002000:00010000:0.0:1762166978.555340:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (222596->18446744073709551615) 00002000:00100000:0.0:1762166978.555344:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1e6e680 with x1847765450529024 ext(222596->18446744073709551615) 00002000:00010000:0.0:1762166978.555352:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1e6e680. 00000100:00100000:2.0:1762166978.555367:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450529152 00000100:00100000:2.0:1762166978.555373:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450529152 00000100:00100000:0.0:1762166978.555376:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450529280 00000100:00100000:0.0:1762166978.555381:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450529280 00002000:00010000:2.0:1762166978.555391:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:2.0:1762166978.555397:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1e6ed80 with x1847765450529152 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166978.555397:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:0.0:1762166978.555404:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1e6df80 with x1847765450529280 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166978.555406:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945cf1e6ed80. 00000100:00100000:1.0:1762166978.555410:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2399 00002000:00010000:0.0:1762166978.555413:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1e6df80. 00000100:00100000:1.0:1762166978.555424:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+24:2418:x1847765450529024:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:2.0:1762166978.555440:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2400 00000100:00100000:2.0:1762166978.555451:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450529152:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:0.0:1762166978.555519:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2401 00000100:00100000:0.0:1762166978.555529:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765450529280:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:2.0:1762166978.555565:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166978.555570:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166978.555578:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166978.555581:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166978.555584:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00000100:00100000:2.0:1762166978.555622:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450529152:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 173us (337us total) trans 21474843339 rc 0/0 00002000:00010000:1.0:1762166978.555623:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 8651 -> 222596 00002000:00010000:0.0:1762166978.555630:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166978.555632:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00000100:00100000:2.0:1762166978.555636:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2400 00002000:00010000:1.0:1762166978.555638:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:1.0:1762166978.555641:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:0.0:1762166978.555643:0:23943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:1.0:1762166978.555648:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 24 -> 24 00002000:00010000:2.0:1762166978.555649:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00010000:0.0:1762166978.555649:0:23943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00100000:2.0:1762166978.555657:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1e6ed80 with x1847765450529152 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166978.555658:0:23943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:0.0:1762166978.555663:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:2.0:1762166978.555664:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945cf1e6ed80. 00000100:00100000:1.0:1762166978.555679:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+26:2418:x1847765450529024:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 258us (433us total) trans 17179876471 rc 0/0 00000100:00100000:1.0:1762166978.555687:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2399 00002000:00010000:1.0:1762166978.555691:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (222596->18446744073709551615) 00002000:00100000:1.0:1762166978.555697:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1e6e680 with x1847765450529024 ext(222596->18446744073709551615) 00000100:00100000:0.0:1762166978.555697:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765450529280:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 167us (382us total) trans 17179876470 rc 0/0 00002000:00010000:1.0:1762166978.555707:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1e6e680. 00000100:00100000:0.0:1762166978.555712:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2401 00002000:00010000:0.0:1762166978.555717:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:0.0:1762166978.555720:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1e6df80 with x1847765450529280 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166978.555726:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1e6df80. 00000100:00100000:3.0:1762166978.556834:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.556888:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450529408 00000100:00100000:2.0:1762166978.556893:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450529408 00000100:00100000:2.0:1762166978.556923:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30559 00000100:00100000:2.0:1762166978.556931:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5765c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+551:61766:x1847765450529408:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:2.0:1762166978.556944:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166978.556957:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbab526 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea024 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.557018:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbab52d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166978.557029:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbab52d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.557039:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbab52d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:2.0:1762166978.557059:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 222596 00000004:00200000:2.0:1762166978.557064:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166978.557078:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbab52d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.557097:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbab526 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea024 expref: 553 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.557111:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbab52d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea024 expref: 552 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.557119:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:2.0:1762166978.557122:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166978.557125:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa8800, rc 0) 00000100:00100000:2.0:1762166978.557157:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5765c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+552:61766:x1847765450529408:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 227us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166978.557162:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30559 00000100:00100000:3.0:1762166978.558882:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.558943:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450529536 00000100:00100000:0.0:1762166978.558949:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450529536 00002000:00100000:0.0:1762166978.558984:0:23943:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000400:0xa77:0x0] (151552->188415) req@ffff945bc5764700 x1847765450529536/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:9/0 lens 504/0 e 0 to 0 dl 1762166989 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166978.558995:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5764700 with x1847765450529536 ext(151552->188415) 00002000:00010000:0.0:1762166978.558999:0:23943:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5764700 00000100:00100000:0.0:1762166978.559025:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2402 00000100:00100000:0.0:1762166978.559033:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+25:2419:x1847765450529536:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:0.0:1762166978.559973:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+25:2419:x1847765450529536:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 940us (1093us total) trans 0 rc 28672/28672 00000100:00100000:0.0:1762166978.559982:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2402 00002000:00100000:0.0:1762166978.559989:0:23943:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000400:0xa77:0x0] (151552->188415) req@ffff945bc5764700 x1847765450529536/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:9/0 lens 504/440 e 0 to 0 dl 1762166989 ref 1 fl Complete:/600/0 rc 28672/28672 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166978.560005:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5764700 with x1847765450529536 ext(151552->188415) 00002000:00010000:0.0:1762166978.560009:0:23943:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5764700 00000100:00100000:3.0:1762166978.561873:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.561914:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450529792 00000100:00100000:2.0:1762166978.561921:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450529792 00000100:00100000:2.0:1762166978.561962:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30560 00000100:00100000:2.0:1762166978.561971:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5766300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+552:61766:x1847765450529792:12345-192.168.204.38@tcp:36:fsx.0 00010000:00010000:2.0:1762166978.562015:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166978.562035:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbab52d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea024 expref: 552 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.562050:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:2.0:1762166978.562055:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166978.562184:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbab534 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166978.562194:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbab534 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.562200:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbab534 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000001:00080000:2.0:1762166978.562228:0:6495:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992180 00000004:00010000:2.0:1762166978.562241:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000046574079 reply state 0000000011324b0c transno 4294992181 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbab534 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.562249:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbab534 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.562253:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:2.0:1762166978.562255:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166978.562256:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166978.562315:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5766300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+554:61766:x1847765450529792:12345-192.168.204.38@tcp:36:fsx.0 Request processed in 345us (456us total) trans 4294992181 rc 0/0 00000100:00100000:2.0:1762166978.562326:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30560 00000020:00080000:2.0:1762166978.562331:0:6495:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1762166978.563977:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166978.564008:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.564028:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450529920 00000100:00100000:0.0:1762166978.564033:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450529920 00000100:00100000:3.0:1762166978.564041:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00002000:00010000:0.0:1762166978.564053:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (79749->18446744073709551615) 00002000:00100000:0.0:1762166978.564057:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5766a00 with x1847765450529920 ext(79749->18446744073709551615) 00000100:00100000:1.0:1762166978.564065:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450530048 00002000:00010000:0.0:1762166978.564065:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5766a00. 00000100:00100000:1.0:1762166978.564073:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450530048 00000100:00100000:0.0:1762166978.564091:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450530176 00002000:00010000:1.0:1762166978.564094:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00000100:00100000:0.0:1762166978.564095:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450530176 00000100:00100000:2.0:1762166978.564102:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2403 00002000:00100000:1.0:1762166978.564102:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5767100 with x1847765450530048 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166978.564108:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:0.0:1762166978.564112:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5765f80 with x1847765450530176 ext(0->18446744073709551615) 00002000:00010000:1.0:1762166978.564113:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc5767100. 00000100:00100000:2.0:1762166978.564116:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5766a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+26:2418:x1847765450529920:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:0.0:1762166978.564117:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5765f80. 00000100:00100000:1.0:1762166978.564136:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2404 00000100:00100000:0.0:1762166978.564144:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2405 00000100:00100000:1.0:1762166978.564149:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5767100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450530048:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:0.0:1762166978.564156:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5765f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765450530176:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:0.0:1762166978.564235:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166978.564238:0:23943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:0.0:1762166978.564241:0:23943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:1.0:1762166978.564244:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166978.564245:0:23943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:1.0:1762166978.564250:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:0.0:1762166978.564251:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:1.0:1762166978.564256:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:1.0:1762166978.564259:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:1.0:1762166978.564261:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00002000:00010000:2.0:1762166978.564292:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 222596 -> 79749 00002000:00010000:2.0:1762166978.564298:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00000100:00100000:0.0:1762166978.564298:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5765f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+28:2419:x1847765450530176:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 143us (255us total) trans 17179876472 rc 0/0 00002000:00010000:2.0:1762166978.564303:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00000100:00100000:1.0:1762166978.564306:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5767100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450530048:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 159us (294us total) trans 21474843340 rc 0/0 00002000:00010000:2.0:1762166978.564307:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166978.564312:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 24 -> 24 00000100:00100000:0.0:1762166978.564316:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2405 00002000:00010000:0.0:1762166978.564322:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00000100:00100000:1.0:1762166978.564326:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2404 00002000:00100000:0.0:1762166978.564327:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5765f80 with x1847765450530176 ext(0->18446744073709551615) 00002000:00010000:1.0:1762166978.564333:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00010000:0.0:1762166978.564335:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5765f80. 00002000:00100000:1.0:1762166978.564338:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5767100 with x1847765450530048 ext(0->18446744073709551615) 00000100:00100000:2.0:1762166978.564341:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5766a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+28:2418:x1847765450529920:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 227us (363us total) trans 17179876473 rc 0/0 00002000:00010000:1.0:1762166978.564347:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc5767100. 00000100:00100000:2.0:1762166978.564352:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2403 00002000:00010000:2.0:1762166978.564357:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (79749->18446744073709551615) 00002000:00100000:2.0:1762166978.564361:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5766a00 with x1847765450529920 ext(79749->18446744073709551615) 00002000:00010000:2.0:1762166978.564367:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5766a00. 00000100:00100000:3.0:1762166978.565634:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.565682:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450530304 00000100:00100000:2.0:1762166978.565689:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450530304 00000100:00100000:2.0:1762166978.565724:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30561 00000100:00100000:2.0:1762166978.565734:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5765180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+554:61766:x1847765450530304:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:2.0:1762166978.565749:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166978.565762:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbab53b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea02b expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.565882:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbab542 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166978.565895:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbab542 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.565905:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbab542 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:2.0:1762166978.565927:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 79749 00000004:00200000:2.0:1762166978.565932:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166978.565947:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbab542 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.565968:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbab53b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea02b expref: 556 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.565986:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbab542 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea02b expref: 555 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.565994:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:2.0:1762166978.565997:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166978.566000:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa8e00, rc 0) 00000100:00100000:2.0:1762166978.566035:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5765180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+555:61766:x1847765450530304:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 304us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166978.566042:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30561 00000100:00100000:3.0:1762166978.568868:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.568919:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450530432 00000100:00100000:2.0:1762166978.568932:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450530432 00002000:00100000:2.0:1762166978.568970:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (73728->77823) req@ffff945bc5766d80 x1847765450530432/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:9/0 lens 488/0 e 0 to 0 dl 1762166989 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166978.568980:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5766d80 with x1847765450530432 ext(73728->77823) 00002000:00010000:2.0:1762166978.568986:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5766d80 00000100:00100000:2.0:1762166978.569013:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2406 00000100:00100000:2.0:1762166978.569022:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5766d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+27:2418:x1847765450530432:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:2.0:1762166978.569191:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5766d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+27:2418:x1847765450530432:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 170us (339us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1762166978.569199:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2406 00002000:00100000:2.0:1762166978.569206:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (73728->77823) req@ffff945bc5766d80 x1847765450530432/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:9/0 lens 488/4536 e 0 to 0 dl 1762166989 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166978.569222:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5766d80 with x1847765450530432 ext(73728->77823) 00002000:00010000:2.0:1762166978.569227:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5766d80 00000100:00100000:3.0:1762166978.570590:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.570626:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450530560 00000100:00100000:2.0:1762166978.570633:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450530560 00002000:00100000:2.0:1762166978.570659:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (77824->81919) req@ffff945bc5766680 x1847765450530560/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:9/0 lens 488/0 e 0 to 0 dl 1762166989 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166978.570669:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5766680 with x1847765450530560 ext(77824->81919) 00002000:00010000:2.0:1762166978.570673:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5766680 00000100:00100000:2.0:1762166978.570697:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2407 00000100:00100000:2.0:1762166978.570705:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5766680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+27:2418:x1847765450530560:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:2.0:1762166978.570816:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5766680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+27:2418:x1847765450530560:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 112us (226us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1762166978.570823:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2407 00002000:00100000:2.0:1762166978.570830:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (77824->81919) req@ffff945bc5766680 x1847765450530560/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:9/0 lens 488/4536 e 0 to 0 dl 1762166989 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166978.570837:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5766680 with x1847765450530560 ext(77824->81919) 00002000:00010000:2.0:1762166978.570840:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5766680 00000100:00100000:3.0:1762166978.572573:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.572711:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450530688 00000100:00100000:2.0:1762166978.572719:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450530688 00000100:00100000:2.0:1762166978.572774:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2408 00000100:00100000:2.0:1762166978.572782:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5764380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+27:2417:x1847765450530688:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:2.0:1762166978.573033:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 79749 -> 79749 00002000:00010000:2.0:1762166978.573037:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166978.573040:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166978.573042:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166978.573045:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 24 -> 120 00000100:00100000:2.0:1762166978.573090:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5764380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+28:2417:x1847765450530688:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 308us (527us total) trans 17179876474 rc 0/0 00000100:00100000:2.0:1762166978.573097:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2408 00000100:00100000:3.0:1762166978.575600:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.575681:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450530944 00000100:00100000:2.0:1762166978.575692:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450530944 00000100:00100000:2.0:1762166978.575751:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30562 00000100:00100000:2.0:1762166978.575764:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5767800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+555:61766:x1847765450530944:12345-192.168.204.38@tcp:36:fsx.0 00010000:00010000:2.0:1762166978.575812:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166978.575834:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbab542 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea02b expref: 555 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.575846:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:2.0:1762166978.575849:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166978.576005:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbab549 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166978.576019:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbab549 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.576028:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbab549 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000001:00080000:2.0:1762166978.576068:0:6495:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992182 00000004:00010000:2.0:1762166978.576086:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000bdab34b0 reply state 0000000004b33c78 transno 4294992183 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbab549 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.576094:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbab549 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.576098:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:2.0:1762166978.576100:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166978.576102:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166978.576181:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5767800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+557:61766:x1847765450530944:12345-192.168.204.38@tcp:36:fsx.0 Request processed in 417us (587us total) trans 4294992183 rc 0/0 00000100:00100000:2.0:1762166978.576193:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30562 00000020:00080000:2.0:1762166978.576199:0:6495:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1762166978.577392:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.577454:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450531072 00000100:00100000:2.0:1762166978.577462:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450531072 00000100:00100000:3.0:1762166978.577465:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166978.577547:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00002000:00010000:2.0:1762166978.577551:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (79956->18446744073709551615) 00002000:00100000:2.0:1762166978.577558:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5767480 with x1847765450531072 ext(79956->18446744073709551615) 00002000:00010000:2.0:1762166978.577574:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5767480. 00000100:00100000:1.0:1762166978.577591:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450531200 00000100:00100000:1.0:1762166978.577599:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450531200 00000100:00100000:0.0:1762166978.577621:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450531328 00002000:00010000:1.0:1762166978.577631:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00000100:00100000:0.0:1762166978.577635:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450531328 00002000:00100000:1.0:1762166978.577639:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5765500 with x1847765450531200 ext(0->18446744073709551615) 00000100:00100000:2.0:1762166978.577643:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2409 00002000:00010000:1.0:1762166978.577651:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc5765500. 00000100:00100000:2.0:1762166978.577659:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5767480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+29:2419:x1847765450531072:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:3.0:1762166978.577674:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2410 00002000:00010000:0.0:1762166978.577682:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:0.0:1762166978.577690:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5764a80 with x1847765450531328 ext(0->18446744073709551615) 00000100:00100000:3.0:1762166978.577693:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5765500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450531200:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:0.0:1762166978.577705:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5764a80. 00000100:00100000:0.0:1762166978.577749:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2411 00000100:00100000:0.0:1762166978.577764:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5764a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+29:2419:x1847765450531328:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:2.0:1762166978.577810:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 79749 -> 79956 00002000:00010000:2.0:1762166978.577815:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166978.577817:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166978.577818:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166978.577820:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 120 -> 120 00002000:00010000:3.0:1762166978.577886:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:2.0:1762166978.577887:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5767480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+31:2419:x1847765450531072:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 230us (500us total) trans 17179876475 rc 0/0 00002000:00010000:0.0:1762166978.577898:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166978.577903:0:23943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:0.0:1762166978.577907:0:23939:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00000100:00100000:2.0:1762166978.577914:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2409 00002000:00010000:3.0:1762166978.577917:0:23943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:0.0:1762166978.577926:0:23939:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166978.577928:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (79956->18446744073709551615) 00002000:00010000:3.0:1762166978.577929:0:23943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:0.0:1762166978.577931:0:23939:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:0.0:1762166978.577942:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:3.0:1762166978.577944:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00002000:00100000:2.0:1762166978.577949:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5767480 with x1847765450531072 ext(79956->18446744073709551615) 00002000:00010000:2.0:1762166978.577959:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5767480. 00000100:00100000:3.0:1762166978.578004:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5765500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765450531200:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 317us (537us total) trans 21474843341 rc 0/0 00000100:00100000:0.0:1762166978.578006:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5764a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+30:2419:x1847765450531328:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 244us (456us total) trans 17179876476 rc 0/0 00000100:00100000:3.0:1762166978.578021:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2410 00002000:00010000:3.0:1762166978.578027:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00000100:00100000:0.0:1762166978.578031:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2411 00002000:00100000:3.0:1762166978.578033:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5765500 with x1847765450531200 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166978.578036:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:0.0:1762166978.578041:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5764a80 with x1847765450531328 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166978.578042:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc5765500. 00002000:00010000:0.0:1762166978.578048:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5764a80. 00000100:00100000:3.0:1762166978.579166:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.579207:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450531456 00000100:00100000:2.0:1762166978.579214:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450531456 00000100:00100000:2.0:1762166978.579250:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30563 00000100:00100000:2.0:1762166978.579259:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5765880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+557:61766:x1847765450531456:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:2.0:1762166978.579274:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166978.579288:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbab550 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea032 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.579362:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbab557 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166978.579374:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbab557 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.579383:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbab557 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:2.0:1762166978.579406:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 79956 00000004:00200000:2.0:1762166978.579411:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166978.579427:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbab557 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.579449:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbab550 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea032 expref: 559 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.579464:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbab557 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea032 expref: 558 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.579472:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:2.0:1762166978.579475:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166978.579501:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa8000, rc 0) 00000100:00100000:2.0:1762166978.579544:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5765880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+558:61766:x1847765450531456:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 286us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166978.579550:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30563 00000100:00100000:1.0:1762166978.581308:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.581376:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450531584 00000100:00100000:0.0:1762166978.581385:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450531584 00000100:00100000:0.0:1762166978.581434:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2412 00000100:00100000:0.0:1762166978.581444:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc59d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+30:2418:x1847765450531584:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:0.0:1762166978.581640:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 79956 -> 79956 00002000:00010000:0.0:1762166978.581643:0:23939:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:0.0:1762166978.581645:0:23939:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:0.0:1762166978.581646:0:23939:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:0.0:1762166978.581649:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 120 -> 120 00000100:00100000:0.0:1762166978.581679:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc59d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+31:2418:x1847765450531584:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 238us (384us total) trans 17179876477 rc 0/0 00000100:00100000:0.0:1762166978.581684:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2412 00000100:00100000:3.0:1762166978.583759:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.583808:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450531712 00000100:00100000:0.0:1762166978.583818:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450531712 00000100:00100000:0.0:1762166978.583876:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2413 00000100:00100000:0.0:1762166978.583887:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5767b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+31:2419:x1847765450531712:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:0.0:1762166978.583995:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 79956 -> 79956 00002000:00010000:0.0:1762166978.583999:0:23939:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:0.0:1762166978.584002:0:23939:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:0.0:1762166978.584004:0:23939:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:0.0:1762166978.584006:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 120 -> 120 00000100:00100000:0.0:1762166978.584050:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5767b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+32:2419:x1847765450531712:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 165us (299us total) trans 17179876478 rc 0/0 00000100:00100000:0.0:1762166978.584058:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2413 00000100:00100000:3.0:1762166978.586669:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.586778:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450531840 00000100:00100000:0.0:1762166978.586789:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450531840 00002000:00100000:0.0:1762166978.586834:0:23939:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xa77:0x0] (253952->262143) req@ffff945bc5764e00 x1847765450531840/t0(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:9/0 lens 8680/0 e 0 to 0 dl 1762166989 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166978.586845:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5764e00 with x1847765450531840 ext(253952->262143) 00002000:00010000:0.0:1762166978.586851:0:23939:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5764e00 00000100:00100000:0.0:1762166978.586891:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2414 00000100:00100000:0.0:1762166978.586906:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5764e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+32:2418:x1847765450531840:12345-192.168.204.38@tcp:4:fsx.0 00000100:00100000:0.0:1762166978.587656:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5764e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+34:2418:x1847765450531840:12345-192.168.204.38@tcp:4:fsx.0 Request processed in 755us (997us total) trans 17179876479 rc 0/0 00000100:00100000:0.0:1762166978.587669:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2414 00002000:00100000:0.0:1762166978.587678:0:23939:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xa77:0x0] (253952->262143) req@ffff945bc5764e00 x1847765450531840/t17179876479(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:9/0 lens 8680/448 e 0 to 0 dl 1762166989 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166978.587687:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5764e00 with x1847765450531840 ext(253952->262143) 00002000:00010000:0.0:1762166978.587691:0:23939:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5764e00 00000100:00100000:1.0:1762166978.589704:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.589762:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450531968 00000100:00100000:0.0:1762166978.589777:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450531968 00000100:00100000:0.0:1762166978.589873:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2415 00000100:00100000:0.0:1762166978.589886:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5768000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+34:2419:x1847765450531968:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:0.0:1762166978.590301:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 79956 -> 262144 00002000:00010000:0.0:1762166978.590306:0:23939:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:0.0:1762166978.590310:0:23939:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:0.0:1762166978.590312:0:23939:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:0.0:1762166978.590315:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 120 -> 224 00000100:00100000:0.0:1762166978.590393:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5768000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+35:2419:x1847765450531968:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 510us (693us total) trans 17179876480 rc 0/0 00000100:00100000:0.0:1762166978.590402:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2415 00000100:00100000:1.0:1762166978.593163:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.593259:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450532096 00000100:00100000:0.0:1762166978.593273:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450532096 00002000:00100000:0.0:1762166978.593336:0:23939:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xa77:0x0] (155648->221183) req@ffff945bc576bb80 x1847765450532096/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:9/0 lens 488/0 e 0 to 0 dl 1762166989 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166978.593349:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc576bb80 with x1847765450532096 ext(155648->221183) 00002000:00010000:0.0:1762166978.593357:0:23939:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc576bb80 00000100:00100000:0.0:1762166978.593389:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2416 00000100:00100000:0.0:1762166978.593398:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc576bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+35:2418:x1847765450532096:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:0.0:1762166978.594912:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc576bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+35:2418:x1847765450532096:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 1511us (1751us total) trans 0 rc 65536/65536 00000100:00100000:0.0:1762166978.594920:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2416 00002000:00100000:0.0:1762166978.594929:0:23939:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xa77:0x0] (155648->221183) req@ffff945bc576bb80 x1847765450532096/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:9/0 lens 488/440 e 0 to 0 dl 1762166989 ref 1 fl Complete:/600/0 rc 65536/65536 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166978.594936:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc576bb80 with x1847765450532096 ext(155648->221183) 00002000:00010000:0.0:1762166978.594939:0:23939:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc576bb80 00000100:00100000:1.0:1762166978.596396:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.596475:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450532224 00000100:00100000:0.0:1762166978.596508:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450532224 00002000:00100000:0.0:1762166978.596545:0:23939:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xa77:0x0] (184320->192511) req@ffff945bc576aa00 x1847765450532224/t0(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:9/0 lens 8680/0 e 0 to 0 dl 1762166989 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166978.596553:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc576aa00 with x1847765450532224 ext(184320->192511) 00002000:00010000:0.0:1762166978.596556:0:23939:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc576aa00 00000100:00100000:0.0:1762166978.596583:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2417 00000100:00100000:0.0:1762166978.596597:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc576aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+35:2416:x1847765450532224:12345-192.168.204.38@tcp:4:fsx.0 00000100:00100000:0.0:1762166978.597198:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc576aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+37:2416:x1847765450532224:12345-192.168.204.38@tcp:4:fsx.0 Request processed in 605us (806us total) trans 17179876481 rc 0/0 00000100:00100000:0.0:1762166978.597205:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2417 00002000:00100000:0.0:1762166978.597212:0:23939:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xa77:0x0] (184320->192511) req@ffff945bc576aa00 x1847765450532224/t17179876481(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:9/0 lens 8680/448 e 0 to 0 dl 1762166989 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166978.597220:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc576aa00 with x1847765450532224 ext(184320->192511) 00002000:00010000:0.0:1762166978.597224:0:23939:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc576aa00 00000100:00100000:1.0:1762166978.598125:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.598217:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450532352 00000100:00100000:2.0:1762166978.598232:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450532352 00000100:00100000:2.0:1762166978.598301:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19072 00000100:00100000:2.0:1762166978.598314:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5769f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+37:2417:x1847765450532352:12345-192.168.204.38@tcp:16:fsx.0 00000001:00080000:0.0:1762166978.599638:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876481 is committed 00000001:00080000:0.0:1762166978.599679:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876467 is committed 00000100:00100000:2.0:1762166978.599834:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5769f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+17:2417:x1847765450532352:12345-192.168.204.38@tcp:16:fsx.0 Request processed in 1519us (1706us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166978.599848:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19072 00000100:00100000:3.0:1762166978.602025:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.602076:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450532608 00000100:00100000:2.0:1762166978.602089:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450532608 00000100:00100000:2.0:1762166978.602157:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30564 00000100:00100000:2.0:1762166978.602169:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+558:61766:x1847765450532608:12345-192.168.204.38@tcp:36:fsx.0 00010000:00010000:2.0:1762166978.602235:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166978.602267:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbab557 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea032 expref: 558 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.602286:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:2.0:1762166978.602291:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166978.602515:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbab55e lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166978.602531:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbab55e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.602542:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbab55e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000001:00080000:2.0:1762166978.602587:0:6495:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992184 00000004:00010000:2.0:1762166978.602608:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000000b85b2aa reply state 0000000076af3805 transno 4294992185 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbab55e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.602619:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbab55e lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.602625:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:2.0:1762166978.602628:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166978.602630:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166978.602714:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+560:61766:x1847765450532608:12345-192.168.204.38@tcp:36:fsx.0 Request processed in 547us (698us total) trans 4294992185 rc 0/0 00000100:00100000:2.0:1762166978.602722:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30564 00000020:00080000:2.0:1762166978.602728:0:6495:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1762166978.604141:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.604174:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.604201:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166978.604248:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450532736 00000100:00100000:3.0:1762166978.604256:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450532736 00000100:00100000:0.0:1762166978.604268:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450532864 00000100:00100000:0.0:1762166978.604274:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450532864 00002000:00010000:3.0:1762166978.604297:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (90640->18446744073709551615) 00002000:00010000:0.0:1762166978.604297:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:0.0:1762166978.604306:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc576a680 with x1847765450532864 ext(0->18446744073709551615) 00002000:00100000:3.0:1762166978.604307:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc576b800 with x1847765450532736 ext(90640->18446744073709551615) 00002000:00010000:3.0:1762166978.604320:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc576b800. 00002000:00010000:0.0:1762166978.604320:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc576a680. 00000100:00100000:0.0:1762166978.604348:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450532992 00000100:00100000:0.0:1762166978.604352:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450532992 00002000:00010000:0.0:1762166978.604362:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:0.0:1762166978.604367:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc576ad80 with x1847765450532992 ext(0->18446744073709551615) 00000100:00100000:3.0:1762166978.604372:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2418 00002000:00010000:0.0:1762166978.604375:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc576ad80. 00000100:00100000:3.0:1762166978.604385:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc576a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450532864:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:0.0:1762166978.604398:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2419 00000100:00100000:0.0:1762166978.604407:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc576b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450532736:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:2.0:1762166978.604536:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2420 00000100:00100000:2.0:1762166978.604568:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc576ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450532992:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:3.0:1762166978.604593:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166978.604600:0:23943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:3.0:1762166978.604603:0:23943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:3.0:1762166978.604606:0:23943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:3.0:1762166978.604609:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00000100:00100000:3.0:1762166978.604657:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc576a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765450532864:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 276us (480us total) trans 21474843342 rc 0/0 00000100:00100000:3.0:1762166978.604666:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2418 00002000:00010000:3.0:1762166978.604672:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:3.0:1762166978.604677:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc576a680 with x1847765450532864 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166978.604681:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc576a680. 00002000:00010000:2.0:1762166978.604745:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166978.604750:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166978.604753:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166978.604755:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166978.604759:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:0.0:1762166978.604820:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 262144 -> 90640 00002000:00010000:0.0:1762166978.604825:0:23939:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:0.0:1762166978.604828:0:23939:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:0.0:1762166978.604832:0:23939:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:0.0:1762166978.604837:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 224 -> 128 00000100:00100000:2.0:1762166978.604842:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc576ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450532992:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 286us (632us total) trans 17179876483 rc 0/0 00000100:00100000:2.0:1762166978.604854:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2420 00002000:00010000:2.0:1762166978.604867:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:2.0:1762166978.604871:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc576ad80 with x1847765450532992 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166978.604879:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc576ad80. 00000100:00100000:0.0:1762166978.604887:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc576b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450532736:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 476us (745us total) trans 17179876482 rc 0/0 00000100:00100000:0.0:1762166978.604897:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2419 00002000:00010000:0.0:1762166978.604902:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (90640->18446744073709551615) 00002000:00100000:0.0:1762166978.604906:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc576b800 with x1847765450532736 ext(90640->18446744073709551615) 00002000:00010000:0.0:1762166978.604912:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc576b800. 00000100:00100000:1.0:1762166978.606247:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.606303:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450533120 00000100:00100000:2.0:1762166978.606311:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450533120 00000100:00100000:2.0:1762166978.606361:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30565 00000100:00100000:2.0:1762166978.606370:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5769880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+560:61766:x1847765450533120:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:2.0:1762166978.606389:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166978.606407:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbab565 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea039 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.606516:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbab56c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166978.606534:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbab56c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.606545:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbab56c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:2.0:1762166978.606572:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 90640 00000004:00200000:2.0:1762166978.606581:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166978.606598:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbab56c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.606623:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbab565 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea039 expref: 562 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.606640:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbab56c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea039 expref: 561 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.606648:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:2.0:1762166978.606651:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166978.606654:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa9000, rc 0) 00000100:00100000:2.0:1762166978.606697:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5769880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+561:61766:x1847765450533120:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 328us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166978.606705:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30565 00000100:00100000:1.0:1762166978.608885:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.608958:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450533248 00000100:00100000:0.0:1762166978.608971:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450533248 00002000:00100000:0.0:1762166978.609027:0:23939:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xa77:0x0] (0->94207) req@ffff945bc5768e00 x1847765450533248/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:9/0 lens 504/0 e 0 to 0 dl 1762166989 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166978.609036:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5768e00 with x1847765450533248 ext(0->94207) 00002000:00010000:0.0:1762166978.609042:0:23939:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5768e00 00000100:00100000:0.0:1762166978.609073:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2421 00000100:00100000:0.0:1762166978.609080:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5768e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450533248:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:0.0:1762166978.610520:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5768e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450533248:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 1433us (1631us total) trans 0 rc 86016/86016 00000100:00100000:0.0:1762166978.610531:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2421 00002000:00100000:0.0:1762166978.610542:0:23939:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xa77:0x0] (0->94207) req@ffff945bc5768e00 x1847765450533248/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:9/0 lens 504/440 e 0 to 0 dl 1762166989 ref 1 fl Complete:/600/0 rc 86016/86016 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166978.610552:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5768e00 with x1847765450533248 ext(0->94207) 00002000:00010000:0.0:1762166978.610556:0:23939:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5768e00 00000100:00100000:1.0:1762166978.612373:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.612434:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450533376 00000100:00100000:0.0:1762166978.612442:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450533376 00000100:00100000:0.0:1762166978.612529:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2422 00000100:00100000:0.0:1762166978.612541:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5769180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450533376:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:0.0:1762166978.612806:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 90640 -> 90640 00002000:00010000:0.0:1762166978.612809:0:23939:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:0.0:1762166978.612811:0:23939:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:0.0:1762166978.612812:0:23939:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:0.0:1762166978.612814:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 128 -> 136 00000100:00100000:0.0:1762166978.612866:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5769180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450533376:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 319us (489us total) trans 17179876484 rc 0/0 00000100:00100000:0.0:1762166978.612876:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2422 00000100:00100000:1.0:1762166978.615100:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.615175:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450533504 00000100:00100000:0.0:1762166978.615184:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450533504 00002000:00100000:0.0:1762166978.615229:0:23939:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xa77:0x0] (86016->90111) req@ffff945bc5769c00 x1847765450533504/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:9/0 lens 488/0 e 0 to 0 dl 1762166989 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166978.615241:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5769c00 with x1847765450533504 ext(86016->90111) 00002000:00010000:0.0:1762166978.615247:0:23939:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5769c00 00000100:00100000:0.0:1762166978.615279:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2423 00000100:00100000:0.0:1762166978.615289:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5769c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+20:2416:x1847765450533504:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:0.0:1762166978.615472:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5769c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+20:2416:x1847765450533504:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 184us (381us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1762166978.615515:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2423 00002000:00100000:0.0:1762166978.615523:0:23939:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xa77:0x0] (86016->90111) req@ffff945bc5769c00 x1847765450533504/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:9/0 lens 488/4536 e 0 to 0 dl 1762166989 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166978.615531:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5769c00 with x1847765450533504 ext(86016->90111) 00002000:00010000:0.0:1762166978.615535:0:23939:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5769c00 00000100:00100000:3.0:1762166978.617200:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.617285:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450533632 00000100:00100000:0.0:1762166978.617293:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450533632 00002000:00100000:0.0:1762166978.617330:0:23939:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xa77:0x0] (90112->94207) req@ffff945cf3db4e00 x1847765450533632/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:9/0 lens 488/0 e 0 to 0 dl 1762166989 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166978.617340:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf3db4e00 with x1847765450533632 ext(90112->94207) 00002000:00010000:0.0:1762166978.617344:0:23939:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf3db4e00 00000100:00100000:0.0:1762166978.617376:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2424 00000100:00100000:0.0:1762166978.617385:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+20:2417:x1847765450533632:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:0.0:1762166978.617575:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+20:2417:x1847765450533632:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 190us (382us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1762166978.617583:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2424 00002000:00100000:0.0:1762166978.617590:0:23939:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xa77:0x0] (90112->94207) req@ffff945cf3db4e00 x1847765450533632/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:9/0 lens 488/4536 e 0 to 0 dl 1762166989 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166978.617597:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf3db4e00 with x1847765450533632 ext(90112->94207) 00002000:00010000:0.0:1762166978.617601:0:23939:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf3db4e00 00000100:00100000:1.0:1762166978.621147:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.621201:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450533760 00000100:00100000:0.0:1762166978.621212:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450533760 00000100:00100000:0.0:1762166978.621297:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2425 00000100:00100000:0.0:1762166978.621309:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5768380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+20:2417:x1847765450533760:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:0.0:1762166978.621708:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 90640 -> 135959 00002000:00010000:0.0:1762166978.621712:0:23939:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:0.0:1762166978.621715:0:23939:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:0.0:1762166978.621717:0:23939:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:0.0:1762166978.621720:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 136 -> 224 00000100:00100000:0.0:1762166978.621809:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5768380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+21:2417:x1847765450533760:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 502us (671us total) trans 17179876485 rc 0/0 00000100:00100000:0.0:1762166978.621818:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2425 00000100:00100000:1.0:1762166978.626113:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.626176:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450533888 00000100:00100000:0.0:1762166978.626189:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450533888 00002000:00100000:0.0:1762166978.626249:0:23939:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xa77:0x0] (94208->221183) req@ffff945bc576b100 x1847765450533888/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:9/0 lens 488/0 e 0 to 0 dl 1762166989 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166978.626261:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc576b100 with x1847765450533888 ext(94208->221183) 00002000:00010000:0.0:1762166978.626269:0:23939:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc576b100 00000100:00100000:0.0:1762166978.626306:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2426 00000100:00100000:0.0:1762166978.626317:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc576b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+21:2417:x1847765450533888:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:0.0:1762166978.627970:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc576b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+21:2417:x1847765450533888:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 1646us (1863us total) trans 0 rc 45056/45056 00000100:00100000:0.0:1762166978.627983:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2426 00002000:00100000:0.0:1762166978.627994:0:23939:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xa77:0x0] (94208->221183) req@ffff945bc576b100 x1847765450533888/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:9/0 lens 488/440 e 0 to 0 dl 1762166989 ref 1 fl Complete:/600/0 rc 45056/45056 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166978.628002:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc576b100 with x1847765450533888 ext(94208->221183) 00002000:00010000:0.0:1762166978.628007:0:23939:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc576b100 00000100:00100000:1.0:1762166978.631019:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.631086:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450534144 00000100:00100000:2.0:1762166978.631098:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450534144 00000100:00100000:2.0:1762166978.631173:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30566 00000100:00100000:2.0:1762166978.631183:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5768700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+561:61766:x1847765450534144:12345-192.168.204.38@tcp:36:fsx.0 00010000:00010000:2.0:1762166978.631247:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166978.631278:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbab56c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea039 expref: 561 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.631302:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:2.0:1762166978.631307:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166978.631555:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbab573 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166978.631572:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbab573 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.631581:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbab573 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000001:00080000:2.0:1762166978.631624:0:6495:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992186 00000004:00010000:2.0:1762166978.631643:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000045e17d1c reply state 000000004271709b transno 4294992187 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbab573 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.631652:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbab573 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.631656:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:2.0:1762166978.631659:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166978.631661:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166978.631736:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5768700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+563:61766:x1847765450534144:12345-192.168.204.38@tcp:36:fsx.0 Request processed in 555us (727us total) trans 4294992187 rc 0/0 00000100:00100000:2.0:1762166978.631741:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30566 00000020:00080000:2.0:1762166978.631746:0:6495:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1762166978.633017:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.633051:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.633079:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450534272 00000100:00100000:1.0:1762166978.633081:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.633087:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450534272 00000100:00100000:2.0:1762166978.633108:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450534400 00000100:00100000:2.0:1762166978.633115:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450534400 00002000:00010000:0.0:1762166978.633123:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (232857->18446744073709551615) 00002000:00100000:0.0:1762166978.633129:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc558b480 with x1847765450534272 ext(232857->18446744073709551615) 00002000:00010000:2.0:1762166978.633136:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00010000:0.0:1762166978.633141:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc558b480. 00000100:00100000:3.0:1762166978.633142:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450534528 00002000:00100000:2.0:1762166978.633142:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc558b800 with x1847765450534400 ext(0->18446744073709551615) 00000100:00100000:3.0:1762166978.633151:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450534528 00002000:00010000:2.0:1762166978.633155:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc558b800. 00002000:00010000:3.0:1762166978.633173:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00000100:00100000:0.0:1762166978.633179:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2427 00002000:00100000:3.0:1762166978.633181:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc558bb80 with x1847765450534528 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166978.633191:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc558bb80. 00000100:00100000:0.0:1762166978.633192:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450534272:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:2.0:1762166978.633197:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2428 00000100:00100000:2.0:1762166978.633211:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765450534400:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:3.0:1762166978.633234:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2429 00000100:00100000:3.0:1762166978.633244:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450534528:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:3.0:1762166978.633340:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166978.633340:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166978.633347:0:23943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166978.633348:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:3.0:1762166978.633354:0:23943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166978.633354:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:3.0:1762166978.633360:0:23943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166978.633361:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:3.0:1762166978.633368:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:2.0:1762166978.633368:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00002000:00010000:0.0:1762166978.633375:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 135959 -> 232857 00002000:00010000:0.0:1762166978.633380:0:23939:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:0.0:1762166978.633384:0:23939:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:0.0:1762166978.633387:0:23939:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:0.0:1762166978.633390:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 224 -> 224 00000100:00100000:2.0:1762166978.633416:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+24:2418:x1847765450534400:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 206us (362us total) trans 21474843343 rc 0/0 00000100:00100000:3.0:1762166978.633417:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765450534528:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 173us (331us total) trans 17179876486 rc 0/0 00000100:00100000:0.0:1762166978.633423:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765450534272:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 232us (407us total) trans 17179876487 rc 0/0 00000100:00100000:2.0:1762166978.633437:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2428 00002000:00010000:2.0:1762166978.633444:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:2.0:1762166978.633448:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc558b800 with x1847765450534400 ext(0->18446744073709551615) 00000100:00100000:3.0:1762166978.633451:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2429 00002000:00010000:2.0:1762166978.633455:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc558b800. 00002000:00010000:3.0:1762166978.633457:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00000100:00100000:0.0:1762166978.633461:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2427 00002000:00100000:3.0:1762166978.633464:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc558bb80 with x1847765450534528 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166978.633467:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (232857->18446744073709551615) 00002000:00010000:3.0:1762166978.633473:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc558bb80. 00002000:00100000:0.0:1762166978.633473:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc558b480 with x1847765450534272 ext(232857->18446744073709551615) 00002000:00010000:0.0:1762166978.633506:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc558b480. 00000100:00100000:3.0:1762166978.634598:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.634650:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450534656 00000100:00100000:2.0:1762166978.634656:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450534656 00000100:00100000:2.0:1762166978.634695:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30567 00000100:00100000:2.0:1762166978.634701:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+563:61766:x1847765450534656:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:2.0:1762166978.634718:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166978.634732:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbab57a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea040 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.634818:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42f6200/0x2f180c4effbab581 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166978.634831:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42f6200/0x2f180c4effbab581 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.634843:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42f6200/0x2f180c4effbab581 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:2.0:1762166978.634883:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 232857 00000004:00200000:2.0:1762166978.634888:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166978.634907:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42f6200/0x2f180c4effbab581 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.634932:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbab57a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea040 expref: 565 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.634956:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42f6200/0x2f180c4effbab581 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea040 expref: 564 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.634966:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:2.0:1762166978.634969:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166978.634972:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc42f6200, rc 0) 00000100:00100000:2.0:1762166978.635014:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+564:61766:x1847765450534656:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 313us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166978.635021:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30567 00000100:00100000:1.0:1762166978.637328:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.637411:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450534784 00000100:00100000:0.0:1762166978.637419:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450534784 00000100:00100000:0.0:1762166978.637520:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2430 00000100:00100000:0.0:1762166978.637533:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765450534784:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:0.0:1762166978.637846:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 232857 -> 232857 00002000:00010000:0.0:1762166978.637851:0:23939:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:0.0:1762166978.637864:0:23939:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:0.0:1762166978.637867:0:23939:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:0.0:1762166978.637869:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 224 -> 272 00000100:00100000:0.0:1762166978.637925:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+25:2418:x1847765450534784:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 395us (602us total) trans 17179876488 rc 0/0 00000100:00100000:0.0:1762166978.637934:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2430 00000100:00100000:1.0:1762166978.641167:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.641247:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450535040 00000100:00100000:0.0:1762166978.641257:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450535040 00000100:00100000:0.0:1762166978.641314:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11883 00000100:00100000:0.0:1762166978.641335:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+564:61766:x1847765450535040:12345-192.168.204.38@tcp:35:fsx.0 00000100:00100000:0.0:1762166978.641702:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+565:61766:x1847765450535040:12345-192.168.204.38@tcp:35:fsx.0 Request processed in 378us (545us total) trans 4294992188 rc 0/0 00000100:00100000:0.0:1762166978.641710:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11883 00000100:00100000:0.0:1762166978.650296:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.650432:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450535296 00000100:00100000:2.0:1762166978.650448:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450535296 00000100:00100000:2.0:1762166978.650543:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30568 00000100:00100000:2.0:1762166978.650552:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1dde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+565:61858:x1847765450535296:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166978.650572:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166978.650591:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbab588 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea047 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.650650:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbab58f lrc: 3/1,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166978.650667:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbab58f lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.650678:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbab58f lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.650691:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bca743600/0x2f180c4effbab596 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166978.650696:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bca743600/0x2f180c4effbab596 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.650700:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bca743600/0x2f180c4effbab596 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.650788:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bca743200/0x2f180c4effbab59d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166978.650795:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bca743200/0x2f180c4effbab59d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.650799:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bca743200/0x2f180c4effbab59d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:2.0:1762166978.650806:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 232857 00010000:00010000:2.0:1762166978.650882:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbab58f lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.650887:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbab58f lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.650891:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbab58f lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.650903:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbab58f lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.650911:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa9000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166978.650915:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbab58f lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.650922:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbab58f lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.650933:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0x0 (ffff945bc809bc00) 00010000:00010000:2.0:1762166978.650935:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166978.650939:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbab58f lrc: 3/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.650947:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbab58f lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.650962:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bca743600/0x2f180c4effbab596 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.650967:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bca743600/0x2f180c4effbab596 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.650971:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bca743600/0x2f180c4effbab596 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.650976:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bca743600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166978.650978:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bca743600/0x2f180c4effbab596 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.650982:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bca743600/0x2f180c4effbab596 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.650988:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0xdd396665 (ffff945bc809b800) 00010000:00010000:2.0:1762166978.650990:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166978.650993:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bca743600/0x2f180c4effbab596 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.650999:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bca743600/0x2f180c4effbab596 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.651033:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbab588 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea047 expref: 568 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.651044:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bca743200/0x2f180c4effbab59d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea047 expref: 567 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.651049:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:2.0:1762166978.651050:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166978.651052:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bca743200, rc 0) 00000100:00100000:2.0:1762166978.651108:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1dde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+567:61858:x1847765450535296:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 558us (829us total) trans 4294992189 rc 0/0 00000100:00100000:2.0:1762166978.651113:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30568 00000100:00100000:1.0:1762166978.652468:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.652709:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450535424 00000100:00100000:2.0:1762166978.652717:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450535424 00000100:00100000:2.0:1762166978.652766:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 880 00000100:00100000:2.0:1762166978.652776:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5589500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+567:2418:x1847765450535424:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166978.652789:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166978.652805:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bca743200/0x2f180c4effbab59d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea047 expref: 567 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.652820:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:2.0:1762166978.652825:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166978.652882:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5589500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+566:2418:x1847765450535424:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 106us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166978.652890:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 880 00000100:00100000:0.0:1762166978.652939:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.652992:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450535680 00000100:00100000:2.0:1762166978.652998:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450535680 00000100:00100000:2.0:1762166978.653044:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30569 00000100:00100000:2.0:1762166978.653054:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+566:61858:x1847765450535680:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166978.653068:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166978.653083:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4a14000/0x2f180c4effbab5ab lrc: 2/0,0 mode: --/CW res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea04e expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.653441:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc606fc00/0x2f180c4effbab5b2 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x611:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166978.653452:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc606fc00/0x2f180c4effbab5b2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x611:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.653460:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc606fc00/0x2f180c4effbab5b2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x611:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:2.0:1762166978.653468:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x611:0x0]: returning size 0 00010000:00010000:2.0:1762166978.653519:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4a14000/0x2f180c4effbab5ab lrc: 0/0,0 mode: --/CW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea04e expref: 569 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.653535:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc606fc00/0x2f180c4effbab5b2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x611:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea04e expref: 568 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.653542:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x611:0x0].0x0 (ffff945bc809b100) 00010000:00010000:2.0:1762166978.653545:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166978.653548:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc606fc00, rc 0) 00000100:00100000:2.0:1762166978.653580:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+568:61858:x1847765450535680:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 527us (645us total) trans 4294992190 rc 0/0 00000100:00100000:2.0:1762166978.653587:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30569 00000100:00100000:1.0:1762166978.654960:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.655007:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450535936 00000100:00100000:2.0:1762166978.655013:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450535936 00000100:00100000:2.0:1762166978.655049:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30570 00000100:00100000:2.0:1762166978.655060:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+568:61858:x1847765450535936:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166978.655074:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166978.655083:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc606e800/0x2f180c4effbab5c0 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x611:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea055 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.655161:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc606ee00/0x2f180c4effbab5c7 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x611:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166978.655173:0:6495:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc606fc00/0x2f180c4effbab5b2 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x611:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea04e expref: 569 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.655182:0:6495:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc606ee00/0x2f180c4effbab5c7 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x611:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.655210:0:6495:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc606fc00/0x2f180c4effbab5b2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x611:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea04e expref: 569 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.655229:0:6495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc606fc00/0x2f180c4effbab5b2 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x611:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea04e expref: 569 pid: 6495 timeout: 697 lvb_type: 0 00000100:00100000:2.0:1762166978.655241:0:6495:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55dd500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6495:1847765449735680:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166978.655316:0:6495:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc63990c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166978.656376:0:6495:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55dd500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6495:1847765449735680:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166978.656393:0:6495:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc606ee00/0x2f180c4effbab5c7 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x611:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000100:00100000:1.0:1762166978.656555:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.656591:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450536064 00000100:00100000:2.0:1762166978.656596:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450536064 00010000:00010000:2.0:1762166978.656615:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc606fc00/0x2f180c4effbab5b2 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x611:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea04e expref: 570 pid: 6495 timeout: 697 lvb_type: 0 00000100:00100000:2.0:1762166978.656645:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9635 00000100:00100000:2.0:1762166978.656654:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+570:2419:x1847765450536064:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166978.656664:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166978.656670:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc606fc00/0x2f180c4effbab5b2 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x611:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea04e expref: 570 pid: 6495 timeout: 697 lvb_type: 0 00010000:00010000:2.0:1762166978.656683:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc606fc00/0x2f180c4effbab5b2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x611:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea04e expref: 570 pid: 6495 timeout: 697 lvb_type: 0 00010000:00010000:2.0:1762166978.656698:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc606fc00/0x2f180c4effbab5b2 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x611:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea04e expref: 570 pid: 6495 timeout: 697 lvb_type: 0 00010000:00010000:2.0:1762166978.656710:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x611:0x0].0x0 (ffff945bc809b100) 00010000:00010000:2.0:1762166978.656714:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc606ee00/0x2f180c4effbab5c7 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x611:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.656721:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc606ee00/0x2f180c4effbab5c7 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x611:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.656727:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc606ee00/0x2f180c4effbab5c7 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x611:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.656745:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166978.656774:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+569:2419:x1847765450536064:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 121us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166978.656781:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9635 00010000:00010000:0.0:1762166978.656785:0:6495:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc606ee00/0x2f180c4effbab5c7 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x611:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.656796:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc606ee00/0x2f180c4effbab5c7 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x611:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:0.0:1762166978.656808:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x611:0x0]: returning size 0 00000004:00080000:0.0:1762166978.657033:0:6495:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xa8c:0x0], index 0: 0 00000004:00080000:0.0:1762166978.657047:0:6495:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xa8b:0x0], index 1: 0 00010000:00010000:0.0:1762166978.657181:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc606ee00/0x2f180c4effbab5c7 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x611:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.657192:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc606ee00/0x2f180c4effbab5c7 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x611:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.657200:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc606ee00/0x2f180c4effbab5c7 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x611:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.657206:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc606ee00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166978.657211:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc606ee00/0x2f180c4effbab5c7 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x611:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.657220:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc606ee00/0x2f180c4effbab5c7 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x611:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.657234:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x611:0x0].0x0 (ffff945bc809b100) 00010000:00010000:0.0:1762166978.657238:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166978.657243:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc606ee00/0x2f180c4effbab5c7 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x611:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.657249:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc606ee00/0x2f180c4effbab5c7 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x611:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.657306:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc606e800/0x2f180c4effbab5c0 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x611:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea055 expref: 569 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.657316:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x611:0x0].0x0 (ffff945bc809b100) 00010000:00010000:0.0:1762166978.657319:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1762166978.657324:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc606e800/0x2f180c4effbab5c0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x611:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea055 expref: 569 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.657338:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc606e800, rc 0) 00000100:00100000:0.0:1762166978.657398:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+568:61858:x1847765450535936:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2340us (2439us total) trans 4294992191 rc 301/301 00000100:00100000:0.0:1762166978.657408:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30570 00000100:00100000:1.0:1762166978.658630:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.658685:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450536320 00000100:00100000:0.0:1762166978.658692:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450536320 00000100:00100000:0.0:1762166978.658743:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11884 00000100:00100000:0.0:1762166978.658752:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7be5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+568:61858:x1847765450536320:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166978.658980:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7be5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+569:61858:x1847765450536320:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 229us (353us total) trans 4294992192 rc 0/0 00000100:00100000:0.0:1762166978.658988:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11884 00000100:00100000:1.0:1762166978.660748:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.660798:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450536448 00000100:00100000:0.0:1762166978.660808:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450536448 00000100:00100000:0.0:1762166978.660871:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30571 00000100:00100000:0.0:1762166978.660881:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5588380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+569:61858:x1847765450536448:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166978.660902:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166978.660925:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbab5d5 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x611:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea05c expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.661031:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbab5dc lrc: 3/1,0 mode: --/PR res: [0x240000404:0x611:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166978.661046:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbab5dc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x611:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.661059:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbab5dc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x611:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:0.0:1762166978.661100:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x611:0x0]: returning size 0 00000004:00200000:0.0:1762166978.661105:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166978.661124:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbab5dc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x611:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.661151:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbab5d5 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x611:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea05c expref: 571 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.661168:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbab5dc lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x611:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea05c expref: 570 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.661178:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x611:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:0.0:1762166978.661181:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1762166978.661185:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdf800, rc 0) 00000100:00100000:0.0:1762166978.661239:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5588380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+570:61858:x1847765450536448:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 360us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166978.661246:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30571 00000100:00100000:3.0:1762166978.662679:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166978.662720:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.662737:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450536576 00000100:00100000:2.0:1762166978.662748:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450536576 00000100:00100000:2.0:1762166978.662796:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450536704 00000100:00100000:2.0:1762166978.662800:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450536704 00000100:00100000:2.0:1762166978.662833:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19073 00000100:00100000:0.0:1762166978.662843:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19074 00000100:00100000:2.0:1762166978.662845:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+24:2418:x1847765450536576:12345-192.168.204.38@tcp:101:lfs.0 00000100:00100000:0.0:1762166978.662870:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+25:2419:x1847765450536704:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166978.662872:0:8382:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166978.662883:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166978.662894:0:8382:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bca743200/0x2f180c4effbab5e3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea063 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.662901:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde800/0x2f180c4effbab5ea lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa8b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea06a expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166978.662917:0:8382:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa8c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:0.0:1762166978.662924:0:28434:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa8b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1762166978.662934:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166978.662937:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166978.662940:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166978.662944:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166978.662945:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bca743200/0x2f180c4effbab5e3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea063 expref: 25 pid: 8382 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166978.662958:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde800/0x2f180c4effbab5ea lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea06a expref: 26 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166978.662960:0:8382:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bca743200/0x2f180c4effbab5e3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea063 expref: 25 pid: 8382 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166978.662985:0:8382:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bca743200, rc 0) 00010000:00010000:0.0:1762166978.662990:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde800/0x2f180c4effbab5ea lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea06a expref: 26 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166978.663001:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bde800, rc 0) 00000100:00100000:2.0:1762166978.663032:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+25:2418:x1847765450536576:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 191us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166978.663035:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765450536704:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 180us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166978.663042:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19073 00000100:00100000:0.0:1762166978.663050:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19074 00000100:00100000:1.0:1762166978.664990:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.665101:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450536960 00000100:00100000:0.0:1762166978.665111:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450536960 00000100:00100000:0.0:1762166978.665170:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30572 00000100:00100000:0.0:1762166978.665182:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5589f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+570:61858:x1847765450536960:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166978.665206:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166978.665229:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbab5f1 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea071 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.665370:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbab5f8 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166978.665388:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbab5f8 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.665405:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbab5f8 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:0.0:1762166978.665421:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 232857 00010000:00010000:0.0:1762166978.665591:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbab5f1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 13 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea071 expref: 573 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.665610:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbab5f8 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea071 expref: 572 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.665621:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:0.0:1762166978.665624:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166978.665628:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdf400, rc 0) 00000100:00100000:0.0:1762166978.665695:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5589f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+572:61858:x1847765450536960:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 516us (717us total) trans 4294992193 rc 0/0 00000100:00100000:0.0:1762166978.665704:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30572 00000100:00100000:1.0:1762166978.667956:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.668002:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.668036:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.668082:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450537088 00000100:00100000:2.0:1762166978.668093:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450537088 00000100:00100000:3.0:1762166978.668111:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450537216 00000100:00100000:3.0:1762166978.668126:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450537216 00000100:00100000:0.0:1762166978.668131:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450537344 00000100:00100000:0.0:1762166978.668139:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450537344 00000100:00100000:2.0:1762166978.668175:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19075 00000100:00100000:2.0:1762166978.668192:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+27:2419:x1847765450537088:12345-192.168.204.38@tcp:1:lfs.0 00000100:00100000:3.0:1762166978.668204:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19076 00000100:00100000:0.0:1762166978.668224:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19077 00000100:00100000:3.0:1762166978.668227:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5589180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+25:2418:x1847765450537216:12345-192.168.204.38@tcp:1:lfs.0 00000100:00100000:0.0:1762166978.668244:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5589c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+27:2419:x1847765450537344:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:2.0:1762166978.668250:0:8382:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bca743600/0x2f180c4effbab606 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.668275:0:8382:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945cc355bc00/0x2f180c4effbab3d6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 102400->106495) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9fa6 expref: 27 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.668284:0:9165:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effbab60d lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.668285:0:28434:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde400/0x2f180c4effbab614 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.668286:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166978.668293:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166978.668301:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bca743600/0x2f180c4effbab606 lrc: 4/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.668352:0:28434:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbab40e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9fc9 expref: 27 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.668356:0:9165:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945cc355be00/0x2f180c4effbab407 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9fc2 expref: 25 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.668378:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166978.668384:0:8382:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945cc355bc00/0x2f180c4effbab3d6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 102400->106495) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9fa6 expref: 27 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.668389:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166978.668394:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166978.668399:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166978.668403:0:9165:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effbab60d lrc: 4/1,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.668406:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde400/0x2f180c4effbab614 lrc: 4/1,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.668416:0:8382:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945cc355bc00/0x2f180c4effbab3d6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 102400->106495) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9fa6 expref: 27 pid: 8382 timeout: 697 lvb_type: 0 00000100:00100000:2.0:1762166978.668470:0:8382:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55dd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8382:1847765449735808:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166978.668473:0:28434:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbab40e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9fc9 expref: 27 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.668543:0:9165:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945cc355be00/0x2f180c4effbab407 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9fc2 expref: 25 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.668563:0:28434:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbab40e lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9fc9 expref: 27 pid: 8382 timeout: 697 lvb_type: 0 00010000:00010000:3.0:1762166978.668565:0:9165:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945cc355be00/0x2f180c4effbab407 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9fc2 expref: 25 pid: 8382 timeout: 697 lvb_type: 0 00000100:00100000:3.0:1762166978.668631:0:9165:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf3db6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9165:1847765449736064:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166978.668632:0:8382:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc63990c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166978.668632:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1ddf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765449735936:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166978.668674:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1c8dc00 going to sleep for 11 seconds 00000100:00100000:3.0:1762166978.668720:0:9165:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf3a33cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166978.669944:0:8382:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55dd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8382:1847765449735808:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166978.669946:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1ddf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765449735936:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166978.669985:0:28434:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde400/0x2f180c4effbab614 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.669986:0:8382:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bca743600/0x2f180c4effbab606 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166978.669989:0:9165:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3db6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9165:1847765449736064:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166978.670041:0:9165:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effbab60d lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166978.670187:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166978.670220:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166978.670246:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.670260:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450537472 00000100:00100000:1.0:1762166978.670267:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450537472 00010000:00010000:1.0:1762166978.670298:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945cc355be00/0x2f180c4effbab407 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9fc2 expref: 26 pid: 8382 timeout: 697 lvb_type: 0 00000100:00100000:0.0:1762166978.670302:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450537728 00000100:00100000:2.0:1762166978.670303:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450537600 00000100:00100000:2.0:1762166978.670314:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450537600 00000100:00100000:0.0:1762166978.670314:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450537728 00010000:00010000:2.0:1762166978.670346:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbab40e lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9fc9 expref: 29 pid: 8382 timeout: 697 lvb_type: 0 00000100:00100000:1.0:1762166978.670354:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9636 00002000:00100000:0.0:1762166978.670366:0:23939:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xa77:0x0] (28672->232856) req@ffff945cf3db7480 x1847765450537728/t0(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:9/0 lens 504/0 e 0 to 0 dl 1762166989 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1762166978.670375:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff1a8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+26:2416:x1847765450537472:12345-192.168.204.38@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1762166978.670392:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9637 00010000:00010000:1.0:1762166978.670404:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00100000:0.0:1762166978.670416:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf3db7480 with x1847765450537728 ext(28672->232856) 00000100:00100000:2.0:1762166978.670417:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+29:2418:x1847765450537600:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166978.670435:0:23939:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff945cc355bc00/0x2f180c4effbab3d6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 102400->106495) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9fa6 expref: 29 pid: 8382 timeout: 697 lvb_type: 0 00010000:00010000:2.0:1762166978.670436:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166978.670437:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945cc355be00/0x2f180c4effbab407 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9fc2 expref: 26 pid: 8382 timeout: 697 lvb_type: 0 00010000:00010000:2.0:1762166978.670459:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbab40e lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9fc9 expref: 29 pid: 8382 timeout: 697 lvb_type: 0 00010000:00010000:0.0:1762166978.670521:0:23939:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff945cc355bc00/0x2f180c4effbab3d6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 102400->106495) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9fa6 expref: 29 pid: 8382 timeout: 697 lvb_type: 0 00010000:00010000:1.0:1762166978.670524:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945cc355be00/0x2f180c4effbab407 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9fc2 expref: 26 pid: 8382 timeout: 697 lvb_type: 0 00010000:00010000:2.0:1762166978.670530:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbab40e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9fc9 expref: 29 pid: 8382 timeout: 697 lvb_type: 0 00002000:00010000:0.0:1762166978.670587:0:23939:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff945cf3db7480 00010000:00010000:2.0:1762166978.670603:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbab40e lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9fc9 expref: 29 pid: 8382 timeout: 697 lvb_type: 0 00010000:00010000:1.0:1762166978.670612:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cc355be00/0x2f180c4effbab407 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9fc2 expref: 26 pid: 8382 timeout: 697 lvb_type: 0 00010000:00010000:2.0:1762166978.670623:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166978.670627:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166978.670629:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166978.670633:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde400/0x2f180c4effbab614 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166978.670634:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 29 00010000:00010000:1.0:1762166978.670636:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166978.670651:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde400/0x2f180c4effbab614 lrc: 4/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.670652:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effbab60d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166978.670660:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+28:2419:x1847765450537728:12345-192.168.204.38@tcp:4:fsx.0 00010000:00010000:1.0:1762166978.670691:0:6479:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effbab60d lrc: 4/1,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.670711:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166978.670724:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166978.670729:0:28434:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde400/0x2f180c4effbab614 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.670744:0:28434:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde400/0x2f180c4effbab614 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166978.670766:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+28:2418:x1847765450537600:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 351us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166978.670766:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff1a8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+25:2416:x1847765450537472:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 396us (576us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166978.670768:0:28434:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde400/0x2f180c4effbab614 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.670786:0:28434:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde400/0x2f180c4effbab614 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166978.670787:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9637 00000100:00100000:1.0:1762166978.670798:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9636 00010000:00010000:3.0:1762166978.670805:0:28434:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde400/0x2f180c4effbab614 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.670817:0:28434:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bde400 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166978.670822:0:28434:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde400/0x2f180c4effbab614 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.670834:0:28434:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde400/0x2f180c4effbab614 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.670849:0:9165:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effbab60d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.670851:0:28434:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde400/0x2f180c4effbab614 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.670881:0:28434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde400/0x2f180c4effbab614 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.670884:0:9165:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effbab60d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.670910:0:9165:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effbab60d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.670918:0:9165:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effbab60d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.670927:0:9165:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effbab60d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.670934:0:9165:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8473600 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166978.670938:0:9165:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effbab60d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.670946:0:9165:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effbab60d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166978.670952:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5589c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+28:2419:x1847765450537344:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 2715us (2913us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166978.670962:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19077 00010000:00010000:2.0:1762166978.670964:0:9165:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effbab60d lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.670974:0:9165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc8473600/0x2f180c4effbab60d lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166978.671030:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5589180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+24:2418:x1847765450537216:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 2817us (3027us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166978.671038:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19076 00000100:00100000:0.0:1762166978.672632:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+28:2419:x1847765450537728:12345-192.168.204.38@tcp:4:fsx.0 Request processed in 1980us (2381us total) trans 17179876489 rc 0/0 00000100:00100000:0.0:1762166978.672643:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 29 00002000:00100000:0.0:1762166978.672653:0:23939:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xa77:0x0] (28672->232856) req@ffff945cf3db7480 x1847765450537728/t17179876489(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:9/0 lens 504/448 e 0 to 0 dl 1762166989 ref 1 fl Complete:H/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166978.672663:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf3db7480 with x1847765450537728 ext(28672->232856) 00010000:00010000:0.0:1762166978.672671:0:23939:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff945cc355bc00/0x2f180c4effbab3d6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 102400->106495) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9fa6 expref: 28 pid: 8382 timeout: 697 lvb_type: 0 00010000:00010000:0.0:1762166978.672684:0:23939:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff945cc355bc00/0x2f180c4effbab3d6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 102400->106495) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9fa6 expref: 28 pid: 8382 timeout: 697 lvb_type: 0 00002000:00010000:0.0:1762166978.672691:0:23939:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff945cf3db7480 00000100:00100000:3.0:1762166978.674224:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.674282:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450537856 00000100:00100000:1.0:1762166978.674292:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450537856 00010000:00010000:1.0:1762166978.674332:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355bc00/0x2f180c4effbab3d6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 102400->106495) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9fa6 expref: 28 pid: 8382 timeout: 697 lvb_type: 0 00000100:00100000:1.0:1762166978.674372:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9638 00000100:00100000:1.0:1762166978.674382:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+28:2417:x1847765450537856:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166978.674395:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1762166978.674410:0:6479:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 272 -> 296 00010000:00010000:1.0:1762166978.674417:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945cc355bc00/0x2f180c4effbab3d6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 102400->106495) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9fa6 expref: 28 pid: 8382 timeout: 697 lvb_type: 0 00010000:00010000:1.0:1762166978.674434:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945cc355bc00/0x2f180c4effbab3d6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 102400->106495) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9fa6 expref: 28 pid: 8382 timeout: 697 lvb_type: 0 00010000:00010000:1.0:1762166978.674453:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cc355bc00/0x2f180c4effbab3d6 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 102400->106495) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9fa6 expref: 28 pid: 8382 timeout: 697 lvb_type: 0 00010000:00010000:1.0:1762166978.674469:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166978.674471:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166978.674500:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bca743600/0x2f180c4effbab606 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.674511:0:6479:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bca743600/0x2f180c4effbab606 lrc: 4/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.674544:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166978.674554:0:8382:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bca743600/0x2f180c4effbab606 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.674567:0:8382:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bca743600/0x2f180c4effbab606 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166978.674591:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+27:2417:x1847765450537856:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 210us (384us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166978.674595:0:8382:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bca743600/0x2f180c4effbab606 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166978.674604:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9638 00010000:00010000:2.0:1762166978.674607:0:8382:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bca743600/0x2f180c4effbab606 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.674615:0:8382:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bca743600/0x2f180c4effbab606 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.674622:0:8382:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bca743600 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166978.674627:0:8382:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bca743600/0x2f180c4effbab606 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.674634:0:8382:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bca743600/0x2f180c4effbab606 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.674646:0:8382:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bca743600/0x2f180c4effbab606 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.674653:0:8382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bca743600/0x2f180c4effbab606 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166978.674721:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765450537088:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 6535us (6777us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166978.674730:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19075 00000100:00100000:3.0:1762166978.676211:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166978.676266:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.676302:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450537984 00000100:00100000:2.0:1762166978.676315:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450537984 00000100:00100000:2.0:1762166978.676377:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450538240 00000100:00100000:2.0:1762166978.676381:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450538240 00000100:00100000:2.0:1762166978.676432:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19078 00000100:00100000:1.0:1762166978.676445:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19079 00000100:00100000:2.0:1762166978.676449:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+27:2418:x1847765450537984:12345-192.168.204.38@tcp:101:lfs.0 00000100:00100000:1.0:1762166978.676467:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+27:2418:x1847765450538240:12345-192.168.204.38@tcp:101:lfs.0 00000100:00100000:3.0:1762166978.676521:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:2.0:1762166978.676522:0:8382:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166978.676523:0:9165:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166978.676559:0:8382:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc606e800/0x2f180c4effbab61b lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea078 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.676560:0:9165:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cc355aa00/0x2f180c4effbab622 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea086 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166978.676590:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450538112 00000100:00100000:0.0:1762166978.676599:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450538112 00002000:00010000:2.0:1762166978.676601:0:8382:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa77:0x0] initial LVB size: 232857, mtime: 0x690888c2, atime: 0x690888c2, ctime: 0x690888c2, blocks: 0x128 00002000:00010000:1.0:1762166978.676613:0:9165:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa79:0x0] initial LVB size: 0, mtime: 0x690888c2, atime: 0x690888c2, ctime: 0x690888c2, blocks: 0x0 00010000:00010000:2.0:1762166978.676626:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166978.676630:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166978.676633:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166978.676638:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166978.676644:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc606e800/0x2f180c4effbab61b lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea078 expref: 29 pid: 8382 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166978.676649:0:9165:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355aa00/0x2f180c4effbab622 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea086 expref: 29 pid: 9165 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1762166978.676664:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19080 00010000:00010000:2.0:1762166978.676690:0:8382:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc606e800/0x2f180c4effbab61b lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea078 expref: 29 pid: 8382 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1762166978.676690:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765450538112:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166978.676692:0:9165:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945cc355aa00/0x2f180c4effbab622 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea086 expref: 29 pid: 9165 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166978.676717:0:35247:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166978.676745:0:35247:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde600/0x2f180c4effbab629 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea07f expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.676748:0:8382:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc606e800, rc 0) 00010000:00010000:1.0:1762166978.676749:0:9165:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355aa00, rc 0) 00002000:00010000:0.0:1762166978.676796:0:35247:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa7a:0x0] initial LVB size: 0, mtime: 0x690888c2, atime: 0x690888c2, ctime: 0x690888c2, blocks: 0x1800 00000100:00100000:1.0:1762166978.676812:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+29:2418:x1847765450538240:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 353us (542us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166978.676813:0:35247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166978.676820:0:35247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1762166978.676825:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+29:2418:x1847765450537984:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 374us (607us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166978.676835:0:35247:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde600/0x2f180c4effbab629 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea07f expref: 25 pid: 35247 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1762166978.676845:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19079 00000100:00100000:2.0:1762166978.676879:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19078 00010000:00010000:0.0:1762166978.676886:0:35247:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde600/0x2f180c4effbab629 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea07f expref: 25 pid: 35247 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166978.676899:0:35247:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bde600, rc 0) 00000100:00100000:0.0:1762166978.676934:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+25:2419:x1847765450538112:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 252us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166978.676943:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19080 00000100:00100000:3.0:1762166978.702318:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.702427:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450538368 00000100:00100000:0.0:1762166978.702443:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450538368 00000100:00100000:0.0:1762166978.702555:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19081 00000100:00100000:0.0:1762166978.702566:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+28:2417:x1847765450538368:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:0.0:1762166978.702718:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+28:2417:x1847765450538368:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 153us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166978.702727:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19081 00000100:00100000:3.0:1762166978.704177:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.704248:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450538496 00000100:00100000:0.0:1762166978.704259:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450538496 00000100:00100000:0.0:1762166978.704311:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30573 00000100:00100000:0.0:1762166978.704319:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+572:61858:x1847765450538496:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166978.704342:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166978.704366:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbab630 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x611:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea08d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.704409:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbab637 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x611:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166978.704424:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbab637 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x611:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.704436:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbab637 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x611:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.704639:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbab630 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x611:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea08d expref: 574 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.704657:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbab637 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x611:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea08d expref: 573 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.704666:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x611:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:0.0:1762166978.704669:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1762166978.704673:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdea00, rc 0) 00000100:00100000:0.0:1762166978.704726:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+573:61858:x1847765450538496:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 407us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166978.704733:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30573 00000100:00100000:3.0:1762166978.705977:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.706050:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450538752 00000100:00100000:0.0:1762166978.706057:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450538752 00000100:00100000:0.0:1762166978.706092:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30574 00000100:00100000:0.0:1762166978.706101:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+573:61858:x1847765450538752:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:0.0:1762166978.706144:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166978.706164:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbab5dc lrc: 0/0,0 mode: --/PR res: [0x240000404:0x611:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea05c expref: 573 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.706181:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x611:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:0.0:1762166978.706185:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166978.706376:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbab63e lrc: 3/0,1 mode: --/PW res: [0x240000404:0x611:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166978.706387:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbab63e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x611:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.706395:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbab63e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x611:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000001:00080000:0.0:1762166978.706440:0:6495:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992194 00000004:00010000:0.0:1762166978.706459:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000476cda9e reply state 00000000da6a848e transno 4294992195 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbab63e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x611:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.706470:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbab63e lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x611:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.706500:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x611:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:0.0:1762166978.706503:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762166978.706506:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166978.706584:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+575:61858:x1847765450538752:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 484us (612us total) trans 4294992195 rc 0/0 00000100:00100000:0.0:1762166978.706592:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30574 00000020:00080000:0.0:1762166978.706596:0:6495:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1762166978.707967:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.708095:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450538880 00000100:00100000:2.0:1762166978.708106:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450538880 00000100:00100000:2.0:1762166978.708224:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30575 00000100:00100000:2.0:1762166978.708235:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+575:61858:x1847765450538880:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166978.708261:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166978.708280:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc606ee00/0x2f180c4effbab645 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x611:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea094 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.708330:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc606ee00/0x2f180c4effbab645 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x611:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea094 expref: 576 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.708344:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc606ee00/0x2f180c4effbab645 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x611:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea094 expref: 576 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.708361:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x611:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166978.708364:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166978.708367:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc606ee00, rc 0) 00000100:00100000:2.0:1762166978.708419:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+576:61858:x1847765450538880:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 186us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166978.708426:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30575 00000100:00100000:1.0:1762166978.709781:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.709821:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450539008 00000100:00100000:0.0:1762166978.709827:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450539008 00000100:00100000:0.0:1762166978.709877:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19082 00000100:00100000:0.0:1762166978.709886:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5589500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+25:61858:x1847765450539008:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166978.709897:0:35247:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166978.709910:0:35247:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdec00/0x2f180c4effbab64c lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea09b expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.709933:0:35247:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bca743200/0x2f180c4effbab5e3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea063 expref: 26 pid: 8382 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166978.709941:0:35247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166978.709944:0:35247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166978.709948:0:35247:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdec00/0x2f180c4effbab64c lrc: 4/0,0 mode: --/PW res: [0x280000400:0xa8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea09b expref: 26 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.709979:0:35247:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bca743200/0x2f180c4effbab5e3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea063 expref: 26 pid: 8382 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166978.709992:0:35247:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bca743200/0x2f180c4effbab5e3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea063 expref: 26 pid: 8382 timeout: 697 lvb_type: 1 00000100:00100000:0.0:1762166978.710006:0:35247:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1ddf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:35247:1847765449736192:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166978.710097:0:35247:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1c8df00 going to sleep for 11 seconds 00000100:00100000:0.0:1762166978.710968:0:35247:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1ddf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:35247:1847765449736192:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166978.710989:0:35247:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdec00/0x2f180c4effbab64c lrc: 3/0,0 mode: --/PW res: [0x280000400:0xa8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea09b expref: 26 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.711001:0:35247:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdec00, rc 0) 00000100:00100000:0.0:1762166978.711034:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5589500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+26:61858:x1847765450539008:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1150us (1255us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166978.711040:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19082 00000100:00100000:3.0:1762166978.711270:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.711318:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450539136 00000100:00100000:1.0:1762166978.711324:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450539136 00010000:00010000:1.0:1762166978.711346:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bca743200/0x2f180c4effbab5e3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea063 expref: 26 pid: 8382 timeout: 697 lvb_type: 1 00000100:00100000:1.0:1762166978.711384:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9639 00000100:00100000:1.0:1762166978.711393:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce77480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765450539136:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166978.711402:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166978.711407:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bca743200/0x2f180c4effbab5e3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea063 expref: 26 pid: 8382 timeout: 697 lvb_type: 1 00010000:00010000:1.0:1762166978.711420:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bca743200/0x2f180c4effbab5e3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea063 expref: 26 pid: 8382 timeout: 697 lvb_type: 1 00010000:00010000:1.0:1762166978.711441:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bca743200/0x2f180c4effbab5e3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea063 expref: 26 pid: 8382 timeout: 697 lvb_type: 1 00010000:00010000:1.0:1762166978.711464:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166978.711466:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166978.711472:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdec00/0x2f180c4effbab64c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea09b expref: 25 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.711508:0:6479:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdec00/0x2f180c4effbab64c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea09b expref: 25 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.711534:0:6479:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdec00/0x2f180c4effbab64c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea09b expref: 25 pid: 35247 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166978.711543:0:6479:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc558b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6479:1847765449736320:192.168.204.38@tcp:105: 00000100:00100000:1.0:1762166978.711598:0:6479:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccac36b40 going to sleep for 11 seconds 00000100:00100000:0.0:1762166978.712663:0:6479:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc558b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6479:1847765449736320:192.168.204.38@tcp:105: 00010000:00010000:0.0:1762166978.712688:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166978.712756:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce77480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+25:2419:x1847765450539136:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1363us (1484us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166978.712768:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9639 00000100:00100000:3.0:1762166978.712827:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.712886:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450539264 00000100:00100000:0.0:1762166978.712894:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450539264 00000100:00100000:0.0:1762166978.712945:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19083 00000100:00100000:0.0:1762166978.712954:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+28:61858:x1847765450539264:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166978.712972:0:35247:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166978.712990:0:35247:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbab653 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa8b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea0a2 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.713020:0:35247:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde800/0x2f180c4effbab5ea lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea06a expref: 29 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166978.713029:0:35247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166978.713031:0:35247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166978.713035:0:35247:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbab653 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xa8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0a2 expref: 29 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.713068:0:35247:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde800/0x2f180c4effbab5ea lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea06a expref: 29 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166978.713082:0:35247:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde800/0x2f180c4effbab5ea lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea06a expref: 29 pid: 28434 timeout: 697 lvb_type: 1 00000100:00100000:0.0:1762166978.713102:0:35247:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1ddf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:35247:1847765449736448:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166978.713161:0:35247:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1c8df00 going to sleep for 11 seconds 00000100:00100000:0.0:1762166978.714127:0:35247:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1ddf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:35247:1847765449736448:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166978.714147:0:35247:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbab653 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xa8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0a2 expref: 29 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.714161:0:35247:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdf600, rc 0) 00000100:00100000:0.0:1762166978.714202:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+29:61858:x1847765450539264:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1249us (1379us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166978.714210:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19083 00000100:00100000:3.0:1762166978.714390:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.714505:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450539392 00000100:00100000:0.0:1762166978.714511:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450539392 00010000:00010000:0.0:1762166978.714542:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde800/0x2f180c4effbab5ea lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea06a expref: 29 pid: 28434 timeout: 697 lvb_type: 1 00000100:00100000:0.0:1762166978.714578:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9640 00000100:00100000:0.0:1762166978.714587:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce74e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+29:2418:x1847765450539392:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166978.714602:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166978.714608:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde800/0x2f180c4effbab5ea lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa8b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea06a expref: 29 pid: 28434 timeout: 697 lvb_type: 1 00010000:00010000:0.0:1762166978.714621:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde800/0x2f180c4effbab5ea lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa8b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea06a expref: 29 pid: 28434 timeout: 697 lvb_type: 1 00010000:00010000:0.0:1762166978.714648:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde800/0x2f180c4effbab5ea lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa8b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea06a expref: 29 pid: 28434 timeout: 697 lvb_type: 1 00010000:00010000:0.0:1762166978.714660:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166978.714662:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166978.714667:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbab653 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0a2 expref: 28 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.714677:0:6479:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbab653 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0a2 expref: 28 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.714707:0:6479:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbab653 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0a2 expref: 28 pid: 35247 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166978.714719:0:6479:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1ddf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6479:1847765449736576:192.168.204.38@tcp:105: 00000100:00100000:0.0:1762166978.714769:0:6479:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1c8df00 going to sleep for 11 seconds 00000100:00100000:0.0:1762166978.715711:0:6479:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1ddf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6479:1847765449736576:192.168.204.38@tcp:105: 00010000:00010000:0.0:1762166978.715720:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166978.715755:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce74e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+28:2418:x1847765450539392:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1168us (1366us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166978.715763:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9640 00000100:00100000:1.0:1762166978.716009:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.716061:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450539520 00000100:00100000:0.0:1762166978.716069:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450539520 00000100:00100000:1.0:1762166978.716083:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00002000:00010000:0.0:1762166978.716101:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2700 (0->18446744073709551615) 00002000:00100000:0.0:1762166978.716108:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5588e00 with x1847765450539520 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166978.716120:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc5588e00. 00000100:00100000:0.0:1762166978.716146:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450539648 00000100:00100000:0.0:1762166978.716150:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450539648 00002000:00010000:0.0:1762166978.716165:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2699 (0->18446744073709551615) 00002000:00100000:0.0:1762166978.716168:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc558b100 with x1847765450539648 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166978.716174:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc558b100. 00000100:00100000:3.0:1762166978.716180:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2431 00000100:00100000:3.0:1762166978.716194:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5588e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+25:2419:x1847765450539520:12345-192.168.204.38@tcp:10:lfs.0 00000100:00100000:2.0:1762166978.716196:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2432 00000100:00100000:2.0:1762166978.716215:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+28:2419:x1847765450539648:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:2.0:1762166978.716422:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa8b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166978.716423:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa8c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166978.716429:0:23943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa8c:0x0] updating lvb mtime from disk: 0 -> 1762166978 00002000:00010000:2.0:1762166978.716430:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa8b:0x0] updating lvb mtime from disk: 0 -> 1762166978 00002000:00010000:3.0:1762166978.716434:0:23943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa8c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1762166978.716436:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa8b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1762166978.716439:0:23943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa8c:0x0] updating lvb ctime from disk: 0 -> 1762166978 00002000:00010000:2.0:1762166978.716440:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa8b:0x0] updating lvb ctime from disk: 0 -> 1762166978 00002000:00010000:3.0:1762166978.716444:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa8c:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:2.0:1762166978.716446:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa8b:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166978.716513:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5588e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765450539520:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 321us (506us total) trans 21474843344 rc 0/0 00000100:00100000:2.0:1762166978.716514:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+29:2419:x1847765450539648:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 303us (429us total) trans 17179876490 rc 0/0 00000100:00100000:3.0:1762166978.716530:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2431 00002000:00010000:3.0:1762166978.716535:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2700 (0->18446744073709551615) 00002000:00100000:3.0:1762166978.716541:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5588e00 with x1847765450539520 ext(0->18446744073709551615) 00000100:00100000:2.0:1762166978.716541:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2432 00002000:00010000:2.0:1762166978.716549:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2699 (0->18446744073709551615) 00002000:00010000:3.0:1762166978.716550:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc5588e00. 00002000:00100000:2.0:1762166978.716556:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc558b100 with x1847765450539648 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166978.716565:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc558b100. 00000100:00100000:1.0:1762166978.717890:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.717969:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450539776 00000100:00100000:0.0:1762166978.717980:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450539776 00000100:00100000:0.0:1762166978.718029:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19084 00000100:00100000:0.0:1762166978.718042:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+29:2419:x1847765450539776:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:0.0:1762166978.718148:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+29:2419:x1847765450539776:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 111us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166978.718157:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19084 00000100:00100000:2.0:1762166978.719837:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.719882:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450539904 00000100:00100000:0.0:1762166978.719891:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450539904 00000100:00100000:0.0:1762166978.719931:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19085 00000100:00100000:0.0:1762166978.719940:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+29:2418:x1847765450539904:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:0.0:1762166978.720037:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+29:2418:x1847765450539904:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 97us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166978.720044:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19085 00000100:00100000:1.0:1762166978.721615:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.721701:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450540032 00000100:00100000:2.0:1762166978.721707:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450540032 00000100:00100000:2.0:1762166978.721762:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2433 00000100:00100000:2.0:1762166978.721771:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+29:2416:x1847765450540032:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:2.0:1762166978.721838:0:8388:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc606fc00/0x2f180c4effbab65a lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.721876:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166978.721882:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166978.721889:0:8388:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc606fc00/0x2f180c4effbab65a lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.721905:0:8388:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc606fc00/0x2f180c4effbab65a lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.722045:0:8388:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc606fc00/0x2f180c4effbab65a lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.722055:0:8388:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc606fc00/0x2f180c4effbab65a lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.722064:0:8388:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc606fc00/0x2f180c4effbab65a lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.722072:0:8388:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc606fc00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166978.722077:0:8388:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc606fc00/0x2f180c4effbab65a lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.722088:0:8388:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc606fc00/0x2f180c4effbab65a lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.722106:0:8388:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc606fc00/0x2f180c4effbab65a lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.722112:0:8388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc606fc00/0x2f180c4effbab65a lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166978.722176:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+29:2416:x1847765450540032:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 405us (564us total) trans 0 rc 12288/12288 00000100:00100000:2.0:1762166978.722183:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2433 00000100:00100000:1.0:1762166978.723917:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.724196:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450540160 00000100:00100000:2.0:1762166978.724206:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450540160 00000100:00100000:2.0:1762166978.724271:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2434 00000100:00100000:2.0:1762166978.724281:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+26:2417:x1847765450540160:12345-192.168.204.38@tcp:4:lfs.0 00010000:00010000:2.0:1762166978.724318:0:8388:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bca743200/0x2f180c4effbab661 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.724337:0:8388:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdec00/0x2f180c4effbab64c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea09b expref: 26 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.724345:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166978.724349:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166978.724353:0:8388:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bca743200/0x2f180c4effbab661 lrc: 4/0,1 mode: --/PW res: [0x280000400:0xa8c:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.724388:0:8388:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdec00/0x2f180c4effbab64c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea09b expref: 26 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.724403:0:8388:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdec00/0x2f180c4effbab64c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea09b expref: 26 pid: 35247 timeout: 697 lvb_type: 0 00000100:00100000:2.0:1762166978.724421:0:8388:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55dc380 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0000_UUID:8388:1847765449736704:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166978.724537:0:8388:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc63990c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166978.725699:0:8388:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55dc380 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0000_UUID:8388:1847765449736704:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166978.725730:0:8388:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bca743200/0x2f180c4effbab661 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa8c:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166978.726727:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.726829:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450540288 00000100:00100000:0.0:1762166978.726837:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450540288 00010000:00010000:0.0:1762166978.726882:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdec00/0x2f180c4effbab64c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea09b expref: 27 pid: 35247 timeout: 697 lvb_type: 0 00000100:00100000:0.0:1762166978.726926:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9641 00000100:00100000:0.0:1762166978.726937:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+27:2419:x1847765450540288:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166978.726953:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166978.726973:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdec00/0x2f180c4effbab64c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea09b expref: 27 pid: 35247 timeout: 697 lvb_type: 0 00010000:00010000:0.0:1762166978.726985:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdec00/0x2f180c4effbab64c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea09b expref: 27 pid: 35247 timeout: 697 lvb_type: 0 00010000:00010000:0.0:1762166978.727009:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdec00/0x2f180c4effbab64c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea09b expref: 27 pid: 35247 timeout: 697 lvb_type: 0 00010000:00010000:0.0:1762166978.727025:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166978.727027:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166978.727031:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bca743200/0x2f180c4effbab661 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa8c:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.727041:0:6479:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bca743200/0x2f180c4effbab661 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa8c:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.727079:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166978.727135:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765450540288:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 199us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166978.727143:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9641 00010000:00010000:3.0:1762166978.727255:0:8388:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bca743200/0x2f180c4effbab661 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.727265:0:8388:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bca743200/0x2f180c4effbab661 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000001:00080000:2.0:1762166978.729226:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843345 is committed 00000001:00080000:2.0:1762166978.729250:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843337 is committed 00002000:00010000:3.0:1762166978.729367:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa8c:0x0] updating lvb size from disk: 0 -> 12288 00002000:00010000:3.0:1762166978.729371:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa8c:0x0] updating lvb blocks from disk: 0 -> 24 00010000:00010000:3.0:1762166978.729380:0:8388:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bca743200/0x2f180c4effbab661 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.729390:0:8388:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bca743200/0x2f180c4effbab661 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.729399:0:8388:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bca743200/0x2f180c4effbab661 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.729406:0:8388:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bca743200 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166978.729410:0:8388:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bca743200/0x2f180c4effbab661 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.729419:0:8388:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bca743200/0x2f180c4effbab661 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.729432:0:8388:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bca743200/0x2f180c4effbab661 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.729444:0:8388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bca743200/0x2f180c4effbab661 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166978.729531:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+15:2417:x1847765450540160:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 5246us (5616us total) trans 21474843345 rc 0/0 00000100:00100000:3.0:1762166978.729541:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2434 00000100:00100000:1.0:1762166978.731052:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.731119:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450540416 00000100:00100000:0.0:1762166978.731125:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450540416 00000100:00100000:0.0:1762166978.731160:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19086 00000100:00100000:0.0:1762166978.731168:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+29:2419:x1847765450540416:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:0.0:1762166978.731257:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+29:2419:x1847765450540416:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 86us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166978.731265:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19086 00000100:00100000:2.0:1762166978.732739:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.732813:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450540544 00000100:00100000:1.0:1762166978.732823:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450540544 00000100:00100000:1.0:1762166978.732891:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19087 00000100:00100000:1.0:1762166978.732899:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+29:2419:x1847765450540544:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:1.0:1762166978.733041:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+29:2419:x1847765450540544:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 144us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166978.733047:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19087 00000100:00100000:1.0:1762166978.736475:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166978.736618:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450540672 00000100:00100000:3.0:1762166978.736627:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450540672 00000100:00100000:3.0:1762166978.736691:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2435 00000100:00100000:3.0:1762166978.736701:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+29:2419:x1847765450540672:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:3.0:1762166978.736733:0:8388:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8472400/0x2f180c4effbab668 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.736763:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166978.736770:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166978.736775:0:8388:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472400/0x2f180c4effbab668 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [28672->49151] (req 28672->49151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.736789:0:8388:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8472400/0x2f180c4effbab668 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [28672->49151] (req 28672->49151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.738287:0:8388:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8472400/0x2f180c4effbab668 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [28672->49151] (req 28672->49151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.738308:0:8388:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472400/0x2f180c4effbab668 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [28672->49151] (req 28672->49151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.738317:0:8388:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc8472400/0x2f180c4effbab668 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [28672->49151] (req 28672->49151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.738325:0:8388:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8472400 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166978.738330:0:8388:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8472400/0x2f180c4effbab668 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [28672->49151] (req 28672->49151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.738340:0:8388:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8472400/0x2f180c4effbab668 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [28672->49151] (req 28672->49151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.738363:0:8388:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc8472400/0x2f180c4effbab668 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [28672->49151] (req 28672->49151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.738376:0:8388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8472400/0x2f180c4effbab668 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [28672->49151] (req 28672->49151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166978.738474:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+29:2419:x1847765450540672:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 1770us (2003us total) trans 0 rc 20480/20480 00000100:00100000:3.0:1762166978.738526:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2435 00000100:00100000:2.0:1762166978.740246:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166978.740368:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450540800 00000100:00100000:3.0:1762166978.740383:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450540800 00000100:00100000:3.0:1762166978.740448:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2436 00000100:00100000:3.0:1762166978.740454:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+15:2418:x1847765450540800:12345-192.168.204.38@tcp:4:lfs.0 00002000:00010000:3.0:1762166978.740534:0:8388:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa8c:0x0] initial LVB size: 12288, mtime: 0x690888c2, atime: 0x0, ctime: 0x690888c2, blocks: 0x18 00010000:00010000:3.0:1762166978.740545:0:8388:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc8472a00/0x2f180c4effbab66f lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.740559:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166978.740563:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166978.740568:0:8388:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8472a00/0x2f180c4effbab66f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [28672->49151] (req 28672->49151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.740581:0:8388:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc8472a00/0x2f180c4effbab66f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [28672->49151] (req 28672->49151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000001:00080000:3.0:1762166978.743511:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843346 is committed 00002000:00010000:2.0:1762166978.743642:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa8c:0x0] updating lvb size from disk: 12288 -> 49152 00002000:00010000:2.0:1762166978.743647:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa8c:0x0] updating lvb blocks from disk: 24 -> 64 00010000:00010000:2.0:1762166978.743659:0:8388:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc8472a00/0x2f180c4effbab66f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [28672->49151] (req 28672->49151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.743669:0:8388:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8472a00/0x2f180c4effbab66f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [28672->49151] (req 28672->49151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.743683:0:8388:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc8472a00/0x2f180c4effbab66f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [28672->49151] (req 28672->49151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.743689:0:8388:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8472a00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166978.743693:0:8388:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc8472a00/0x2f180c4effbab66f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [28672->49151] (req 28672->49151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.743701:0:8388:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc8472a00/0x2f180c4effbab66f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [28672->49151] (req 28672->49151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.743719:0:8388:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc8472a00/0x2f180c4effbab66f lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [28672->49151] (req 28672->49151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.743726:0:8388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc8472a00/0x2f180c4effbab66f lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [28672->49151] (req 28672->49151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166978.743807:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+15:2418:x1847765450540800:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 3349us (3566us total) trans 21474843346 rc 0/0 00000100:00100000:2.0:1762166978.743821:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2436 00000100:00100000:1.0:1762166978.745672:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.745776:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450540928 00000100:00100000:0.0:1762166978.745793:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450540928 00000100:00100000:0.0:1762166978.745880:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19088 00000100:00100000:0.0:1762166978.745892:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+29:2419:x1847765450540928:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:0.0:1762166978.746059:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+29:2419:x1847765450540928:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 169us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166978.746068:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19088 00000100:00100000:3.0:1762166978.749891:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.749949:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450541056 00000100:00100000:2.0:1762166978.749960:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450541056 00000100:00100000:2.0:1762166978.750033:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19089 00000100:00100000:2.0:1762166978.750044:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+29:2417:x1847765450541056:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:2.0:1762166978.750174:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+29:2417:x1847765450541056:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 131us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166978.750183:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19089 00000100:00100000:1.0:1762166978.752734:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.752790:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450541184 00000100:00100000:2.0:1762166978.752809:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450541184 00000100:00100000:2.0:1762166978.752887:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2437 00000100:00100000:2.0:1762166978.752899:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+29:2419:x1847765450541184:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:2.0:1762166978.752953:0:8388:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bca743600/0x2f180c4effbab676 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.752969:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166978.752971:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166978.752976:0:8388:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bca743600/0x2f180c4effbab676 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [221184->233471] (req 221184->233471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.752989:0:8388:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bca743600/0x2f180c4effbab676 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [221184->233471] (req 221184->233471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.753087:0:8388:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bca743600/0x2f180c4effbab676 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [221184->233471] (req 221184->233471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.753097:0:8388:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bca743600/0x2f180c4effbab676 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [221184->233471] (req 221184->233471) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.753105:0:8388:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bca743600/0x2f180c4effbab676 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [221184->233471] (req 221184->233471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.753112:0:8388:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bca743600 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166978.753116:0:8388:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bca743600/0x2f180c4effbab676 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [221184->233471] (req 221184->233471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.753124:0:8388:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bca743600/0x2f180c4effbab676 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [221184->233471] (req 221184->233471) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.753139:0:8388:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bca743600/0x2f180c4effbab676 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [221184->233471] (req 221184->233471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.753147:0:8388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bca743600/0x2f180c4effbab676 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [221184->233471] (req 221184->233471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166978.753206:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+29:2419:x1847765450541184:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 310us (483us total) trans 0 rc 11673/11673 00000100:00100000:2.0:1762166978.753215:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2437 00000100:00100000:1.0:1762166978.755070:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.755120:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450541312 00000100:00100000:2.0:1762166978.755126:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450541312 00000100:00100000:2.0:1762166978.755209:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2438 00000100:00100000:2.0:1762166978.755219:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+15:2419:x1847765450541312:12345-192.168.204.38@tcp:4:lfs.0 00002000:00010000:2.0:1762166978.755257:0:8388:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa8c:0x0] initial LVB size: 49152, mtime: 0x690888c2, atime: 0x0, ctime: 0x690888c2, blocks: 0x40 00010000:00010000:2.0:1762166978.755264:0:8388:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bca743200/0x2f180c4effbab67d lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.755275:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166978.755277:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166978.755281:0:8388:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bca743200/0x2f180c4effbab67d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [221184->233471] (req 221184->233471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.755291:0:8388:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bca743200/0x2f180c4effbab67d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [221184->233471] (req 221184->233471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000001:00080000:3.0:1762166978.757089:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843347 is committed 00002000:00010000:2.0:1762166978.757180:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa8c:0x0] updating lvb size from disk: 49152 -> 232857 00002000:00010000:2.0:1762166978.757185:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa8c:0x0] updating lvb blocks from disk: 64 -> 88 00010000:00010000:2.0:1762166978.757199:0:8388:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bca743200/0x2f180c4effbab67d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [221184->233471] (req 221184->233471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.757209:0:8388:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bca743200/0x2f180c4effbab67d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [221184->233471] (req 221184->233471) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.757218:0:8388:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bca743200/0x2f180c4effbab67d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [221184->233471] (req 221184->233471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.757225:0:8388:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bca743200 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166978.757229:0:8388:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bca743200/0x2f180c4effbab67d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [221184->233471] (req 221184->233471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.757239:0:8388:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bca743200/0x2f180c4effbab67d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [221184->233471] (req 221184->233471) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.757259:0:8388:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bca743200/0x2f180c4effbab67d lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [221184->233471] (req 221184->233471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.757267:0:8388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bca743200/0x2f180c4effbab67d lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [221184->233471] (req 221184->233471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166978.757370:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+15:2419:x1847765450541312:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 2148us (2298us total) trans 21474843347 rc 0/0 00000100:00100000:2.0:1762166978.757382:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2438 00000100:00100000:3.0:1762166978.758886:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.758976:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450541440 00000100:00100000:2.0:1762166978.758985:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450541440 00000100:00100000:2.0:1762166978.759042:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30576 00000100:00100000:2.0:1762166978.759051:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+576:61858:x1847765450541440:12345-192.168.204.38@tcp:44:lfs.0 00000001:00080000:3.0:1762166978.760642:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294992195 is committed 00000004:00080000:3.0:1762166978.760699:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3273 committed 00000004:00080000:3.0:1762166978.760716:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3270 committed 00000020:00080000:3.0:1762166978.760748:0:7412:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff945ccac7a240 refcount 2 committed 0 result 0 batchid 52 00000020:00080000:3.0:1762166978.760755:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cc3e9ff00 obd lustre-OST0001-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff945cc9a5e0c0 00000020:00080000:3.0:1762166978.760758:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cf1d0e400 obd lustre-OST0000-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff945cc7c0f240 00000020:00080000:3.0:1762166978.760761:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cf1d0e700 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff945bc41d9800 00000020:00080000:3.0:1762166978.760765:0:7412:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000400:0x2:0x0].51 00000020:00080000:3.0:1762166978.760807:0:7412:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0001: 51 batchid updated 00000020:00080000:3.0:1762166978.760830:0:7435:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 52 committed batchid 51 00000100:00100000:0.0:1762166978.760872:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1ddf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449736832:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1762166978.760873:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449736960:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1762166978.760954:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1762166978.760991:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9400/0x2f180c4effbab3f9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00000100:00100000:1.0:1762166978.761005:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1762166978.761008:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9400/0x2f180c4effbab3f9 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.761018:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9400/0x2f180c4effbab3f9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.761025:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa9400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166978.761031:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9400/0x2f180c4effbab3f9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00000100:00100000:0.0:1762166978.761033:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449736832 00000100:00100000:0.0:1762166978.761040:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449736832 00010000:00010000:2.0:1762166978.761043:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9400/0x2f180c4effbab3f9 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00000100:00100000:1.0:1762166978.761048:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449736960 00000100:00100000:1.0:1762166978.761053:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449736960 00010000:00010000:2.0:1762166978.761065:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:2.0:1762166978.761070:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166978.761076:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9400/0x2f180c4effbab3f9 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000100:00100000:0.0:1762166978.761082:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19090 00010000:00010000:2.0:1762166978.761087:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9400/0x2f180c4effbab3f9 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000100:00100000:1.0:1762166978.761092:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19091 00000100:00100000:0.0:1762166978.761093:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1847765449736832:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1762166978.761107:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3633:x1847765449736960:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1762166978.761121:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbab50a lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00002000:00080000:0.0:1762166978.761122:0:8382:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:2699 count 1 00010000:00010000:2.0:1762166978.761133:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbab50a lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00002000:00080000:1.0:1762166978.761138:0:35247:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:2698 count 1 00010000:00010000:2.0:1762166978.761140:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbab50a lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.761148:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa8600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166978.761148:0:8382:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdec00/0x2f180c4effbab684 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa8b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.761155:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbab50a lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.761158:0:35247:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945cc355a000/0x2f180c4effbab68b lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.761169:0:8382:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde200/0x2f180c4effbab2be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f52 expref: 14 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.761170:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbab50a lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.761187:0:35247:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbab3b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 102400->106495) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f98 expref: 28 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.761189:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166978.761192:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166978.761194:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:0.0:1762166978.761196:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdec00/0x2f180c4effbab684 lrc: 4/0,1 mode: --/PW res: [0x280000400:0xa8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.761202:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166978.761208:0:35247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166978.761209:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbab50a lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.761213:0:35247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166978.761218:0:35247:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355a000/0x2f180c4effbab68b lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.761228:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbab50a lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.761250:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbab51f lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.761255:0:8382:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde200/0x2f180c4effbab2be lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f52 expref: 14 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.761260:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbab51f lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.761263:0:35247:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbab3b3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 102400->106495) gid 0 flags: 0x50000000030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f98 expref: 28 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.761279:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbab51f lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.761285:0:8382:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde200/0x2f180c4effbab2be lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f52 expref: 14 pid: 28434 timeout: 697 lvb_type: 0 00010000:00010000:1.0:1762166978.761287:0:35247:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbab3b3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 102400->106495) gid 0 flags: 0x70000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f98 expref: 28 pid: 28434 timeout: 697 lvb_type: 0 00010000:00010000:2.0:1762166978.761292:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa9e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166978.761298:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbab51f lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.761315:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbab51f lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00000100:00100000:1.0:1762166978.761323:0:35247:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:35247:1847765449737216:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166978.761332:0:8382:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1ddfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8382:1847765449737088:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166978.761335:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:2.0:1762166978.761340:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166978.761344:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbab51f lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.761355:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbab51f lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.761369:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbab534 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.761381:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbab534 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.761389:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbab534 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.761394:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa8c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166978.761398:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbab534 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.761404:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbab534 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.761414:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:2.0:1762166978.761419:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166978.761423:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbab534 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.761430:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbab534 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000100:00100000:1.0:1762166978.761431:0:35247:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccac36b40 going to sleep for 11 seconds 00000100:00100000:0.0:1762166978.761431:0:8382:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1c8df00 going to sleep for 11 seconds 00000020:00080000:3.0:1762166978.761433:0:7435:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 51 cancel update log [0x240000400:0x2:0x0].50: rc = 0 00010000:00010000:2.0:1762166978.761461:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbab549 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00000020:00080000:3.0:1762166978.761465:0:7435:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 51 00010000:00010000:2.0:1762166978.761471:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbab549 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.761516:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbab549 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.761521:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa8800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166978.761523:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbab549 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.761531:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbab549 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.761541:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:2.0:1762166978.761544:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166978.761547:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbab549 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.761553:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbab549 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.761565:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbab55e lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.761571:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbab55e lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.761577:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbab55e lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.761583:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa9c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166978.761585:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbab55e lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.761592:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbab55e lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.761599:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:2.0:1762166978.761602:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166978.761605:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbab55e lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.761610:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbab55e lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.761625:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbab573 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.761632:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbab573 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.761638:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbab573 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.761643:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa8e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166978.761647:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbab573 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.761653:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbab573 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.761660:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:2.0:1762166978.761662:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166978.761665:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbab573 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.761670:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbab573 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.761681:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbab63e lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x611:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.761688:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbab63e lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x611:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.761698:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbab63e lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x611:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.761704:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdee00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166978.761707:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbab63e lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x611:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.761714:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbab63e lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x611:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.761726:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x611:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166978.761729:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166978.761732:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbab63e lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x611:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.761737:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbab63e lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x611:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000100:00100000:0.0:1762166978.761751:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+529:61858:x1847765450541440:12345-192.168.204.38@tcp:44:lfs.0 Request processed in 2700us (2870us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166978.761762:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30576 00000100:00100000:1.0:1762166978.762776:0:35247:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:35247:1847765449737216:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166978.762818:0:35247:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945cc355a000/0x2f180c4effbab68b lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166978.762842:0:8382:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1ddfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8382:1847765449737088:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166978.762880:0:8382:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdec00/0x2f180c4effbab684 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166978.763317:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.763458:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450541568 00000100:00100000:2.0:1762166978.763465:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450541568 00010000:00010000:2.0:1762166978.763540:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbab3b3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 102400->106495) gid 0 flags: 0x60000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f98 expref: 29 pid: 28434 timeout: 697 lvb_type: 0 00000100:00100000:2.0:1762166978.763583:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9642 00000100:00100000:2.0:1762166978.763594:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+29:2416:x1847765450541568:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166978.763610:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166978.763618:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbab3b3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 102400->106495) gid 0 flags: 0x60000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f98 expref: 29 pid: 28434 timeout: 697 lvb_type: 0 00010000:00010000:2.0:1762166978.763632:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbab3b3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 102400->106495) gid 0 flags: 0x50000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f98 expref: 29 pid: 28434 timeout: 697 lvb_type: 0 00000100:00100000:3.0:1762166978.763702:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:2.0:1762166978.763733:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbab3b3 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 102400->106495) gid 0 flags: 0x44801400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f98 expref: 29 pid: 28434 timeout: 697 lvb_type: 0 00010000:00010000:2.0:1762166978.763753:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166978.763755:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1762166978.763757:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450541696 00010000:00010000:2.0:1762166978.763760:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945cc355a000/0x2f180c4effbab68b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166978.763764:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450541696 00010000:00010000:2.0:1762166978.763774:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355a000/0x2f180c4effbab68b lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.763786:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde200/0x2f180c4effbab2be lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f52 expref: 15 pid: 28434 timeout: 697 lvb_type: 0 00010000:00010000:2.0:1762166978.763810:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166978.763828:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9643 00000100:00100000:1.0:1762166978.763839:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff1a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+15:2418:x1847765450541696:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166978.763865:0:35247:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945cc355a000/0x2f180c4effbab68b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.763867:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166978.763880:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde200/0x2f180c4effbab2be lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa8b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f52 expref: 15 pid: 28434 timeout: 697 lvb_type: 0 00000100:00100000:2.0:1762166978.763888:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+28:2416:x1847765450541568:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 293us (569us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166978.763900:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde200/0x2f180c4effbab2be lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa8b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f52 expref: 15 pid: 28434 timeout: 697 lvb_type: 0 00000100:00100000:2.0:1762166978.763903:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9642 00010000:00010000:1.0:1762166978.763935:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde200/0x2f180c4effbab2be lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa8b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e9f52 expref: 15 pid: 28434 timeout: 697 lvb_type: 0 00010000:00010000:3.0:1762166978.763947:0:35247:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cc355a000/0x2f180c4effbab68b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.763955:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166978.763960:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166978.763966:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdec00/0x2f180c4effbab684 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.763968:0:35247:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945cc355a000/0x2f180c4effbab68b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.763979:0:6479:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdec00/0x2f180c4effbab684 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166978.764008:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:3.0:1762166978.764020:0:35247:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355a000/0x2f180c4effbab68b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.764029:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166978.764046:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:2.0:1762166978.764064:0:8382:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdec00/0x2f180c4effbab684 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166978.764070:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff1a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+14:2418:x1847765450541696:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 232us (369us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166978.764081:0:8382:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdec00/0x2f180c4effbab684 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166978.764085:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9643 00010000:00010000:2.0:1762166978.764098:0:8382:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdec00/0x2f180c4effbab684 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.764107:0:8382:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdec00/0x2f180c4effbab684 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166978.764113:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450541824 00000100:00100000:0.0:1762166978.764119:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450541824 00010000:00010000:2.0:1762166978.764138:0:8382:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762166978.764157:0:6483:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1762166978.764164:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450541952 00010000:00010000:1.0:1762166978.764167:0:6483:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdec00/0x2f180c4effbab684 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166978.764168:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450541952 00010000:00010000:1.0:1762166978.764178:0:6483:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdec00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166978.764184:0:6483:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdec00/0x2f180c4effbab684 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.764195:0:6483:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdec00/0x2f180c4effbab684 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.764202:0:35247:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1762166978.764204:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19092 00010000:00010000:1.0:1762166978.764207:0:6483:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdec00/0x2f180c4effbab684 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.764218:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdec00/0x2f180c4effbab684 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166978.764220:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+14:2418:x1847765450541824:12345-192.168.204.38@tcp:16:lfs.0 00010000:00010000:1.0:1762166978.764247:0:6483:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166978.764252:0:6483:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945cc355a000/0x2f180c4effbab68b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.764259:0:6483:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355a000 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166978.764263:0:6483:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc355a000/0x2f180c4effbab68b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.764270:0:6483:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc355a000/0x2f180c4effbab68b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.764283:0:6483:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945cc355a000/0x2f180c4effbab68b lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.764291:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cc355a000/0x2f180c4effbab68b lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166978.764302:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+14:2418:x1847765450541824:12345-192.168.204.38@tcp:16:lfs.0 Request processed in 83us (302us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166978.764305:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166978.764308:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166978.764313:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19092 00010000:00010000:1.0:1762166978.764317:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166978.764344:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19093 00000100:00100000:1.0:1762166978.764355:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3d5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+28:2418:x1847765450541952:12345-192.168.204.38@tcp:16:lfs.0 00000100:00100000:2.0:1762166978.764449:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3636:x1847765449736832:12345-0@lo:6:osp-syn-0-1.0 Request processed in 3353us (3489us total) trans 21474843348 rc 0/0 00000100:00100000:2.0:1762166978.764460:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19090 00000100:00100000:0.0:1762166978.764471:0:3636:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 21474843337 gen 2 00000004:00080000:0.0:1762166978.764500:0:3636:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 21474843331 committed transno 21474843337 00000004:00080000:0.0:1762166978.764525:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc406e680, transno 21474843332 00010000:00010000:2.0:1762166978.764526:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1762166978.764536:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc406c700, transno 21474843333 00000004:00080000:0.0:1762166978.764540:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc406ea00, transno 21474843334 00000004:00080000:0.0:1762166978.764545:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc7b23800, transno 21474843335 00000004:00080000:0.0:1762166978.764549:0:3636:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 21474843337 committed transno 21474843337 00000100:00100000:0.0:1762166978.764566:0:3636:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff945cf1ddf480 x1847765449736832/t21474843348(21474843348) o6->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 544/432 e 0 to 0 dl 1762166994 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1762166978.764577:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf1ddf480/2, rc 0, transno 21474843348 00000100:00100000:0.0:1762166978.764582:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1ddf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449736832:0@lo:6:osp-syn-0-1.0 00000004:00080000:2.0:1762166978.764653:0:9158:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0001: 0 changes, 1 in progress, 0 in flight, 4 done 00000100:00100000:2.0:1762166978.765311:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+6:3633:x1847765449736960:12345-0@lo:6:osp-syn-1-1.0 Request processed in 4207us (4313us total) trans 17179876491 rc 0/0 00000100:00100000:2.0:1762166978.765320:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19091 00000100:00100000:1.0:1762166978.765356:0:3633:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 17179876467 gen 2 00000004:00080000:1.0:1762166978.765361:0:3633:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 17179876467 committed transno 17179876467 00000100:00100000:1.0:1762166978.765375:0:3633:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff945cf1cd0380 x1847765449736960/t17179876491(17179876491) o6->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 544/432 e 0 to 0 dl 1762166994 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1762166978.765384:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf1cd0380/2, rc 0, transno 17179876491 00000100:00100000:1.0:1762166978.765388:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449736960:0@lo:6:osp-syn-1-1.0 00000001:00080000:1.0:1762166978.765726:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876491 is committed 00000001:00080000:1.0:1762166978.765732:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876490 is committed 00000100:00100000:2.0:1762166978.765814:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3d5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450541952:12345-192.168.204.38@tcp:16:lfs.0 Request processed in 1463us (1769us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166978.765821:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19093 00000100:00100000:0.0:1762166978.773336:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.773391:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.773406:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450542208 00000100:00100000:2.0:1762166978.773423:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450542208 00000100:00100000:0.0:1762166978.773430:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.773456:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450542080 00000100:00100000:1.0:1762166978.773461:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450542080 00000100:00100000:1.0:1762166978.773528:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450542336 00000100:00100000:1.0:1762166978.773534:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450542336 00000100:00100000:2.0:1762166978.773556:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19094 00000100:00100000:1.0:1762166978.773567:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19095 00000100:00100000:1.0:1762166978.773581:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450542080:12345-192.168.204.38@tcp:1:lfs.0 00000100:00100000:2.0:1762166978.773585:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1dddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+14:2419:x1847765450542208:12345-192.168.204.38@tcp:1:lfs.0 00000100:00100000:3.0:1762166978.773603:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19096 00000100:00100000:3.0:1762166978.773628:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1dded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450542336:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:1.0:1762166978.773637:0:35247:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945cc355a000/0x2f180c4effbab692 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.773638:0:28874:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bca743200/0x2f180c4effbab699 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.773667:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166978.773667:0:35247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166978.773673:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166978.773673:0:35247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166978.773683:0:8382:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8472400/0x2f180c4effbab6a0 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.773685:0:35247:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355a000/0x2f180c4effbab692 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.773686:0:28874:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bca743200/0x2f180c4effbab699 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.773743:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166978.773745:0:35247:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cc355a000/0x2f180c4effbab692 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.773749:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166978.773749:0:28874:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bca743200/0x2f180c4effbab699 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.773763:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472400/0x2f180c4effbab6a0 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.773811:0:35247:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945cc355a000/0x2f180c4effbab692 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.773821:0:8382:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8472400/0x2f180c4effbab6a0 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.773824:0:28874:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bca743200/0x2f180c4effbab699 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.773824:0:35247:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355a000/0x2f180c4effbab692 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.773867:0:35247:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945cc355a000/0x2f180c4effbab692 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.773882:0:28874:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bca743200/0x2f180c4effbab699 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.773882:0:35247:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355a000 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166978.773889:0:35247:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc355a000/0x2f180c4effbab692 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.773897:0:8382:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8472400/0x2f180c4effbab6a0 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.773899:0:28874:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bca743200/0x2f180c4effbab699 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.773902:0:35247:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc355a000/0x2f180c4effbab692 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.773944:0:8382:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472400/0x2f180c4effbab6a0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.773946:0:28874:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bca743200 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166978.773958:0:35247:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945cc355a000/0x2f180c4effbab692 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.773959:0:28874:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bca743200/0x2f180c4effbab699 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.773960:0:8382:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc8472400/0x2f180c4effbab6a0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.774003:0:35247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cc355a000/0x2f180c4effbab692 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.774007:0:8382:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8472400 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166978.774014:0:28874:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bca743200/0x2f180c4effbab699 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.774019:0:8382:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8472400/0x2f180c4effbab6a0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.774056:0:28874:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bca743200/0x2f180c4effbab699 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.774066:0:8382:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8472400/0x2f180c4effbab6a0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.774069:0:28874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bca743200/0x2f180c4effbab699 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166978.774098:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450542080:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 517us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166978.774108:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19095 00010000:00010000:3.0:1762166978.774109:0:8382:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc8472400/0x2f180c4effbab6a0 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166978.774122:0:8382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8472400/0x2f180c4effbab6a0 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166978.774142:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1dddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+14:2419:x1847765450542208:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 570us (823us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166978.774152:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19094 00000100:00100000:3.0:1762166978.774205:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1dded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450542336:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 585us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166978.774227:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19096 00000100:00100000:0.0:1762166978.775441:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.775555:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450542592 00000100:00100000:2.0:1762166978.775564:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450542592 00000100:00100000:2.0:1762166978.775623:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30577 00000100:00100000:2.0:1762166978.775632:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+529:61858:x1847765450542592:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:2.0:1762166978.775726:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bca743600/0x2f180c4effbab6a7 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x611:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166978.775743:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bca743600/0x2f180c4effbab6a7 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x611:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166978.775752:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bca743600/0x2f180c4effbab6a7 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x611:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00010000:2.0:1762166978.775916:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000051abf6ef reply state 00000000c6ca762e transno 4294992196 ns: mdt-lustre-MDT0001_UUID lock: ffff945bca743600/0x2f180c4effbab6a7 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x611:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166978.775942:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bca743600/0x2f180c4effbab6a7 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x611:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166978.775949:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x611:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166978.775953:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166978.775956:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166978.776040:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+531:61858:x1847765450542592:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 409us (608us total) trans 4294992196 rc 0/0 00000100:00100000:2.0:1762166978.776048:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30577 00000100:00100000:0.0:1762166978.776984:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.777015:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.777038:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450542848 00000100:00100000:2.0:1762166978.777045:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450542848 00000100:00100000:1.0:1762166978.777077:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450542720 00000100:00100000:1.0:1762166978.777090:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450542720 00000100:00100000:2.0:1762166978.777096:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19097 00000100:00100000:2.0:1762166978.777109:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450542848:12345-192.168.204.38@tcp:2:lfs.0 00000100:00100000:1.0:1762166978.777153:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19098 00000100:00100000:1.0:1762166978.777166:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+14:2419:x1847765450542720:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:2.0:1762166978.777234:0:8382:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa8b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166978.777240:0:8382:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa8b:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166978.777243:0:8382:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa8b:0x0] updating lvb atime from disk: 0 -> 1762166978 00002000:00010000:2.0:1762166978.777246:0:8382:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa8b:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166978.777249:0:8382:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa8b:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1762166978.777300:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450542848:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 193us (317us total) trans 17179876492 rc 0/0 00000100:00100000:2.0:1762166978.777309:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19097 00000100:00100000:1.0:1762166978.777342:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+15:2419:x1847765450542720:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 178us (325us total) trans 21474843349 rc 0/0 00000100:00100000:1.0:1762166978.777348:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19098 00000100:00100000:1.0:1762166978.778475:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.778547:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450543104 00000100:00100000:0.0:1762166978.778556:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450543104 00000100:00100000:0.0:1762166978.778604:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30578 00000100:00100000:0.0:1762166978.778615:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+531:61858:x1847765450543104:12345-192.168.204.38@tcp:55:lfs.0 00010000:00010000:0.0:1762166978.778685:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbab6ae lrc: 3/0,1 mode: --/PW res: [0x240000404:0x611:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166978.778701:0:6495:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbab637 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x611:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea08d expref: 531 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.778716:0:6495:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbab6ae lrc: 4/0,1 mode: --/PW res: [0x240000404:0x611:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.778756:0:6495:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbab637 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x611:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea08d expref: 531 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.778771:0:6495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbab637 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x611:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea08d expref: 531 pid: 6495 timeout: 697 lvb_type: 0 00000100:00100000:0.0:1762166978.778789:0:6495:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1ddc700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6495:1847765449737344:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166978.778894:0:6495:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1c8dc00 going to sleep for 11 seconds 00000100:00100000:2.0:1762166978.779770:0:6495:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1ddc700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6495:1847765449737344:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166978.779786:0:6495:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbab6ae lrc: 3/0,1 mode: --/PW res: [0x240000404:0x611:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000100:00100000:1.0:1762166978.780057:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.780302:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450543232 00000100:00100000:0.0:1762166978.780308:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450543232 00010000:00010000:0.0:1762166978.780352:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbab637 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x611:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea08d expref: 532 pid: 6495 timeout: 697 lvb_type: 0 00000100:00100000:0.0:1762166978.780393:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9644 00000100:00100000:0.0:1762166978.780402:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+532:2419:x1847765450543232:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166978.780416:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166978.780424:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbab637 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x611:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea08d expref: 532 pid: 6495 timeout: 697 lvb_type: 0 00010000:00010000:0.0:1762166978.780436:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbab637 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x611:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea08d expref: 532 pid: 6495 timeout: 697 lvb_type: 0 00010000:00010000:0.0:1762166978.780460:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbab637 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x611:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea08d expref: 532 pid: 6495 timeout: 697 lvb_type: 0 00010000:00010000:0.0:1762166978.780513:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x611:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:0.0:1762166978.780518:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbab6ae lrc: 3/0,1 mode: --/PW res: [0x240000404:0x611:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.780527:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbab6ae lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x611:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.780536:0:6479:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbab6ae lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x611:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.780562:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166978.780592:0:6495:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbab6ae lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x611:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.780606:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbab6ae lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x611:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000100:00100000:0.0:1762166978.780615:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+531:2419:x1847765450543232:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 210us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166978.780626:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9644 00010000:00010000:2.0:1762166978.780648:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbab6ae lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x611:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.780657:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbab6ae lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x611:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.780664:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbab6ae lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x611:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.780671:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bde000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166978.780676:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbab6ae lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x611:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.780684:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbab6ae lrc: 4/0,0 mode: PW/PW res: [0x240000404:0x611:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.780702:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x611:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166978.780707:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1762166978.780711:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbab6ae lrc: 2/0,0 mode: --/PW res: [0x240000404:0x611:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.780716:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbab6ae lrc: 0/0,0 mode: --/PW res: [0x240000404:0x611:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000100:00100000:2.0:1762166978.780805:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+530:61858:x1847765450543104:12345-192.168.204.38@tcp:55:lfs.0 Request processed in 2190us (2330us total) trans 0 rc -22/-22 00000100:00100000:2.0:1762166978.780816:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30578 00000100:00100000:1.0:1762166978.781733:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.781772:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450543488 00000100:00100000:2.0:1762166978.781780:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450543488 00000100:00100000:2.0:1762166978.781830:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30579 00000100:00100000:2.0:1762166978.781839:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7c70850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+530:61858:x1847765450543488:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:2.0:1762166978.781900:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166978.781918:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42f6200/0x2f180c4effbab581 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea040 expref: 530 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.781930:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:2.0:1762166978.781934:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166978.781973:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc606fc00/0x2f180c4effbab6b5 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166978.781984:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc606fc00/0x2f180c4effbab6b5 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.781993:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc606fc00/0x2f180c4effbab6b5 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00010000:2.0:1762166978.782097:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000180437d9 reply state 000000007ca69c11 transno 4294992197 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc606fc00/0x2f180c4effbab6b5 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.782113:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc606fc00/0x2f180c4effbab6b5 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166978.782120:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:2.0:1762166978.782123:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166978.782126:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166978.782187:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7c70850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+531:61858:x1847765450543488:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 349us (454us total) trans 4294992197 rc 0/0 00000100:00100000:2.0:1762166978.782194:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30579 00000100:00100000:0.0:1762166978.783415:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.783511:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450543616 00000100:00100000:1.0:1762166978.783521:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450543616 00000100:00100000:1.0:1762166978.783584:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19099 00000100:00100000:1.0:1762166978.783601:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1dddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+18:61858:x1847765450543616:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166978.783621:0:28874:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166978.783638:0:28874:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cc355a000/0x2f180c4effbab6bc lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea0a9 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.783667:0:28874:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc606e800/0x2f180c4effbab61b lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea078 expref: 19 pid: 8382 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166978.783676:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166978.783679:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166978.783684:0:28874:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355a000/0x2f180c4effbab6bc lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0a9 expref: 19 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.783728:0:28874:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc606e800/0x2f180c4effbab61b lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea078 expref: 19 pid: 8382 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166978.783744:0:28874:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc606e800/0x2f180c4effbab61b lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea078 expref: 19 pid: 8382 timeout: 697 lvb_type: 1 00000100:00100000:1.0:1762166978.783760:0:28874:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28874:1847765449737472:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166978.783874:0:28874:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccac369c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166978.784898:0:28874:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28874:1847765449737472:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166978.784924:0:28874:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945cc355a000/0x2f180c4effbab6bc lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0a9 expref: 19 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.784940:0:28874:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355a000, rc 0) 00000100:00100000:1.0:1762166978.784989:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1dddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+19:61858:x1847765450543616:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1395us (1582us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166978.784997:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19099 00000100:00100000:0.0:1762166978.785033:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.785070:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450543744 00000100:00100000:1.0:1762166978.785074:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450543744 00010000:00010000:1.0:1762166978.785092:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc606e800/0x2f180c4effbab61b lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea078 expref: 19 pid: 8382 timeout: 697 lvb_type: 1 00000100:00100000:1.0:1762166978.785126:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9645 00000100:00100000:1.0:1762166978.785135:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1dde300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450543744:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166978.785147:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166978.785172:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc606e800/0x2f180c4effbab61b lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea078 expref: 19 pid: 8382 timeout: 697 lvb_type: 1 00010000:00010000:1.0:1762166978.785185:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc606e800/0x2f180c4effbab61b lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea078 expref: 19 pid: 8382 timeout: 697 lvb_type: 1 00010000:00010000:1.0:1762166978.785205:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc606e800/0x2f180c4effbab61b lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea078 expref: 19 pid: 8382 timeout: 697 lvb_type: 1 00010000:00010000:1.0:1762166978.785215:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166978.785217:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166978.785224:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945cc355a000/0x2f180c4effbab6bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0a9 expref: 18 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.785231:0:6479:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355a000/0x2f180c4effbab6bc lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0a9 expref: 18 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.785255:0:6479:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff945cc355a000/0x2f180c4effbab6bc lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0a9 expref: 18 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166978.785263:0:6479:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6479:1847765449737600:192.168.204.38@tcp:105: 00000100:00100000:1.0:1762166978.785297:0:6479:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccac369c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166978.786227:0:6479:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6479:1847765449737600:192.168.204.38@tcp:105: 00010000:00010000:1.0:1762166978.786242:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166978.786282:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1dde300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450543744:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1148us (1250us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166978.786291:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9645 00000100:00100000:0.0:1762166978.786501:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.786605:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450543872 00000100:00100000:1.0:1762166978.786611:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450543872 00000100:00100000:1.0:1762166978.786650:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19100 00000100:00100000:1.0:1762166978.786658:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+15:61858:x1847765450543872:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166978.786673:0:28874:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166978.786690:0:28874:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cc355ba00/0x2f180c4effbab6c3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea0b0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.786713:0:28874:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde600/0x2f180c4effbab629 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea07f expref: 16 pid: 35247 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166978.786720:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166978.786723:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166978.786727:0:28874:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cc355ba00/0x2f180c4effbab6c3 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0b0 expref: 16 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.786759:0:28874:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde600/0x2f180c4effbab629 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea07f expref: 16 pid: 35247 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166978.786773:0:28874:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde600/0x2f180c4effbab629 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea07f expref: 16 pid: 35247 timeout: 697 lvb_type: 1 00000100:00100000:1.0:1762166978.786786:0:28874:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28874:1847765449737728:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166978.786835:0:28874:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccac369c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166978.787870:0:28874:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28874:1847765449737728:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166978.787907:0:28874:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945cc355ba00/0x2f180c4effbab6c3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0b0 expref: 16 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.787941:0:28874:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355ba00, rc 0) 00000100:00100000:1.0:1762166978.788013:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+16:61858:x1847765450543872:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1353us (1533us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166978.788022:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19100 00000100:00100000:0.0:1762166978.788069:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.788117:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450544000 00000100:00100000:1.0:1762166978.788126:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450544000 00010000:00010000:1.0:1762166978.788154:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde600/0x2f180c4effbab629 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea07f expref: 16 pid: 35247 timeout: 697 lvb_type: 1 00000100:00100000:1.0:1762166978.788187:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9646 00000100:00100000:1.0:1762166978.788198:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+16:2418:x1847765450544000:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166978.788227:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166978.788248:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde600/0x2f180c4effbab629 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea07f expref: 16 pid: 35247 timeout: 697 lvb_type: 1 00010000:00010000:1.0:1762166978.788261:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde600/0x2f180c4effbab629 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea07f expref: 16 pid: 35247 timeout: 697 lvb_type: 1 00010000:00010000:1.0:1762166978.788288:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde600/0x2f180c4effbab629 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea07f expref: 16 pid: 35247 timeout: 697 lvb_type: 1 00010000:00010000:1.0:1762166978.788301:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166978.788303:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166978.788310:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945cc355ba00/0x2f180c4effbab6c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0b0 expref: 15 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.788321:0:6479:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cc355ba00/0x2f180c4effbab6c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0b0 expref: 15 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.788352:0:6479:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff945cc355ba00/0x2f180c4effbab6c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0b0 expref: 15 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166978.788366:0:6479:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6479:1847765449737856:192.168.204.38@tcp:105: 00000100:00100000:1.0:1762166978.788438:0:6479:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccac369c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166978.789863:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.790145:0:6479:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6479:1847765449737856:192.168.204.38@tcp:105: 00010000:00010000:1.0:1762166978.790159:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166978.790205:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+15:2418:x1847765450544000:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 2009us (2143us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166978.790215:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9646 00000100:00100000:2.0:1762166978.790410:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450544128 00000100:00100000:2.0:1762166978.790417:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450544128 00000100:00100000:2.0:1762166978.790462:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19101 00000100:00100000:2.0:1762166978.790471:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1dde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+18:61858:x1847765450544128:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166978.790510:0:28874:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166978.790526:0:28874:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bca743200/0x2f180c4effbab6ca lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea0b7 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.790549:0:28874:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945cc355aa00/0x2f180c4effbab622 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea086 expref: 19 pid: 9165 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166978.790557:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166978.790559:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166978.790563:0:28874:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bca743200/0x2f180c4effbab6ca lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0b7 expref: 19 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.790600:0:28874:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945cc355aa00/0x2f180c4effbab622 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea086 expref: 19 pid: 9165 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166978.790618:0:28874:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945cc355aa00/0x2f180c4effbab622 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea086 expref: 19 pid: 9165 timeout: 697 lvb_type: 1 00000100:00100000:2.0:1762166978.790631:0:28874:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55df480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28874:1847765449737984:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166978.790676:0:28874:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc63990c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166978.791979:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.791993:0:28874:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55df480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28874:1847765449737984:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166978.792016:0:28874:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bca743200/0x2f180c4effbab6ca lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0b7 expref: 19 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.792030:0:28874:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bca743200, rc 0) 00000100:00100000:2.0:1762166978.792070:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1dde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+19:61858:x1847765450544128:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1600us (2220us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166978.792078:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19101 00000100:00100000:1.0:1762166978.792112:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450544256 00000100:00100000:1.0:1762166978.792117:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450544256 00010000:00010000:1.0:1762166978.792134:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355aa00/0x2f180c4effbab622 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea086 expref: 19 pid: 9165 timeout: 697 lvb_type: 1 00000100:00100000:1.0:1762166978.792156:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9647 00000100:00100000:1.0:1762166978.792162:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450544256:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166978.792169:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166978.792184:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945cc355aa00/0x2f180c4effbab622 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea086 expref: 19 pid: 9165 timeout: 697 lvb_type: 1 00010000:00010000:1.0:1762166978.792193:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945cc355aa00/0x2f180c4effbab622 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea086 expref: 19 pid: 9165 timeout: 697 lvb_type: 1 00010000:00010000:1.0:1762166978.792209:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cc355aa00/0x2f180c4effbab622 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea086 expref: 19 pid: 9165 timeout: 697 lvb_type: 1 00010000:00010000:1.0:1762166978.792218:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166978.792219:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166978.792224:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bca743200/0x2f180c4effbab6ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0b7 expref: 18 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.792231:0:6479:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bca743200/0x2f180c4effbab6ca lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0b7 expref: 18 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.792251:0:6479:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff945bca743200/0x2f180c4effbab6ca lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0b7 expref: 18 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166978.792258:0:6479:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6479:1847765449738112:192.168.204.38@tcp:105: 00000100:00100000:1.0:1762166978.792290:0:6479:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccac369c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166978.794007:0:6479:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6479:1847765449738112:192.168.204.38@tcp:105: 00010000:00010000:1.0:1762166978.794044:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166978.794182:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450544256:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 2012us (2197us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166978.794206:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9647 00000100:00100000:0.0:1762166978.794213:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.794310:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.794342:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166978.794372:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450544384 00000100:00100000:3.0:1762166978.794381:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450544384 00000100:00100000:1.0:1762166978.794424:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450544512 00000100:00100000:1.0:1762166978.794433:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450544512 00000100:00100000:2.0:1762166978.794444:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450544640 00000100:00100000:2.0:1762166978.794451:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450544640 00000100:00100000:1.0:1762166978.794502:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19102 00000100:00100000:1.0:1762166978.794515:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450544384:12345-192.168.204.38@tcp:2:lfs.0 00000100:00100000:0.0:1762166978.794538:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19103 00000100:00100000:3.0:1762166978.794547:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19104 00000100:00100000:0.0:1762166978.794553:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+15:2418:x1847765450544512:12345-192.168.204.38@tcp:2:lfs.0 00000100:00100000:3.0:1762166978.794556:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450544640:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:1.0:1762166978.794692:0:35247:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 232857 -> 232857 00002000:00010000:1.0:1762166978.794698:0:35247:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:1.0:1762166978.794701:0:35247:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:1.0:1762166978.794705:0:35247:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166978 -> 1762166979 00002000:00010000:1.0:1762166978.794709:0:35247:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 296 -> 296 00002000:00010000:2.0:1762166978.794714:0:28874:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166978.794719:0:28874:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166978.794724:0:28874:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166978.794727:0:28874:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166978 -> 1762166979 00002000:00010000:2.0:1762166978.794730:0:28874:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:0.0:1762166978.794742:0:35472:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166978.794747:0:35472:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:0.0:1762166978.794751:0:35472:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:0.0:1762166978.794754:0:35472:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166978 -> 1762166979 00002000:00010000:0.0:1762166978.794757:0:35472:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00000100:00100000:1.0:1762166978.794782:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450544384:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 268us (582us total) trans 17179876493 rc 0/0 00000100:00100000:2.0:1762166978.794790:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450544640:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 231us (442us total) trans 17179876494 rc 0/0 00000100:00100000:1.0:1762166978.794798:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19102 00000100:00100000:2.0:1762166978.794808:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19104 00000100:00100000:0.0:1762166978.794808:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+16:2418:x1847765450544512:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 252us (491us total) trans 21474843350 rc 0/0 00000100:00100000:0.0:1762166978.794827:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19103 00000100:00100000:2.0:1762166978.796402:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.796629:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450544896 00000100:00100000:0.0:1762166978.796640:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450544896 00000100:00100000:0.0:1762166978.796696:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11885 00000100:00100000:0.0:1762166978.796708:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+531:61858:x1847765450544896:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:0.0:1762166978.796793:0:6497:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x240000404:0x5eb:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbab5f8 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea071 expref: 531 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.796833:0:6497:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbab6d1 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 00010000:00010000:0.0:1762166978.796844:0:6497:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbab4cb lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea008 expref: 531 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.796850:0:6497:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbab503 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea016 expref: 531 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.796868:0:6497:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbab6d1 lrc: 5/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166978.796900:0:6497:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbab503 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea016 expref: 531 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.796912:0:6497:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbab503 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea016 expref: 531 pid: 6495 timeout: 697 lvb_type: 0 00000100:00100000:0.0:1762166978.796926:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1ddf100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6497:1847765449738240:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166978.797016:0:6497:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbab4cb lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea008 expref: 531 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.797022:0:6497:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbab4cb lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea008 expref: 531 pid: 6495 timeout: 697 lvb_type: 0 00000100:00100000:0.0:1762166978.797029:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1ddfb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6497:1847765449738368:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166978.797052:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1c8df00 going to sleep for 11 seconds 00000100:00100000:0.0:1762166978.798332:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1ddf100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6497:1847765449738240:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166978.798353:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1ddfb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6497:1847765449738368:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166978.798387:0:6497:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbab6d1 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00000100:00100000:2.0:1762166978.798586:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.798663:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450545024 00000100:00100000:1.0:1762166978.798672:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450545024 00010000:00010000:1.0:1762166978.798751:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbab4cb lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea008 expref: 532 pid: 6495 timeout: 697 lvb_type: 0 00000100:00100000:1.0:1762166978.798792:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9648 00000100:00100000:1.0:1762166978.798802:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+532:2419:x1847765450545024:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166978.798818:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166978.798826:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbab4cb lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea008 expref: 532 pid: 6495 timeout: 697 lvb_type: 0 00010000:00010000:1.0:1762166978.798837:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbab4cb lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea008 expref: 532 pid: 6495 timeout: 697 lvb_type: 0 00010000:00010000:1.0:1762166978.798870:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbab4cb lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea008 expref: 532 pid: 6495 timeout: 697 lvb_type: 0 00010000:00010000:1.0:1762166978.798887:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:1.0:1762166978.798892:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbab6d1 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166978.798900:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbab6d1 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166978.798905:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166978.798954:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+531:2419:x1847765450545024:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 154us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166978.798961:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9648 00000100:00100000:2.0:1762166978.799177:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.799225:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450545152 00000100:00100000:1.0:1762166978.799230:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450545152 00010000:00010000:1.0:1762166978.799247:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbab503 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea016 expref: 531 pid: 6495 timeout: 697 lvb_type: 0 00000100:00100000:1.0:1762166978.799282:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9649 00000100:00100000:1.0:1762166978.799290:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+531:2419:x1847765450545152:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166978.799298:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166978.799304:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbab503 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea016 expref: 531 pid: 6495 timeout: 697 lvb_type: 0 00010000:00010000:1.0:1762166978.799320:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbab503 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea016 expref: 531 pid: 6495 timeout: 697 lvb_type: 0 00010000:00010000:1.0:1762166978.799337:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbab503 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea016 expref: 531 pid: 6495 timeout: 697 lvb_type: 0 00010000:00010000:1.0:1762166978.799349:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:1.0:1762166978.799353:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbab6d1 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166978.799361:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbab6d1 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166978.799370:0:6479:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbab6d1 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166978.799406:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166978.799437:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+530:2419:x1847765450545152:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 148us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166978.799445:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9649 00010000:00010000:0.0:1762166978.799513:0:6497:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbab6d1 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166978.799525:0:6497:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbab6d1 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166978.799553:0:6497:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbab6d8 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x611:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 00010000:00010000:0.0:1762166978.799570:0:6497:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc606ee00/0x2f180c4effbab645 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x611:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea094 expref: 529 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.799579:0:6497:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbab6d8 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x611:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166978.799621:0:6497:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc606ee00/0x2f180c4effbab645 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x611:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea094 expref: 529 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.799644:0:6497:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc606ee00/0x2f180c4effbab645 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x611:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea094 expref: 529 pid: 6494 timeout: 697 lvb_type: 0 00000100:00100000:0.0:1762166978.799660:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1ddfb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6497:1847765449738496:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166978.799741:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1c8df00 going to sleep for 11 seconds 00000100:00100000:2.0:1762166978.801008:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.801016:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1ddfb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6497:1847765449738496:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166978.801046:0:6497:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbab6d8 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x611:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00000100:00100000:1.0:1762166978.801103:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450545280 00000100:00100000:1.0:1762166978.801112:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450545280 00010000:00010000:1.0:1762166978.801138:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc606ee00/0x2f180c4effbab645 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x611:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea094 expref: 530 pid: 6494 timeout: 697 lvb_type: 0 00000100:00100000:1.0:1762166978.801171:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9650 00000100:00100000:1.0:1762166978.801180:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7c31450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+530:2419:x1847765450545280:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166978.801191:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166978.801197:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc606ee00/0x2f180c4effbab645 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x611:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea094 expref: 530 pid: 6494 timeout: 697 lvb_type: 0 00010000:00010000:1.0:1762166978.801210:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc606ee00/0x2f180c4effbab645 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x611:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea094 expref: 530 pid: 6494 timeout: 697 lvb_type: 0 00010000:00010000:1.0:1762166978.801229:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc606ee00/0x2f180c4effbab645 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x611:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea094 expref: 530 pid: 6494 timeout: 697 lvb_type: 0 00010000:00010000:1.0:1762166978.801243:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x611:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:1.0:1762166978.801247:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbab6d8 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x611:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166978.801256:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbab6d8 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x611:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166978.801263:0:6479:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbab6d8 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x611:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166978.801299:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166978.801357:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7c31450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+529:2419:x1847765450545280:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 178us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166978.801365:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9650 00010000:00010000:0.0:1762166978.801461:0:6497:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbab6d8 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x611:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166978.801469:0:6497:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbab6d8 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x611:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00000100:00100000:0.0:1762166978.801822:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1ddfb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449738624:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762166978.801874:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166978.801901:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1c8d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166978.801970:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449738624 00000100:00100000:3.0:1762166978.801975:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449738624 00000100:00100000:3.0:1762166978.802010:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1383 00000100:00100000:3.0:1762166978.802017:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:6497:x1847765449738624:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166978.802094:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:6497:x1847765449738624:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 77us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166978.802101:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1383 00000100:00100000:0.0:1762166978.802129:0:6497:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 17179876491 gen 2 00000004:00080000:0.0:1762166978.802135:0:6497:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf1cd0380, transno 17179876491 00000100:00100000:0.0:1762166978.802157:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1ddfb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449738624:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762166978.802204:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1ddfb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449738752:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762166978.802230:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166978.802255:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1c8d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166978.802278:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449738752 00000100:00100000:3.0:1762166978.802283:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449738752 00000100:00100000:3.0:1762166978.802309:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1384 00000100:00100000:3.0:1762166978.802316:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1dde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:6497:x1847765449738752:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166978.802385:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1dde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:6497:x1847765449738752:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 69us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166978.802392:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1384 00000100:00100000:0.0:1762166978.802429:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1ddfb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449738752:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762166978.802472:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1ddfb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449738880:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762166978.802532:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166978.802555:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1c8da80 going to sleep for 11 seconds 00000100:00100000:3.0:1762166978.802582:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449738880 00000100:00100000:3.0:1762166978.802590:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449738880 00000100:00100000:3.0:1762166978.802617:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1385 00000100:00100000:3.0:1762166978.802625:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:6497:x1847765449738880:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166978.802679:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:6497:x1847765449738880:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 55us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166978.802687:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1385 00000100:00100000:0.0:1762166978.802709:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1ddfb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449738880:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762166978.802757:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1ddfb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449739008:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762166978.802780:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166978.802806:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1c8dc00 going to sleep for 11 seconds 00000100:00100000:3.0:1762166978.802832:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449739008 00000100:00100000:3.0:1762166978.802838:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449739008 00000100:00100000:3.0:1762166978.802876:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1386 00000100:00100000:3.0:1762166978.802885:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:6497:x1847765449739008:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166978.802958:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:6497:x1847765449739008:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 75us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166978.802965:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1386 00000100:00100000:0.0:1762166978.803009:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1ddfb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449739008:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762166978.803542:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1ddfb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449739136:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762166978.803603:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166978.803641:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cee083e40 going to sleep for 11 seconds 00000100:00100000:3.0:1762166978.803737:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449739136 00000100:00100000:3.0:1762166978.803744:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449739136 00000100:00100000:3.0:1762166978.803794:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1387 00000100:00100000:3.0:1762166978.803803:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc59d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:6497:x1847765449739136:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166978.803907:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc59d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:6497:x1847765449739136:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 105us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166978.803919:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1387 00000100:00100000:0.0:1762166978.803948:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1ddfb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449739136:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762166978.804004:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc59d7480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449739264:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762166978.804027:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166978.804050:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cee083780 going to sleep for 11 seconds 00000100:00100000:3.0:1762166978.804085:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449739264 00000100:00100000:3.0:1762166978.804090:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449739264 00000100:00100000:3.0:1762166978.804115:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1388 00000100:00100000:3.0:1762166978.804121:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc59d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:6497:x1847765449739264:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166978.804180:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc59d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:6497:x1847765449739264:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 59us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166978.804188:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1388 00000100:00100000:0.0:1762166978.804208:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc59d7480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449739264:0@lo:1000:mdt_rdpg00_000.0 00000040:00080000:0.0:1762166978.804382:0:6497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x2:0x0].52, 456 off67744 00000001:00080000:0.0:1762166978.804391:0:6497:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992198 00000100:00100000:0.0:1762166978.804449:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc59d7480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449739392:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762166978.804473:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166978.804519:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1c8d240 going to sleep for 11 seconds 00000100:00100000:3.0:1762166978.804523:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449739392 00000100:00100000:3.0:1762166978.804528:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449739392 00000100:00100000:3.0:1762166978.804556:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1389 00000100:00100000:3.0:1762166978.804561:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc59d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:6497:x1847765449739392:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166978.804664:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc59d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:6497:x1847765449739392:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 101us (188us total) trans 17179876495 rc 0/0 00000100:00100000:3.0:1762166978.804671:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1389 00000100:00100000:0.0:1762166978.804700:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc59d7480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449739392:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762166978.804723:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc59d5f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449739520:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762166978.804747:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166978.804766:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cee083e40 going to sleep for 11 seconds 00000100:00100000:3.0:1762166978.804783:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449739520 00000100:00100000:3.0:1762166978.804787:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449739520 00000100:00100000:3.0:1762166978.804819:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1390 00000100:00100000:3.0:1762166978.804824:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc59d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:6497:x1847765449739520:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166978.804927:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc59d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:6497:x1847765449739520:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 103us (179us total) trans 21474843351 rc 0/0 00000100:00100000:3.0:1762166978.804935:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1390 00000100:00100000:0.0:1762166978.804961:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc59d5f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449739520:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1762166978.805016:0:6497:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992199 00010000:00010000:0.0:1762166978.805043:0:6497:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbab6d8 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x611:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166978.805052:0:6497:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbab6d8 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x611:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166978.805060:0:6497:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbab6d8 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x611:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166978.805067:0:6497:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdf800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166978.805072:0:6497:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbab6d8 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x611:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166978.805080:0:6497:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbab6d8 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x611:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166978.805100:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x611:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:0.0:1762166978.805104:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166978.805109:0:6497:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbab6d8 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x611:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166978.805116:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbab6d8 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x611:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166978.805131:0:6497:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbab6d1 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166978.805142:0:6497:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbab6d1 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166978.805147:0:6497:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbab6d1 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166978.805152:0:6497:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bde800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166978.805155:0:6497:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbab6d1 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166978.805160:0:6497:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbab6d1 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166978.805167:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:0.0:1762166978.805170:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166978.805172:0:6497:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbab6d1 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166978.805177:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbab6d1 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166978.805188:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:0.0:1762166978.805190:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166978.805197:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbab5f8 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea071 expref: 531 pid: 6495 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166978.805300:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+530:61858:x1847765450544896:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 8595us (8903us total) trans 4294992200 rc 0/0 00000100:00100000:0.0:1762166978.805309:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11885 00000020:00080000:0.0:1762166978.805314:0:6497:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1762166978.807867:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.807983:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450545408 00000100:00100000:0.0:1762166978.808001:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450545408 00000100:00100000:0.0:1762166978.808080:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30580 00000100:00100000:0.0:1762166978.808093:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+530:61858:x1847765450545408:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166978.808126:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166978.808154:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbab6df lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea0be expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.808224:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbab6df lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0be expref: 531 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.808240:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbab6df lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0be expref: 531 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.808259:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:0.0:1762166978.808262:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166978.808266:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bde600, rc 0) 00000100:00100000:0.0:1762166978.808337:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+531:61858:x1847765450545408:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 246us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166978.808345:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30580 00000100:00100000:3.0:1762166978.810420:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.810516:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450545664 00000100:00100000:0.0:1762166978.810527:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450545664 00000100:00100000:0.0:1762166978.810599:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11886 00000100:00100000:0.0:1762166978.810612:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+531:61858:x1847765450545664:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166978.810909:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+532:61858:x1847765450545664:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 300us (498us total) trans 4294992201 rc 0/0 00000100:00100000:0.0:1762166978.810918:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11886 00000100:00100000:2.0:1762166978.811933:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.811975:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450545920 00000100:00100000:0.0:1762166978.811983:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450545920 00000100:00100000:0.0:1762166978.812015:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11887 00000100:00100000:0.0:1762166978.812020:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+532:61858:x1847765450545920:12345-192.168.204.38@tcp:35:lfs.0 00000004:00080000:0.0:1762166978.812163:0:6497:0:(mdd_object.c:3965:mdd_close()) Object [0x240000404:0x611:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:0.0:1762166978.812246:0:6497:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbab6e6 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x611:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 00010000:00010000:0.0:1762166978.812267:0:6497:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbab6e6 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x611:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166978.812281:0:6497:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbab6e6 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x611:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166978.812298:0:6497:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbab6e6 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x611:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166978.812305:0:6497:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbab6e6 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x611:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166978.812311:0:6497:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbab6e6 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x611:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166978.812351:0:6497:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1762166978.812390:0:10257:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1762166978.812400:0:10257:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbab6e6 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x611:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6497 initiator: MDT1 00010000:00010000:3.0:1762166978.812408:0:10257:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdf200 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166978.812414:0:10257:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbab6e6 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x611:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6497 initiator: MDT1 00010000:00010000:3.0:1762166978.812424:0:10257:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbab6e6 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x611:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6497 initiator: MDT1 00010000:00010000:3.0:1762166978.812440:0:10257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x611:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:3.0:1762166978.812444:0:10257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1762166978.812450:0:10257:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbab6e6 lrc: 1/0,0 mode: --/PW res: [0x240000404:0x611:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6497 initiator: MDT1 00010000:00010000:3.0:1762166978.812456:0:10257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbab6e6 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x611:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6497 initiator: MDT1 00010000:00010000:3.0:1762166978.812472:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166978.812474:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166978.812540:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166978.812637:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+533:61858:x1847765450545920:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 609us (699us total) trans 4294992202 rc 0/0 00000100:00100000:0.0:1762166978.812647:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11887 00000100:00100000:2.0:1762166978.824841:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.824965:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450546048 00000100:00100000:0.0:1762166978.824976:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450546048 00000100:00100000:0.0:1762166978.825032:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30581 00000100:00100000:0.0:1762166978.825042:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+533:61859:x1847765450546048:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166978.825066:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166978.825090:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbab6ed lrc: 2/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea0c5 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.825159:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbab6f4 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166978.825172:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbab6f4 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.825183:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbab6f4 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.825195:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbab6fb lrc: 3/1,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166978.825201:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbab6fb lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.825207:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbab6fb lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.825281:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbab702 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:0.0:1762166978.825290:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbab702 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.825297:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbab702 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:0.0:1762166978.825336:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 232857 00000004:00200000:0.0:1762166978.825340:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166978.825356:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbab702 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.825367:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbab702 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.825376:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbab6f4 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.825382:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbab6f4 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.825389:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbab6f4 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.825395:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbab6f4 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.825401:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bde800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166978.825405:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbab6f4 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.825412:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbab6f4 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.825422:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0x0 (ffff945bc4afef00) 00010000:00010000:0.0:1762166978.825425:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166978.825429:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbab6f4 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.825434:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbab6f4 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.825447:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbab6fb lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.825451:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbab6fb lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.825456:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbab6fb lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.825461:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdf800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166978.825463:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbab6fb lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.825468:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbab6fb lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.825474:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0xdd396665 (ffff945bc4afeb00) 00010000:00010000:0.0:1762166978.825528:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166978.825532:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbab6fb lrc: 2/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.825538:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbab6fb lrc: 0/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166978.825573:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbab6ed lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0c5 expref: 535 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.825590:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbab702 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0c5 expref: 534 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.825598:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:0.0:1762166978.825601:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166978.825603:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bde400, rc 0) 00000100:00100000:0.0:1762166978.825680:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+534:61859:x1847765450546048:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 639us (849us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166978.825687:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30581 00000100:00100000:3.0:1762166978.827865:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.827921:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450546304 00000100:00100000:2.0:1762166978.827938:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450546304 00000100:00100000:2.0:1762166978.827988:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30582 00000100:00100000:2.0:1762166978.827997:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+534:61859:x1847765450546304:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166978.828011:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166978.828026:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4a14000/0x2f180c4effbab709 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea0cc expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.828101:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42f6200/0x2f180c4effbab710 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166978.828113:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42f6200/0x2f180c4effbab710 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166978.828123:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42f6200/0x2f180c4effbab710 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:2.0:1762166978.828132:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 232857 00010000:00010000:2.0:1762166978.828239:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4a14000/0x2f180c4effbab709 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0cc expref: 537 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.828255:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42f6200/0x2f180c4effbab710 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0cc expref: 536 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.828267:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:2.0:1762166978.828270:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1762166978.828273:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc42f6200, rc 0) 00000100:00100000:2.0:1762166978.828326:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+536:61859:x1847765450546304:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 330us (478us total) trans 4294992203 rc 0/0 00000100:00100000:2.0:1762166978.828334:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30582 00000100:00100000:1.0:1762166978.828689:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166978.828802:0:32222:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450546432 00000100:00100000:3.0:1762166978.828808:0:32222:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450546432 00000100:00100000:1.0:1762166978.828819:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.828887:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450546560 00000100:00100000:2.0:1762166978.828892:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450546560 00000100:00080000:0.0:1762166978.828934:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1762166978.828942:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 662 00000100:00100000:3.0:1762166978.828951:0:32222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 130 00000100:00100000:2.0:1762166978.828956:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+24:2416:x1847765450546560:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:3.0:1762166978.828964:0:32222:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc34e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc359222-7391-43f5-989b-bf5867ae8fd6+9:2417:x1847765450546432:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1762166978.829009:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+24:2416:x1847765450546560:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 57us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166978.829011:0:32222:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc34e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc359222-7391-43f5-989b-bf5867ae8fd6+9:2417:x1847765450546432:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 50us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166978.829026:0:32222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 130 00000100:00100000:2.0:1762166978.829026:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 662 00000100:00100000:0.0:1762166978.830544:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.830574:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450546816 00000100:00100000:2.0:1762166978.830578:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450546816 00000100:00100000:2.0:1762166978.830613:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30583 00000100:00100000:2.0:1762166978.830621:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc59d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+536:61859:x1847765450546816:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166978.830635:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166978.830649:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbab71e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea0d3 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.830722:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbab725 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166978.830734:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbab725 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166978.830748:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbab725 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:2.0:1762166978.830757:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 232857 00010000:00010000:2.0:1762166978.830832:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbab71e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0d3 expref: 539 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.830844:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbab725 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0d3 expref: 538 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.830849:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:2.0:1762166978.830850:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166978.830863:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa8200, rc 0) 00000100:00100000:2.0:1762166978.830893:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc59d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+538:61859:x1847765450546816:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 275us (355us total) trans 4294992204 rc 0/0 00000100:00100000:2.0:1762166978.830898:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30583 00000100:00100000:0.0:1762166978.856936:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.857077:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450546944 00000100:00100000:2.0:1762166978.857094:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450546944 00000100:00100000:2.0:1762166978.857176:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2439 00000100:00100000:2.0:1762166978.857198:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc59d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450546944:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:2.0:1762166978.857236:0:8388:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbab733 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.857257:0:8388:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945cc355a000/0x2f180c4effbab6bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0a9 expref: 20 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.857265:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166978.857267:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166978.857270:0:8388:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbab733 lrc: 4/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->233471] (req 0->233471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.857307:0:8388:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945cc355a000/0x2f180c4effbab6bc lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0a9 expref: 20 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.857321:0:8388:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945cc355a000/0x2f180c4effbab6bc lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0a9 expref: 20 pid: 28874 timeout: 698 lvb_type: 0 00000100:00100000:2.0:1762166978.857338:0:8388:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55dc380 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:8388:1847765449739648:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166978.857457:0:8388:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc6399cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166978.859061:0:8388:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55dc380 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:8388:1847765449739648:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166978.859087:0:8388:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbab733 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->233471] (req 0->233471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166978.859660:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.859728:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450547072 00000100:00100000:1.0:1762166978.859736:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450547072 00010000:00010000:1.0:1762166978.859772:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355a000/0x2f180c4effbab6bc lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0a9 expref: 21 pid: 28874 timeout: 698 lvb_type: 0 00000100:00100000:1.0:1762166978.859806:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9651 00000100:00100000:1.0:1762166978.859815:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc59d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450547072:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166978.859832:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166978.859871:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945cc355a000/0x2f180c4effbab6bc lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0a9 expref: 21 pid: 28874 timeout: 698 lvb_type: 0 00010000:00010000:1.0:1762166978.859888:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945cc355a000/0x2f180c4effbab6bc lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0a9 expref: 21 pid: 28874 timeout: 698 lvb_type: 0 00010000:00010000:1.0:1762166978.859916:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cc355a000/0x2f180c4effbab6bc lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0a9 expref: 21 pid: 28874 timeout: 698 lvb_type: 0 00010000:00010000:1.0:1762166978.859931:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166978.859933:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166978.859937:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbab733 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->233471] (req 0->233471) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.859947:0:6479:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbab733 lrc: 4/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->233471] (req 0->233471) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.859978:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166978.860027:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc59d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450547072:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 212us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166978.860043:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9651 00010000:00010000:2.0:1762166978.860080:0:8388:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbab733 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->233471] (req 0->233471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.860090:0:8388:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbab733 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->233471] (req 0->233471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.862223:0:8388:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbab733 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->233471] (req 0->233471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.862240:0:8388:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbab733 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->233471] (req 0->233471) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.862249:0:8388:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbab733 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->233471] (req 0->233471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.862256:0:8388:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa9800 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166978.862260:0:8388:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbab733 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->233471] (req 0->233471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.862269:0:8388:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbab733 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->233471] (req 0->233471) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.862284:0:8388:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbab733 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->233471] (req 0->233471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.862290:0:8388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbab733 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->233471] (req 0->233471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166978.862367:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc59d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450546944:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 5173us (5444us total) trans 0 rc 232857/232857 00000100:00100000:2.0:1762166978.862375:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2439 00000100:00100000:1.0:1762166978.865251:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.865323:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.865362:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450547200 00000100:00100000:0.0:1762166978.865380:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450547200 00000100:00100000:2.0:1762166978.865469:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450547328 00000100:00100000:0.0:1762166978.865506:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19105 00000100:00100000:0.0:1762166978.865525:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+16:2418:x1847765450547200:12345-192.168.204.38@tcp:101:lfs.0 00000100:00100000:2.0:1762166978.865526:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450547328 00010000:00010000:0.0:1762166978.865564:0:35472:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166978.865595:0:35472:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdea00/0x2f180c4effbab73a lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea0da expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166978.865634:0:35472:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa8c:0x0] initial LVB size: 232857, mtime: 0x690888c2, atime: 0x690888c2, ctime: 0x690888c2, blocks: 0x58 00000100:00100000:2.0:1762166978.865635:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19106 00000100:00100000:2.0:1762166978.865655:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450547328:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166978.865678:0:35472:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166978.865679:0:28874:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166978.865684:0:35472:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166978.865698:0:35472:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdea00/0x2f180c4effbab73a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0da expref: 17 pid: 35472 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166978.865702:0:28874:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbab741 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa8b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea0e1 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.865747:0:35472:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdea00/0x2f180c4effbab73a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0da expref: 17 pid: 35472 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166978.865767:0:35472:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdea00, rc 0) 00000100:00100000:2.0:1762166978.865777:0:28874:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55dc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28874:1847765449739776:192.168.204.38@tcp:106: 00000100:00100000:0.0:1762166978.865873:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450547200:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 351us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166978.865885:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19105 00000100:00100000:2.0:1762166978.865897:0:28874:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc6399cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166978.867917:0:28874:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55dc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28874:1847765449739776:192.168.204.38@tcp:106: 00010000:00010000:2.0:1762166978.867960:0:28874:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbab741 lrc: 1/0,0 mode: --/PR res: [0x2c0000400:0xa8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0e1 expref: 20 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166978.867984:0:28874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbab741 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0e1 expref: 20 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166978.867999:0:28874:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa8e00, rc 0) 00000100:00100000:2.0:1762166978.868061:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450547328:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2411us (2748us total) trans 0 rc 301/301 00000100:00100000:2.0:1762166978.868070:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19106 00000100:00100000:3.0:1762166978.870611:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.870713:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450547456 00000100:00100000:2.0:1762166978.870726:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450547456 00000100:00100000:2.0:1762166978.870816:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2440 00000100:00100000:2.0:1762166978.870828:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+17:2417:x1847765450547456:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:2.0:1762166978.870885:0:8388:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9c00/0x2f180c4effbab748 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.870903:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166978.870906:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166978.870914:0:8388:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9c00/0x2f180c4effbab748 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa8c:0x0].0x0 rrc: 3 type: EXT [0->233471] (req 0->233471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.870931:0:8388:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9c00/0x2f180c4effbab748 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa8c:0x0].0x0 rrc: 3 type: EXT [0->233471] (req 0->233471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.873750:0:8388:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9c00/0x2f180c4effbab748 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa8c:0x0].0x0 rrc: 3 type: EXT [0->233471] (req 0->233471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.873783:0:8388:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9c00/0x2f180c4effbab748 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa8c:0x0].0x0 rrc: 3 type: EXT [0->233471] (req 0->233471) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.873793:0:8388:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9c00/0x2f180c4effbab748 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa8c:0x0].0x0 rrc: 3 type: EXT [0->233471] (req 0->233471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.873801:0:8388:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa9c00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166978.873808:0:8388:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9c00/0x2f180c4effbab748 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa8c:0x0].0x0 rrc: 3 type: EXT [0->233471] (req 0->233471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.873819:0:8388:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9c00/0x2f180c4effbab748 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa8c:0x0].0x0 rrc: 3 type: EXT [0->233471] (req 0->233471) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.873844:0:8388:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9c00/0x2f180c4effbab748 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa8c:0x0].0x0 rrc: 3 type: EXT [0->233471] (req 0->233471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166978.873867:0:8388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9c00/0x2f180c4effbab748 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa8c:0x0].0x0 rrc: 3 type: EXT [0->233471] (req 0->233471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166978.873983:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+17:2417:x1847765450547456:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 3152us (3378us total) trans 0 rc 232857/232857 00000100:00100000:2.0:1762166978.873997:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2440 00000100:00100000:0.0:1762166978.881389:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.881460:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450547584 00000100:00100000:1.0:1762166978.881510:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450547584 00000100:00100000:1.0:1762166978.881617:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 881 00000100:00100000:1.0:1762166978.881630:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+538:61859:x1847765450547584:12345-192.168.204.38@tcp:103:lfs.0 00010000:00010000:1.0:1762166978.881651:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166978.881689:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbab725 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0d3 expref: 538 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.881713:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:1.0:1762166978.881718:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166978.881793:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+537:61859:x1847765450547584:12345-192.168.204.38@tcp:103:lfs.0 Request processed in 166us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166978.881801:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 881 00000100:00100000:3.0:1762166978.882917:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.882995:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450547840 00000100:00100000:0.0:1762166978.883007:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450547840 00000100:00100000:0.0:1762166978.883060:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11888 00000100:00100000:0.0:1762166978.883070:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+537:61859:x1847765450547840:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166978.883287:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+538:61859:x1847765450547840:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 217us (381us total) trans 4294992205 rc 0/0 00000100:00100000:0.0:1762166978.883294:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11888 00000100:00100000:2.0:1762166978.885238:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.885303:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450548096 00000100:00100000:0.0:1762166978.885310:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450548096 00000100:00100000:0.0:1762166978.885351:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30584 00000100:00100000:0.0:1762166978.885362:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+538:61766:x1847765450548096:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:0.0:1762166978.885385:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166978.885409:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbab74f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea0e8 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.885531:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbab756 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166978.885547:0:6494:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbab702 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0c5 expref: 539 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.885556:0:6494:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbab756 lrc: 4/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166978.885589:0:6494:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbab702 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0c5 expref: 539 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.885602:0:6494:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbab702 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0c5 expref: 539 pid: 6495 timeout: 698 lvb_type: 0 00000100:00100000:0.0:1762166978.885615:0:6494:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4012d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765449739904:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166978.885688:0:6494:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cee083e40 going to sleep for 11 seconds 00000100:00100000:0.0:1762166978.886809:0:6494:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4012d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765449739904:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166978.886830:0:6494:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbab756 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000100:00100000:2.0:1762166978.886951:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.887000:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450548224 00000100:00100000:1.0:1762166978.887013:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450548224 00010000:00010000:1.0:1762166978.887057:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbab702 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0c5 expref: 540 pid: 6495 timeout: 698 lvb_type: 0 00000100:00100000:1.0:1762166978.887097:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9652 00000100:00100000:1.0:1762166978.887107:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+540:2418:x1847765450548224:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166978.887122:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166978.887129:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbab702 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0c5 expref: 540 pid: 6495 timeout: 698 lvb_type: 0 00010000:00010000:1.0:1762166978.887149:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbab702 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0c5 expref: 540 pid: 6495 timeout: 698 lvb_type: 0 00010000:00010000:1.0:1762166978.887172:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbab702 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0c5 expref: 540 pid: 6495 timeout: 698 lvb_type: 0 00010000:00010000:1.0:1762166978.887190:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:1.0:1762166978.887195:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbab756 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166978.887202:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbab756 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166978.887208:0:6479:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbab756 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166978.887235:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166978.887270:0:6494:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbab756 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166978.887281:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbab756 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000100:00100000:1.0:1762166978.887293:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+539:2418:x1847765450548224:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 185us (341us total) trans 0 rc 0/0 00000004:00200000:0.0:1762166978.887303:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 232857 00000100:00100000:1.0:1762166978.887304:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9652 00010000:00010000:0.0:1762166978.887446:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbab74f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0e8 expref: 540 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.887468:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbab756 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0e8 expref: 539 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.887509:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:0.0:1762166978.887513:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1762166978.887517:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdfc00, rc 0) 00000100:00100000:0.0:1762166978.887565:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+539:61766:x1847765450548096:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 2205us (2329us total) trans 4294992206 rc 0/0 00000100:00100000:0.0:1762166978.887575:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30584 00000100:00100000:2.0:1762166978.888882:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.888962:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450548352 00000100:00100000:0.0:1762166978.888973:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450548352 00000100:00100000:0.0:1762166978.889018:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30585 00000100:00100000:0.0:1762166978.889028:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+539:61766:x1847765450548352:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:0.0:1762166978.889057:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166978.889074:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbab764 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea0ef expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.889170:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbab76b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166978.889184:0:6494:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbab756 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0e8 expref: 540 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.889192:0:6494:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbab76b lrc: 4/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166978.889227:0:6494:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbab756 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0e8 expref: 540 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.889238:0:6494:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbab756 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0e8 expref: 540 pid: 6494 timeout: 698 lvb_type: 0 00000100:00100000:0.0:1762166978.889249:0:6494:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4012d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765449740032:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166978.889323:0:6494:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cee083780 going to sleep for 11 seconds 00000100:00100000:0.0:1762166978.890428:0:6494:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4012d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765449740032:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166978.890451:0:6494:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbab76b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000100:00100000:2.0:1762166978.890769:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.890810:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450548480 00000100:00100000:1.0:1762166978.890819:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450548480 00010000:00010000:1.0:1762166978.890866:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbab756 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0e8 expref: 541 pid: 6494 timeout: 698 lvb_type: 0 00000100:00100000:1.0:1762166978.890903:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9653 00000100:00100000:1.0:1762166978.890914:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+541:2418:x1847765450548480:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166978.890928:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166978.890935:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbab756 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0e8 expref: 541 pid: 6494 timeout: 698 lvb_type: 0 00010000:00010000:1.0:1762166978.890948:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbab756 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0e8 expref: 541 pid: 6494 timeout: 698 lvb_type: 0 00010000:00010000:1.0:1762166978.890968:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbab756 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0e8 expref: 541 pid: 6494 timeout: 698 lvb_type: 0 00010000:00010000:1.0:1762166978.890988:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:1.0:1762166978.890993:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbab76b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166978.891003:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbab76b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166978.891010:0:6479:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbab76b lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166978.891038:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166978.891066:0:6494:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbab76b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166978.891077:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbab76b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000100:00100000:1.0:1762166978.891091:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+540:2418:x1847765450548480:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 177us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166978.891101:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9653 00000004:00200000:0.0:1762166978.891124:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 232857 00000004:00200000:0.0:1762166978.891131:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166978.891157:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbab76b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166978.891197:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbab764 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0ef expref: 540 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.891214:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbab76b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0ef expref: 539 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.891223:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:0.0:1762166978.891226:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166978.891229:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdfe00, rc 0) 00000100:00100000:0.0:1762166978.891287:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+539:61766:x1847765450548352:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 2261us (2408us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166978.891296:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30585 00000100:00100000:2.0:1762166978.892657:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.892706:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450548608 00000100:00100000:0.0:1762166978.892713:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450548608 00000100:00100000:0.0:1762166978.892770:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19107 00000100:00100000:0.0:1762166978.892780:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450548608:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:0.0:1762166978.892798:0:28874:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166978.892816:0:28874:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbab772 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa8b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea0f6 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166978.892884:0:28874:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4012d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28874:1847765449740160:192.168.204.38@tcp:106: 00000100:00100000:0.0:1762166978.892958:0:28874:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cee083780 going to sleep for 11 seconds 00000100:00100000:0.0:1762166978.893802:0:28874:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4012d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28874:1847765449740160:192.168.204.38@tcp:106: 00010000:00010000:0.0:1762166978.893833:0:28874:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbab772 lrc: 1/0,0 mode: --/PR res: [0x2c0000400:0xa8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0f6 expref: 20 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166978.893873:0:28874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbab772 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0f6 expref: 20 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166978.893887:0:28874:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdf000, rc 0) 00000100:00100000:0.0:1762166978.893928:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450548608:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 1149us (1275us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166978.893936:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19107 00000100:00100000:3.0:1762166978.894911:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.894955:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450548864 00000100:00100000:0.0:1762166978.894963:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450548864 00000100:00100000:0.0:1762166978.895005:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11889 00000100:00100000:0.0:1762166978.895015:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7be3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+539:61766:x1847765450548864:12345-192.168.204.38@tcp:35:fsx.0 00000100:00100000:0.0:1762166978.895251:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7be3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+540:61766:x1847765450548864:12345-192.168.204.38@tcp:35:fsx.0 Request processed in 237us (341us total) trans 4294992207 rc 0/0 00000100:00100000:0.0:1762166978.895258:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11889 00000100:00100000:2.0:1762166978.896047:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.896086:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450549120 00000100:00100000:0.0:1762166978.896091:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450549120 00000100:00100000:0.0:1762166978.896129:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30586 00000100:00100000:0.0:1762166978.896137:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+540:61766:x1847765450549120:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:0.0:1762166978.896153:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166978.896157:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 1 00010000:00010000:0.0:1762166978.896181:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbab76b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0ef expref: 540 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.896202:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42f6200/0x2f180c4effbab710 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0cc expref: 539 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.896218:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbab6df lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0be expref: 538 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.896229:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:0.0:1762166978.896234:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166978.896247:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbab779 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea0fd expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.896294:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbab780 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166978.896308:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbab780 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166978.896320:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbab780 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000040:00080000:0.0:1762166978.896649:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5910, 88 off462856 00000004:00080000:0.0:1762166978.896658:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 598045179885ns, next at 598687976533ns, rc = 0 00000040:00080000:0.0:1762166978.896705:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5909, 88 off462856 00000004:00080000:0.0:1762166978.896711:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 598045232830ns, next at 598688050423ns, rc = 0 00000040:00080000:0.0:1762166978.896734:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5910, 88 off462944 00000004:00080000:0.0:1762166978.896739:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 598045260205ns, next at 598688050423ns, rc = 0 00000040:00080000:0.0:1762166978.896750:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5911, 88 off462944 00000004:00080000:0.0:1762166978.896754:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 598045276632ns, next at 598687976533ns, rc = 0 00000040:00080000:0.0:1762166978.896774:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5911, 88 off463032 00000004:00080000:0.0:1762166978.896781:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 598045302290ns, next at 598688050423ns, rc = 0 00000040:00080000:0.0:1762166978.896792:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5912, 88 off463032 00000004:00080000:0.0:1762166978.896797:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 598045319616ns, next at 598687976533ns, rc = 0 00000001:00080000:3.0:1762166978.898005:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294992208 is committed 00000004:00080000:3.0:1762166978.898013:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3273 committed 00000004:00080000:3.0:1762166978.898025:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3276 committed 00000004:00080000:3.0:1762166978.898039:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3272 committed 00000004:00080000:3.0:1762166978.898043:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3275 committed 00000004:00080000:3.0:1762166978.898046:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3274 committed 00010000:00010000:1.0:1762166978.898047:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bca743600/0x2f180c4effbab6a7 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x611:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00000004:00080000:3.0:1762166978.898050:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3271 committed 00010000:00010000:1.0:1762166978.898059:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bca743600/0x2f180c4effbab6a7 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x611:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166978.898070:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bca743600/0x2f180c4effbab6a7 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x611:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166978.898080:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bca743600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166978.898087:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bca743600/0x2f180c4effbab6a7 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x611:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00000020:00080000:3.0:1762166978.898088:0:7412:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff945cf1c8d6c0 refcount 2 committed 0 result 0 batchid 53 00000020:00080000:3.0:1762166978.898097:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cc3103900 obd lustre-OST0001-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff945cf1c8dc00 00000020:00080000:3.0:1762166978.898103:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945bc5f03f00 obd lustre-OST0000-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff945cf1c8df00 00010000:00010000:1.0:1762166978.898105:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bca743600/0x2f180c4effbab6a7 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x611:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00000020:00080000:3.0:1762166978.898108:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945bc5f03300 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff945bcc023800 00000020:00080000:3.0:1762166978.898116:0:7412:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000400:0x2:0x0].52 00010000:00010000:1.0:1762166978.898129:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x611:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:1.0:1762166978.898137:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000020:00080000:3.0:1762166978.898144:0:7412:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0001: 52 batchid updated 00010000:00010000:1.0:1762166978.898144:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bca743600/0x2f180c4effbab6a7 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x611:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166978.898154:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bca743600/0x2f180c4effbab6a7 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x611:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00000020:00080000:3.0:1762166978.898174:0:7435:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 53 committed batchid 52 00000100:00100000:0.0:1762166978.898190:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449740416:0@lo:2:osp-syn-1-1.0 00010000:00010000:1.0:1762166978.898197:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc606fc00/0x2f180c4effbab6b5 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.898206:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc606fc00/0x2f180c4effbab6b5 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.898214:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc606fc00/0x2f180c4effbab6b5 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.898220:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc606fc00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166978.898224:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc606fc00/0x2f180c4effbab6b5 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.898230:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc606fc00/0x2f180c4effbab6b5 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166978.898240:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:1.0:1762166978.898243:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166978.898248:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc606fc00/0x2f180c4effbab6b5 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000100:00100000:2.0:1762166978.898259:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4010000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449740672:0@lo:2:osp-syn-0-1.0 00010000:00010000:1.0:1762166978.898262:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc606fc00/0x2f180c4effbab6b5 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000100:00100000:0.0:1762166978.898278:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1762166978.898282:0:7435:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 52 cancel update log [0x240000400:0x2:0x0].51: rc = 0 00000020:00080000:3.0:1762166978.898300:0:7435:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 52 00000100:00100000:1.0:1762166978.898318:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4013b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449740544:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166978.898331:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4012d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449740288:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1762166978.898359:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449740416 00000100:00100000:0.0:1762166978.898367:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449740416 00000100:00100000:2.0:1762166978.898377:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166978.898430:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449740672 00000100:00100000:0.0:1762166978.898434:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449740672 00000100:00100000:3.0:1762166978.898439:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19108 00000100:00100000:3.0:1762166978.898460:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4012300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+6:3636:x1847765449740416:12345-0@lo:2:osp-syn-1-1.0 00010000:00010000:1.0:1762166978.898460:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbab780 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0fd expref: 525 pid: 6494 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166978.898466:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19109 00000100:00100000:0.0:1762166978.898506:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4493480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+7:3633:x1847765449740672:12345-0@lo:2:osp-syn-0-1.0 00010000:00010000:1.0:1762166978.898512:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:1.0:1762166978.898517:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1762166978.898531:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbab779 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0fd expref: 525 pid: 6494 timeout: 0 lvb_type: 3 00000100:00100000:2.0:1762166978.898545:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1762166978.898555:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbab780 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0fd expref: 524 pid: 6494 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166978.898567:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449740800:0@lo:2:osp-syn-1-1.0 00010000:00010000:1.0:1762166978.898584:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:1.0:1762166978.898589:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1762166978.898593:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bde800, rc 0) 00000100:00100000:2.0:1762166978.898614:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:0.0:1762166978.898632:0:28874:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa8c:0x0] updating lvb size from disk: 232857 -> 232857 00002000:00010000:0.0:1762166978.898639:0:28874:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa8c:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:0.0:1762166978.898642:0:28874:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa8c:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:0.0:1762166978.898645:0:28874:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa8c:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:0.0:1762166978.898648:0:28874:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa8c:0x0] updating lvb blocks from disk: 88 -> 88 00000100:00100000:1.0:1762166978.898664:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+524:61766:x1847765450549120:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 2522us (2611us total) trans 4294992208 rc 0/0 00000100:00100000:3.0:1762166978.898673:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4012300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+7:3636:x1847765449740416:12345-0@lo:2:osp-syn-1-1.0 Request processed in 221us (406us total) trans 17179876496 rc 0/0 00000100:00100000:1.0:1762166978.898681:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30586 00000100:00100000:3.0:1762166978.898686:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19108 00000100:00100000:2.0:1762166978.898689:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449740288 00000100:00100000:2.0:1762166978.898698:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449740288 00000100:00100000:0.0:1762166978.898706:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4493480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+9:3633:x1847765449740672:12345-0@lo:2:osp-syn-0-1.0 Request processed in 228us (336us total) trans 21474843352 rc 0/0 00000100:00100000:3.0:1762166978.898708:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449740800 00000100:00100000:3.0:1762166978.898715:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449740800 00000100:00100000:0.0:1762166978.898718:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19109 00000100:00100000:0.0:1762166978.898746:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19110 00000100:00100000:0.0:1762166978.898759:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4492d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+8:3634:x1847765449740288:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1762166978.898767:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19111 00000100:00100000:1.0:1762166978.898793:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4490e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+7:3634:x1847765449740800:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1762166978.898824:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:0.0:1762166978.898826:0:28874:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166978.898832:0:28874:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb mtime from disk: 1762166966 -> 1762166966 00002000:00010000:0.0:1762166978.898834:0:28874:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1762166978.898836:0:28874:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb ctime from disk: 1762166966 -> 1762166966 00002000:00010000:0.0:1762166978.898839:0:28874:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1762166978.898871:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4492300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449740928:0@lo:2:osp-syn-1-1.0 00002000:00010000:1.0:1762166978.898888:0:35247:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166978.898894:0:35247:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00000100:00100000:0.0:1762166978.898896:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4492d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+9:3634:x1847765449740288:12345-0@lo:2:osp-syn-0-1.0 Request processed in 140us (350us total) trans 21474843353 rc 0/0 00002000:00010000:1.0:1762166978.898899:0:35247:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:1.0:1762166978.898905:0:35247:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166979 -> 1762166979 00002000:00010000:1.0:1762166978.898914:0:35247:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1762166978.898925:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166978.898926:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19110 00000100:00100000:0.0:1762166978.898963:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449740544 00000100:00100000:1.0:1762166978.898969:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4490e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+8:3634:x1847765449740800:12345-0@lo:2:osp-syn-1-1.0 Request processed in 189us (360us total) trans 17179876497 rc 0/0 00000100:00100000:0.0:1762166978.898970:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449740544 00000100:00100000:1.0:1762166978.898982:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19111 00000100:00100000:1.0:1762166978.899014:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449740928 00000100:00100000:1.0:1762166978.899021:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449740928 00000100:00100000:0.0:1762166978.899025:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19112 00000100:00100000:0.0:1762166978.899037:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4490700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+9:3635:x1847765449740544:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1762166978.899064:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19113 00000100:00100000:2.0:1762166978.899084:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4491880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+8:3635:x1847765449740928:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:0.0:1762166978.899108:0:28874:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166978.899111:0:28874:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00002000:00010000:0.0:1762166978.899113:0:28874:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:0.0:1762166978.899116:0:28874:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166979 -> 1762166979 00002000:00010000:0.0:1762166978.899123:0:28874:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00000004:00080000:1.0:1762166978.899128:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc4010000/2, rc 0, transno 21474843352 00000100:00100000:1.0:1762166978.899137:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4010000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449740672:0@lo:2:osp-syn-0-1.0 00000004:00080000:1.0:1762166978.899166:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc55df480/2, rc 0, transno 17179876496 00000100:00100000:0.0:1762166978.899170:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4490700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+10:3635:x1847765449740544:12345-0@lo:2:osp-syn-0-1.0 Request processed in 134us (346us total) trans 21474843354 rc 0/0 00000100:00100000:1.0:1762166978.899174:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449740416:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1762166978.899187:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19112 00000004:00080000:3.0:1762166978.899189:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc4013b80/2, rc 0, transno 21474843354 00000100:00100000:3.0:1762166978.899197:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4013b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449740544:0@lo:2:osp-syn-0-1.0 00000004:00080000:1.0:1762166978.899225:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc4012d80/2, rc 0, transno 21474843353 00000100:00100000:1.0:1762166978.899232:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4012d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449740288:0@lo:2:osp-syn-0-1.0 00002000:00010000:2.0:1762166978.899239:0:28434:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa8b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166978.899245:0:28434:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa8b:0x0] updating lvb mtime from disk: 1762166978 -> 1762166978 00000004:00080000:1.0:1762166978.899246:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc55de680/2, rc 0, transno 17179876497 00002000:00010000:2.0:1762166978.899258:0:28434:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa8b:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00000100:00100000:1.0:1762166978.899262:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449740800:0@lo:2:osp-syn-1-1.0 00002000:00010000:2.0:1762166978.899266:0:28434:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa8b:0x0] updating lvb ctime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166978.899272:0:28434:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa8b:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1762166978.899324:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4491880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+9:3635:x1847765449740928:12345-0@lo:2:osp-syn-1-1.0 Request processed in 248us (410us total) trans 17179876498 rc 0/0 00000100:00100000:2.0:1762166978.899334:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19113 00000004:00080000:3.0:1762166978.899344:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc4492300/2, rc 0, transno 17179876498 00000100:00100000:3.0:1762166978.899352:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4492300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449740928:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1762166978.900560:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.900611:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450549248 00000100:00100000:0.0:1762166978.900617:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450549248 00000100:00100000:0.0:1762166978.900649:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19114 00000100:00100000:0.0:1762166978.900654:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+19:61766:x1847765450549248:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:0.0:1762166978.900666:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166978.900683:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbab787 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea104 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166978.900698:0:28434:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa77:0x0] initial LVB size: 232857, mtime: 0x690888c2, atime: 0x690888c2, ctime: 0x690888c3, blocks: 0x128 00010000:00010000:0.0:1762166978.900713:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166978.900715:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166978.900722:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbab787 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 20480->45055) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea104 expref: 20 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.900738:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbab787 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 20480->45055) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea104 expref: 20 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.900747:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdfa00, rc 0) 00000100:00100000:0.0:1762166978.900781:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+20:61766:x1847765450549248:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 127us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166978.900786:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19114 00000100:00100000:3.0:1762166978.901711:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166978.901765:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450549376 00000100:00100000:2.0:1762166978.901770:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450549376 00000100:00100000:2.0:1762166978.901804:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2441 00000100:00100000:2.0:1762166978.901809:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450549376:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:2.0:1762166978.902160:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 232857 -> 232857 00002000:00010000:2.0:1762166978.902165:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166978 -> 1762166979 00002000:00010000:2.0:1762166978.902167:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166978.902170:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166979 -> 1762166979 00002000:00010000:2.0:1762166978.902172:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 296 -> 296 00000100:00100000:2.0:1762166978.902205:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450549376:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 396us (495us total) trans 17179876499 rc 0/0 00000100:00100000:2.0:1762166978.902210:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2441 00000100:00100000:2.0:1762166978.903224:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.903265:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450549504 00000100:00100000:1.0:1762166978.903271:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450549504 00000100:00100000:1.0:1762166978.903310:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30587 00000100:00100000:1.0:1762166978.903318:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4490a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+524:61766:x1847765450549504:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:1.0:1762166978.903338:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166978.903357:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a000/0x2f180c4effbab78e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea10b expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.903459:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a400/0x2f180c4effbab795 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166978.903473:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a400/0x2f180c4effbab795 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166978.903508:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a400/0x2f180c4effbab795 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:1.0:1762166978.903543:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 232857 00000004:00200000:1.0:1762166978.903549:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166978.903570:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a400/0x2f180c4effbab795 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166978.903601:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a000/0x2f180c4effbab78e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea10b expref: 526 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.903620:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a400/0x2f180c4effbab795 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea10b expref: 525 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.903630:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:1.0:1762166978.903633:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166978.903636:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355a400, rc 0) 00000100:00100000:1.0:1762166978.903675:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4490a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+525:61766:x1847765450549504:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 358us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166978.903683:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30587 00000100:00100000:0.0:1762166978.905314:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.905392:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450549760 00000100:00100000:1.0:1762166978.905404:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450549760 00000100:00100000:1.0:1762166978.905460:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11890 00000100:00100000:1.0:1762166978.905522:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4011880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+525:61766:x1847765450549760:12345-192.168.204.38@tcp:35:fsx.0 00000100:00100000:1.0:1762166978.905744:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4011880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+526:61766:x1847765450549760:12345-192.168.204.38@tcp:35:fsx.0 Request processed in 276us (439us total) trans 4294992209 rc 0/0 00000100:00100000:1.0:1762166978.905751:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11890 00000100:00100000:3.0:1762166978.915641:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.915716:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450550016 00000100:00100000:1.0:1762166978.915729:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450550016 00000100:00100000:1.0:1762166978.915805:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30588 00000100:00100000:1.0:1762166978.915817:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+526:61860:x1847765450550016:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166978.915865:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166978.915898:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a000/0x2f180c4effbab79c lrc: 2/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea112 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.915999:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355be00/0x2f180c4effbab7a3 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166978.916012:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355be00/0x2f180c4effbab7a3 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166978.916021:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355be00/0x2f180c4effbab7a3 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166978.916031:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbab7aa lrc: 3/1,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166978.916035:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbab7aa lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166978.916039:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbab7aa lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166978.916155:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbab7b1 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166978.916161:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbab7b1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166978.916166:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbab7b1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:1.0:1762166978.916177:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 232857 00010000:00010000:1.0:1762166978.916265:0:6494:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355be00/0x2f180c4effbab7a3 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166978.916273:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355be00/0x2f180c4effbab7a3 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166978.916278:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355be00/0x2f180c4effbab7a3 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166978.916285:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355be00/0x2f180c4effbab7a3 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166978.916291:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355be00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166978.916296:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355be00/0x2f180c4effbab7a3 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166978.916304:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355be00/0x2f180c4effbab7a3 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166978.916317:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0x0 (ffff945bc812e100) 00010000:00010000:1.0:1762166978.916320:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166978.916326:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355be00/0x2f180c4effbab7a3 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166978.916332:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355be00/0x2f180c4effbab7a3 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166978.916348:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbab7aa lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166978.916354:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbab7aa lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166978.916364:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbab7aa lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166978.916370:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355bc00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166978.916372:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbab7aa lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166978.916378:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbab7aa lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166978.916386:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0xdd396665 (ffff945bc812e200) 00010000:00010000:1.0:1762166978.916388:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166978.916391:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbab7aa lrc: 2/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166978.916397:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbab7aa lrc: 0/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166978.916442:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a000/0x2f180c4effbab79c lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea112 expref: 529 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.916454:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbab7b1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea112 expref: 528 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.916459:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:1.0:1762166978.916461:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166978.916462:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355ae00, rc 0) 00000100:00100000:1.0:1762166978.916578:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+528:61860:x1847765450550016:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 762us (948us total) trans 4294992210 rc 0/0 00000100:00100000:1.0:1762166978.916587:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30588 00000100:00100000:2.0:1762166978.917863:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.917962:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450550144 00000100:00100000:1.0:1762166978.917969:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450550144 00000100:00100000:1.0:1762166978.918020:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 882 00000100:00100000:1.0:1762166978.918028:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4532300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+528:2418:x1847765450550144:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166978.918042:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166978.918061:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbab7b1 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea112 expref: 528 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.918076:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:1.0:1762166978.918080:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166978.918116:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4532300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+527:2418:x1847765450550144:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 89us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166978.918124:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 882 00000100:00100000:0.0:1762166978.918588:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.918644:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450550400 00000100:00100000:1.0:1762166978.918651:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450550400 00000100:00100000:1.0:1762166978.918686:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11891 00000100:00100000:1.0:1762166978.918693:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4010380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+527:61860:x1847765450550400:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:1.0:1762166978.918893:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4010380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+528:61860:x1847765450550400:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 199us (313us total) trans 4294992211 rc 0/0 00000100:00100000:1.0:1762166978.918904:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11891 00000100:00100000:3.0:1762166978.920152:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.920242:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450550656 00000100:00100000:1.0:1762166978.920248:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450550656 00000100:00100000:1.0:1762166978.920291:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30589 00000100:00100000:1.0:1762166978.920299:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+528:61860:x1847765450550656:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166978.920319:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166978.920348:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbab7bf lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea119 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.920457:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbab7c6 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166978.920473:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbab7c6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166978.920508:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbab7c6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:1.0:1762166978.920519:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 232857 00010000:00010000:1.0:1762166978.920626:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbab7bf lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea119 expref: 531 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.920648:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbab7c6 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea119 expref: 530 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.920657:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:1.0:1762166978.920660:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1762166978.920663:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355b600, rc 0) 00000100:00100000:1.0:1762166978.920706:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+530:61860:x1847765450550656:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 408us (559us total) trans 4294992212 rc 0/0 00000100:00100000:1.0:1762166978.920711:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30589 00000100:00100000:2.0:1762166978.922366:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.922427:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450550912 00000100:00100000:1.0:1762166978.922433:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450550912 00000100:00100000:1.0:1762166978.922473:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30590 00000100:00100000:1.0:1762166978.922498:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4530a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+530:61860:x1847765450550912:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166978.922512:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166978.922522:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a000/0x2f180c4effbab7d4 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea120 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.922576:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbab7db lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166978.922588:0:6494:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a400/0x2f180c4effbab795 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea10b expref: 531 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.922598:0:6494:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbab7db lrc: 4/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166978.922638:0:6494:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a400/0x2f180c4effbab795 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea10b expref: 531 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.922653:0:6494:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a400/0x2f180c4effbab795 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea10b expref: 531 pid: 6494 timeout: 698 lvb_type: 0 00000100:00100000:1.0:1762166978.922665:0:6494:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd2300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765449741056:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166978.922762:0:6494:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7c77840 going to sleep for 11 seconds 00000100:00100000:1.0:1762166978.923747:0:6494:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd2300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765449741056:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166978.923772:0:6494:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbab7db lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000100:00100000:2.0:1762166978.923843:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.923892:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450551040 00000100:00100000:1.0:1762166978.923898:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450551040 00010000:00010000:1.0:1762166978.923919:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a400/0x2f180c4effbab795 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea10b expref: 532 pid: 6494 timeout: 698 lvb_type: 0 00000100:00100000:1.0:1762166978.923949:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9654 00000100:00100000:1.0:1762166978.923957:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4530000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+532:2419:x1847765450551040:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166978.923971:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166978.923977:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a400/0x2f180c4effbab795 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea10b expref: 532 pid: 6494 timeout: 698 lvb_type: 0 00010000:00010000:1.0:1762166978.923993:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a400/0x2f180c4effbab795 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea10b expref: 532 pid: 6494 timeout: 698 lvb_type: 0 00010000:00010000:1.0:1762166978.924016:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a400/0x2f180c4effbab795 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea10b expref: 532 pid: 6494 timeout: 698 lvb_type: 0 00010000:00010000:1.0:1762166978.924030:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:1.0:1762166978.924034:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbab7db lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166978.924043:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbab7db lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166978.924051:0:6479:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbab7db lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166978.924079:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166978.924108:0:6494:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbab7db lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166978.924122:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbab7db lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000100:00100000:1.0:1762166978.924124:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4530000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+531:2419:x1847765450551040:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 165us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166978.924146:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9654 00000004:00200000:0.0:1762166978.924157:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 232857 00010000:00010000:0.0:1762166978.924282:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a000/0x2f180c4effbab7d4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea120 expref: 532 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.924309:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbab7db lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea120 expref: 531 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.924318:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:0.0:1762166978.924321:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1762166978.924324:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355bc00, rc 0) 00000100:00100000:0.0:1762166978.924394:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4530a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+531:61860:x1847765450550912:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1897us (2032us total) trans 4294992213 rc 0/0 00000100:00100000:0.0:1762166978.924404:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30590 00000100:00100000:2.0:1762166978.925371:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.925410:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450551168 00000100:00100000:1.0:1762166978.925415:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450551168 00000100:00100000:1.0:1762166978.925442:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11892 00000100:00100000:1.0:1762166978.925447:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4530e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+531:61860:x1847765450551168:12345-192.168.204.38@tcp:33:lfs.0 00000100:00100000:1.0:1762166978.925603:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4530e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+531:61860:x1847765450551168:12345-192.168.204.38@tcp:33:lfs.0 Request processed in 154us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166978.925612:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11892 00000100:00100000:2.0:1762166978.926309:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.926364:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450551424 00000100:00100000:1.0:1762166978.926369:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450551424 00000100:00100000:1.0:1762166978.926399:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11893 00000100:00100000:1.0:1762166978.926407:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4533b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+531:61860:x1847765450551424:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:1.0:1762166978.926657:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4533b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+532:61860:x1847765450551424:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 249us (348us total) trans 4294992214 rc 0/0 00000100:00100000:1.0:1762166978.926665:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11893 00000100:00100000:3.0:1762166978.927601:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.927648:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450551680 00000100:00100000:0.0:1762166978.927660:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450551680 00000100:00100000:0.0:1762166978.927713:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30591 00000100:00100000:0.0:1762166978.927720:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+532:61860:x1847765450551680:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166978.927741:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166978.927743:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:0.0:1762166978.927763:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbab7db lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea120 expref: 532 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.927782:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbab7c6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea119 expref: 531 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.927792:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:0.0:1762166978.927796:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166978.927809:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbab7e9 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea127 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.927903:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbab7f0 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166978.927912:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbab7f0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166978.927919:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbab7f0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:0.0:1762166978.927925:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 232857 00010000:00010000:0.0:1762166978.928002:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbab7e9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea127 expref: 533 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.928012:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbab7f0 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea127 expref: 532 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.928016:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:0.0:1762166978.928018:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166978.928020:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdee00, rc 0) 00000100:00100000:0.0:1762166978.928066:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+532:61860:x1847765450551680:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 345us (468us total) trans 4294992215 rc 0/0 00000100:00100000:0.0:1762166978.928073:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30591 00000100:00100000:2.0:1762166978.928993:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.929046:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450551936 00000100:00100000:1.0:1762166978.929053:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450551936 00000100:00100000:1.0:1762166978.929093:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11894 00000100:00100000:1.0:1762166978.929103:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7be2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+532:61860:x1847765450551936:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:1.0:1762166978.929154:0:6497:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x240000404:0x5eb:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbab7f0 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea127 expref: 532 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.929188:0:6497:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbab7fe lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 00010000:00010000:1.0:1762166978.929200:0:6497:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbab780 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0fd expref: 532 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.929209:0:6497:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbab7fe lrc: 4/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166978.929247:0:6497:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbab780 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0fd expref: 532 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.929263:0:6497:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbab780 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0fd expref: 532 pid: 6494 timeout: 698 lvb_type: 0 00000100:00100000:1.0:1762166978.929280:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd2300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6497:1847765449741184:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166978.929352:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7c77000 going to sleep for 11 seconds 00000100:00100000:1.0:1762166978.930544:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd2300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6497:1847765449741184:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166978.930554:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:1.0:1762166978.930575:0:6497:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbab7fe lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00000100:00100000:0.0:1762166978.930612:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450552064 00000100:00100000:0.0:1762166978.930625:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450552064 00010000:00010000:0.0:1762166978.930655:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbab780 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0fd expref: 533 pid: 6494 timeout: 698 lvb_type: 0 00000100:00100000:0.0:1762166978.930688:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9655 00000100:00100000:0.0:1762166978.930698:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7c30850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+533:2419:x1847765450552064:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166978.930712:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166978.930718:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbab780 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0fd expref: 533 pid: 6494 timeout: 698 lvb_type: 0 00010000:00010000:0.0:1762166978.930729:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbab780 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0fd expref: 533 pid: 6494 timeout: 698 lvb_type: 0 00010000:00010000:0.0:1762166978.930748:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbab780 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0fd expref: 533 pid: 6494 timeout: 698 lvb_type: 0 00010000:00010000:0.0:1762166978.930763:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:0.0:1762166978.930769:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbab7fe lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166978.930777:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbab7fe lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166978.930783:0:6479:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbab7fe lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166978.930812:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166978.930875:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7c30850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+532:2419:x1847765450552064:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 176us (325us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166978.930877:0:6497:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbab7fe lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00000100:00100000:0.0:1762166978.930886:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9655 00010000:00010000:1.0:1762166978.930892:0:6497:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbab7fe lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166978.931070:0:6497:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbab7fe lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166978.931079:0:6497:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbab7fe lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166978.931086:0:6497:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbab7fe lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166978.931091:0:6497:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355ae00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166978.931096:0:6497:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbab7fe lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166978.931103:0:6497:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbab7fe lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166978.931111:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:1.0:1762166978.931114:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1762166978.931117:0:6497:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbab7fe lrc: 2/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166978.931122:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbab7fe lrc: 0/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166978.931132:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:1.0:1762166978.931134:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762166978.931138:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbab7f0 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea127 expref: 531 pid: 6494 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166978.931242:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7be2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+531:61860:x1847765450551936:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 2141us (2250us total) trans 4294992216 rc -22/-22 00000100:00100000:1.0:1762166978.931251:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11894 00000100:00100000:2.0:1762166978.932220:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.932279:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450552192 00000100:00100000:0.0:1762166978.932287:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450552192 00000100:00100000:0.0:1762166978.932330:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30592 00000100:00100000:0.0:1762166978.932340:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4533480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+531:61860:x1847765450552192:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166978.932358:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166978.932375:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbab805 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea12e expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.932416:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbab805 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea12e expref: 532 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.932429:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbab805 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea12e expref: 532 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.932446:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe100) 00010000:00010000:0.0:1762166978.932449:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166978.932452:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdf400, rc 0) 00000100:00100000:0.0:1762166978.932511:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4533480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+532:61860:x1847765450552192:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 173us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166978.932519:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30592 00000100:00100000:3.0:1762166978.933932:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.933974:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450552448 00000100:00100000:0.0:1762166978.933980:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450552448 00000100:00100000:0.0:1762166978.934016:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30593 00000100:00100000:0.0:1762166978.934026:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+532:61860:x1847765450552448:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166978.934039:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166978.934053:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbab80c lrc: 2/0,0 mode: --/CW res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea135 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.934473:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbab813 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x612:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166978.934509:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbab813 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x612:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166978.934519:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbab813 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x612:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:0.0:1762166978.934529:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x612:0x0]: returning size 0 00010000:00010000:0.0:1762166978.934581:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbab80c lrc: 0/0,0 mode: --/CW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea135 expref: 535 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.934604:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbab813 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x612:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea135 expref: 534 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.934612:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x612:0x0].0x0 (ffff945bc4afe600) 00010000:00010000:0.0:1762166978.934616:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166978.934619:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bde200, rc 0) 00000100:00100000:0.0:1762166978.934662:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+534:61860:x1847765450552448:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 638us (734us total) trans 4294992217 rc 0/0 00000100:00100000:0.0:1762166978.934669:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30593 00000100:00100000:2.0:1762166978.935949:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.935985:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450552704 00000100:00100000:0.0:1762166978.935991:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450552704 00000100:00100000:0.0:1762166978.936022:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30594 00000100:00100000:0.0:1762166978.936028:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4533800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+534:61860:x1847765450552704:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166978.936041:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166978.936050:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbab821 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea13c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.936102:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbab828 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166978.936108:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbab828 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166978.936114:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbab828 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:0.0:1762166978.936120:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 232857 00010000:00010000:0.0:1762166978.936169:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbab821 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea13c expref: 537 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.936178:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbab828 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea13c expref: 536 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.936183:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe100) 00010000:00010000:0.0:1762166978.936184:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166978.936186:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdfe00, rc 0) 00000100:00100000:0.0:1762166978.936223:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4533800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+536:61860:x1847765450552704:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 194us (275us total) trans 4294992218 rc 0/0 00000100:00100000:0.0:1762166978.936230:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30594 00000100:00100000:2.0:1762166978.937287:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.937328:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450552960 00000100:00100000:1.0:1762166978.937334:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450552960 00000100:00100000:1.0:1762166978.937377:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11895 00000100:00100000:1.0:1762166978.937386:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4530380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+536:61860:x1847765450552960:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:1.0:1762166978.937433:0:6497:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x240000404:0x5eb:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbab828 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea13c expref: 536 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.937456:0:6497:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbab836 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 00010000:00010000:1.0:1762166978.937466:0:6497:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbab805 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea12e expref: 536 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.937471:0:6497:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbab836 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166978.937509:0:6497:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbab805 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea12e expref: 536 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.937524:0:6497:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbab805 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea12e expref: 536 pid: 6494 timeout: 698 lvb_type: 0 00000100:00100000:1.0:1762166978.937537:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd2300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6497:1847765449741312:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166978.937600:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7c77cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166978.938575:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd2300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6497:1847765449741312:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166978.938599:0:6497:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbab836 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00000100:00100000:2.0:1762166978.938787:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.938883:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450553088 00000100:00100000:0.0:1762166978.938895:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450553088 00010000:00010000:0.0:1762166978.938932:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbab805 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea12e expref: 537 pid: 6494 timeout: 698 lvb_type: 0 00000100:00100000:0.0:1762166978.938965:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9656 00000100:00100000:0.0:1762166978.938975:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4531500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+537:2418:x1847765450553088:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166978.938987:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166978.938992:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbab805 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea12e expref: 537 pid: 6494 timeout: 698 lvb_type: 0 00010000:00010000:0.0:1762166978.939002:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbab805 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea12e expref: 537 pid: 6494 timeout: 698 lvb_type: 0 00010000:00010000:0.0:1762166978.939018:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbab805 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea12e expref: 537 pid: 6494 timeout: 698 lvb_type: 0 00010000:00010000:0.0:1762166978.939030:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe100) 00010000:00010000:0.0:1762166978.939034:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbab836 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166978.939040:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbab836 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166978.939045:0:6479:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbab836 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166978.939069:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166978.939096:0:6497:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbab836 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166978.939110:0:6497:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbab836 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00000100:00100000:0.0:1762166978.939116:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4531500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+536:2418:x1847765450553088:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 143us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166978.939130:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9656 00010000:00010000:1.0:1762166978.939140:0:6497:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355be00/0x2f180c4effbab83d lrc: 3/0,1 mode: --/EX res: [0x240000404:0x612:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 00010000:00010000:1.0:1762166978.939153:0:6497:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbab813 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x612:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea135 expref: 535 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.939159:0:6497:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355be00/0x2f180c4effbab83d lrc: 4/0,1 mode: --/EX res: [0x240000404:0x612:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166978.939180:0:6497:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbab813 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x612:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea135 expref: 535 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166978.939196:0:6497:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbab813 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x612:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea135 expref: 535 pid: 6494 timeout: 698 lvb_type: 0 00000100:00100000:1.0:1762166978.939214:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd2300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6497:1847765449741440:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166978.939262:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7c77cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166978.940025:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd2300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6497:1847765449741440:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166978.940044:0:6497:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355be00/0x2f180c4effbab83d lrc: 3/0,1 mode: --/EX res: [0x240000404:0x612:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00000100:00100000:2.0:1762166978.940268:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.940309:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450553216 00000100:00100000:0.0:1762166978.940315:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450553216 00010000:00010000:0.0:1762166978.940334:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbab813 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x612:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea135 expref: 536 pid: 6494 timeout: 698 lvb_type: 0 00000100:00100000:0.0:1762166978.940359:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9657 00000100:00100000:0.0:1762166978.940371:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4531c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+536:2418:x1847765450553216:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166978.940381:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166978.940386:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbab813 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x612:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea135 expref: 536 pid: 6494 timeout: 698 lvb_type: 0 00010000:00010000:0.0:1762166978.940398:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbab813 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x612:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea135 expref: 536 pid: 6494 timeout: 698 lvb_type: 0 00010000:00010000:0.0:1762166978.940413:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbab813 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x612:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea135 expref: 536 pid: 6494 timeout: 698 lvb_type: 0 00010000:00010000:0.0:1762166978.940426:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x612:0x0].0x0 (ffff945bc4afe600) 00010000:00010000:0.0:1762166978.940430:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355be00/0x2f180c4effbab83d lrc: 3/0,1 mode: --/EX res: [0x240000404:0x612:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166978.940437:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355be00/0x2f180c4effbab83d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x612:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166978.940447:0:6479:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355be00/0x2f180c4effbab83d lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x612:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166978.940472:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166978.940561:0:6497:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355be00/0x2f180c4effbab83d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x612:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00000100:00100000:0.0:1762166978.940572:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4531c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+535:2418:x1847765450553216:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 201us (300us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166978.940581:0:6497:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355be00/0x2f180c4effbab83d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x612:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00000100:00100000:0.0:1762166978.940589:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9657 00000100:00100000:1.0:1762166978.940927:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd2300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449741568:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762166978.940973:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166978.940995:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cee083e40 going to sleep for 11 seconds 00000100:00100000:3.0:1762166978.941020:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449741568 00000100:00100000:3.0:1762166978.941027:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449741568 00000100:00100000:3.0:1762166978.941073:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1391 00000100:00100000:3.0:1762166978.941082:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:6497:x1847765449741568:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166978.941159:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:6497:x1847765449741568:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 79us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166978.941167:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1391 00000100:00100000:1.0:1762166978.941184:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd2300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449741568:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762166978.941225:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd2300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449741696:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762166978.941252:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166978.941272:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7c77cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166978.941278:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449741696 00000100:00100000:3.0:1762166978.941282:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449741696 00000100:00100000:3.0:1762166978.941308:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1392 00000100:00100000:3.0:1762166978.941315:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:6497:x1847765449741696:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166978.941372:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:6497:x1847765449741696:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 58us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166978.941379:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1392 00000100:00100000:1.0:1762166978.941403:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd2300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449741696:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762166978.941446:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd2300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449741824:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762166978.941467:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166978.941503:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449741824 00000100:00100000:3.0:1762166978.941508:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449741824 00000100:00100000:1.0:1762166978.941508:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011c7300 going to sleep for 11 seconds 00000100:00100000:3.0:1762166978.941535:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1393 00000100:00100000:3.0:1762166978.941544:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:6497:x1847765449741824:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166978.941590:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:6497:x1847765449741824:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 48us (121us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166978.941597:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1393 00000100:00100000:1.0:1762166978.941604:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd2300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449741824:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762166978.941637:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd2300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449741952:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762166978.941659:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166978.941679:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011c7000 going to sleep for 11 seconds 00000100:00100000:3.0:1762166978.941684:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449741952 00000100:00100000:3.0:1762166978.941689:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449741952 00000100:00100000:3.0:1762166978.941714:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1394 00000100:00100000:3.0:1762166978.941722:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:6497:x1847765449741952:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166978.941771:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:6497:x1847765449741952:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 49us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166978.941778:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1394 00000100:00100000:1.0:1762166978.941784:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd2300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449741952:0@lo:1000:mdt_rdpg00_000.0 00000040:00080000:1.0:1762166978.941932:0:6497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x2:0x0].53, 280 off68024 00000001:00080000:1.0:1762166978.941940:0:6497:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992219 00000100:00100000:1.0:1762166978.941982:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd2300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449742080:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762166978.942006:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166978.942033:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7c77000 going to sleep for 11 seconds 00000100:00100000:3.0:1762166978.942087:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449742080 00000100:00100000:3.0:1762166978.942092:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449742080 00000100:00100000:3.0:1762166978.942123:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1395 00000100:00100000:3.0:1762166978.942131:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:6497:x1847765449742080:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166978.942218:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:6497:x1847765449742080:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 88us (211us total) trans 17179876500 rc 0/0 00000100:00100000:3.0:1762166978.942226:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1395 00000100:00100000:1.0:1762166978.942240:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd2300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449742080:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762166978.942269:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd0000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449742208:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762166978.942295:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166978.942315:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7a779c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166978.942336:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449742208 00000100:00100000:3.0:1762166978.942340:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449742208 00000100:00100000:3.0:1762166978.942365:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1396 00000100:00100000:3.0:1762166978.942373:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:6497:x1847765449742208:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166978.942453:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:6497:x1847765449742208:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 79us (155us total) trans 21474843355 rc 0/0 00000100:00100000:3.0:1762166978.942461:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1396 00000100:00100000:1.0:1762166978.942468:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd0000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449742208:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1762166978.942548:0:6497:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992220 00010000:00010000:1.0:1762166978.942571:0:6497:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355be00/0x2f180c4effbab83d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x612:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166978.942594:0:6497:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355be00/0x2f180c4effbab83d lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x612:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166978.942601:0:6497:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355be00/0x2f180c4effbab83d lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x612:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166978.942608:0:6497:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355be00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166978.942612:0:6497:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355be00/0x2f180c4effbab83d lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x612:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166978.942624:0:6497:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355be00/0x2f180c4effbab83d lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x612:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166978.942639:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x612:0x0].0x0 (ffff945bc4afe600) 00010000:00010000:1.0:1762166978.942643:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1762166978.942647:0:6497:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355be00/0x2f180c4effbab83d lrc: 2/0,0 mode: --/EX res: [0x240000404:0x612:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166978.942652:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355be00/0x2f180c4effbab83d lrc: 0/0,0 mode: --/EX res: [0x240000404:0x612:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166978.942673:0:6497:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbab836 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166978.942678:0:6497:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbab836 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166978.942684:0:6497:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbab836 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166978.942688:0:6497:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355a200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166978.942691:0:6497:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbab836 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166978.942697:0:6497:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbab836 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166978.942704:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe100) 00010000:00010000:1.0:1762166978.942706:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1762166978.942709:0:6497:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbab836 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166978.942714:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbab836 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166978.942724:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe100) 00010000:00010000:1.0:1762166978.942726:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762166978.942733:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbab828 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea13c expref: 537 pid: 6494 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166978.942821:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4530380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+536:61860:x1847765450552960:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 5436us (5533us total) trans 4294992221 rc 0/0 00000100:00100000:1.0:1762166978.942829:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11895 00000020:00080000:1.0:1762166978.942833:0:6497:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1762166978.944008:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.944062:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450553344 00000100:00100000:0.0:1762166978.944069:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450553344 00000100:00100000:0.0:1762166978.944110:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30595 00000100:00100000:0.0:1762166978.944118:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4530e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+536:61860:x1847765450553344:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166978.944135:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166978.944153:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbab844 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea143 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.944194:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbab844 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea143 expref: 537 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.944207:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbab844 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea143 expref: 537 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.944221:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:0.0:1762166978.944224:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166978.944227:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdf000, rc 0) 00000100:00100000:0.0:1762166978.944264:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4530e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+537:61860:x1847765450553344:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 148us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166978.944271:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30595 00000100:00100000:2.0:1762166978.945824:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.945915:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450553600 00000100:00100000:1.0:1762166978.945921:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450553600 00000100:00100000:1.0:1762166978.945970:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11896 00000100:00100000:1.0:1762166978.945980:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4533b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+537:61860:x1847765450553600:12345-192.168.204.38@tcp:35:lfs.0 00000004:00080000:1.0:1762166978.946248:0:6497:0:(mdd_object.c:3965:mdd_close()) Object [0x240000404:0x612:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1762166978.946309:0:6497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5912, 64 off463096 00000040:00080000:1.0:1762166978.946334:0:6497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5913, 64 off463096 00000001:00080000:1.0:1762166978.946342:0:6497:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992222 00010000:00010000:1.0:1762166978.946377:0:6497:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbab84b lrc: 3/0,1 mode: --/PW res: [0x240000404:0x612:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 00010000:00010000:1.0:1762166978.946389:0:6497:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbab84b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x612:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166978.946398:0:6497:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbab84b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x612:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166978.946406:0:6497:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbab84b lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x612:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166978.946412:0:6497:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbab84b lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x612:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166978.946418:0:6497:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbab84b lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x612:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166978.946441:0:6497:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1762166978.946467:0:6482:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1762166978.946502:0:6482:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbab84b lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x612:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166978.946511:0:6482:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355ae00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166978.946516:0:6482:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbab84b lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x612:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166978.946524:0:6482:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbab84b lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x612:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166978.946536:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x612:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:0.0:1762166978.946539:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1762166978.946544:0:6482:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbab84b lrc: 1/0,0 mode: --/PW res: [0x240000404:0x612:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166978.946549:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbab84b lrc: 0/0,0 mode: --/PW res: [0x240000404:0x612:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166978.946570:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166978.946574:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166978.946576:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166978.946634:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4533b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+539:61860:x1847765450553600:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 655us (812us total) trans 4294992223 rc 0/0 00000100:00100000:1.0:1762166978.946642:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11896 00000020:00080000:1.0:1762166978.946647:0:6497:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1762166978.947732:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.947781:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450553856 00000100:00100000:1.0:1762166978.947787:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450553856 00000100:00100000:1.0:1762166978.947826:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11897 00000100:00100000:1.0:1762166978.947836:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+539:61860:x1847765450553856:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:1.0:1762166978.948031:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+540:61860:x1847765450553856:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 196us (299us total) trans 4294992224 rc 0/0 00000100:00100000:1.0:1762166978.948039:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11897 00000100:00100000:2.0:1762166978.950640:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.950683:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450554112 00000100:00100000:0.0:1762166978.950691:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450554112 00000100:00100000:0.0:1762166978.950738:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30596 00000100:00100000:0.0:1762166978.950749:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4532300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+540:61766:x1847765450554112:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:0.0:1762166978.950768:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166978.950800:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbab852 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea14a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.950879:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbab859 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166978.950896:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbab859 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166978.950907:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbab859 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166978.950929:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbab860 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166978.950936:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbab860 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166978.950942:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbab860 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166978.951036:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbab867 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166978.951055:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbab867 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166978.951062:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbab867 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:0.0:1762166978.951071:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 232857 00010000:00010000:0.0:1762166978.951135:0:6494:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbab859 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166978.951142:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbab859 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166978.951148:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbab859 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166978.951154:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbab859 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166978.951160:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdf400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166978.951164:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbab859 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166978.951186:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbab859 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166978.951197:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0x0 (ffff945bc4afec00) 00010000:00010000:0.0:1762166978.951200:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166978.951204:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbab859 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166978.951210:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbab859 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166978.951225:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbab860 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166978.951231:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbab860 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166978.951236:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbab860 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166978.951240:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdf200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166978.951243:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbab860 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166978.951248:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbab860 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166978.951256:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0xdd396665 (ffff945bc4afea00) 00010000:00010000:0.0:1762166978.951258:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166978.951261:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbab860 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166978.951266:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbab860 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166978.951304:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbab852 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea14a expref: 543 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.951320:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbab867 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea14a expref: 542 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.951327:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:0.0:1762166978.951330:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166978.951332:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdec00, rc 0) 00000100:00100000:0.0:1762166978.951383:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4532300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+542:61766:x1847765450554112:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 636us (749us total) trans 4294992225 rc 0/0 00000100:00100000:0.0:1762166978.951390:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30596 00000100:00100000:2.0:1762166978.953882:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.953926:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450554240 00000100:00100000:0.0:1762166978.953933:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450554240 00002000:00100000:0.0:1762166978.953968:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (188416->192511) req@ffff945bc4530000 x1847765450554240/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:9/0 lens 488/0 e 0 to 0 dl 1762166989 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166978.953975:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4530000 with x1847765450554240 ext(188416->192511) 00002000:00010000:0.0:1762166978.953979:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4530000 00000100:00100000:0.0:1762166978.954000:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2442 00000100:00100000:0.0:1762166978.954006:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4530000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:2417:x1847765450554240:12345-192.168.204.38@tcp:3:lfs.0 00000100:00100000:0.0:1762166978.954157:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4530000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:2417:x1847765450554240:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 150us (279us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1762166978.954164:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2442 00002000:00100000:0.0:1762166978.954169:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (188416->192511) req@ffff945bc4530000 x1847765450554240/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:9/0 lens 488/4536 e 0 to 0 dl 1762166989 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166978.954174:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4530000 with x1847765450554240 ext(188416->192511) 00002000:00010000:0.0:1762166978.954177:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4530000 00000100:00100000:3.0:1762166978.955530:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.955569:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450554368 00000100:00100000:0.0:1762166978.955575:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450554368 00002000:00100000:0.0:1762166978.955597:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (192512->196607) req@ffff945bcce77100 x1847765450554368/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:9/0 lens 488/0 e 0 to 0 dl 1762166989 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166978.955604:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bcce77100 with x1847765450554368 ext(192512->196607) 00002000:00010000:0.0:1762166978.955607:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bcce77100 00000100:00100000:0.0:1762166978.955632:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2443 00000100:00100000:0.0:1762166978.955640:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450554368:12345-192.168.204.38@tcp:3:lfs.0 00000100:00100000:0.0:1762166978.955774:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450554368:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 134us (245us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1762166978.955781:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2443 00002000:00100000:0.0:1762166978.955787:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (192512->196607) req@ffff945bcce77100 x1847765450554368/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:9/0 lens 488/4536 e 0 to 0 dl 1762166989 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166978.955794:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bcce77100 with x1847765450554368 ext(192512->196607) 00002000:00010000:0.0:1762166978.955797:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bcce77100 00000100:00100000:2.0:1762166978.957271:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.957327:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450554496 00000100:00100000:0.0:1762166978.957334:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450554496 00002000:00100000:0.0:1762166978.957362:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (167936->233471) req@ffff945cf783b800 x1847765450554496/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:9/0 lens 504/0 e 0 to 0 dl 1762166989 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166978.957378:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf783b800 with x1847765450554496 ext(167936->233471) 00002000:00010000:0.0:1762166978.957383:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf783b800 00000100:00100000:0.0:1762166978.957411:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2444 00000100:00100000:0.0:1762166978.957419:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:2417:x1847765450554496:12345-192.168.204.38@tcp:3:lfs.0 00000100:00100000:0.0:1762166978.958414:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:2417:x1847765450554496:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 993us (1143us total) trans 0 rc 57344/57344 00000100:00100000:0.0:1762166978.958422:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2444 00002000:00100000:0.0:1762166978.958430:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (167936->233471) req@ffff945cf783b800 x1847765450554496/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:9/0 lens 504/440 e 0 to 0 dl 1762166989 ref 1 fl Complete:/600/0 rc 57344/57344 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166978.958439:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf783b800 with x1847765450554496 ext(167936->233471) 00002000:00010000:0.0:1762166978.958443:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf783b800 00000100:00100000:3.0:1762166978.960755:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.960810:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450554624 00000100:00100000:0.0:1762166978.960820:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450554624 00000100:00100000:0.0:1762166978.960887:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30597 00000100:00100000:0.0:1762166978.960895:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+542:61766:x1847765450554624:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:0.0:1762166978.960919:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166978.960942:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbab875 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea151 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.960984:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbab87c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166978.960998:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbab87c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166978.961008:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbab87c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166978.961133:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbab875 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea151 expref: 544 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.961153:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbab87c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea151 expref: 543 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.961163:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:0.0:1762166978.961166:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1762166978.961171:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bde600, rc 0) 00000100:00100000:0.0:1762166978.961226:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+543:61766:x1847765450554624:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 331us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166978.961234:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30597 00000100:00100000:2.0:1762166978.963884:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.963949:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450554752 00000100:00100000:0.0:1762166978.963960:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450554752 00002000:00100000:0.0:1762166978.964010:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (106496->167935) req@ffff945cf7838a80 x1847765450554752/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:9/0 lens 488/0 e 0 to 0 dl 1762166989 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166978.964023:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf7838a80 with x1847765450554752 ext(106496->167935) 00002000:00010000:0.0:1762166978.964028:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf7838a80 00000100:00100000:0.0:1762166978.964063:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2445 00000100:00100000:0.0:1762166978.964072:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf7838a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450554752:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:0.0:1762166978.965684:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf7838a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450554752:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 1609us (1807us total) trans 0 rc 61440/61440 00000100:00100000:0.0:1762166978.965694:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2445 00002000:00100000:0.0:1762166978.965703:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (106496->167935) req@ffff945cf7838a80 x1847765450554752/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:9/0 lens 488/440 e 0 to 0 dl 1762166989 ref 1 fl Complete:/600/0 rc 61440/61440 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166978.965719:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf7838a80 with x1847765450554752 ext(106496->167935) 00002000:00010000:0.0:1762166978.965724:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf7838a80 00000100:00100000:3.0:1762166978.969584:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.969643:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450554880 00000100:00100000:0.0:1762166978.969654:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450554880 00000100:00100000:0.0:1762166978.969717:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2446 00000100:00100000:0.0:1762166978.969728:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450554880:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:0.0:1762166978.969944:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 232857 -> 232857 00002000:00010000:0.0:1762166978.969948:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166979 -> 1762166979 00002000:00010000:0.0:1762166978.969950:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:0.0:1762166978.969953:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166979 -> 1762166979 00002000:00010000:0.0:1762166978.969955:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 296 -> 312 00000100:00100000:0.0:1762166978.970012:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450554880:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 286us (440us total) trans 17179876501 rc 0/0 00000100:00100000:0.0:1762166978.970021:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2446 00000100:00100000:2.0:1762166978.974473:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.974600:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450555008 00000100:00100000:0.0:1762166978.974610:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450555008 00002000:00100000:0.0:1762166978.974657:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (258048->262143) req@ffff945bc5806680 x1847765450555008/t0(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:9/0 lens 4584/0 e 0 to 0 dl 1762166989 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166978.974670:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5806680 with x1847765450555008 ext(258048->262143) 00002000:00010000:0.0:1762166978.974675:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5806680 00000100:00100000:0.0:1762166978.974708:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2447 00000100:00100000:0.0:1762166978.974727:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5806680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765450555008:12345-192.168.204.38@tcp:4:fsx.0 00000100:00100000:0.0:1762166978.975372:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5806680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+24:2418:x1847765450555008:12345-192.168.204.38@tcp:4:fsx.0 Request processed in 652us (909us total) trans 17179876502 rc 0/0 00000100:00100000:0.0:1762166978.975385:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2447 00002000:00100000:0.0:1762166978.975393:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (258048->262143) req@ffff945bc5806680 x1847765450555008/t17179876502(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:9/0 lens 4584/448 e 0 to 0 dl 1762166989 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166978.975402:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5806680 with x1847765450555008 ext(258048->262143) 00002000:00010000:0.0:1762166978.975406:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5806680 00000100:00100000:2.0:1762166978.976598:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.976727:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450555136 00000100:00100000:0.0:1762166978.976740:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450555136 00000100:00100000:0.0:1762166978.976823:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2448 00000100:00100000:0.0:1762166978.976835:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5807480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+24:2418:x1847765450555136:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:0.0:1762166978.977120:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 232857 -> 262144 00002000:00010000:0.0:1762166978.977124:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166979 -> 1762166979 00002000:00010000:0.0:1762166978.977125:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:0.0:1762166978.977127:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166979 -> 1762166979 00002000:00010000:0.0:1762166978.977129:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 312 -> 312 00000100:00100000:0.0:1762166978.977188:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5807480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+25:2418:x1847765450555136:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 357us (594us total) trans 17179876503 rc 0/0 00000100:00100000:0.0:1762166978.977193:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2448 00000100:00100000:3.0:1762166978.978998:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.979038:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450555264 00000100:00100000:0.0:1762166978.979045:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450555264 00000100:00100000:0.0:1762166978.979092:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2449 00000100:00100000:0.0:1762166978.979097:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+25:2419:x1847765450555264:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:0.0:1762166978.979225:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:0.0:1762166978.979228:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166979 -> 1762166979 00002000:00010000:0.0:1762166978.979229:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:0.0:1762166978.979232:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166979 -> 1762166979 00002000:00010000:0.0:1762166978.979233:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 312 -> 336 00000100:00100000:0.0:1762166978.979277:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765450555264:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 180us (284us total) trans 17179876504 rc 0/0 00000100:00100000:0.0:1762166978.979284:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2449 00000100:00100000:2.0:1762166978.980894:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.980947:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450555392 00000100:00100000:0.0:1762166978.980956:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450555392 00000100:00100000:0.0:1762166978.981016:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2450 00000100:00100000:0.0:1762166978.981025:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5805500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+26:2418:x1847765450555392:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:0.0:1762166978.981314:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:0.0:1762166978.981319:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166979 -> 1762166979 00002000:00010000:0.0:1762166978.981321:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:0.0:1762166978.981324:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166979 -> 1762166979 00002000:00010000:0.0:1762166978.981326:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 336 -> 224 00000100:00100000:0.0:1762166978.981389:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5805500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+27:2418:x1847765450555392:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 365us (502us total) trans 17179876505 rc 0/0 00000100:00100000:0.0:1762166978.981397:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2450 00000100:00100000:2.0:1762166978.983506:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166978.983576:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450555648 00000100:00100000:1.0:1762166978.983584:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450555648 00000100:00100000:1.0:1762166978.983631:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11898 00000100:00100000:1.0:1762166978.983638:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5807b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+543:61766:x1847765450555648:12345-192.168.204.38@tcp:35:fsx.0 00000100:00100000:1.0:1762166978.983927:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5807b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+544:61766:x1847765450555648:12345-192.168.204.38@tcp:35:fsx.0 Request processed in 290us (428us total) trans 4294992226 rc 0/0 00000100:00100000:1.0:1762166978.983933:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11898 00000100:00100000:3.0:1762166978.991878:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.991960:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450555904 00000100:00100000:0.0:1762166978.991972:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450555904 00000100:00100000:0.0:1762166978.992045:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30598 00000100:00100000:0.0:1762166978.992064:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+544:61861:x1847765450555904:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166978.992100:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166978.992122:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbab883 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea158 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.992235:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbab88a lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166978.992251:0:6494:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbab867 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea14a expref: 545 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.992258:0:6494:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbab88a lrc: 4/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166978.992285:0:6494:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbab867 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea14a expref: 545 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.992295:0:6494:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbab867 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea14a expref: 545 pid: 6494 timeout: 698 lvb_type: 0 00000100:00100000:0.0:1762166978.992305:0:6494:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4013800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765449742336:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166978.992397:0:6494:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7a779c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166978.994615:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.994711:0:6494:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4013800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765449742336:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166978.994745:0:6494:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbab88a lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000100:00100000:1.0:1762166978.994746:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450556032 00000100:00100000:1.0:1762166978.994760:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450556032 00010000:00010000:1.0:1762166978.994808:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbab867 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea14a expref: 546 pid: 6494 timeout: 698 lvb_type: 0 00000100:00100000:1.0:1762166978.994867:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9658 00000100:00100000:1.0:1762166978.994879:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5807100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+546:2419:x1847765450556032:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166978.994892:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166978.994899:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbab867 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea14a expref: 546 pid: 6494 timeout: 698 lvb_type: 0 00010000:00010000:1.0:1762166978.994913:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbab867 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea14a expref: 546 pid: 6494 timeout: 698 lvb_type: 0 00010000:00010000:1.0:1762166978.994935:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbab867 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea14a expref: 546 pid: 6494 timeout: 698 lvb_type: 0 00010000:00010000:1.0:1762166978.994953:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:1.0:1762166978.994958:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbab88a lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166978.994967:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbab88a lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166978.994973:0:6479:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbab88a lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166978.995004:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166978.995054:0:6494:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbab88a lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000100:00100000:1.0:1762166978.995063:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5807100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+545:2419:x1847765450556032:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 185us (452us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166978.995072:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbab88a lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000100:00100000:1.0:1762166978.995078:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9658 00000004:00200000:0.0:1762166978.995105:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 262144 00010000:00010000:0.0:1762166978.995263:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbab883 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea158 expref: 546 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.995279:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbab88a lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea158 expref: 545 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.995287:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:0.0:1762166978.995290:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1762166978.995293:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bde200, rc 0) 00000100:00100000:0.0:1762166978.995351:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+545:61861:x1847765450555904:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 3292us (3483us total) trans 4294992227 rc 0/0 00000100:00100000:0.0:1762166978.995359:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30598 00000100:00100000:2.0:1762166978.997387:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166978.997445:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450556288 00000100:00100000:0.0:1762166978.997455:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450556288 00000100:00100000:0.0:1762166978.997552:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30599 00000100:00100000:0.0:1762166978.997573:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+545:61861:x1847765450556288:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166978.997602:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166978.997629:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbab898 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea15f expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.998217:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbab89f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x613:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166978.998234:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbab89f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x613:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166978.998246:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbab89f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x613:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:0.0:1762166978.998259:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x613:0x0]: returning size 0 00010000:00010000:0.0:1762166978.998309:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbab898 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea15f expref: 548 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.998340:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbab89f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x613:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea15f expref: 547 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166978.998351:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x613:0x0].0x0 (ffff945bc4afea00) 00010000:00010000:0.0:1762166978.998355:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166978.998358:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdf400, rc 0) 00000100:00100000:0.0:1762166978.998436:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+547:61861:x1847765450556288:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 873us (1067us total) trans 4294992228 rc 0/0 00000100:00100000:0.0:1762166978.998444:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30599 00000100:00100000:2.0:1762166979.001105:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.001158:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450556544 00000100:00100000:0.0:1762166979.001173:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450556544 00000100:00100000:0.0:1762166979.001259:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30600 00000100:00100000:0.0:1762166979.001272:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+547:61861:x1847765450556544:12345-192.168.204.38@tcp:101:lfs.0 00000100:00080000:3.0:1762166979.001275:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1762166979.001305:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166979.001333:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbab8ad lrc: 2/0,0 mode: --/CR res: [0x240000404:0x613:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea166 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.001501:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbab8b4 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x613:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166979.001515:0:6494:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbab89f lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x613:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea15f expref: 548 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.001522:0:6494:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbab8b4 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x613:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166979.001558:0:6494:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbab89f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x613:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea15f expref: 548 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.001570:0:6494:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbab89f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x613:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea15f expref: 548 pid: 6494 timeout: 698 lvb_type: 0 00000100:00100000:0.0:1762166979.001586:0:6494:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4013800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765449742464:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166979.001682:0:6494:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7a779c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166979.002802:0:6494:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4013800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765449742464:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166979.002824:0:6494:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbab8b4 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x613:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000100:00100000:2.0:1762166979.003131:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166979.003254:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450556672 00000100:00100000:1.0:1762166979.003274:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450556672 00010000:00010000:1.0:1762166979.003339:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbab89f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x613:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea15f expref: 549 pid: 6494 timeout: 698 lvb_type: 0 00000100:00100000:1.0:1762166979.003401:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9659 00000100:00100000:1.0:1762166979.003419:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+549:2418:x1847765450556672:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166979.003443:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166979.003451:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbab89f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x613:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea15f expref: 549 pid: 6494 timeout: 698 lvb_type: 0 00010000:00010000:1.0:1762166979.003466:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbab89f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x613:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea15f expref: 549 pid: 6494 timeout: 698 lvb_type: 0 00010000:00010000:1.0:1762166979.003553:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbab89f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x613:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea15f expref: 549 pid: 6494 timeout: 698 lvb_type: 0 00010000:00010000:1.0:1762166979.003575:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x613:0x0].0x0 (ffff945bc4afea00) 00010000:00010000:1.0:1762166979.003580:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbab8b4 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x613:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166979.003589:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbab8b4 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x613:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166979.003597:0:6479:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbab8b4 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x613:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166979.003627:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166979.003652:0:6494:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbab8b4 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x613:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166979.003663:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbab8b4 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x613:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:0.0:1762166979.003683:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x613:0x0]: returning size 0 00000100:00100000:1.0:1762166979.003697:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+548:2418:x1847765450556672:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 283us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166979.003707:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9659 00000004:00080000:0.0:1762166979.003982:0:6494:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xa8c:0x0], index 1: 0 00000004:00080000:0.0:1762166979.003994:0:6494:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xa8d:0x0], index 0: 0 00010000:00010000:0.0:1762166979.004151:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbab8b4 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x613:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166979.004160:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbab8b4 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x613:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166979.004168:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbab8b4 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x613:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166979.004175:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdfc00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166979.004179:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbab8b4 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x613:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166979.004188:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbab8b4 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x613:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166979.004208:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x613:0x0].0x0 (ffff945bc4afea00) 00010000:00010000:0.0:1762166979.004211:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166979.004216:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbab8b4 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x613:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166979.004222:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbab8b4 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x613:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166979.004285:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbab8ad lrc: 1/0,0 mode: --/CR res: [0x240000404:0x613:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea166 expref: 548 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.004298:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x613:0x0].0x0 (ffff945bc4afea00) 00010000:00010000:0.0:1762166979.004300:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1762166979.004306:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbab8ad lrc: 0/0,0 mode: --/CR res: [0x240000404:0x613:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea166 expref: 548 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.004323:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bde000, rc 0) 00000100:00100000:0.0:1762166979.004390:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+547:61861:x1847765450556544:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 3121us (3292us total) trans 4294992229 rc 301/301 00000100:00100000:0.0:1762166979.004399:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30600 00000100:00100000:2.0:1762166979.005906:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166979.005953:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450556928 00000100:00100000:1.0:1762166979.005965:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450556928 00000100:00100000:1.0:1762166979.006014:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11899 00000100:00100000:1.0:1762166979.006024:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7be2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+547:61861:x1847765450556928:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:1.0:1762166979.006319:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7be2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+548:61861:x1847765450556928:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 296us (420us total) trans 4294992230 rc 0/0 00000100:00100000:1.0:1762166979.006328:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11899 00000100:00100000:3.0:1762166979.007290:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.007358:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450557056 00000100:00100000:0.0:1762166979.007374:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450557056 00000100:00100000:0.0:1762166979.007439:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30601 00000100:00100000:0.0:1762166979.007449:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+548:61861:x1847765450557056:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166979.007473:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166979.007535:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbab8c2 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea16d expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.007655:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbab8c9 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166979.007670:0:6494:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbab88a lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea158 expref: 549 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.007686:0:6494:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbab8c9 lrc: 4/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166979.007729:0:6494:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbab88a lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea158 expref: 549 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.007758:0:6494:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbab88a lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea158 expref: 549 pid: 6494 timeout: 698 lvb_type: 0 00000100:00100000:0.0:1762166979.007780:0:6494:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4013800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765449742592:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166979.007897:0:6494:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011c7000 going to sleep for 11 seconds 00000100:00100000:2.0:1762166979.009159:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.009201:0:6494:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4013800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765449742592:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166979.009235:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450557184 00010000:00010000:0.0:1762166979.009236:0:6494:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbab8c9 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000100:00100000:1.0:1762166979.009253:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450557184 00010000:00010000:1.0:1762166979.009292:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbab88a lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea158 expref: 550 pid: 6494 timeout: 698 lvb_type: 0 00000100:00100000:1.0:1762166979.009337:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9660 00000100:00100000:1.0:1762166979.009347:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+550:2419:x1847765450557184:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166979.009362:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166979.009368:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbab88a lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea158 expref: 550 pid: 6494 timeout: 698 lvb_type: 0 00010000:00010000:1.0:1762166979.009382:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbab88a lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea158 expref: 550 pid: 6494 timeout: 698 lvb_type: 0 00010000:00010000:1.0:1762166979.009407:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbab88a lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea158 expref: 550 pid: 6494 timeout: 698 lvb_type: 0 00010000:00010000:1.0:1762166979.009423:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:1.0:1762166979.009428:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbab8c9 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166979.009437:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbab8c9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166979.009446:0:6479:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbab8c9 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166979.009502:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166979.009537:0:6494:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbab8c9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166979.009545:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbab8c9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000100:00100000:1.0:1762166979.009557:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+549:2419:x1847765450557184:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 204us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166979.009570:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9660 00000004:00200000:0.0:1762166979.009604:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 262144 00000004:00200000:0.0:1762166979.009611:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166979.009635:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbab8c9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166979.009670:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbab8c2 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea16d expref: 549 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.009685:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbab8c9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea16d expref: 548 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.009692:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:0.0:1762166979.009694:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166979.009697:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bde400, rc 0) 00000100:00100000:0.0:1762166979.009757:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+548:61861:x1847765450557056:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2310us (2469us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166979.009765:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30601 00000100:00100000:2.0:1762166979.011592:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.011649:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450557312 00000100:00100000:0.0:1762166979.011656:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450557312 00000100:00100000:0.0:1762166979.011705:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30602 00000100:00100000:0.0:1762166979.011714:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+548:61861:x1847765450557312:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166979.011731:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166979.011750:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbab8d0 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x613:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea174 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.011826:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbab8d7 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x613:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166979.011839:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbab8d7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x613:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166979.011858:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbab8d7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x613:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:0.0:1762166979.011906:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x613:0x0]: returning size 0 00000004:00200000:0.0:1762166979.011910:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166979.011929:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbab8d7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x613:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166979.011956:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbab8d0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x613:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea174 expref: 550 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.011973:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbab8d7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x613:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea174 expref: 549 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.011982:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x613:0x0].0x0 (ffff945bc4afec00) 00010000:00010000:0.0:1762166979.011984:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1762166979.011987:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdf800, rc 0) 00000100:00100000:0.0:1762166979.012028:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+549:61861:x1847765450557312:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 316us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166979.012033:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30602 00000100:00100000:2.0:1762166979.013319:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.013367:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.013403:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450557440 00000100:00100000:0.0:1762166979.013411:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450557440 00000100:00100000:0.0:1762166979.013466:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450557568 00000100:00100000:0.0:1762166979.013470:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450557568 00000100:00100000:3.0:1762166979.013496:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19115 00000100:00100000:3.0:1762166979.013514:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+27:2419:x1847765450557440:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166979.013529:0:9165:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166979.013552:0:9165:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8472600/0x2f180c4effbab8de lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea17b expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166979.013558:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19116 00000100:00100000:1.0:1762166979.013579:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450557568:12345-192.168.204.38@tcp:101:lfs.0 00002000:00010000:3.0:1762166979.013582:0:9165:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa8c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1762166979.013591:0:28874:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166979.013603:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166979.013607:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166979.013610:0:28874:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cc355a200/0x2f180c4effbab8e5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa8d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea182 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166979.013616:0:9165:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472600/0x2f180c4effbab8de lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea17b expref: 28 pid: 9165 timeout: 0 lvb_type: 1 00002000:00010000:1.0:1762166979.013633:0:28874:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa8d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1762166979.013635:0:9165:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc8472600/0x2f180c4effbab8de lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea17b expref: 28 pid: 9165 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166979.013645:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166979.013649:0:9165:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8472600, rc 0) 00010000:00010000:1.0:1762166979.013650:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166979.013658:0:28874:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cc355a200/0x2f180c4effbab8e5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea182 expref: 18 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166979.013672:0:28874:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945cc355a200/0x2f180c4effbab8e5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea182 expref: 18 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166979.013682:0:28874:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355a200, rc 0) 00000100:00100000:3.0:1762166979.013700:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+28:2419:x1847765450557440:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 191us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166979.013711:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19115 00000100:00100000:1.0:1762166979.013711:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450557568:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 139us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166979.013726:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19116 00000100:00100000:3.0:1762166979.014816:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.014867:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450557824 00000100:00100000:0.0:1762166979.014872:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450557824 00000100:00100000:0.0:1762166979.014902:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30603 00000100:00100000:0.0:1762166979.014909:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+549:61861:x1847765450557824:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166979.014918:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166979.014927:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbab8ec lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea189 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.014995:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbab8f3 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166979.015004:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbab8f3 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166979.015010:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbab8f3 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:0.0:1762166979.015016:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 262144 00010000:00010000:0.0:1762166979.015110:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbab8ec lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea189 expref: 552 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.015121:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbab8f3 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea189 expref: 551 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.015126:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:0.0:1762166979.015128:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166979.015130:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdfe00, rc 0) 00000100:00100000:0.0:1762166979.015169:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+551:61861:x1847765450557824:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 258us (355us total) trans 4294992231 rc 0/0 00000100:00100000:0.0:1762166979.015177:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30603 00000100:00100000:2.0:1762166979.016926:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166979.016989:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450557952 00000100:00100000:1.0:1762166979.016998:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450557952 00000100:00100000:1.0:1762166979.017076:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19117 00000100:00100000:1.0:1762166979.017087:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+28:2419:x1847765450557952:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:1.0:1762166979.017124:0:28874:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945cc355be00/0x2f180c4effbab901 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166979.017145:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:1.0:1762166979.017146:0:28874:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbab787 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 20480->45055) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea104 expref: 28 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.017161:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166979.017163:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166979.017166:0:28874:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355be00/0x2f180c4effbab901 lrc: 4/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166979.017201:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450558208 00000100:00100000:2.0:1762166979.017210:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450558208 00010000:00010000:1.0:1762166979.017214:0:28874:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbab787 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 20480->45055) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea104 expref: 28 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166979.017219:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:1.0:1762166979.017241:0:28874:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbab787 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 20480->45055) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea104 expref: 29 pid: 28434 timeout: 698 lvb_type: 0 00000100:00100000:2.0:1762166979.017254:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450558080 00000100:00100000:2.0:1762166979.017258:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450558080 00000100:00100000:1.0:1762166979.017258:0:28874:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28874:1847765449742720:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166979.017281:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19118 00000100:00100000:3.0:1762166979.017300:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19119 00000100:00100000:0.0:1762166979.017303:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+29:2419:x1847765450558208:12345-192.168.204.38@tcp:1:lfs.0 00000100:00100000:3.0:1762166979.017318:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450558080:12345-192.168.204.38@tcp:1:lfs.0 00000100:00100000:1.0:1762166979.017361:0:28874:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccb393cc0 going to sleep for 11 seconds 00010000:00010000:3.0:1762166979.017364:0:28434:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc8472400/0x2f180c4effbab90f lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.017364:0:8382:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbab908 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.017396:0:8382:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bca743200/0x2f180c4effbab6ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0b7 expref: 29 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166979.017398:0:28434:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945cc355ba00/0x2f180c4effbab6c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0b0 expref: 18 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.017417:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166979.017418:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166979.017421:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166979.017423:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166979.017427:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbab908 lrc: 4/1,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166979.017429:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8472400/0x2f180c4effbab90f lrc: 4/1,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.017507:0:8382:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bca743200/0x2f180c4effbab6ca lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0b7 expref: 29 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166979.017527:0:28434:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945cc355ba00/0x2f180c4effbab6c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0b0 expref: 18 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.017527:0:8382:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bca743200/0x2f180c4effbab6ca lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0b7 expref: 29 pid: 28874 timeout: 698 lvb_type: 0 00010000:00010000:3.0:1762166979.017556:0:28434:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945cc355ba00/0x2f180c4effbab6c3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0b0 expref: 18 pid: 28874 timeout: 698 lvb_type: 0 00000100:00100000:0.0:1762166979.017560:0:8382:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4013800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8382:1847765449742976:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166979.017623:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcce74e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765449742848:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166979.017655:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf3a33780 going to sleep for 11 seconds 00000100:00100000:0.0:1762166979.017655:0:8382:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1fe2d80 going to sleep for 11 seconds 00000100:00100000:1.0:1762166979.019217:0:28874:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28874:1847765449742720:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166979.019246:0:8382:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4013800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8382:1847765449742976:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166979.019251:0:28874:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945cc355be00/0x2f180c4effbab901 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166979.019253:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:0.0:1762166979.019282:0:8382:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbab908 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166979.019289:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcce74e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765449742848:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166979.019297:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450558336 00000100:00100000:3.0:1762166979.019305:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166979.019308:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450558336 00010000:00010000:2.0:1762166979.019340:0:28434:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bc8472400/0x2f180c4effbab90f lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166979.019344:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450558464 00000100:00100000:0.0:1762166979.019352:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450558464 00010000:00010000:1.0:1762166979.019359:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bca743200/0x2f180c4effbab6ca lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0b7 expref: 30 pid: 28874 timeout: 698 lvb_type: 0 00000100:00100000:3.0:1762166979.019368:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:0.0:1762166979.019380:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbab787 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 20480->45055) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea104 expref: 31 pid: 28434 timeout: 698 lvb_type: 0 00000100:00100000:1.0:1762166979.019419:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450558592 00000100:00100000:1.0:1762166979.019424:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450558592 00000100:00100000:0.0:1762166979.019441:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9661 00010000:00010000:1.0:1762166979.019450:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945cc355ba00/0x2f180c4effbab6c3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0b0 expref: 19 pid: 28874 timeout: 698 lvb_type: 0 00000100:00100000:3.0:1762166979.019455:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9662 00000100:00100000:0.0:1762166979.019457:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce75f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+31:2418:x1847765450558336:12345-192.168.204.38@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1762166979.019528:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7c32450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+31:2418:x1847765450558464:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166979.019544:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166979.019544:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1762166979.019555:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9663 00010000:00010000:3.0:1762166979.019575:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbab787 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 20480->45055) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea104 expref: 31 pid: 28434 timeout: 698 lvb_type: 0 00000100:00100000:2.0:1762166979.019578:0:6480:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce74e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+19:2416:x1847765450558592:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166979.019587:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bca743200/0x2f180c4effbab6ca lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0b7 expref: 31 pid: 28874 timeout: 698 lvb_type: 0 00010000:00010000:2.0:1762166979.019612:0:6480:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166979.019627:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbab787 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 20480->45055) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea104 expref: 31 pid: 28434 timeout: 698 lvb_type: 0 00010000:00010000:0.0:1762166979.019627:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bca743200/0x2f180c4effbab6ca lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0b7 expref: 31 pid: 28874 timeout: 698 lvb_type: 0 00010000:00010000:2.0:1762166979.019659:0:6480:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945cc355ba00/0x2f180c4effbab6c3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0b0 expref: 19 pid: 28874 timeout: 698 lvb_type: 0 00010000:00010000:3.0:1762166979.019673:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbab787 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 20480->45055) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea104 expref: 31 pid: 28434 timeout: 698 lvb_type: 0 00010000:00010000:0.0:1762166979.019674:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bca743200/0x2f180c4effbab6ca lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0b7 expref: 31 pid: 28874 timeout: 698 lvb_type: 0 00010000:00010000:2.0:1762166979.019682:0:6480:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945cc355ba00/0x2f180c4effbab6c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0b0 expref: 19 pid: 28874 timeout: 698 lvb_type: 0 00010000:00010000:3.0:1762166979.019725:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166979.019726:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166979.019729:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166979.019730:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166979.019737:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945cc355be00/0x2f180c4effbab901 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.019738:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbab908 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.019739:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cc355ba00/0x2f180c4effbab6c3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0b0 expref: 19 pid: 28874 timeout: 698 lvb_type: 0 00010000:00010000:3.0:1762166979.019797:0:9458:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355be00/0x2f180c4effbab901 lrc: 4/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.019797:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbab908 lrc: 4/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.019802:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166979.019811:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166979.019822:0:6480:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc8472400/0x2f180c4effbab90f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.019836:0:6480:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8472400/0x2f180c4effbab90f lrc: 4/1,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.019844:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166979.019861:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166979.019877:0:6480:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166979.019923:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7c32450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+29:2418:x1847765450558464:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 455us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166979.019934:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9662 00010000:00010000:1.0:1762166979.019945:0:8382:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbab908 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.019959:0:8382:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbab908 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166979.019980:0:28434:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bc8472400/0x2f180c4effbab90f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.019987:0:8382:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbab908 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166979.020000:0:28434:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc8472400/0x2f180c4effbab90f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.020008:0:8382:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbab908 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.020020:0:8382:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbab908 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166979.020027:0:28434:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc8472400/0x2f180c4effbab90f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.020028:0:8382:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdee00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166979.020039:0:8382:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbab908 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166979.020077:0:28434:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8472400/0x2f180c4effbab90f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.020085:0:8382:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbab908 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166979.020086:0:28434:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc8472400/0x2f180c4effbab90f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166979.020119:0:28434:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8472400 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166979.020127:0:28434:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc8472400/0x2f180c4effbab90f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.020133:0:8382:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbab908 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166979.020135:0:28434:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc8472400/0x2f180c4effbab90f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166979.020176:0:28434:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc8472400/0x2f180c4effbab90f lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.020184:0:8382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbab908 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166979.020187:0:28434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc8472400/0x2f180c4effbab90f lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166979.021131:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce75f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+28:2418:x1847765450558336:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1673us (1878us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166979.021147:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9661 00000100:00100000:2.0:1762166979.021187:0:6480:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce74e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+18:2416:x1847765450558592:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1609us (1811us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166979.021202:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9663 00000100:00100000:3.0:1762166979.021210:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450558080:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 3895us (4002us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166979.021226:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19119 00010000:00010000:0.0:1762166979.021246:0:28874:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945cc355be00/0x2f180c4effbab901 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166979.021251:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+27:2419:x1847765450558208:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 3945us (4170us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166979.021262:0:28874:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cc355be00/0x2f180c4effbab901 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166979.021270:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19118 00010000:00010000:0.0:1762166979.021289:0:28874:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945cc355be00/0x2f180c4effbab901 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.021301:0:28874:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355be00/0x2f180c4effbab901 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.021309:0:28874:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945cc355be00/0x2f180c4effbab901 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.021317:0:28874:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355be00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166979.021321:0:28874:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc355be00/0x2f180c4effbab901 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.021329:0:28874:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc355be00/0x2f180c4effbab901 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.021343:0:28874:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945cc355be00/0x2f180c4effbab901 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.021351:0:28874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cc355be00/0x2f180c4effbab901 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166979.021400:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765450557952:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 4316us (4479us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166979.021409:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19117 00000100:00100000:2.0:1762166979.023146:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.023193:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.023232:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450558848 00000100:00100000:0.0:1762166979.023243:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450558848 00000100:00100000:1.0:1762166979.023282:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450558976 00000100:00100000:1.0:1762166979.023292:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450558976 00000100:00100000:0.0:1762166979.023297:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19120 00000100:00100000:0.0:1762166979.023312:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+17:2416:x1847765450558848:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166979.023332:0:28874:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1762166979.023354:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19121 00010000:00010000:0.0:1762166979.023356:0:28874:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde800/0x2f180c4effbab916 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea197 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166979.023376:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+26:2417:x1847765450558976:12345-192.168.204.38@tcp:101:lfs.0 00002000:00010000:0.0:1762166979.023385:0:28874:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa7a:0x0] initial LVB size: 0, mtime: 0x690888c2, atime: 0x690888c2, ctime: 0x690888c3, blocks: 0x1800 00010000:00010000:1.0:1762166979.023395:0:8382:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166979.023407:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166979.023412:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166979.023418:0:8382:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cc355a400/0x2f180c4effbab91d lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea19e expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.023424:0:28874:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde800/0x2f180c4effbab916 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea197 expref: 18 pid: 28874 timeout: 0 lvb_type: 1 00002000:00010000:1.0:1762166979.023472:0:8382:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa79:0x0] initial LVB size: 0, mtime: 0x690888c2, atime: 0x690888c2, ctime: 0x690888c3, blocks: 0x0 00010000:00010000:0.0:1762166979.023472:0:28874:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde800/0x2f180c4effbab916 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea197 expref: 18 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166979.023518:0:28874:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bde800, rc 0) 00010000:00010000:1.0:1762166979.023521:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166979.023525:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166979.023535:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355a400/0x2f180c4effbab91d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea19e expref: 27 pid: 8382 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166979.023553:0:8382:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945cc355a400/0x2f180c4effbab91d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea19e expref: 27 pid: 8382 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166979.023571:0:8382:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355a400, rc 0) 00000100:00100000:0.0:1762166979.023583:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+18:2416:x1847765450558848:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 273us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166979.023593:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19120 00000100:00100000:1.0:1762166979.023623:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+27:2417:x1847765450558976:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 250us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166979.023633:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19121 00000100:00100000:2.0:1762166979.023759:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166979.023803:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450558720 00000100:00100000:1.0:1762166979.023809:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450558720 00000100:00100000:1.0:1762166979.023844:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19122 00000100:00100000:1.0:1762166979.023862:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+27:2416:x1847765450558720:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166979.023870:0:8382:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166979.023881:0:8382:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cc355b400/0x2f180c4effbab924 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea190 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762166979.023904:0:8382:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa77:0x0] initial LVB size: 262144, mtime: 0x690888c3, atime: 0x690888c2, ctime: 0x690888c3, blocks: 0xe0 00010000:00010000:1.0:1762166979.023918:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166979.023920:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166979.023927:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355b400/0x2f180c4effbab924 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea190 expref: 28 pid: 8382 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166979.023939:0:8382:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945cc355b400/0x2f180c4effbab924 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea190 expref: 28 pid: 8382 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166979.023948:0:8382:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355b400, rc 0) 00000100:00100000:1.0:1762166979.023982:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+28:2416:x1847765450558720:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 132us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166979.023989:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19122 00000100:00100000:3.0:1762166979.048214:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166979.048551:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450559104 00000100:00100000:1.0:1762166979.048569:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450559104 00000100:00100000:1.0:1762166979.048663:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19123 00000100:00100000:1.0:1762166979.048677:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+28:2416:x1847765450559104:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:1.0:1762166979.048870:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+28:2416:x1847765450559104:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 196us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166979.048879:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19123 00000100:00100000:3.0:1762166979.050722:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.051187:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450559232 00000100:00100000:0.0:1762166979.051198:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450559232 00000100:00100000:0.0:1762166979.051258:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30604 00000100:00100000:0.0:1762166979.051268:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb386300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+551:61861:x1847765450559232:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166979.051295:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166979.051321:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbab92b lrc: 2/0,0 mode: --/PR res: [0x240000404:0x613:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea1a5 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.051362:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbab932 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x613:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166979.051397:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbab932 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x613:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166979.051414:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbab932 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x613:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166979.051595:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbab92b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x613:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1a5 expref: 553 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.051613:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbab932 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x613:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1a5 expref: 552 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.051623:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x613:0x0].0x0 (ffff945bc4afec00) 00010000:00010000:0.0:1762166979.051626:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1762166979.051630:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdf200, rc 0) 00000100:00100000:0.0:1762166979.051694:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb386300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+552:61861:x1847765450559232:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 428us (981us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166979.051702:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30604 00000100:00100000:2.0:1762166979.053026:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.053099:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450559488 00000100:00100000:0.0:1762166979.053110:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450559488 00000100:00100000:0.0:1762166979.053180:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30605 00000100:00100000:0.0:1762166979.053191:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+552:61861:x1847765450559488:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:0.0:1762166979.053252:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166979.053284:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbab8d7 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x613:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea174 expref: 552 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.053303:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x613:0x0].0x0 (ffff945bc4afec00) 00010000:00010000:0.0:1762166979.053308:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166979.053554:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbab939 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x613:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166979.053568:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbab939 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x613:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166979.053578:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbab939 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x613:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000001:00080000:0.0:1762166979.053624:0:6494:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992232 00000004:00010000:0.0:1762166979.053645:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000e54b38a3 reply state 000000001428ca2c transno 4294992233 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbab939 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x613:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166979.053656:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbab939 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x613:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166979.053662:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x613:0x0].0x0 (ffff945bc4afec00) 00010000:00010000:0.0:1762166979.053665:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762166979.053669:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166979.053757:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+554:61861:x1847765450559488:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 568us (738us total) trans 4294992233 rc 0/0 00000100:00100000:0.0:1762166979.053767:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30605 00000020:00080000:0.0:1762166979.053775:0:6494:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1762166979.054907:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.055027:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450559616 00000100:00100000:0.0:1762166979.055035:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450559616 00000100:00100000:0.0:1762166979.055078:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30606 00000100:00100000:0.0:1762166979.055087:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb386a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+554:61861:x1847765450559616:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166979.055107:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166979.055121:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbab940 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x613:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea1ac expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.055163:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbab940 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x613:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1ac expref: 555 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.055177:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbab940 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x613:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1ac expref: 555 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.055193:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x613:0x0].0x0 (ffff945bc4afec00) 00010000:00010000:0.0:1762166979.055197:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166979.055200:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdfc00, rc 0) 00000100:00100000:0.0:1762166979.055242:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb386a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+555:61861:x1847765450559616:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 156us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166979.055248:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30606 00000100:00100000:3.0:1762166979.057430:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.057501:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450559744 00000100:00100000:0.0:1762166979.057511:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450559744 00000100:00100000:0.0:1762166979.057560:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19124 00000100:00100000:0.0:1762166979.057571:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb384380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+28:61861:x1847765450559744:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166979.057588:0:28874:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166979.057606:0:28874:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbab947 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea1b3 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.057639:0:28874:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc8472600/0x2f180c4effbab8de lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea17b expref: 29 pid: 9165 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166979.057648:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166979.057650:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166979.057654:0:28874:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbab947 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1b3 expref: 29 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.057689:0:28874:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc8472600/0x2f180c4effbab8de lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea17b expref: 29 pid: 9165 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166979.057706:0:28874:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc8472600/0x2f180c4effbab8de lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea17b expref: 29 pid: 9165 timeout: 698 lvb_type: 1 00000100:00100000:0.0:1762166979.057721:0:28874:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4013800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28874:1847765449743104:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166979.057833:0:28874:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc12ed300 going to sleep for 11 seconds 00000100:00100000:0.0:1762166979.059059:0:28874:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4013800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28874:1847765449743104:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166979.059084:0:28874:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbab947 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1b3 expref: 29 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.059099:0:28874:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdee00, rc 0) 00000100:00100000:0.0:1762166979.059142:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb384380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+29:61861:x1847765450559744:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1573us (1718us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166979.059150:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19124 00000100:00100000:3.0:1762166979.059333:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.059401:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450559872 00000100:00100000:2.0:1762166979.059408:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450559872 00010000:00010000:2.0:1762166979.059432:0:6480:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472600/0x2f180c4effbab8de lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea17b expref: 29 pid: 9165 timeout: 698 lvb_type: 1 00000100:00100000:2.0:1762166979.059472:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9664 00000100:00100000:2.0:1762166979.059508:0:6480:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb387800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+29:2419:x1847765450559872:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166979.059521:0:6480:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166979.059527:0:6480:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc8472600/0x2f180c4effbab8de lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea17b expref: 29 pid: 9165 timeout: 698 lvb_type: 1 00010000:00010000:2.0:1762166979.059539:0:6480:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc8472600/0x2f180c4effbab8de lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea17b expref: 29 pid: 9165 timeout: 698 lvb_type: 1 00010000:00010000:2.0:1762166979.059558:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8472600/0x2f180c4effbab8de lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea17b expref: 29 pid: 9165 timeout: 698 lvb_type: 1 00010000:00010000:2.0:1762166979.059570:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166979.059572:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166979.059577:0:6480:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbab947 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1b3 expref: 28 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.059586:0:6480:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbab947 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1b3 expref: 28 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.059614:0:6480:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbab947 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1b3 expref: 28 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166979.059627:0:6480:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79e9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6480:1847765449743232:192.168.204.38@tcp:105: 00000100:00100000:2.0:1762166979.059682:0:6480:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc6399cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166979.060779:0:6480:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79e9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6480:1847765449743232:192.168.204.38@tcp:105: 00010000:00010000:2.0:1762166979.060799:0:6480:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166979.060886:0:6480:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb387800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+28:2419:x1847765450559872:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1405us (1566us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166979.060902:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9664 00000100:00100000:3.0:1762166979.061125:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.061179:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450560000 00000100:00100000:0.0:1762166979.061188:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450560000 00000100:00100000:0.0:1762166979.061239:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19125 00000100:00100000:0.0:1762166979.061248:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb387480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+18:61861:x1847765450560000:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166979.061264:0:28874:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166979.061279:0:28874:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfa00/0x2f180c4effbab94e lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea1ba expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.061304:0:28874:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945cc355a200/0x2f180c4effbab8e5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea182 expref: 19 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166979.061326:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166979.061328:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166979.061332:0:28874:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfa00/0x2f180c4effbab94e lrc: 4/0,0 mode: --/PW res: [0x280000400:0xa8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1ba expref: 19 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.061358:0:28874:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945cc355a200/0x2f180c4effbab8e5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea182 expref: 19 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166979.061371:0:28874:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945cc355a200/0x2f180c4effbab8e5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea182 expref: 19 pid: 28874 timeout: 698 lvb_type: 1 00000100:00100000:0.0:1762166979.061383:0:28874:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4013800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28874:1847765449743360:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166979.061438:0:28874:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc12ed300 going to sleep for 11 seconds 00000100:00100000:1.0:1762166979.064520:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.064561:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450560128 00000100:00100000:2.0:1762166979.064571:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450560128 00010000:00010000:2.0:1762166979.064627:0:6480:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945cc355a200/0x2f180c4effbab8e5 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xa8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea182 expref: 20 pid: 28874 timeout: 698 lvb_type: 1 00000100:00100000:2.0:1762166979.064684:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9665 00000100:00100000:2.0:1762166979.064697:0:6480:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450560128:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166979.064712:0:6480:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166979.064718:0:6480:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945cc355a200/0x2f180c4effbab8e5 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xa8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea182 expref: 20 pid: 28874 timeout: 698 lvb_type: 1 00000100:00100000:0.0:1762166979.064732:0:28874:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4013800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28874:1847765449743360:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166979.064741:0:6480:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945cc355a200/0x2f180c4effbab8e5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea182 expref: 20 pid: 28874 timeout: 698 lvb_type: 1 00010000:00010000:2.0:1762166979.064779:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cc355a200/0x2f180c4effbab8e5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea182 expref: 20 pid: 28874 timeout: 698 lvb_type: 1 00010000:00010000:0.0:1762166979.064796:0:28874:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfa00/0x2f180c4effbab94e lrc: 3/0,0 mode: --/PW res: [0x280000400:0xa8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1ba expref: 19 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.064797:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166979.064811:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166979.064820:0:6480:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfa00/0x2f180c4effbab94e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1ba expref: 19 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.064837:0:6480:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfa00/0x2f180c4effbab94e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1ba expref: 19 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.064865:0:28874:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdfa00, rc 0) 00010000:00010000:2.0:1762166979.064888:0:6480:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfa00/0x2f180c4effbab94e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1ba expref: 19 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166979.064906:0:6480:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79e9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6480:1847765449743488:192.168.204.38@tcp:105: 00000100:00100000:0.0:1762166979.064950:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb387480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+19:61861:x1847765450560000:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 3700us (3830us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166979.064966:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19125 00000100:00100000:2.0:1762166979.064981:0:6480:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc6399cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166979.066533:0:6480:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79e9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6480:1847765449743488:192.168.204.38@tcp:105: 00010000:00010000:2.0:1762166979.066551:0:6480:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166979.066602:0:6480:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450560128:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1908us (2091us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166979.066616:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9665 00000100:00100000:3.0:1762166979.067720:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.067835:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450560256 00000100:00100000:0.0:1762166979.067843:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450560256 00002000:00010000:0.0:1762166979.067890:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2700 (0->18446744073709551615) 00002000:00100000:0.0:1762166979.067896:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bcb385500 with x1847765450560256 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166979.067907:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bcb385500. 00000100:00100000:0.0:1762166979.067942:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2451 00000100:00100000:0.0:1762166979.067953:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb385500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+28:2418:x1847765450560256:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:0.0:1762166979.068131:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa8c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166979.068135:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa8c:0x0] updating lvb mtime from disk: 0 -> 1762166979 00002000:00010000:0.0:1762166979.068138:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa8c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1762166979.068140:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa8c:0x0] updating lvb ctime from disk: 0 -> 1762166979 00002000:00010000:0.0:1762166979.068142:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa8c:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166979.068277:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.068304:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb385500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+29:2418:x1847765450560256:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 344us (578us total) trans 17179876506 rc 0/0 00000100:00100000:0.0:1762166979.068329:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2451 00002000:00010000:0.0:1762166979.068336:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2700 (0->18446744073709551615) 00002000:00100000:0.0:1762166979.068340:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bcb385500 with x1847765450560256 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166979.068353:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bcb385500. 00000100:00100000:0.0:1762166979.068388:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450560384 00000100:00100000:0.0:1762166979.068396:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450560384 00002000:00010000:0.0:1762166979.068430:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2701 (0->18446744073709551615) 00002000:00100000:0.0:1762166979.068434:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bcb385880 with x1847765450560384 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166979.068440:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bcb385880. 00000100:00100000:0.0:1762166979.068471:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2452 00000100:00100000:0.0:1762166979.068532:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb385880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450560384:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:0.0:1762166979.068699:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa8d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166979.068702:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa8d:0x0] updating lvb mtime from disk: 0 -> 1762166979 00002000:00010000:0.0:1762166979.068705:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa8d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1762166979.068707:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa8d:0x0] updating lvb ctime from disk: 0 -> 1762166979 00002000:00010000:0.0:1762166979.068710:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa8d:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1762166979.068756:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb385880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450560384:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 277us (481us total) trans 21474843356 rc 0/0 00000100:00100000:0.0:1762166979.068764:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2452 00002000:00010000:0.0:1762166979.068768:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2701 (0->18446744073709551615) 00002000:00100000:0.0:1762166979.068773:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bcb385880 with x1847765450560384 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166979.068784:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bcb385880. 00000100:00100000:3.0:1762166979.070605:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.070715:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450560512 00000100:00100000:0.0:1762166979.070723:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450560512 00000100:00100000:0.0:1762166979.070769:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19126 00000100:00100000:0.0:1762166979.070777:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb385f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+29:2417:x1847765450560512:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:0.0:1762166979.070903:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb385f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+29:2417:x1847765450560512:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 126us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166979.070911:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19126 00000100:00100000:1.0:1762166979.072368:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.072452:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450560640 00000100:00100000:0.0:1762166979.072462:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450560640 00000100:00100000:0.0:1762166979.072541:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19127 00000100:00100000:0.0:1762166979.072551:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+29:2417:x1847765450560640:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:0.0:1762166979.072662:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+29:2417:x1847765450560640:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 113us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166979.072672:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19127 00000100:00100000:2.0:1762166979.074128:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.074180:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450560768 00000100:00100000:0.0:1762166979.074187:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450560768 00000100:00100000:0.0:1762166979.074236:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2453 00000100:00100000:0.0:1762166979.074246:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+29:2417:x1847765450560768:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:0.0:1762166979.074293:0:8388:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbab955 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.074309:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166979.074320:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166979.074328:0:8388:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbab955 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.074343:0:8388:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbab955 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.074437:0:8388:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbab955 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.074446:0:8388:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbab955 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.074454:0:8388:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbab955 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.074461:0:8388:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdf800 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166979.074465:0:8388:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbab955 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.074473:0:8388:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbab955 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.074531:0:8388:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbab955 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.074539:0:8388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbab955 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166979.074601:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+29:2417:x1847765450560768:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 356us (475us total) trans 0 rc 12288/12288 00000100:00100000:0.0:1762166979.074609:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2453 00000100:00100000:3.0:1762166979.076053:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.076096:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450560896 00000100:00100000:0.0:1762166979.076103:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450560896 00000100:00100000:0.0:1762166979.076149:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2454 00000100:00100000:0.0:1762166979.076158:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb384000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+29:2417:x1847765450560896:12345-192.168.204.38@tcp:4:lfs.0 00010000:00010000:0.0:1762166979.076183:0:8388:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbab95c lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.076197:0:8388:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbab947 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1b3 expref: 29 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.076205:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166979.076207:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166979.076209:0:8388:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbab95c lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.076244:0:8388:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbab947 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1b3 expref: 29 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.076259:0:8388:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbab947 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1b3 expref: 29 pid: 28874 timeout: 698 lvb_type: 0 00000100:00100000:0.0:1762166979.076274:0:8388:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4013800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:8388:1847765449743616:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166979.076354:0:8388:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc12ed300 going to sleep for 11 seconds 00000100:00100000:0.0:1762166979.077741:0:8388:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4013800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:8388:1847765449743616:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166979.077772:0:8388:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbab95c lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166979.077900:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.077967:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450561024 00000100:00100000:2.0:1762166979.077977:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450561024 00010000:00010000:2.0:1762166979.078009:0:6480:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbab947 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1b3 expref: 30 pid: 28874 timeout: 698 lvb_type: 0 00000100:00100000:2.0:1762166979.078058:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9666 00000100:00100000:2.0:1762166979.078068:0:6480:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb386d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+30:2419:x1847765450561024:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166979.078081:0:6480:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166979.078099:0:6480:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbab947 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1b3 expref: 30 pid: 28874 timeout: 698 lvb_type: 0 00010000:00010000:2.0:1762166979.078119:0:6480:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbab947 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1b3 expref: 30 pid: 28874 timeout: 698 lvb_type: 0 00010000:00010000:2.0:1762166979.078141:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbab947 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1b3 expref: 30 pid: 28874 timeout: 698 lvb_type: 0 00010000:00010000:2.0:1762166979.078157:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166979.078159:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166979.078164:0:6480:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbab95c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.078183:0:6480:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbab95c lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.078221:0:6480:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166979.078249:0:8388:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbab95c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.078261:0:8388:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbab95c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166979.078274:0:6480:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb386d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+29:2419:x1847765450561024:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 205us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166979.078283:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9666 00000001:00080000:1.0:1762166979.080238:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876507 is committed 00000001:00080000:1.0:1762166979.080259:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876500 is committed 00002000:00010000:0.0:1762166979.080365:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa8c:0x0] updating lvb size from disk: 0 -> 12288 00002000:00010000:0.0:1762166979.080372:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa8c:0x0] updating lvb blocks from disk: 0 -> 24 00010000:00010000:0.0:1762166979.080384:0:8388:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbab95c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.080396:0:8388:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbab95c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.080405:0:8388:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbab95c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.080412:0:8388:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdec00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166979.080417:0:8388:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbab95c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.080427:0:8388:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbab95c lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.080446:0:8388:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbab95c lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.080460:0:8388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbab95c lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166979.080605:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb384000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+17:2417:x1847765450560896:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 4443us (4549us total) trans 17179876507 rc 0/0 00000100:00100000:0.0:1762166979.080619:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2454 00000100:00100000:3.0:1762166979.081989:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.082040:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450561152 00000100:00100000:0.0:1762166979.082051:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450561152 00000100:00100000:0.0:1762166979.082108:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19128 00000100:00100000:0.0:1762166979.082119:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb386680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+17:2417:x1847765450561152:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:0.0:1762166979.082238:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb386680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+17:2417:x1847765450561152:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 121us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166979.082246:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19128 00000100:00100000:1.0:1762166979.083626:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.083671:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450561280 00000100:00100000:0.0:1762166979.083678:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450561280 00000100:00100000:0.0:1762166979.083719:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19129 00000100:00100000:0.0:1762166979.083726:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4531500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+17:2417:x1847765450561280:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:0.0:1762166979.083808:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4531500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+17:2417:x1847765450561280:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 81us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166979.083816:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19129 00000100:00100000:3.0:1762166979.084829:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.084910:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450561408 00000100:00100000:0.0:1762166979.084914:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450561408 00000100:00100000:0.0:1762166979.084952:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2455 00000100:00100000:0.0:1762166979.084960:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+17:2416:x1847765450561408:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:0.0:1762166979.085020:0:8388:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbab963 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.085035:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166979.085037:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166979.085043:0:8388:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbab963 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [40960->49151] (req 40960->49151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.085053:0:8388:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbab963 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [40960->49151] (req 40960->49151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.085169:0:8388:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbab963 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [40960->49151] (req 40960->49151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.085180:0:8388:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbab963 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [40960->49151] (req 40960->49151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.085188:0:8388:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbab963 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [40960->49151] (req 40960->49151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.085193:0:8388:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdf800 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166979.085197:0:8388:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbab963 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [40960->49151] (req 40960->49151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.085203:0:8388:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbab963 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [40960->49151] (req 40960->49151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.085216:0:8388:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbab963 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [40960->49151] (req 40960->49151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.085224:0:8388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbab963 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [40960->49151] (req 40960->49151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166979.085269:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+17:2416:x1847765450561408:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 311us (443us total) trans 0 rc 8192/8192 00000100:00100000:0.0:1762166979.085276:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2455 00000100:00100000:3.0:1762166979.086584:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.086663:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450561536 00000100:00100000:0.0:1762166979.086675:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450561536 00000100:00100000:0.0:1762166979.086727:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2456 00000100:00100000:0.0:1762166979.086736:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+17:2417:x1847765450561536:12345-192.168.204.38@tcp:4:lfs.0 00002000:00010000:0.0:1762166979.086783:0:8388:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa8c:0x0] initial LVB size: 12288, mtime: 0x690888c3, atime: 0x0, ctime: 0x690888c3, blocks: 0x18 00010000:00010000:0.0:1762166979.086791:0:8388:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde200/0x2f180c4effbab96a lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.086803:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166979.086805:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166979.086808:0:8388:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde200/0x2f180c4effbab96a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [40960->49151] (req 40960->49151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.086819:0:8388:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde200/0x2f180c4effbab96a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [40960->49151] (req 40960->49151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1762166979.088896:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876508 is committed 00002000:00010000:0.0:1762166979.089184:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa8c:0x0] updating lvb size from disk: 12288 -> 49152 00002000:00010000:0.0:1762166979.089190:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa8c:0x0] updating lvb blocks from disk: 24 -> 40 00010000:00010000:0.0:1762166979.089205:0:8388:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde200/0x2f180c4effbab96a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [40960->49151] (req 40960->49151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.089221:0:8388:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde200/0x2f180c4effbab96a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [40960->49151] (req 40960->49151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.089231:0:8388:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde200/0x2f180c4effbab96a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [40960->49151] (req 40960->49151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.089239:0:8388:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bde200 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166979.089244:0:8388:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde200/0x2f180c4effbab96a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [40960->49151] (req 40960->49151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.089253:0:8388:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde200/0x2f180c4effbab96a lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [40960->49151] (req 40960->49151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.089273:0:8388:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde200/0x2f180c4effbab96a lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [40960->49151] (req 40960->49151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.089281:0:8388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde200/0x2f180c4effbab96a lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [40960->49151] (req 40960->49151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166979.089377:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+17:2417:x1847765450561536:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 2639us (2794us total) trans 17179876508 rc 0/0 00000100:00100000:0.0:1762166979.089390:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2456 00000100:00100000:1.0:1762166979.091117:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.091165:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450561664 00000100:00100000:0.0:1762166979.091177:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450561664 00000100:00100000:0.0:1762166979.091242:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19130 00000100:00100000:0.0:1762166979.091253:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4531c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+17:2416:x1847765450561664:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:0.0:1762166979.091412:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4531c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+17:2416:x1847765450561664:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 160us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166979.091418:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19130 00000100:00100000:3.0:1762166979.093457:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.093552:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450561792 00000100:00100000:0.0:1762166979.093566:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450561792 00000100:00100000:0.0:1762166979.093647:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19131 00000100:00100000:0.0:1762166979.093658:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+17:2417:x1847765450561792:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:0.0:1762166979.094734:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+17:2417:x1847765450561792:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 1073us (1282us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166979.094747:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19131 00000100:00100000:3.0:1762166979.098626:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.098759:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450561920 00000100:00100000:0.0:1762166979.098775:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450561920 00000100:00100000:0.0:1762166979.098878:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2457 00000100:00100000:0.0:1762166979.098892:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+17:2416:x1847765450561920:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:0.0:1762166979.098979:0:8388:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbab971 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.099000:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166979.099003:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166979.099010:0:8388:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbab971 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [221184->233471] (req 221184->233471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.099028:0:8388:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbab971 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [221184->233471] (req 221184->233471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.099172:0:8388:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbab971 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [221184->233471] (req 221184->233471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.099181:0:8388:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbab971 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [221184->233471] (req 221184->233471) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.099191:0:8388:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbab971 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [221184->233471] (req 221184->233471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.099199:0:8388:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdf800 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166979.099204:0:8388:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbab971 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [221184->233471] (req 221184->233471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.099213:0:8388:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbab971 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [221184->233471] (req 221184->233471) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.099231:0:8388:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbab971 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [221184->233471] (req 221184->233471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.099239:0:8388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbab971 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [221184->233471] (req 221184->233471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166979.099329:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+17:2416:x1847765450561920:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 439us (719us total) trans 0 rc 12288/12288 00000100:00100000:0.0:1762166979.099343:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2457 00000100:00100000:1.0:1762166979.101391:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.101950:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450562048 00000100:00100000:0.0:1762166979.101963:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450562048 00000100:00100000:0.0:1762166979.102044:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2458 00000100:00100000:0.0:1762166979.102055:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4530380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+17:2417:x1847765450562048:12345-192.168.204.38@tcp:4:lfs.0 00002000:00010000:0.0:1762166979.102125:0:8388:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa8c:0x0] initial LVB size: 49152, mtime: 0x690888c3, atime: 0x0, ctime: 0x690888c3, blocks: 0x28 00010000:00010000:0.0:1762166979.102136:0:8388:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde200/0x2f180c4effbab978 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.102159:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166979.102161:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166979.102168:0:8388:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde200/0x2f180c4effbab978 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [221184->233471] (req 221184->233471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.102188:0:8388:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde200/0x2f180c4effbab978 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [221184->233471] (req 221184->233471) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1762166979.103756:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876509 is committed 00002000:00010000:0.0:1762166979.103833:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa8c:0x0] updating lvb size from disk: 49152 -> 233472 00002000:00010000:0.0:1762166979.103839:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa8c:0x0] updating lvb blocks from disk: 40 -> 64 00010000:00010000:0.0:1762166979.103861:0:8388:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde200/0x2f180c4effbab978 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [221184->233471] (req 221184->233471) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.103871:0:8388:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde200/0x2f180c4effbab978 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [221184->233471] (req 221184->233471) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.103880:0:8388:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde200/0x2f180c4effbab978 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [221184->233471] (req 221184->233471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.103887:0:8388:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bde200 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166979.103893:0:8388:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde200/0x2f180c4effbab978 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [221184->233471] (req 221184->233471) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.103901:0:8388:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde200/0x2f180c4effbab978 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [221184->233471] (req 221184->233471) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.103920:0:8388:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde200/0x2f180c4effbab978 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [221184->233471] (req 221184->233471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.103933:0:8388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde200/0x2f180c4effbab978 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [221184->233471] (req 221184->233471) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166979.104038:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4530380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+17:2417:x1847765450562048:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 1982us (2662us total) trans 17179876509 rc 0/0 00000100:00100000:0.0:1762166979.104051:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2458 00000100:00100000:3.0:1762166979.106062:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.106369:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450562176 00000100:00100000:0.0:1762166979.106381:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450562176 00000100:00100000:0.0:1762166979.106452:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19132 00000100:00100000:0.0:1762166979.106463:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3d5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+17:2416:x1847765450562176:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:0.0:1762166979.106696:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3d5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+17:2416:x1847765450562176:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 235us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166979.106706:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19132 00000100:00100000:3.0:1762166979.108551:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166979.108602:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450562432 00000100:00100000:1.0:1762166979.108614:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450562432 00000100:00100000:1.0:1762166979.108676:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30607 00000100:00100000:1.0:1762166979.108686:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+555:61861:x1847765450562432:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:1.0:1762166979.108948:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbab97f lrc: 3/0,1 mode: --/PW res: [0x240000404:0x613:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166979.108967:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbab97f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x613:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.108980:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbab97f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x613:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000001:00080000:1.0:1762166979.109026:0:6495:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992234 00000004:00010000:1.0:1762166979.109045:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000006f17d97c reply state 00000000444aab77 transno 4294992235 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbab97f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x613:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.109057:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbab97f lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x613:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.109064:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x613:0x0].0x0 (ffff945bc4afec00) 00010000:00010000:1.0:1762166979.109067:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166979.109071:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166979.109151:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+558:61861:x1847765450562432:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 465us (610us total) trans 4294992235 rc 0/0 00000100:00100000:1.0:1762166979.109158:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30607 00000020:00080000:1.0:1762166979.109169:0:6495:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1762166979.110323:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.110383:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450562560 00000100:00100000:0.0:1762166979.110392:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450562560 00000100:00100000:0.0:1762166979.110440:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19133 00000100:00100000:0.0:1762166979.110450:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+17:61861:x1847765450562560:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166979.110501:0:28874:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166979.110524:0:28874:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbab986 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea1c1 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166979.110551:0:28874:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa8c:0x0] initial LVB size: 233472, mtime: 0x690888c3, atime: 0x0, ctime: 0x690888c3, blocks: 0x40 00010000:00010000:0.0:1762166979.110575:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166979.110578:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166979.110591:0:28874:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbab986 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1c1 expref: 18 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.110608:0:28874:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbab986 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1c1 expref: 18 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.110623:0:28874:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdf800, rc 0) 00000100:00100000:0.0:1762166979.110677:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+18:61861:x1847765450562560:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 229us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166979.110684:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19133 00000100:00100000:3.0:1762166979.112132:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166979.112168:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.112199:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450562688 00000100:00100000:0.0:1762166979.112209:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450562688 00002000:00010000:0.0:1762166979.112248:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2700 (262144->18446744073709551615) 00002000:00100000:0.0:1762166979.112253:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1e6ce00 with x1847765450562688 ext(262144->18446744073709551615) 00000100:00100000:1.0:1762166979.112258:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450562816 00000100:00100000:1.0:1762166979.112265:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450562816 00002000:00010000:0.0:1762166979.112265:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1e6ce00. 00002000:00010000:1.0:1762166979.112293:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2701 (0->18446744073709551615) 00002000:00100000:1.0:1762166979.112299:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1e6ea00 with x1847765450562816 ext(0->18446744073709551615) 00002000:00010000:1.0:1762166979.112307:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945cf1e6ea00. 00000100:00100000:0.0:1762166979.112313:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2459 00000100:00100000:1.0:1762166979.112351:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2460 00000100:00100000:1.0:1762166979.112362:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450562816:12345-192.168.204.38@tcp:10:lfs.0 00000100:00100000:0.0:1762166979.112401:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450562688:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:1.0:1762166979.112609:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa8d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166979.112609:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa8c:0x0] updating lvb size from disk: 233472 -> 262144 00002000:00010000:0.0:1762166979.112616:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa8c:0x0] updating lvb mtime from disk: 1762166979 -> 1762166979 00002000:00010000:1.0:1762166979.112617:0:23943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa8d:0x0] updating lvb mtime from disk: 1762166979 -> 1762166979 00002000:00010000:0.0:1762166979.112622:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa8c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1762166979.112623:0:23943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa8d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1762166979.112628:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa8c:0x0] updating lvb ctime from disk: 1762166979 -> 1762166979 00002000:00010000:1.0:1762166979.112629:0:23943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa8d:0x0] updating lvb ctime from disk: 1762166979 -> 1762166979 00002000:00010000:0.0:1762166979.112634:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa8c:0x0] updating lvb blocks from disk: 64 -> 64 00002000:00010000:1.0:1762166979.112635:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa8d:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1762166979.112694:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450562816:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 334us (524us total) trans 21474843357 rc 0/0 00000100:00100000:0.0:1762166979.112703:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450562688:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 378us (574us total) trans 17179876510 rc 0/0 00000100:00100000:1.0:1762166979.112708:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2460 00002000:00010000:1.0:1762166979.112714:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2701 (0->18446744073709551615) 00002000:00100000:1.0:1762166979.112719:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1e6ea00 with x1847765450562816 ext(0->18446744073709551615) 00000100:00100000:0.0:1762166979.112720:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2459 00002000:00010000:1.0:1762166979.112726:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945cf1e6ea00. 00002000:00010000:0.0:1762166979.112727:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2700 (262144->18446744073709551615) 00002000:00100000:0.0:1762166979.112733:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1e6ce00 with x1847765450562688 ext(262144->18446744073709551615) 00002000:00010000:0.0:1762166979.112741:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1e6ce00. 00000100:00100000:2.0:1762166979.113962:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166979.114032:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450562944 00000100:00100000:1.0:1762166979.114040:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450562944 00000100:00100000:1.0:1762166979.114087:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30608 00000100:00100000:1.0:1762166979.114096:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+558:61861:x1847765450562944:12345-192.168.204.38@tcp:44:lfs.0 00000001:00080000:3.0:1762166979.115354:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294992235 is committed 00000020:00080000:3.0:1762166979.115395:0:7412:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff945cf1c8d240 refcount 2 committed 0 result 0 batchid 54 00010000:00010000:2.0:1762166979.115396:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbab939 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x613:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00000020:00080000:3.0:1762166979.115404:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cf1d0ea00 obd lustre-OST0001-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff945cc11cad80 00010000:00010000:2.0:1762166979.115408:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbab939 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x613:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00000020:00080000:3.0:1762166979.115410:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cf1d0ef00 obd lustre-OST0000-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff945cee083e40 00000020:00080000:3.0:1762166979.115419:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cf1d0ee00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff945d00f67e00 00010000:00010000:2.0:1762166979.115422:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbab939 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x613:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00000020:00080000:3.0:1762166979.115424:0:7412:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000400:0x2:0x0].53 00010000:00010000:2.0:1762166979.115437:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bde000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166979.115442:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbab939 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x613:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166979.115449:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbab939 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x613:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00000020:00080000:3.0:1762166979.115457:0:7412:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0001: 53 batchid updated 00000020:00080000:0.0:1762166979.115508:0:7435:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 54 committed batchid 53 00010000:00010000:2.0:1762166979.115513:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x613:0x0].0x0 (ffff945bc4afec00) 00010000:00010000:2.0:1762166979.115517:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166979.115523:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbab939 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x613:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166979.115535:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbab939 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x613:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166979.115555:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbab97f lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x613:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.115561:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbab97f lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x613:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.115567:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbab97f lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x613:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.115572:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355b000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166979.115575:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbab97f lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x613:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.115579:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbab97f lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x613:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.115586:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x613:0x0].0x0 (ffff945bc4afec00) 00010000:00010000:2.0:1762166979.115588:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166979.115591:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbab97f lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x613:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.115596:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbab97f lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x613:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000020:00080000:0.0:1762166979.115643:0:7435:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 53 cancel update log [0x240000400:0x2:0x0].52: rc = 0 00000020:00080000:0.0:1762166979.115650:0:7435:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 53 00000100:00100000:1.0:1762166979.115670:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+529:61861:x1847765450562944:12345-192.168.204.38@tcp:44:lfs.0 Request processed in 1572us (1712us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166979.115680:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30608 00000100:00100000:2.0:1762166979.116723:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.116755:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.116774:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450563072 00000100:00100000:0.0:1762166979.116782:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450563072 00000100:00100000:1.0:1762166979.116801:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450563200 00000100:00100000:1.0:1762166979.116807:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450563200 00000100:00100000:0.0:1762166979.116821:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19134 00000100:00100000:0.0:1762166979.116829:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450563072:12345-192.168.204.38@tcp:16:lfs.0 00000100:00100000:3.0:1762166979.116862:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19135 00000100:00100000:3.0:1762166979.116873:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450563200:12345-192.168.204.38@tcp:16:lfs.0 00000001:00080000:1.0:1762166979.117656:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876510 is committed 00000100:00100000:0.0:1762166979.117749:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450563072:12345-192.168.204.38@tcp:16:lfs.0 Request processed in 920us (1027us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166979.117755:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19134 00000001:00080000:2.0:1762166979.118138:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843357 is committed 00000001:00080000:2.0:1762166979.118156:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843355 is committed 00000100:00100000:3.0:1762166979.118339:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+16:2418:x1847765450563200:12345-192.168.204.38@tcp:16:lfs.0 Request processed in 1463us (1578us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166979.118352:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19135 00000100:00100000:2.0:1762166979.125193:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.125234:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166979.125266:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450563456 00000100:00100000:2.0:1762166979.125270:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166979.125282:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450563456 00000100:00100000:0.0:1762166979.125306:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450563328 00000100:00100000:0.0:1762166979.125317:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450563328 00000100:00100000:1.0:1762166979.125324:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450563584 00000100:00100000:1.0:1762166979.125330:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450563584 00000100:00100000:3.0:1762166979.125365:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19136 00000100:00100000:0.0:1762166979.125378:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19137 00000100:00100000:3.0:1762166979.125381:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+16:2417:x1847765450563456:12345-192.168.204.38@tcp:1:lfs.0 00000100:00100000:1.0:1762166979.125390:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19138 00000100:00100000:1.0:1762166979.125408:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+19:2416:x1847765450563584:12345-192.168.204.38@tcp:1:lfs.0 00000100:00100000:0.0:1762166979.125416:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+19:2416:x1847765450563328:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:1.0:1762166979.125447:0:8382:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945cc355b800/0x2f180c4effbab994 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.125448:0:28874:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde200/0x2f180c4effbab98d lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.125469:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166979.125469:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166979.125474:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166979.125475:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166979.125513:0:28874:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde200/0x2f180c4effbab98d lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.125524:0:28434:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8200/0x2f180c4effbab99b lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.125526:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355b800/0x2f180c4effbab994 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.125530:0:28874:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde200/0x2f180c4effbab98d lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.125535:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166979.125538:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166979.125545:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8200/0x2f180c4effbab99b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.125545:0:8382:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cc355b800/0x2f180c4effbab994 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.125557:0:28434:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8200/0x2f180c4effbab99b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.125571:0:28434:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8200/0x2f180c4effbab99b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.125571:0:8382:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945cc355b800/0x2f180c4effbab994 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.125571:0:28874:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde200/0x2f180c4effbab98d lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.125595:0:28874:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde200/0x2f180c4effbab98d lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.125596:0:28434:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8200/0x2f180c4effbab99b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.125596:0:8382:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355b800/0x2f180c4effbab994 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.125611:0:28874:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde200/0x2f180c4effbab98d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.125614:0:8382:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945cc355b800/0x2f180c4effbab994 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.125615:0:28434:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8200/0x2f180c4effbab99b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.125629:0:28874:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bde200 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166979.125631:0:28434:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa8200 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166979.125631:0:8382:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355b800 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166979.125637:0:28874:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde200/0x2f180c4effbab98d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.125638:0:28434:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8200/0x2f180c4effbab99b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.125638:0:8382:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc355b800/0x2f180c4effbab994 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.125663:0:28874:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde200/0x2f180c4effbab98d lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.125664:0:28434:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8200/0x2f180c4effbab99b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.125664:0:8382:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc355b800/0x2f180c4effbab994 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.125695:0:28874:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde200/0x2f180c4effbab98d lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.125696:0:28434:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8200/0x2f180c4effbab99b lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.125696:0:8382:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945cc355b800/0x2f180c4effbab994 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.125719:0:28874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde200/0x2f180c4effbab98d lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.125720:0:28434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8200/0x2f180c4effbab99b lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.125720:0:8382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cc355b800/0x2f180c4effbab994 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166979.125809:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+19:2416:x1847765450563584:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 410us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166979.125821:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19138 00000100:00100000:0.0:1762166979.125822:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+19:2416:x1847765450563328:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 430us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166979.125823:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+16:2417:x1847765450563456:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 443us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166979.125841:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19137 00000100:00100000:2.0:1762166979.125857:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19136 00000100:00100000:2.0:1762166979.126865:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166979.126901:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450563840 00000100:00100000:1.0:1762166979.126909:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450563840 00000100:00100000:1.0:1762166979.126955:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30609 00000100:00100000:1.0:1762166979.126962:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+529:61861:x1847765450563840:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:1.0:1762166979.127046:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbab9a2 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x613:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166979.127058:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbab9a2 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x613:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.127065:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbab9a2 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x613:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00010000:1.0:1762166979.127203:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000588f5a5c reply state 0000000048bb58e0 transno 4294992236 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbab9a2 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x613:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.127216:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbab9a2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x613:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.127222:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x613:0x0].0x0 (ffff945bc4afec00) 00010000:00010000:1.0:1762166979.127225:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166979.127229:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166979.127305:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+531:61861:x1847765450563840:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 343us (442us total) trans 4294992236 rc 0/0 00000100:00100000:1.0:1762166979.127310:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30609 00000100:00100000:3.0:1762166979.128360:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166979.128397:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.128425:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450563968 00000100:00100000:2.0:1762166979.128433:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450563968 00000100:00100000:0.0:1762166979.128457:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450564096 00000100:00100000:0.0:1762166979.128464:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450564096 00000100:00100000:2.0:1762166979.128516:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19139 00000100:00100000:0.0:1762166979.128529:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19140 00000100:00100000:2.0:1762166979.128531:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450563968:12345-192.168.204.38@tcp:2:lfs.0 00000100:00100000:0.0:1762166979.128544:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+16:2419:x1847765450564096:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:2.0:1762166979.128703:0:28434:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa8c:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:0.0:1762166979.128703:0:28874:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa8d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166979.128710:0:28434:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa8c:0x0] updating lvb mtime from disk: 1762166979 -> 1762166979 00002000:00010000:0.0:1762166979.128711:0:28874:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa8d:0x0] updating lvb mtime from disk: 1762166979 -> 1762166979 00002000:00010000:2.0:1762166979.128717:0:28434:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa8c:0x0] updating lvb atime from disk: 0 -> 1762166978 00002000:00010000:0.0:1762166979.128718:0:28874:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa8d:0x0] updating lvb atime from disk: 0 -> 1762166978 00002000:00010000:2.0:1762166979.128724:0:28434:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa8c:0x0] updating lvb ctime from disk: 1762166979 -> 1762166979 00002000:00010000:0.0:1762166979.128725:0:28874:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa8d:0x0] updating lvb ctime from disk: 1762166979 -> 1762166979 00002000:00010000:2.0:1762166979.128733:0:28434:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa8c:0x0] updating lvb blocks from disk: 64 -> 64 00002000:00010000:0.0:1762166979.128733:0:28874:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa8d:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1762166979.128790:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450563968:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 264us (433us total) trans 17179876511 rc 0/0 00000100:00100000:0.0:1762166979.128791:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450564096:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 249us (391us total) trans 21474843358 rc 0/0 00000100:00100000:2.0:1762166979.128807:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19139 00000100:00100000:0.0:1762166979.128816:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19140 00000100:00100000:2.0:1762166979.130001:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166979.130049:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450564352 00000100:00100000:1.0:1762166979.130057:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450564352 00000100:00100000:1.0:1762166979.130101:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30610 00000100:00100000:1.0:1762166979.130112:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+531:61861:x1847765450564352:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:1.0:1762166979.130179:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166979.130210:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbab8c9 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea16d expref: 531 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.130237:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:1.0:1762166979.130243:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166979.130288:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbab9a9 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166979.130299:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbab9a9 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.130307:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbab9a9 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00010000:1.0:1762166979.130401:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000002c84980c reply state 00000000e5c2b50b transno 4294992237 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbab9a9 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.130414:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbab9a9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.130421:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:1.0:1762166979.130424:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166979.130427:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166979.130549:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+532:61861:x1847765450564352:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 438us (552us total) trans 4294992237 rc 0/0 00000100:00100000:1.0:1762166979.130557:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30610 00000100:00100000:3.0:1762166979.131427:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.131500:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450564480 00000100:00100000:0.0:1762166979.131506:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450564480 00000100:00100000:0.0:1762166979.131545:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19141 00000100:00100000:0.0:1762166979.131553:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+19:61861:x1847765450564480:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166979.131569:0:28874:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166979.131581:0:28874:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbab9b0 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea1c8 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.131613:0:28874:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945cc355b400/0x2f180c4effbab924 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea190 expref: 20 pid: 8382 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166979.131623:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166979.131625:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166979.131630:0:28874:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbab9b0 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1c8 expref: 20 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.131670:0:28874:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945cc355b400/0x2f180c4effbab924 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea190 expref: 20 pid: 8382 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166979.131692:0:28874:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945cc355b400/0x2f180c4effbab924 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea190 expref: 20 pid: 8382 timeout: 698 lvb_type: 1 00000100:00100000:0.0:1762166979.131708:0:28874:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4012300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28874:1847765449743744:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166979.131809:0:28874:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc12ed300 going to sleep for 11 seconds 00000100:00100000:0.0:1762166979.132703:0:28874:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4012300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28874:1847765449743744:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166979.132730:0:28874:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbab9b0 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1c8 expref: 20 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.132746:0:28874:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdec00, rc 0) 00000100:00100000:0.0:1762166979.132785:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+20:61861:x1847765450564480:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1232us (1368us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166979.132793:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19141 00000100:00100000:3.0:1762166979.132897:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.132941:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450564608 00000100:00100000:0.0:1762166979.132947:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450564608 00010000:00010000:0.0:1762166979.132970:0:6480:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355b400/0x2f180c4effbab924 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea190 expref: 20 pid: 8382 timeout: 698 lvb_type: 1 00000100:00100000:0.0:1762166979.133004:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9667 00000100:00100000:0.0:1762166979.133013:0:6480:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5764000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450564608:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166979.133024:0:6480:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166979.133045:0:6480:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945cc355b400/0x2f180c4effbab924 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea190 expref: 20 pid: 8382 timeout: 698 lvb_type: 1 00010000:00010000:0.0:1762166979.133065:0:6480:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945cc355b400/0x2f180c4effbab924 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea190 expref: 20 pid: 8382 timeout: 698 lvb_type: 1 00010000:00010000:0.0:1762166979.133085:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cc355b400/0x2f180c4effbab924 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea190 expref: 20 pid: 8382 timeout: 698 lvb_type: 1 00010000:00010000:0.0:1762166979.133098:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166979.133100:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166979.133107:0:6480:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbab9b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1c8 expref: 19 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.133117:0:6480:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbab9b0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1c8 expref: 19 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.133143:0:6480:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbab9b0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1c8 expref: 19 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166979.133154:0:6480:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4012300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6480:1847765449743872:192.168.204.38@tcp:105: 00000100:00100000:0.0:1762166979.133196:0:6480:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc12ed300 going to sleep for 11 seconds 00000100:00100000:0.0:1762166979.134049:0:6480:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4012300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6480:1847765449743872:192.168.204.38@tcp:105: 00010000:00010000:0.0:1762166979.134060:0:6480:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166979.134092:0:6480:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5764000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450564608:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1081us (1197us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166979.134101:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9667 00000100:00100000:3.0:1762166979.134194:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.134302:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450564736 00000100:00100000:0.0:1762166979.134308:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450564736 00000100:00100000:0.0:1762166979.134344:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19142 00000100:00100000:0.0:1762166979.134355:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5765c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+17:61861:x1847765450564736:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166979.134372:0:28874:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166979.134387:0:28874:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf400/0x2f180c4effbab9b7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea1cf expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.134409:0:28874:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde800/0x2f180c4effbab916 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea197 expref: 18 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166979.134417:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166979.134419:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166979.134422:0:28874:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf400/0x2f180c4effbab9b7 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1cf expref: 18 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.134447:0:28874:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde800/0x2f180c4effbab916 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea197 expref: 18 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166979.134460:0:28874:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde800/0x2f180c4effbab916 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea197 expref: 18 pid: 28874 timeout: 698 lvb_type: 1 00000100:00100000:0.0:1762166979.134471:0:28874:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4012300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28874:1847765449744000:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166979.134535:0:28874:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc12ed300 going to sleep for 11 seconds 00000100:00100000:0.0:1762166979.135266:0:28874:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4012300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28874:1847765449744000:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166979.135284:0:28874:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf400/0x2f180c4effbab9b7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1cf expref: 18 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.135304:0:28874:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdf400, rc 0) 00000100:00100000:0.0:1762166979.135337:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5765c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+18:61861:x1847765450564736:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 983us (1145us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166979.135345:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19142 00000100:00100000:3.0:1762166979.135570:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.135661:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450564864 00000100:00100000:0.0:1762166979.135667:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450564864 00010000:00010000:0.0:1762166979.135685:0:6480:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde800/0x2f180c4effbab916 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea197 expref: 18 pid: 28874 timeout: 698 lvb_type: 1 00000100:00100000:0.0:1762166979.135717:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9668 00000100:00100000:0.0:1762166979.135730:0:6480:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5766300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450564864:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166979.135742:0:6480:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166979.135764:0:6480:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde800/0x2f180c4effbab916 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea197 expref: 18 pid: 28874 timeout: 698 lvb_type: 1 00010000:00010000:0.0:1762166979.135777:0:6480:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde800/0x2f180c4effbab916 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea197 expref: 18 pid: 28874 timeout: 698 lvb_type: 1 00010000:00010000:0.0:1762166979.135797:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde800/0x2f180c4effbab916 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea197 expref: 18 pid: 28874 timeout: 698 lvb_type: 1 00010000:00010000:0.0:1762166979.135808:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166979.135811:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166979.135817:0:6480:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf400/0x2f180c4effbab9b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1cf expref: 17 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.135832:0:6480:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf400/0x2f180c4effbab9b7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1cf expref: 17 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.135870:0:6480:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf400/0x2f180c4effbab9b7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1cf expref: 17 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166979.135882:0:6480:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4012300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6480:1847765449744128:192.168.204.38@tcp:105: 00000100:00100000:0.0:1762166979.135930:0:6480:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc12ed300 going to sleep for 11 seconds 00000100:00100000:0.0:1762166979.136811:0:6480:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4012300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6480:1847765449744128:192.168.204.38@tcp:105: 00010000:00010000:0.0:1762166979.136824:0:6480:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166979.136870:0:6480:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5766300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450564864:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1141us (1300us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166979.136879:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9668 00000100:00100000:3.0:1762166979.137009:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.137101:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450564992 00000100:00100000:0.0:1762166979.137108:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450564992 00000100:00100000:0.0:1762166979.137149:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19143 00000100:00100000:0.0:1762166979.137159:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5765180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+19:61861:x1847765450564992:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166979.137176:0:28874:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166979.137192:0:28874:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde200/0x2f180c4effbab9be lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea1d6 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.137217:0:28874:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945cc355a400/0x2f180c4effbab91d lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea19e expref: 20 pid: 8382 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166979.137232:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166979.137234:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166979.137238:0:28874:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde200/0x2f180c4effbab9be lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1d6 expref: 20 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.137263:0:28874:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945cc355a400/0x2f180c4effbab91d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea19e expref: 20 pid: 8382 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166979.137276:0:28874:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945cc355a400/0x2f180c4effbab91d lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea19e expref: 20 pid: 8382 timeout: 698 lvb_type: 1 00000100:00100000:0.0:1762166979.137286:0:28874:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4012300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28874:1847765449744256:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166979.137332:0:28874:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc12ed300 going to sleep for 11 seconds 00000100:00100000:0.0:1762166979.138195:0:28874:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4012300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28874:1847765449744256:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166979.138212:0:28874:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde200/0x2f180c4effbab9be lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1d6 expref: 20 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.138227:0:28874:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bde200, rc 0) 00000100:00100000:0.0:1762166979.138267:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5765180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+20:61861:x1847765450564992:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1109us (1258us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166979.138275:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19143 00000100:00100000:2.0:1762166979.138688:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.138763:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450565120 00000100:00100000:0.0:1762166979.138773:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450565120 00010000:00010000:0.0:1762166979.138818:0:6480:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355a400/0x2f180c4effbab91d lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea19e expref: 20 pid: 8382 timeout: 698 lvb_type: 1 00000100:00100000:0.0:1762166979.138868:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9669 00000100:00100000:0.0:1762166979.138878:0:6480:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7c30c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450565120:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166979.138893:0:6480:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166979.138911:0:6480:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945cc355a400/0x2f180c4effbab91d lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea19e expref: 20 pid: 8382 timeout: 698 lvb_type: 1 00010000:00010000:0.0:1762166979.138934:0:6480:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945cc355a400/0x2f180c4effbab91d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea19e expref: 20 pid: 8382 timeout: 698 lvb_type: 1 00010000:00010000:0.0:1762166979.138959:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cc355a400/0x2f180c4effbab91d lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea19e expref: 20 pid: 8382 timeout: 698 lvb_type: 1 00010000:00010000:0.0:1762166979.138974:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166979.138977:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166979.138982:0:6480:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde200/0x2f180c4effbab9be lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1d6 expref: 19 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.138997:0:6480:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde200/0x2f180c4effbab9be lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1d6 expref: 19 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.139032:0:6480:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde200/0x2f180c4effbab9be lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1d6 expref: 19 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166979.139045:0:6480:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4012300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6480:1847765449744384:192.168.204.38@tcp:105: 00000100:00100000:0.0:1762166979.139121:0:6480:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc12ed300 going to sleep for 11 seconds 00000100:00100000:0.0:1762166979.140132:0:6480:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4012300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6480:1847765449744384:192.168.204.38@tcp:105: 00010000:00010000:0.0:1762166979.140150:0:6480:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166979.140183:0:6480:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7c30c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450565120:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1306us (1504us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166979.140190:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9669 00000100:00100000:3.0:1762166979.140440:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166979.140468:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.140519:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450565248 00000100:00100000:0.0:1762166979.140526:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450565248 00000100:00100000:3.0:1762166979.140537:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.140586:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450565376 00000100:00100000:1.0:1762166979.140588:0:35248:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450565504 00000100:00100000:2.0:1762166979.140594:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450565376 00000100:00100000:1.0:1762166979.140596:0:35248:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450565504 00000100:00100000:0.0:1762166979.140606:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19144 00000100:00100000:0.0:1762166979.140618:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5767800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450565248:12345-192.168.204.38@tcp:2:lfs.0 00000100:00100000:1.0:1762166979.140652:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19145 00000100:00100000:1.0:1762166979.140663:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5764000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450565504:12345-192.168.204.38@tcp:2:lfs.0 00000100:00100000:2.0:1762166979.140674:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19146 00000100:00100000:2.0:1762166979.140688:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5765880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450565376:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:0.0:1762166979.140777:0:8382:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:1.0:1762166979.140782:0:35248:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166979.140783:0:8382:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166979 -> 1762166979 00002000:00010000:1.0:1762166979.140786:0:35248:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166978 -> 1762166979 00002000:00010000:1.0:1762166979.140792:0:35248:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:0.0:1762166979.140792:0:8382:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166979.140801:0:28434:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166979.140805:0:35248:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166979 -> 1762166979 00002000:00010000:0.0:1762166979.140807:0:8382:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166979 -> 1762166979 00002000:00010000:2.0:1762166979.140809:0:28434:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166978 -> 1762166979 00002000:00010000:1.0:1762166979.140811:0:35248:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:0.0:1762166979.140822:0:8382:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 224 -> 224 00002000:00010000:2.0:1762166979.140823:0:28434:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166979.140830:0:28434:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166979 -> 1762166979 00002000:00010000:2.0:1762166979.140834:0:28434:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00000100:00100000:1.0:1762166979.140874:0:35248:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5764000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450565504:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 213us (340us total) trans 17179876513 rc 0/0 00000100:00100000:0.0:1762166979.140887:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5767800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765450565248:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 262us (438us total) trans 17179876512 rc 0/0 00000100:00100000:2.0:1762166979.140892:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5765880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450565376:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 199us (413us total) trans 21474843359 rc 0/0 00000100:00100000:1.0:1762166979.140896:0:35248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19145 00000100:00100000:0.0:1762166979.140911:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19144 00000100:00100000:2.0:1762166979.140921:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19146 00000100:00100000:2.0:1762166979.142070:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166979.142183:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450565760 00000100:00100000:1.0:1762166979.142192:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450565760 00000100:00100000:1.0:1762166979.142242:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11900 00000100:00100000:1.0:1762166979.142251:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+532:61861:x1847765450565760:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:1.0:1762166979.142329:0:6497:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x240000404:0x5eb:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbab8f3 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea189 expref: 532 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.142373:0:6497:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbab9c5 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 00010000:00010000:1.0:1762166979.142387:0:6497:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbab844 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea143 expref: 532 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.142396:0:6497:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbab87c lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea151 expref: 532 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.142404:0:6497:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbab9c5 lrc: 5/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166979.142440:0:6497:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbab87c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea151 expref: 532 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.142455:0:6497:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbab87c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea151 expref: 532 pid: 6494 timeout: 698 lvb_type: 0 00000100:00100000:1.0:1762166979.142471:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4533b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6497:1847765449744512:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166979.142621:0:6497:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbab844 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea143 expref: 532 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.142632:0:6497:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbab844 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea143 expref: 532 pid: 6494 timeout: 698 lvb_type: 0 00000100:00100000:1.0:1762166979.142642:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4531500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6497:1847765449744640:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166979.142665:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cd123b480 going to sleep for 11 seconds 00000100:00100000:1.0:1762166979.143886:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4533b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6497:1847765449744512:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166979.143901:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4531500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6497:1847765449744640:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166979.143925:0:6497:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbab9c5 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00000100:00100000:2.0:1762166979.144039:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.144089:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450566016 00000100:00100000:0.0:1762166979.144097:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450566016 00000100:00100000:2.0:1762166979.144119:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:0.0:1762166979.144130:0:6480:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbab87c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea151 expref: 533 pid: 6494 timeout: 698 lvb_type: 0 00000100:00100000:0.0:1762166979.144184:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450565888 00000100:00100000:0.0:1762166979.144189:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450565888 00010000:00010000:0.0:1762166979.144203:0:6480:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbab844 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea143 expref: 534 pid: 6494 timeout: 698 lvb_type: 0 00000100:00100000:0.0:1762166979.144249:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9670 00000100:00100000:0.0:1762166979.144262:0:6480:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+534:2419:x1847765450566016:12345-192.168.204.38@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1762166979.144271:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9671 00010000:00010000:0.0:1762166979.144286:0:6480:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1762166979.144296:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d20e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+534:2418:x1847765450565888:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166979.144299:0:6480:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbab87c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea151 expref: 534 pid: 6494 timeout: 698 lvb_type: 0 00010000:00010000:3.0:1762166979.144320:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166979.144328:0:6480:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbab87c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea151 expref: 534 pid: 6494 timeout: 698 lvb_type: 0 00010000:00010000:3.0:1762166979.144336:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbab844 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea143 expref: 534 pid: 6494 timeout: 698 lvb_type: 0 00010000:00010000:0.0:1762166979.144383:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbab87c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea151 expref: 534 pid: 6494 timeout: 698 lvb_type: 0 00010000:00010000:3.0:1762166979.144384:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbab844 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea143 expref: 534 pid: 6494 timeout: 698 lvb_type: 0 00010000:00010000:3.0:1762166979.144460:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbab844 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea143 expref: 533 pid: 6494 timeout: 698 lvb_type: 0 00010000:00010000:0.0:1762166979.144464:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:0.0:1762166979.144511:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbab9c5 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166979.144543:0:6480:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbab9c5 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166979.144553:0:6480:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbab9c5 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT1 00010000:00010000:3.0:1762166979.144570:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:3.0:1762166979.144580:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166979.144604:0:6480:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166979.144649:0:6497:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbab9c5 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166979.144659:0:6497:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbab9c5 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00000100:00100000:3.0:1762166979.144674:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d20e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+532:2418:x1847765450565888:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 378us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166979.144674:0:6480:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+532:2419:x1847765450566016:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 403us (624us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166979.144699:0:6497:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbab9cc lrc: 3/0,1 mode: --/EX res: [0x240000404:0x613:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 00000100:00100000:0.0:1762166979.144704:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9670 00000100:00100000:3.0:1762166979.144718:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9671 00010000:00010000:1.0:1762166979.144724:0:6497:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbab932 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x613:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1a5 expref: 532 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.144741:0:6497:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbab940 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x613:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1ac expref: 531 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.144752:0:6497:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbab9cc lrc: 5/0,1 mode: --/EX res: [0x240000404:0x613:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166979.144790:0:6497:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbab940 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x613:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1ac expref: 530 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.144810:0:6497:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbab940 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x613:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1ac expref: 530 pid: 6494 timeout: 698 lvb_type: 0 00000100:00100000:1.0:1762166979.144827:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4531500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6497:1847765449744768:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166979.144923:0:6497:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbab932 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x613:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1a5 expref: 530 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.144934:0:6497:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbab932 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x613:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1a5 expref: 530 pid: 6494 timeout: 698 lvb_type: 0 00000100:00100000:1.0:1762166979.144945:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4533b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6497:1847765449744896:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166979.144978:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cd123b480 going to sleep for 11 seconds 00000100:00100000:2.0:1762166979.146860:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166979.146880:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4531500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6497:1847765449744768:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166979.146897:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4533b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6497:1847765449744896:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166979.146903:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450566144 00010000:00010000:1.0:1762166979.146921:0:6497:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbab9cc lrc: 3/0,1 mode: --/EX res: [0x240000404:0x613:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00000100:00100000:3.0:1762166979.147139:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450566144 00010000:00010000:3.0:1762166979.147166:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbab940 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x613:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1ac expref: 531 pid: 6494 timeout: 698 lvb_type: 0 00000100:00100000:2.0:1762166979.147176:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166979.147242:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450566272 00000100:00100000:3.0:1762166979.147245:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450566272 00010000:00010000:3.0:1762166979.147257:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbab932 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x613:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1a5 expref: 532 pid: 6494 timeout: 698 lvb_type: 0 00000100:00100000:3.0:1762166979.147276:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9672 00000100:00100000:3.0:1762166979.147282:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d21180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+532:2418:x1847765450566144:12345-192.168.204.38@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1762166979.147290:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9673 00010000:00010000:3.0:1762166979.147293:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166979.147299:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbab940 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x613:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1ac expref: 532 pid: 6494 timeout: 698 lvb_type: 0 00000100:00100000:1.0:1762166979.147305:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d23800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+532:2418:x1847765450566272:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166979.147322:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbab940 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x613:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1ac expref: 532 pid: 6494 timeout: 698 lvb_type: 0 00010000:00010000:1.0:1762166979.147324:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166979.147335:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbab932 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x613:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1a5 expref: 532 pid: 6494 timeout: 698 lvb_type: 0 00010000:00010000:3.0:1762166979.147345:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbab940 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x613:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1ac expref: 532 pid: 6494 timeout: 698 lvb_type: 0 00010000:00010000:1.0:1762166979.147351:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbab932 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x613:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1a5 expref: 532 pid: 6494 timeout: 698 lvb_type: 0 00010000:00010000:1.0:1762166979.147378:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbab932 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x613:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1a5 expref: 531 pid: 6494 timeout: 698 lvb_type: 0 00010000:00010000:3.0:1762166979.147379:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x613:0x0].0x0 (ffff945bc4afec00) 00010000:00010000:3.0:1762166979.147386:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbab9cc lrc: 3/0,1 mode: --/EX res: [0x240000404:0x613:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00010000:00010000:3.0:1762166979.147399:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbab9cc lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x613:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT1 00010000:00010000:3.0:1762166979.147407:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbab9cc lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x613:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166979.147416:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x613:0x0].0x0 (ffff945bc4afec00) 00010000:00010000:1.0:1762166979.147420:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166979.147436:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166979.147469:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d21180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+530:2418:x1847765450566144:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 181us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166979.147469:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d23800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+530:2418:x1847765450566272:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 166us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166979.147522:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9672 00010000:00010000:0.0:1762166979.147528:0:6497:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbab9cc lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x613:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00000100:00100000:1.0:1762166979.147530:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9673 00010000:00010000:0.0:1762166979.147551:0:6497:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbab9cc lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x613:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00000100:00100000:0.0:1762166979.147939:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4012300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449745024:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762166979.148005:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166979.148043:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1c8d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166979.148054:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449745024 00000100:00100000:3.0:1762166979.148062:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449745024 00000100:00080000:0.0:1762166979.148118:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1762166979.148125:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1397 00000100:00100000:3.0:1762166979.148136:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4013800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:6497:x1847765449745024:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166979.148239:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4013800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:6497:x1847765449745024:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 105us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166979.148247:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1397 00000100:00100000:0.0:1762166979.148383:0:6497:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 17179876500 gen 2 00000004:00080000:0.0:1762166979.148391:0:6497:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 17179876495 committed transno 17179876500 00000004:00080000:0.0:1762166979.148412:0:6497:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc55df480, transno 17179876496 00000004:00080000:0.0:1762166979.148429:0:6497:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc55de680, transno 17179876497 00000004:00080000:0.0:1762166979.148433:0:6497:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc4492300, transno 17179876498 00000004:00080000:0.0:1762166979.148436:0:6497:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 17179876500 committed transno 17179876500 00000100:00100000:0.0:1762166979.148459:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4012300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449745024:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762166979.148554:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4012300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449745152:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762166979.148592:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1762166979.148618:0:9994:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0001: 1 changes, 0 in progress, 0 in flight, 3 done 00000100:00100000:0.0:1762166979.148625:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011c7000 going to sleep for 11 seconds 00000100:00100000:3.0:1762166979.148649:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449745152 00000100:00100000:3.0:1762166979.148657:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449745152 00000100:00080000:0.0:1762166979.148703:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1762166979.148717:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1398 00000100:00100000:3.0:1762166979.148728:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4012680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:6497:x1847765449745152:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166979.148818:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4012680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:6497:x1847765449745152:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 92us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166979.148829:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1398 00000100:00100000:0.0:1762166979.148866:0:6497:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 21474843355 gen 2 00000004:00080000:0.0:1762166979.148871:0:6497:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf1ddf480, transno 21474843348 00000004:00080000:0.0:1762166979.148889:0:6497:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 21474843351 committed transno 21474843355 00000004:00080000:0.0:1762166979.148903:0:6497:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc4010000, transno 21474843352 00000004:00080000:0.0:1762166979.148909:0:6497:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc4012d80, transno 21474843353 00000004:00080000:0.0:1762166979.148916:0:6497:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc4013b80, transno 21474843354 00000004:00080000:0.0:1762166979.148920:0:6497:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 21474843355 committed transno 21474843355 00000100:00100000:0.0:1762166979.148931:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4012300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449745152:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762166979.148995:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4012300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449745280:0@lo:1000:mdt_rdpg00_000.0 00000004:00080000:2.0:1762166979.149002:0:9158:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0001: 1 changes, 1 in progress, 0 in flight, 3 done 00000100:00100000:0.0:1762166979.149025:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166979.149049:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc11cad80 going to sleep for 11 seconds 00000100:00100000:3.0:1762166979.149071:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449745280 00000100:00100000:3.0:1762166979.149076:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449745280 00000100:00100000:3.0:1762166979.149114:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1399 00000100:00100000:3.0:1762166979.149128:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4011c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:6497:x1847765449745280:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166979.149196:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4011c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:6497:x1847765449745280:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 65us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166979.149205:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1399 00000100:00100000:0.0:1762166979.149219:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4012300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449745280:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762166979.149250:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4012300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449745408:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762166979.149269:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166979.149288:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1c8dd80 going to sleep for 11 seconds 00000100:00100000:3.0:1762166979.149303:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449745408 00000100:00100000:3.0:1762166979.149307:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449745408 00000100:00100000:3.0:1762166979.149344:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1400 00000100:00100000:3.0:1762166979.149351:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4013480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:6497:x1847765449745408:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166979.149412:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4013480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:6497:x1847765449745408:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 61us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166979.149420:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1400 00000100:00100000:0.0:1762166979.149526:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4012300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449745408:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762166979.149563:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4012300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449745536:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762166979.149585:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166979.149605:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1c8dc00 going to sleep for 11 seconds 00000100:00100000:3.0:1762166979.149610:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449745536 00000100:00100000:3.0:1762166979.149616:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449745536 00000100:00100000:3.0:1762166979.149645:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1401 00000100:00100000:3.0:1762166979.149652:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4011180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:6497:x1847765449745536:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1762166979.149710:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4011180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:6497:x1847765449745536:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 57us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166979.149718:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1401 00000100:00100000:0.0:1762166979.149723:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4012300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449745536:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762166979.149764:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4012300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449745664:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762166979.149785:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166979.149813:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1c8dc00 going to sleep for 11 seconds 00000100:00100000:1.0:1762166979.149879:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449745664 00000100:00100000:1.0:1762166979.149884:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449745664 00000100:00100000:1.0:1762166979.149913:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1402 00000100:00100000:1.0:1762166979.149923:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4011f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:6497:x1847765449745664:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762166979.149985:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4011f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:6497:x1847765449745664:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 64us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166979.149991:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1402 00000100:00100000:0.0:1762166979.150045:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4012300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449745664:0@lo:1000:mdt_rdpg00_000.0 00000040:00080000:0.0:1762166979.150204:0:6497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x2:0x0].54, 456 off68480 00000001:00080000:0.0:1762166979.150217:0:6497:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992238 00000100:00100000:0.0:1762166979.150269:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4012300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449745792:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762166979.150290:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166979.150314:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1c8dc00 going to sleep for 11 seconds 00000100:00100000:1.0:1762166979.150352:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449745792 00000100:00100000:1.0:1762166979.150356:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449745792 00000100:00100000:1.0:1762166979.150389:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1403 00000100:00100000:1.0:1762166979.150396:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4010e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:6497:x1847765449745792:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762166979.150539:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4010e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:6497:x1847765449745792:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 142us (246us total) trans 17179876514 rc 0/0 00000100:00100000:1.0:1762166979.150549:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1403 00000100:00100000:0.0:1762166979.150560:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4012300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449745792:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762166979.150587:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4013100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449745920:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1762166979.150614:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166979.150637:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1c8dc00 going to sleep for 11 seconds 00000100:00100000:1.0:1762166979.150648:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449745920 00000100:00100000:1.0:1762166979.150654:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449745920 00000100:00100000:1.0:1762166979.150682:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1404 00000100:00100000:1.0:1762166979.150688:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4010a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:6497:x1847765449745920:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762166979.150776:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4010a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:6497:x1847765449745920:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 87us (160us total) trans 21474843360 rc 0/0 00000100:00100000:1.0:1762166979.150784:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1404 00000100:00100000:0.0:1762166979.150794:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4013100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449745920:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1762166979.150837:0:6497:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992239 00010000:00010000:0.0:1762166979.150870:0:6497:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbab9cc lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x613:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166979.150879:0:6497:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbab9cc lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x613:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166979.150887:0:6497:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbab9cc lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x613:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166979.150893:0:6497:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355aa00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166979.150898:0:6497:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbab9cc lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x613:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166979.150907:0:6497:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbab9cc lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x613:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166979.150935:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x613:0x0].0x0 (ffff945bc4afec00) 00010000:00010000:0.0:1762166979.150939:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166979.150944:0:6497:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbab9cc lrc: 2/0,0 mode: --/EX res: [0x240000404:0x613:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166979.150950:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbab9cc lrc: 0/0,0 mode: --/EX res: [0x240000404:0x613:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166979.150965:0:6497:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbab9c5 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166979.150971:0:6497:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbab9c5 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166979.150980:0:6497:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbab9c5 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166979.150986:0:6497:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355b800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166979.150989:0:6497:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbab9c5 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166979.150995:0:6497:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbab9c5 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166979.151003:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:0.0:1762166979.151005:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166979.151008:0:6497:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbab9c5 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166979.151014:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbab9c5 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166979.151026:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:0.0:1762166979.151028:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166979.151035:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbab8f3 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea189 expref: 531 pid: 6494 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166979.151137:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+530:61861:x1847765450565760:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 8887us (9068us total) trans 4294992240 rc 0/0 00000100:00100000:0.0:1762166979.151144:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11900 00000020:00080000:0.0:1762166979.151148:0:6497:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1762166979.152414:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166979.152468:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450566400 00000100:00100000:1.0:1762166979.152494:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450566400 00000100:00100000:1.0:1762166979.152537:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30611 00000100:00100000:1.0:1762166979.152546:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+530:61861:x1847765450566400:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166979.152565:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166979.152579:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbab9d3 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea1dd expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.152622:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbab9d3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1dd expref: 531 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.152632:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbab9d3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1dd expref: 531 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.152644:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:1.0:1762166979.152646:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166979.152648:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355b400, rc 0) 00000100:00100000:1.0:1762166979.152690:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+531:61861:x1847765450566400:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 146us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166979.152698:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30611 00000100:00100000:2.0:1762166979.154695:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.154784:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450566656 00000100:00100000:0.0:1762166979.154793:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450566656 00000100:00100000:0.0:1762166979.154844:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11901 00000100:00100000:0.0:1762166979.154865:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+531:61861:x1847765450566656:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166979.155069:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+532:61861:x1847765450566656:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 206us (381us total) trans 4294992241 rc 0/0 00000100:00100000:0.0:1762166979.155077:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11901 00000100:00100000:2.0:1762166979.156648:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166979.157094:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450566912 00000100:00100000:3.0:1762166979.157102:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450566912 00000100:00100000:3.0:1762166979.157152:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11902 00000100:00100000:3.0:1762166979.157162:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+532:61861:x1847765450566912:12345-192.168.204.38@tcp:35:lfs.0 00000004:00080000:3.0:1762166979.157324:0:19593:0:(mdd_object.c:3965:mdd_close()) Object [0x240000404:0x613:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:3.0:1762166979.157400:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473a00/0x2f180c4effbab9da lrc: 3/0,1 mode: --/PW res: [0x240000404:0x613:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166979.157416:0:19593:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473a00/0x2f180c4effbab9da lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x613:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166979.157428:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473a00/0x2f180c4effbab9da lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x613:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166979.157437:0:19593:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473a00/0x2f180c4effbab9da lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x613:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166979.157443:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473a00/0x2f180c4effbab9da lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x613:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166979.157448:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473a00/0x2f180c4effbab9da lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x613:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166979.157506:0:19593:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1762166979.157587:0:7420:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1762166979.157601:0:7420:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473a00/0x2f180c4effbab9da lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x613:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166979.157613:0:7420:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8473a00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166979.157618:0:7420:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473a00/0x2f180c4effbab9da lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x613:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166979.157628:0:7420:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473a00/0x2f180c4effbab9da lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x613:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166979.157651:0:7420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x613:0x0].0x0 (ffff945bc4afec00) 00010000:00010000:0.0:1762166979.157655:0:7420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1762166979.157661:0:7420:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473a00/0x2f180c4effbab9da lrc: 1/0,0 mode: --/PW res: [0x240000404:0x613:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166979.157668:0:7420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473a00/0x2f180c4effbab9da lrc: 0/0,0 mode: --/PW res: [0x240000404:0x613:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166979.157689:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166979.157693:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166979.157698:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1762166979.157773:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+533:61861:x1847765450566912:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 610us (1125us total) trans 4294992242 rc 0/0 00000100:00100000:2.0:1762166979.157784:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11902 00000100:00100000:2.0:1762166979.171253:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166979.171965:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450567040 00000100:00100000:1.0:1762166979.171976:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450567040 00000100:00100000:1.0:1762166979.172038:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30612 00000100:00100000:1.0:1762166979.172049:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+533:61862:x1847765450567040:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166979.172074:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166979.172097:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbab9e1 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea1e4 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.172158:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbab9e8 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166979.172173:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbab9e8 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.172184:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbab9e8 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.172195:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbab9ef lrc: 3/1,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166979.172202:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbab9ef lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.172209:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbab9ef lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.172286:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a000/0x2f180c4effbab9f6 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166979.172294:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a000/0x2f180c4effbab9f6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.172301:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a000/0x2f180c4effbab9f6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:1.0:1762166979.172341:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 262144 00000004:00200000:1.0:1762166979.172346:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166979.172363:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a000/0x2f180c4effbab9f6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.172374:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a000/0x2f180c4effbab9f6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.172381:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbab9e8 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.172387:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbab9e8 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.172393:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbab9e8 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.172399:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbab9e8 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.172405:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355a600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166979.172409:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbab9e8 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.172415:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbab9e8 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.172427:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:1.0:1762166979.172430:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166979.172435:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbab9e8 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.172441:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbab9e8 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.172453:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbab9ef lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.172458:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbab9ef lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.172463:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbab9ef lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.172468:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355b200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166979.172471:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbab9ef lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.172495:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbab9ef lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.172503:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0xdd396665 (ffff945bc812e000) 00010000:00010000:1.0:1762166979.172505:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166979.172508:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbab9ef lrc: 2/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.172513:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbab9ef lrc: 0/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.172545:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbab9e1 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1e4 expref: 535 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.172565:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a000/0x2f180c4effbab9f6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1e4 expref: 534 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.172578:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:1.0:1762166979.172581:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166979.172583:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355a000, rc 0) 00000100:00100000:1.0:1762166979.172647:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+534:61862:x1847765450567040:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 600us (1402us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166979.172655:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30612 00000100:00100000:3.0:1762166979.175184:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166979.175966:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450567296 00000100:00100000:1.0:1762166979.175981:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450567296 00000100:00100000:1.0:1762166979.176060:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30613 00000100:00100000:1.0:1762166979.176071:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5766300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+534:61862:x1847765450567296:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166979.176092:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166979.176110:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbab9fd lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea1eb expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.176220:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbaba04 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166979.176234:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbaba04 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.176245:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbaba04 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:1.0:1762166979.176255:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 262144 00010000:00010000:1.0:1762166979.176356:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbab9fd lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1eb expref: 537 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.176374:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbaba04 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1eb expref: 536 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.176383:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:1.0:1762166979.176386:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1762166979.176389:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355a200, rc 0) 00000100:00100000:1.0:1762166979.176442:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5766300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+536:61862:x1847765450567296:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 374us (1271us total) trans 4294992243 rc 0/0 00000100:00100000:1.0:1762166979.176449:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30613 00000100:00100000:3.0:1762166979.179570:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166979.179829:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450567552 00000100:00100000:1.0:1762166979.179839:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450567552 00000100:00100000:1.0:1762166979.179907:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30614 00000100:00100000:1.0:1762166979.179917:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+536:61862:x1847765450567552:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166979.179938:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166979.179955:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbaba12 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea1f2 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.180048:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbaba19 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166979.180060:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbaba19 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.180070:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbaba19 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:1.0:1762166979.180081:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 262144 00010000:00010000:1.0:1762166979.180169:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbaba12 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1f2 expref: 539 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.180185:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbaba19 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1f2 expref: 538 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.180193:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:1.0:1762166979.180195:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762166979.180198:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355ae00, rc 0) 00000100:00100000:1.0:1762166979.180254:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+538:61862:x1847765450567552:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 338us (697us total) trans 4294992244 rc 0/0 00000100:00100000:1.0:1762166979.180261:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30614 00000100:00100000:2.0:1762166979.207995:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.208445:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450567680 00000100:00100000:0.0:1762166979.208456:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450567680 00000100:00100000:0.0:1762166979.208659:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2461 00000100:00100000:0.0:1762166979.208679:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450567680:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:0.0:1762166979.208726:0:8388:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbaba27 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.208749:0:8388:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbab9b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1c8 expref: 21 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.208758:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166979.208760:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166979.208764:0:8388:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbaba27 lrc: 4/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.208824:0:8388:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbab9b0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1c8 expref: 21 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.208841:0:8388:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbab9b0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1c8 expref: 21 pid: 28874 timeout: 698 lvb_type: 0 00000100:00100000:0.0:1762166979.208873:0:8388:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4013b80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:8388:1847765449746048:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166979.209004:0:8388:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1c8da80 going to sleep for 11 seconds 00000100:00100000:2.0:1762166979.211317:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.211332:0:8388:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4013b80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:8388:1847765449746048:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166979.211370:0:8388:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbaba27 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166979.211420:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450567808 00000100:00100000:1.0:1762166979.211430:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450567808 00010000:00010000:1.0:1762166979.211469:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbab9b0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1c8 expref: 22 pid: 28874 timeout: 698 lvb_type: 0 00000100:00100000:1.0:1762166979.211544:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9674 00000100:00100000:1.0:1762166979.211556:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450567808:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166979.211571:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166979.211592:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbab9b0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1c8 expref: 22 pid: 28874 timeout: 698 lvb_type: 0 00010000:00010000:1.0:1762166979.211606:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbab9b0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1c8 expref: 22 pid: 28874 timeout: 698 lvb_type: 0 00010000:00010000:1.0:1762166979.211630:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbab9b0 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1c8 expref: 22 pid: 28874 timeout: 698 lvb_type: 0 00010000:00010000:1.0:1762166979.211646:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166979.211648:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166979.211653:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbaba27 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.211663:0:9458:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbaba27 lrc: 4/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.211694:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166979.211728:0:8388:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbaba27 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.211739:0:8388:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbaba27 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166979.211747:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450567808:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 191us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166979.211761:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9674 00010000:00010000:0.0:1762166979.214143:0:8388:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbaba27 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.214165:0:8388:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbaba27 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.214175:0:8388:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbaba27 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.214183:0:8388:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdfe00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166979.214188:0:8388:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbaba27 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.214198:0:8388:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbaba27 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.214219:0:8388:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbaba27 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.214227:0:8388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbaba27 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166979.214407:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450567680:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 5729us (6416us total) trans 0 rc 262144/262144 00000100:00100000:0.0:1762166979.214420:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2461 00000100:00100000:3.0:1762166979.216547:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166979.216585:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.216620:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450567936 00000100:00100000:2.0:1762166979.216629:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450567936 00000100:00100000:2.0:1762166979.216676:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450568064 00000100:00100000:2.0:1762166979.216679:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450568064 00000100:00100000:2.0:1762166979.216705:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19147 00000100:00100000:2.0:1762166979.216713:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450567936:12345-192.168.204.38@tcp:101:lfs.0 00000100:00100000:3.0:1762166979.216720:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19148 00010000:00010000:2.0:1762166979.216729:0:35247:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1762166979.216744:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450568064:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166979.216744:0:35247:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbaba2e lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea1f9 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166979.216763:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166979.216777:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc8472400/0x2f180c4effbaba35 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea200 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166979.216799:0:35247:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc48ab100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:35247:1847765449746176:192.168.204.38@tcp:106: 00000100:00100000:3.0:1762166979.216822:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bc2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765449746304:192.168.204.38@tcp:106: 00000100:00100000:3.0:1762166979.216896:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf3a33cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166979.216896:0:35247:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc6399cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166979.218348:0:35247:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc48ab100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:35247:1847765449746176:192.168.204.38@tcp:106: 00000100:00100000:0.0:1762166979.218351:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bc2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765449746304:192.168.204.38@tcp:106: 00010000:00010000:2.0:1762166979.218392:0:35247:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbaba2e lrc: 1/0,0 mode: --/PR res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1f9 expref: 21 pid: 35247 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166979.218398:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc8472400/0x2f180c4effbaba35 lrc: 1/0,0 mode: --/PR res: [0x280000400:0xa8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea200 expref: 19 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166979.218439:0:35247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbaba2e lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1f9 expref: 21 pid: 35247 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166979.218449:0:28434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc8472400/0x2f180c4effbaba35 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea200 expref: 19 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166979.218519:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8472400, rc 0) 00010000:00010000:2.0:1762166979.218526:0:35247:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa8800, rc 0) 00000100:00100000:0.0:1762166979.218587:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450568064:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1856us (1998us total) trans 0 rc 301/301 00000100:00100000:2.0:1762166979.218592:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450567936:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1877us (2051us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166979.218604:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19148 00000100:00100000:2.0:1762166979.218614:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19147 00000100:00100000:0.0:1762166979.220221:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.220272:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450568192 00000100:00100000:2.0:1762166979.220280:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450568192 00000100:00100000:2.0:1762166979.220348:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2462 00000100:00100000:2.0:1762166979.220359:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4013b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:2416:x1847765450568192:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:2.0:1762166979.220403:0:8388:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbaba3c lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.220418:0:8388:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbab986 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1c1 expref: 20 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.220426:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166979.220428:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166979.220432:0:8388:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbaba3c lrc: 4/1,0 mode: --/PR res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.220462:0:8388:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbab986 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1c1 expref: 20 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.220507:0:8388:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbab986 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1c1 expref: 20 pid: 28874 timeout: 698 lvb_type: 0 00000100:00100000:2.0:1762166979.220529:0:8388:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc48ab100 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:8388:1847765449746432:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166979.220602:0:8388:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc6399cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166979.221608:0:8388:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc48ab100 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:8388:1847765449746432:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166979.221623:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:2.0:1762166979.221630:0:8388:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbaba3c lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166979.221758:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450568320 00000100:00100000:1.0:1762166979.221764:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450568320 00010000:00010000:1.0:1762166979.221790:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbab986 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1c1 expref: 21 pid: 28874 timeout: 698 lvb_type: 0 00000100:00100000:1.0:1762166979.221826:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9675 00000100:00100000:1.0:1762166979.221834:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450568320:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166979.221857:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166979.221874:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbab986 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1c1 expref: 21 pid: 28874 timeout: 698 lvb_type: 0 00010000:00010000:1.0:1762166979.221886:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbab986 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1c1 expref: 21 pid: 28874 timeout: 698 lvb_type: 0 00010000:00010000:1.0:1762166979.221906:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbab986 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1c1 expref: 21 pid: 28874 timeout: 698 lvb_type: 0 00010000:00010000:1.0:1762166979.221928:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166979.221930:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166979.221935:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbaba3c lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.221943:0:9458:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbaba3c lrc: 4/1,0 mode: PR/PR res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.221970:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166979.222014:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450568320:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 180us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166979.222022:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9675 00010000:00010000:2.0:1762166979.222033:0:8388:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbaba3c lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.222043:0:8388:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbaba3c lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.224717:0:8388:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbaba3c lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.224734:0:8388:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbaba3c lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.224744:0:8388:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbaba3c lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.224750:0:8388:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa9c00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166979.224754:0:8388:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbaba3c lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.224763:0:8388:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbaba3c lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.224780:0:8388:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbaba3c lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.224791:0:8388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbaba3c lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166979.224883:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4013b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:2416:x1847765450568192:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 4522us (4664us total) trans 0 rc 262144/262144 00000100:00100000:2.0:1762166979.224893:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2462 00000100:00100000:3.0:1762166979.232547:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.232644:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450568448 00000100:00100000:0.0:1762166979.232663:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450568448 00000100:00100000:0.0:1762166979.232754:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 883 00000100:00100000:0.0:1762166979.232768:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7c30050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+538:61862:x1847765450568448:12345-192.168.204.38@tcp:103:lfs.0 00010000:00010000:0.0:1762166979.232790:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166979.232822:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbaba19 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1f2 expref: 538 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.232858:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:0.0:1762166979.232865:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166979.232942:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7c30050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+537:61862:x1847765450568448:12345-192.168.204.38@tcp:103:lfs.0 Request processed in 177us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166979.232951:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 883 00000100:00100000:0.0:1762166979.234196:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.234249:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450568704 00000100:00100000:2.0:1762166979.234263:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450568704 00000100:00100000:2.0:1762166979.234316:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11903 00000100:00100000:2.0:1762166979.234331:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4010000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+537:61862:x1847765450568704:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:2.0:1762166979.234618:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4010000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+538:61862:x1847765450568704:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 294us (426us total) trans 4294992245 rc 0/0 00000100:00100000:2.0:1762166979.234628:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11903 00000100:00100000:3.0:1762166979.237655:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166979.237720:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450568960 00000100:00100000:1.0:1762166979.237729:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450568960 00000100:00100000:1.0:1762166979.237789:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30615 00000100:00100000:1.0:1762166979.237799:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+538:61766:x1847765450568960:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:1.0:1762166979.237819:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166979.237839:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbaba43 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea207 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.237943:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbaba4a lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166979.237954:0:6495:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a000/0x2f180c4effbab9f6 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1e4 expref: 539 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.237960:0:6495:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbaba4a lrc: 4/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.237983:0:6495:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a000/0x2f180c4effbab9f6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1e4 expref: 539 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.237992:0:6495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a000/0x2f180c4effbab9f6 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1e4 expref: 539 pid: 6495 timeout: 698 lvb_type: 0 00000100:00100000:1.0:1762166979.238002:0:6495:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4533b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6495:1847765449746560:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166979.238077:0:6495:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccb393cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166979.238904:0:6495:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4533b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6495:1847765449746560:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166979.238918:0:6495:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbaba4a lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000100:00100000:3.0:1762166979.239114:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.239146:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450569088 00000100:00100000:0.0:1762166979.239151:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450569088 00010000:00010000:0.0:1762166979.239172:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a000/0x2f180c4effbab9f6 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1e4 expref: 540 pid: 6495 timeout: 698 lvb_type: 0 00000100:00100000:0.0:1762166979.239202:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9676 00000100:00100000:0.0:1762166979.239210:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+540:2418:x1847765450569088:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166979.239231:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166979.239238:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a000/0x2f180c4effbab9f6 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1e4 expref: 540 pid: 6495 timeout: 698 lvb_type: 0 00010000:00010000:0.0:1762166979.239255:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a000/0x2f180c4effbab9f6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1e4 expref: 540 pid: 6495 timeout: 698 lvb_type: 0 00010000:00010000:0.0:1762166979.239274:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a000/0x2f180c4effbab9f6 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1e4 expref: 540 pid: 6495 timeout: 698 lvb_type: 0 00010000:00010000:0.0:1762166979.239287:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:0.0:1762166979.239290:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbaba4a lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166979.239295:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbaba4a lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166979.239300:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbaba4a lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166979.239316:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166979.239347:0:6495:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbaba4a lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000100:00100000:0.0:1762166979.239354:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+539:2418:x1847765450569088:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 143us (239us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166979.239361:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbaba4a lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000100:00100000:0.0:1762166979.239367:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9676 00000004:00200000:1.0:1762166979.239388:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 262144 00010000:00010000:1.0:1762166979.239533:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbaba43 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea207 expref: 540 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.239548:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbaba4a lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea207 expref: 539 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.239555:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:1.0:1762166979.239558:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1762166979.239561:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355bc00, rc 0) 00000100:00100000:1.0:1762166979.239608:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+539:61766:x1847765450568960:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 1810us (1965us total) trans 4294992246 rc 0/0 00000100:00100000:1.0:1762166979.239614:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30615 00000100:00100000:3.0:1762166979.240748:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166979.240781:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450569216 00000100:00100000:1.0:1762166979.240786:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450569216 00000100:00100000:1.0:1762166979.240814:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30616 00000100:00100000:1.0:1762166979.240819:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+539:61766:x1847765450569216:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:1.0:1762166979.240833:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166979.240853:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbaba58 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea20e expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.240910:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbaba5f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166979.240918:0:6495:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbaba4a lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea207 expref: 540 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.240925:0:6495:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbaba5f lrc: 4/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.240950:0:6495:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbaba4a lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea207 expref: 540 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.240962:0:6495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbaba4a lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea207 expref: 540 pid: 6495 timeout: 698 lvb_type: 0 00000100:00100000:1.0:1762166979.240975:0:6495:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4533b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6495:1847765449746688:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166979.241029:0:6495:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cca8ae300 going to sleep for 11 seconds 00000100:00100000:1.0:1762166979.241917:0:6495:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4533b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6495:1847765449746688:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166979.241936:0:6495:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbaba5f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000100:00100000:3.0:1762166979.241986:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.242038:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450569344 00000100:00100000:0.0:1762166979.242047:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450569344 00010000:00010000:0.0:1762166979.242084:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbaba4a lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea207 expref: 541 pid: 6495 timeout: 698 lvb_type: 0 00000100:00100000:0.0:1762166979.242137:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9677 00000100:00100000:0.0:1762166979.242149:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+541:2419:x1847765450569344:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166979.242167:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166979.242175:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbaba4a lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea207 expref: 541 pid: 6495 timeout: 698 lvb_type: 0 00010000:00010000:0.0:1762166979.242190:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbaba4a lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea207 expref: 541 pid: 6495 timeout: 698 lvb_type: 0 00010000:00010000:0.0:1762166979.242212:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbaba4a lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea207 expref: 541 pid: 6495 timeout: 698 lvb_type: 0 00010000:00010000:0.0:1762166979.242230:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:0.0:1762166979.242235:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbaba5f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166979.242245:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbaba5f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166979.242253:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbaba5f lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166979.242288:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166979.242327:0:6495:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbaba5f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.242342:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbaba5f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000100:00100000:0.0:1762166979.242350:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+540:2419:x1847765450569344:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 202us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166979.242360:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9677 00000004:00200000:1.0:1762166979.242400:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 262144 00000004:00200000:1.0:1762166979.242406:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166979.242431:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbaba5f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.242463:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbaba58 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea20e expref: 540 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.242522:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbaba5f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea20e expref: 539 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.242536:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:1.0:1762166979.242540:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166979.242543:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355b200, rc 0) 00000100:00100000:1.0:1762166979.242588:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+539:61766:x1847765450569216:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 1766us (1839us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166979.242597:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30616 00000100:00100000:3.0:1762166979.244216:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.244322:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450569472 00000100:00100000:2.0:1762166979.244330:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450569472 00000100:00100000:2.0:1762166979.244382:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19149 00000100:00100000:2.0:1762166979.244392:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450569472:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:2.0:1762166979.244411:0:35247:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1762166979.244432:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:2.0:1762166979.244433:0:35247:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbaba66 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea215 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166979.244460:0:35247:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa8c:0x0] initial LVB size: 262144, mtime: 0x690888c3, atime: 0x690888c2, ctime: 0x690888c3, blocks: 0x40 00010000:00010000:2.0:1762166979.244518:0:35247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166979.244521:0:35247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1762166979.244530:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450569600 00010000:00010000:2.0:1762166979.244531:0:35247:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbaba66 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea215 expref: 20 pid: 35247 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1762166979.244537:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450569600 00010000:00010000:2.0:1762166979.244555:0:35247:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbaba66 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea215 expref: 20 pid: 35247 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166979.244569:0:35247:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa8e00, rc 0) 00000100:00100000:0.0:1762166979.244574:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19150 00000100:00100000:0.0:1762166979.244584:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450569600:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:0.0:1762166979.244593:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166979.244611:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdec00/0x2f180c4effbaba6d lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea21c expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166979.244616:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450569472:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 224us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166979.244631:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19149 00000100:00100000:0.0:1762166979.244673:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4012d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765449746816:192.168.204.38@tcp:106: 00000100:00100000:0.0:1762166979.244743:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1c8d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166979.246029:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4012d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765449746816:192.168.204.38@tcp:106: 00010000:00010000:0.0:1762166979.246061:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdec00/0x2f180c4effbaba6d lrc: 1/0,0 mode: --/PR res: [0x280000400:0xa8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea21c expref: 19 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166979.246079:0:28434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdec00/0x2f180c4effbaba6d lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea21c expref: 19 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166979.246092:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdec00, rc 0) 00000100:00100000:0.0:1762166979.246143:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450569600:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 1560us (1712us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166979.246151:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19150 00000100:00100000:3.0:1762166979.247581:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.247631:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450569728 00000100:00100000:0.0:1762166979.247638:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450569728 00000100:00100000:0.0:1762166979.247683:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19151 00000100:00100000:0.0:1762166979.247693:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+18:2417:x1847765450569728:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:0.0:1762166979.247709:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166979.247725:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde600/0x2f180c4effbaba74 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea223 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166979.247778:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4012d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765449746944:192.168.204.38@tcp:106: 00000100:00100000:0.0:1762166979.247842:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1c8d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166979.248907:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4012d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765449746944:192.168.204.38@tcp:106: 00010000:00010000:0.0:1762166979.248937:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde600/0x2f180c4effbaba74 lrc: 1/0,0 mode: --/PR res: [0x280000400:0xa8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea223 expref: 19 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166979.248954:0:28434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde600/0x2f180c4effbaba74 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea223 expref: 19 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166979.248964:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bde600, rc 0) 00000100:00100000:0.0:1762166979.249011:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+18:2417:x1847765450569728:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 1320us (1436us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166979.249018:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19151 00000100:00100000:3.0:1762166979.250430:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.250503:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450569856 00000100:00100000:0.0:1762166979.250511:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450569856 00000100:00100000:0.0:1762166979.250552:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19152 00000100:00100000:0.0:1762166979.250562:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+18:2417:x1847765450569856:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:0.0:1762166979.250576:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166979.250591:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfc00/0x2f180c4effbaba7b lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea22a expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166979.250639:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4012d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765449747072:192.168.204.38@tcp:106: 00000100:00100000:0.0:1762166979.250702:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1c8d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166979.251687:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4012d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765449747072:192.168.204.38@tcp:106: 00010000:00010000:0.0:1762166979.251709:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfc00/0x2f180c4effbaba7b lrc: 1/0,0 mode: --/PR res: [0x280000400:0xa8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea22a expref: 19 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166979.251725:0:28434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfc00/0x2f180c4effbaba7b lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea22a expref: 19 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166979.251735:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdfc00, rc 0) 00000100:00100000:0.0:1762166979.251772:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+18:2417:x1847765450569856:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 1212us (1346us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166979.251780:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19152 00000100:00100000:3.0:1762166979.253121:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.253201:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450569984 00000100:00100000:0.0:1762166979.253208:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450569984 00000100:00100000:0.0:1762166979.253240:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19153 00000100:00100000:0.0:1762166979.253246:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc576a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+18:2416:x1847765450569984:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:0.0:1762166979.253256:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166979.253264:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf000/0x2f180c4effbaba82 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea231 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166979.253295:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4012d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765449747200:192.168.204.38@tcp:106: 00000100:00100000:0.0:1762166979.253352:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1c8d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166979.254135:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4012d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765449747200:192.168.204.38@tcp:106: 00010000:00010000:0.0:1762166979.254151:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf000/0x2f180c4effbaba82 lrc: 1/0,0 mode: --/PR res: [0x280000400:0xa8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea231 expref: 19 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166979.254162:0:28434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf000/0x2f180c4effbaba82 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea231 expref: 19 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166979.254170:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdf000, rc 0) 00000100:00100000:0.0:1762166979.254197:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc576a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+18:2416:x1847765450569984:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 951us (1080us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166979.254202:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19153 00000100:00100000:3.0:1762166979.255231:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.255288:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450570112 00000100:00100000:0.0:1762166979.255296:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450570112 00000100:00100000:0.0:1762166979.255364:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19154 00000100:00100000:0.0:1762166979.255372:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc576b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+20:61766:x1847765450570112:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:0.0:1762166979.255386:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166979.255404:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbaba89 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea238 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.255428:0:28434:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbaba66 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea215 expref: 21 pid: 35247 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166979.255434:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166979.255436:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166979.255439:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbaba89 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 3 type: EXT [16384->20479] (req 16384->20479) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea238 expref: 21 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.255462:0:28434:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbaba66 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea215 expref: 21 pid: 35247 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166979.255472:0:28434:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbaba66 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea215 expref: 21 pid: 35247 timeout: 698 lvb_type: 1 00000100:00100000:0.0:1762166979.255511:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4012d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765449747328:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166979.255593:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1c8d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166979.256355:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4012d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765449747328:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166979.256376:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbaba89 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 3 type: EXT [16384->20479] (req 16384->20479) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea238 expref: 21 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.256390:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdf200, rc 0) 00000100:00100000:0.0:1762166979.256432:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc576b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+21:61766:x1847765450570112:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 1060us (1209us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166979.256441:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19154 00000100:00100000:3.0:1762166979.256759:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.256860:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450570240 00000100:00100000:0.0:1762166979.256866:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450570240 00010000:00010000:0.0:1762166979.256890:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbaba66 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea215 expref: 21 pid: 35247 timeout: 698 lvb_type: 1 00000100:00100000:0.0:1762166979.256927:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9678 00000100:00100000:0.0:1762166979.256935:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5769500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450570240:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166979.256947:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166979.256970:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbaba66 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea215 expref: 21 pid: 35247 timeout: 698 lvb_type: 1 00010000:00010000:0.0:1762166979.256984:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbaba66 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea215 expref: 21 pid: 35247 timeout: 698 lvb_type: 1 00010000:00010000:0.0:1762166979.257013:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbaba66 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea215 expref: 21 pid: 35247 timeout: 698 lvb_type: 1 00010000:00010000:0.0:1762166979.257026:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166979.257028:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166979.257036:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbaba89 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->20479) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea238 expref: 20 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.257046:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbaba89 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->20479) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea238 expref: 20 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.257072:0:6481:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbaba89 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->20479) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea238 expref: 20 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166979.257084:0:6481:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4012d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6481:1847765449747456:192.168.204.38@tcp:105: 00000100:00100000:0.0:1762166979.257131:0:6481:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1c8d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166979.257939:0:6481:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4012d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6481:1847765449747456:192.168.204.38@tcp:105: 00010000:00010000:0.0:1762166979.257949:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166979.257980:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5769500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450570240:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1047us (1223us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166979.257985:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9678 00000100:00100000:3.0:1762166979.258273:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.258318:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450570368 00000100:00100000:2.0:1762166979.258329:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450570368 00002000:00100000:2.0:1762166979.258374:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa8c:0x0] (16384->20479) req@ffff945bc5768a80 x1847765450570368/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:10/0 lens 488/0 e 0 to 0 dl 1762166990 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166979.258384:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5768a80 with x1847765450570368 ext(16384->20479) 00002000:00010000:2.0:1762166979.258389:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5768a80 00000100:00100000:2.0:1762166979.258412:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2463 00000100:00100000:2.0:1762166979.258420:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5768a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450570368:12345-192.168.204.38@tcp:3:lfs.0 00000100:00100000:2.0:1762166979.258592:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5768a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450570368:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 172us (327us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1762166979.258600:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2463 00002000:00100000:2.0:1762166979.258607:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa8c:0x0] (16384->20479) req@ffff945bc5768a80 x1847765450570368/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:10/0 lens 488/4536 e 0 to 0 dl 1762166990 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166979.258615:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5768a80 with x1847765450570368 ext(16384->20479) 00002000:00010000:2.0:1762166979.258618:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5768a80 00000100:00100000:3.0:1762166979.259780:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.259822:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450570624 00000100:00100000:2.0:1762166979.259827:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450570624 00000100:00100000:2.0:1762166979.259875:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11904 00000100:00100000:2.0:1762166979.259888:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7be2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+539:61766:x1847765450570624:12345-192.168.204.38@tcp:35:fsx.0 00000100:00100000:2.0:1762166979.260083:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7be2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+540:61766:x1847765450570624:12345-192.168.204.38@tcp:35:fsx.0 Request processed in 199us (302us total) trans 4294992247 rc 0/0 00000100:00100000:2.0:1762166979.260091:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11904 00000100:00100000:3.0:1762166979.261011:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166979.261070:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450570880 00000100:00100000:1.0:1762166979.261081:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450570880 00000100:00100000:1.0:1762166979.261146:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30617 00000100:00100000:1.0:1762166979.261159:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5769880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+540:61766:x1847765450570880:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:1.0:1762166979.261184:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166979.261187:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 1 00010000:00010000:1.0:1762166979.261213:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbaba5f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea20e expref: 540 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.261233:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbaba04 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1eb expref: 539 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.261242:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbab9d3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1dd expref: 538 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.261249:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:1.0:1762166979.261252:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166979.261262:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbaba90 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea23f expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.261304:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbaba97 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166979.261314:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbaba97 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.261322:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbaba97 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000040:00080000:1.0:1762166979.261573:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5914, 88 off463184 00000004:00080000:1.0:1762166979.261584:0:6495:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 598410105574ns, next at 598687976533ns, rc = 0 00000040:00080000:1.0:1762166979.261618:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5913, 88 off463184 00000004:00080000:1.0:1762166979.261622:0:6495:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 598410144432ns, next at 598688050423ns, rc = 0 00000040:00080000:1.0:1762166979.261639:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5914, 88 off463272 00000004:00080000:1.0:1762166979.261642:0:6495:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 598410164831ns, next at 598688050423ns, rc = 0 00000040:00080000:1.0:1762166979.261648:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5915, 88 off463272 00000004:00080000:1.0:1762166979.261650:0:6495:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 598410173063ns, next at 598687976533ns, rc = 0 00000040:00080000:1.0:1762166979.261655:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5916, 88 off463360 00000004:00080000:1.0:1762166979.261659:0:6495:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 598410181453ns, next at 598687976533ns, rc = 0 00000040:00080000:1.0:1762166979.261665:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5915, 88 off463360 00000004:00080000:1.0:1762166979.261671:0:6495:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 598410192973ns, next at 598688050423ns, rc = 0 00000001:00080000:3.0:1762166979.262853:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294992248 is committed 00000004:00080000:3.0:1762166979.262863:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3279 committed 00010000:00010000:1.0:1762166979.262877:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbab9a2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x613:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00000004:00080000:3.0:1762166979.262880:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3276 committed 00010000:00010000:1.0:1762166979.262892:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbab9a2 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x613:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00000004:00080000:3.0:1762166979.262893:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3275 committed 00000004:00080000:3.0:1762166979.262898:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3278 committed 00010000:00010000:1.0:1762166979.262901:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbab9a2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x613:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00000004:00080000:3.0:1762166979.262903:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3277 committed 00000004:00080000:3.0:1762166979.262911:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3274 committed 00010000:00010000:1.0:1762166979.262911:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355a800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166979.262920:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbab9a2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x613:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.262927:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbab9a2 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x613:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.262940:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x613:0x0].0x0 (ffff945bc4afec00) 00010000:00010000:1.0:1762166979.262945:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166979.262948:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbab9a2 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x613:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000020:00080000:3.0:1762166979.262954:0:7412:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff945d011c7300 refcount 2 committed 0 result 0 batchid 55 00010000:00010000:1.0:1762166979.262955:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbab9a2 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x613:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000020:00080000:3.0:1762166979.262963:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945bc5f03300 obd lustre-OST0001-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff945cf1c8df00 00000020:00080000:3.0:1762166979.262969:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cc3e9f400 obd lustre-OST0000-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff945cc12ed240 00000020:00080000:3.0:1762166979.262975:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cc3e9ff00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff945bc41d8400 00000020:00080000:3.0:1762166979.262980:0:7412:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000400:0x2:0x0].54 00010000:00010000:1.0:1762166979.262983:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbab9a9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.262987:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbab9a9 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.262992:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbab9a9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.262997:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355ac00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166979.263000:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbab9a9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.263005:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbab9a9 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00000020:00080000:3.0:1762166979.263007:0:7412:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0001: 54 batchid updated 00010000:00010000:1.0:1762166979.263010:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:1.0:1762166979.263014:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166979.263016:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbab9a9 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.263019:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbab9a9 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000100:00100000:1.0:1762166979.263050:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4012d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449747584:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1762166979.263089:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc48aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449747712:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1762166979.263107:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc48a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449747968:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1762166979.263160:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166979.263179:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4011880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449747840:0@lo:2:osp-syn-0-1.0 00000020:00080000:0.0:1762166979.263184:0:7435:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 55 committed batchid 54 00000100:00100000:2.0:1762166979.263234:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166979.263246:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4010380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449748096:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166979.263260:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449747584 00000100:00100000:3.0:1762166979.263269:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449747584 00000100:00100000:2.0:1762166979.263276:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc48aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449748352:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1762166979.263296:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1762166979.263320:0:7435:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 54 cancel update log [0x240000400:0x2:0x0].53: rc = 0 00000100:00100000:3.0:1762166979.263323:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449747840 00000100:00100000:3.0:1762166979.263328:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449747840 00000100:00100000:2.0:1762166979.263338:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1762166979.263350:0:7435:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 54 00000100:00100000:3.0:1762166979.263374:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449748096 00000100:00100000:3.0:1762166979.263377:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449748096 00000100:00100000:0.0:1762166979.263378:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449747712 00000100:00100000:0.0:1762166979.263381:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449747712 00000100:00100000:1.0:1762166979.263385:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19155 00000100:00100000:2.0:1762166979.263391:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc48ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449748224:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1762166979.263399:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4533b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+8:3636:x1847765449747584:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1762166979.263407:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19156 00000100:00100000:0.0:1762166979.263414:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19157 00000100:00100000:3.0:1762166979.263419:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+8:3634:x1847765449747840:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1762166979.263425:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4531500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+8:3636:x1847765449748096:12345-0@lo:2:osp-syn-0-1.0 00002000:00080000:1.0:1762166979.263433:0:28874:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:2700 count 1 00000100:00100000:2.0:1762166979.263442:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1762166979.263467:0:28874:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945cc355a600/0x2f180c4effbaba9e lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.263525:0:28874:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdea00/0x2f180c4effbab73a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0da expref: 17 pid: 35472 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1762166979.263539:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1762166979.263551:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166979.263554:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166979.263557:0:28874:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cc355a600/0x2f180c4effbaba9e lrc: 4/0,1 mode: --/PW res: [0x280000400:0xa8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166979.263574:0:8382:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166979.263579:0:8382:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166979 -> 1762166979 00002000:00010000:3.0:1762166979.263583:0:28434:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166979.263583:0:8382:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:3.0:1762166979.263586:0:28434:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb mtime from disk: 1762166966 -> 1762166966 00002000:00010000:0.0:1762166979.263586:0:8382:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166979 -> 1762166979 00002000:00010000:3.0:1762166979.263591:0:28434:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1762166979.263591:0:8382:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00000100:00100000:1.0:1762166979.263593:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449748224 00002000:00010000:3.0:1762166979.263594:0:28434:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb ctime from disk: 1762166966 -> 1762166966 00000100:00100000:2.0:1762166979.263597:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449748352 00002000:00010000:3.0:1762166979.263599:0:28434:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1762166979.263599:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449748224 00000100:00100000:2.0:1762166979.263613:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449748352 00000100:00100000:1.0:1762166979.263637:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19158 00000100:00100000:0.0:1762166979.263649:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4531500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+10:3636:x1847765449748096:12345-0@lo:2:osp-syn-0-1.0 Request processed in 225us (353us total) trans 21474843361 rc 0/0 00000100:00100000:1.0:1762166979.263650:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+8:3633:x1847765449747712:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1762166979.263653:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+10:3634:x1847765449747840:12345-0@lo:2:osp-syn-0-1.0 Request processed in 236us (420us total) trans 21474843362 rc 0/0 00000100:00100000:2.0:1762166979.263667:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19159 00002000:00080000:1.0:1762166979.263669:0:8380:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:2699 count 1 00000100:00100000:0.0:1762166979.263680:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19157 00000100:00100000:2.0:1762166979.263686:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+8:3633:x1847765449748224:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166979.263687:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19156 00010000:00010000:1.0:1762166979.263687:0:8380:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945cc355ba00/0x2f180c4effbabaa5 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa8b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166979.263707:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19160 00010000:00010000:1.0:1762166979.263717:0:8380:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbab653 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0a2 expref: 19 pid: 35247 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166979.263719:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5589880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+8:3634:x1847765449748352:12345-0@lo:2:osp-syn-1-1.0 00010000:00010000:1.0:1762166979.263729:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166979.263731:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166979.263734:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355ba00/0x2f180c4effbabaa5 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0xa8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.263767:0:8380:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbab653 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0a2 expref: 19 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.263780:0:8380:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbab653 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0a2 expref: 19 pid: 35247 timeout: 698 lvb_type: 0 00000100:00100000:1.0:1762166979.263800:0:8380:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4531c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8380:1847765449748608:192.168.204.38@tcp:104: 00002000:00010000:0.0:1762166979.263816:0:8382:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa8c:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:0.0:1762166979.263821:0:8382:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa8c:0x0] updating lvb mtime from disk: 1762166979 -> 1762166979 00002000:00010000:0.0:1762166979.263824:0:8382:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa8c:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:0.0:1762166979.263826:0:8382:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa8c:0x0] updating lvb ctime from disk: 1762166979 -> 1762166979 00002000:00010000:0.0:1762166979.263828:0:8382:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa8c:0x0] updating lvb blocks from disk: 64 -> 64 00000100:00100000:0.0:1762166979.263874:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5589880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+10:3634:x1847765449748352:12345-0@lo:2:osp-syn-1-1.0 Request processed in 157us (339us total) trans 17179876515 rc 0/0 00002000:00010000:2.0:1762166979.263876:0:9168:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166979.263885:0:9168:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166979 -> 1762166979 00000100:00100000:0.0:1762166979.263888:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19160 00000100:00100000:1.0:1762166979.263890:0:8380:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccb393cc0 going to sleep for 11 seconds 00002000:00010000:2.0:1762166979.263895:0:9168:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166979.263902:0:9168:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166979 -> 1762166979 00002000:00010000:2.0:1762166979.263905:0:9168:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00010000:1.0:1762166979.263934:0:28874:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdea00/0x2f180c4effbab73a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0da expref: 17 pid: 35472 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1762166979.263934:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1762166979.263948:0:28874:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdea00/0x2f180c4effbab73a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0da expref: 17 pid: 35472 timeout: 698 lvb_type: 1 00000100:00100000:1.0:1762166979.263963:0:28874:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5807100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28874:1847765449748736:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166979.263971:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4010000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449748480:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1762166979.263987:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+9:3633:x1847765449748224:12345-0@lo:2:osp-syn-1-1.0 Request processed in 305us (550us total) trans 17179876516 rc 0/0 00000100:00100000:1.0:1762166979.264000:0:28874:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc40760c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166979.264004:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19159 00000100:00100000:0.0:1762166979.264013:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166979.264048:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449747968 00000100:00100000:2.0:1762166979.264055:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449747968 00000100:00100000:0.0:1762166979.264068:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449748480 00000100:00100000:0.0:1762166979.264075:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449748480 00010000:00010000:1.0:1762166979.264080:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbaba97 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea23f expref: 525 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.264093:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:1.0:1762166979.264097:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000100:00100000:2.0:1762166979.264111:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19161 00010000:00010000:1.0:1762166979.264119:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbaba90 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea23f expref: 525 pid: 6495 timeout: 0 lvb_type: 3 00000100:00100000:0.0:1762166979.264121:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19162 00000100:00100000:2.0:1762166979.264129:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+9:3635:x1847765449747968:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1762166979.264146:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+9:3635:x1847765449748480:12345-0@lo:2:osp-syn-0-1.0 00010000:00010000:1.0:1762166979.264166:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbaba97 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea23f expref: 524 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.264194:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:1.0:1762166979.264197:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1762166979.264201:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355b600, rc 0) 00002000:00010000:0.0:1762166979.264240:0:8383:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa8d:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:1.0:1762166979.264247:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5769880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+524:61766:x1847765450570880:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 3090us (3233us total) trans 4294992248 rc 0/0 00002000:00010000:0.0:1762166979.264247:0:8383:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa8d:0x0] updating lvb mtime from disk: 1762166979 -> 1762166979 00002000:00010000:0.0:1762166979.264252:0:8383:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa8d:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:0.0:1762166979.264263:0:8383:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa8d:0x0] updating lvb ctime from disk: 1762166979 -> 1762166979 00000100:00100000:2.0:1762166979.264264:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+10:3635:x1847765449747968:12345-0@lo:2:osp-syn-1-1.0 Request processed in 136us (326us total) trans 17179876517 rc 0/0 00002000:00010000:0.0:1762166979.264268:0:8383:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa8d:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1762166979.264274:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30617 00000100:00100000:2.0:1762166979.264293:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19161 00000100:00100000:0.0:1762166979.264337:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+10:3635:x1847765449748480:12345-0@lo:2:osp-syn-0-1.0 Request processed in 197us (325us total) trans 21474843363 rc 0/0 00000100:00100000:0.0:1762166979.264348:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19162 00000004:00080000:2.0:1762166979.264385:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc4011880/2, rc 0, transno 21474843362 00000004:00080000:1.0:1762166979.264390:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc4010380/2, rc 0, transno 21474843361 00000100:00100000:2.0:1762166979.264396:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4011880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449747840:0@lo:2:osp-syn-0-1.0 00000004:00080000:0.0:1762166979.264401:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc48a8700/2, rc 0, transno 17179876517 00000100:00100000:1.0:1762166979.264402:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4010380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449748096:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1762166979.264412:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc48a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449747968:0@lo:2:osp-syn-1-1.0 00000004:00080000:2.0:1762166979.264430:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc48aa300/2, rc 0, transno 17179876515 00000004:00080000:0.0:1762166979.264436:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc4010000/2, rc 0, transno 21474843363 00000100:00100000:2.0:1762166979.264443:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc48aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449748352:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1762166979.264448:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4010000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449748480:0@lo:2:osp-syn-0-1.0 00000004:00080000:2.0:1762166979.264525:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc48ab100/2, rc 0, transno 17179876516 00000100:00100000:2.0:1762166979.264533:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc48ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449748224:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1762166979.265956:0:8380:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4531c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8380:1847765449748608:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166979.265995:0:28874:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5807100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:28874:1847765449748736:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166979.265996:0:8380:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945cc355ba00/0x2f180c4effbabaa5 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166979.266031:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:2.0:1762166979.266038:0:28874:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945cc355a600/0x2f180c4effbaba9e lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166979.266070:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450571008 00000100:00100000:1.0:1762166979.266078:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450571008 00000100:00100000:3.0:1762166979.266099:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:1.0:1762166979.266107:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbab653 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0a2 expref: 20 pid: 35247 timeout: 698 lvb_type: 0 00000100:00100000:1.0:1762166979.266164:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450571136 00000100:00100000:1.0:1762166979.266169:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450571136 00000100:00100000:2.0:1762166979.266179:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9679 00010000:00010000:1.0:1762166979.266195:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdea00/0x2f180c4effbab73a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0da expref: 18 pid: 35472 timeout: 698 lvb_type: 1 00000100:00100000:2.0:1762166979.266197:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5768700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450571008:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166979.266227:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166979.266236:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbab653 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa8b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0a2 expref: 20 pid: 35247 timeout: 698 lvb_type: 0 00000100:00100000:1.0:1762166979.266250:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9680 00010000:00010000:2.0:1762166979.266277:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbab653 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa8b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0a2 expref: 20 pid: 35247 timeout: 698 lvb_type: 0 00000100:00100000:1.0:1762166979.266278:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5769f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450571136:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166979.266302:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166979.266312:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdea00/0x2f180c4effbab73a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0da expref: 18 pid: 35472 timeout: 698 lvb_type: 1 00010000:00010000:2.0:1762166979.266319:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbab653 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa8b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0a2 expref: 20 pid: 35247 timeout: 698 lvb_type: 0 00010000:00010000:2.0:1762166979.266338:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166979.266341:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166979.266345:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945cc355ba00/0x2f180c4effbabaa5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.266349:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdea00/0x2f180c4effbab73a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0da expref: 18 pid: 35472 timeout: 698 lvb_type: 1 00010000:00010000:2.0:1762166979.266370:0:9458:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355ba00/0x2f180c4effbabaa5 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xa8b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.266422:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdea00/0x2f180c4effbab73a lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea0da expref: 18 pid: 35472 timeout: 698 lvb_type: 1 00010000:00010000:2.0:1762166979.266434:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166979.266439:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166979.266444:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166979.266449:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945cc355a600/0x2f180c4effbaba9e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.266459:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cc355a600/0x2f180c4effbaba9e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.266465:0:8380:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945cc355ba00/0x2f180c4effbabaa5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.266506:0:8380:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cc355ba00/0x2f180c4effbabaa5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.266517:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166979.266518:0:8380:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945cc355ba00/0x2f180c4effbabaa5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166979.266523:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5768700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450571008:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 331us (499us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166979.266528:0:8380:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355ba00/0x2f180c4effbabaa5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166979.266533:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9679 00010000:00010000:0.0:1762166979.266556:0:8380:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1762166979.266560:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5769f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450571136:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 291us (457us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166979.266570:0:28874:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945cc355a600/0x2f180c4effbaba9e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166979.266577:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9680 00010000:00010000:2.0:1762166979.266589:0:28874:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cc355a600/0x2f180c4effbaba9e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.266597:0:28874:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945cc355a600/0x2f180c4effbaba9e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.266607:0:28874:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945cc355a600/0x2f180c4effbaba9e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.266627:0:28874:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1762166979.266633:0:6483:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1762166979.266642:0:6483:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945cc355ba00/0x2f180c4effbabaa5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.266653:0:6483:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355ba00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166979.266659:0:10256:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166979.266661:0:6483:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc355ba00/0x2f180c4effbabaa5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.266676:0:10256:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945cc355a600/0x2f180c4effbaba9e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.266678:0:6483:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc355ba00/0x2f180c4effbabaa5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166979.266689:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:2.0:1762166979.266732:0:10256:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355a600 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166979.266742:0:6483:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945cc355ba00/0x2f180c4effbabaa5 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xa8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.266748:0:10256:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945cc355a600/0x2f180c4effbaba9e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.266765:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cc355ba00/0x2f180c4effbabaa5 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.266773:0:10256:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945cc355a600/0x2f180c4effbaba9e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.266800:0:10256:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945cc355a600/0x2f180c4effbaba9e lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.266809:0:10256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cc355a600/0x2f180c4effbaba9e lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.266810:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166979.266810:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+10:3633:x1847765449747712:12345-0@lo:6:osp-syn-1-1.0 Request processed in 3160us (3475us total) trans 17179876518 rc 0/0 00010000:00010000:1.0:1762166979.266817:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166979.266826:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166979.266830:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19158 00010000:00010000:2.0:1762166979.266861:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166979.266865:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166979.266865:0:35248:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450571264 00010000:00010000:2.0:1762166979.266872:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166979.266873:0:35248:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450571264 00000004:00080000:0.0:1762166979.266901:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc48aa680/2, rc 0, transno 17179876518 00000100:00100000:0.0:1762166979.266908:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc48aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449747712:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1762166979.266932:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19163 00000100:00100000:1.0:1762166979.266949:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+19:61766:x1847765450571264:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:1.0:1762166979.266964:0:35248:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166979.266982:0:35248:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cc355be00/0x2f180c4effbabaac lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea246 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762166979.267002:0:35248:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa77:0x0] initial LVB size: 262144, mtime: 0x690888c3, atime: 0x690888c2, ctime: 0x690888c3, blocks: 0xe0 00010000:00010000:1.0:1762166979.267018:0:35248:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166979.267021:0:35248:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166979.267029:0:35248:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355be00/0x2f180c4effbabaac lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 16384->20479) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea246 expref: 20 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.267042:0:35248:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945cc355be00/0x2f180c4effbabaac lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 16384->20479) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea246 expref: 20 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.267052:0:35248:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355be00, rc 0) 00000100:00100000:1.0:1762166979.267093:0:35248:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+20:61766:x1847765450571264:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 149us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166979.267106:0:35248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19163 00000100:00100000:2.0:1762166979.267257:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4533b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+10:3636:x1847765449747584:12345-0@lo:6:osp-syn-0-1.0 Request processed in 3863us (4103us total) trans 21474843364 rc 0/0 00000100:00100000:2.0:1762166979.267263:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19155 00000004:00080000:1.0:1762166979.267311:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc4012d80/2, rc 0, transno 21474843364 00000100:00100000:1.0:1762166979.267320:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4012d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449747584:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1762166979.280391:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.280453:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450571392 00000100:00100000:2.0:1762166979.280462:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450571392 00002000:00100000:2.0:1762166979.280551:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (16384->20479) req@ffff945bc406f800 x1847765450571392/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:10/0 lens 488/0 e 0 to 0 dl 1762166990 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166979.280559:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc406f800 with x1847765450571392 ext(16384->20479) 00002000:00010000:2.0:1762166979.280564:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc406f800 00000100:00100000:2.0:1762166979.280587:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2464 00000100:00100000:2.0:1762166979.280594:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:2416:x1847765450571392:12345-192.168.204.38@tcp:3:lfs.0 00000100:00100000:2.0:1762166979.280756:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:2416:x1847765450571392:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 162us (375us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1762166979.280762:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2464 00002000:00100000:2.0:1762166979.280767:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (16384->20479) req@ffff945bc406f800 x1847765450571392/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:10/0 lens 488/4536 e 0 to 0 dl 1762166990 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166979.280773:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc406f800 with x1847765450571392 ext(16384->20479) 00002000:00010000:2.0:1762166979.280775:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc406f800 00000100:00100000:3.0:1762166979.282905:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.282958:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450571520 00000100:00100000:2.0:1762166979.282965:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450571520 00002000:00100000:2.0:1762166979.283005:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (4096->69631) req@ffff945bc406d180 x1847765450571520/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:10/0 lens 504/0 e 0 to 0 dl 1762166990 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166979.283016:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc406d180 with x1847765450571520 ext(4096->69631) 00002000:00010000:2.0:1762166979.283020:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc406d180 00000100:00100000:2.0:1762166979.283050:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2465 00000100:00100000:2.0:1762166979.283060:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:2417:x1847765450571520:12345-192.168.204.38@tcp:3:lfs.0 00000100:00100000:2.0:1762166979.284236:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:2417:x1847765450571520:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 1175us (1334us total) trans 0 rc 61440/61440 00000100:00100000:2.0:1762166979.284248:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2465 00002000:00100000:2.0:1762166979.284258:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (4096->69631) req@ffff945bc406d180 x1847765450571520/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:10/0 lens 504/440 e 0 to 0 dl 1762166990 ref 1 fl Complete:/600/0 rc 61440/61440 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166979.284267:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc406d180 with x1847765450571520 ext(4096->69631) 00002000:00010000:2.0:1762166979.284271:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc406d180 00000100:00100000:3.0:1762166979.286547:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.287831:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450571648 00000100:00100000:0.0:1762166979.287857:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450571648 00002000:00100000:0.0:1762166979.287933:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (16384->28671) req@ffff945bc406ed80 x1847765450571648/t0(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:10/0 lens 12776/0 e 0 to 0 dl 1762166990 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166979.287950:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc406ed80 with x1847765450571648 ext(16384->28671) 00002000:00010000:0.0:1762166979.287957:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc406ed80 00000100:00100000:0.0:1762166979.288000:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2466 00000100:00100000:0.0:1762166979.288010:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:2416:x1847765450571648:12345-192.168.204.38@tcp:4:lfs.0 00000100:00100000:0.0:1762166979.288891:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+22:2416:x1847765450571648:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 881us (2356us total) trans 17179876519 rc 0/0 00000100:00100000:0.0:1762166979.288901:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2466 00002000:00100000:0.0:1762166979.288909:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (16384->28671) req@ffff945bc406ed80 x1847765450571648/t17179876519(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:10/0 lens 12776/448 e 0 to 0 dl 1762166990 ref 1 fl Complete:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166979.288919:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc406ed80 with x1847765450571648 ext(16384->28671) 00002000:00010000:0.0:1762166979.288922:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc406ed80 00000100:00100000:3.0:1762166979.290279:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.290391:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450571776 00000100:00100000:2.0:1762166979.290405:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450571776 00000100:00100000:2.0:1762166979.290507:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19164 00000100:00100000:2.0:1762166979.290520:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765450571776:12345-192.168.204.38@tcp:16:fsx.0 00000001:00080000:1.0:1762166979.291663:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876519 is committed 00000001:00080000:1.0:1762166979.291672:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876518 is committed 00000100:00100000:2.0:1762166979.291830:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450571776:12345-192.168.204.38@tcp:16:fsx.0 Request processed in 1308us (1550us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166979.291840:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19164 00000100:00100000:3.0:1762166979.293208:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166979.293287:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450571904 00000100:00100000:1.0:1762166979.293298:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450571904 00000100:00100000:1.0:1762166979.293359:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30618 00000100:00100000:1.0:1762166979.293366:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+524:61766:x1847765450571904:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:1.0:1762166979.293392:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166979.293417:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbabab3 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea24d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.293564:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbababa lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166979.293582:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbababa lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.293596:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbababa lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:1.0:1762166979.293627:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 262144 00000004:00200000:1.0:1762166979.293633:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166979.293654:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbababa lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.293683:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbabab3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea24d expref: 526 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.293706:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbababa lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea24d expref: 525 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.293715:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:1.0:1762166979.293719:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166979.293723:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355b000, rc 0) 00000100:00100000:1.0:1762166979.293779:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+525:61766:x1847765450571904:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 412us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166979.293787:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30618 00000100:00100000:3.0:1762166979.296276:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.296366:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450572032 00000100:00100000:0.0:1762166979.296377:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450572032 00002000:00100000:0.0:1762166979.296437:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (86016->151551) req@ffff945bc406e300 x1847765450572032/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:10/0 lens 488/0 e 0 to 0 dl 1762166990 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166979.296449:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc406e300 with x1847765450572032 ext(86016->151551) 00002000:00010000:0.0:1762166979.296454:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc406e300 00000100:00100000:0.0:1762166979.296508:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2467 00000100:00100000:0.0:1762166979.296518:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450572032:12345-192.168.204.38@tcp:3:lfs.0 00000100:00100000:0.0:1762166979.297908:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450572032:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 1383us (1633us total) trans 0 rc 65536/65536 00000100:00100000:0.0:1762166979.297917:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2467 00002000:00100000:0.0:1762166979.297925:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (86016->151551) req@ffff945bc406e300 x1847765450572032/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:10/0 lens 488/440 e 0 to 0 dl 1762166990 ref 1 fl Complete:/600/0 rc 65536/65536 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166979.297934:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc406e300 with x1847765450572032 ext(86016->151551) 00002000:00010000:0.0:1762166979.297939:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc406e300 00000100:00100000:3.0:1762166979.299760:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166979.299817:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450572160 00000100:00100000:1.0:1762166979.299828:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450572160 00000100:00100000:1.0:1762166979.299893:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30619 00000100:00100000:1.0:1762166979.299905:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+525:61766:x1847765450572160:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:1.0:1762166979.299929:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166979.299954:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbabac1 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea254 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.299996:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbabac8 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166979.300013:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbabac8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.300035:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbabac8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.300186:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbabac1 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea254 expref: 527 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.300212:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbabac8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea254 expref: 526 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.300221:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:1.0:1762166979.300225:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1762166979.300229:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355ac00, rc 0) 00000100:00100000:1.0:1762166979.300279:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+526:61766:x1847765450572160:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 377us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166979.300286:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30619 00000100:00100000:3.0:1762166979.301422:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166979.301460:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450572416 00000100:00100000:1.0:1762166979.301466:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450572416 00000100:00100000:1.0:1762166979.301539:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30620 00000100:00100000:1.0:1762166979.301548:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+526:61766:x1847765450572416:12345-192.168.204.38@tcp:36:fsx.0 00010000:00010000:1.0:1762166979.301597:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1762166979.301618:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbababa lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea24d expref: 526 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.301635:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbaba97 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea23f expref: 525 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.301643:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:1.0:1762166979.301647:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166979.301836:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbabacf lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166979.301856:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbabacf lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.301869:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbabacf lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000001:00080000:1.0:1762166979.301913:0:6495:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992249 00000004:00010000:1.0:1762166979.301935:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000057f9ee5f reply state 00000000e41bc45d transno 4294992250 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbabacf lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.301947:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbabacf lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.301953:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:1.0:1762166979.301956:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166979.301958:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166979.302035:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+527:61766:x1847765450572416:12345-192.168.204.38@tcp:36:fsx.0 Request processed in 488us (613us total) trans 4294992250 rc 0/0 00000100:00100000:1.0:1762166979.302042:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30620 00000020:00080000:1.0:1762166979.302047:0:6495:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1762166979.303068:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166979.303140:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450572544 00000100:00100000:1.0:1762166979.303149:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450572544 00000100:00100000:1.0:1762166979.303196:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30621 00000100:00100000:1.0:1762166979.303204:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+527:61766:x1847765450572544:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:1.0:1762166979.303221:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166979.303235:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbabad6 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea25b expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.303279:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbabad6 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea25b expref: 528 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.303291:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbabad6 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea25b expref: 528 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.303307:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:1.0:1762166979.303310:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166979.303312:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355b400, rc 0) 00000100:00100000:1.0:1762166979.303356:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+528:61766:x1847765450572544:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 153us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166979.303408:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30621 00000100:00100000:3.0:1762166979.304551:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166979.304588:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166979.304619:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.304639:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450572800 00000100:00100000:0.0:1762166979.304646:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450572800 00000100:00100000:1.0:1762166979.304657:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450572672 00000100:00100000:1.0:1762166979.304669:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450572672 00002000:00010000:0.0:1762166979.304683:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:0.0:1762166979.304689:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc406c700 with x1847765450572800 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166979.304705:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc406c700. 00002000:00010000:1.0:1762166979.304708:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (22016->18446744073709551615) 00002000:00100000:1.0:1762166979.304715:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc406ea00 with x1847765450572672 ext(22016->18446744073709551615) 00000100:00100000:2.0:1762166979.304720:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450572928 00000100:00100000:2.0:1762166979.304727:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450572928 00002000:00010000:1.0:1762166979.304728:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc406ea00. 00000100:00100000:0.0:1762166979.304743:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2468 00002000:00010000:2.0:1762166979.304755:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00000100:00100000:0.0:1762166979.304760:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450572800:12345-192.168.204.38@tcp:10:fsx.0 00002000:00100000:2.0:1762166979.304765:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc7b20700 with x1847765450572928 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166979.304776:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc7b20700. 00000100:00100000:1.0:1762166979.304782:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2469 00000100:00100000:1.0:1762166979.304795:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450572672:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:2.0:1762166979.304809:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2470 00000100:00100000:2.0:1762166979.304817:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450572928:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:0.0:1762166979.304951:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166979.304957:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166979 -> 1762166979 00002000:00010000:0.0:1762166979.304961:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:0.0:1762166979.304964:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166979 -> 1762166979 00002000:00010000:0.0:1762166979.304969:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00002000:00010000:2.0:1762166979.305007:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166979.305014:0:23939:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166979 -> 1762166979 00002000:00010000:2.0:1762166979.305017:0:23939:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166979.305019:0:23939:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166979 -> 1762166979 00002000:00010000:2.0:1762166979.305022:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1762166979.305030:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450572800:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 275us (481us total) trans 21474843365 rc 0/0 00000100:00100000:0.0:1762166979.305042:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2468 00002000:00010000:0.0:1762166979.305047:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:0.0:1762166979.305051:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc406c700 with x1847765450572800 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166979.305057:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc406c700. 00000100:00100000:2.0:1762166979.305081:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450572928:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 261us (458us total) trans 17179876520 rc 0/0 00000100:00100000:2.0:1762166979.305091:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2470 00002000:00010000:2.0:1762166979.305095:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:2.0:1762166979.305099:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc7b20700 with x1847765450572928 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166979.305107:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc7b20700. 00002000:00010000:1.0:1762166979.305390:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 262144 -> 22016 00002000:00010000:1.0:1762166979.305394:0:23943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166979 -> 1762166979 00002000:00010000:1.0:1762166979.305397:0:23943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:1.0:1762166979.305399:0:23943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166979 -> 1762166979 00002000:00010000:1.0:1762166979.305401:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 224 -> 48 00000100:00100000:1.0:1762166979.305436:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450572672:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 645us (845us total) trans 17179876521 rc 0/0 00000100:00100000:1.0:1762166979.305443:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2469 00002000:00010000:1.0:1762166979.305446:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (22016->18446744073709551615) 00002000:00100000:1.0:1762166979.305449:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc406ea00 with x1847765450572672 ext(22016->18446744073709551615) 00002000:00010000:1.0:1762166979.305452:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc406ea00. 00000100:00100000:3.0:1762166979.306871:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166979.306933:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450573056 00000100:00100000:1.0:1762166979.306941:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450573056 00000100:00100000:1.0:1762166979.306987:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30622 00000100:00100000:1.0:1762166979.306996:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+528:61766:x1847765450573056:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:1.0:1762166979.307014:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166979.307031:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbabadd lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea262 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.307130:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbabae4 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166979.307143:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbabae4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.307154:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbabae4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:1.0:1762166979.307183:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 22016 00000004:00200000:1.0:1762166979.307188:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166979.307206:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbabae4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.307234:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbabadd lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea262 expref: 530 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.307251:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbabae4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea262 expref: 529 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.307259:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:1.0:1762166979.307263:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166979.307266:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355b200, rc 0) 00000100:00100000:1.0:1762166979.307310:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+529:61766:x1847765450573056:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 315us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166979.307317:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30622 00000100:00100000:3.0:1762166979.309458:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166979.309543:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450573184 00000100:00100000:1.0:1762166979.309549:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450573184 00002000:00100000:1.0:1762166979.309583:0:23943:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000400:0xa77:0x0] (0->4095) req@ffff945bc7b21180 x1847765450573184/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:10/0 lens 488/0 e 0 to 0 dl 1762166990 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166979.309591:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc7b21180 with x1847765450573184 ext(0->4095) 00002000:00010000:1.0:1762166979.309597:0:23943:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc7b21180 00000100:00100000:1.0:1762166979.309628:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2471 00000100:00100000:1.0:1762166979.309637:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450573184:12345-192.168.204.38@tcp:3:lfs.0 00000100:00100000:1.0:1762166979.309807:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450573184:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 172us (353us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1762166979.309812:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2471 00002000:00100000:1.0:1762166979.309818:0:23943:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000400:0xa77:0x0] (0->4095) req@ffff945bc7b21180 x1847765450573184/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:10/0 lens 488/4536 e 0 to 0 dl 1762166990 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166979.309824:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc7b21180 with x1847765450573184 ext(0->4095) 00002000:00010000:1.0:1762166979.309826:0:23943:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc7b21180 00000100:00100000:3.0:1762166979.312246:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.312316:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450573440 00000100:00100000:2.0:1762166979.312325:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450573440 00000100:00100000:2.0:1762166979.312386:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11905 00000100:00100000:2.0:1762166979.312395:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+529:61766:x1847765450573440:12345-192.168.204.38@tcp:35:fsx.0 00000100:00100000:2.0:1762166979.312717:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+530:61766:x1847765450573440:12345-192.168.204.38@tcp:35:fsx.0 Request processed in 323us (479us total) trans 4294992251 rc 0/0 00000100:00100000:2.0:1762166979.312725:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11905 00000100:00100000:3.0:1762166979.321183:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166979.321306:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450573696 00000100:00100000:1.0:1762166979.321320:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450573696 00000100:00100000:1.0:1762166979.321392:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30623 00000100:00100000:1.0:1762166979.321402:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+530:61863:x1847765450573696:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166979.321433:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166979.321458:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbabaeb lrc: 2/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea269 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.321565:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbabaf2 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166979.321577:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbabaf2 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.321588:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbabaf2 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.321599:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbabaf9 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166979.321605:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbabaf9 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.321611:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbabaf9 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.321734:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbabb00 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166979.321742:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbabb00 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.321749:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbabb00 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:1.0:1762166979.321758:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 22016 00010000:00010000:1.0:1762166979.321827:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbabaf2 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.321839:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbabaf2 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.321859:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbabaf2 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.321866:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbabaf2 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.321871:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355b600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166979.321876:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbabaf2 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.321884:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbabaf2 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.321895:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0x0 (ffff945cc7f4cc00) 00010000:00010000:1.0:1762166979.321898:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166979.321902:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbabaf2 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.321908:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbabaf2 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.321921:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbabaf9 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.321926:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbabaf9 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.321931:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbabaf9 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.321937:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355b000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166979.321940:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbabaf9 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.321950:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbabaf9 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.321956:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0xdd396665 (ffff945cc7f4cd00) 00010000:00010000:1.0:1762166979.321958:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166979.321960:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbabaf9 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.321966:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbabaf9 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.322000:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbabaeb lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea269 expref: 533 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.322012:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbabb00 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea269 expref: 532 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.322019:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:1.0:1762166979.322021:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166979.322023:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355ba00, rc 0) 00000100:00100000:1.0:1762166979.322087:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+532:61863:x1847765450573696:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 686us (918us total) trans 4294992252 rc 0/0 00000100:00100000:1.0:1762166979.322095:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30623 00000100:00100000:3.0:1762166979.323329:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166979.323380:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450573824 00000100:00100000:1.0:1762166979.323391:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450573824 00000100:00100000:1.0:1762166979.323443:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 884 00000100:00100000:1.0:1762166979.323450:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b20000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+532:2418:x1847765450573824:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166979.323460:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166979.323497:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbabb00 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea269 expref: 532 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.323511:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:1.0:1762166979.323514:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166979.323552:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b20000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+531:2418:x1847765450573824:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 102us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166979.323562:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 884 00000100:00100000:3.0:1762166979.323867:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.323923:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450574080 00000100:00100000:2.0:1762166979.323935:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450574080 00000100:00100000:2.0:1762166979.323997:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11906 00000100:00100000:2.0:1762166979.324009:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+531:61863:x1847765450574080:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:2.0:1762166979.324256:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+532:61863:x1847765450574080:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 249us (388us total) trans 4294992253 rc 0/0 00000100:00100000:2.0:1762166979.324264:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11906 00000100:00100000:3.0:1762166979.325755:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166979.325829:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450574336 00000100:00100000:1.0:1762166979.325837:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450574336 00000100:00100000:1.0:1762166979.325888:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30624 00000100:00100000:1.0:1762166979.325897:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+532:61863:x1847765450574336:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166979.325919:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166979.325935:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbabb0e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea270 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.326022:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbabb15 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166979.326034:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbabb15 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.326044:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbabb15 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:1.0:1762166979.326053:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 22016 00010000:00010000:1.0:1762166979.326134:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbabb0e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea270 expref: 535 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.326149:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbabb15 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea270 expref: 534 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.326158:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:1.0:1762166979.326161:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1762166979.326164:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355bc00, rc 0) 00000100:00100000:1.0:1762166979.326204:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+534:61863:x1847765450574336:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 308us (456us total) trans 4294992254 rc 0/0 00000100:00100000:1.0:1762166979.326211:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30624 00000100:00100000:3.0:1762166979.328040:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166979.328089:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450574592 00000100:00100000:1.0:1762166979.328096:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450574592 00000100:00100000:1.0:1762166979.328140:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30625 00000100:00100000:1.0:1762166979.328149:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+534:61863:x1847765450574592:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166979.328165:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166979.328184:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbabb23 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea277 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.328265:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbabb2a lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166979.328277:0:6495:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbabae4 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea262 expref: 535 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.328285:0:6495:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbabb2a lrc: 4/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.328315:0:6495:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbabae4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea262 expref: 535 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.328329:0:6495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbabae4 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea262 expref: 535 pid: 6495 timeout: 698 lvb_type: 0 00000100:00100000:1.0:1762166979.328348:0:6495:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5807b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6495:1847765449748864:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166979.328436:0:6495:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc4076b40 going to sleep for 11 seconds 00000100:00100000:1.0:1762166979.329516:0:6495:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5807b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6495:1847765449748864:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166979.329532:0:6495:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbabb2a lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000100:00100000:3.0:1762166979.329728:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166979.329783:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450574720 00000100:00100000:1.0:1762166979.329790:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450574720 00010000:00010000:1.0:1762166979.329812:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbabae4 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea262 expref: 536 pid: 6495 timeout: 698 lvb_type: 0 00000100:00100000:1.0:1762166979.329853:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9681 00000100:00100000:1.0:1762166979.329862:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7c33450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+536:2419:x1847765450574720:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166979.329875:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166979.329880:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbabae4 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea262 expref: 536 pid: 6495 timeout: 698 lvb_type: 0 00010000:00010000:1.0:1762166979.329889:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbabae4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea262 expref: 536 pid: 6495 timeout: 698 lvb_type: 0 00010000:00010000:1.0:1762166979.329905:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbabae4 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea262 expref: 536 pid: 6495 timeout: 698 lvb_type: 0 00010000:00010000:1.0:1762166979.329934:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:1.0:1762166979.329942:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbabb2a lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.329954:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbabb2a lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.329960:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbabb2a lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.329981:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166979.330020:0:6495:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbabb2a lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000100:00100000:1.0:1762166979.330020:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7c33450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+535:2419:x1847765450574720:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 156us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166979.330035:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9681 00010000:00010000:2.0:1762166979.330036:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbabb2a lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:2.0:1762166979.330058:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 22016 00010000:00010000:2.0:1762166979.330185:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbabb23 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea277 expref: 536 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.330200:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbabb2a lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea277 expref: 535 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.330207:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166979.330210:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1762166979.330213:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355b000, rc 0) 00000100:00100000:2.0:1762166979.330250:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+535:61863:x1847765450574592:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2102us (2215us total) trans 4294992255 rc 0/0 00000100:00100000:2.0:1762166979.330257:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30625 00000100:00100000:3.0:1762166979.331251:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.331293:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450574848 00000100:00100000:2.0:1762166979.331300:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450574848 00000100:00100000:2.0:1762166979.331341:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11907 00000100:00100000:2.0:1762166979.331349:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+535:61863:x1847765450574848:12345-192.168.204.38@tcp:33:lfs.0 00000100:00100000:2.0:1762166979.331458:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+535:61863:x1847765450574848:12345-192.168.204.38@tcp:33:lfs.0 Request processed in 108us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166979.331465:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11907 00000100:00100000:3.0:1762166979.332273:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.332336:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450575104 00000100:00100000:2.0:1762166979.332342:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450575104 00000100:00100000:2.0:1762166979.332374:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11908 00000100:00100000:2.0:1762166979.332381:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+535:61863:x1847765450575104:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:2.0:1762166979.332538:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+536:61863:x1847765450575104:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 156us (267us total) trans 4294992256 rc 0/0 00000100:00100000:2.0:1762166979.332546:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11908 00000100:00100000:3.0:1762166979.333734:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.333775:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450575360 00000100:00100000:2.0:1762166979.333780:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450575360 00000100:00100000:2.0:1762166979.333818:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30626 00000100:00100000:2.0:1762166979.333826:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+536:61863:x1847765450575360:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166979.333852:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166979.333856:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:2.0:1762166979.333880:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbabb2a lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea277 expref: 536 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.333899:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbabb15 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea270 expref: 535 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.333909:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166979.333914:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166979.333931:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbabb38 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea27e expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.333998:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbabb3f lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166979.334008:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbabb3f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.334014:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbabb3f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:2.0:1762166979.334020:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 22016 00010000:00010000:2.0:1762166979.334074:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbabb38 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea27e expref: 537 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.334083:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbabb3f lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea27e expref: 536 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.334092:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166979.334094:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166979.334095:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa9800, rc 0) 00000100:00100000:2.0:1762166979.334130:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+536:61863:x1847765450575360:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 305us (399us total) trans 4294992257 rc 0/0 00000100:00100000:2.0:1762166979.334136:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30626 00000100:00100000:3.0:1762166979.335292:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.335374:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450575616 00000100:00100000:2.0:1762166979.335381:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450575616 00000100:00100000:2.0:1762166979.335428:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11909 00000100:00100000:2.0:1762166979.335437:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7be3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+536:61863:x1847765450575616:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:2.0:1762166979.335512:0:19593:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x240000404:0x5eb:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbabb3f lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea27e expref: 536 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.335538:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbabb4d lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:2.0:1762166979.335547:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbabac8 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea254 expref: 536 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.335553:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbabad6 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea25b expref: 536 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.335557:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbabb4d lrc: 5/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166979.335580:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbabad6 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea25b expref: 536 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.335592:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbabad6 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea25b expref: 536 pid: 6495 timeout: 698 lvb_type: 0 00000100:00100000:2.0:1762166979.335601:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc558ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449748992:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166979.335668:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbabac8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea254 expref: 536 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.335678:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbabac8 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea254 expref: 536 pid: 6495 timeout: 698 lvb_type: 0 00000100:00100000:2.0:1762166979.335687:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5588380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449749120:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166979.335712:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc63999c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166979.336747:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc558ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449748992:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166979.336757:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5588380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449749120:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166979.336784:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbabb4d lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:3.0:1762166979.336925:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166979.336996:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450575872 00000100:00100000:3.0:1762166979.337003:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166979.337003:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450575872 00010000:00010000:1.0:1762166979.337048:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbabad6 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea25b expref: 537 pid: 6495 timeout: 698 lvb_type: 0 00000100:00100000:2.0:1762166979.337049:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450575744 00000100:00100000:2.0:1762166979.337054:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450575744 00010000:00010000:2.0:1762166979.337069:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbabac8 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea254 expref: 538 pid: 6495 timeout: 698 lvb_type: 0 00000100:00100000:1.0:1762166979.337083:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9682 00000100:00100000:1.0:1762166979.337093:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+538:2419:x1847765450575872:12345-192.168.204.38@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1762166979.337110:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9683 00010000:00010000:1.0:1762166979.337110:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166979.337116:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbabad6 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea25b expref: 538 pid: 6495 timeout: 698 lvb_type: 0 00010000:00010000:1.0:1762166979.337130:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbabad6 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea25b expref: 538 pid: 6495 timeout: 698 lvb_type: 0 00010000:00010000:1.0:1762166979.337151:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbabad6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea25b expref: 538 pid: 6495 timeout: 698 lvb_type: 0 00010000:00010000:1.0:1762166979.337168:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:1.0:1762166979.337174:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbabb4d lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166979.337183:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbabb4d lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166979.337189:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166979.337217:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+537:2418:x1847765450575744:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166979.337226:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166979.337232:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbabac8 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea254 expref: 537 pid: 6495 timeout: 698 lvb_type: 0 00000100:00100000:1.0:1762166979.337240:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+537:2419:x1847765450575872:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 150us (318us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166979.337242:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbabac8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea254 expref: 537 pid: 6495 timeout: 698 lvb_type: 0 00000100:00100000:1.0:1762166979.337248:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9682 00010000:00010000:2.0:1762166979.337255:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbabac8 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea254 expref: 537 pid: 6495 timeout: 698 lvb_type: 0 00010000:00010000:2.0:1762166979.337265:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166979.337269:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbabb4d lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166979.337278:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbabb4d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166979.337286:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbabb4d lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166979.337314:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166979.337348:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+535:2418:x1847765450575744:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 230us (345us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166979.337351:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbabb4d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:2.0:1762166979.337360:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9683 00010000:00010000:0.0:1762166979.337365:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbabb4d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166979.337634:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbabb4d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166979.337643:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbabb4d lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166979.337649:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbabb4d lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166979.337655:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa8800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166979.337660:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbabb4d lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166979.337667:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbabb4d lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166979.337676:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:0.0:1762166979.337679:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166979.337683:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbabb4d lrc: 2/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166979.337691:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbabb4d lrc: 0/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166979.337702:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:0.0:1762166979.337704:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166979.337709:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbabb3f lrc: 0/0,0 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea27e expref: 534 pid: 6495 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166979.337858:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7be3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+534:61863:x1847765450575616:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 2421us (2566us total) trans 4294992258 rc -22/-22 00000100:00100000:0.0:1762166979.337868:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11909 00000100:00100000:3.0:1762166979.338657:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.338711:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450576000 00000100:00100000:2.0:1762166979.338718:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450576000 00000100:00100000:2.0:1762166979.338755:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30627 00000100:00100000:2.0:1762166979.338763:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+534:61863:x1847765450576000:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166979.338783:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166979.338798:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbabb54 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea285 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.338859:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbabb54 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea285 expref: 535 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.338873:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbabb54 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea285 expref: 535 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.338890:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166979.338893:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166979.338896:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa9c00, rc 0) 00000100:00100000:2.0:1762166979.338936:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+535:61863:x1847765450576000:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 173us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166979.338946:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30627 00000100:00100000:3.0:1762166979.340202:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.340241:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450576256 00000100:00100000:2.0:1762166979.340247:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450576256 00000100:00100000:2.0:1762166979.340282:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30628 00000100:00100000:2.0:1762166979.340295:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+535:61863:x1847765450576256:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166979.340306:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166979.340325:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbabb5b lrc: 2/0,0 mode: --/CW res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea28c expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.340909:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbabb62 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x614:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166979.340922:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbabb62 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x614:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.340931:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbabb62 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x614:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:2.0:1762166979.340947:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x614:0x0]: returning size 0 00010000:00010000:2.0:1762166979.340992:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbabb5b lrc: 0/0,0 mode: --/CW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea28c expref: 538 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.341012:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbabb62 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x614:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea28c expref: 537 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.341021:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x614:0x0].0x0 (ffff945bc809b000) 00010000:00010000:2.0:1762166979.341023:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166979.341026:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa8e00, rc 0) 00000100:00100000:2.0:1762166979.341072:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+537:61863:x1847765450576256:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 783us (875us total) trans 4294992259 rc 0/0 00000100:00100000:2.0:1762166979.341078:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30628 00000100:00100000:3.0:1762166979.342319:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.342403:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450576512 00000100:00100000:2.0:1762166979.342410:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450576512 00000100:00100000:2.0:1762166979.342455:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30629 00000100:00100000:2.0:1762166979.342465:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+537:61863:x1847765450576512:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166979.342521:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166979.342538:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbabb70 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea293 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.342623:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbabb77 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166979.342634:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbabb77 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.342644:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbabb77 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:2.0:1762166979.342655:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 22016 00010000:00010000:2.0:1762166979.342739:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbabb70 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea293 expref: 540 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.342758:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbabb77 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea293 expref: 539 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.342766:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166979.342769:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166979.342772:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa8600, rc 0) 00000100:00100000:2.0:1762166979.342815:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+539:61863:x1847765450576512:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 353us (499us total) trans 4294992260 rc 0/0 00000100:00100000:2.0:1762166979.342820:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30629 00000100:00100000:3.0:1762166979.344123:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.344187:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450576768 00000100:00100000:0.0:1762166979.344197:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450576768 00000100:00100000:0.0:1762166979.344250:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11910 00000100:00100000:0.0:1762166979.344260:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+539:61863:x1847765450576768:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:0.0:1762166979.344337:0:19593:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x240000404:0x5eb:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbabb77 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea293 expref: 539 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.344374:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbabb85 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166979.344388:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbabb54 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea285 expref: 539 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.344397:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbabb85 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166979.344430:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbabb54 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea285 expref: 539 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.344443:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbabb54 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea285 expref: 539 pid: 6495 timeout: 698 lvb_type: 0 00000100:00100000:0.0:1762166979.344454:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7b20e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449749248:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166979.344560:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1c8d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166979.345888:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.345940:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7b20e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449749248:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166979.345942:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450576896 00000100:00100000:2.0:1762166979.345953:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450576896 00010000:00010000:0.0:1762166979.345965:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbabb85 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166979.345993:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbabb54 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea285 expref: 540 pid: 6495 timeout: 698 lvb_type: 0 00000100:00100000:2.0:1762166979.346034:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9684 00000100:00100000:2.0:1762166979.346046:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+540:2419:x1847765450576896:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166979.346068:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166979.346076:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbabb54 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea285 expref: 540 pid: 6495 timeout: 698 lvb_type: 0 00010000:00010000:2.0:1762166979.346089:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbabb54 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea285 expref: 540 pid: 6495 timeout: 698 lvb_type: 0 00010000:00010000:2.0:1762166979.346114:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbabb54 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea285 expref: 540 pid: 6495 timeout: 698 lvb_type: 0 00010000:00010000:2.0:1762166979.346132:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166979.346137:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbabb85 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166979.346155:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbabb85 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166979.346162:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbabb85 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166979.346189:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166979.346209:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbabb85 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166979.346216:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbabb85 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166979.346230:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbabb8c lrc: 3/0,1 mode: --/EX res: [0x240000404:0x614:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166979.346246:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbabb62 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x614:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea28c expref: 539 pid: 6495 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166979.346250:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+539:2419:x1847765450576896:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 197us (353us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166979.346266:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbabb8c lrc: 4/0,1 mode: --/EX res: [0x240000404:0x614:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00000100:00100000:2.0:1762166979.346276:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9684 00010000:00010000:0.0:1762166979.346294:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbabb62 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x614:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea28c expref: 538 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.346308:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbabb62 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x614:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea28c expref: 538 pid: 6495 timeout: 698 lvb_type: 0 00000100:00100000:0.0:1762166979.346326:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7b20e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449749376:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166979.346376:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1c8d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166979.347232:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7b20e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449749376:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166979.347246:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbabb8c lrc: 3/0,1 mode: --/EX res: [0x240000404:0x614:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:0.0:1762166979.347672:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.347710:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450577024 00000100:00100000:2.0:1762166979.347717:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450577024 00010000:00010000:2.0:1762166979.347745:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbabb62 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x614:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea28c expref: 539 pid: 6495 timeout: 698 lvb_type: 0 00000100:00100000:2.0:1762166979.347787:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9685 00000100:00100000:2.0:1762166979.347798:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b20e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+539:2418:x1847765450577024:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166979.347808:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166979.347813:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbabb62 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x614:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea28c expref: 539 pid: 6495 timeout: 698 lvb_type: 0 00010000:00010000:2.0:1762166979.347835:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbabb62 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x614:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea28c expref: 539 pid: 6495 timeout: 698 lvb_type: 0 00010000:00010000:2.0:1762166979.347866:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbabb62 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x614:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea28c expref: 539 pid: 6495 timeout: 698 lvb_type: 0 00010000:00010000:2.0:1762166979.347881:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x614:0x0].0x0 (ffff945bc809b000) 00010000:00010000:2.0:1762166979.347886:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbabb8c lrc: 3/0,1 mode: --/EX res: [0x240000404:0x614:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166979.347894:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbabb8c lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x614:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166979.347900:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbabb8c lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x614:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166979.347924:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166979.347950:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbabb8c lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x614:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166979.347960:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbabb8c lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x614:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:2.0:1762166979.347970:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b20e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+538:2418:x1847765450577024:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 172us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166979.347979:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9685 00000100:00100000:0.0:1762166979.348281:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7b21f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449749504:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166979.348316:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166979.348339:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1c8d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166979.348371:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449749504 00000100:00100000:1.0:1762166979.348379:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449749504 00000100:00100000:1.0:1762166979.348424:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1405 00000100:00100000:1.0:1762166979.348437:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc6358450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449749504:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166979.348562:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc6358450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449749504:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 129us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166979.348570:0:19593:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 17179876518 gen 2 00000100:00100000:1.0:1762166979.348573:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1405 00000004:00080000:0.0:1762166979.348581:0:19593:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 17179876514 committed transno 17179876518 00000004:00080000:0.0:1762166979.348602:0:19593:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc48aa300, transno 17179876515 00000004:00080000:0.0:1762166979.348617:0:19593:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc48ab100, transno 17179876516 00000004:00080000:0.0:1762166979.348622:0:19593:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc48a8700, transno 17179876517 00000004:00080000:0.0:1762166979.348626:0:19593:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc48aa680, transno 17179876518 00000100:00100000:0.0:1762166979.348634:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7b21f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449749504:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166979.348695:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7b21f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449749632:0@lo:1000:mdt_rdpg00_003.0 00000004:00080000:2.0:1762166979.348785:0:9994:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0001: 0 changes, 0 in progress, 0 in flight, 4 done 00000100:00100000:0.0:1762166979.348861:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166979.348906:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc63999c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166979.348917:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449749632 00000100:00100000:3.0:1762166979.348923:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449749632 00000100:00100000:3.0:1762166979.348966:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1406 00000100:00100000:3.0:1762166979.348978:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:19593:x1847765449749632:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166979.349069:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:19593:x1847765449749632:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 96us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166979.349076:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1406 00000100:00100000:0.0:1762166979.349195:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7b21f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449749632:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166979.349267:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7b21f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449749760:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166979.349298:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166979.349319:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc63999c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166979.349342:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449749760 00000100:00100000:3.0:1762166979.349346:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449749760 00000100:00100000:3.0:1762166979.349370:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1407 00000100:00100000:3.0:1762166979.349376:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:19593:x1847765449749760:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166979.349443:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:19593:x1847765449749760:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 66us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166979.349450:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1407 00000100:00100000:0.0:1762166979.349517:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7b21f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449749760:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166979.349553:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7b21f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449749888:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166979.349577:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166979.349602:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7a779c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166979.349650:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449749888 00000100:00100000:3.0:1762166979.349654:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449749888 00000100:00100000:3.0:1762166979.349682:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1408 00000100:00100000:3.0:1762166979.349689:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449749888:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166979.349759:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449749888:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 70us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166979.349766:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1408 00000100:00100000:0.0:1762166979.349789:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7b21f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449749888:0@lo:1000:mdt_rdpg00_003.0 00000040:00080000:0.0:1762166979.349937:0:19593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x2:0x0].55, 280 off68760 00000001:00080000:0.0:1762166979.349945:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992261 00000100:00100000:0.0:1762166979.349996:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7b21f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449750016:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166979.350021:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166979.350046:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc6399cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166979.350069:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449750016 00000100:00100000:3.0:1762166979.350074:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449750016 00000100:00100000:3.0:1762166979.350105:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1409 00000100:00100000:3.0:1762166979.350113:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449750016:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166979.350236:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:19593:x1847765449750016:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 123us (214us total) trans 17179876522 rc 0/0 00000100:00100000:3.0:1762166979.350244:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1409 00000100:00100000:0.0:1762166979.350277:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7b21f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449750016:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166979.350302:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7b23480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449750144:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166979.350327:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166979.350353:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc11cad80 going to sleep for 11 seconds 00000100:00100000:3.0:1762166979.350410:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449750144 00000100:00100000:3.0:1762166979.350414:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449750144 00000100:00100000:3.0:1762166979.350433:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1410 00000100:00100000:3.0:1762166979.350437:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:19593:x1847765449750144:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166979.350542:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:19593:x1847765449750144:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 103us (214us total) trans 21474843366 rc 0/0 00000100:00100000:3.0:1762166979.350548:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1410 00000100:00100000:0.0:1762166979.350569:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7b23480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449750144:0@lo:1000:mdt_rdpg00_003.0 00000001:00080000:0.0:1762166979.350629:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992262 00010000:00010000:0.0:1762166979.350653:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbabb8c lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x614:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166979.350665:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbabb8c lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x614:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166979.350677:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbabb8c lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x614:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166979.350683:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdfc00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166979.350688:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbabb8c lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x614:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166979.350697:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbabb8c lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x614:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166979.350713:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x614:0x0].0x0 (ffff945bc809b000) 00010000:00010000:0.0:1762166979.350716:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166979.350721:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbabb8c lrc: 2/0,0 mode: --/EX res: [0x240000404:0x614:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166979.350728:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbabb8c lrc: 0/0,0 mode: --/EX res: [0x240000404:0x614:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166979.350748:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbabb85 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166979.350754:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbabb85 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166979.350760:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbabb85 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166979.350765:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdf000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166979.350768:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbabb85 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166979.350774:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbabb85 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166979.350785:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:0.0:1762166979.350788:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166979.350791:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbabb85 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166979.350796:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbabb85 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166979.350807:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:0.0:1762166979.350809:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166979.350815:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbabb77 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea293 expref: 540 pid: 6495 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166979.350917:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+539:61863:x1847765450576768:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 6658us (6803us total) trans 4294992263 rc 0/0 00000100:00100000:0.0:1762166979.350926:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11910 00000020:00080000:0.0:1762166979.350931:0:19593:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1762166979.351975:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.352023:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450577152 00000100:00100000:2.0:1762166979.352031:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450577152 00000100:00100000:2.0:1762166979.352073:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30630 00000100:00100000:2.0:1762166979.352083:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+539:61863:x1847765450577152:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166979.352104:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166979.352124:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbabb93 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea29a expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.352180:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbabb93 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea29a expref: 540 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.352196:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbabb93 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea29a expref: 540 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.352212:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166979.352215:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166979.352218:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa9e00, rc 0) 00000100:00100000:2.0:1762166979.352257:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+540:61863:x1847765450577152:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 175us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166979.352264:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30630 00000100:00100000:3.0:1762166979.353679:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.353737:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450577408 00000100:00100000:0.0:1762166979.353745:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450577408 00000100:00100000:0.0:1762166979.353787:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11911 00000100:00100000:0.0:1762166979.353795:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+540:61863:x1847765450577408:12345-192.168.204.38@tcp:35:lfs.0 00000004:00080000:0.0:1762166979.354095:0:19593:0:(mdd_object.c:3965:mdd_close()) Object [0x240000404:0x614:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1762166979.354178:0:19593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5917, 64 off463424 00000040:00080000:0.0:1762166979.354206:0:19593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5916, 64 off463424 00000001:00080000:0.0:1762166979.354213:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992264 00010000:00010000:0.0:1762166979.354250:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbabb9a lrc: 3/0,1 mode: --/PW res: [0x240000404:0x614:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166979.354266:0:19593:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbabb9a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x614:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166979.354278:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbabb9a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x614:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166979.354286:0:19593:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbabb9a lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x614:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166979.354292:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbabb9a lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x614:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166979.354297:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbabb9a lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x614:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166979.354320:0:19593:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1762166979.354360:0:10257:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1762166979.354371:0:10257:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbabb9a lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x614:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166979.354383:0:10257:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bde600 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166979.354387:0:10257:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbabb9a lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x614:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166979.354396:0:10257:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbabb9a lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x614:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166979.354416:0:10257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x614:0x0].0x0 (ffff945bc4afe700) 00010000:00010000:3.0:1762166979.354420:0:10257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1762166979.354425:0:10257:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbabb9a lrc: 1/0,0 mode: --/PW res: [0x240000404:0x614:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166979.354431:0:10257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbabb9a lrc: 0/0,0 mode: --/PW res: [0x240000404:0x614:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166979.354460:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166979.354463:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166979.354465:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166979.354561:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+542:61863:x1847765450577408:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 765us (886us total) trans 4294992265 rc 0/0 00000100:00100000:0.0:1762166979.354571:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11911 00000020:00080000:0.0:1762166979.354586:0:19593:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1762166979.355369:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.355418:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450577664 00000100:00100000:0.0:1762166979.355425:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450577664 00000100:00100000:0.0:1762166979.355463:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11912 00000100:00100000:0.0:1762166979.355473:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+542:61863:x1847765450577664:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166979.355659:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+543:61863:x1847765450577664:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 188us (295us total) trans 4294992266 rc 0/0 00000100:00100000:0.0:1762166979.355669:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11912 00000100:00100000:3.0:1762166979.357657:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.357711:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450577920 00000100:00100000:2.0:1762166979.357717:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450577920 00000100:00100000:2.0:1762166979.357752:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30631 00000100:00100000:2.0:1762166979.357758:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+543:61766:x1847765450577920:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:2.0:1762166979.357775:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166979.357793:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbabba1 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea2a1 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.357864:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbabba8 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166979.357876:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbabba8 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.357884:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbabba8 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.357895:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbabbaf lrc: 3/1,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166979.357900:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbabbaf lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.357904:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbabbaf lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.357986:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbabbb6 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166979.357991:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbabbb6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.357995:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbabbb6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:2.0:1762166979.358003:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 22016 00010000:00010000:2.0:1762166979.358056:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbabba8 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.358061:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbabba8 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.358065:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbabba8 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.358069:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbabba8 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.358073:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa9c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166979.358076:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbabba8 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.358081:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbabba8 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.358090:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0x0 (ffff945bc809b600) 00010000:00010000:2.0:1762166979.358092:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166979.358095:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbabba8 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.358099:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbabba8 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.358109:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbabbaf lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.358112:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbabbaf lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.358116:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbabbaf lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.358119:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa8c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166979.358120:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbabbaf lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.358123:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbabbaf lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.358126:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0xdd396665 (ffff945bc809bd00) 00010000:00010000:2.0:1762166979.358128:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166979.358129:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbabbaf lrc: 2/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.358132:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbabbaf lrc: 0/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.358164:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbabba1 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea2a1 expref: 546 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.358179:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbabbb6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea2a1 expref: 545 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.358187:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166979.358189:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166979.358191:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa8000, rc 0) 00000100:00100000:2.0:1762166979.358238:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+545:61766:x1847765450577920:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 480us (587us total) trans 4294992267 rc 0/0 00000100:00100000:2.0:1762166979.358243:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30631 00000100:00100000:3.0:1762166979.360033:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.360072:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450578048 00000100:00100000:2.0:1762166979.360078:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450578048 00000100:00100000:2.0:1762166979.360114:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30632 00000100:00100000:2.0:1762166979.360123:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+545:61766:x1847765450578048:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:2.0:1762166979.360142:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166979.360157:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9400/0x2f180c4effbabbc4 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea2a8 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.360184:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbabbcb lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166979.360196:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbabbcb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.360206:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbabbcb lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.360304:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9400/0x2f180c4effbabbc4 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea2a8 expref: 547 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.360319:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbabbcb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea2a8 expref: 546 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.360326:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166979.360329:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1762166979.360332:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa8200, rc 0) 00000100:00100000:2.0:1762166979.360375:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+546:61766:x1847765450578048:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 253us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166979.360385:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30632 00000100:00100000:3.0:1762166979.361227:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.361268:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450578304 00000100:00100000:2.0:1762166979.361272:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450578304 00000100:00100000:2.0:1762166979.361301:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30633 00000100:00100000:2.0:1762166979.361306:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+546:61766:x1847765450578304:12345-192.168.204.38@tcp:36:fsx.0 00010000:00010000:2.0:1762166979.361351:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166979.361369:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbabbb6 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea2a1 expref: 546 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.361388:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166979.361393:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166979.361559:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbabbd2 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166979.361570:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbabbd2 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.361586:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbabbd2 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000001:00080000:2.0:1762166979.361623:0:6495:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992268 00000004:00010000:2.0:1762166979.361640:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000d2b1b213 reply state 000000004271709b transno 4294992269 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbabbd2 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.361649:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbabbd2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.361653:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166979.361655:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166979.361657:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166979.361703:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+548:61766:x1847765450578304:12345-192.168.204.38@tcp:36:fsx.0 Request processed in 397us (479us total) trans 4294992269 rc 0/0 00000100:00100000:2.0:1762166979.361708:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30633 00000020:00080000:2.0:1762166979.361711:0:6495:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1762166979.362599:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166979.362662:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450578432 00000100:00100000:1.0:1762166979.362667:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450578432 00000100:00100000:3.0:1762166979.362677:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00002000:00010000:1.0:1762166979.362693:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (102375->18446744073709551615) 00002000:00100000:1.0:1762166979.362698:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf783f480 with x1847765450578432 ext(102375->18446744073709551615) 00002000:00010000:1.0:1762166979.362707:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf783f480. 00000100:00100000:2.0:1762166979.362710:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450578560 00000100:00100000:2.0:1762166979.362715:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450578560 00000100:00100000:3.0:1762166979.362723:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00002000:00010000:2.0:1762166979.362731:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00000100:00100000:1.0:1762166979.362735:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450578688 00002000:00100000:2.0:1762166979.362736:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc6224000 with x1847765450578560 ext(0->18446744073709551615) 00000100:00100000:1.0:1762166979.362740:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450578688 00002000:00010000:2.0:1762166979.362745:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc6224000. 00000100:00100000:3.0:1762166979.362751:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2472 00002000:00010000:1.0:1762166979.362753:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:1.0:1762166979.362756:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc6227b80 with x1847765450578688 ext(0->18446744073709551615) 00002000:00010000:1.0:1762166979.362761:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc6227b80. 00000100:00100000:3.0:1762166979.362762:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450578432:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:2.0:1762166979.362783:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2473 00000100:00100000:1.0:1762166979.362791:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2474 00000100:00100000:2.0:1762166979.362795:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6224000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450578560:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:1.0:1762166979.362804:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6227b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450578688:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:1.0:1762166979.362906:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166979.362907:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166979.362911:0:23939:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166979 -> 1762166979 00002000:00010000:1.0:1762166979.362913:0:23943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166979 -> 1762166979 00002000:00010000:2.0:1762166979.362915:0:23939:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:1.0:1762166979.362919:0:23943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166979.362920:0:23939:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166979 -> 1762166979 00002000:00010000:2.0:1762166979.362925:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00002000:00010000:1.0:1762166979.362927:0:23943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166979 -> 1762166979 00002000:00010000:1.0:1762166979.362931:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:3.0:1762166979.362957:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 22016 -> 102375 00002000:00010000:3.0:1762166979.362961:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166979 -> 1762166979 00002000:00010000:3.0:1762166979.362963:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00000100:00100000:2.0:1762166979.362976:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6224000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450578560:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 185us (297us total) trans 21474843367 rc 0/0 00000100:00100000:2.0:1762166979.362987:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2473 00000100:00100000:1.0:1762166979.362987:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6227b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450578688:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 184us (261us total) trans 17179876523 rc 0/0 00002000:00010000:2.0:1762166979.362991:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:2.0:1762166979.362997:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc6224000 with x1847765450578560 ext(0->18446744073709551615) 00000100:00100000:1.0:1762166979.363002:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2474 00002000:00010000:2.0:1762166979.363003:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc6224000. 00002000:00010000:3.0:1762166979.363006:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166979 -> 1762166979 00002000:00010000:1.0:1762166979.363008:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00010000:3.0:1762166979.363011:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 48 -> 48 00002000:00100000:1.0:1762166979.363014:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc6227b80 with x1847765450578688 ext(0->18446744073709551615) 00002000:00010000:1.0:1762166979.363022:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc6227b80. 00000100:00100000:3.0:1762166979.363056:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450578432:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 297us (458us total) trans 17179876524 rc 0/0 00000100:00100000:3.0:1762166979.363066:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2472 00002000:00010000:3.0:1762166979.363070:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (102375->18446744073709551615) 00002000:00100000:3.0:1762166979.363074:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf783f480 with x1847765450578432 ext(102375->18446744073709551615) 00002000:00010000:3.0:1762166979.363079:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf783f480. 00000100:00100000:3.0:1762166979.363925:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.363967:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450578816 00000100:00100000:2.0:1762166979.363972:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450578816 00000100:00100000:2.0:1762166979.364008:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30634 00000100:00100000:2.0:1762166979.364015:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6225880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+548:61766:x1847765450578816:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:2.0:1762166979.364030:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166979.364044:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbabbd9 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea2af expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.364115:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbabbe0 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166979.364128:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbabbe0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.364138:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbabbe0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:2.0:1762166979.364176:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 102375 00000004:00200000:2.0:1762166979.364180:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166979.364197:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbabbe0 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.364220:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbabbd9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea2af expref: 550 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.364237:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbabbe0 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea2af expref: 549 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.364246:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166979.364250:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166979.364253:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa9800, rc 0) 00000100:00100000:2.0:1762166979.364288:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6225880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+549:61766:x1847765450578816:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 273us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166979.364295:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30634 00000100:00100000:0.0:1762166979.365957:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166979.366036:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450578944 00000100:00100000:3.0:1762166979.366043:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450578944 00002000:00100000:3.0:1762166979.366081:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (4096->8191) req@ffff945bc4011500 x1847765450578944/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:10/0 lens 488/0 e 0 to 0 dl 1762166990 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166979.366089:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4011500 with x1847765450578944 ext(4096->8191) 00002000:00010000:3.0:1762166979.366094:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4011500 00000100:00100000:3.0:1762166979.366112:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2475 00000100:00100000:3.0:1762166979.366119:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4011500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+21:2416:x1847765450578944:12345-192.168.204.38@tcp:3:lfs.0 00000100:00100000:3.0:1762166979.366292:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4011500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+21:2416:x1847765450578944:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 171us (342us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1762166979.366300:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2475 00002000:00100000:3.0:1762166979.366308:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (4096->8191) req@ffff945bc4011500 x1847765450578944/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:10/0 lens 488/4536 e 0 to 0 dl 1762166990 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166979.366317:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4011500 with x1847765450578944 ext(4096->8191) 00002000:00010000:3.0:1762166979.366321:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4011500 00000100:00100000:0.0:1762166979.367760:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166979.367925:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450579072 00000100:00100000:3.0:1762166979.367933:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450579072 00002000:00100000:3.0:1762166979.367972:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (8192->12287) req@ffff945bc4013800 x1847765450579072/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:10/0 lens 488/0 e 0 to 0 dl 1762166990 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166979.367983:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4013800 with x1847765450579072 ext(8192->12287) 00002000:00010000:3.0:1762166979.367988:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4013800 00000100:00100000:3.0:1762166979.368023:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2476 00000100:00100000:3.0:1762166979.368033:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4013800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450579072:12345-192.168.204.38@tcp:3:lfs.0 00000100:00100000:3.0:1762166979.368173:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4013800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450579072:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 141us (421us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1762166979.368181:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2476 00002000:00100000:3.0:1762166979.368189:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (8192->12287) req@ffff945bc4013800 x1847765450579072/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:10/0 lens 488/4536 e 0 to 0 dl 1762166990 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166979.368198:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4013800 with x1847765450579072 ext(8192->12287) 00002000:00010000:3.0:1762166979.368202:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4013800 00000100:00100000:2.0:1762166979.369689:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166979.369763:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450579200 00000100:00100000:1.0:1762166979.369779:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450579200 00002000:00100000:1.0:1762166979.369839:0:23943:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000400:0xa77:0x0] (12288->69631) req@ffff945bc5588380 x1847765450579200/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:10/0 lens 488/0 e 0 to 0 dl 1762166990 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166979.369861:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5588380 with x1847765450579200 ext(12288->69631) 00002000:00010000:1.0:1762166979.369868:0:23943:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5588380 00000100:00100000:1.0:1762166979.369900:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2477 00000100:00100000:1.0:1762166979.369915:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5588380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+21:2416:x1847765450579200:12345-192.168.204.38@tcp:3:lfs.0 00000100:00100000:1.0:1762166979.371323:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5588380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+21:2416:x1847765450579200:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 1410us (1637us total) trans 0 rc 57344/57344 00000100:00100000:1.0:1762166979.371334:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2477 00002000:00100000:1.0:1762166979.371343:0:23943:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000400:0xa77:0x0] (12288->69631) req@ffff945bc5588380 x1847765450579200/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:10/0 lens 488/440 e 0 to 0 dl 1762166990 ref 1 fl Complete:/600/0 rc 57344/57344 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166979.371359:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5588380 with x1847765450579200 ext(12288->69631) 00002000:00010000:1.0:1762166979.371363:0:23943:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5588380 00000100:00100000:0.0:1762166979.374375:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.374443:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450579456 00000100:00100000:2.0:1762166979.374454:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450579456 00000100:00100000:2.0:1762166979.374548:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30635 00000100:00100000:2.0:1762166979.374560:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4012680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+549:61766:x1847765450579456:12345-192.168.204.38@tcp:36:fsx.0 00010000:00010000:2.0:1762166979.374614:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166979.374640:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbabbe0 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea2af expref: 549 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.374664:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166979.374669:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166979.374878:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbabbe7 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166979.374895:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbabbe7 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.374905:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbabbe7 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000001:00080000:2.0:1762166979.374951:0:6495:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992270 00000004:00010000:2.0:1762166979.374973:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000d27f8c9f reply state 0000000053f40154 transno 4294992271 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbabbe7 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.374985:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbabbe7 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.374991:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166979.374993:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166979.374996:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166979.375100:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4012680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+551:61766:x1847765450579456:12345-192.168.204.38@tcp:36:fsx.0 Request processed in 542us (737us total) trans 4294992271 rc 0/0 00000100:00100000:2.0:1762166979.375107:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30635 00000020:00080000:2.0:1762166979.375112:0:6495:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1762166979.377974:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.378024:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166979.378053:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450579584 00000100:00100000:1.0:1762166979.378079:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450579584 00002000:00010000:1.0:1762166979.378136:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (249911->18446744073709551615) 00002000:00100000:1.0:1762166979.378142:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc558ad80 with x1847765450579584 ext(249911->18446744073709551615) 00002000:00010000:1.0:1762166979.378157:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc558ad80. 00000100:00100000:1.0:1762166979.378201:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450579712 00000100:00100000:1.0:1762166979.378206:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450579712 00002000:00010000:1.0:1762166979.378226:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:1.0:1762166979.378229:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5589f80 with x1847765450579712 ext(0->18446744073709551615) 00002000:00010000:1.0:1762166979.378237:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc5589f80. 00000100:00100000:2.0:1762166979.378245:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.379713:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450579840 00000100:00100000:0.0:1762166979.379725:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450579840 00000100:00100000:1.0:1762166979.379730:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2478 00000100:00100000:1.0:1762166979.379751:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765450579584:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:3.0:1762166979.379753:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2479 00002000:00010000:0.0:1762166979.379760:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:0.0:1762166979.379767:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5589c00 with x1847765450579840 ext(0->18446744073709551615) 00000100:00100000:3.0:1762166979.379779:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5589f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450579712:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:0.0:1762166979.379779:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5589c00. 00000100:00100000:2.0:1762166979.379815:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2480 00000100:00100000:2.0:1762166979.379834:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5589c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450579840:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:3.0:1762166979.379975:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166979.379975:0:14623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166979.379981:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166979 -> 1762166979 00002000:00010000:2.0:1762166979.379981:0:14623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166979 -> 1762166979 00002000:00010000:3.0:1762166979.379985:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:2.0:1762166979.379985:0:14623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:3.0:1762166979.379988:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166979 -> 1762166979 00002000:00010000:2.0:1762166979.379988:0:14623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166979 -> 1762166979 00002000:00010000:2.0:1762166979.379991:0:14623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:3.0:1762166979.379992:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00002000:00010000:1.0:1762166979.380016:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 102375 -> 249911 00002000:00010000:1.0:1762166979.380019:0:23943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166979 -> 1762166979 00002000:00010000:1.0:1762166979.380021:0:23943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:1.0:1762166979.380023:0:23943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166979 -> 1762166979 00002000:00010000:1.0:1762166979.380025:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 48 -> 48 00000100:00100000:3.0:1762166979.380058:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5589f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450579712:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 290us (2032us total) trans 21474843368 rc 0/0 00000100:00100000:2.0:1762166979.380058:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5589c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765450579840:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 230us (1813us total) trans 17179876525 rc 0/0 00000100:00100000:2.0:1762166979.380068:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2480 00000100:00100000:1.0:1762166979.380073:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+24:2418:x1847765450579584:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 332us (2105us total) trans 17179876526 rc 0/0 00002000:00010000:2.0:1762166979.380079:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00000100:00100000:3.0:1762166979.380082:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2479 00002000:00100000:2.0:1762166979.380084:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5589c00 with x1847765450579840 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166979.380085:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:3.0:1762166979.380088:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5589f80 with x1847765450579712 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166979.380092:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5589c00. 00002000:00010000:3.0:1762166979.380094:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc5589f80. 00000100:00100000:1.0:1762166979.380095:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2478 00002000:00010000:1.0:1762166979.380104:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (249911->18446744073709551615) 00002000:00100000:1.0:1762166979.380109:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc558ad80 with x1847765450579584 ext(249911->18446744073709551615) 00002000:00010000:1.0:1762166979.380119:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc558ad80. 00000100:00100000:0.0:1762166979.381923:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.381981:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450579968 00000100:00100000:2.0:1762166979.381992:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450579968 00000100:00100000:2.0:1762166979.382047:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30636 00000100:00100000:2.0:1762166979.382057:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4011c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+551:61766:x1847765450579968:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:2.0:1762166979.382077:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166979.382094:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbabbee lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea2b6 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.382196:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbabbf5 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166979.382211:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbabbf5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.382222:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbabbf5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:2.0:1762166979.382247:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 249911 00000004:00200000:2.0:1762166979.382251:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166979.382268:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbabbf5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.382293:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbabbee lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea2b6 expref: 553 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.382311:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbabbf5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea2b6 expref: 552 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.382323:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166979.382326:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166979.382329:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa8000, rc 0) 00000100:00100000:2.0:1762166979.382386:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4011c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+552:61766:x1847765450579968:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 330us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166979.382393:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30636 00000100:00100000:0.0:1762166979.384808:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166979.384889:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450580096 00000100:00100000:1.0:1762166979.384899:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450580096 00000100:00100000:1.0:1762166979.384975:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2481 00000100:00100000:1.0:1762166979.384989:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4013480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765450580096:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:1.0:1762166979.385327:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 249911 -> 249911 00002000:00010000:1.0:1762166979.385331:0:23943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166979 -> 1762166979 00002000:00010000:1.0:1762166979.385334:0:23943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:1.0:1762166979.385337:0:23943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166979 -> 1762166979 00002000:00010000:1.0:1762166979.385339:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 48 -> 104 00000100:00100000:1.0:1762166979.385408:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4013480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+25:2419:x1847765450580096:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 422us (610us total) trans 17179876527 rc 0/0 00000100:00100000:1.0:1762166979.385418:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2481 00000100:00100000:3.0:1762166979.387890:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166979.387967:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450580224 00000100:00100000:1.0:1762166979.387982:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450580224 00000100:00100000:1.0:1762166979.388058:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2482 00000100:00100000:1.0:1762166979.388069:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6224e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+25:2418:x1847765450580224:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:1.0:1762166979.388271:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 249911 -> 249911 00002000:00010000:1.0:1762166979.388275:0:23943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166979 -> 1762166979 00002000:00010000:1.0:1762166979.388277:0:23943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:1.0:1762166979.388280:0:23943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166979 -> 1762166979 00002000:00010000:1.0:1762166979.388282:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 104 -> 104 00000100:00100000:1.0:1762166979.388356:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6224e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+26:2418:x1847765450580224:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 288us (476us total) trans 17179876528 rc 0/0 00000100:00100000:1.0:1762166979.388364:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2482 00000100:00100000:0.0:1762166979.390311:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.390429:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450580480 00000100:00100000:2.0:1762166979.390441:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450580480 00000100:00100000:2.0:1762166979.390525:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30637 00000100:00100000:2.0:1762166979.390536:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4011180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+552:61766:x1847765450580480:12345-192.168.204.38@tcp:36:fsx.0 00010000:00010000:2.0:1762166979.390585:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166979.390611:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbabbf5 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea2b6 expref: 552 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.390630:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166979.390636:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166979.390784:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbabbfc lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166979.390798:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbabbfc lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.390807:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbabbfc lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000001:00080000:2.0:1762166979.390840:0:6495:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992272 00000004:00010000:2.0:1762166979.390875:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000de91c911 reply state 00000000116ed1e4 transno 4294992273 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbabbfc lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.390891:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbabbfc lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.390907:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166979.390910:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166979.390913:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166979.391001:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4011180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+554:61766:x1847765450580480:12345-192.168.204.38@tcp:36:fsx.0 Request processed in 467us (699us total) trans 4294992273 rc 0/0 00000100:00100000:2.0:1762166979.391008:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30637 00000020:00080000:2.0:1762166979.391013:0:6495:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1762166979.393167:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.393215:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166979.393232:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450580608 00000100:00100000:1.0:1762166979.393242:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450580608 00000100:00100000:2.0:1762166979.393251:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450580736 00000100:00100000:2.0:1762166979.393256:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450580736 00000100:00100000:0.0:1762166979.393257:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00002000:00010000:2.0:1762166979.393276:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00010000:1.0:1762166979.393276:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (192321->18446744073709551615) 00002000:00100000:2.0:1762166979.393281:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4010e00 with x1847765450580736 ext(0->18446744073709551615) 00002000:00100000:1.0:1762166979.393281:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4011f80 with x1847765450580608 ext(192321->18446744073709551615) 00002000:00010000:2.0:1762166979.393292:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc4010e00. 00002000:00010000:1.0:1762166979.393292:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4011f80. 00000100:00100000:2.0:1762166979.393331:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450580864 00000100:00100000:2.0:1762166979.393335:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450580864 00002000:00010000:2.0:1762166979.393347:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00000100:00100000:1.0:1762166979.393347:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2483 00002000:00100000:2.0:1762166979.393350:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4010a80 with x1847765450580864 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166979.393355:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4010a80. 00000100:00100000:1.0:1762166979.393355:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4010e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450580736:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:0.0:1762166979.393403:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2484 00000100:00100000:3.0:1762166979.393424:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2485 00000100:00100000:0.0:1762166979.393424:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4011f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+27:2419:x1847765450580608:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:3.0:1762166979.393452:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4010a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+27:2418:x1847765450580864:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:1.0:1762166979.393542:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166979.393546:0:23943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166979 -> 1762166979 00002000:00010000:1.0:1762166979.393549:0:23943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:1.0:1762166979.393552:0:23943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166979 -> 1762166979 00002000:00010000:1.0:1762166979.393554:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00000100:00100000:1.0:1762166979.393609:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4010e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450580736:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 252us (393us total) trans 21474843369 rc 0/0 00000100:00100000:1.0:1762166979.393617:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2483 00002000:00010000:1.0:1762166979.393622:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:1.0:1762166979.393626:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4010e00 with x1847765450580736 ext(0->18446744073709551615) 00002000:00010000:1.0:1762166979.393632:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc4010e00. 00002000:00010000:3.0:1762166979.393653:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166979.393658:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166979 -> 1762166979 00002000:00010000:0.0:1762166979.393661:0:14623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 249911 -> 192321 00002000:00010000:3.0:1762166979.393662:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:0.0:1762166979.393674:0:14623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166979 -> 1762166979 00002000:00010000:3.0:1762166979.393675:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166979 -> 1762166979 00002000:00010000:3.0:1762166979.393683:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:0.0:1762166979.393686:0:14623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:0.0:1762166979.393691:0:14623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166979 -> 1762166979 00002000:00010000:0.0:1762166979.393694:0:14623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 104 -> 104 00000100:00100000:3.0:1762166979.393744:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4010a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+29:2418:x1847765450580864:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 300us (486us total) trans 17179876530 rc 0/0 00000100:00100000:0.0:1762166979.393752:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4011f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+29:2419:x1847765450580608:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 333us (585us total) trans 17179876529 rc 0/0 00000100:00100000:3.0:1762166979.393762:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2485 00002000:00010000:3.0:1762166979.393769:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00000100:00100000:0.0:1762166979.393775:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2484 00002000:00100000:3.0:1762166979.393777:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4010a80 with x1847765450580864 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166979.393782:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (192321->18446744073709551615) 00002000:00010000:3.0:1762166979.393789:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4010a80. 00002000:00100000:0.0:1762166979.393790:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4011f80 with x1847765450580608 ext(192321->18446744073709551615) 00002000:00010000:0.0:1762166979.393803:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4011f80. 00000100:00100000:3.0:1762166979.395835:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.395939:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450580992 00000100:00100000:2.0:1762166979.395949:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450580992 00000100:00100000:2.0:1762166979.396005:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30638 00000100:00100000:2.0:1762166979.396014:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6225c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+554:61766:x1847765450580992:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:2.0:1762166979.396039:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166979.396060:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbabc03 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea2bd expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.396164:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbabc0a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166979.396179:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbabc0a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.396191:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbabc0a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:2.0:1762166979.396217:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 192321 00000004:00200000:2.0:1762166979.396222:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166979.396244:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbabc0a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.396271:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbabc03 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea2bd expref: 556 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.396305:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbabc0a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea2bd expref: 555 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.396314:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166979.396317:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166979.396321:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa8c00, rc 0) 00000100:00100000:2.0:1762166979.396372:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6225c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+555:61766:x1847765450580992:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 359us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166979.396379:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30638 00000100:00100000:2.0:1762166979.400018:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.400130:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450581120 00000100:00100000:0.0:1762166979.400145:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450581120 00000100:00100000:0.0:1762166979.400228:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2486 00000100:00100000:0.0:1762166979.400240:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5589180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+28:2416:x1847765450581120:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:0.0:1762166979.400616:0:14623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 192321 -> 192321 00002000:00010000:0.0:1762166979.400621:0:14623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166979 -> 1762166979 00002000:00010000:0.0:1762166979.400624:0:14623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:0.0:1762166979.400626:0:14623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166979 -> 1762166979 00002000:00010000:0.0:1762166979.400629:0:14623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 104 -> 104 00000100:00100000:0.0:1762166979.400704:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5589180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+29:2416:x1847765450581120:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 466us (694us total) trans 17179876531 rc 0/0 00000100:00100000:0.0:1762166979.400714:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2486 00000100:00100000:0.0:1762166979.402881:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.402951:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450581376 00000100:00100000:2.0:1762166979.402960:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450581376 00000100:00100000:2.0:1762166979.403013:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30639 00000100:00100000:2.0:1762166979.403022:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4012300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+555:61766:x1847765450581376:12345-192.168.204.38@tcp:36:fsx.0 00010000:00010000:2.0:1762166979.403084:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166979.403117:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbabc0a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea2bd expref: 555 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.403136:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166979.403142:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166979.403335:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbabc11 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166979.403356:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbabc11 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.403368:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbabc11 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000001:00080000:2.0:1762166979.403415:0:6495:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992274 00000004:00010000:2.0:1762166979.403444:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000007ef2ede6 reply state 00000000d8d94306 transno 4294992275 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbabc11 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.403457:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbabc11 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.403464:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166979.403466:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166979.403469:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166979.403601:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4012300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+557:61766:x1847765450581376:12345-192.168.204.38@tcp:36:fsx.0 Request processed in 579us (725us total) trans 4294992275 rc 0/0 00000100:00100000:2.0:1762166979.403609:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30639 00000020:00080000:2.0:1762166979.403614:0:6495:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1762166979.406326:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166979.406363:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.406406:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450581504 00000100:00100000:0.0:1762166979.406415:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450581504 00000100:00100000:3.0:1762166979.406450:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00002000:00010000:0.0:1762166979.406461:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (204311->18446744073709551615) 00002000:00100000:0.0:1762166979.406467:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc6224a80 with x1847765450581504 ext(204311->18446744073709551615) 00000100:00100000:1.0:1762166979.406468:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450581632 00000100:00100000:1.0:1762166979.406496:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450581632 00002000:00010000:0.0:1762166979.406504:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc6224a80. 00002000:00010000:1.0:1762166979.406523:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:1.0:1762166979.406529:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc6226680 with x1847765450581632 ext(0->18446744073709551615) 00000100:00100000:0.0:1762166979.406531:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450581760 00000100:00100000:0.0:1762166979.406536:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450581760 00002000:00010000:1.0:1762166979.406537:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc6226680. 00000100:00100000:3.0:1762166979.406548:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2487 00002000:00010000:0.0:1762166979.406551:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:0.0:1762166979.406555:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc6225500 with x1847765450581760 ext(0->18446744073709551615) 00000100:00100000:1.0:1762166979.406562:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2488 00000100:00100000:3.0:1762166979.406563:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6224a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+30:2419:x1847765450581504:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:0.0:1762166979.406568:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc6225500. 00000100:00100000:1.0:1762166979.406569:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6226680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450581632:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:0.0:1762166979.406591:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2489 00000100:00100000:0.0:1762166979.406601:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6225500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+30:2419:x1847765450581760:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:1.0:1762166979.406739:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166979.406739:0:14623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166979.406746:0:14623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166979 -> 1762166979 00002000:00010000:1.0:1762166979.406747:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166979 -> 1762166979 00002000:00010000:1.0:1762166979.406754:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:0.0:1762166979.406754:0:14623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:0.0:1762166979.406759:0:14623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166979 -> 1762166979 00002000:00010000:1.0:1762166979.406761:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166979 -> 1762166979 00002000:00010000:0.0:1762166979.406764:0:14623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:1.0:1762166979.406766:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00002000:00010000:3.0:1762166979.406775:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 192321 -> 204311 00002000:00010000:3.0:1762166979.406778:0:23939:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166979 -> 1762166979 00002000:00010000:3.0:1762166979.406780:0:23939:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166978 -> 1762166978 00002000:00010000:3.0:1762166979.406782:0:23939:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166979 -> 1762166979 00002000:00010000:3.0:1762166979.406785:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 104 -> 104 00000100:00100000:0.0:1762166979.406832:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6225500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+32:2419:x1847765450581760:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 232us (381us total) trans 17179876532 rc 0/0 00000100:00100000:3.0:1762166979.406836:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6224a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+32:2419:x1847765450581504:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 274us (515us total) trans 17179876533 rc 0/0 00000100:00100000:1.0:1762166979.406836:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6226680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450581632:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 264us (469us total) trans 21474843370 rc 0/0 00000100:00100000:0.0:1762166979.406857:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2489 00002000:00010000:0.0:1762166979.406862:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00000100:00100000:1.0:1762166979.406866:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2488 00002000:00100000:0.0:1762166979.406868:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc6225500 with x1847765450581760 ext(0->18446744073709551615) 00002000:00010000:1.0:1762166979.406872:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00000100:00100000:3.0:1762166979.406873:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2487 00002000:00010000:0.0:1762166979.406874:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc6225500. 00002000:00010000:3.0:1762166979.406876:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (204311->18446744073709551615) 00002000:00100000:1.0:1762166979.406876:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc6226680 with x1847765450581632 ext(0->18446744073709551615) 00002000:00100000:3.0:1762166979.406881:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc6224a80 with x1847765450581504 ext(204311->18446744073709551615) 00002000:00010000:1.0:1762166979.406883:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc6226680. 00002000:00010000:3.0:1762166979.406886:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc6224a80. 00000100:00100000:1.0:1762166979.410441:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166979.410512:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450581888 00000100:00100000:3.0:1762166979.410524:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450581888 00002000:00100000:3.0:1762166979.410573:0:23939:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xa77:0x0] (172032->204799) req@ffff945bc5807b80 x1847765450581888/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:10/0 lens 488/0 e 0 to 0 dl 1762166990 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166979.410585:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5807b80 with x1847765450581888 ext(172032->204799) 00002000:00010000:3.0:1762166979.410591:0:23939:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5807b80 00010000:00010000:0.0:1762166979.410627:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166979.410628:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2490 00000100:00100000:3.0:1762166979.410642:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5807b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+31:2416:x1847765450581888:12345-192.168.204.38@tcp:3:lfs.0 00000100:00100000:3.0:1762166979.412319:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5807b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+31:2416:x1847765450581888:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 1676us (1886us total) trans 0 rc 32768/32768 00000100:00100000:3.0:1762166979.412327:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2490 00002000:00100000:3.0:1762166979.412333:0:23939:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xa77:0x0] (172032->204799) req@ffff945bc5807b80 x1847765450581888/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:10/0 lens 488/440 e 0 to 0 dl 1762166990 ref 1 fl Complete:/600/0 rc 32768/32768 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166979.412345:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5807b80 with x1847765450581888 ext(172032->204799) 00002000:00010000:3.0:1762166979.412349:0:23939:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5807b80 00000100:00100000:2.0:1762166979.414646:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166979.414735:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450582016 00000100:00100000:3.0:1762166979.414747:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450582016 00002000:00100000:3.0:1762166979.414798:0:23939:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xa77:0x0] (200704->204310) req@ffff945bc558a680 x1847765450582016/t0(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:10/0 lens 4096/0 e 0 to 0 dl 1762166990 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166979.414807:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc558a680 with x1847765450582016 ext(200704->204310) 00002000:00010000:3.0:1762166979.414811:0:23939:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc558a680 00000100:00100000:1.0:1762166979.414879:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2491 00000100:00100000:1.0:1762166979.414894:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+31:2419:x1847765450582016:12345-192.168.204.38@tcp:4:lfs.0 00000100:00100000:1.0:1762166979.416197:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+33:2419:x1847765450582016:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 1302us (1566us total) trans 17179876534 rc 0/0 00000100:00100000:1.0:1762166979.416208:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2491 00002000:00100000:1.0:1762166979.416217:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (200704->204310) req@ffff945bc558a680 x1847765450582016/t17179876534(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:10/0 lens 4096/448 e 0 to 0 dl 1762166990 ref 1 fl Complete:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166979.416227:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc558a680 with x1847765450582016 ext(200704->204310) 00002000:00010000:1.0:1762166979.416231:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc558a680 00000100:00100000:1.0:1762166979.418135:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.418198:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450582144 00000100:00100000:2.0:1762166979.418208:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450582144 00000100:00100000:2.0:1762166979.418265:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19165 00000100:00100000:2.0:1762166979.418276:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5807100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+33:2417:x1847765450582144:12345-192.168.204.38@tcp:16:fsx.0 00000001:00080000:1.0:1762166979.419621:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876534 is committed 00000001:00080000:1.0:1762166979.419647:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876522 is committed 00000100:00100000:2.0:1762166979.419986:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5807100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+17:2417:x1847765450582144:12345-192.168.204.38@tcp:16:fsx.0 Request processed in 1709us (1858us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166979.419994:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19165 00000100:00100000:2.0:1762166979.421658:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166979.421770:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450582272 00000100:00100000:1.0:1762166979.421782:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450582272 00000100:00100000:1.0:1762166979.421855:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30640 00000100:00100000:1.0:1762166979.421863:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5589500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+557:61766:x1847765450582272:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:1.0:1762166979.421891:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166979.421911:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbabc18 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea2c4 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.422027:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbabc1f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166979.422044:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbabc1f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.422057:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbabc1f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:1.0:1762166979.422088:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 204311 00000004:00200000:1.0:1762166979.422092:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166979.422110:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbabc1f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.422136:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbabc18 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea2c4 expref: 559 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.422151:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbabc1f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea2c4 expref: 558 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.422161:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:1.0:1762166979.422164:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166979.422168:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355ba00, rc 0) 00000100:00100000:1.0:1762166979.422231:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5589500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+558:61766:x1847765450582272:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 367us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166979.422246:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30640 00000100:00100000:3.0:1762166979.424398:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.424460:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450582528 00000100:00100000:0.0:1762166979.424468:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450582528 00000100:00100000:0.0:1762166979.424533:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11913 00000100:00100000:0.0:1762166979.424545:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+558:61766:x1847765450582528:12345-192.168.204.38@tcp:35:fsx.0 00000100:00100000:0.0:1762166979.424862:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+559:61766:x1847765450582528:12345-192.168.204.38@tcp:35:fsx.0 Request processed in 319us (469us total) trans 4294992276 rc 0/0 00000100:00100000:0.0:1762166979.424870:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11913 00000100:00100000:2.0:1762166979.433609:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166979.433679:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450582784 00000100:00100000:1.0:1762166979.433691:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450582784 00000100:00100000:1.0:1762166979.433770:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30641 00000100:00100000:1.0:1762166979.433782:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+559:61864:x1847765450582784:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166979.433819:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166979.433860:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbabc26 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea2cb expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.433956:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbabc2d lrc: 3/1,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166979.433973:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbabc2d lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.433986:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbabc2d lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.433999:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a000/0x2f180c4effbabc34 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166979.434006:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a000/0x2f180c4effbabc34 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.434012:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a000/0x2f180c4effbabc34 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.434151:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbabc3b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166979.434162:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbabc3b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.434168:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbabc3b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:1.0:1762166979.434177:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 204311 00010000:00010000:1.0:1762166979.434265:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbabc2d lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.434271:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbabc2d lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.434275:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbabc2d lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.434279:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbabc2d lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.434283:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355b600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166979.434286:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbabc2d lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.434291:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbabc2d lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.434300:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0x0 (ffff945bc812ec00) 00010000:00010000:1.0:1762166979.434303:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166979.434306:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbabc2d lrc: 3/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.434310:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbabc2d lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.434320:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a000/0x2f180c4effbabc34 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.434327:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a000/0x2f180c4effbabc34 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.434331:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a000/0x2f180c4effbabc34 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.434333:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355a000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166979.434335:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a000/0x2f180c4effbabc34 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.434338:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a000/0x2f180c4effbabc34 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.434341:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0xdd396665 (ffff945bc812eb00) 00010000:00010000:1.0:1762166979.434342:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166979.434344:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a000/0x2f180c4effbabc34 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.434346:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a000/0x2f180c4effbabc34 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.434384:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbabc26 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea2cb expref: 562 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.434394:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbabc3b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea2cb expref: 561 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.434399:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:1.0:1762166979.434400:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166979.434402:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355ae00, rc 0) 00000100:00100000:1.0:1762166979.434462:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+561:61864:x1847765450582784:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 684us (866us total) trans 4294992277 rc 0/0 00000100:00100000:1.0:1762166979.434468:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30641 00000100:00100000:2.0:1762166979.435682:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166979.435737:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450582912 00000100:00100000:1.0:1762166979.435745:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450582912 00000100:00100000:1.0:1762166979.435798:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 885 00000100:00100000:1.0:1762166979.435808:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+561:2418:x1847765450582912:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166979.435825:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166979.435859:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbabc3b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea2cb expref: 561 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.435876:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:1.0:1762166979.435880:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166979.435940:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+560:2418:x1847765450582912:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 133us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166979.435948:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 885 00000100:00100000:2.0:1762166979.436007:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166979.436050:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450583168 00000100:00100000:1.0:1762166979.436056:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450583168 00000100:00100000:1.0:1762166979.436099:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30642 00000100:00100000:1.0:1762166979.436108:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+560:61864:x1847765450583168:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166979.436128:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166979.436144:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbabc49 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea2d2 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.436673:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbabc50 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x615:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166979.436686:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbabc50 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x615:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.436700:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbabc50 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x615:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:1.0:1762166979.436710:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x615:0x0]: returning size 0 00010000:00010000:1.0:1762166979.436749:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbabc49 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea2d2 expref: 563 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.436767:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbabc50 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x615:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea2d2 expref: 562 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.436773:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x615:0x0].0x0 (ffff945bc812e400) 00010000:00010000:1.0:1762166979.436775:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166979.436777:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355aa00, rc 0) 00000100:00100000:1.0:1762166979.436806:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+562:61864:x1847765450583168:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 702us (803us total) trans 4294992278 rc 0/0 00000100:00100000:1.0:1762166979.436811:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30642 00000100:00100000:3.0:1762166979.438106:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166979.438154:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450583424 00000100:00100000:1.0:1762166979.438161:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450583424 00000100:00100000:1.0:1762166979.438204:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30643 00000100:00100000:1.0:1762166979.438212:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+562:61864:x1847765450583424:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166979.438233:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166979.438245:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a400/0x2f180c4effbabc5e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x615:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea2d9 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.438313:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbabc65 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x615:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166979.438325:0:6495:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbabc50 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x615:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea2d2 expref: 563 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.438334:0:6495:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbabc65 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x615:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.438377:0:6495:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbabc50 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x615:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea2d2 expref: 563 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.438393:0:6495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbabc50 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x615:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea2d2 expref: 563 pid: 6495 timeout: 698 lvb_type: 0 00000100:00100000:1.0:1762166979.438409:0:6495:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bc0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6495:1847765449750272:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166979.438522:0:6495:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc4076780 going to sleep for 11 seconds 00000100:00100000:1.0:1762166979.439648:0:6495:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bc0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6495:1847765449750272:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166979.439679:0:6495:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbabc65 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x615:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000100:00100000:3.0:1762166979.439873:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166979.439990:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450583552 00000100:00100000:1.0:1762166979.440000:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450583552 00010000:00010000:1.0:1762166979.440039:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbabc50 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x615:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea2d2 expref: 564 pid: 6495 timeout: 698 lvb_type: 0 00000100:00100000:1.0:1762166979.440090:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9686 00000100:00100000:1.0:1762166979.440101:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+564:2418:x1847765450583552:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166979.440118:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166979.440124:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbabc50 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x615:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea2d2 expref: 564 pid: 6495 timeout: 698 lvb_type: 0 00010000:00010000:1.0:1762166979.440134:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbabc50 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x615:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea2d2 expref: 564 pid: 6495 timeout: 698 lvb_type: 0 00010000:00010000:1.0:1762166979.440152:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbabc50 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x615:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea2d2 expref: 564 pid: 6495 timeout: 698 lvb_type: 0 00010000:00010000:1.0:1762166979.440164:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x615:0x0].0x0 (ffff945bc812e400) 00010000:00010000:1.0:1762166979.440166:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbabc65 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x615:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.440173:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbabc65 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x615:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.440177:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbabc65 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x615:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.440204:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166979.440255:0:6495:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbabc65 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x615:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.440267:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbabc65 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x615:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000100:00100000:1.0:1762166979.440278:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+563:2418:x1847765450583552:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 171us (405us total) trans 0 rc 0/0 00000004:00200000:2.0:1762166979.440283:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x615:0x0]: returning size 0 00000100:00100000:1.0:1762166979.440291:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9686 00000004:00080000:2.0:1762166979.440509:0:6495:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xa8e:0x0], index 0: 0 00000004:00080000:2.0:1762166979.440520:0:6495:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xa8d:0x0], index 1: 0 00010000:00010000:2.0:1762166979.440631:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbabc65 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x615:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.440638:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbabc65 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x615:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.440645:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbabc65 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x615:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.440651:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355b200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166979.440657:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbabc65 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x615:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.440664:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbabc65 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x615:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.440677:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x615:0x0].0x0 (ffff945bc812e400) 00010000:00010000:2.0:1762166979.440680:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166979.440685:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbabc65 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x615:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.440691:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbabc65 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x615:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.440741:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a400/0x2f180c4effbabc5e lrc: 1/0,0 mode: --/CR res: [0x240000404:0x615:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea2d9 expref: 563 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.440751:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x615:0x0].0x0 (ffff945bc812e400) 00010000:00010000:2.0:1762166979.440754:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1762166979.440759:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a400/0x2f180c4effbabc5e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x615:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea2d9 expref: 563 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.440776:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355a400, rc 0) 00000100:00100000:2.0:1762166979.440826:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+562:61864:x1847765450583424:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2614us (2724us total) trans 4294992279 rc 301/301 00000100:00100000:2.0:1762166979.440835:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30643 00000100:00100000:3.0:1762166979.441706:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.441753:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450583808 00000100:00100000:0.0:1762166979.441760:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450583808 00000100:00100000:0.0:1762166979.441804:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11914 00000100:00100000:0.0:1762166979.441813:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7be3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+562:61864:x1847765450583808:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166979.442010:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7be3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+563:61864:x1847765450583808:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 198us (304us total) trans 4294992280 rc 0/0 00000100:00100000:0.0:1762166979.442018:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11914 00000100:00100000:0.0:1762166979.443184:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.443226:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450583936 00000100:00100000:2.0:1762166979.443232:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450583936 00000100:00100000:2.0:1762166979.443267:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30644 00000100:00100000:2.0:1762166979.443274:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+563:61864:x1847765450583936:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166979.443289:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166979.443307:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbabc73 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x615:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea2e0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.443360:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbabc7a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x615:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166979.443372:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbabc7a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x615:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.443387:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbabc7a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x615:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:2.0:1762166979.443419:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x615:0x0]: returning size 0 00000004:00200000:2.0:1762166979.443423:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166979.443438:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbabc7a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x615:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.443460:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbabc73 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x615:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea2e0 expref: 565 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.443506:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbabc7a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x615:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea2e0 expref: 564 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.443516:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x615:0x0].0x0 (ffff945bc809b600) 00010000:00010000:2.0:1762166979.443520:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1762166979.443523:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa9800, rc 0) 00000100:00100000:2.0:1762166979.443564:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+564:61864:x1847765450583936:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 290us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166979.443571:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30644 00000100:00100000:3.0:1762166979.444573:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166979.444632:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.444657:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450584064 00000100:00100000:2.0:1762166979.444664:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450584064 00000100:00100000:1.0:1762166979.444676:0:35248:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450584192 00000100:00100000:1.0:1762166979.444681:0:35248:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450584192 00000100:00100000:2.0:1762166979.444708:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19166 00000100:00100000:2.0:1762166979.444721:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450584064:12345-192.168.204.38@tcp:101:lfs.0 00000100:00100000:1.0:1762166979.444728:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19167 00010000:00010000:2.0:1762166979.444736:0:28874:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166979.444754:0:28874:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9400/0x2f180c4effbabc81 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea2e7 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166979.444778:0:28874:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa8e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1762166979.444790:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450584192:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166979.444801:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166979.444805:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166979.444816:0:28874:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9400/0x2f180c4effbabc81 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea2e7 expref: 23 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166979.444817:0:35248:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166979.444835:0:28874:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9400/0x2f180c4effbabc81 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea2e7 expref: 23 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166979.444854:0:35248:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cc355a600/0x2f180c4effbabc88 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa8d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea2ee expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.444861:0:28874:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa9400, rc 0) 00002000:00010000:1.0:1762166979.444888:0:35248:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa8d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:2.0:1762166979.444910:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765450584064:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 190us (337us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166979.444911:0:35248:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166979.444916:0:35248:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1762166979.444926:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19166 00010000:00010000:1.0:1762166979.444931:0:35248:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355a600/0x2f180c4effbabc88 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea2ee expref: 18 pid: 35248 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166979.444952:0:35248:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945cc355a600/0x2f180c4effbabc88 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea2ee expref: 18 pid: 35248 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166979.444965:0:35248:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355a600, rc 0) 00000100:00100000:1.0:1762166979.445025:0:35248:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450584192:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 289us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166979.445033:0:35248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19167 00000100:00100000:3.0:1762166979.446304:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.446380:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450584448 00000100:00100000:2.0:1762166979.446388:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450584448 00000100:00100000:2.0:1762166979.446442:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30645 00000100:00100000:2.0:1762166979.446452:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+564:61864:x1847765450584448:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166979.446466:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166979.446506:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbabc8f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea2f5 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.446605:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbabc96 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166979.446618:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbabc96 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.446628:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbabc96 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:2.0:1762166979.446639:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 204311 00010000:00010000:2.0:1762166979.446741:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbabc8f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea2f5 expref: 567 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.446759:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbabc96 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea2f5 expref: 566 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.446766:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166979.446769:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166979.446772:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa8c00, rc 0) 00000100:00100000:2.0:1762166979.446811:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+566:61864:x1847765450584448:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 361us (510us total) trans 4294992281 rc 0/0 00000100:00100000:2.0:1762166979.446818:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30645 00000100:00100000:3.0:1762166979.448275:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166979.448302:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166979.448329:0:35248:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450584576 00000100:00100000:1.0:1762166979.448339:0:35248:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450584576 00000100:00100000:3.0:1762166979.448344:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.448379:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450584704 00000100:00100000:2.0:1762166979.448391:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450584704 00000100:00100000:1.0:1762166979.448393:0:35248:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450584832 00000100:00100000:3.0:1762166979.448400:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19168 00000100:00100000:1.0:1762166979.448401:0:35248:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450584832 00000100:00100000:3.0:1762166979.448446:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450584576:12345-192.168.204.38@tcp:1:lfs.0 00000100:00100000:0.0:1762166979.448454:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19169 00000100:00100000:1.0:1762166979.448466:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19170 00000100:00100000:0.0:1762166979.448474:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450584832:12345-192.168.204.38@tcp:1:lfs.0 00000100:00100000:1.0:1762166979.448517:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765450584704:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:3.0:1762166979.448530:0:8380:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effbabca4 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.448530:0:35247:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbabcab lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.448548:0:35248:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945cc355ae00/0x2f180c4effbabcb2 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.448567:0:35247:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde200/0x2f180c4effbab9be lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1d6 expref: 19 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166979.448568:0:8380:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945cc355be00/0x2f180c4effbabaac lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->20479) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea246 expref: 19 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.448568:0:35248:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf400/0x2f180c4effbab9b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1cf expref: 23 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.448580:0:35247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166979.448583:0:35247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166979.448587:0:35247:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbabcab lrc: 4/1,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.448608:0:35248:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166979.448609:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166979.448612:0:35248:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166979.448613:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166979.448618:0:35248:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cc355ae00/0x2f180c4effbabcb2 lrc: 4/1,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166979.448619:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effbabca4 lrc: 4/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.448640:0:35247:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde200/0x2f180c4effbab9be lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1d6 expref: 19 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.448656:0:35247:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde200/0x2f180c4effbab9be lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1d6 expref: 19 pid: 28874 timeout: 698 lvb_type: 0 00010000:00010000:3.0:1762166979.448662:0:8380:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945cc355be00/0x2f180c4effbabaac lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->20479) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea246 expref: 19 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.448663:0:35248:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf400/0x2f180c4effbab9b7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1cf expref: 23 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166979.448681:0:35247:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:35247:1847765449750400:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166979.448688:0:8380:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945cc355be00/0x2f180c4effbabaac lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->20479) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea246 expref: 19 pid: 35248 timeout: 698 lvb_type: 0 00010000:00010000:1.0:1762166979.448691:0:35248:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf400/0x2f180c4effbab9b7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1cf expref: 23 pid: 28874 timeout: 698 lvb_type: 0 00000100:00100000:3.0:1762166979.448713:0:8380:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bccb7dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8380:1847765449750656:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166979.448717:0:35248:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bc0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:35248:1847765449750528:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166979.448779:0:8380:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf3a33e40 going to sleep for 11 seconds 00000100:00100000:1.0:1762166979.448779:0:35248:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc4076780 going to sleep for 11 seconds 00000100:00100000:0.0:1762166979.448779:0:35247:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1c8d240 going to sleep for 11 seconds 00000100:00100000:1.0:1762166979.449855:0:35247:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:35247:1847765449750400:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166979.449876:0:35247:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbabcab lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166979.449999:0:35248:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bc0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:35248:1847765449750528:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166979.450007:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166979.450022:0:8380:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bccb7dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8380:1847765449750656:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166979.450038:0:35248:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945cc355ae00/0x2f180c4effbabcb2 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166979.450059:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.450090:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450584960 00000100:00100000:0.0:1762166979.450095:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450584960 00010000:00010000:3.0:1762166979.450128:0:8380:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effbabca4 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.450132:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde200/0x2f180c4effbab9be lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1d6 expref: 20 pid: 28874 timeout: 698 lvb_type: 0 00000100:00100000:2.0:1762166979.450158:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.450193:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450585088 00000100:00100000:0.0:1762166979.450198:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450585088 00010000:00010000:0.0:1762166979.450216:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355be00/0x2f180c4effbabaac lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->20479) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea246 expref: 21 pid: 35248 timeout: 698 lvb_type: 0 00000100:00100000:1.0:1762166979.450226:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450585216 00000100:00100000:1.0:1762166979.450236:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450585216 00000100:00100000:3.0:1762166979.450253:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9687 00000100:00100000:0.0:1762166979.450264:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9688 00010000:00010000:1.0:1762166979.450268:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf400/0x2f180c4effbab9b7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1cf expref: 24 pid: 28874 timeout: 698 lvb_type: 0 00000100:00100000:3.0:1762166979.450271:0:6480:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7c32c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450584960:12345-192.168.204.38@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1762166979.450287:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450585088:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166979.450309:0:6480:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166979.450321:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166979.450337:0:6480:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde200/0x2f180c4effbab9be lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1d6 expref: 21 pid: 28874 timeout: 698 lvb_type: 0 00000100:00100000:1.0:1762166979.450338:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9689 00002000:00010000:0.0:1762166979.450340:0:9458:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 104 -> 120 00010000:00010000:0.0:1762166979.450366:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945cc355be00/0x2f180c4effbabaac lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 16384->20479) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea246 expref: 21 pid: 35248 timeout: 698 lvb_type: 0 00010000:00010000:3.0:1762166979.450369:0:6480:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde200/0x2f180c4effbab9be lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1d6 expref: 21 pid: 28874 timeout: 698 lvb_type: 0 00000100:00100000:1.0:1762166979.450382:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+24:2418:x1847765450585216:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166979.450390:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945cc355be00/0x2f180c4effbabaac lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 16384->20479) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea246 expref: 21 pid: 35248 timeout: 698 lvb_type: 0 00010000:00010000:1.0:1762166979.450405:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166979.450414:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde200/0x2f180c4effbab9be lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1d6 expref: 21 pid: 28874 timeout: 698 lvb_type: 0 00010000:00010000:0.0:1762166979.450425:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cc355be00/0x2f180c4effbabaac lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 16384->20479) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea246 expref: 21 pid: 35248 timeout: 698 lvb_type: 0 00010000:00010000:1.0:1762166979.450427:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf400/0x2f180c4effbab9b7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1cf expref: 24 pid: 28874 timeout: 698 lvb_type: 0 00010000:00010000:3.0:1762166979.450436:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166979.450443:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166979.450452:0:6480:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbabcab lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.450461:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166979.450467:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166979.450521:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effbabca4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166979.450533:0:6480:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbabcab lrc: 4/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.450548:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf400/0x2f180c4effbab9b7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1cf expref: 24 pid: 28874 timeout: 698 lvb_type: 0 00010000:00010000:0.0:1762166979.450566:0:9458:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effbabca4 lrc: 4/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.450604:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf400/0x2f180c4effbab9b7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1cf expref: 24 pid: 28874 timeout: 698 lvb_type: 0 00010000:00010000:3.0:1762166979.450610:0:6480:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166979.450610:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166979.450621:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166979.450625:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166979.450629:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945cc355ae00/0x2f180c4effbabcb2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.450638:0:7421:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cc355ae00/0x2f180c4effbabcb2 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166979.450658:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450585088:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 380us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166979.450669:0:6480:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7c32c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450584960:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 402us (671us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166979.450671:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166979.450673:0:35247:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbabcab lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166979.450674:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9688 00010000:00010000:2.0:1762166979.450700:0:35247:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbabcab lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166979.450701:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9687 00000100:00100000:1.0:1762166979.450711:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765450585216:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 339us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166979.450720:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9689 00010000:00010000:2.0:1762166979.450724:0:35247:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbabcab lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.450732:0:35247:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbabcab lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.450740:0:35247:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbabcab lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.450752:0:35247:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdec00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166979.450759:0:35247:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbabcab lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.450761:0:35248:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945cc355ae00/0x2f180c4effbabcb2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.450778:0:35247:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbabcab lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.450779:0:35248:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cc355ae00/0x2f180c4effbabcb2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166979.450801:0:8380:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effbabca4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.450808:0:35247:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbabcab lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166979.450813:0:8380:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effbabca4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.450822:0:35248:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945cc355ae00/0x2f180c4effbabcb2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.450823:0:35247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbabcab lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.450867:0:35248:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945cc355ae00/0x2f180c4effbabcb2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166979.450871:0:8380:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effbabca4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.450875:0:35248:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945cc355ae00/0x2f180c4effbabcb2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166979.450879:0:8380:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effbabca4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.450891:0:35248:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355ae00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166979.450893:0:8380:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effbabca4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.450896:0:35248:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945cc355ae00/0x2f180c4effbabcb2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166979.450899:0:8380:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8473c00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166979.450904:0:8380:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effbabca4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.450911:0:35248:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945cc355ae00/0x2f180c4effbabcb2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166979.450913:0:8380:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effbabca4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166979.450921:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450584832:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 2453us (2572us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166979.450929:0:35248:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945cc355ae00/0x2f180c4effbabcb2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166979.450934:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19169 00010000:00010000:1.0:1762166979.450942:0:35248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cc355ae00/0x2f180c4effbabcb2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166979.450980:0:8380:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effbabca4 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166979.450989:0:35248:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765450584704:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 2510us (2682us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166979.450991:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8473c00/0x2f180c4effbabca4 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166979.451006:0:35248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19170 00000100:00100000:3.0:1762166979.451035:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+16:2418:x1847765450584576:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 2593us (2766us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166979.451042:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19168 00000100:00100000:2.0:1762166979.452333:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166979.452464:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450585344 00000100:00100000:0.0:1762166979.452469:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166979.452507:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450585344 00000100:00100000:1.0:1762166979.452548:0:35248:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450585472 00000100:00100000:3.0:1762166979.452555:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19171 00000100:00100000:1.0:1762166979.452555:0:35248:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450585472 00000100:00100000:0.0:1762166979.452556:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.452569:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450585600 00000100:00100000:3.0:1762166979.452571:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3d5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+16:2416:x1847765450585344:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166979.452587:0:8380:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1762166979.452593:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450585600 00000100:00100000:1.0:1762166979.452594:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19172 00010000:00010000:3.0:1762166979.452605:0:8380:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8473a00/0x2f180c4effbabcb9 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea2fc expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166979.452606:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+22:2417:x1847765450585472:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166979.452621:0:35248:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:3.0:1762166979.452629:0:8380:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa77:0x0] initial LVB size: 204311, mtime: 0x690888c3, atime: 0x690888c2, ctime: 0x690888c3, blocks: 0x78 00000100:00100000:2.0:1762166979.452635:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19173 00010000:00010000:1.0:1762166979.452636:0:35248:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cc355aa00/0x2f180c4effbabcc0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea303 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762166979.452652:0:35248:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa7a:0x0] initial LVB size: 0, mtime: 0x690888c3, atime: 0x690888c2, ctime: 0x690888c3, blocks: 0x1800 00000100:00100000:2.0:1762166979.452659:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+17:2417:x1847765450585600:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166979.452668:0:35248:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166979.452669:0:35247:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166979.452673:0:35248:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166979.452683:0:35247:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbabcc7 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea30a expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.452684:0:35248:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cc355aa00/0x2f180c4effbabcc0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea303 expref: 23 pid: 35248 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166979.452686:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166979.452690:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166979.452699:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8473a00/0x2f180c4effbabcb9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea2fc expref: 18 pid: 8380 timeout: 0 lvb_type: 1 00002000:00010000:2.0:1762166979.452717:0:35247:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa79:0x0] initial LVB size: 0, mtime: 0x690888c3, atime: 0x690888c2, ctime: 0x690888c3, blocks: 0x0 00010000:00010000:3.0:1762166979.452719:0:8380:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc8473a00/0x2f180c4effbabcb9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea2fc expref: 18 pid: 8380 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166979.452721:0:35248:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945cc355aa00/0x2f180c4effbabcc0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea303 expref: 23 pid: 35248 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166979.452729:0:35247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166979.452733:0:35247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166979.452741:0:35247:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbabcc7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea30a expref: 19 pid: 35247 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166979.452743:0:8380:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8473a00, rc 0) 00010000:00010000:1.0:1762166979.452746:0:35248:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355aa00, rc 0) 00010000:00010000:2.0:1762166979.452760:0:35247:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbabcc7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea30a expref: 19 pid: 35247 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166979.452771:0:35247:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa8800, rc 0) 00000100:00100000:3.0:1762166979.452788:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3d5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+19:2416:x1847765450585344:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 221us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166979.452790:0:35248:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+23:2417:x1847765450585472:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 184us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166979.452799:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+19:2417:x1847765450585600:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 144us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166979.452815:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19171 00000100:00100000:1.0:1762166979.452823:0:35248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19172 00000100:00100000:2.0:1762166979.452831:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19173 00000100:00100000:2.0:1762166979.477926:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166979.477991:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450585728 00000100:00100000:3.0:1762166979.478004:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450585728 00000100:00100000:3.0:1762166979.478070:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19174 00000100:00100000:3.0:1762166979.478084:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+18:2416:x1847765450585728:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:3.0:1762166979.478214:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+18:2416:x1847765450585728:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 133us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166979.478222:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19174 00000100:00100000:0.0:1762166979.479784:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.479836:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450585856 00000100:00100000:2.0:1762166979.479856:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450585856 00000100:00100000:2.0:1762166979.479901:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30646 00000100:00100000:2.0:1762166979.479910:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+566:61864:x1847765450585856:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166979.479941:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166979.479964:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbabcce lrc: 2/0,0 mode: --/PR res: [0x240000404:0x615:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea311 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.479999:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbabcd5 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x615:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166979.480015:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbabcd5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x615:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.480027:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbabcd5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x615:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.480141:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbabcce lrc: 0/0,0 mode: --/PR res: [0x240000404:0x615:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea311 expref: 568 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.480162:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbabcd5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x615:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea311 expref: 567 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.480169:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x615:0x0].0x0 (ffff945bc809b600) 00010000:00010000:2.0:1762166979.480172:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1762166979.480175:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa8e00, rc 0) 00000100:00100000:2.0:1762166979.480217:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+567:61864:x1847765450585856:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 309us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166979.480224:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30646 00000100:00100000:0.0:1762166979.481433:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.481544:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450586112 00000100:00100000:2.0:1762166979.481551:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450586112 00000100:00100000:2.0:1762166979.481596:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30647 00000100:00100000:2.0:1762166979.481606:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+567:61864:x1847765450586112:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:2.0:1762166979.481641:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166979.481657:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbabc7a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x615:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea2e0 expref: 567 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.481670:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x615:0x0].0x0 (ffff945bc809b600) 00010000:00010000:2.0:1762166979.481674:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166979.481836:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4a14000/0x2f180c4effbabcdc lrc: 3/0,1 mode: --/PW res: [0x240000404:0x615:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166979.481878:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4a14000/0x2f180c4effbabcdc lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x615:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.481886:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4a14000/0x2f180c4effbabcdc lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x615:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000001:00080000:2.0:1762166979.481934:0:6495:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992282 00000004:00010000:2.0:1762166979.481958:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000cf335bbd reply state 0000000076af3805 transno 4294992283 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4a14000/0x2f180c4effbabcdc lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x615:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.481968:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4a14000/0x2f180c4effbabcdc lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x615:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.481972:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x615:0x0].0x0 (ffff945bc809b600) 00010000:00010000:2.0:1762166979.481974:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166979.481976:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166979.482038:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+569:61864:x1847765450586112:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 434us (615us total) trans 4294992283 rc 0/0 00000100:00100000:2.0:1762166979.482045:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30647 00000020:00080000:2.0:1762166979.482050:0:6495:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1762166979.483255:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.483301:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450586240 00000100:00100000:2.0:1762166979.483311:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450586240 00000100:00100000:2.0:1762166979.483360:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30648 00000100:00100000:2.0:1762166979.483368:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+569:61864:x1847765450586240:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166979.483385:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166979.483396:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14000/0x2f180c4effbabce3 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x615:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea318 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.483430:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14000/0x2f180c4effbabce3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x615:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea318 expref: 570 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.483441:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14000/0x2f180c4effbabce3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x615:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea318 expref: 570 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.483456:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x615:0x0].0x0 (ffff945bc809b600) 00010000:00010000:2.0:1762166979.483459:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166979.483462:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945d00f14000, rc 0) 00000100:00100000:2.0:1762166979.483516:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+570:61864:x1847765450586240:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 148us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166979.483524:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30648 00000100:00100000:0.0:1762166979.484698:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166979.484756:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450586368 00000100:00100000:3.0:1762166979.484768:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450586368 00000100:00100000:3.0:1762166979.484834:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19175 00000100:00100000:3.0:1762166979.484860:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+23:61864:x1847765450586368:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166979.484881:0:8380:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166979.484901:0:8380:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc8473c00/0x2f180c4effbabcea lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea31f expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166979.484934:0:8380:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9400/0x2f180c4effbabc81 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea2e7 expref: 24 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166979.484944:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166979.484947:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166979.484953:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8473c00/0x2f180c4effbabcea lrc: 4/0,0 mode: --/PW res: [0x280000400:0xa8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea31f expref: 24 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166979.485000:0:8380:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9400/0x2f180c4effbabc81 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea2e7 expref: 24 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166979.485016:0:8380:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9400/0x2f180c4effbabc81 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea2e7 expref: 24 pid: 28874 timeout: 698 lvb_type: 1 00000100:00100000:3.0:1762166979.485032:0:8380:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bccb7ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8380:1847765449750784:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166979.485162:0:8380:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf3a33780 going to sleep for 11 seconds 00000100:00100000:3.0:1762166979.486433:0:8380:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bccb7ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8380:1847765449750784:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166979.486470:0:8380:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc8473c00/0x2f180c4effbabcea lrc: 3/0,0 mode: --/PW res: [0x280000400:0xa8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea31f expref: 24 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166979.486581:0:8380:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8473c00, rc 0) 00000100:00100000:0.0:1762166979.486614:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166979.486694:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450586496 00000100:00100000:1.0:1762166979.486702:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450586496 00000100:00100000:3.0:1762166979.486713:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+25:61864:x1847765450586368:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1778us (1936us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166979.486732:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19175 00010000:00010000:1.0:1762166979.486746:0:6480:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9400/0x2f180c4effbabc81 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea2e7 expref: 25 pid: 28874 timeout: 698 lvb_type: 1 00000100:00100000:1.0:1762166979.486790:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9690 00000100:00100000:1.0:1762166979.486806:0:6480:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d20e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+24:2418:x1847765450586496:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166979.486822:0:6480:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166979.486828:0:6480:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9400/0x2f180c4effbabc81 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea2e7 expref: 24 pid: 28874 timeout: 698 lvb_type: 1 00010000:00010000:1.0:1762166979.486855:0:6480:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9400/0x2f180c4effbabc81 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea2e7 expref: 24 pid: 28874 timeout: 698 lvb_type: 1 00010000:00010000:1.0:1762166979.486881:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9400/0x2f180c4effbabc81 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea2e7 expref: 24 pid: 28874 timeout: 698 lvb_type: 1 00010000:00010000:1.0:1762166979.486897:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166979.486900:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166979.486906:0:6480:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc8473c00/0x2f180c4effbabcea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea31f expref: 23 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.486916:0:6480:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8473c00/0x2f180c4effbabcea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea31f expref: 23 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.486954:0:6480:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff945bc8473c00/0x2f180c4effbabcea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea31f expref: 23 pid: 8380 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166979.486966:0:6480:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bc0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6480:1847765449750912:192.168.204.38@tcp:105: 00000100:00100000:1.0:1762166979.487023:0:6480:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc4076780 going to sleep for 11 seconds 00000100:00100000:0.0:1762166979.488255:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166979.488335:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450586624 00000100:00100000:3.0:1762166979.488344:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450586624 00000100:00100000:1.0:1762166979.488368:0:6480:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bc0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6480:1847765449750912:192.168.204.38@tcp:105: 00010000:00010000:1.0:1762166979.488391:0:6480:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166979.488398:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19176 00000100:00100000:3.0:1762166979.488409:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+18:61864:x1847765450586624:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166979.488425:0:8380:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166979.488444:0:8380:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8472600/0x2f180c4effbabcf1 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea326 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166979.488455:0:6480:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d20e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765450586496:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1651us (1842us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166979.488518:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9690 00010000:00010000:3.0:1762166979.488525:0:8380:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945cc355a600/0x2f180c4effbabc88 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea2ee expref: 19 pid: 35248 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166979.488538:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166979.488541:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166979.488546:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472600/0x2f180c4effbabcf1 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xa8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea326 expref: 19 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166979.488584:0:8380:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945cc355a600/0x2f180c4effbabc88 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea2ee expref: 19 pid: 35248 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166979.488599:0:8380:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945cc355a600/0x2f180c4effbabc88 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea2ee expref: 19 pid: 35248 timeout: 698 lvb_type: 1 00000100:00100000:3.0:1762166979.488629:0:8380:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bccb7ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8380:1847765449751040:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166979.488707:0:8380:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf3a33780 going to sleep for 11 seconds 00000100:00100000:3.0:1762166979.489627:0:8380:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bccb7ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8380:1847765449751040:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166979.489643:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:3.0:1762166979.489652:0:8380:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc8472600/0x2f180c4effbabcf1 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xa8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea326 expref: 19 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166979.489668:0:8380:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8472600, rc 0) 00000100:00100000:1.0:1762166979.489684:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450586752 00000100:00100000:1.0:1762166979.489694:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450586752 00010000:00010000:1.0:1762166979.489728:0:6480:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355a600/0x2f180c4effbabc88 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea2ee expref: 20 pid: 35248 timeout: 698 lvb_type: 1 00000100:00100000:3.0:1762166979.489760:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+20:61864:x1847765450586624:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1349us (1506us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166979.489774:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19176 00000100:00100000:1.0:1762166979.489784:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9691 00000100:00100000:1.0:1762166979.489800:0:6480:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d23800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450586752:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166979.489817:0:6480:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166979.489824:0:6480:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945cc355a600/0x2f180c4effbabc88 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea2ee expref: 19 pid: 35248 timeout: 698 lvb_type: 1 00010000:00010000:1.0:1762166979.489852:0:6480:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945cc355a600/0x2f180c4effbabc88 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea2ee expref: 19 pid: 35248 timeout: 698 lvb_type: 1 00010000:00010000:1.0:1762166979.489880:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cc355a600/0x2f180c4effbabc88 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea2ee expref: 19 pid: 35248 timeout: 698 lvb_type: 1 00010000:00010000:1.0:1762166979.489894:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166979.489896:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166979.489901:0:6480:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc8472600/0x2f180c4effbabcf1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea326 expref: 18 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.489911:0:6480:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472600/0x2f180c4effbabcf1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea326 expref: 18 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.489946:0:6480:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff945bc8472600/0x2f180c4effbabcf1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea326 expref: 18 pid: 8380 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166979.489966:0:6480:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bc0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6480:1847765449751168:192.168.204.38@tcp:105: 00000100:00100000:1.0:1762166979.490034:0:6480:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc4076780 going to sleep for 11 seconds 00000100:00100000:1.0:1762166979.490944:0:6480:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bc0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6480:1847765449751168:192.168.204.38@tcp:105: 00010000:00010000:1.0:1762166979.490962:0:6480:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166979.490998:0:6480:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d23800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450586752:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1203us (1357us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166979.491008:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9691 00000100:00100000:3.0:1762166979.491241:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166979.491279:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166979.491320:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450586880 00000100:00100000:1.0:1762166979.491331:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450586880 00000100:00100000:2.0:1762166979.491349:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450587008 00000100:00100000:2.0:1762166979.491358:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450587008 00002000:00010000:1.0:1762166979.491374:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2702 (0->18446744073709551615) 00002000:00100000:1.0:1762166979.491381:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bccb7ca80 with x1847765450586880 ext(0->18446744073709551615) 00002000:00010000:1.0:1762166979.491393:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bccb7ca80. 00002000:00010000:2.0:1762166979.491396:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2701 (0->18446744073709551615) 00002000:00100000:2.0:1762166979.491402:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bccb7ed80 with x1847765450587008 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166979.491413:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bccb7ed80. 00000100:00100000:1.0:1762166979.491424:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2492 00000100:00100000:1.0:1762166979.491436:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765450586880:12345-192.168.204.38@tcp:10:lfs.0 00000100:00100000:0.0:1762166979.491460:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2493 00000100:00100000:0.0:1762166979.491509:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450587008:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:0.0:1762166979.491684:0:14623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa8d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166979.491685:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa8e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166979.491691:0:14623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa8d:0x0] updating lvb mtime from disk: 0 -> 1762166979 00002000:00010000:1.0:1762166979.491692:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa8e:0x0] updating lvb mtime from disk: 0 -> 1762166979 00002000:00010000:0.0:1762166979.491698:0:14623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa8d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1762166979.491699:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa8e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1762166979.491706:0:14623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa8d:0x0] updating lvb ctime from disk: 0 -> 1762166979 00002000:00010000:1.0:1762166979.491707:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa8e:0x0] updating lvb ctime from disk: 0 -> 1762166979 00002000:00010000:1.0:1762166979.491715:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa8e:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:0.0:1762166979.491715:0:14623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa8d:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1762166979.491760:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+24:2418:x1847765450586880:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 327us (521us total) trans 21474843371 rc 0/0 00000100:00100000:0.0:1762166979.491766:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450587008:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 294us (484us total) trans 17179876535 rc 0/0 00000100:00100000:1.0:1762166979.491775:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2492 00002000:00010000:1.0:1762166979.491781:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2702 (0->18446744073709551615) 00000100:00100000:0.0:1762166979.491784:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2493 00002000:00100000:1.0:1762166979.491786:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bccb7ca80 with x1847765450586880 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166979.491790:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2701 (0->18446744073709551615) 00002000:00010000:1.0:1762166979.491794:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bccb7ca80. 00002000:00100000:0.0:1762166979.491796:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bccb7ed80 with x1847765450587008 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166979.491805:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bccb7ed80. 00000100:00100000:0.0:1762166979.493303:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166979.493418:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450587136 00000100:00100000:3.0:1762166979.493425:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450587136 00000100:00100000:3.0:1762166979.493461:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19177 00000100:00100000:3.0:1762166979.493467:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4492300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+19:2416:x1847765450587136:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:3.0:1762166979.493602:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4492300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+19:2416:x1847765450587136:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 135us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166979.493609:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19177 00000100:00100000:2.0:1762166979.494956:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166979.494998:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450587264 00000100:00100000:3.0:1762166979.495003:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450587264 00000100:00100000:3.0:1762166979.495030:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19178 00000100:00100000:3.0:1762166979.495036:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+19:2416:x1847765450587264:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:3.0:1762166979.495091:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+19:2416:x1847765450587264:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 55us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166979.495098:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19178 00000100:00100000:2.0:1762166979.496834:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.496909:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450587392 00000100:00100000:0.0:1762166979.496915:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450587392 00000100:00100000:0.0:1762166979.496961:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2494 00000100:00100000:0.0:1762166979.496971:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+19:2416:x1847765450587392:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:0.0:1762166979.497020:0:14623:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbabcf8 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.497034:0:14623:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166979.497036:0:14623:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166979.497041:0:14623:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbabcf8 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.497054:0:14623:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbabcf8 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.497158:0:14623:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbabcf8 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.497166:0:14623:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbabcf8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.497174:0:14623:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbabcf8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.497180:0:14623:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdf000 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166979.497184:0:14623:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbabcf8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.497192:0:14623:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbabcf8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.497207:0:14623:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbabcf8 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.497214:0:14623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbabcf8 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166979.497263:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+19:2416:x1847765450587392:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 295us (434us total) trans 0 rc 12288/12288 00000100:00100000:0.0:1762166979.497268:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2494 00000100:00100000:0.0:1762166979.498778:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.498837:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450587520 00000100:00100000:2.0:1762166979.498855:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450587520 00000100:00100000:2.0:1762166979.498900:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2495 00000100:00100000:2.0:1762166979.498910:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4493480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+24:2417:x1847765450587520:12345-192.168.204.38@tcp:4:lfs.0 00010000:00010000:2.0:1762166979.498937:0:14623:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc6eeaa00/0x2f180c4effbabcff lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.498952:0:14623:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc8473c00/0x2f180c4effbabcea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea31f expref: 24 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.498960:0:14623:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166979.498961:0:14623:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166979.498964:0:14623:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc6eeaa00/0x2f180c4effbabcff lrc: 4/0,1 mode: --/PW res: [0x280000400:0xa8e:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.498998:0:14623:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc8473c00/0x2f180c4effbabcea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea31f expref: 24 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.499008:0:14623:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc8473c00/0x2f180c4effbabcea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea31f expref: 24 pid: 8380 timeout: 698 lvb_type: 0 00000100:00100000:2.0:1762166979.499018:0:14623:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc48a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0000_UUID:14623:1847765449751296:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166979.499074:0:14623:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cd123b480 going to sleep for 11 seconds 00000100:00100000:0.0:1762166979.500024:0:14623:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc48a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0000_UUID:14623:1847765449751296:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166979.500041:0:14623:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bc6eeaa00/0x2f180c4effbabcff lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa8e:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166979.500395:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166979.500452:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450587648 00000100:00100000:1.0:1762166979.500457:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450587648 00010000:00010000:1.0:1762166979.500501:0:6480:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8473c00/0x2f180c4effbabcea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea31f expref: 25 pid: 8380 timeout: 698 lvb_type: 0 00000100:00100000:1.0:1762166979.500533:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9692 00000100:00100000:1.0:1762166979.500543:0:6480:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4492d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+25:2419:x1847765450587648:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166979.500554:0:6480:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166979.500576:0:6480:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc8473c00/0x2f180c4effbabcea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea31f expref: 25 pid: 8380 timeout: 698 lvb_type: 0 00010000:00010000:1.0:1762166979.500588:0:6480:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc8473c00/0x2f180c4effbabcea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea31f expref: 25 pid: 8380 timeout: 698 lvb_type: 0 00010000:00010000:1.0:1762166979.500606:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc8473c00/0x2f180c4effbabcea lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea31f expref: 25 pid: 8380 timeout: 698 lvb_type: 0 00010000:00010000:1.0:1762166979.500618:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166979.500619:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166979.500623:0:6480:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc6eeaa00/0x2f180c4effbabcff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa8e:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.500631:0:6480:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc6eeaa00/0x2f180c4effbabcff lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa8e:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.500655:0:6480:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166979.500675:0:14623:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bc6eeaa00/0x2f180c4effbabcff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.500685:0:14623:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc6eeaa00/0x2f180c4effbabcff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166979.500698:0:6480:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4492d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765450587648:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 156us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166979.500708:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9692 00000001:00080000:2.0:1762166979.502011:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843372 is committed 00000001:00080000:2.0:1762166979.502031:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843366 is committed 00002000:00010000:0.0:1762166979.502100:0:14623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa8e:0x0] updating lvb size from disk: 0 -> 12288 00002000:00010000:0.0:1762166979.502104:0:14623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa8e:0x0] updating lvb blocks from disk: 0 -> 24 00010000:00010000:0.0:1762166979.502112:0:14623:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc6eeaa00/0x2f180c4effbabcff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.502122:0:14623:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc6eeaa00/0x2f180c4effbabcff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.502131:0:14623:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc6eeaa00/0x2f180c4effbabcff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.502137:0:14623:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc6eeaa00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166979.502142:0:14623:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc6eeaa00/0x2f180c4effbabcff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.502151:0:14623:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc6eeaa00/0x2f180c4effbabcff lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.502163:0:14623:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc6eeaa00/0x2f180c4effbabcff lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.502168:0:14623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc6eeaa00/0x2f180c4effbabcff lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166979.502224:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4493480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+15:2417:x1847765450587520:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 3315us (3446us total) trans 21474843372 rc 0/0 00000100:00100000:0.0:1762166979.502232:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2495 00000100:00100000:0.0:1762166979.503518:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166979.503565:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450587776 00000100:00100000:3.0:1762166979.503574:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450587776 00000100:00100000:3.0:1762166979.503617:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19179 00000100:00100000:3.0:1762166979.503625:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4490e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450587776:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:3.0:1762166979.503697:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4490e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450587776:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 73us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166979.503702:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19179 00000100:00100000:2.0:1762166979.505061:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166979.505124:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450587904 00000100:00100000:3.0:1762166979.505129:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450587904 00000100:00100000:3.0:1762166979.505161:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19180 00000100:00100000:3.0:1762166979.505170:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450587904:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:3.0:1762166979.505237:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450587904:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 68us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166979.505244:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19180 00000100:00100000:0.0:1762166979.506875:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.506953:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450588032 00000100:00100000:2.0:1762166979.506961:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450588032 00000100:00100000:2.0:1762166979.507016:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2496 00000100:00100000:2.0:1762166979.507025:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4490700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450588032:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:2.0:1762166979.507075:0:14623:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbabd06 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.507090:0:14623:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166979.507092:0:14623:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166979.507097:0:14623:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbabd06 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [16384->24575] (req 16384->24575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.507111:0:14623:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbabd06 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [16384->24575] (req 16384->24575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.507206:0:14623:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbabd06 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [16384->24575] (req 16384->24575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.507216:0:14623:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbabd06 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [16384->24575] (req 16384->24575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.507223:0:14623:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbabd06 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [16384->24575] (req 16384->24575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.507230:0:14623:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa9800 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166979.507234:0:14623:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbabd06 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [16384->24575] (req 16384->24575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.507242:0:14623:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbabd06 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [16384->24575] (req 16384->24575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.507257:0:14623:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbabd06 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [16384->24575] (req 16384->24575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.507275:0:14623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbabd06 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [16384->24575] (req 16384->24575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166979.507341:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4490700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450588032:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 317us (469us total) trans 0 rc 8192/8192 00000100:00100000:2.0:1762166979.507349:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2496 00000100:00100000:0.0:1762166979.508960:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.509070:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450588160 00000100:00100000:2.0:1762166979.509077:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450588160 00000100:00100000:2.0:1762166979.509128:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2497 00000100:00100000:2.0:1762166979.509138:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4491880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+15:2418:x1847765450588160:12345-192.168.204.38@tcp:4:lfs.0 00002000:00010000:2.0:1762166979.509180:0:14623:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa8e:0x0] initial LVB size: 12288, mtime: 0x690888c3, atime: 0x0, ctime: 0x690888c3, blocks: 0x18 00010000:00010000:2.0:1762166979.509187:0:14623:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9c00/0x2f180c4effbabd0d lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.509198:0:14623:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166979.509200:0:14623:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166979.509204:0:14623:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9c00/0x2f180c4effbabd0d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [16384->24575] (req 16384->24575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.509216:0:14623:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9c00/0x2f180c4effbabd0d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [16384->24575] (req 16384->24575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00000001:00080000:3.0:1762166979.510733:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843373 is committed 00002000:00010000:2.0:1762166979.510904:0:14623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa8e:0x0] updating lvb size from disk: 12288 -> 24576 00002000:00010000:2.0:1762166979.510910:0:14623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa8e:0x0] updating lvb blocks from disk: 24 -> 40 00010000:00010000:2.0:1762166979.510926:0:14623:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9c00/0x2f180c4effbabd0d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [16384->24575] (req 16384->24575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.510944:0:14623:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9c00/0x2f180c4effbabd0d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [16384->24575] (req 16384->24575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.510953:0:14623:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9c00/0x2f180c4effbabd0d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [16384->24575] (req 16384->24575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.510960:0:14623:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa9c00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166979.510964:0:14623:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9c00/0x2f180c4effbabd0d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [16384->24575] (req 16384->24575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.510974:0:14623:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9c00/0x2f180c4effbabd0d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [16384->24575] (req 16384->24575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.510996:0:14623:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9c00/0x2f180c4effbabd0d lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [16384->24575] (req 16384->24575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.511003:0:14623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9c00/0x2f180c4effbabd0d lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [16384->24575] (req 16384->24575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166979.511107:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4491880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+15:2418:x1847765450588160:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 1966us (2149us total) trans 21474843373 rc 0/0 00000100:00100000:2.0:1762166979.511117:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2497 00000100:00100000:0.0:1762166979.513939:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166979.514037:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450588288 00000100:00100000:3.0:1762166979.514050:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450588288 00000100:00100000:3.0:1762166979.514115:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19181 00000100:00100000:3.0:1762166979.514129:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450588288:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:3.0:1762166979.514325:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450588288:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 199us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166979.514334:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19181 00000100:00100000:0.0:1762166979.516895:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166979.516967:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450588416 00000100:00100000:3.0:1762166979.516985:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450588416 00000100:00100000:3.0:1762166979.517049:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19182 00000100:00100000:3.0:1762166979.517065:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450588416:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:3.0:1762166979.517235:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450588416:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 176us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166979.517244:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19182 00000100:00100000:0.0:1762166979.519264:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.519357:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450588544 00000100:00100000:2.0:1762166979.519368:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450588544 00000100:00100000:2.0:1762166979.519456:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2498 00000100:00100000:2.0:1762166979.519472:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450588544:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:2.0:1762166979.519584:0:14623:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbabd14 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.519604:0:14623:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166979.519607:0:14623:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166979.519614:0:14623:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbabd14 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [200704->204799] (req 200704->204799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.519631:0:14623:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbabd14 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [200704->204799] (req 200704->204799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.519776:0:14623:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbabd14 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [200704->204799] (req 200704->204799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.519786:0:14623:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbabd14 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [200704->204799] (req 200704->204799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.519795:0:14623:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbabd14 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [200704->204799] (req 200704->204799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.519803:0:14623:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa9800 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166979.519806:0:14623:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbabd14 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [200704->204799] (req 200704->204799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.519814:0:14623:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbabd14 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [200704->204799] (req 200704->204799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.519831:0:14623:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbabd14 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [200704->204799] (req 200704->204799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.519838:0:14623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbabd14 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [200704->204799] (req 200704->204799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166979.519931:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450588544:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 463us (676us total) trans 0 rc 3607/3607 00000100:00100000:2.0:1762166979.519938:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2498 00000100:00100000:2.0:1762166979.522367:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.522519:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450588672 00000100:00100000:0.0:1762166979.522540:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450588672 00000100:00100000:0.0:1762166979.522636:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2499 00000100:00100000:0.0:1762166979.522647:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc48a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+15:2419:x1847765450588672:12345-192.168.204.38@tcp:4:lfs.0 00002000:00010000:0.0:1762166979.522724:0:14623:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa8e:0x0] initial LVB size: 24576, mtime: 0x690888c3, atime: 0x0, ctime: 0x690888c3, blocks: 0x28 00010000:00010000:0.0:1762166979.522735:0:14623:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde000/0x2f180c4effbabd1b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.522757:0:14623:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166979.522760:0:14623:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166979.522767:0:14623:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde000/0x2f180c4effbabd1b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [200704->204799] (req 200704->204799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.522781:0:14623:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde000/0x2f180c4effbabd1b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [200704->204799] (req 200704->204799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00000001:00080000:3.0:1762166979.525060:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843374 is committed 00002000:00010000:0.0:1762166979.525231:0:14623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa8e:0x0] updating lvb size from disk: 24576 -> 204311 00002000:00010000:0.0:1762166979.525241:0:14623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa8e:0x0] updating lvb blocks from disk: 40 -> 48 00010000:00010000:0.0:1762166979.525256:0:14623:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde000/0x2f180c4effbabd1b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [200704->204799] (req 200704->204799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.525268:0:14623:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde000/0x2f180c4effbabd1b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [200704->204799] (req 200704->204799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.525278:0:14623:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde000/0x2f180c4effbabd1b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [200704->204799] (req 200704->204799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.525285:0:14623:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bde000 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166979.525290:0:14623:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde000/0x2f180c4effbabd1b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [200704->204799] (req 200704->204799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.525300:0:14623:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde000/0x2f180c4effbabd1b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [200704->204799] (req 200704->204799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.525320:0:14623:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde000/0x2f180c4effbabd1b lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [200704->204799] (req 200704->204799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.525334:0:14623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde000/0x2f180c4effbabd1b lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [200704->204799] (req 200704->204799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166979.525472:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc48a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+15:2419:x1847765450588672:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 2822us (3114us total) trans 21474843374 rc 0/0 00000100:00100000:0.0:1762166979.525788:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2499 00000100:00100000:0.0:1762166979.527165:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.527271:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450588800 00000100:00100000:2.0:1762166979.527285:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450588800 00000100:00100000:2.0:1762166979.527413:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30649 00000100:00100000:2.0:1762166979.527426:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+570:61864:x1847765450588800:12345-192.168.204.38@tcp:44:lfs.0 00000001:00080000:2.0:1762166979.530308:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294992283 is committed 00010000:00010000:3.0:1762166979.530338:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbabacf lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166979.530353:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbabacf lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166979.530361:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbabacf lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166979.530369:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355a800 already unused, calling callback (ffffffffc18e2310) 00000020:00080000:2.0:1762166979.530373:0:7412:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff945cf1c8df00 refcount 2 committed 0 result 0 batchid 56 00010000:00010000:3.0:1762166979.530374:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbabacf lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00000020:00080000:2.0:1762166979.530382:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945bc464c900 obd lustre-OST0001-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff945cc63999c0 00010000:00010000:3.0:1762166979.530388:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbabacf lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00000020:00080000:2.0:1762166979.530388:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cc3103900 obd lustre-OST0000-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff945cf1c8d6c0 00000020:00080000:2.0:1762166979.530398:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cc3103100 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff945bcc022800 00000020:00080000:2.0:1762166979.530404:0:7412:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000400:0x2:0x0].55 00010000:00010000:3.0:1762166979.530419:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:3.0:1762166979.530424:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166979.530431:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbabacf lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166979.530439:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbabacf lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000020:00080000:2.0:1762166979.530453:0:7412:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0001: 55 batchid updated 00010000:00010000:3.0:1762166979.530467:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbabbd2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166979.530475:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbabbd2 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166979.530527:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbabbd2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166979.530533:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa9a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166979.530535:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbabbd2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166979.530541:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbabbd2 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166979.530551:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:3.0:1762166979.530554:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166979.530557:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbabbd2 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166979.530563:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbabbd2 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166979.530579:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbabbe7 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00000020:00080000:0.0:1762166979.530585:0:7435:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 56 committed batchid 55 00010000:00010000:3.0:1762166979.530586:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbabbe7 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166979.530596:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbabbe7 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166979.530601:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa8600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166979.530608:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbabbe7 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166979.530613:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbabbe7 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166979.530624:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:3.0:1762166979.530628:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166979.530630:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbabbe7 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166979.530637:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbabbe7 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166979.530648:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbabbfc lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166979.530653:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbabbfc lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166979.530659:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbabbfc lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166979.530664:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa9000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166979.530667:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbabbfc lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166979.530675:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbabbfc lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166979.530684:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:3.0:1762166979.530688:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166979.530691:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbabbfc lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166979.530701:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbabbfc lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166979.530714:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbabc11 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166979.530720:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbabc11 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166979.530726:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbabc11 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166979.530733:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa8000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166979.530736:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbabc11 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166979.530744:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbabc11 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166979.530752:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:3.0:1762166979.530755:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166979.530758:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbabc11 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166979.530764:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbabc11 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166979.530777:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4a14000/0x2f180c4effbabcdc lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x615:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166979.530784:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4a14000/0x2f180c4effbabcdc lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x615:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00000020:00080000:0.0:1762166979.530786:0:7435:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 55 cancel update log [0x240000400:0x2:0x0].54: rc = 0 00000100:00100000:1.0:1762166979.530801:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+530:61864:x1847765450588800:12345-192.168.204.38@tcp:44:lfs.0 Request processed in 3361us (3624us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166979.530803:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4a14000/0x2f180c4effbabcdc lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x615:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00000020:00080000:0.0:1762166979.530806:0:7435:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 55 00010000:00010000:3.0:1762166979.530836:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4a14000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166979.530854:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4a14000/0x2f180c4effbabcdc lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x615:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00000100:00100000:1.0:1762166979.530854:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30649 00010000:00010000:3.0:1762166979.530870:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4a14000/0x2f180c4effbabcdc lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x615:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166979.530881:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x615:0x0].0x0 (ffff945bc809b600) 00010000:00010000:3.0:1762166979.530885:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166979.530888:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4a14000/0x2f180c4effbabcdc lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x615:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166979.530894:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4a14000/0x2f180c4effbabcdc lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x615:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000100:00100000:2.0:1762166979.532631:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.532673:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166979.532714:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450588928 00000100:00100000:3.0:1762166979.532726:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450588928 00000100:00100000:0.0:1762166979.532759:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450589056 00000100:00100000:0.0:1762166979.532765:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450589056 00000100:00100000:3.0:1762166979.532789:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19183 00000100:00100000:3.0:1762166979.532802:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+15:2418:x1847765450588928:12345-192.168.204.38@tcp:16:lfs.0 00000100:00100000:0.0:1762166979.532816:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19184 00000100:00100000:0.0:1762166979.532828:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450589056:12345-192.168.204.38@tcp:16:lfs.0 00000100:00100000:3.0:1762166979.532947:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+15:2418:x1847765450588928:12345-192.168.204.38@tcp:16:lfs.0 Request processed in 147us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166979.532955:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19183 00000001:00080000:2.0:1762166979.534340:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876535 is committed 00000100:00100000:0.0:1762166979.534539:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450589056:12345-192.168.204.38@tcp:16:lfs.0 Request processed in 1709us (1859us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166979.534550:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19184 00000100:00100000:2.0:1762166979.541969:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.542002:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.542031:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.542046:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450589312 00000100:00100000:0.0:1762166979.542061:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450589312 00000100:00100000:1.0:1762166979.542077:0:35248:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450589184 00000100:00100000:1.0:1762166979.542084:0:35248:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450589184 00000100:00100000:0.0:1762166979.542268:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450589440 00000100:00100000:0.0:1762166979.542273:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450589440 00000100:00100000:1.0:1762166979.542290:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19185 00000100:00100000:2.0:1762166979.542300:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19186 00000100:00100000:1.0:1762166979.542306:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+15:2419:x1847765450589312:12345-192.168.204.38@tcp:1:lfs.0 00000100:00100000:2.0:1762166979.542319:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450589184:12345-192.168.204.38@tcp:1:lfs.0 00000100:00100000:0.0:1762166979.542326:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19187 00000100:00100000:0.0:1762166979.542337:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450589440:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:1.0:1762166979.542374:0:35248:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945cc355a600/0x2f180c4effbabd30 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.542375:0:8383:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbabd29 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.542383:0:35247:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbabd22 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.542409:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166979.542409:0:35248:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166979.542410:0:35247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166979.542415:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166979.542416:0:35248:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166979.542416:0:35247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166979.542425:0:35248:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cc355a600/0x2f180c4effbabd30 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.542427:0:8383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbabd29 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.542427:0:35247:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbabd22 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.542454:0:35248:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cc355a600/0x2f180c4effbabd30 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.542458:0:8383:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbabd29 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.542458:0:35247:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbabd22 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.542524:0:35248:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945cc355a600/0x2f180c4effbabd30 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.542525:0:8383:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbabd29 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.542526:0:35247:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbabd22 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.542553:0:8383:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbabd29 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.542554:0:35247:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbabd22 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.542555:0:35248:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945cc355a600/0x2f180c4effbabd30 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.542579:0:35247:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbabd22 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.542580:0:35248:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945cc355a600/0x2f180c4effbabd30 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.542592:0:8383:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbabd29 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.542602:0:35247:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdf000 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166979.542610:0:35247:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbabd22 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.542619:0:8383:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa8000 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166979.542621:0:35248:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355a600 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166979.542627:0:8383:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbabd29 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.542629:0:35248:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945cc355a600/0x2f180c4effbabd30 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.542631:0:35247:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbabd22 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.542655:0:35248:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945cc355a600/0x2f180c4effbabd30 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.542656:0:8383:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbabd29 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.542663:0:35247:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbabd22 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.542685:0:35248:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945cc355a600/0x2f180c4effbabd30 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.542686:0:8383:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbabd29 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.542688:0:35247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbabd22 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.542711:0:35248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cc355a600/0x2f180c4effbabd30 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.542726:0:8383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbabd29 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166979.542792:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450589440:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 456us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166979.542797:0:35248:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+15:2419:x1847765450589312:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 491us (833us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166979.542798:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450589184:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 480us (786us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166979.542807:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19187 00000100:00100000:1.0:1762166979.542817:0:35248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19185 00000100:00100000:2.0:1762166979.542825:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19186 00000100:00100000:2.0:1762166979.543982:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166979.544152:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450589696 00000100:00100000:1.0:1762166979.544166:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450589696 00000100:00100000:1.0:1762166979.544243:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30650 00000100:00100000:1.0:1762166979.544252:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+529:61864:x1847765450589696:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:1.0:1762166979.544339:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbabd37 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x615:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166979.544356:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbabd37 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x615:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.544368:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbabd37 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x615:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00010000:1.0:1762166979.544535:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000f543dbee reply state 0000000014104b5a transno 4294992284 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbabd37 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x615:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.544548:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbabd37 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x615:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.544555:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x615:0x0].0x0 (ffff945bc809b600) 00010000:00010000:1.0:1762166979.544558:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166979.544561:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166979.544665:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+531:61864:x1847765450589696:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 413us (685us total) trans 4294992284 rc 0/0 00000100:00100000:1.0:1762166979.544673:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30650 00000100:00100000:3.0:1762166979.545691:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.545780:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450589824 00000100:00100000:2.0:1762166979.545788:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450589824 00000100:00100000:3.0:1762166979.545813:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.545862:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450589952 00000100:00100000:2.0:1762166979.545867:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450589952 00000100:00100000:2.0:1762166979.545902:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19188 00000100:00100000:2.0:1762166979.545927:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+15:2416:x1847765450589824:12345-192.168.204.38@tcp:2:lfs.0 00000100:00100000:1.0:1762166979.545927:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19189 00000100:00100000:1.0:1762166979.545953:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+18:2416:x1847765450589952:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:1.0:1762166979.546087:0:35248:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa8d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166979.546091:0:35248:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa8d:0x0] updating lvb mtime from disk: 1762166979 -> 1762166979 00002000:00010000:1.0:1762166979.546095:0:35248:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa8d:0x0] updating lvb atime from disk: 0 -> 1762166979 00002000:00010000:1.0:1762166979.546098:0:35248:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa8d:0x0] updating lvb ctime from disk: 1762166979 -> 1762166979 00002000:00010000:1.0:1762166979.546102:0:35248:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa8d:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1762166979.546172:0:35248:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+19:2416:x1847765450589952:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 230us (360us total) trans 17179876536 rc 0/0 00000100:00100000:1.0:1762166979.546180:0:35248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19189 00000100:00100000:2.0:1762166979.546200:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+16:2416:x1847765450589824:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 281us (506us total) trans 21474843375 rc 0/0 00000100:00100000:2.0:1762166979.546211:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19188 00000100:00100000:2.0:1762166979.547011:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166979.547058:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450590208 00000100:00100000:1.0:1762166979.547066:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450590208 00000100:00100000:1.0:1762166979.547104:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30651 00000100:00100000:1.0:1762166979.547111:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+531:61864:x1847765450590208:12345-192.168.204.38@tcp:55:lfs.0 00010000:00010000:1.0:1762166979.547158:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbabd3e lrc: 3/0,1 mode: --/PW res: [0x240000404:0x615:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166979.547171:0:6495:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbabcd5 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x615:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea311 expref: 531 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.547180:0:6495:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbabd3e lrc: 4/0,1 mode: --/PW res: [0x240000404:0x615:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.547212:0:6495:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbabcd5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x615:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea311 expref: 531 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.547225:0:6495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbabcd5 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x615:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea311 expref: 531 pid: 6495 timeout: 698 lvb_type: 0 00000100:00100000:1.0:1762166979.547240:0:6495:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bc0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6495:1847765449751424:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166979.547328:0:6495:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc4076900 going to sleep for 11 seconds 00000100:00100000:1.0:1762166979.548277:0:6495:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bc0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6495:1847765449751424:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166979.548304:0:6495:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbabd3e lrc: 3/0,1 mode: --/PW res: [0x240000404:0x615:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000100:00100000:2.0:1762166979.548534:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166979.548570:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450590336 00000100:00100000:1.0:1762166979.548576:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450590336 00010000:00010000:1.0:1762166979.548605:0:6480:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbabcd5 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x615:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea311 expref: 532 pid: 6495 timeout: 698 lvb_type: 0 00000100:00100000:1.0:1762166979.548637:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9693 00000100:00100000:1.0:1762166979.548645:0:6480:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+532:2419:x1847765450590336:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166979.548657:0:6480:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166979.548665:0:6480:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbabcd5 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x615:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea311 expref: 532 pid: 6495 timeout: 698 lvb_type: 0 00010000:00010000:1.0:1762166979.548678:0:6480:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbabcd5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x615:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea311 expref: 532 pid: 6495 timeout: 698 lvb_type: 0 00010000:00010000:1.0:1762166979.548697:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbabcd5 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x615:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea311 expref: 532 pid: 6495 timeout: 698 lvb_type: 0 00010000:00010000:1.0:1762166979.548712:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x615:0x0].0x0 (ffff945bc809b600) 00010000:00010000:1.0:1762166979.548717:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbabd3e lrc: 3/0,1 mode: --/PW res: [0x240000404:0x615:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.548725:0:6480:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbabd3e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x615:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.548732:0:6480:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbabd3e lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x615:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.548757:0:6480:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166979.548782:0:6495:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbabd3e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x615:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.548791:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbabd3e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x615:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000100:00100000:1.0:1762166979.548798:0:6480:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+531:2419:x1847765450590336:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 151us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166979.548809:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9693 00010000:00010000:2.0:1762166979.548825:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbabd3e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x615:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.548833:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbabd3e lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x615:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.548849:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbabd3e lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x615:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.548853:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355b800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166979.548858:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbabd3e lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x615:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.548863:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbabd3e lrc: 4/0,0 mode: PW/PW res: [0x240000404:0x615:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.548871:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x615:0x0].0x0 (ffff945bc809b600) 00010000:00010000:2.0:1762166979.548873:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1762166979.548877:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbabd3e lrc: 2/0,0 mode: --/PW res: [0x240000404:0x615:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.548881:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbabd3e lrc: 0/0,0 mode: --/PW res: [0x240000404:0x615:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000100:00100000:2.0:1762166979.548919:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+530:61864:x1847765450590208:12345-192.168.204.38@tcp:55:lfs.0 Request processed in 1806us (1908us total) trans 0 rc -22/-22 00000100:00100000:2.0:1762166979.548928:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30651 00000100:00100000:3.0:1762166979.549945:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.549990:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450590592 00000100:00100000:2.0:1762166979.549996:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450590592 00000100:00100000:2.0:1762166979.550031:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30652 00000100:00100000:2.0:1762166979.550047:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+530:61864:x1847765450590592:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:2.0:1762166979.550085:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166979.550099:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbabc1f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea2c4 expref: 530 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.550111:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166979.550116:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166979.550146:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbabd45 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166979.550156:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbabd45 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.550164:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbabd45 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00010000:2.0:1762166979.550260:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000008eb0352d reply state 000000007ca69c11 transno 4294992285 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbabd45 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.550272:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbabd45 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.550278:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166979.550281:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166979.550283:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166979.550339:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+531:61864:x1847765450590592:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 301us (395us total) trans 4294992285 rc 0/0 00000100:00100000:2.0:1762166979.550347:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30652 00000100:00100000:0.0:1762166979.551381:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.551422:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.551454:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450590720 00000100:00100000:2.0:1762166979.551463:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450590720 00000100:00100000:1.0:1762166979.551513:0:35248:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450590848 00000100:00100000:1.0:1762166979.551518:0:35248:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450590848 00000100:00100000:2.0:1762166979.551550:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19190 00000100:00100000:1.0:1762166979.551562:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19191 00000100:00100000:2.0:1762166979.551568:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450590720:12345-192.168.204.38@tcp:2:lfs.0 00000100:00100000:0.0:1762166979.551568:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166979.551576:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+16:2418:x1847765450590848:12345-192.168.204.38@tcp:2:lfs.0 00000100:00100000:3.0:1762166979.551582:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450590976 00000100:00100000:3.0:1762166979.551589:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450590976 00000100:00100000:3.0:1762166979.551624:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19192 00000100:00100000:3.0:1762166979.551635:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450590976:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:3.0:1762166979.551734:0:9165:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166979.551734:0:8383:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 204311 -> 204311 00002000:00010000:1.0:1762166979.551735:0:35248:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166979.551742:0:9165:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166979 -> 1762166979 00002000:00010000:2.0:1762166979.551743:0:8383:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166979 -> 1762166979 00002000:00010000:1.0:1762166979.551743:0:35248:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166979 -> 1762166979 00002000:00010000:3.0:1762166979.551749:0:9165:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166978 -> 1762166979 00002000:00010000:2.0:1762166979.551751:0:8383:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166978 -> 1762166979 00002000:00010000:1.0:1762166979.551752:0:35248:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166978 -> 1762166979 00002000:00010000:3.0:1762166979.551754:0:9165:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166979 -> 1762166979 00002000:00010000:2.0:1762166979.551758:0:8383:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166979 -> 1762166979 00002000:00010000:1.0:1762166979.551760:0:35248:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166979 -> 1762166979 00002000:00010000:3.0:1762166979.551761:0:9165:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:2.0:1762166979.551765:0:8383:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 120 -> 120 00002000:00010000:1.0:1762166979.551768:0:35248:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00000100:00100000:1.0:1762166979.551823:0:35248:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450590848:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 250us (400us total) trans 21474843376 rc 0/0 00000100:00100000:1.0:1762166979.551831:0:35248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19191 00000100:00100000:3.0:1762166979.551902:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765450590976:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 267us (336us total) trans 17179876538 rc 0/0 00000100:00100000:2.0:1762166979.551915:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450590720:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 341us (525us total) trans 17179876537 rc 0/0 00000100:00100000:3.0:1762166979.551917:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19192 00000100:00100000:2.0:1762166979.551938:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19190 00000100:00100000:0.0:1762166979.553274:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.553323:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450591232 00000100:00100000:2.0:1762166979.553333:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450591232 00000100:00100000:2.0:1762166979.553393:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11915 00000100:00100000:2.0:1762166979.553403:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+531:61864:x1847765450591232:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:2.0:1762166979.553462:0:19593:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x240000404:0x5eb:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbabc96 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea2f5 expref: 531 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.553539:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbabd4c lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:2.0:1762166979.553553:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbabb93 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea29a expref: 531 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.553564:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbabbcb lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea2a8 expref: 531 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.553572:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbabd4c lrc: 5/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166979.553604:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbabbcb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea2a8 expref: 531 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.553618:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbabbcb lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea2a8 expref: 531 pid: 6495 timeout: 698 lvb_type: 0 00000100:00100000:2.0:1762166979.553632:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449751552:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166979.553717:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbabb93 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea29a expref: 531 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.553727:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbabb93 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea29a expref: 531 pid: 6495 timeout: 698 lvb_type: 0 00000100:00100000:2.0:1762166979.553737:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5d180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449751680:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166979.553762:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7a779c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166979.555040:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449751552:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166979.555052:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5d180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449751680:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166979.555074:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbabd4c lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:0.0:1762166979.555190:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166979.555231:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450591488 00000100:00100000:1.0:1762166979.555236:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450591488 00010000:00010000:1.0:1762166979.555258:0:6480:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbabbcb lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea2a8 expref: 532 pid: 6495 timeout: 698 lvb_type: 0 00000100:00100000:0.0:1762166979.555269:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166979.555306:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450591360 00000100:00100000:1.0:1762166979.555309:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450591360 00010000:00010000:1.0:1762166979.555318:0:6480:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbabb93 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea29a expref: 533 pid: 6495 timeout: 698 lvb_type: 0 00000100:00100000:2.0:1762166979.555331:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9694 00000100:00100000:2.0:1762166979.555344:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7c32850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+533:2418:x1847765450591488:12345-192.168.204.38@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1762166979.555355:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9695 00010000:00010000:2.0:1762166979.555359:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1762166979.555369:0:6480:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce77480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+533:2419:x1847765450591360:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166979.555371:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbabbcb lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea2a8 expref: 533 pid: 6495 timeout: 698 lvb_type: 0 00010000:00010000:1.0:1762166979.555383:0:6480:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166979.555391:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbabbcb lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea2a8 expref: 533 pid: 6495 timeout: 698 lvb_type: 0 00010000:00010000:1.0:1762166979.555393:0:6480:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbabb93 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea29a expref: 533 pid: 6495 timeout: 698 lvb_type: 0 00010000:00010000:2.0:1762166979.555422:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbabbcb lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea2a8 expref: 533 pid: 6495 timeout: 698 lvb_type: 0 00010000:00010000:1.0:1762166979.555424:0:6480:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbabb93 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea29a expref: 533 pid: 6495 timeout: 698 lvb_type: 0 00010000:00010000:2.0:1762166979.555452:0:7421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:1.0:1762166979.555458:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbabb93 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea29a expref: 532 pid: 6495 timeout: 698 lvb_type: 0 00010000:00010000:2.0:1762166979.555459:0:7421:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbabd4c lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166979.555502:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbabd4c lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166979.555511:0:7421:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbabd4c lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166979.555520:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:1.0:1762166979.555524:0:6480:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166979.555537:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166979.555564:0:6480:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce77480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+531:2419:x1847765450591360:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 198us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166979.555573:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7c32850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+531:2418:x1847765450591488:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 229us (381us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166979.555573:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbabd4c lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:1.0:1762166979.555574:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9695 00010000:00010000:0.0:1762166979.555598:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbabd4c lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:2.0:1762166979.555600:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9694 00010000:00010000:0.0:1762166979.555634:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbabd53 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x615:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166979.555651:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14000/0x2f180c4effbabce3 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x615:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea318 expref: 529 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.555661:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbabd53 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x615:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166979.555698:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14000/0x2f180c4effbabce3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x615:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea318 expref: 529 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.555714:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14000/0x2f180c4effbabce3 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x615:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea318 expref: 529 pid: 6495 timeout: 698 lvb_type: 0 00000100:00100000:0.0:1762166979.555725:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcce75500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449751808:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166979.555795:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1c8d240 going to sleep for 11 seconds 00000100:00100000:2.0:1762166979.556585:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcce75500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449751808:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166979.556602:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbabd53 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x615:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:3.0:1762166979.556901:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.556955:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450591616 00000100:00100000:2.0:1762166979.556963:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450591616 00010000:00010000:2.0:1762166979.556993:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14000/0x2f180c4effbabce3 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x615:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea318 expref: 530 pid: 6495 timeout: 698 lvb_type: 0 00000100:00100000:2.0:1762166979.557032:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9696 00000100:00100000:2.0:1762166979.557050:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+530:2418:x1847765450591616:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166979.557063:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166979.557069:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14000/0x2f180c4effbabce3 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x615:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea318 expref: 530 pid: 6495 timeout: 698 lvb_type: 0 00010000:00010000:2.0:1762166979.557080:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14000/0x2f180c4effbabce3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x615:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea318 expref: 530 pid: 6495 timeout: 698 lvb_type: 0 00010000:00010000:2.0:1762166979.557107:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14000/0x2f180c4effbabce3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x615:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea318 expref: 530 pid: 6495 timeout: 698 lvb_type: 0 00010000:00010000:2.0:1762166979.557121:0:7421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x615:0x0].0x0 (ffff945bc809b600) 00010000:00010000:2.0:1762166979.557124:0:7421:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbabd53 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x615:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166979.557129:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbabd53 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x615:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166979.557134:0:7421:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbabd53 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x615:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166979.557160:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166979.557199:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+529:2418:x1847765450591616:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 157us (300us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166979.557203:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbabd53 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x615:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:2.0:1762166979.557209:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9696 00010000:00010000:0.0:1762166979.557218:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbabd53 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x615:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:0.0:1762166979.557577:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcce75f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449751936:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166979.557622:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166979.557651:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011c7300 going to sleep for 11 seconds 00000100:00100000:3.0:1762166979.557670:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449751936 00000100:00100000:3.0:1762166979.557675:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449751936 00000100:00100000:3.0:1762166979.557714:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1411 00000100:00100000:3.0:1762166979.557720:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449751936:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166979.557808:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449751936:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 87us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166979.557816:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1411 00000100:00100000:0.0:1762166979.557867:0:19593:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 17179876522 gen 2 00000004:00080000:0.0:1762166979.557873:0:19593:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 17179876522 committed transno 17179876522 00000100:00100000:0.0:1762166979.557897:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcce75f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449751936:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166979.557938:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcce75f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449752064:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166979.557959:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166979.557978:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7c77cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166979.558000:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449752064 00000100:00100000:3.0:1762166979.558005:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449752064 00000100:00100000:3.0:1762166979.558039:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1412 00000100:00100000:3.0:1762166979.558046:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449752064:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166979.558111:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449752064:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 66us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166979.558119:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1412 00000100:00100000:0.0:1762166979.558125:0:19593:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 21474843366 gen 2 00000004:00080000:0.0:1762166979.558129:0:19593:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 21474843360 committed transno 21474843366 00000004:00080000:0.0:1762166979.558141:0:19593:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc4010380, transno 21474843361 00000004:00080000:0.0:1762166979.558153:0:19593:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc4011880, transno 21474843362 00000004:00080000:0.0:1762166979.558156:0:19593:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc4010000, transno 21474843363 00000004:00080000:0.0:1762166979.558159:0:19593:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc4012d80, transno 21474843364 00000004:00080000:0.0:1762166979.558164:0:19593:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 21474843366 committed transno 21474843366 00000100:00100000:0.0:1762166979.558180:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcce75f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449752064:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166979.558220:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd2680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449752192:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166979.558243:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166979.558262:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1c8d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166979.558276:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449752192 00000004:00080000:2.0:1762166979.558279:0:9158:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0001: 1 changes, 0 in progress, 0 in flight, 4 done 00000100:00100000:3.0:1762166979.558282:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449752192 00000100:00100000:3.0:1762166979.558313:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1413 00000100:00100000:3.0:1762166979.558320:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449752192:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166979.558373:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449752192:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 53us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166979.558379:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1413 00000100:00100000:0.0:1762166979.558408:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd2680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449752192:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166979.558440:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd2680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449752320:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166979.558464:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166979.558506:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1c8dd80 going to sleep for 11 seconds 00000100:00100000:3.0:1762166979.558518:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449752320 00000100:00100000:3.0:1762166979.558524:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449752320 00000100:00100000:3.0:1762166979.558552:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1414 00000100:00100000:3.0:1762166979.558559:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449752320:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166979.558608:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449752320:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 50us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166979.558615:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1414 00000100:00100000:0.0:1762166979.558647:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd2680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449752320:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166979.558683:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd2680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449752448:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166979.558701:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166979.558715:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc12ed240 going to sleep for 11 seconds 00000100:00100000:3.0:1762166979.558726:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449752448 00000100:00100000:3.0:1762166979.558731:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449752448 00000100:00100000:3.0:1762166979.558760:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1415 00000100:00100000:3.0:1762166979.558767:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449752448:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166979.558833:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449752448:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 66us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166979.558849:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1415 00000100:00100000:0.0:1762166979.558867:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd2680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449752448:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166979.558899:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd2680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449752576:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166979.558920:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166979.558942:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011c7300 going to sleep for 11 seconds 00000100:00100000:3.0:1762166979.558952:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449752576 00000100:00100000:3.0:1762166979.558957:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449752576 00000100:00100000:3.0:1762166979.558981:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1416 00000100:00100000:3.0:1762166979.558986:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449752576:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166979.559040:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449752576:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 53us (118us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166979.559047:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1416 00000100:00100000:0.0:1762166979.559059:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd2680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449752576:0@lo:1000:mdt_rdpg00_003.0 00000040:00080000:0.0:1762166979.559207:0:19593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x2:0x0].56, 456 off69216 00000001:00080000:0.0:1762166979.559216:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992286 00000100:00100000:0.0:1762166979.559260:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd2680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449752704:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166979.559282:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166979.559301:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cd123b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166979.559319:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449752704 00000100:00100000:3.0:1762166979.559324:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449752704 00000100:00100000:3.0:1762166979.559347:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1417 00000100:00100000:3.0:1762166979.559352:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449752704:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166979.559459:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:19593:x1847765449752704:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 106us (176us total) trans 17179876539 rc 0/0 00000100:00100000:3.0:1762166979.559466:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1417 00000100:00100000:0.0:1762166979.559561:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd2680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449752704:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166979.559594:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd2300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449752832:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166979.559619:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166979.559638:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011c7000 going to sleep for 11 seconds 00000100:00100000:3.0:1762166979.559733:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449752832 00000100:00100000:3.0:1762166979.559743:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449752832 00000100:00100000:3.0:1762166979.559795:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1418 00000100:00100000:3.0:1762166979.559805:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449752832:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166979.560011:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:19593:x1847765449752832:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 206us (390us total) trans 21474843377 rc 0/0 00000100:00100000:3.0:1762166979.560026:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1418 00000100:00100000:0.0:1762166979.560055:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd2300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449752832:0@lo:1000:mdt_rdpg00_003.0 00000001:00080000:0.0:1762166979.560118:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992287 00010000:00010000:0.0:1762166979.560144:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbabd53 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x615:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166979.560155:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbabd53 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x615:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166979.560162:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbabd53 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x615:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166979.560169:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bde200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166979.560174:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbabd53 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x615:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166979.560182:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbabd53 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x615:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166979.560199:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x615:0x0].0x0 (ffff945bc809b600) 00010000:00010000:0.0:1762166979.560203:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166979.560207:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbabd53 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x615:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166979.560212:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbabd53 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x615:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166979.560226:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbabd4c lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166979.560235:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbabd4c lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166979.560241:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbabd4c lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166979.560245:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa8600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166979.560247:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbabd4c lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166979.560251:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbabd4c lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166979.560258:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:0.0:1762166979.560260:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166979.560263:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbabd4c lrc: 2/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166979.560268:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbabd4c lrc: 0/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166979.560279:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:0.0:1762166979.560281:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166979.560288:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbabc96 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea2f5 expref: 531 pid: 6495 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166979.560379:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+530:61864:x1847765450591232:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 6977us (7109us total) trans 4294992288 rc 0/0 00000100:00100000:0.0:1762166979.560388:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11915 00000020:00080000:0.0:1762166979.560394:0:19593:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1762166979.561654:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.561696:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450591744 00000100:00100000:2.0:1762166979.561704:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450591744 00000100:00100000:2.0:1762166979.561753:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30653 00000100:00100000:2.0:1762166979.561763:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+530:61864:x1847765450591744:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166979.561784:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166979.561806:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9400/0x2f180c4effbabd5a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea32d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.561874:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9400/0x2f180c4effbabd5a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea32d expref: 531 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.561891:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9400/0x2f180c4effbabd5a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea32d expref: 531 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.561911:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166979.561914:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166979.561917:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa9400, rc 0) 00000100:00100000:2.0:1762166979.561959:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+531:61864:x1847765450591744:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 198us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166979.561965:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30653 00000100:00100000:2.0:1762166979.563448:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.563521:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450592000 00000100:00100000:0.0:1762166979.563529:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450592000 00000100:00100000:0.0:1762166979.563566:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11916 00000100:00100000:0.0:1762166979.563573:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+531:61864:x1847765450592000:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166979.563742:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+532:61864:x1847765450592000:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 168us (297us total) trans 4294992289 rc 0/0 00000100:00100000:0.0:1762166979.563750:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11916 00000100:00100000:3.0:1762166979.564561:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.564588:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450592256 00000100:00100000:0.0:1762166979.564593:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450592256 00000100:00100000:0.0:1762166979.564616:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11917 00000100:00100000:0.0:1762166979.564621:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+532:61864:x1847765450592256:12345-192.168.204.38@tcp:35:lfs.0 00000004:00080000:0.0:1762166979.564744:0:19593:0:(mdd_object.c:3965:mdd_close()) Object [0x240000404:0x615:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:0.0:1762166979.564828:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbabd61 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x615:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166979.564851:0:19593:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbabd61 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x615:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166979.564863:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbabd61 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x615:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166979.564873:0:19593:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbabd61 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x615:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166979.564879:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbabd61 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x615:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166979.564885:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbabd61 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x615:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166979.564913:0:19593:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1762166979.564944:0:7420:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1762166979.564954:0:7420:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbabd61 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x615:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166979.564963:0:7420:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdec00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166979.564970:0:7420:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbabd61 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x615:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166979.564979:0:7420:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbabd61 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x615:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166979.565000:0:7420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x615:0x0].0x0 (ffff945bc809b600) 00010000:00010000:3.0:1762166979.565004:0:7420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1762166979.565009:0:7420:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbabd61 lrc: 1/0,0 mode: --/PW res: [0x240000404:0x615:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166979.565018:0:7420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbabd61 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x615:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166979.565035:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166979.565037:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166979.565039:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166979.565100:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+533:61864:x1847765450592256:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 478us (541us total) trans 4294992290 rc 0/0 00000100:00100000:0.0:1762166979.565106:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11917 00000100:00100000:3.0:1762166979.574110:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.574231:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450592384 00000100:00100000:2.0:1762166979.574246:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450592384 00000100:00100000:2.0:1762166979.574322:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30654 00000100:00100000:2.0:1762166979.574335:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+533:61865:x1847765450592384:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166979.574369:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166979.574397:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbabd68 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea334 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.574506:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbabd6f lrc: 3/1,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166979.574522:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbabd6f lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.574535:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbabd6f lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.574552:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbabd76 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166979.574559:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbabd76 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.574566:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbabd76 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.574664:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbabd7d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166979.574674:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbabd7d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.574681:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbabd7d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:2.0:1762166979.574727:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 204311 00000004:00200000:2.0:1762166979.574732:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166979.574755:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbabd7d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.574768:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbabd7d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.574777:0:6495:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbabd6f lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.574784:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbabd6f lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.574791:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbabd6f lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.574798:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbabd6f lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.574809:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa9c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166979.574813:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbabd6f lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.574821:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbabd6f lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.574834:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0x0 (ffff945bc477f400) 00010000:00010000:2.0:1762166979.574852:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166979.574858:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbabd6f lrc: 3/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.574865:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbabd6f lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.574881:0:6495:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbabd76 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.574888:0:6495:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbabd76 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.574893:0:6495:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbabd76 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.574898:0:6495:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa8200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166979.574901:0:6495:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbabd76 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.574906:0:6495:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbabd76 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.574913:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0xdd396665 (ffff945cced86900) 00010000:00010000:2.0:1762166979.574916:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166979.574919:0:6495:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbabd76 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.574925:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbabd76 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:2.0:1762166979.574957:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbabd68 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea334 expref: 535 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.574973:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbabd7d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea334 expref: 534 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.574980:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166979.574983:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166979.574986:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa8c00, rc 0) 00000100:00100000:2.0:1762166979.575059:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+534:61865:x1847765450592384:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 726us (958us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166979.575067:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30654 00000100:00100000:2.0:1762166979.576760:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166979.576858:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450592640 00000100:00100000:1.0:1762166979.576867:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450592640 00000100:00100000:1.0:1762166979.576920:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30655 00000100:00100000:1.0:1762166979.576932:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+534:61865:x1847765450592640:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166979.576953:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166979.576970:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbabd84 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea33b expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.577074:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a000/0x2f180c4effbabd8b lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166979.577087:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a000/0x2f180c4effbabd8b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.577098:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a000/0x2f180c4effbabd8b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:1.0:1762166979.577110:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 204311 00010000:00010000:1.0:1762166979.577230:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbabd84 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea33b expref: 537 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.577248:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a000/0x2f180c4effbabd8b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea33b expref: 536 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.577257:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:1.0:1762166979.577260:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1762166979.577263:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355a000, rc 0) 00000100:00100000:1.0:1762166979.577314:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+536:61865:x1847765450592640:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 385us (562us total) trans 4294992291 rc 0/0 00000100:00100000:1.0:1762166979.577322:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30655 00000100:00100000:3.0:1762166979.578556:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166979.578596:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450592896 00000100:00100000:1.0:1762166979.578603:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450592896 00000100:00100000:1.0:1762166979.578643:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30656 00000100:00100000:1.0:1762166979.578651:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+536:61865:x1847765450592896:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166979.578672:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166979.578685:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbabd99 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea342 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.578757:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbabda0 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166979.578766:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbabda0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.578773:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbabda0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:1.0:1762166979.578781:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 204311 00010000:00010000:1.0:1762166979.578836:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbabd99 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea342 expref: 539 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.578864:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbabda0 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea342 expref: 538 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.578869:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:1.0:1762166979.578871:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762166979.578873:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355b400, rc 0) 00000100:00100000:1.0:1762166979.578909:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+538:61865:x1847765450592896:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 260us (361us total) trans 4294992292 rc 0/0 00000100:00100000:1.0:1762166979.578915:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30656 00000100:00100000:3.0:1762166979.604624:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.604749:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450593024 00000100:00100000:0.0:1762166979.604769:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450593024 00000100:00100000:0.0:1762166979.604908:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2500 00000100:00100000:0.0:1762166979.604924:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+21:2416:x1847765450593024:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:0.0:1762166979.604990:0:14623:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde200/0x2f180c4effbabdae lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.605013:0:14623:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166979.605015:0:14623:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166979.605023:0:14623:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde200/0x2f180c4effbabdae lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.605039:0:14623:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde200/0x2f180c4effbabdae lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.607686:0:14623:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde200/0x2f180c4effbabdae lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.607709:0:14623:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde200/0x2f180c4effbabdae lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.607719:0:14623:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde200/0x2f180c4effbabdae lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.607727:0:14623:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bde200 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166979.607732:0:14623:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde200/0x2f180c4effbabdae lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.607748:0:14623:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde200/0x2f180c4effbabdae lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.607771:0:14623:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde200/0x2f180c4effbabdae lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.607779:0:14623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde200/0x2f180c4effbabdae lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166979.607897:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+21:2416:x1847765450593024:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 2972us (3329us total) trans 0 rc 204311/204311 00000100:00100000:0.0:1762166979.607909:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2500 00000100:00100000:3.0:1762166979.610462:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.610567:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450593152 00000100:00100000:0.0:1762166979.610579:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450593152 00000100:00100000:0.0:1762166979.610661:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2501 00000100:00100000:0.0:1762166979.610674:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+17:2417:x1847765450593152:12345-192.168.204.38@tcp:3:lfs.0 00002000:00010000:0.0:1762166979.610736:0:14623:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa8e:0x0] initial LVB size: 204311, mtime: 0x690888c3, atime: 0x690888c3, ctime: 0x690888c3, blocks: 0x30 00010000:00010000:0.0:1762166979.610747:0:14623:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf400/0x2f180c4effbabdb5 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.610763:0:14623:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166979.610765:0:14623:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166979.610772:0:14623:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf400/0x2f180c4effbabdb5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.610787:0:14623:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf400/0x2f180c4effbabdb5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.612797:0:14623:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf400/0x2f180c4effbabdb5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.612814:0:14623:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf400/0x2f180c4effbabdb5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.612823:0:14623:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf400/0x2f180c4effbabdb5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.612831:0:14623:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdf400 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166979.612835:0:14623:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf400/0x2f180c4effbabdb5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.612854:0:14623:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf400/0x2f180c4effbabdb5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.612875:0:14623:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf400/0x2f180c4effbabdb5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.612883:0:14623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf400/0x2f180c4effbabdb5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14623 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166979.612972:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+17:2417:x1847765450593152:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 2297us (2522us total) trans 0 rc 204311/204311 00000100:00100000:0.0:1762166979.612983:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2501 00000100:00100000:2.0:1762166979.620310:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.620383:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450593280 00000100:00100000:0.0:1762166979.620396:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450593280 00000100:00100000:0.0:1762166979.620522:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 886 00000100:00100000:0.0:1762166979.620535:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+538:61865:x1847765450593280:12345-192.168.204.38@tcp:103:lfs.0 00010000:00010000:0.0:1762166979.620554:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166979.620591:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbabda0 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea342 expref: 538 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.620615:0:7421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:0.0:1762166979.620622:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166979.620694:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+537:61865:x1847765450593280:12345-192.168.204.38@tcp:103:lfs.0 Request processed in 163us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166979.620701:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 886 00000100:00100000:3.0:1762166979.622253:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.622339:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450593536 00000100:00100000:0.0:1762166979.622348:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450593536 00000100:00100000:0.0:1762166979.622397:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11918 00000100:00100000:0.0:1762166979.622404:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+537:61865:x1847765450593536:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166979.622651:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+538:61865:x1847765450593536:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 246us (408us total) trans 4294992293 rc 0/0 00000100:00100000:0.0:1762166979.622656:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11918 00000100:00100000:3.0:1762166979.625375:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166979.625543:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450593792 00000100:00100000:1.0:1762166979.625561:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450593792 00000100:00100000:1.0:1762166979.625636:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30657 00000100:00100000:1.0:1762166979.625648:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+538:61766:x1847765450593792:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:1.0:1762166979.625675:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166979.625713:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbabdbc lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea349 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.625822:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbabdc3 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166979.625851:0:6495:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbabd7d lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea334 expref: 539 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.625861:0:6495:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbabdc3 lrc: 4/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.625902:0:6495:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbabd7d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea334 expref: 539 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.625917:0:6495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbabd7d lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea334 expref: 539 pid: 6495 timeout: 698 lvb_type: 0 00000100:00100000:1.0:1762166979.625934:0:6495:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bc0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6495:1847765449752960:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166979.626044:0:6495:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc4076000 going to sleep for 11 seconds 00000100:00100000:1.0:1762166979.627537:0:6495:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bc0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6495:1847765449752960:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166979.627559:0:6495:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbabdc3 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000100:00100000:3.0:1762166979.627653:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.627696:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450593920 00000100:00100000:0.0:1762166979.627702:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450593920 00010000:00010000:0.0:1762166979.627731:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbabd7d lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea334 expref: 540 pid: 6495 timeout: 698 lvb_type: 0 00000100:00100000:0.0:1762166979.627764:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9697 00000100:00100000:0.0:1762166979.627773:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5765c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+540:2419:x1847765450593920:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166979.627786:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166979.627794:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbabd7d lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea334 expref: 540 pid: 6495 timeout: 698 lvb_type: 0 00010000:00010000:0.0:1762166979.627806:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbabd7d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea334 expref: 540 pid: 6495 timeout: 698 lvb_type: 0 00010000:00010000:0.0:1762166979.627828:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbabd7d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea334 expref: 540 pid: 6495 timeout: 698 lvb_type: 0 00010000:00010000:0.0:1762166979.627854:0:7421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:0.0:1762166979.627860:0:7421:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbabdc3 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166979.627868:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbabdc3 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166979.627876:0:7421:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbabdc3 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166979.627901:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166979.627927:0:6495:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbabdc3 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.627936:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbabdc3 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000100:00100000:0.0:1762166979.627954:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5765c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+539:2419:x1847765450593920:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 180us (300us total) trans 0 rc 0/0 00000004:00200000:1.0:1762166979.627959:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 204311 00000100:00100000:0.0:1762166979.627964:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9697 00010000:00010000:1.0:1762166979.628086:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbabdbc lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea349 expref: 540 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.628103:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbabdc3 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea349 expref: 539 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.628112:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:1.0:1762166979.628115:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1762166979.628117:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355a600, rc 0) 00000100:00100000:1.0:1762166979.628156:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+539:61766:x1847765450593792:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 2510us (2797us total) trans 4294992294 rc 0/0 00000100:00100000:1.0:1762166979.628163:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30657 00000100:00100000:3.0:1762166979.631010:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166979.631069:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450594048 00000100:00100000:1.0:1762166979.631079:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450594048 00000100:00100000:1.0:1762166979.631143:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30658 00000100:00100000:1.0:1762166979.631153:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5765180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+539:61766:x1847765450594048:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:1.0:1762166979.631178:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166979.631196:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbabdd1 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea350 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.631300:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbabdd8 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166979.631317:0:6495:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbabdc3 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea349 expref: 540 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.631326:0:6495:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbabdd8 lrc: 4/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.631357:0:6495:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbabdc3 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea349 expref: 540 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.631371:0:6495:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbabdc3 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea349 expref: 540 pid: 6495 timeout: 698 lvb_type: 0 00000100:00100000:1.0:1762166979.631385:0:6495:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bc0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6495:1847765449753088:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166979.631460:0:6495:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc4076900 going to sleep for 11 seconds 00000100:00100000:1.0:1762166979.632650:0:6495:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bc0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6495:1847765449753088:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166979.632675:0:6495:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbabdd8 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000100:00100000:3.0:1762166979.633145:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.633277:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450594176 00000100:00100000:0.0:1762166979.633287:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450594176 00010000:00010000:0.0:1762166979.633342:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbabdc3 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea349 expref: 541 pid: 6495 timeout: 698 lvb_type: 0 00000100:00100000:0.0:1762166979.633381:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9698 00000100:00100000:0.0:1762166979.633392:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5764000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+541:2419:x1847765450594176:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166979.633420:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166979.633427:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbabdc3 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea349 expref: 541 pid: 6495 timeout: 698 lvb_type: 0 00010000:00010000:0.0:1762166979.633441:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbabdc3 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea349 expref: 541 pid: 6495 timeout: 698 lvb_type: 0 00010000:00010000:0.0:1762166979.633468:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbabdc3 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea349 expref: 541 pid: 6495 timeout: 698 lvb_type: 0 00010000:00010000:0.0:1762166979.633518:0:7421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:0.0:1762166979.633524:0:7421:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbabdd8 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166979.633537:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbabdd8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166979.633546:0:7421:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbabdd8 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 00010000:00010000:0.0:1762166979.633578:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166979.633598:0:6495:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbabdd8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.633610:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbabdd8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000100:00100000:0.0:1762166979.633651:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5764000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+540:2419:x1847765450594176:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 257us (511us total) trans 0 rc 0/0 00000004:00200000:1.0:1762166979.633655:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 204311 00000004:00200000:1.0:1762166979.633662:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:0.0:1762166979.633669:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9698 00000004:00010000:1.0:1762166979.633686:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbabdd8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.633727:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbabdd1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea350 expref: 540 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.633747:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbabdd8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea350 expref: 539 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.633756:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:1.0:1762166979.633759:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166979.633761:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355bc00, rc 0) 00000100:00100000:1.0:1762166979.633812:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5765180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+539:61766:x1847765450594048:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 2661us (2812us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166979.633822:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30658 00000100:00100000:3.0:1762166979.634917:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166979.634981:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.635026:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450594304 00000100:00100000:0.0:1762166979.635033:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450594304 00000100:00100000:0.0:1762166979.635074:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450594432 00000100:00100000:0.0:1762166979.635078:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450594432 00000100:00100000:0.0:1762166979.635111:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19193 00000100:00100000:0.0:1762166979.635124:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5767800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+17:2416:x1847765450594304:12345-192.168.204.38@tcp:101:fsx.0 00000100:00100000:1.0:1762166979.635130:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19194 00010000:00010000:0.0:1762166979.635145:0:9165:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1762166979.635146:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5765880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+21:2417:x1847765450594432:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:1.0:1762166979.635160:0:35248:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166979.635171:0:9165:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf400/0x2f180c4effbabddf lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea357 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.635175:0:35248:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cc355b600/0x2f180c4effbabde6 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea35e expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166979.635207:0:9165:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa8e:0x0] initial LVB size: 204311, mtime: 0x690888c3, atime: 0x690888c3, ctime: 0x690888c3, blocks: 0x30 00010000:00010000:0.0:1762166979.635224:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166979.635226:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166979.635236:0:9165:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf400/0x2f180c4effbabddf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea357 expref: 18 pid: 9165 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1762166979.635245:0:35248:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bc0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:35248:1847765449753216:192.168.204.38@tcp:106: 00010000:00010000:0.0:1762166979.635257:0:9165:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf400/0x2f180c4effbabddf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea357 expref: 18 pid: 9165 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166979.635271:0:9165:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdf400, rc 0) 00000100:00100000:1.0:1762166979.635336:0:35248:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc4076900 going to sleep for 11 seconds 00000100:00100000:0.0:1762166979.635530:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5767800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+18:2416:x1847765450594304:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 410us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166979.635539:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19193 00000100:00100000:1.0:1762166979.636346:0:35248:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bc0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:35248:1847765449753216:192.168.204.38@tcp:106: 00010000:00010000:1.0:1762166979.636371:0:35248:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945cc355b600/0x2f180c4effbabde6 lrc: 1/0,0 mode: --/PR res: [0x2c0000400:0xa8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea35e expref: 22 pid: 35248 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166979.636388:0:35248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cc355b600/0x2f180c4effbabde6 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea35e expref: 22 pid: 35248 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166979.636396:0:35248:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355b600, rc 0) 00000100:00100000:1.0:1762166979.636428:0:35248:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5765880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+21:2417:x1847765450594432:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 1289us (1447us total) trans 0 rc 301/301 00000100:00100000:1.0:1762166979.636433:0:35248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19194 00000100:00100000:3.0:1762166979.638330:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.638395:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450594688 00000100:00100000:0.0:1762166979.638407:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450594688 00000100:00100000:0.0:1762166979.638475:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11919 00000100:00100000:0.0:1762166979.638535:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7be3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+539:61766:x1847765450594688:12345-192.168.204.38@tcp:35:fsx.0 00000100:00100000:0.0:1762166979.638834:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7be3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+540:61766:x1847765450594688:12345-192.168.204.38@tcp:35:fsx.0 Request processed in 307us (514us total) trans 4294992295 rc 0/0 00000100:00100000:0.0:1762166979.638852:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11919 00000100:00100000:3.0:1762166979.640169:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166979.640226:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450594944 00000100:00100000:1.0:1762166979.640239:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450594944 00000100:00100000:1.0:1762166979.640317:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30659 00000100:00100000:1.0:1762166979.640340:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5589880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+540:61766:x1847765450594944:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:1.0:1762166979.640387:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166979.640392:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 1 00010000:00010000:1.0:1762166979.640425:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbabdd8 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea350 expref: 540 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.640451:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a000/0x2f180c4effbabd8b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea33b expref: 539 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.640466:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9400/0x2f180c4effbabd5a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea32d expref: 538 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.640498:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:1.0:1762166979.640504:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166979.640518:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbabded lrc: 2/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea365 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.640566:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbabdf4 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166979.640578:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbabdf4 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.640587:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbabdf4 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000040:00080000:1.0:1762166979.640853:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5918, 88 off463512 00000004:00080000:1.0:1762166979.640861:0:6495:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 598789383045ns, next at 598687976533ns, rc = 0 00000040:00080000:1.0:1762166979.640907:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5917, 88 off463512 00000004:00080000:1.0:1762166979.640912:0:6495:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 598789434515ns, next at 598688050423ns, rc = 0 00000040:00080000:1.0:1762166979.640938:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5918, 88 off463600 00000004:00080000:1.0:1762166979.640942:0:6495:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 598789464415ns, next at 598688050423ns, rc = 0 00000040:00080000:1.0:1762166979.640960:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5919, 88 off463600 00000004:00080000:1.0:1762166979.640964:0:6495:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 598789485729ns, next at 598687976533ns, rc = 0 00000040:00080000:1.0:1762166979.640979:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5919, 88 off463688 00000004:00080000:1.0:1762166979.640984:0:6495:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 598789505995ns, next at 598688050423ns, rc = 0 00000040:00080000:1.0:1762166979.640992:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5920, 88 off463688 00000004:00080000:1.0:1762166979.640998:0:6495:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 598789518452ns, next at 598687976533ns, rc = 0 00000001:00080000:2.0:1762166979.642700:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294992296 is committed 00000004:00080000:2.0:1762166979.642711:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3279 committed 00000004:00080000:2.0:1762166979.642731:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3282 committed 00010000:00010000:1.0:1762166979.642733:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbabd37 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x615:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.642744:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbabd37 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x615:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00000004:00080000:2.0:1762166979.642748:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3278 committed 00000004:00080000:2.0:1762166979.642753:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3281 committed 00010000:00010000:1.0:1762166979.642754:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbabd37 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x615:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00000004:00080000:2.0:1762166979.642759:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3280 committed 00000004:00080000:2.0:1762166979.642764:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3277 committed 00010000:00010000:1.0:1762166979.642772:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355ae00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166979.642777:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbabd37 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x615:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.642786:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbabd37 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x615:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00000020:00080000:2.0:1762166979.642790:0:7412:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff945cc7c77cc0 refcount 2 committed 0 result 0 batchid 57 00000020:00080000:2.0:1762166979.642796:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945bc49ab400 obd lustre-OST0001-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff945cf1c8d6c0 00000020:00080000:2.0:1762166979.642799:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945bc49aba00 obd lustre-OST0000-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff945cc7c77780 00000020:00080000:2.0:1762166979.642802:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945bc49ab200 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff945bc8098200 00010000:00010000:1.0:1762166979.642803:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x615:0x0].0x0 (ffff945bc809b600) 00000020:00080000:2.0:1762166979.642807:0:7412:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000400:0x2:0x0].56 00010000:00010000:1.0:1762166979.642808:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166979.642815:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbabd37 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x615:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.642823:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbabd37 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x615:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000020:00080000:2.0:1762166979.642828:0:7412:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0001: 56 batchid updated 00010000:00010000:1.0:1762166979.642858:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbabd45 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.642866:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbabd45 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.642872:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbabd45 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.642878:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa8000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166979.642882:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbabd45 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00000100:00100000:2.0:1762166979.642884:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:1.0:1762166979.642890:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbabd45 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00000100:00100000:2.0:1762166979.642906:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449753600:0@lo:2:osp-syn-1-1.0 00010000:00010000:1.0:1762166979.642910:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:1.0:1762166979.642914:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166979.642918:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbabd45 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000100:00100000:3.0:1762166979.642926:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449753344:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1762166979.642927:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbabd45 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000100:00100000:3.0:1762166979.642984:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1762166979.642984:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbabdf4 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea365 expref: 525 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.642997:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:1.0:1762166979.642999:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1762166979.643012:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbabded lrc: 0/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea365 expref: 525 pid: 6495 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1762166979.643027:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbabdf4 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea365 expref: 524 pid: 6495 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166979.643035:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1762166979.643042:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449753728:0@lo:2:osp-syn-1-1.0 00010000:00010000:1.0:1762166979.643054:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:1.0:1762166979.643058:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1762166979.643061:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355a200, rc 0) 00000100:00100000:3.0:1762166979.643066:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166979.643128:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5589880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+524:61766:x1847765450594944:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 2791us (2970us total) trans 4294992296 rc 0/0 00000100:00100000:1.0:1762166979.643138:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30659 00000020:00080000:0.0:1762166979.643264:0:7435:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 57 committed batchid 56 00000020:00080000:0.0:1762166979.643361:0:7435:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 56 cancel update log [0x240000400:0x2:0x0].55: rc = 0 00000020:00080000:0.0:1762166979.643369:0:7435:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 56 00000100:00100000:3.0:1762166979.643447:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449753856:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1762166979.643503:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bccb7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449754240:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166979.643513:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166979.643525:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449753984:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1762166979.643541:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166979.643566:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166979.643571:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449753344 00000100:00100000:3.0:1762166979.643579:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449753344 00000100:00100000:1.0:1762166979.643585:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449753728 00000100:00100000:1.0:1762166979.643590:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449753728 00000100:00100000:0.0:1762166979.643597:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1762166979.643606:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449754112:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166979.643621:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449753856 00000100:00100000:3.0:1762166979.643627:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449753856 00000100:00100000:1.0:1762166979.643633:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449754240 00000100:00100000:1.0:1762166979.643638:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449754240 00000100:00100000:3.0:1762166979.643652:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449753984 00000100:00100000:3.0:1762166979.643656:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449753984 00000100:00100000:1.0:1762166979.643667:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19195 00000100:00100000:1.0:1762166979.643682:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+7:3636:x1847765449753344:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1762166979.643705:0:35247:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:2700 count 1 00000100:00100000:3.0:1762166979.643710:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19196 00000100:00100000:3.0:1762166979.643722:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+7:3636:x1847765449753728:12345-0@lo:2:osp-syn-1-1.0 00010000:00010000:1.0:1762166979.643728:0:35247:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945cc355ac00/0x2f180c4effbabdfb lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.643745:0:35247:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbaba89 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->20479) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea238 expref: 20 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.643754:0:35247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166979.643756:0:35247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166979.643760:0:35247:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355ac00/0x2f180c4effbabdfb lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.643785:0:35247:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbaba89 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->20479) gid 0 flags: 0x50000000030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea238 expref: 20 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.643797:0:35247:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbaba89 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->20479) gid 0 flags: 0x70000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea238 expref: 20 pid: 28434 timeout: 698 lvb_type: 0 00000100:00100000:1.0:1762166979.643810:0:35247:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bc3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:35247:1847765449754368:192.168.204.38@tcp:104: 00002000:00010000:3.0:1762166979.643832:0:9165:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa8d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166979.643847:0:9165:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa8d:0x0] updating lvb mtime from disk: 1762166979 -> 1762166979 00002000:00010000:3.0:1762166979.643851:0:9165:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa8d:0x0] updating lvb atime from disk: 1762166979 -> 1762166979 00002000:00010000:3.0:1762166979.643854:0:9165:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa8d:0x0] updating lvb ctime from disk: 1762166979 -> 1762166979 00002000:00010000:3.0:1762166979.643856:0:9165:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa8d:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1762166979.643867:0:35247:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc4076900 going to sleep for 11 seconds 00000100:00100000:1.0:1762166979.643886:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19197 00000100:00100000:0.0:1762166979.643898:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166979.643899:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+8:3636:x1847765449753856:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1762166979.643910:0:35248:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449754112 00000100:00100000:3.0:1762166979.643915:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+8:3636:x1847765449753728:12345-0@lo:2:osp-syn-1-1.0 Request processed in 185us (840us total) trans 17179876540 rc 0/0 00000100:00100000:2.0:1762166979.643915:0:35248:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449754112 00002000:00080000:1.0:1762166979.643917:0:8382:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:2701 count 1 00000100:00100000:3.0:1762166979.643929:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19196 00010000:00010000:1.0:1762166979.643936:0:8382:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945cc355a600/0x2f180c4effbabe02 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166979.643939:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19198 00000100:00100000:3.0:1762166979.643950:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19199 00000100:00100000:2.0:1762166979.643956:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19200 00010000:00010000:1.0:1762166979.643956:0:8382:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfa00/0x2f180c4effbab94e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1ba expref: 17 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166979.643956:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+9:3635:x1847765449754240:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166979.643963:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+9:3633:x1847765449753984:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1762166979.643972:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+9:3633:x1847765449754112:12345-0@lo:2:osp-syn-0-1.0 00010000:00010000:1.0:1762166979.643976:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166979.643979:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166979.643982:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cc355a600/0x2f180c4effbabe02 lrc: 4/0,1 mode: --/PW res: [0x280000400:0xa8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.644004:0:8382:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfa00/0x2f180c4effbab94e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1ba expref: 17 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.644015:0:8382:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfa00/0x2f180c4effbab94e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1ba expref: 17 pid: 28874 timeout: 698 lvb_type: 0 00000100:00100000:1.0:1762166979.644027:0:8382:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bc1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8382:1847765449754496:192.168.204.38@tcp:104: 00002000:00010000:3.0:1762166979.644047:0:9165:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166979.644051:0:9165:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb mtime from disk: 1762166966 -> 1762166966 00000100:00100000:1.0:1762166979.644053:0:8382:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc4076780 going to sleep for 11 seconds 00002000:00010000:3.0:1762166979.644054:0:9165:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1762166979.644054:0:28874:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa8e:0x0] updating lvb size from disk: 204311 -> 204311 00002000:00010000:2.0:1762166979.644057:0:35248:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166979.644061:0:9165:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb ctime from disk: 1762166966 -> 1762166966 00002000:00010000:2.0:1762166979.644062:0:35248:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166979 -> 1762166979 00002000:00010000:0.0:1762166979.644062:0:28874:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa8e:0x0] updating lvb mtime from disk: 1762166979 -> 1762166979 00002000:00010000:3.0:1762166979.644067:0:9165:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:2.0:1762166979.644068:0:35248:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166979 -> 1762166979 00002000:00010000:0.0:1762166979.644068:0:28874:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa8e:0x0] updating lvb atime from disk: 1762166979 -> 1762166979 00002000:00010000:2.0:1762166979.644073:0:35248:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166979 -> 1762166979 00002000:00010000:0.0:1762166979.644073:0:28874:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa8e:0x0] updating lvb ctime from disk: 1762166979 -> 1762166979 00002000:00010000:2.0:1762166979.644075:0:35248:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00002000:00010000:0.0:1762166979.644076:0:28874:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa8e:0x0] updating lvb blocks from disk: 48 -> 48 00000100:00100000:3.0:1762166979.644110:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+12:3633:x1847765449753984:12345-0@lo:2:osp-syn-0-1.0 Request processed in 152us (545us total) trans 21474843379 rc 0/0 00000100:00100000:2.0:1762166979.644118:0:35248:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+12:3633:x1847765449754112:12345-0@lo:2:osp-syn-0-1.0 Request processed in 150us (224us total) trans 21474843380 rc 0/0 00000100:00100000:3.0:1762166979.644121:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19199 00000100:00100000:0.0:1762166979.644122:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+12:3635:x1847765449754240:12345-0@lo:2:osp-syn-0-1.0 Request processed in 170us (580us total) trans 21474843378 rc 0/0 00000100:00100000:2.0:1762166979.644128:0:35248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19200 00000100:00100000:0.0:1762166979.644133:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19198 00000100:00100000:2.0:1762166979.644171:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1762166979.644186:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bccb7f100/2, rc 0, transno 21474843378 00000004:00080000:3.0:1762166979.644188:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf79e8380/2, rc 0, transno 17179876540 00000100:00100000:0.0:1762166979.644193:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bccb7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449754240:0@lo:2:osp-syn-0-1.0 00000004:00080000:1.0:1762166979.644194:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf1cd1f80/2, rc 0, transno 21474843380 00000100:00100000:3.0:1762166979.644196:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449753728:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1762166979.644201:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449753472:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1762166979.644205:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449754112:0@lo:2:osp-syn-0-1.0 00000004:00080000:1.0:1762166979.644220:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf1cd0700/2, rc 0, transno 21474843379 00000100:00100000:1.0:1762166979.644224:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449753984:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1762166979.644233:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166979.644263:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449753600 00000100:00100000:3.0:1762166979.644267:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449753600 00000100:00100000:2.0:1762166979.644283:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449753472 00000100:00100000:2.0:1762166979.644288:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449753472 00000100:00100000:3.0:1762166979.644306:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19201 00000100:00100000:3.0:1762166979.644315:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+9:3634:x1847765449753600:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1762166979.644326:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19202 00000100:00100000:2.0:1762166979.644339:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+9:3634:x1847765449753472:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:3.0:1762166979.644375:0:8380:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166979.644378:0:8380:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166979 -> 1762166979 00002000:00010000:3.0:1762166979.644381:0:8380:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166979 -> 1762166979 00002000:00010000:3.0:1762166979.644383:0:8380:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166979 -> 1762166979 00002000:00010000:3.0:1762166979.644385:0:8380:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:2.0:1762166979.644411:0:8383:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 204311 -> 204311 00002000:00010000:2.0:1762166979.644415:0:8383:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166979 -> 1762166979 00002000:00010000:2.0:1762166979.644418:0:8383:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166979 -> 1762166979 00002000:00010000:2.0:1762166979.644421:0:8383:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166979 -> 1762166979 00002000:00010000:2.0:1762166979.644424:0:8383:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 120 -> 120 00000100:00100000:3.0:1762166979.644427:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+11:3634:x1847765449753600:12345-0@lo:2:osp-syn-1-1.0 Request processed in 112us (253us total) trans 17179876541 rc 0/0 00000100:00100000:3.0:1762166979.644437:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19201 00000100:00100000:2.0:1762166979.644515:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+10:3634:x1847765449753472:12345-0@lo:2:osp-syn-1-1.0 Request processed in 175us (279us total) trans 17179876542 rc 0/0 00000100:00100000:2.0:1762166979.644523:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19202 00000004:00080000:0.0:1762166979.644534:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf79eb100/2, rc 0, transno 17179876541 00000100:00100000:0.0:1762166979.644550:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449753600:0@lo:2:osp-syn-1-1.0 00000004:00080000:0.0:1762166979.644566:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf79e8a80/2, rc 0, transno 17179876542 00000100:00100000:0.0:1762166979.644570:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449753472:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166979.645125:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.645190:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450595072 00000100:00100000:2.0:1762166979.645198:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450595072 00000100:00100000:2.0:1762166979.645265:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19203 00000100:00100000:2.0:1762166979.645277:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:61766:x1847765450595072:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:2.0:1762166979.645289:0:8383:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1762166979.645299:0:8382:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bc1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8382:1847765449754496:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166979.645302:0:8383:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbabe09 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea36c expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.645327:0:8383:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc8473a00/0x2f180c4effbabcb9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea2fc expref: 22 pid: 8380 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166979.645329:0:8382:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945cc355a600/0x2f180c4effbabe02 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.645356:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166979.645359:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166979.645366:0:8383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbabe09 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [139264->167935] (req 139264->167935) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea36c expref: 22 pid: 8383 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166979.645371:0:35247:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bc3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:35247:1847765449754368:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166979.645412:0:35247:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945cc355ac00/0x2f180c4effbabdfb lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.645415:0:8383:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc8473a00/0x2f180c4effbabcb9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea2fc expref: 22 pid: 8380 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166979.645460:0:8383:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc8473a00/0x2f180c4effbabcb9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea2fc expref: 22 pid: 8380 timeout: 698 lvb_type: 1 00000100:00100000:2.0:1762166979.645519:0:8383:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8383:1847765449754624:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166979.645597:0:8383:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1dce9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166979.645647:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.645720:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450595200 00000100:00100000:0.0:1762166979.645727:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450595200 00010000:00010000:0.0:1762166979.645766:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfa00/0x2f180c4effbab94e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1ba expref: 18 pid: 28874 timeout: 698 lvb_type: 0 00000100:00100000:0.0:1762166979.645803:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9699 00000100:00100000:0.0:1762166979.645815:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450595200:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166979.645830:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166979.645848:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfa00/0x2f180c4effbab94e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1ba expref: 18 pid: 28874 timeout: 698 lvb_type: 0 00010000:00010000:0.0:1762166979.645861:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfa00/0x2f180c4effbab94e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1ba expref: 18 pid: 28874 timeout: 698 lvb_type: 0 00010000:00010000:0.0:1762166979.645886:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfa00/0x2f180c4effbab94e lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea1ba expref: 18 pid: 28874 timeout: 698 lvb_type: 0 00010000:00010000:0.0:1762166979.645902:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166979.645904:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166979.645909:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945cc355a600/0x2f180c4effbabe02 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.645920:0:7421:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cc355a600/0x2f180c4effbabe02 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.645948:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166979.645980:0:8382:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945cc355a600/0x2f180c4effbabe02 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166979.645996:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450595200:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 179us (347us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166979.646022:0:8382:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cc355a600/0x2f180c4effbabe02 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166979.646025:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9699 00010000:00010000:1.0:1762166979.646041:0:8382:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945cc355a600/0x2f180c4effbabe02 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.646050:0:8382:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945cc355a600/0x2f180c4effbabe02 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.646079:0:8382:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1762166979.646114:0:6483:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1762166979.646134:0:6483:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945cc355a600/0x2f180c4effbabe02 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.646147:0:6483:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355a600 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166979.646153:0:6483:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945cc355a600/0x2f180c4effbabe02 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.646164:0:6483:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945cc355a600/0x2f180c4effbabe02 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.646181:0:6483:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945cc355a600/0x2f180c4effbabe02 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.646188:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cc355a600/0x2f180c4effbabe02 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.646215:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166979.646218:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166979.646224:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1762166979.646250:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.646285:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450595328 00000100:00100000:0.0:1762166979.646292:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450595328 00010000:00010000:0.0:1762166979.646317:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbaba89 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->20479) gid 0 flags: 0x60000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea238 expref: 23 pid: 28434 timeout: 698 lvb_type: 0 00000100:00100000:0.0:1762166979.646360:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9700 00000100:00100000:0.0:1762166979.646371:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7c32050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765450595328:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166979.646380:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166979.646385:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbaba89 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 16384->20479) gid 0 flags: 0x60000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea238 expref: 23 pid: 28434 timeout: 698 lvb_type: 0 00010000:00010000:0.0:1762166979.646399:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbaba89 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 16384->20479) gid 0 flags: 0x50000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea238 expref: 23 pid: 28434 timeout: 698 lvb_type: 0 00000100:00100000:1.0:1762166979.646412:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+10:3636:x1847765449753856:12345-0@lo:6:osp-syn-0-1.0 Request processed in 2512us (2893us total) trans 21474843381 rc 0/0 00010000:00010000:0.0:1762166979.646422:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbaba89 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 16384->20479) gid 0 flags: 0x44801400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea238 expref: 23 pid: 28434 timeout: 698 lvb_type: 0 00000100:00100000:1.0:1762166979.646429:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19197 00010000:00010000:0.0:1762166979.646447:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166979.646450:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166979.646453:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945cc355ac00/0x2f180c4effbabdfb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.646461:0:7421:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355ac00/0x2f180c4effbabdfb lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.646527:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00080000:2.0:1762166979.646560:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf1cd0e00/2, rc 0, transno 21474843381 00000100:00100000:2.0:1762166979.646571:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449753856:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1762166979.646586:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7c32050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765450595328:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 201us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166979.646597:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9700 00010000:00010000:1.0:1762166979.646681:0:35247:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945cc355ac00/0x2f180c4effbabdfb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.646692:0:35247:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cc355ac00/0x2f180c4effbabdfb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.646699:0:35247:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945cc355ac00/0x2f180c4effbabdfb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.646706:0:35247:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355ac00/0x2f180c4effbabdfb lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.646730:0:35247:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1762166979.646850:0:8383:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8383:1847765449754624:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166979.646885:0:8383:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbabe09 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [139264->167935] (req 139264->167935) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea36c expref: 21 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.646907:0:8383:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa9000, rc 0) 00000100:00100000:0.0:1762166979.646954:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:61766:x1847765450595072:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 1681us (1888us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166979.646966:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19203 00010000:00010000:2.0:1762166979.647233:0:10256:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166979.647242:0:10256:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945cc355ac00/0x2f180c4effbabdfb lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.647251:0:10256:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355ac00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166979.647256:0:10256:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc355ac00/0x2f180c4effbabdfb lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.647265:0:10256:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc355ac00/0x2f180c4effbabdfb lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.647300:0:10256:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945cc355ac00/0x2f180c4effbabdfb lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.647310:0:10256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cc355ac00/0x2f180c4effbabdfb lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166979.647330:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:2.0:1762166979.647342:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166979.647348:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166979.647355:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166979.647366:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450595456 00000100:00100000:0.0:1762166979.647373:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450595456 00010000:00010000:0.0:1762166979.647395:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8473a00/0x2f180c4effbabcb9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea2fc expref: 21 pid: 8380 timeout: 698 lvb_type: 1 00000100:00100000:0.0:1762166979.647423:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9701 00000100:00100000:0.0:1762166979.647432:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce77480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450595456:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166979.647442:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166979.647463:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc8473a00/0x2f180c4effbabcb9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea2fc expref: 21 pid: 8380 timeout: 698 lvb_type: 1 00010000:00010000:0.0:1762166979.647475:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc8473a00/0x2f180c4effbabcb9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea2fc expref: 21 pid: 8380 timeout: 698 lvb_type: 1 00010000:00010000:0.0:1762166979.647531:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8473a00/0x2f180c4effbabcb9 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea2fc expref: 21 pid: 8380 timeout: 698 lvb_type: 1 00010000:00010000:0.0:1762166979.647545:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166979.647548:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166979.647556:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbabe09 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 139264->167935) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea36c expref: 20 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.647570:0:7421:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbabe09 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 139264->167935) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea36c expref: 20 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.647610:0:7421:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbabe09 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 139264->167935) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea36c expref: 20 pid: 8383 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166979.647626:0:7421:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcce75f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7421:1847765449754752:192.168.204.38@tcp:105: 00000100:00100000:0.0:1762166979.647700:0:7421:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc63999c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166979.647723:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+10:3636:x1847765449753344:12345-0@lo:6:osp-syn-1-1.0 Request processed in 4043us (4737us total) trans 17179876543 rc 0/0 00000100:00100000:1.0:1762166979.647735:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19195 00000004:00080000:2.0:1762166979.647832:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf79ead80/2, rc 0, transno 17179876543 00000100:00100000:2.0:1762166979.647850:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449753344:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1762166979.649473:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.649581:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450595584 00000100:00100000:2.0:1762166979.649592:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450595584 00000100:00100000:0.0:1762166979.649661:0:7421:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcce75f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7421:1847765449754752:192.168.204.38@tcp:105: 00000100:00100000:2.0:1762166979.649674:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2502 00010000:00010000:0.0:1762166979.649690:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166979.649701:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450595584:12345-192.168.204.38@tcp:22:fsx.0 00000100:00100000:0.0:1762166979.649735:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce77480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450595456:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 2302us (2407us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166979.649747:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9701 00002000:00010000:2.0:1762166979.649986:0:14623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 204311 -> 204311 00002000:00010000:2.0:1762166979.649991:0:14623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166979 -> 1762166979 00002000:00010000:2.0:1762166979.649994:0:14623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166979 -> 1762166979 00002000:00010000:2.0:1762166979.649996:0:14623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166979 -> 1762166979 00002000:00010000:2.0:1762166979.649998:0:14623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 120 -> 96 00000100:00100000:2.0:1762166979.650057:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450595584:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 372us (590us total) trans 17179876544 rc 0/0 00000100:00100000:2.0:1762166979.650064:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2502 00000100:00100000:3.0:1762166979.651163:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166979.651219:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450595712 00000100:00100000:1.0:1762166979.651228:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450595712 00000100:00100000:1.0:1762166979.651275:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30660 00000100:00100000:1.0:1762166979.651287:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+524:61766:x1847765450595712:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:1.0:1762166979.651313:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166979.651343:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbabe10 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea373 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.651499:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbabe17 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166979.651520:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbabe17 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.651535:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbabe17 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:1.0:1762166979.651568:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 204311 00000004:00200000:1.0:1762166979.651574:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166979.651595:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbabe17 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.651621:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbabe10 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea373 expref: 526 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.651638:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbabe17 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea373 expref: 525 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.651653:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:1.0:1762166979.651657:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166979.651660:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355ae00, rc 0) 00000100:00100000:1.0:1762166979.651702:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+525:61766:x1847765450595712:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 419us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166979.651710:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30660 00000100:00100000:0.0:1762166979.654517:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.654591:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450595840 00000100:00100000:2.0:1762166979.654611:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450595840 00000100:00100000:2.0:1762166979.654697:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2503 00000100:00100000:2.0:1762166979.654710:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450595840:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:2.0:1762166979.654996:0:14623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 204311 -> 204311 00002000:00010000:2.0:1762166979.655001:0:14623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166979 -> 1762166979 00002000:00010000:2.0:1762166979.655003:0:14623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166979 -> 1762166979 00002000:00010000:2.0:1762166979.655006:0:14623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166979 -> 1762166979 00002000:00010000:2.0:1762166979.655009:0:14623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 96 -> 96 00000100:00100000:2.0:1762166979.655093:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450595840:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 385us (620us total) trans 17179876545 rc 0/0 00000100:00100000:2.0:1762166979.655105:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2503 00000100:00100000:3.0:1762166979.656969:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166979.657028:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450595968 00000100:00100000:1.0:1762166979.657037:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450595968 00000100:00100000:1.0:1762166979.657094:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30661 00000100:00100000:1.0:1762166979.657102:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5807100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+525:61766:x1847765450595968:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:1.0:1762166979.657121:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166979.657139:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a000/0x2f180c4effbabe1e lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea37a expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.657173:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbabe25 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166979.657192:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbabe25 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.657204:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbabe25 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.657346:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a000/0x2f180c4effbabe1e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea37a expref: 527 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.657364:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbabe25 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea37a expref: 526 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.657377:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:1.0:1762166979.657380:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1762166979.657384:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355bc00, rc 0) 00000100:00100000:1.0:1762166979.657441:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5807100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+526:61766:x1847765450595968:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 339us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166979.657449:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30661 00000100:00100000:3.0:1762166979.659071:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166979.659664:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450596224 00000100:00100000:1.0:1762166979.659676:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450596224 00000100:00100000:1.0:1762166979.659747:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30662 00000100:00100000:1.0:1762166979.659758:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+526:61766:x1847765450596224:12345-192.168.204.38@tcp:36:fsx.0 00010000:00010000:1.0:1762166979.659811:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1762166979.659849:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbabe17 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea373 expref: 526 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.659874:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbabdf4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea365 expref: 525 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.659884:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:1.0:1762166979.659889:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166979.660085:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbabe2c lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166979.660099:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbabe2c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.660108:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbabe2c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000001:00080000:1.0:1762166979.660155:0:6495:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992297 00000004:00010000:1.0:1762166979.660182:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000097915802 reply state 00000000f3dc930f transno 4294992298 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbabe2c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.660193:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbabe2c lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.660199:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:1.0:1762166979.660202:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166979.660205:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166979.660292:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+527:61766:x1847765450596224:12345-192.168.204.38@tcp:36:fsx.0 Request processed in 536us (1230us total) trans 4294992298 rc 0/0 00000100:00100000:1.0:1762166979.660300:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30662 00000020:00080000:1.0:1762166979.660305:0:6495:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1762166979.661977:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166979.662073:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450596352 00000100:00100000:1.0:1762166979.662084:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450596352 00000100:00100000:1.0:1762166979.662148:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30663 00000100:00100000:1.0:1762166979.662159:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+527:61766:x1847765450596352:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:1.0:1762166979.662189:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166979.662210:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbabe33 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea381 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.662273:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbabe33 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea381 expref: 528 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.662287:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbabe33 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea381 expref: 528 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.662307:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:1.0:1762166979.662312:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166979.662316:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355ba00, rc 0) 00000100:00100000:1.0:1762166979.662383:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+528:61766:x1847765450596352:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 225us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166979.662392:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30663 00000100:00100000:3.0:1762166979.663928:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166979.663992:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450596480 00000100:00100000:1.0:1762166979.664001:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450596480 00000100:00100000:1.0:1762166979.664053:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19204 00000100:00100000:1.0:1762166979.664064:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+17:61766:x1847765450596480:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:1.0:1762166979.664080:0:35247:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166979.664097:0:35247:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cc355b800/0x2f180c4effbabe3a lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea388 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.664127:0:35247:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945cc355aa00/0x2f180c4effbabcc0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea303 expref: 18 pid: 35248 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166979.664137:0:35247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166979.664140:0:35247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166979.664145:0:35247:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cc355b800/0x2f180c4effbabe3a lrc: 4/0,0 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea388 expref: 18 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.664186:0:35247:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945cc355aa00/0x2f180c4effbabcc0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea303 expref: 18 pid: 35248 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166979.664202:0:35247:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945cc355aa00/0x2f180c4effbabcc0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea303 expref: 18 pid: 35248 timeout: 698 lvb_type: 1 00000100:00100000:1.0:1762166979.664218:0:35247:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bc1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:35247:1847765449754880:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166979.664318:0:35247:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc4076000 going to sleep for 11 seconds 00000100:00100000:3.0:1762166979.665912:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.665996:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450596608 00000100:00100000:0.0:1762166979.666008:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450596608 00010000:00010000:0.0:1762166979.666049:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945cc355aa00/0x2f180c4effbabcc0 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea303 expref: 19 pid: 35248 timeout: 698 lvb_type: 1 00000100:00100000:0.0:1762166979.666090:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9702 00000100:00100000:0.0:1762166979.666100:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b20e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450596608:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166979.666115:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166979.666147:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945cc355aa00/0x2f180c4effbabcc0 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea303 expref: 19 pid: 35248 timeout: 698 lvb_type: 1 00010000:00010000:0.0:1762166979.666163:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945cc355aa00/0x2f180c4effbabcc0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea303 expref: 19 pid: 35248 timeout: 698 lvb_type: 1 00010000:00010000:0.0:1762166979.666192:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166979.666194:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166979.666202:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945cc355b800/0x2f180c4effbabe3a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea388 expref: 19 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.666213:0:7421:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cc355b800/0x2f180c4effbabe3a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea388 expref: 19 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.666251:0:7421:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff945cc355b800/0x2f180c4effbabe3a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea388 expref: 19 pid: 35247 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166979.666265:0:7421:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5765c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7421:1847765449755008:192.168.204.38@tcp:105: 00000100:00100000:0.0:1762166979.666351:0:7421:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc63999c0 going to sleep for 11 seconds 00010000:00010000:1.0:1762166979.666463:0:35247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cc355aa00/0x2f180c4effbabcc0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea303 expref: 19 pid: 35248 timeout: 698 lvb_type: 1 00000100:00100000:1.0:1762166979.666516:0:35247:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bc1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:35247:1847765449754880:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166979.666548:0:35247:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945cc355b800/0x2f180c4effbabe3a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea388 expref: 18 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.666564:0:35247:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355b800, rc 0) 00000100:00100000:1.0:1762166979.666621:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+18:61766:x1847765450596480:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 2559us (2697us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166979.666631:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19204 00000100:00100000:0.0:1762166979.667864:0:7421:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5765c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7421:1847765449755008:192.168.204.38@tcp:105: 00000100:00100000:3.0:1762166979.667881:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:0.0:1762166979.667898:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166979.668022:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450596736 00000100:00100000:2.0:1762166979.668032:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450596736 00000100:00100000:0.0:1762166979.668039:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b20e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450596608:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1934us (2131us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166979.668055:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9702 00000100:00100000:0.0:1762166979.668132:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19205 00000100:00100000:0.0:1762166979.668160:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+22:61766:x1847765450596736:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:0.0:1762166979.668185:0:8383:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166979.668208:0:8383:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbabe41 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea38f expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.668239:0:8383:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbabcc7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea30a expref: 23 pid: 35247 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166979.668248:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166979.668250:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166979.668254:0:8383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbabe41 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea38f expref: 23 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.668288:0:8383:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbabcc7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea30a expref: 23 pid: 35247 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166979.668306:0:8383:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbabcc7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea30a expref: 23 pid: 35247 timeout: 698 lvb_type: 1 00000100:00100000:0.0:1762166979.668326:0:8383:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5765c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8383:1847765449755136:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166979.668397:0:8383:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc63999c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166979.669820:0:8383:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5765c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8383:1847765449755136:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166979.669850:0:8383:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbabe41 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea38f expref: 23 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.669868:0:8383:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdfa00, rc 0) 00000100:00100000:0.0:1762166979.669939:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+23:61766:x1847765450596736:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 1795us (2069us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166979.669949:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19205 00000100:00100000:3.0:1762166979.670374:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.670422:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450596864 00000100:00100000:0.0:1762166979.670430:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450596864 00010000:00010000:0.0:1762166979.670461:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbabcc7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea30a expref: 23 pid: 35247 timeout: 698 lvb_type: 1 00000100:00100000:0.0:1762166979.670543:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9703 00000100:00100000:0.0:1762166979.670561:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a29880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765450596864:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166979.670584:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166979.670609:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbabcc7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea30a expref: 23 pid: 35247 timeout: 698 lvb_type: 1 00010000:00010000:0.0:1762166979.670626:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbabcc7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea30a expref: 23 pid: 35247 timeout: 698 lvb_type: 1 00010000:00010000:0.0:1762166979.670653:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbabcc7 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea30a expref: 23 pid: 35247 timeout: 698 lvb_type: 1 00010000:00010000:0.0:1762166979.670667:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166979.670670:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166979.670675:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbabe41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea38f expref: 22 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.670684:0:7421:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbabe41 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea38f expref: 22 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.670719:0:7421:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbabe41 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea38f expref: 22 pid: 8383 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166979.670739:0:7421:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5765c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7421:1847765449755264:192.168.204.38@tcp:105: 00000100:00100000:0.0:1762166979.670807:0:7421:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc63999c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166979.671745:0:7421:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5765c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7421:1847765449755264:192.168.204.38@tcp:105: 00010000:00010000:0.0:1762166979.671760:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166979.671816:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a29880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450596864:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1263us (1442us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166979.671824:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9703 00000100:00100000:1.0:1762166979.672174:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166979.672208:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166979.672297:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450596992 00000100:00100000:3.0:1762166979.672303:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450596992 00002000:00010000:3.0:1762166979.672337:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (200741->18446744073709551615) 00000100:00100000:0.0:1762166979.672341:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00002000:00100000:3.0:1762166979.672343:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5bc1180 with x1847765450596992 ext(200741->18446744073709551615) 00002000:00010000:3.0:1762166979.672357:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5bc1180. 00000100:00100000:2.0:1762166979.672383:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450597248 00000100:00100000:3.0:1762166979.672391:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450597120 00000100:00100000:3.0:1762166979.672398:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450597120 00000100:00100000:1.0:1762166979.672405:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2504 00000100:00100000:2.0:1762166979.672408:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450597248 00002000:00010000:3.0:1762166979.672420:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00000100:00100000:1.0:1762166979.672421:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765450596992:12345-192.168.204.38@tcp:10:fsx.0 00002000:00100000:3.0:1762166979.672427:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5765c00 with x1847765450597120 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166979.672437:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc5765c00. 00000100:00100000:3.0:1762166979.672470:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2505 00002000:00010000:2.0:1762166979.672472:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:2.0:1762166979.672523:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5bc3100 with x1847765450597248 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166979.672541:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5bc3100. 00000100:00100000:3.0:1762166979.672560:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5765c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450597120:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:2.0:1762166979.672599:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2506 00000100:00100000:2.0:1762166979.672617:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765450597248:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:3.0:1762166979.672711:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166979.672716:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166979 -> 1762166979 00002000:00010000:3.0:1762166979.672720:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166979 -> 1762166979 00002000:00010000:3.0:1762166979.672722:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166979 -> 1762166979 00002000:00010000:3.0:1762166979.672725:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00000100:00100000:3.0:1762166979.672768:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5765c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450597120:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 287us (425us total) trans 21474843382 rc 0/0 00000100:00100000:3.0:1762166979.672784:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2505 00002000:00010000:3.0:1762166979.672788:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:3.0:1762166979.672791:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5765c00 with x1847765450597120 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166979.672797:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc5765c00. 00002000:00010000:2.0:1762166979.672866:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166979.672872:0:23943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166979 -> 1762166979 00002000:00010000:2.0:1762166979.672876:0:23943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166979 -> 1762166979 00002000:00010000:2.0:1762166979.672879:0:23943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166979 -> 1762166979 00002000:00010000:2.0:1762166979.672882:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:1.0:1762166979.672940:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 204311 -> 200741 00002000:00010000:1.0:1762166979.672947:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166979 -> 1762166979 00002000:00010000:1.0:1762166979.672950:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166979 -> 1762166979 00002000:00010000:1.0:1762166979.672952:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166979 -> 1762166979 00002000:00010000:1.0:1762166979.672955:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 96 -> 96 00000100:00100000:2.0:1762166979.672990:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+25:2419:x1847765450597248:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 376us (776us total) trans 17179876547 rc 0/0 00000100:00100000:1.0:1762166979.672992:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+25:2419:x1847765450596992:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 575us (816us total) trans 17179876546 rc 0/0 00000100:00100000:1.0:1762166979.673024:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2504 00002000:00010000:1.0:1762166979.673029:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (200741->18446744073709551615) 00000100:00100000:2.0:1762166979.673038:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2506 00002000:00100000:1.0:1762166979.673038:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5bc1180 with x1847765450596992 ext(200741->18446744073709551615) 00002000:00010000:1.0:1762166979.673051:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5bc1180. 00002000:00010000:2.0:1762166979.673053:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:2.0:1762166979.673061:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5bc3100 with x1847765450597248 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166979.673072:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5bc3100. 00000100:00100000:0.0:1762166979.674210:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166979.674275:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450597376 00000100:00100000:1.0:1762166979.674282:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450597376 00000100:00100000:1.0:1762166979.674331:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30664 00000100:00100000:1.0:1762166979.674340:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+528:61766:x1847765450597376:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:1.0:1762166979.674356:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166979.674386:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbabe48 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea396 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.674524:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbabe4f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166979.674539:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbabe4f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166979.674550:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbabe4f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:1.0:1762166979.674577:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 200741 00000004:00200000:1.0:1762166979.674581:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166979.674599:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbabe4f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166979.674627:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbabe48 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea396 expref: 530 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.674645:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbabe4f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea396 expref: 529 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.674654:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:1.0:1762166979.674657:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166979.674661:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355ae00, rc 0) 00000100:00100000:1.0:1762166979.674722:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+529:61766:x1847765450597376:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 383us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166979.674729:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30664 00000100:00100000:3.0:1762166979.676679:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.676737:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450597632 00000100:00100000:0.0:1762166979.676747:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450597632 00000100:00100000:0.0:1762166979.676816:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11920 00000100:00100000:0.0:1762166979.676826:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+529:61766:x1847765450597632:12345-192.168.204.38@tcp:35:fsx.0 00000100:00100000:0.0:1762166979.677209:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+530:61766:x1847765450597632:12345-192.168.204.38@tcp:35:fsx.0 Request processed in 385us (540us total) trans 4294992299 rc 0/0 00000100:00100000:0.0:1762166979.677215:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11920 00000100:00100000:3.0:1762166979.685946:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166979.686031:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450597888 00000100:00100000:1.0:1762166979.686045:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450597888 00000100:00100000:1.0:1762166979.686116:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30665 00000100:00100000:1.0:1762166979.686140:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+530:61866:x1847765450597888:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166979.686175:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166979.686207:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbabe56 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea39d expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.686302:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbabe5d lrc: 3/1,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166979.686315:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbabe5d lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166979.686325:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbabe5d lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166979.686334:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a000/0x2f180c4effbabe64 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166979.686338:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a000/0x2f180c4effbabe64 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166979.686342:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a000/0x2f180c4effbabe64 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166979.686501:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355be00/0x2f180c4effbabe6b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166979.686510:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355be00/0x2f180c4effbabe6b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166979.686515:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355be00/0x2f180c4effbabe6b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:1.0:1762166979.686524:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 200741 00010000:00010000:1.0:1762166979.686610:0:6494:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbabe5d lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166979.686617:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbabe5d lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166979.686623:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbabe5d lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166979.686629:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbabe5d lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166979.686635:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355aa00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166979.686640:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbabe5d lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166979.686649:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbabe5d lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166979.686663:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0x0 (ffff945bc812ea00) 00010000:00010000:1.0:1762166979.686666:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166979.686671:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbabe5d lrc: 3/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166979.686678:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbabe5d lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166979.686697:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a000/0x2f180c4effbabe64 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166979.686704:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a000/0x2f180c4effbabe64 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166979.686710:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a000/0x2f180c4effbabe64 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166979.686715:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355a000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166979.686719:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a000/0x2f180c4effbabe64 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166979.686725:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a000/0x2f180c4effbabe64 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166979.686732:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0xdd396665 (ffff945bc812e300) 00010000:00010000:1.0:1762166979.686735:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166979.686737:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a000/0x2f180c4effbabe64 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166979.686741:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a000/0x2f180c4effbabe64 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166979.686785:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbabe56 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea39d expref: 533 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.686801:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355be00/0x2f180c4effbabe6b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea39d expref: 532 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.686809:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:1.0:1762166979.686813:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166979.686816:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355be00, rc 0) 00000100:00100000:1.0:1762166979.686898:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+532:61866:x1847765450597888:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 764us (964us total) trans 4294992300 rc 0/0 00000100:00100000:1.0:1762166979.686904:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30665 00000100:00100000:3.0:1762166979.688246:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.688365:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450598016 00000100:00100000:0.0:1762166979.688375:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450598016 00000100:00100000:0.0:1762166979.688431:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 887 00000100:00100000:0.0:1762166979.688440:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+532:2418:x1847765450598016:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166979.688455:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166979.688472:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355be00/0x2f180c4effbabe6b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea39d expref: 532 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.688534:0:7421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:0.0:1762166979.688539:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166979.688583:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+531:2418:x1847765450598016:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 144us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166979.688592:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 887 00000100:00100000:1.0:1762166979.688653:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.688713:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450598272 00000100:00100000:0.0:1762166979.688718:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450598272 00000100:00100000:0.0:1762166979.688849:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30666 00000100:00100000:0.0:1762166979.688859:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+531:61866:x1847765450598272:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166979.688877:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166979.688893:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbabe79 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea3a4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.689471:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbabe80 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x616:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166979.689509:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbabe80 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x616:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166979.689519:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbabe80 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x616:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:0.0:1762166979.689528:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x616:0x0]: returning size 0 00010000:00010000:0.0:1762166979.689567:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbabe79 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3a4 expref: 534 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.689585:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbabe80 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x616:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3a4 expref: 533 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.689598:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x616:0x0].0x0 (ffff945bc4afea00) 00010000:00010000:0.0:1762166979.689601:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166979.689603:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bde800, rc 0) 00000100:00100000:0.0:1762166979.689648:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+533:61866:x1847765450598272:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 791us (996us total) trans 4294992301 rc 0/0 00000100:00100000:0.0:1762166979.689655:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30666 00000100:00100000:1.0:1762166979.691064:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.691107:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450598528 00000100:00100000:0.0:1762166979.691128:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450598528 00000100:00100000:0.0:1762166979.691179:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30667 00000100:00100000:0.0:1762166979.691188:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+533:61866:x1847765450598528:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166979.691212:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166979.691228:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbabe8e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x616:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea3ab expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.691317:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbabe95 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x616:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166979.691331:0:6494:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbabe80 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x616:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3a4 expref: 534 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.691340:0:6494:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbabe95 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x616:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166979.691384:0:6494:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbabe80 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x616:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3a4 expref: 534 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.691401:0:6494:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbabe80 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x616:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3a4 expref: 534 pid: 6494 timeout: 698 lvb_type: 0 00000100:00100000:0.0:1762166979.691424:0:6494:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4010380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765449755392:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166979.691563:0:6494:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc350f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166979.692752:0:6494:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4010380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765449755392:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166979.692774:0:6494:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbabe95 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x616:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000100:00100000:1.0:1762166979.693218:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.693312:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450598656 00000100:00100000:0.0:1762166979.693323:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450598656 00010000:00010000:0.0:1762166979.693365:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbabe80 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x616:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3a4 expref: 535 pid: 6494 timeout: 698 lvb_type: 0 00000100:00100000:0.0:1762166979.693419:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9704 00000100:00100000:0.0:1762166979.693430:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+535:2419:x1847765450598656:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166979.693446:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166979.693453:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbabe80 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x616:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3a4 expref: 535 pid: 6494 timeout: 698 lvb_type: 0 00010000:00010000:0.0:1762166979.693467:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbabe80 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x616:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3a4 expref: 535 pid: 6494 timeout: 698 lvb_type: 0 00010000:00010000:0.0:1762166979.693526:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbabe80 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x616:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3a4 expref: 535 pid: 6494 timeout: 698 lvb_type: 0 00010000:00010000:0.0:1762166979.693543:0:7421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x616:0x0].0x0 (ffff945bc4afea00) 00010000:00010000:0.0:1762166979.693548:0:7421:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbabe95 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x616:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166979.693563:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbabe95 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x616:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166979.693570:0:7421:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbabe95 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x616:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166979.693596:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166979.693645:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+534:2419:x1847765450598656:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 217us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166979.693654:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9704 00010000:00010000:1.0:1762166979.693683:0:6494:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbabe95 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x616:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166979.693694:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbabe95 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x616:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:1.0:1762166979.693713:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x616:0x0]: returning size 0 00000004:00080000:1.0:1762166979.693938:0:6494:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xa8e:0x0], index 1: 0 00000004:00080000:1.0:1762166979.693947:0:6494:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xa8f:0x0], index 0: 0 00010000:00010000:1.0:1762166979.694076:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbabe95 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x616:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166979.694085:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbabe95 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x616:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166979.694091:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbabe95 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x616:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166979.694097:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdfe00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166979.694101:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbabe95 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x616:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166979.694109:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbabe95 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x616:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166979.694123:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x616:0x0].0x0 (ffff945bc4afea00) 00010000:00010000:1.0:1762166979.694126:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166979.694130:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbabe95 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x616:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166979.694135:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbabe95 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x616:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166979.694181:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbabe8e lrc: 1/0,0 mode: --/CR res: [0x240000404:0x616:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3ab expref: 534 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.694190:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x616:0x0].0x0 (ffff945bc4afea00) 00010000:00010000:1.0:1762166979.694193:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1762166979.694196:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbabe8e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x616:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3ab expref: 534 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.694212:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdf200, rc 0) 00000100:00100000:1.0:1762166979.694248:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+533:61866:x1847765450598528:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 3061us (3189us total) trans 4294992302 rc 301/301 00000100:00100000:1.0:1762166979.694255:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30667 00000100:00100000:1.0:1762166979.695377:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.695448:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450598912 00000100:00100000:0.0:1762166979.695458:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450598912 00000100:00100000:0.0:1762166979.695555:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11921 00000100:00100000:0.0:1762166979.695569:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+533:61866:x1847765450598912:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166979.695891:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+534:61866:x1847765450598912:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 325us (520us total) trans 4294992303 rc 0/0 00000100:00100000:0.0:1762166979.695901:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11921 00000100:00100000:3.0:1762166979.697204:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166979.697254:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450599040 00000100:00100000:1.0:1762166979.697261:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450599040 00000100:00100000:1.0:1762166979.697310:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30668 00000100:00100000:1.0:1762166979.697318:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc3552d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+534:61866:x1847765450599040:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166979.697340:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166979.697366:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a400/0x2f180c4effbabea3 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x616:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea3b2 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.697449:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbabeaa lrc: 3/1,0 mode: --/PR res: [0x240000404:0x616:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166979.697466:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbabeaa lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x616:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166979.697530:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbabeaa lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x616:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:1.0:1762166979.697570:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x616:0x0]: returning size 0 00000004:00200000:1.0:1762166979.697575:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166979.697593:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbabeaa lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x616:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166979.697620:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a400/0x2f180c4effbabea3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x616:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3b2 expref: 536 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.697637:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbabeaa lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x616:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3b2 expref: 535 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.697646:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x616:0x0].0x0 (ffff945bc812e900) 00010000:00010000:1.0:1762166979.697650:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1762166979.697654:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355b200, rc 0) 00000100:00100000:1.0:1762166979.697699:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc3552d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+535:61866:x1847765450599040:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 382us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166979.697707:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30668 00000100:00100000:2.0:1762166979.698896:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.698971:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450599296 00000100:00100000:0.0:1762166979.698978:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450599296 00000100:00100000:0.0:1762166979.699032:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19206 00000100:00100000:0.0:1762166979.699043:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+18:2416:x1847765450599296:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166979.699058:0:8383:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1762166979.699076:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:0.0:1762166979.699083:0:8383:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde200/0x2f180c4effbabeb1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa8f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea3c0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166979.699115:0:8383:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa8f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:2.0:1762166979.699116:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450599168 00000100:00100000:2.0:1762166979.699131:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450599168 00010000:00010000:0.0:1762166979.699137:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166979.699142:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166979.699152:0:8383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde200/0x2f180c4effbabeb1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3c0 expref: 19 pid: 8383 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166979.699169:0:8383:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde200/0x2f180c4effbabeb1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3c0 expref: 19 pid: 8383 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166979.699182:0:8383:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bde200, rc 0) 00000100:00100000:2.0:1762166979.699198:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19207 00000100:00100000:2.0:1762166979.699212:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc3552680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+24:2416:x1847765450599168:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166979.699232:0:35247:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1762166979.699236:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:2416:x1847765450599296:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 192us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166979.699246:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19206 00010000:00010000:2.0:1762166979.699254:0:35247:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbabeb8 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea3b9 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166979.699278:0:35247:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa8e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1762166979.699298:0:35247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166979.699300:0:35247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166979.699311:0:35247:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbabeb8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3b9 expref: 25 pid: 35247 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166979.699341:0:35247:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbabeb8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3b9 expref: 25 pid: 35247 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166979.699354:0:35247:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa8e00, rc 0) 00000100:00100000:2.0:1762166979.699421:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc3552680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+25:2416:x1847765450599168:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 211us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166979.699430:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19207 00000100:00100000:3.0:1762166979.700709:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166979.700755:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450599552 00000100:00100000:1.0:1762166979.700760:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450599552 00000100:00100000:1.0:1762166979.700797:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30669 00000100:00100000:1.0:1762166979.700808:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc3553800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+535:61866:x1847765450599552:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166979.700821:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166979.700848:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbabebf lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea3c7 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.700938:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a000/0x2f180c4effbabec6 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166979.700952:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a000/0x2f180c4effbabec6 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166979.700962:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a000/0x2f180c4effbabec6 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:1.0:1762166979.700973:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 200741 00010000:00010000:1.0:1762166979.701075:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbabebf lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3c7 expref: 538 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.701088:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a000/0x2f180c4effbabec6 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3c7 expref: 537 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.701094:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:1.0:1762166979.701096:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762166979.701098:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355a000, rc 0) 00000100:00100000:1.0:1762166979.701141:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc3553800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+537:61866:x1847765450599552:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 339us (437us total) trans 4294992304 rc 0/0 00000100:00100000:1.0:1762166979.701145:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30669 00000100:00100000:3.0:1762166979.702978:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166979.703025:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166979.703058:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.703087:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450599680 00000100:00100000:0.0:1762166979.703098:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450599680 00000100:00100000:1.0:1762166979.703114:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450599808 00000100:00100000:1.0:1762166979.703121:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450599808 00000100:00100000:0.0:1762166979.703161:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450599936 00000100:00100000:0.0:1762166979.703166:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450599936 00000100:00100000:1.0:1762166979.703198:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19208 00000100:00100000:2.0:1762166979.703217:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19209 00000100:00100000:1.0:1762166979.703228:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc3550380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765450599680:12345-192.168.204.38@tcp:1:lfs.0 00000100:00100000:3.0:1762166979.703238:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19210 00000100:00100000:3.0:1762166979.703259:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc3553480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+26:2418:x1847765450599936:12345-192.168.204.38@tcp:1:lfs.0 00000100:00100000:2.0:1762166979.703265:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3d5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450599808:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:3.0:1762166979.703300:0:35248:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effbabed4 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.703301:0:8382:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945cc355aa00/0x2f180c4effbabedb lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.703316:0:35247:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9a00/0x2f180c4effbabee2 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166979.703340:0:35248:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbabe41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea38f expref: 26 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.703341:0:8382:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbabe09 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 139264->167935) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea36c expref: 26 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.703347:0:35247:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945cc355b800/0x2f180c4effbabe3a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea388 expref: 19 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166979.703389:0:35248:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166979.703392:0:35247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166979.703395:0:35248:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166979.703399:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166979.703400:0:35247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166979.703403:0:35248:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effbabed4 lrc: 4/1,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.703406:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166979.703410:0:35247:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9a00/0x2f180c4effbabee2 lrc: 4/1,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.703415:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355aa00/0x2f180c4effbabedb lrc: 4/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166979.703475:0:35248:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbabe41 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea38f expref: 26 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.703526:0:8382:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbabe09 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 139264->167935) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea36c expref: 26 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166979.703539:0:35248:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbabe41 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea38f expref: 26 pid: 8383 timeout: 698 lvb_type: 0 00010000:00010000:2.0:1762166979.703542:0:35247:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945cc355b800/0x2f180c4effbabe3a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea388 expref: 19 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.703543:0:8382:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbabe09 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 139264->167935) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea36c expref: 26 pid: 8383 timeout: 698 lvb_type: 0 00000100:00100000:3.0:1762166979.703597:0:35248:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cc3551500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:35248:1847765449755520:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166979.703597:0:8382:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bc3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8382:1847765449755648:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166979.703600:0:35247:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945cc355b800/0x2f180c4effbabe3a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea388 expref: 19 pid: 35247 timeout: 698 lvb_type: 0 00000100:00100000:2.0:1762166979.703631:0:35247:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:35247:1847765449755776:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166979.703706:0:35248:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf3a33780 going to sleep for 11 seconds 00000100:00100000:1.0:1762166979.703706:0:8382:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc4076c00 going to sleep for 11 seconds 00000100:00100000:2.0:1762166979.703707:0:35247:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1dce3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166979.705171:0:35248:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cc3551500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:35248:1847765449755520:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166979.705192:0:8382:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bc3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8382:1847765449755648:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166979.705202:0:35248:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effbabed4 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166979.705218:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:1.0:1762166979.705224:0:8382:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945cc355aa00/0x2f180c4effbabedb lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166979.705258:0:35247:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:35247:1847765449755776:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166979.705282:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450600064 00010000:00010000:2.0:1762166979.705291:0:35247:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9a00/0x2f180c4effbabee2 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166979.705291:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450600064 00000100:00100000:3.0:1762166979.705292:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:0.0:1762166979.705331:0:6480:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbabe41 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea38f expref: 27 pid: 8383 timeout: 698 lvb_type: 0 00000100:00100000:1.0:1762166979.705344:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450600192 00000100:00100000:1.0:1762166979.705353:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450600192 00000100:00100000:3.0:1762166979.705358:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.705376:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450600320 00000100:00100000:0.0:1762166979.705383:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450600320 00010000:00010000:1.0:1762166979.705388:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbabe09 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 139264->167935) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea36c expref: 28 pid: 8383 timeout: 698 lvb_type: 0 00010000:00010000:0.0:1762166979.705411:0:6480:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945cc355b800/0x2f180c4effbabe3a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea388 expref: 20 pid: 35247 timeout: 698 lvb_type: 0 00000100:00100000:2.0:1762166979.705424:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9705 00000100:00100000:3.0:1762166979.705446:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9706 00000100:00100000:2.0:1762166979.705448:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc3550a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+28:2419:x1847765450600064:12345-192.168.204.38@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1762166979.705465:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7c33050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+28:2419:x1847765450600192:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166979.705467:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1762166979.705472:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9707 00010000:00010000:3.0:1762166979.705520:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1762166979.705543:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc3551880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:2417:x1847765450600320:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166979.705550:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbabe09 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 139264->167935) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea36c expref: 28 pid: 8383 timeout: 698 lvb_type: 0 00010000:00010000:2.0:1762166979.705550:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbabe41 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea38f expref: 28 pid: 8383 timeout: 698 lvb_type: 0 00010000:00010000:1.0:1762166979.705554:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166979.705571:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945cc355b800/0x2f180c4effbabe3a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea388 expref: 20 pid: 35247 timeout: 698 lvb_type: 0 00010000:00010000:3.0:1762166979.705584:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbabe09 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 139264->167935) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea36c expref: 28 pid: 8383 timeout: 698 lvb_type: 0 00010000:00010000:2.0:1762166979.705585:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbabe41 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea38f expref: 28 pid: 8383 timeout: 698 lvb_type: 0 00010000:00010000:1.0:1762166979.705587:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945cc355b800/0x2f180c4effbabe3a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea388 expref: 20 pid: 35247 timeout: 698 lvb_type: 0 00010000:00010000:1.0:1762166979.705622:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cc355b800/0x2f180c4effbabe3a lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea388 expref: 20 pid: 35247 timeout: 698 lvb_type: 0 00010000:00010000:3.0:1762166979.705627:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbabe09 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 139264->167935) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea36c expref: 28 pid: 8383 timeout: 698 lvb_type: 0 00010000:00010000:2.0:1762166979.705627:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbabe41 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea38f expref: 28 pid: 8383 timeout: 698 lvb_type: 0 00010000:00010000:1.0:1762166979.705635:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166979.705639:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166979.705644:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9a00/0x2f180c4effbabee2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.705655:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9a00/0x2f180c4effbabee2 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166979.705658:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166979.705659:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166979.705663:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166979.705663:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166979.705668:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945cc355aa00/0x2f180c4effbabedb lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.705670:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effbabed4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.705685:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166979.705690:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355aa00/0x2f180c4effbabedb lrc: 4/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.705692:0:9458:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effbabed4 lrc: 4/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166979.705726:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166979.705727:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166979.705733:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc3551880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:2417:x1847765450600320:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 198us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166979.705742:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9707 00000100:00100000:3.0:1762166979.705752:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7c33050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765450600192:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 293us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166979.705761:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9706 00010000:00010000:1.0:1762166979.705775:0:8382:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945cc355aa00/0x2f180c4effbabedb lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166979.705778:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc3550a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+25:2419:x1847765450600064:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 335us (562us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166979.705782:0:35248:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effbabed4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.705795:0:8382:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cc355aa00/0x2f180c4effbabedb lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166979.705799:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9705 00010000:00010000:3.0:1762166979.705804:0:35247:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9a00/0x2f180c4effbabee2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.705807:0:35248:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effbabed4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.705822:0:8382:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945cc355aa00/0x2f180c4effbabedb lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166979.705825:0:35247:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9a00/0x2f180c4effbabee2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.705849:0:35248:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effbabed4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.705858:0:8382:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355aa00/0x2f180c4effbabedb lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.705880:0:35248:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effbabed4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.705881:0:8382:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945cc355aa00/0x2f180c4effbabedb lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166979.705884:0:35247:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9a00/0x2f180c4effbabee2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.705903:0:35248:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effbabed4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.705906:0:8382:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355aa00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166979.705908:0:35247:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9a00/0x2f180c4effbabee2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.705913:0:8382:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc355aa00/0x2f180c4effbabedb lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166979.705924:0:35247:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9a00/0x2f180c4effbabee2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.705933:0:35248:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8473000 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166979.705938:0:8382:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc355aa00/0x2f180c4effbabedb lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.705940:0:35248:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effbabed4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166979.705943:0:35247:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa9a00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166979.705951:0:35247:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9a00/0x2f180c4effbabee2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.705965:0:8382:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945cc355aa00/0x2f180c4effbabedb lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.705967:0:35248:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effbabed4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166979.705970:0:35247:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9a00/0x2f180c4effbabee2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.705988:0:8382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cc355aa00/0x2f180c4effbabedb lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166979.706003:0:35247:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9a00/0x2f180c4effbabee2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.706003:0:35248:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effbabed4 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166979.706026:0:35247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9a00/0x2f180c4effbabee2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.706026:0:35248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8473000/0x2f180c4effbabed4 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166979.706032:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc3550380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765450599680:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 2817us (3062us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166979.706049:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19208 00000100:00100000:0.0:1762166979.706099:0:35248:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc3553480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765450599936:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 2849us (3039us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166979.706108:0:35248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19210 00000100:00100000:2.0:1762166979.706138:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3d5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450599808:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 2899us (3110us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166979.706146:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19209 00000100:00100000:0.0:1762166979.707708:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.707741:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.707764:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450600448 00000100:00100000:2.0:1762166979.707775:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450600448 00000100:00100000:1.0:1762166979.707792:0:35248:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450600576 00000100:00100000:1.0:1762166979.707799:0:35248:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450600576 00000100:00100000:2.0:1762166979.707822:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19211 00000100:00100000:2.0:1762166979.707833:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4010380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+23:2417:x1847765450600448:12345-192.168.204.38@tcp:101:lfs.0 00000100:00100000:1.0:1762166979.707854:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19212 00010000:00010000:2.0:1762166979.707858:0:35247:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1762166979.707870:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4011880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+18:2417:x1847765450600576:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166979.707880:0:35247:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbabee9 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea3ce expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.707883:0:35248:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:2.0:1762166979.707900:0:35247:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa77:0x0] initial LVB size: 200741, mtime: 0x690888c3, atime: 0x690888c3, ctime: 0x690888c3, blocks: 0x60 00010000:00010000:1.0:1762166979.707902:0:35248:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cc355a200/0x2f180c4effbabef0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea3d5 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166979.707919:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:2.0:1762166979.707925:0:35247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166979.707931:0:35247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00002000:00010000:1.0:1762166979.707932:0:35248:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa7a:0x0] initial LVB size: 0, mtime: 0x690888c3, atime: 0x690888c3, ctime: 0x690888c3, blocks: 0x1800 00010000:00010000:2.0:1762166979.707944:0:35247:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbabee9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3ce expref: 24 pid: 35247 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166979.707947:0:35248:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166979.707952:0:35248:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166979.707960:0:35248:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cc355a200/0x2f180c4effbabef0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3d5 expref: 19 pid: 35248 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166979.707968:0:35247:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbabee9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3ce expref: 24 pid: 35247 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166979.707977:0:35248:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945cc355a200/0x2f180c4effbabef0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3d5 expref: 19 pid: 35248 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166979.707983:0:35247:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa9e00, rc 0) 00010000:00010000:1.0:1762166979.707991:0:35248:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355a200, rc 0) 00000100:00100000:3.0:1762166979.708013:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450600704 00000100:00100000:3.0:1762166979.708018:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450600704 00000100:00100000:2.0:1762166979.708047:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4010380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+25:2417:x1847765450600448:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 212us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166979.708047:0:35248:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4011880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+19:2417:x1847765450600576:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 179us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166979.708049:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19213 00000100:00100000:3.0:1762166979.708062:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4010000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+25:2417:x1847765450600704:12345-192.168.204.38@tcp:101:lfs.0 00000100:00100000:2.0:1762166979.708063:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19211 00010000:00010000:3.0:1762166979.708074:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1762166979.708075:0:35248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19212 00010000:00010000:3.0:1762166979.708089:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8472800/0x2f180c4effbabef7 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea3dc expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166979.708103:0:28434:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa79:0x0] initial LVB size: 0, mtime: 0x690888c3, atime: 0x690888c3, ctime: 0x690888c3, blocks: 0x0 00010000:00010000:2.0:1762166979.708150:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166979.708152:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166979.708158:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472800/0x2f180c4effbabef7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3dc expref: 25 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166979.708170:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc8472800/0x2f180c4effbabef7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3dc expref: 25 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166979.708179:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8472800, rc 0) 00000100:00100000:2.0:1762166979.708212:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4010000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+25:2417:x1847765450600704:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 152us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166979.708218:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19213 00000100:00100000:0.0:1762166979.733686:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.733767:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450600832 00000100:00100000:2.0:1762166979.733782:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450600832 00000100:00100000:2.0:1762166979.733872:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19214 00000100:00100000:2.0:1762166979.733886:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4012d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+25:2416:x1847765450600832:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:2.0:1762166979.734050:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4012d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+25:2416:x1847765450600832:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 167us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166979.734061:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19214 00000100:00100000:1.0:1762166979.735357:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.735439:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450600960 00000100:00100000:0.0:1762166979.735449:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450600960 00000100:00100000:0.0:1762166979.735534:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30670 00000100:00100000:0.0:1762166979.735989:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+537:61866:x1847765450600960:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166979.736014:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166979.736039:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbabefe lrc: 2/0,0 mode: --/PR res: [0x240000404:0x616:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea3e3 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.736079:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbabf05 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x616:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166979.736096:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbabf05 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x616:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166979.736109:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbabf05 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x616:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166979.736235:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbabefe lrc: 0/0,0 mode: --/PR res: [0x240000404:0x616:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3e3 expref: 539 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.736252:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbabf05 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x616:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3e3 expref: 538 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.736263:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x616:0x0].0x0 (ffff945bc812e900) 00010000:00010000:0.0:1762166979.736266:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1762166979.736271:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdf600, rc 0) 00000100:00100000:0.0:1762166979.736324:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+538:61866:x1847765450600960:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 780us (980us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166979.736331:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30670 00000100:00100000:0.0:1762166979.737421:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166979.737551:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450601216 00000100:00100000:1.0:1762166979.737564:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450601216 00000100:00100000:1.0:1762166979.737637:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30671 00000100:00100000:1.0:1762166979.737656:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4013100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+538:61866:x1847765450601216:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:1.0:1762166979.737716:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166979.737760:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbabeaa lrc: 0/0,0 mode: --/PR res: [0x240000404:0x616:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3b2 expref: 538 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.737783:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x616:0x0].0x0 (ffff945bc812e900) 00010000:00010000:1.0:1762166979.737788:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166979.738007:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbabf0c lrc: 3/0,1 mode: --/PW res: [0x240000404:0x616:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166979.738023:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbabf0c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x616:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166979.738035:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbabf0c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x616:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000001:00080000:1.0:1762166979.738083:0:6494:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992305 00000004:00010000:1.0:1762166979.738110:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000098833d4c reply state 00000000fe4474c5 transno 4294992306 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbabf0c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x616:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166979.738122:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbabf0c lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x616:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166979.738128:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x616:0x0].0x0 (ffff945bc812e900) 00010000:00010000:1.0:1762166979.738131:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166979.738134:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166979.738231:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4013100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+540:61866:x1847765450601216:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 582us (810us total) trans 4294992306 rc 0/0 00000100:00100000:1.0:1762166979.738239:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30671 00000020:00080000:1.0:1762166979.738247:0:6494:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1762166979.738967:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166979.739016:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450601344 00000100:00100000:1.0:1762166979.739023:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450601344 00000100:00100000:1.0:1762166979.739070:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30672 00000100:00100000:1.0:1762166979.739079:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc3550e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+540:61866:x1847765450601344:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166979.739101:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166979.739112:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbabf13 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x616:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea3ea expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.739148:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbabf13 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x616:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3ea expref: 541 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.739161:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbabf13 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x616:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3ea expref: 541 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.739177:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x616:0x0].0x0 (ffff945bc812e900) 00010000:00010000:1.0:1762166979.739181:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166979.739184:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355b800, rc 0) 00000100:00100000:1.0:1762166979.739232:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc3550e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+541:61866:x1847765450601344:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 154us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166979.739240:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30672 00000100:00100000:3.0:1762166979.740356:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.740418:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450601472 00000100:00100000:2.0:1762166979.740426:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450601472 00000100:00100000:2.0:1762166979.740515:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19215 00000100:00100000:2.0:1762166979.740584:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc3550700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+25:61866:x1847765450601472:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166979.740600:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166979.740617:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbabf1a lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea3f1 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.740637:0:28434:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbabeb8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3b9 expref: 26 pid: 35247 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166979.740643:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166979.740645:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166979.740648:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbabf1a lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3f1 expref: 26 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.740676:0:28434:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbabeb8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3b9 expref: 26 pid: 35247 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166979.740685:0:28434:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbabeb8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3b9 expref: 26 pid: 35247 timeout: 698 lvb_type: 1 00000100:00100000:2.0:1762166979.740696:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765449755904:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166979.740763:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1dce9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166979.742018:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765449755904:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166979.742020:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:2.0:1762166979.742049:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbabf1a lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3f1 expref: 26 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.742065:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa9c00, rc 0) 00000100:00100000:3.0:1762166979.742089:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450601600 00000100:00100000:3.0:1762166979.742095:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450601600 00000100:00100000:2.0:1762166979.742116:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc3550700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+27:61866:x1847765450601472:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1590us (1759us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166979.742121:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbabeb8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3b9 expref: 27 pid: 35247 timeout: 698 lvb_type: 1 00000100:00100000:2.0:1762166979.742130:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19215 00000100:00100000:3.0:1762166979.742155:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9708 00000100:00100000:3.0:1762166979.742161:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb387800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+26:2418:x1847765450601600:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166979.742169:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166979.742172:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbabeb8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3b9 expref: 26 pid: 35247 timeout: 698 lvb_type: 1 00010000:00010000:3.0:1762166979.742214:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbabeb8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3b9 expref: 26 pid: 35247 timeout: 698 lvb_type: 1 00010000:00010000:3.0:1762166979.742232:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbabeb8 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3b9 expref: 26 pid: 35247 timeout: 698 lvb_type: 1 00010000:00010000:3.0:1762166979.742242:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166979.742243:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166979.742248:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbabf1a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3f1 expref: 25 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166979.742255:0:9458:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbabf1a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3f1 expref: 25 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166979.742275:0:9458:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbabf1a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3f1 expref: 25 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166979.742282:0:9458:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cc3552300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:9458:1847765449756032:192.168.204.38@tcp:105: 00000100:00100000:3.0:1762166979.742310:0:9458:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf3a33cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166979.743920:0:9458:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cc3552300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:9458:1847765449756032:192.168.204.38@tcp:105: 00000100:00100000:3.0:1762166979.743923:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:2.0:1762166979.743939:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166979.743980:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb387800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+25:2418:x1847765450601600:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1817us (1965us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166979.743990:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9708 00000100:00100000:0.0:1762166979.744032:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450601728 00000100:00100000:0.0:1762166979.744045:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450601728 00000100:00100000:0.0:1762166979.744106:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19216 00000100:00100000:0.0:1762166979.744115:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc3551c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+19:61866:x1847765450601728:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166979.744135:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166979.744155:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdea00/0x2f180c4effbabf21 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea3f8 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.744188:0:28434:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde200/0x2f180c4effbabeb1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3c0 expref: 20 pid: 8383 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166979.744198:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166979.744201:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166979.744206:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdea00/0x2f180c4effbabf21 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xa8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3f8 expref: 20 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.744240:0:28434:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde200/0x2f180c4effbabeb1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3c0 expref: 20 pid: 8383 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166979.744262:0:28434:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde200/0x2f180c4effbabeb1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3c0 expref: 20 pid: 8383 timeout: 698 lvb_type: 1 00000100:00100000:0.0:1762166979.744278:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcb386d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765449756160:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166979.744352:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc350f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166979.745504:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.745527:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcb386d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765449756160:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166979.745546:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450601856 00010000:00010000:0.0:1762166979.745553:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdea00/0x2f180c4effbabf21 lrc: 3/0,0 mode: --/PW res: [0x280000400:0xa8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3f8 expref: 20 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166979.745554:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450601856 00010000:00010000:0.0:1762166979.745570:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdea00, rc 0) 00010000:00010000:2.0:1762166979.745581:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde200/0x2f180c4effbabeb1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3c0 expref: 21 pid: 8383 timeout: 698 lvb_type: 1 00000100:00100000:2.0:1762166979.745624:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9709 00000100:00100000:0.0:1762166979.745629:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc3551c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+21:61866:x1847765450601728:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1513us (1711us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166979.745638:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc3550000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450601856:12345-192.168.204.38@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1762166979.745644:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19216 00010000:00010000:2.0:1762166979.745652:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166979.745660:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde200/0x2f180c4effbabeb1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3c0 expref: 20 pid: 8383 timeout: 698 lvb_type: 1 00010000:00010000:2.0:1762166979.745674:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde200/0x2f180c4effbabeb1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3c0 expref: 20 pid: 8383 timeout: 698 lvb_type: 1 00010000:00010000:2.0:1762166979.745702:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde200/0x2f180c4effbabeb1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3c0 expref: 20 pid: 8383 timeout: 698 lvb_type: 1 00010000:00010000:2.0:1762166979.745715:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166979.745718:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166979.745724:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdea00/0x2f180c4effbabf21 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3f8 expref: 19 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.745735:0:9458:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdea00/0x2f180c4effbabf21 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3f8 expref: 19 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.745764:0:9458:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdea00/0x2f180c4effbabf21 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3f8 expref: 19 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166979.745775:0:9458:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:9458:1847765449756288:192.168.204.38@tcp:105: 00000100:00100000:2.0:1762166979.745824:0:9458:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1dce9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166979.746638:0:9458:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:9458:1847765449756288:192.168.204.38@tcp:105: 00010000:00010000:2.0:1762166979.746651:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166979.746682:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc3550000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450601856:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1049us (1208us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166979.746690:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9709 00000100:00100000:3.0:1762166979.746925:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166979.746960:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.746983:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450601984 00000100:00100000:2.0:1762166979.746989:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450601984 00002000:00010000:2.0:1762166979.747018:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2702 (0->18446744073709551615) 00002000:00100000:2.0:1762166979.747023:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cc3553b80 with x1847765450601984 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166979.747034:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cc3553b80. 00000100:00100000:1.0:1762166979.747046:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450602112 00000100:00100000:1.0:1762166979.747058:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450602112 00000100:00100000:2.0:1762166979.747067:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2507 00000100:00100000:2.0:1762166979.747081:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc3553b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+25:2419:x1847765450601984:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:1.0:1762166979.747098:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2703 (0->18446744073709551615) 00002000:00100000:1.0:1762166979.747105:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cc3552a00 with x1847765450602112 ext(0->18446744073709551615) 00002000:00010000:1.0:1762166979.747116:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945cc3552a00. 00000100:00100000:1.0:1762166979.747150:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2508 00000100:00100000:1.0:1762166979.747166:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc3552a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450602112:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:2.0:1762166979.747272:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa8e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166979.747277:0:23943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa8e:0x0] updating lvb mtime from disk: 0 -> 1762166979 00002000:00010000:2.0:1762166979.747280:0:23943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa8e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1762166979.747283:0:23943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa8e:0x0] updating lvb ctime from disk: 0 -> 1762166979 00002000:00010000:2.0:1762166979.747285:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa8e:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1762166979.747324:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc3553b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765450601984:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 247us (398us total) trans 17179876548 rc 0/0 00000100:00100000:2.0:1762166979.747333:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2507 00002000:00010000:2.0:1762166979.747342:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2702 (0->18446744073709551615) 00002000:00100000:2.0:1762166979.747346:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cc3553b80 with x1847765450601984 ext(0->18446744073709551615) 00002000:00010000:1.0:1762166979.747349:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa8f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166979.747352:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cc3553b80. 00002000:00010000:1.0:1762166979.747354:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa8f:0x0] updating lvb mtime from disk: 0 -> 1762166979 00002000:00010000:1.0:1762166979.747359:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa8f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1762166979.747362:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa8f:0x0] updating lvb ctime from disk: 0 -> 1762166979 00002000:00010000:1.0:1762166979.747365:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa8f:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1762166979.747404:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc3552a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450602112:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 245us (443us total) trans 21474843383 rc 0/0 00000100:00100000:1.0:1762166979.747410:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2508 00002000:00010000:1.0:1762166979.747413:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2703 (0->18446744073709551615) 00002000:00100000:1.0:1762166979.747415:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cc3552a00 with x1847765450602112 ext(0->18446744073709551615) 00002000:00010000:1.0:1762166979.747422:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945cc3552a00. 00000100:00100000:1.0:1762166979.748901:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.748988:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450602240 00000100:00100000:0.0:1762166979.748998:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450602240 00000100:00100000:0.0:1762166979.749033:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19217 00000100:00100000:0.0:1762166979.749041:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765450602240:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:0.0:1762166979.749131:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765450602240:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 88us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166979.749138:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19217 00000100:00100000:3.0:1762166979.750124:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.750182:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450602368 00000100:00100000:0.0:1762166979.750188:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450602368 00000100:00100000:0.0:1762166979.750220:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19218 00000100:00100000:0.0:1762166979.750228:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc3553100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765450602368:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:0.0:1762166979.750299:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc3553100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765450602368:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 72us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166979.750307:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19218 00000100:00100000:3.0:1762166979.751447:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166979.751535:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450602496 00000100:00100000:1.0:1762166979.751541:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450602496 00000100:00100000:1.0:1762166979.751619:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2509 00000100:00100000:1.0:1762166979.751628:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc3551f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765450602496:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:1.0:1762166979.751685:0:8388:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945cc355b200/0x2f180c4effbabf28 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.751699:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166979.751701:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166979.751707:0:8388:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355b200/0x2f180c4effbabf28 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.751720:0:8388:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cc355b200/0x2f180c4effbabf28 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.751830:0:8388:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945cc355b200/0x2f180c4effbabf28 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.751858:0:8388:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355b200/0x2f180c4effbabf28 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.751867:0:8388:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945cc355b200/0x2f180c4effbabf28 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.751874:0:8388:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355b200 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166979.751879:0:8388:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc355b200/0x2f180c4effbabf28 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.751888:0:8388:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc355b200/0x2f180c4effbabf28 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.751905:0:8388:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945cc355b200/0x2f180c4effbabf28 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.751912:0:8388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cc355b200/0x2f180c4effbabf28 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166979.751957:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc3551f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765450602496:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 331us (511us total) trans 0 rc 12288/12288 00000100:00100000:1.0:1762166979.751965:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2509 00000100:00100000:3.0:1762166979.753214:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166979.753256:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450602624 00000100:00100000:1.0:1762166979.753262:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450602624 00000100:00100000:1.0:1762166979.753296:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2510 00000100:00100000:1.0:1762166979.753304:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf41a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765450602624:12345-192.168.204.38@tcp:4:lfs.0 00010000:00010000:1.0:1762166979.753323:0:8388:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945cc355b600/0x2f180c4effbabf2f lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.753337:0:8388:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbabf1a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3f1 expref: 26 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.753345:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166979.753347:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166979.753350:0:8388:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355b600/0x2f180c4effbabf2f lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.753383:0:8388:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbabf1a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3f1 expref: 26 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.753397:0:8388:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbabf1a lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3f1 expref: 26 pid: 28434 timeout: 698 lvb_type: 0 00000100:00100000:1.0:1762166979.753412:0:8388:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bc0700 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:8388:1847765449756416:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166979.753499:0:8388:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc4076c00 going to sleep for 11 seconds 00000100:00100000:1.0:1762166979.754309:0:8388:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bc0700 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:8388:1847765449756416:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166979.754334:0:8388:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945cc355b600/0x2f180c4effbabf2f lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166979.754426:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.754499:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450602752 00000100:00100000:2.0:1762166979.754509:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450602752 00010000:00010000:2.0:1762166979.754546:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbabf1a lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3f1 expref: 27 pid: 28434 timeout: 698 lvb_type: 0 00000100:00100000:2.0:1762166979.754581:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9710 00000100:00100000:2.0:1762166979.754590:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc3551180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+27:2419:x1847765450602752:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166979.754603:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166979.754621:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbabf1a lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3f1 expref: 27 pid: 28434 timeout: 698 lvb_type: 0 00010000:00010000:2.0:1762166979.754635:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbabf1a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3f1 expref: 27 pid: 28434 timeout: 698 lvb_type: 0 00010000:00010000:2.0:1762166979.754658:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbabf1a lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3f1 expref: 27 pid: 28434 timeout: 698 lvb_type: 0 00010000:00010000:2.0:1762166979.754679:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166979.754682:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166979.754687:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945cc355b600/0x2f180c4effbabf2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.754696:0:9458:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355b600/0x2f180c4effbabf2f lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 3 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.754723:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166979.754749:0:8388:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945cc355b600/0x2f180c4effbabf2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.754761:0:8388:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cc355b600/0x2f180c4effbabf2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166979.754774:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc3551180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765450602752:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 185us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166979.754786:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9710 00000001:00080000:2.0:1762166979.756025:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876549 is committed 00000001:00080000:2.0:1762166979.756043:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876543 is committed 00002000:00010000:1.0:1762166979.756193:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa8e:0x0] updating lvb size from disk: 0 -> 12288 00002000:00010000:1.0:1762166979.756198:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa8e:0x0] updating lvb blocks from disk: 0 -> 24 00010000:00010000:1.0:1762166979.756206:0:8388:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945cc355b600/0x2f180c4effbabf2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.756217:0:8388:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355b600/0x2f180c4effbabf2f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.756225:0:8388:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945cc355b600/0x2f180c4effbabf2f lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.756232:0:8388:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355b600 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166979.756236:0:8388:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc355b600/0x2f180c4effbabf2f lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.756244:0:8388:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc355b600/0x2f180c4effbabf2f lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.756257:0:8388:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945cc355b600/0x2f180c4effbabf2f lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.756263:0:8388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cc355b600/0x2f180c4effbabf2f lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [0->12287] (req 0->12287) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166979.756331:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf41a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450602624:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 3026us (3156us total) trans 17179876549 rc 0/0 00000100:00100000:1.0:1762166979.756340:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2510 00000100:00100000:3.0:1762166979.757728:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.757778:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450602880 00000100:00100000:0.0:1762166979.757786:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450602880 00000100:00100000:0.0:1762166979.757852:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19219 00000100:00100000:0.0:1762166979.757863:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc3553b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+17:2417:x1847765450602880:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:0.0:1762166979.757972:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc3553b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+17:2417:x1847765450602880:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 111us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166979.757981:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19219 00000100:00100000:3.0:1762166979.758965:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.759013:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450603008 00000100:00100000:0.0:1762166979.759019:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450603008 00000100:00100000:0.0:1762166979.759053:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19220 00000100:00100000:0.0:1762166979.759063:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc3552a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+17:2416:x1847765450603008:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:0.0:1762166979.759119:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc3552a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+17:2416:x1847765450603008:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 58us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166979.759127:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19220 00000100:00100000:3.0:1762166979.760454:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166979.760527:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450603136 00000100:00100000:1.0:1762166979.760534:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450603136 00000100:00100000:1.0:1762166979.760583:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2511 00000100:00100000:1.0:1762166979.760593:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc3551f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+17:2417:x1847765450603136:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:1.0:1762166979.760641:0:8388:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945cc355b200/0x2f180c4effbabf36 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.760656:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166979.760658:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166979.760664:0:8388:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355b200/0x2f180c4effbabf36 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [16384->24575] (req 16384->24575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.760676:0:8388:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cc355b200/0x2f180c4effbabf36 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [16384->24575] (req 16384->24575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.760767:0:8388:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945cc355b200/0x2f180c4effbabf36 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [16384->24575] (req 16384->24575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.760775:0:8388:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355b200/0x2f180c4effbabf36 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [16384->24575] (req 16384->24575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.760784:0:8388:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945cc355b200/0x2f180c4effbabf36 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [16384->24575] (req 16384->24575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.760791:0:8388:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355b200 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166979.760795:0:8388:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc355b200/0x2f180c4effbabf36 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [16384->24575] (req 16384->24575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.760802:0:8388:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc355b200/0x2f180c4effbabf36 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [16384->24575] (req 16384->24575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.760817:0:8388:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945cc355b200/0x2f180c4effbabf36 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [16384->24575] (req 16384->24575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.760824:0:8388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cc355b200/0x2f180c4effbabf36 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [16384->24575] (req 16384->24575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166979.760888:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc3551f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+17:2417:x1847765450603136:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 296us (433us total) trans 0 rc 8192/8192 00000100:00100000:1.0:1762166979.760896:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2511 00000100:00100000:3.0:1762166979.762252:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166979.762313:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450603264 00000100:00100000:1.0:1762166979.762323:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450603264 00000100:00100000:1.0:1762166979.762390:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2512 00000100:00100000:1.0:1762166979.762401:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc3552300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450603264:12345-192.168.204.38@tcp:4:lfs.0 00002000:00010000:1.0:1762166979.762454:0:8388:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa8e:0x0] initial LVB size: 12288, mtime: 0x690888c3, atime: 0x0, ctime: 0x690888c3, blocks: 0x18 00010000:00010000:1.0:1762166979.762462:0:8388:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945cc355ac00/0x2f180c4effbabf3d lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.762474:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166979.762503:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166979.762509:0:8388:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355ac00/0x2f180c4effbabf3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [16384->24575] (req 16384->24575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.762522:0:8388:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cc355ac00/0x2f180c4effbabf3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [16384->24575] (req 16384->24575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000001:00080000:2.0:1762166979.764233:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876550 is committed 00002000:00010000:1.0:1762166979.764318:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa8e:0x0] updating lvb size from disk: 12288 -> 24576 00002000:00010000:1.0:1762166979.764323:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa8e:0x0] updating lvb blocks from disk: 24 -> 40 00010000:00010000:1.0:1762166979.764331:0:8388:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945cc355ac00/0x2f180c4effbabf3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [16384->24575] (req 16384->24575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.764338:0:8388:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355ac00/0x2f180c4effbabf3d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [16384->24575] (req 16384->24575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.764344:0:8388:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945cc355ac00/0x2f180c4effbabf3d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [16384->24575] (req 16384->24575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.764348:0:8388:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355ac00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166979.764351:0:8388:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc355ac00/0x2f180c4effbabf3d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [16384->24575] (req 16384->24575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.764356:0:8388:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc355ac00/0x2f180c4effbabf3d lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [16384->24575] (req 16384->24575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.764378:0:8388:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945cc355ac00/0x2f180c4effbabf3d lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [16384->24575] (req 16384->24575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.764386:0:8388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cc355ac00/0x2f180c4effbabf3d lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [16384->24575] (req 16384->24575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166979.764520:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc3552300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450603264:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 2119us (2274us total) trans 17179876550 rc 0/0 00000100:00100000:1.0:1762166979.764532:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2512 00000100:00100000:3.0:1762166979.766035:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.766123:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450603392 00000100:00100000:0.0:1762166979.766134:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450603392 00000100:00100000:0.0:1762166979.766188:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19221 00000100:00100000:0.0:1762166979.766198:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc3552680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450603392:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:0.0:1762166979.766349:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc3552680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450603392:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 153us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166979.766357:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19221 00000100:00100000:3.0:1762166979.767774:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.767820:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450603520 00000100:00100000:0.0:1762166979.767827:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450603520 00000100:00100000:0.0:1762166979.767883:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19222 00000100:00100000:0.0:1762166979.767895:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc3550380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450603520:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:0.0:1762166979.767979:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc3550380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450603520:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 87us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166979.767987:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19222 00000100:00100000:3.0:1762166979.770459:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166979.770565:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450603648 00000100:00100000:1.0:1762166979.770582:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450603648 00000100:00100000:1.0:1762166979.770666:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2513 00000100:00100000:1.0:1762166979.770676:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc3550a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450603648:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:1.0:1762166979.770707:0:8388:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945cc355b600/0x2f180c4effbabf44 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.770719:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166979.770721:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166979.770726:0:8388:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355b600/0x2f180c4effbabf44 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [200704->204799] (req 200704->204799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.770737:0:8388:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cc355b600/0x2f180c4effbabf44 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [200704->204799] (req 200704->204799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.770852:0:8388:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945cc355b600/0x2f180c4effbabf44 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [200704->204799] (req 200704->204799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.770861:0:8388:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355b600/0x2f180c4effbabf44 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [200704->204799] (req 200704->204799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.770870:0:8388:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945cc355b600/0x2f180c4effbabf44 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [200704->204799] (req 200704->204799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.770877:0:8388:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355b600 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166979.770882:0:8388:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc355b600/0x2f180c4effbabf44 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [200704->204799] (req 200704->204799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.770891:0:8388:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc355b600/0x2f180c4effbabf44 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [200704->204799] (req 200704->204799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.770906:0:8388:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945cc355b600/0x2f180c4effbabf44 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [200704->204799] (req 200704->204799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.770919:0:8388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cc355b600/0x2f180c4effbabf44 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [200704->204799] (req 200704->204799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166979.771001:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc3550a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450603648:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 326us (546us total) trans 0 rc 37/37 00000100:00100000:1.0:1762166979.771010:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2513 00000100:00100000:3.0:1762166979.772171:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166979.772215:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450603776 00000100:00100000:1.0:1762166979.772223:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450603776 00000100:00100000:1.0:1762166979.772270:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2514 00000100:00100000:1.0:1762166979.772280:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc3551500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450603776:12345-192.168.204.38@tcp:4:lfs.0 00002000:00010000:1.0:1762166979.772315:0:8388:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa8e:0x0] initial LVB size: 24576, mtime: 0x690888c3, atime: 0x0, ctime: 0x690888c3, blocks: 0x28 00010000:00010000:1.0:1762166979.772323:0:8388:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945cc355a600/0x2f180c4effbabf4b lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.772330:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166979.772332:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166979.772336:0:8388:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355a600/0x2f180c4effbabf4b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [200704->204799] (req 200704->204799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.772356:0:8388:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cc355a600/0x2f180c4effbabf4b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [200704->204799] (req 200704->204799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000001:00080000:2.0:1762166979.773960:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876551 is committed 00002000:00010000:1.0:1762166979.774039:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa8e:0x0] updating lvb size from disk: 24576 -> 200741 00002000:00010000:1.0:1762166979.774046:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa8e:0x0] updating lvb blocks from disk: 40 -> 48 00010000:00010000:1.0:1762166979.774055:0:8388:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945cc355a600/0x2f180c4effbabf4b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [200704->204799] (req 200704->204799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.774069:0:8388:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355a600/0x2f180c4effbabf4b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [200704->204799] (req 200704->204799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.774077:0:8388:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945cc355a600/0x2f180c4effbabf4b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [200704->204799] (req 200704->204799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.774084:0:8388:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355a600 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166979.774086:0:8388:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc355a600/0x2f180c4effbabf4b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [200704->204799] (req 200704->204799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.774094:0:8388:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc355a600/0x2f180c4effbabf4b lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [200704->204799] (req 200704->204799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.774108:0:8388:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945cc355a600/0x2f180c4effbabf4b lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [200704->204799] (req 200704->204799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.774120:0:8388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cc355a600/0x2f180c4effbabf4b lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [200704->204799] (req 200704->204799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166979.774189:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc3551500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450603776:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 1910us (2021us total) trans 17179876551 rc 0/0 00000100:00100000:1.0:1762166979.774195:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2514 00000100:00100000:3.0:1762166979.775687:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166979.775730:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450603904 00000100:00100000:1.0:1762166979.775740:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450603904 00000100:00100000:1.0:1762166979.775788:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30673 00000100:00100000:1.0:1762166979.775798:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4bd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+541:61866:x1847765450603904:12345-192.168.204.38@tcp:44:lfs.0 00000001:00080000:2.0:1762166979.777653:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294992306 is committed 00000020:00080000:2.0:1762166979.777680:0:7412:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0001: 57 batchid updated 00010000:00010000:3.0:1762166979.777706:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbabe2c lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00000020:00080000:0.0:1762166979.777715:0:7435:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 57 00010000:00010000:3.0:1762166979.777722:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbabe2c lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166979.777732:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbabe2c lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166979.777738:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355b000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166979.777744:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbabe2c lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166979.777753:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbabe2c lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166979.777774:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:3.0:1762166979.777780:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166979.777784:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbabe2c lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166979.777791:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbabe2c lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166979.777816:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbabf0c lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x616:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166979.777823:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbabf0c lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x616:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166979.777829:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbabf0c lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x616:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166979.777849:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355aa00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166979.777854:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbabf0c lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x616:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166979.777861:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbabf0c lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x616:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00000020:00080000:0.0:1762166979.777862:0:7435:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 57 cancel update log [0x240000400:0x2:0x0].56: rc = 0 00000100:00100000:1.0:1762166979.777883:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4bd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+530:61866:x1847765450603904:12345-192.168.204.38@tcp:44:lfs.0 Request processed in 2072us (2186us total) trans 0 rc 0/0 00000020:00080000:0.0:1762166979.777884:0:7435:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 57 00010000:00010000:3.0:1762166979.777887:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x616:0x0].0x0 (ffff945bc812e900) 00010000:00010000:3.0:1762166979.777900:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166979.777907:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbabf0c lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x616:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00000100:00100000:1.0:1762166979.777914:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30673 00010000:00010000:3.0:1762166979.777929:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbabf0c lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x616:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00000100:00100000:3.0:1762166979.779187:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166979.779218:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.779243:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450604032 00000100:00100000:0.0:1762166979.779256:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450604032 00000100:00100000:2.0:1762166979.779281:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450604160 00000100:00100000:2.0:1762166979.779287:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450604160 00000100:00100000:0.0:1762166979.779320:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19223 00000100:00100000:0.0:1762166979.779333:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4bdb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+17:2416:x1847765450604032:12345-192.168.204.38@tcp:16:lfs.0 00000100:00100000:2.0:1762166979.779339:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19224 00000100:00100000:2.0:1762166979.779352:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4bd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+20:2416:x1847765450604160:12345-192.168.204.38@tcp:16:lfs.0 00000100:00100000:0.0:1762166979.779457:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4bdb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+17:2416:x1847765450604032:12345-192.168.204.38@tcp:16:lfs.0 Request processed in 127us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166979.779466:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19223 00000001:00080000:3.0:1762166979.780371:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843383 is committed 00000001:00080000:3.0:1762166979.780381:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843381 is committed 00000100:00100000:2.0:1762166979.780542:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4bd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+16:2416:x1847765450604160:12345-192.168.204.38@tcp:16:lfs.0 Request processed in 1192us (1321us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166979.780554:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19224 00000100:00100000:3.0:1762166979.787128:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166979.787167:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166979.787204:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.787247:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450604544 00000100:00100000:0.0:1762166979.787248:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450604288 00000100:00100000:2.0:1762166979.787262:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450604544 00000100:00100000:0.0:1762166979.787262:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450604288 00000100:00100000:2.0:1762166979.787351:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450604416 00000100:00100000:2.0:1762166979.787356:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450604416 00000100:00100000:0.0:1762166979.787376:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19225 00000100:00100000:3.0:1762166979.787389:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19226 00000100:00100000:0.0:1762166979.787393:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4bd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450604544:12345-192.168.204.38@tcp:1:lfs.0 00000100:00100000:3.0:1762166979.787412:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4bd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450604288:12345-192.168.204.38@tcp:1:lfs.0 00000100:00100000:1.0:1762166979.787423:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19227 00000100:00100000:1.0:1762166979.787470:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4bd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+16:2419:x1847765450604416:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:3.0:1762166979.787473:0:35248:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effbabf52 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.787474:0:8380:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde400/0x2f180c4effbabf59 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166979.787540:0:35248:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166979.787543:0:35248:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166979.787547:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166979.787551:0:35248:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effbabf52 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.787552:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166979.787558:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde400/0x2f180c4effbabf59 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.787570:0:35247:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945cc355a600/0x2f180c4effbabf60 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166979.787605:0:35248:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effbabf52 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.787623:0:35247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166979.787627:0:8380:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde400/0x2f180c4effbabf59 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.787629:0:35247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166979.787642:0:35247:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cc355a600/0x2f180c4effbabf60 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166979.787648:0:35248:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effbabf52 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.787652:0:8380:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde400/0x2f180c4effbabf59 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.787661:0:35247:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cc355a600/0x2f180c4effbabf60 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166979.787674:0:35248:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effbabf52 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.787686:0:8380:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde400/0x2f180c4effbabf59 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166979.787725:0:35248:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effbabf52 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.787726:0:8380:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde400/0x2f180c4effbabf59 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.787742:0:35247:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945cc355a600/0x2f180c4effbabf60 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166979.787751:0:35248:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8473600 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166979.787753:0:8380:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bde400 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166979.787763:0:35248:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effbabf52 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.787763:0:8380:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde400/0x2f180c4effbabf59 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.787790:0:35247:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945cc355a600/0x2f180c4effbabf60 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166979.787808:0:35248:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effbabf52 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.787808:0:8380:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde400/0x2f180c4effbabf59 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.787813:0:35247:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945cc355a600/0x2f180c4effbabf60 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.787869:0:35247:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355a600 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166979.787870:0:35248:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effbabf52 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.787870:0:8380:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde400/0x2f180c4effbabf59 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.787891:0:35247:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945cc355a600/0x2f180c4effbabf60 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166979.787903:0:35248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effbabf52 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.787903:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde400/0x2f180c4effbabf59 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.787918:0:35247:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945cc355a600/0x2f180c4effbabf60 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.787961:0:35247:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945cc355a600/0x2f180c4effbabf60 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.787970:0:35247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cc355a600/0x2f180c4effbabf60 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166979.788035:0:35248:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4bd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450604288:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 631us (928us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166979.788036:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4bd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450604544:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 644us (863us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166979.788058:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4bd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+16:2419:x1847765450604416:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 610us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166979.788060:0:35248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19226 00000100:00100000:0.0:1762166979.788076:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19225 00000100:00100000:1.0:1762166979.788089:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19227 00000100:00100000:3.0:1762166979.789083:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166979.789133:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450604800 00000100:00100000:1.0:1762166979.789144:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450604800 00000100:00100000:1.0:1762166979.789190:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30674 00000100:00100000:1.0:1762166979.789195:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4bd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+529:61866:x1847765450604800:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:1.0:1762166979.789277:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbabf67 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x616:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166979.789288:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbabf67 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x616:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166979.789294:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbabf67 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x616:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00010000:1.0:1762166979.789452:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000d185c46c reply state 00000000f8ed6410 transno 4294992307 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbabf67 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x616:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166979.789467:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbabf67 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x616:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166979.789471:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x616:0x0].0x0 (ffff945bc812e900) 00010000:00010000:1.0:1762166979.789474:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166979.789508:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166979.789605:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4bd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+531:61866:x1847765450604800:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 409us (526us total) trans 4294992307 rc 0/0 00000100:00100000:1.0:1762166979.789614:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30674 00000100:00100000:2.0:1762166979.790455:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166979.790544:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450604928 00000100:00100000:1.0:1762166979.790550:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450604928 00000100:00100000:1.0:1762166979.790587:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19228 00000100:00100000:1.0:1762166979.790595:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+17:61866:x1847765450604928:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166979.790606:0:35247:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166979.790620:0:35247:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cc355ac00/0x2f180c4effbabf6e lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea3ff expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762166979.790637:0:35247:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa8e:0x0] initial LVB size: 200741, mtime: 0x690888c3, atime: 0x0, ctime: 0x690888c3, blocks: 0x30 00010000:00010000:1.0:1762166979.790650:0:35247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166979.790651:0:35247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166979.790656:0:35247:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355ac00/0x2f180c4effbabf6e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3ff expref: 18 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.790666:0:35247:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945cc355ac00/0x2f180c4effbabf6e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3ff expref: 18 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.790673:0:35247:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355ac00, rc 0) 00000100:00100000:1.0:1762166979.790703:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+18:61866:x1847765450604928:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 110us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166979.790707:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19228 00000100:00100000:3.0:1762166979.791583:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166979.791617:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.791667:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450605184 00000100:00100000:2.0:1762166979.791675:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450605184 00000100:00100000:1.0:1762166979.791681:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450605056 00000100:00100000:1.0:1762166979.791690:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450605056 00000100:00100000:2.0:1762166979.791733:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19229 00000100:00100000:2.0:1762166979.791748:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4bda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+16:2419:x1847765450605184:12345-192.168.204.38@tcp:2:lfs.0 00000100:00100000:1.0:1762166979.791763:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19230 00000100:00100000:1.0:1762166979.791782:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4bd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450605056:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:1.0:1762166979.791972:0:35247:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa8e:0x0] updating lvb size from disk: 200741 -> 200741 00002000:00010000:1.0:1762166979.791977:0:35247:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa8e:0x0] updating lvb mtime from disk: 1762166979 -> 1762166979 00002000:00010000:1.0:1762166979.791980:0:35247:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa8e:0x0] updating lvb atime from disk: 0 -> 1762166979 00002000:00010000:1.0:1762166979.791982:0:35247:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa8e:0x0] updating lvb ctime from disk: 1762166979 -> 1762166980 00002000:00010000:1.0:1762166979.791985:0:35247:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa8e:0x0] updating lvb blocks from disk: 48 -> 48 00002000:00010000:2.0:1762166979.791988:0:28434:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa8f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166979.791995:0:28434:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa8f:0x0] updating lvb mtime from disk: 1762166979 -> 1762166979 00002000:00010000:2.0:1762166979.791997:0:28434:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa8f:0x0] updating lvb atime from disk: 0 -> 1762166979 00002000:00010000:2.0:1762166979.792000:0:28434:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa8f:0x0] updating lvb ctime from disk: 1762166979 -> 1762166980 00002000:00010000:2.0:1762166979.792003:0:28434:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa8f:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1762166979.792042:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4bd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450605056:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 266us (422us total) trans 17179876552 rc 0/0 00000100:00100000:2.0:1762166979.792048:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4bda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450605184:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 302us (462us total) trans 21474843384 rc 0/0 00000100:00100000:1.0:1762166979.792061:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19230 00000100:00100000:2.0:1762166979.792076:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19229 00000100:00100000:3.0:1762166979.792944:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166979.793002:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450605440 00000100:00100000:1.0:1762166979.793010:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450605440 00000100:00100000:1.0:1762166979.793053:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30675 00000100:00100000:1.0:1762166979.793064:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4bd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+531:61866:x1847765450605440:12345-192.168.204.38@tcp:55:lfs.0 00010000:00010000:1.0:1762166979.793126:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbabf75 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x616:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166979.793143:0:6494:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbabf05 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x616:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3e3 expref: 531 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.793153:0:6494:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbabf75 lrc: 4/0,1 mode: --/PW res: [0x240000404:0x616:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166979.793197:0:6494:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbabf05 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x616:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3e3 expref: 531 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.793211:0:6494:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbabf05 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x616:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3e3 expref: 531 pid: 6494 timeout: 698 lvb_type: 0 00000100:00100000:1.0:1762166979.793229:0:6494:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bc2300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765449756544:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166979.793341:0:6494:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc40760c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166979.794153:0:6494:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bc2300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765449756544:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166979.794175:0:6494:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbabf75 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x616:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000100:00100000:3.0:1762166979.794243:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.794310:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450605568 00000100:00100000:2.0:1762166979.794315:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450605568 00010000:00010000:2.0:1762166979.794342:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbabf05 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x616:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3e3 expref: 532 pid: 6494 timeout: 698 lvb_type: 0 00000100:00100000:2.0:1762166979.794387:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9711 00000100:00100000:2.0:1762166979.794395:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4bdbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+532:2418:x1847765450605568:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166979.794407:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166979.794413:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbabf05 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x616:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3e3 expref: 532 pid: 6494 timeout: 698 lvb_type: 0 00010000:00010000:2.0:1762166979.794424:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbabf05 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x616:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3e3 expref: 532 pid: 6494 timeout: 698 lvb_type: 0 00010000:00010000:2.0:1762166979.794448:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbabf05 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x616:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3e3 expref: 532 pid: 6494 timeout: 698 lvb_type: 0 00010000:00010000:2.0:1762166979.794467:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x616:0x0].0x0 (ffff945bc812e900) 00010000:00010000:2.0:1762166979.794471:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbabf75 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x616:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166979.794519:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbabf75 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x616:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166979.794542:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbabf75 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x616:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166979.794569:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166979.794593:0:6494:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbabf75 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x616:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166979.794603:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbabf75 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x616:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000100:00100000:2.0:1762166979.794607:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4bdbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+531:2418:x1847765450605568:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 212us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166979.794618:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9711 00010000:00010000:1.0:1762166979.794640:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbabf75 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x616:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166979.794647:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbabf75 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x616:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166979.794652:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbabf75 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x616:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166979.794657:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355b200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166979.794663:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbabf75 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x616:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166979.794670:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbabf75 lrc: 4/0,0 mode: PW/PW res: [0x240000404:0x616:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166979.794679:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x616:0x0].0x0 (ffff945bc812e900) 00010000:00010000:1.0:1762166979.794681:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1762166979.794684:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbabf75 lrc: 2/0,0 mode: --/PW res: [0x240000404:0x616:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166979.794688:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbabf75 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x616:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00000100:00100000:1.0:1762166979.794755:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4bd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+530:61866:x1847765450605440:12345-192.168.204.38@tcp:55:lfs.0 Request processed in 1690us (1806us total) trans 0 rc -22/-22 00000100:00100000:1.0:1762166979.794763:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30675 00000100:00100000:3.0:1762166979.795710:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166979.795755:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450605824 00000100:00100000:1.0:1762166979.795761:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450605824 00000100:00100000:1.0:1762166979.795796:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30676 00000100:00100000:1.0:1762166979.795805:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4bdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+530:61866:x1847765450605824:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:1.0:1762166979.795865:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166979.795882:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbabe4f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea396 expref: 530 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.795895:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:1.0:1762166979.795899:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166979.795939:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbabf7c lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166979.795950:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbabf7c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166979.795964:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbabf7c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00010000:1.0:1762166979.796080:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000027116e7a reply state 000000003958540e transno 4294992308 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbabf7c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166979.796093:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbabf7c lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166979.796100:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:1.0:1762166979.796103:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166979.796106:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166979.796174:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4bdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+531:61866:x1847765450605824:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 370us (465us total) trans 4294992308 rc 0/0 00000100:00100000:1.0:1762166979.796181:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30676 00000100:00100000:0.0:1762166979.797011:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.797055:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450605952 00000100:00100000:2.0:1762166979.797059:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450605952 00000100:00100000:2.0:1762166979.797094:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19231 00000100:00100000:2.0:1762166979.797102:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb386d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+19:61866:x1847765450605952:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166979.797114:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166979.797130:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbabf83 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea406 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.797161:0:28434:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbabee9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3ce expref: 20 pid: 35247 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166979.797171:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166979.797173:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166979.797177:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbabf83 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea406 expref: 20 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.797202:0:28434:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbabee9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3ce expref: 20 pid: 35247 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166979.797210:0:28434:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbabee9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3ce expref: 20 pid: 35247 timeout: 698 lvb_type: 1 00000100:00100000:2.0:1762166979.797221:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765449756672:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166979.797271:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1dce9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166979.797991:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765449756672:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166979.798006:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbabf83 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea406 expref: 20 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.798017:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa9800, rc 0) 00000100:00100000:2.0:1762166979.798042:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb386d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+20:61866:x1847765450605952:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 943us (1035us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166979.798048:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19231 00000100:00100000:3.0:1762166979.798209:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.798254:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450606080 00000100:00100000:2.0:1762166979.798259:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450606080 00010000:00010000:2.0:1762166979.798277:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbabee9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3ce expref: 20 pid: 35247 timeout: 698 lvb_type: 1 00000100:00100000:2.0:1762166979.798305:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9712 00000100:00100000:2.0:1762166979.798313:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4bdb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450606080:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166979.798322:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166979.798341:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbabee9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3ce expref: 20 pid: 35247 timeout: 698 lvb_type: 1 00010000:00010000:2.0:1762166979.798352:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbabee9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3ce expref: 20 pid: 35247 timeout: 698 lvb_type: 1 00010000:00010000:2.0:1762166979.798369:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbabee9 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3ce expref: 20 pid: 35247 timeout: 698 lvb_type: 1 00010000:00010000:2.0:1762166979.798381:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166979.798383:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166979.798391:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbabf83 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea406 expref: 19 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.798399:0:9458:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbabf83 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea406 expref: 19 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.798422:0:9458:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbabf83 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea406 expref: 19 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166979.798432:0:9458:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:9458:1847765449756800:192.168.204.38@tcp:105: 00000100:00100000:2.0:1762166979.798472:0:9458:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1dce9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166979.799183:0:9458:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:9458:1847765449756800:192.168.204.38@tcp:105: 00010000:00010000:2.0:1762166979.799195:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166979.799231:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4bdb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450606080:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 918us (1022us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166979.799239:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9712 00000100:00100000:3.0:1762166979.799262:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.799299:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450606208 00000100:00100000:2.0:1762166979.799304:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450606208 00000100:00100000:2.0:1762166979.799333:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19232 00000100:00100000:2.0:1762166979.799340:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4bd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+17:61866:x1847765450606208:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166979.799352:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166979.799365:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8600/0x2f180c4effbabf8a lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea40d expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.799383:0:28434:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945cc355a200/0x2f180c4effbabef0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3d5 expref: 18 pid: 35248 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166979.799391:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166979.799392:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166979.799396:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8600/0x2f180c4effbabf8a lrc: 4/0,0 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea40d expref: 18 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.799414:0:28434:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945cc355a200/0x2f180c4effbabef0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3d5 expref: 18 pid: 35248 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166979.799424:0:28434:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945cc355a200/0x2f180c4effbabef0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3d5 expref: 18 pid: 35248 timeout: 698 lvb_type: 1 00000100:00100000:2.0:1762166979.799441:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765449756928:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166979.799503:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1dce9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166979.800082:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:28434:1847765449756928:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166979.800095:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8600/0x2f180c4effbabf8a lrc: 3/0,0 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea40d expref: 18 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.800105:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa8600, rc 0) 00000100:00100000:2.0:1762166979.800133:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4bd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+18:61866:x1847765450606208:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 793us (872us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166979.800141:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19232 00000100:00100000:0.0:1762166979.800355:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.800406:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450606336 00000100:00100000:2.0:1762166979.800411:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450606336 00010000:00010000:2.0:1762166979.800427:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945cc355a200/0x2f180c4effbabef0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3d5 expref: 18 pid: 35248 timeout: 698 lvb_type: 1 00000100:00100000:2.0:1762166979.800456:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9713 00000100:00100000:2.0:1762166979.800465:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7c33c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450606336:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166979.800474:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166979.800509:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945cc355a200/0x2f180c4effbabef0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3d5 expref: 18 pid: 35248 timeout: 698 lvb_type: 1 00010000:00010000:2.0:1762166979.800519:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945cc355a200/0x2f180c4effbabef0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3d5 expref: 18 pid: 35248 timeout: 698 lvb_type: 1 00010000:00010000:2.0:1762166979.800540:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cc355a200/0x2f180c4effbabef0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3d5 expref: 18 pid: 35248 timeout: 698 lvb_type: 1 00010000:00010000:2.0:1762166979.800550:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166979.800552:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166979.800557:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8600/0x2f180c4effbabf8a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea40d expref: 17 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.800566:0:9458:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8600/0x2f180c4effbabf8a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea40d expref: 17 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.800584:0:9458:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8600/0x2f180c4effbabf8a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea40d expref: 17 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166979.800595:0:9458:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:9458:1847765449757056:192.168.204.38@tcp:105: 00000100:00100000:2.0:1762166979.800635:0:9458:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1dce9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166979.801506:0:9458:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:9458:1847765449757056:192.168.204.38@tcp:105: 00010000:00010000:2.0:1762166979.801518:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166979.801541:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7c33c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450606336:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1079us (1189us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166979.801547:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9713 00000100:00100000:0.0:1762166979.801643:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.801678:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450606464 00000100:00100000:2.0:1762166979.801683:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450606464 00000100:00100000:2.0:1762166979.801715:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19233 00000100:00100000:2.0:1762166979.801723:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb384380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+19:61866:x1847765450606464:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166979.801736:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166979.801749:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbabf91 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea414 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.801768:0:28434:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc8472800/0x2f180c4effbabef7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3dc expref: 20 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166979.801775:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166979.801777:0:28434:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166979.801780:0:28434:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbabf91 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea414 expref: 20 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.801802:0:28434:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc8472800/0x2f180c4effbabef7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3dc expref: 20 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166979.801814:0:28434:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc8472800/0x2f180c4effbabef7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3dc expref: 20 pid: 28434 timeout: 698 lvb_type: 1 00000100:00100000:2.0:1762166979.801824:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765449757184:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166979.801875:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011c7000 going to sleep for 11 seconds 00000100:00100000:2.0:1762166979.802852:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765449757184:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166979.802901:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbabf91 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea414 expref: 20 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.802923:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa8200, rc 0) 00000100:00100000:2.0:1762166979.802998:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb384380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+20:61866:x1847765450606464:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1275us (1355us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166979.803009:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19233 00000100:00100000:1.0:1762166979.803077:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.803123:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450606592 00000100:00100000:2.0:1762166979.803129:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450606592 00010000:00010000:2.0:1762166979.803152:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472800/0x2f180c4effbabef7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3dc expref: 20 pid: 28434 timeout: 698 lvb_type: 1 00000100:00100000:2.0:1762166979.803183:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9714 00000100:00100000:2.0:1762166979.803191:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450606592:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166979.803203:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166979.803221:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc8472800/0x2f180c4effbabef7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3dc expref: 20 pid: 28434 timeout: 698 lvb_type: 1 00010000:00010000:2.0:1762166979.803230:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc8472800/0x2f180c4effbabef7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3dc expref: 20 pid: 28434 timeout: 698 lvb_type: 1 00010000:00010000:2.0:1762166979.803247:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8472800/0x2f180c4effbabef7 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3dc expref: 20 pid: 28434 timeout: 698 lvb_type: 1 00010000:00010000:2.0:1762166979.803256:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166979.803258:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166979.803261:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbabf91 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea414 expref: 19 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.803268:0:9458:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbabf91 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea414 expref: 19 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.803295:0:9458:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbabf91 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea414 expref: 19 pid: 28434 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166979.803305:0:9458:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:9458:1847765449757312:192.168.204.38@tcp:105: 00000100:00100000:2.0:1762166979.803361:0:9458:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011c7000 going to sleep for 11 seconds 00000100:00100000:2.0:1762166979.804374:0:9458:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:9458:1847765449757312:192.168.204.38@tcp:105: 00010000:00010000:2.0:1762166979.804387:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166979.804438:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450606592:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1242us (1357us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166979.804448:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9714 00000100:00100000:1.0:1762166979.804649:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166979.804688:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.804704:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450606720 00000100:00100000:2.0:1762166979.804709:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450606720 00000100:00100000:1.0:1762166979.804731:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.804761:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450606848 00000100:00100000:2.0:1762166979.804767:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450606848 00000100:00100000:3.0:1762166979.804777:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450606976 00000100:00100000:3.0:1762166979.804788:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450606976 00000100:00100000:2.0:1762166979.804817:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19234 00000100:00100000:1.0:1762166979.804832:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19235 00000100:00100000:2.0:1762166979.804846:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450606720:12345-192.168.204.38@tcp:2:lfs.0 00000100:00100000:1.0:1762166979.804863:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450606848:12345-192.168.204.38@tcp:2:lfs.0 00000100:00100000:3.0:1762166979.804864:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19236 00000100:00100000:3.0:1762166979.804882:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450606976:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:2.0:1762166979.805017:0:8383:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 200741 -> 200741 00002000:00010000:1.0:1762166979.805017:0:8380:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166979.805025:0:8383:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166979 -> 1762166979 00002000:00010000:1.0:1762166979.805025:0:8380:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166979 -> 1762166979 00002000:00010000:2.0:1762166979.805032:0:8383:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166979 -> 1762166979 00002000:00010000:3.0:1762166979.805034:0:35247:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166979.805034:0:8380:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166979 -> 1762166979 00002000:00010000:2.0:1762166979.805036:0:8383:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166979 -> 1762166980 00002000:00010000:3.0:1762166979.805050:0:35247:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166979 -> 1762166979 00002000:00010000:2.0:1762166979.805051:0:8383:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 96 -> 96 00002000:00010000:1.0:1762166979.805052:0:8380:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166979 -> 1762166980 00002000:00010000:3.0:1762166979.805067:0:35247:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166979 -> 1762166979 00002000:00010000:1.0:1762166979.805068:0:8380:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00002000:00010000:3.0:1762166979.805086:0:35247:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166979 -> 1762166980 00002000:00010000:3.0:1762166979.805091:0:35247:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1762166979.805107:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765450606720:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 277us (457us total) trans 17179876553 rc 0/0 00000100:00100000:2.0:1762166979.805121:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19234 00000100:00100000:1.0:1762166979.805121:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450606848:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 263us (429us total) trans 21474843385 rc 0/0 00000100:00100000:1.0:1762166979.805139:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19235 00000100:00100000:3.0:1762166979.805149:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450606976:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 262us (413us total) trans 17179876554 rc 0/0 00000100:00100000:3.0:1762166979.805163:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19236 00000100:00100000:3.0:1762166979.806131:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.806191:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450607232 00000100:00100000:0.0:1762166979.806197:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450607232 00000100:00100000:0.0:1762166979.806241:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11922 00000100:00100000:0.0:1762166979.806250:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4bd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+531:61866:x1847765450607232:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:0.0:1762166979.806330:0:19593:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x240000404:0x5eb:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a000/0x2f180c4effbabec6 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3c7 expref: 531 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.806365:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbabf98 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166979.806378:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbabe25 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea37a expref: 531 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.806386:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbabe33 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea381 expref: 531 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.806393:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbabf98 lrc: 5/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166979.806422:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbabe33 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea381 expref: 531 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.806433:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbabe33 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea381 expref: 531 pid: 6495 timeout: 698 lvb_type: 0 00000100:00100000:0.0:1762166979.806453:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcb387480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449757440:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166979.806587:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbabe25 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea37a expref: 531 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.806598:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbabe25 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea37a expref: 531 pid: 6495 timeout: 698 lvb_type: 0 00000100:00100000:0.0:1762166979.806608:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcb385f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449757568:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166979.806638:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc350f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166979.807430:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcb387480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449757440:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166979.807606:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcb385f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449757568:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166979.807632:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbabf98 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:3.0:1762166979.807677:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166979.807750:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.807794:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450607360 00000100:00100000:0.0:1762166979.807799:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450607360 00010000:00010000:0.0:1762166979.807819:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbabe33 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea381 expref: 532 pid: 6495 timeout: 698 lvb_type: 0 00000100:00100000:2.0:1762166979.807852:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450607488 00000100:00100000:2.0:1762166979.807860:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450607488 00000100:00100000:0.0:1762166979.807872:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9715 00010000:00010000:2.0:1762166979.807884:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbabe25 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea37a expref: 533 pid: 6495 timeout: 698 lvb_type: 0 00000100:00100000:0.0:1762166979.807888:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4bdad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+533:2417:x1847765450607360:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166979.807902:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166979.807910:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbabe33 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea381 expref: 533 pid: 6495 timeout: 698 lvb_type: 0 00010000:00010000:0.0:1762166979.807927:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbabe33 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea381 expref: 533 pid: 6495 timeout: 698 lvb_type: 0 00000100:00100000:2.0:1762166979.807933:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9716 00000100:00100000:2.0:1762166979.807951:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4bda680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+533:2418:x1847765450607488:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166979.807963:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166979.807964:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbabe33 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea381 expref: 533 pid: 6495 timeout: 698 lvb_type: 0 00010000:00010000:2.0:1762166979.807977:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbabe25 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea37a expref: 533 pid: 6495 timeout: 698 lvb_type: 0 00010000:00010000:2.0:1762166979.808023:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbabe25 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea37a expref: 532 pid: 6495 timeout: 698 lvb_type: 0 00010000:00010000:0.0:1762166979.808033:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:0.0:1762166979.808038:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbabf98 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166979.808045:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbabf98 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166979.808048:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166979.808067:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbabe25 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea37a expref: 532 pid: 6495 timeout: 698 lvb_type: 0 00010000:00010000:2.0:1762166979.808080:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00000100:00100000:0.0:1762166979.808086:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4bdad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+531:2417:x1847765450607360:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 202us (460us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166979.808090:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbabf98 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:0.0:1762166979.808102:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9715 00010000:00010000:2.0:1762166979.808107:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbabf98 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166979.808118:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbabf98 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166979.808143:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166979.808169:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbabf98 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166979.808179:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbabf98 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:2.0:1762166979.808190:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4bda680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+530:2418:x1847765450607488:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 239us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166979.808199:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9716 00010000:00010000:0.0:1762166979.808202:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbabf9f lrc: 3/0,1 mode: --/EX res: [0x240000404:0x616:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166979.808224:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbabf13 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x616:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3ea expref: 529 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.808233:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbabf9f lrc: 4/0,1 mode: --/EX res: [0x240000404:0x616:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166979.808257:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbabf13 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x616:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3ea expref: 529 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.808268:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbabf13 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x616:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3ea expref: 529 pid: 6494 timeout: 698 lvb_type: 0 00000100:00100000:0.0:1762166979.808278:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcb386680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449757696:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166979.808323:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc350f000 going to sleep for 11 seconds 00000100:00100000:0.0:1762166979.808956:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcb386680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449757696:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166979.808969:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbabf9f lrc: 3/0,1 mode: --/EX res: [0x240000404:0x616:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:1.0:1762166979.809140:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.809178:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450607616 00000100:00100000:2.0:1762166979.809182:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450607616 00010000:00010000:2.0:1762166979.809197:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbabf13 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x616:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3ea expref: 530 pid: 6494 timeout: 698 lvb_type: 0 00000100:00100000:2.0:1762166979.809224:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9717 00000100:00100000:2.0:1762166979.809233:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+530:2419:x1847765450607616:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166979.809242:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166979.809248:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbabf13 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x616:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3ea expref: 530 pid: 6494 timeout: 698 lvb_type: 0 00010000:00010000:2.0:1762166979.809259:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbabf13 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x616:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3ea expref: 530 pid: 6494 timeout: 698 lvb_type: 0 00010000:00010000:2.0:1762166979.809274:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbabf13 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x616:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3ea expref: 530 pid: 6494 timeout: 698 lvb_type: 0 00010000:00010000:2.0:1762166979.809287:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x616:0x0].0x0 (ffff945bc812e900) 00010000:00010000:2.0:1762166979.809291:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbabf9f lrc: 3/0,1 mode: --/EX res: [0x240000404:0x616:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166979.809303:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbabf9f lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x616:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166979.809309:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbabf9f lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x616:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166979.809332:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166979.809353:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbabf9f lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x616:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166979.809361:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbabf9f lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x616:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:2.0:1762166979.809369:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+529:2419:x1847765450607616:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 134us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166979.809379:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9717 00000100:00100000:0.0:1762166979.809691:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcb386680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449757824:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166979.809731:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166979.809760:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc350f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166979.809784:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449757824 00000100:00100000:3.0:1762166979.809790:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449757824 00000100:00100000:3.0:1762166979.809820:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1419 00000100:00100000:3.0:1762166979.809827:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb385f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449757824:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166979.809911:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb385f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449757824:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 85us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166979.809919:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1419 00000100:00100000:0.0:1762166979.809935:0:19593:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 17179876543 gen 2 00000004:00080000:0.0:1762166979.809940:0:19593:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 17179876539 committed transno 17179876543 00000004:00080000:0.0:1762166979.809953:0:19593:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf79e8380, transno 17179876540 00000004:00080000:0.0:1762166979.809964:0:19593:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf79eb100, transno 17179876541 00000004:00080000:0.0:1762166979.809966:0:19593:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf79e8a80, transno 17179876542 00000004:00080000:0.0:1762166979.809968:0:19593:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf79ead80, transno 17179876543 00000100:00100000:0.0:1762166979.809972:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcb386680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449757824:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166979.810002:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcb386680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449757952:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166979.810022:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166979.810040:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc350f6c0 going to sleep for 11 seconds 00000004:00080000:3.0:1762166979.810060:0:9994:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0001: 0 changes, 0 in progress, 0 in flight, 4 done 00000100:00100000:2.0:1762166979.810066:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449757952 00000100:00100000:2.0:1762166979.810072:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449757952 00000100:00100000:2.0:1762166979.810103:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1420 00000100:00100000:2.0:1762166979.810112:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb387480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449757952:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762166979.810167:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb387480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449757952:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 58us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166979.810173:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1420 00000100:00100000:0.0:1762166979.810181:0:19593:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 21474843381 gen 2 00000004:00080000:0.0:1762166979.810185:0:19593:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 21474843377 committed transno 21474843381 00000004:00080000:0.0:1762166979.810194:0:19593:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bccb7f100, transno 21474843378 00000004:00080000:0.0:1762166979.810204:0:19593:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf1cd0700, transno 21474843379 00000004:00080000:0.0:1762166979.810206:0:19593:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf1cd1f80, transno 21474843380 00000004:00080000:0.0:1762166979.810208:0:19593:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf1cd0e00, transno 21474843381 00000100:00100000:0.0:1762166979.810211:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcb386680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449757952:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166979.810244:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcb386680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449758080:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166979.810260:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166979.810275:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7c77780 going to sleep for 11 seconds 00000004:00080000:2.0:1762166979.810293:0:9158:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0001: 0 changes, 0 in progress, 0 in flight, 4 done 00000100:00100000:3.0:1762166979.810301:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449758080 00000100:00100000:3.0:1762166979.810305:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449758080 00000100:00100000:3.0:1762166979.810332:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1421 00000100:00100000:3.0:1762166979.810340:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb387800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449758080:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166979.810397:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb387800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449758080:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 58us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166979.810404:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1421 00000100:00100000:0.0:1762166979.810431:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcb386680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449758080:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166979.810469:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcb386680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449758208:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166979.810503:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166979.810518:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7c77000 going to sleep for 11 seconds 00000100:00100000:3.0:1762166979.810538:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449758208 00000100:00100000:3.0:1762166979.810543:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449758208 00000100:00100000:3.0:1762166979.810566:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1422 00000100:00100000:3.0:1762166979.810571:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb384e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449758208:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166979.810611:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb384e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449758208:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 40us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166979.810615:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1422 00000100:00100000:0.0:1762166979.810625:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcb386680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449758208:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166979.810654:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcb386680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449758336:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166979.810677:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166979.810696:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc350f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166979.810708:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449758336 00000100:00100000:3.0:1762166979.810711:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449758336 00000100:00100000:3.0:1762166979.810726:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1423 00000100:00100000:3.0:1762166979.810730:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb385c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449758336:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166979.810766:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb385c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449758336:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 35us (88us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166979.810775:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1423 00000100:00100000:0.0:1762166979.810787:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcb386680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449758336:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166979.810819:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcb386680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449758464:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166979.810858:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166979.810876:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7c77cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166979.810886:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449758464 00000100:00100000:3.0:1762166979.810889:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449758464 00000100:00100000:3.0:1762166979.810910:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1424 00000100:00100000:3.0:1762166979.810913:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb387100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449758464:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166979.810950:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb387100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449758464:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 37us (93us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166979.810956:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1424 00000100:00100000:0.0:1762166979.810974:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcb386680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449758464:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166979.811005:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcb386680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449758592:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166979.811029:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166979.811049:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cee083e40 going to sleep for 11 seconds 00000100:00100000:3.0:1762166979.811054:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449758592 00000100:00100000:3.0:1762166979.811059:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449758592 00000100:00100000:3.0:1762166979.811081:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1425 00000100:00100000:3.0:1762166979.811087:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb384700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449758592:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166979.811136:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb384700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449758592:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 49us (106us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166979.811144:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1425 00000100:00100000:0.0:1762166979.811154:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcb386680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449758592:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166979.811188:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcb386680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449758720:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166979.811210:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166979.811232:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc350f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166979.811234:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449758720 00000100:00100000:3.0:1762166979.811239:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449758720 00000100:00100000:3.0:1762166979.811263:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1426 00000100:00100000:3.0:1762166979.811271:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb385180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449758720:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166979.811325:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb385180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449758720:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 55us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166979.811333:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcb386680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449758720:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166979.811334:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1426 00000040:00080000:0.0:1762166979.811459:0:19593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x2:0x0].57, 552 off69768 00000001:00080000:0.0:1762166979.811466:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992309 00000100:00100000:0.0:1762166979.811535:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcb386680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449758848:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166979.811560:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166979.811583:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7c77cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166979.811613:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449758848 00000100:00100000:3.0:1762166979.811622:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449758848 00000100:00100000:3.0:1762166979.811650:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1427 00000100:00100000:3.0:1762166979.811658:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb384a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449758848:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166979.811760:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb384a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:19593:x1847765449758848:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 103us (198us total) trans 17179876555 rc 0/0 00000100:00100000:3.0:1762166979.811768:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1427 00000100:00100000:0.0:1762166979.811791:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcb386680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449758848:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166979.811813:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcb387b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449758976:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166979.811850:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166979.811867:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc350f600 going to sleep for 11 seconds 00000100:00100000:3.0:1762166979.811890:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449758976 00000100:00100000:3.0:1762166979.811895:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449758976 00000100:00100000:3.0:1762166979.811926:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1428 00000100:00100000:3.0:1762166979.811933:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb385500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449758976:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166979.812017:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb385500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:19593:x1847765449758976:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 84us (180us total) trans 21474843386 rc 0/0 00000100:00100000:3.0:1762166979.812025:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1428 00000100:00100000:0.0:1762166979.812033:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcb387b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449758976:0@lo:1000:mdt_rdpg00_003.0 00000001:00080000:0.0:1762166979.812077:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992310 00010000:00010000:0.0:1762166979.812094:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbabf9f lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x616:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166979.812101:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbabf9f lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x616:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166979.812105:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbabf9f lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x616:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166979.812112:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdfc00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166979.812115:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbabf9f lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x616:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166979.812119:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbabf9f lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x616:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166979.812128:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x616:0x0].0x0 (ffff945bc812e900) 00010000:00010000:0.0:1762166979.812130:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166979.812133:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbabf9f lrc: 2/0,0 mode: --/EX res: [0x240000404:0x616:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166979.812136:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbabf9f lrc: 0/0,0 mode: --/EX res: [0x240000404:0x616:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166979.812144:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbabf98 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166979.812147:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbabf98 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166979.812150:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbabf98 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166979.812153:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdf000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166979.812154:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbabf98 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166979.812157:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbabf98 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166979.812161:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:0.0:1762166979.812162:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166979.812165:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbabf98 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166979.812170:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbabf98 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166979.812180:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:0.0:1762166979.812182:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166979.812186:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a000/0x2f180c4effbabec6 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3c7 expref: 531 pid: 6494 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166979.812259:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4bd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+530:61866:x1847765450607232:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 6011us (6130us total) trans 4294992311 rc 0/0 00000100:00100000:0.0:1762166979.812269:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11922 00000020:00080000:0.0:1762166979.812273:0:19593:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1762166979.813314:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.813358:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450607744 00000100:00100000:0.0:1762166979.813364:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450607744 00000100:00100000:0.0:1762166979.813406:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30677 00000100:00100000:0.0:1762166979.813414:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+530:61866:x1847765450607744:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166979.813428:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166979.813442:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbabfa6 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea41b expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.813499:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbabfa6 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea41b expref: 531 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.813513:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbabfa6 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea41b expref: 531 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.813530:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:0.0:1762166979.813533:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166979.813536:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bde200, rc 0) 00000100:00100000:0.0:1762166979.813569:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+531:61866:x1847765450607744:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 156us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166979.813575:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30677 00000100:00100000:1.0:1762166979.814727:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.814777:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450608000 00000100:00100000:0.0:1762166979.814783:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450608000 00000100:00100000:0.0:1762166979.814825:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11923 00000100:00100000:0.0:1762166979.814843:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+531:61866:x1847765450608000:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166979.814996:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+532:61866:x1847765450608000:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 162us (269us total) trans 4294992312 rc 0/0 00000100:00100000:0.0:1762166979.815003:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11923 00000100:00100000:3.0:1762166979.815699:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.815735:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450608256 00000100:00100000:0.0:1762166979.815741:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450608256 00000100:00100000:0.0:1762166979.815778:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11924 00000100:00100000:0.0:1762166979.815786:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7be1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+532:61866:x1847765450608256:12345-192.168.204.38@tcp:35:lfs.0 00000004:00080000:0.0:1762166979.815917:0:19593:0:(mdd_object.c:3965:mdd_close()) Object [0x240000404:0x616:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:0.0:1762166979.815985:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbabfad lrc: 3/0,1 mode: --/PW res: [0x240000404:0x616:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166979.815999:0:19593:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbabfad lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x616:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166979.816010:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbabfad lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x616:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166979.816019:0:19593:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbabfad lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x616:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166979.816029:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbabfad lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x616:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166979.816034:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbabfad lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x616:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166979.816060:0:19593:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1762166979.816094:0:10257:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1762166979.816102:0:10257:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbabfad lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x616:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166979.816110:0:10257:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bde600 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166979.816114:0:10257:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbabfad lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x616:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166979.816122:0:10257:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbabfad lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x616:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166979.816134:0:10257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x616:0x0].0x0 (ffff945bc812e900) 00010000:00010000:3.0:1762166979.816137:0:10257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1762166979.816141:0:10257:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbabfad lrc: 1/0,0 mode: --/PW res: [0x240000404:0x616:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166979.816146:0:10257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbabfad lrc: 0/0,0 mode: --/PW res: [0x240000404:0x616:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166979.816162:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166979.816165:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166979.816168:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166979.816194:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7be1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+533:61866:x1847765450608256:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 408us (494us total) trans 4294992313 rc 0/0 00000100:00100000:0.0:1762166979.816202:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11924 00000100:00100000:1.0:1762166979.824719:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.824774:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450608384 00000100:00100000:0.0:1762166979.824785:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450608384 00000100:00100000:0.0:1762166979.824858:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30678 00000100:00100000:0.0:1762166979.824871:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+533:61867:x1847765450608384:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166979.824897:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166979.824928:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbabfb4 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea422 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.825010:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbabfbb lrc: 3/1,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166979.825026:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbabfbb lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166979.825039:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbabfbb lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166979.825052:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbabfc2 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166979.825059:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbabfc2 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166979.825066:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbabfc2 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166979.825161:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbabfc9 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166979.825169:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbabfc9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166979.825176:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbabfc9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:0.0:1762166979.825226:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 200741 00000004:00200000:0.0:1762166979.825231:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166979.825249:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbabfc9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166979.825260:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbabfc9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166979.825270:0:6494:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbabfbb lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166979.825276:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbabfbb lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166979.825282:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbabfbb lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166979.825288:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbabfbb lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166979.825294:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdfc00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166979.825299:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbabfbb lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166979.825307:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbabfbb lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166979.825318:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0x0 (ffff945bc4afe000) 00010000:00010000:0.0:1762166979.825321:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166979.825326:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbabfbb lrc: 3/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166979.825331:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbabfbb lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166979.825344:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbabfc2 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166979.825349:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbabfc2 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166979.825355:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbabfc2 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166979.825359:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdf800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166979.825362:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbabfc2 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166979.825367:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbabfc2 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166979.825374:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0xdd396665 (ffff945bc4afe900) 00010000:00010000:0.0:1762166979.825377:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166979.825379:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbabfc2 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166979.825385:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbabfc2 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166979.825422:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbabfb4 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea422 expref: 535 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.825437:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbabfc9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea422 expref: 534 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.825445:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:0.0:1762166979.825447:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166979.825449:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdfa00, rc 0) 00000100:00100000:0.0:1762166979.825536:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+534:61867:x1847765450608384:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 667us (828us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166979.825544:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30678 00000100:00100000:1.0:1762166979.827221:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.827283:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450608640 00000100:00100000:0.0:1762166979.827295:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450608640 00000100:00100000:0.0:1762166979.827363:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30679 00000100:00100000:0.0:1762166979.827375:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+534:61867:x1847765450608640:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166979.827395:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166979.827415:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbabfd0 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea429 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.827574:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbabfd7 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166979.827589:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbabfd7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166979.827601:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbabfd7 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:0.0:1762166979.827617:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 200741 00010000:00010000:0.0:1762166979.827739:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbabfd0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea429 expref: 537 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.827753:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbabfd7 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea429 expref: 536 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.827759:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:0.0:1762166979.827761:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1762166979.827764:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdec00, rc 0) 00000100:00100000:0.0:1762166979.827810:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+536:61867:x1847765450608640:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 438us (599us total) trans 4294992314 rc 0/0 00000100:00100000:0.0:1762166979.827814:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30679 00000100:00100000:3.0:1762166979.828832:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.828883:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450608896 00000100:00100000:0.0:1762166979.828888:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450608896 00000100:00100000:0.0:1762166979.828920:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30680 00000100:00100000:0.0:1762166979.828929:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4bdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+536:61867:x1847765450608896:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166979.828946:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166979.828957:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbabfe5 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea430 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.829015:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbabfec lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166979.829026:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbabfec lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166979.829035:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbabfec lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:0.0:1762166979.829045:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 200741 00010000:00010000:0.0:1762166979.829105:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbabfe5 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea430 expref: 539 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.829131:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbabfec lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea430 expref: 538 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.829140:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:0.0:1762166979.829143:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166979.829146:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdfe00, rc 0) 00000100:00100000:0.0:1762166979.829183:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4bdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+538:61867:x1847765450608896:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 254us (353us total) trans 4294992315 rc 0/0 00000100:00100000:0.0:1762166979.829190:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30680 00000100:00100000:1.0:1762166979.853367:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166979.853516:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450609024 00000100:00100000:3.0:1762166979.853526:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450609024 00000100:00100000:3.0:1762166979.853593:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2515 00000100:00100000:3.0:1762166979.853602:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450609024:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:3.0:1762166979.853639:0:8388:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effbabffa lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166979.853659:0:8388:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbabf83 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea406 expref: 21 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166979.853668:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166979.853670:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166979.853673:0:8388:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effbabffa lrc: 4/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166979.853708:0:8388:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbabf83 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea406 expref: 21 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166979.853723:0:8388:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbabf83 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea406 expref: 21 pid: 28434 timeout: 699 lvb_type: 0 00000100:00100000:3.0:1762166979.853738:0:8388:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4bd9180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:8388:1847765449759104:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166979.853816:0:8388:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf3a33cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166979.855082:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.855144:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450609152 00000100:00100000:2.0:1762166979.855149:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450609152 00010000:00010000:2.0:1762166979.855176:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbabf83 lrc: 5/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea406 expref: 22 pid: 28434 timeout: 699 lvb_type: 0 00000100:00100000:3.0:1762166979.855188:0:8388:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4bd9180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:8388:1847765449759104:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166979.855205:0:8388:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effbabffa lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166979.855218:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9718 00000100:00100000:2.0:1762166979.855231:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765450609152:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166979.855245:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166979.855268:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbabf83 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea406 expref: 22 pid: 28434 timeout: 699 lvb_type: 0 00010000:00010000:2.0:1762166979.855282:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbabf83 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea406 expref: 22 pid: 28434 timeout: 699 lvb_type: 0 00010000:00010000:2.0:1762166979.855304:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbabf83 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea406 expref: 22 pid: 28434 timeout: 699 lvb_type: 0 00010000:00010000:2.0:1762166979.855319:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166979.855321:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166979.855326:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effbabffa lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.855335:0:9458:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effbabffa lrc: 4/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.855362:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166979.855411:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450609152:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 185us (332us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166979.855422:0:8388:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effbabffa lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166979.855422:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9718 00010000:00010000:3.0:1762166979.855434:0:8388:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effbabffa lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.856896:0:8388:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effbabffa lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.856914:0:8388:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effbabffa lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.856923:0:8388:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effbabffa lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.856931:0:8388:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8473600 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166979.856936:0:8388:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effbabffa lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.856945:0:8388:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effbabffa lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.856964:0:8388:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effbabffa lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.856973:0:8388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8473600/0x2f180c4effbabffa lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166979.857064:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450609024:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 3458us (3702us total) trans 0 rc 200741/200741 00000100:00100000:2.0:1762166979.857075:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2515 00000100:00100000:2.0:1762166979.858652:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcb385880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449759232:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1762166979.858713:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166979.858769:0:9167:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449759232 00000100:00100000:0.0:1762166979.858779:0:9167:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449759232 00000100:00100000:0.0:1762166979.858831:0:9167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1762166979.858852:0:9167:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3636:x1847765449759232:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1762166979.858878:0:9167:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 484840768 pending 0 free 3921141760 avail 3689320448 00000100:00100000:0.0:1762166979.858931:0:9167:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3636:x1847765449759232:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166979.858939:0:9167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1762166979.858984:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcb385880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449759232:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1762166979.859042:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166979.859105:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450609280 00000100:00100000:1.0:1762166979.859116:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166979.859117:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450609280 00000100:00100000:0.0:1762166979.859171:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450609408 00000100:00100000:0.0:1762166979.859178:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450609408 00000100:00100000:2.0:1762166979.859204:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19237 00000100:00100000:2.0:1762166979.859218:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+20:2416:x1847765450609280:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166979.859237:0:28434:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1762166979.859239:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19238 00000100:00100000:0.0:1762166979.859253:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+18:2417:x1847765450609408:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166979.859258:0:28434:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbac001 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea437 expref: -99 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.859265:0:8380:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166979.859283:0:8380:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf000/0x2f180c4effbac008 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea43e expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166979.859327:0:28434:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765449759360:192.168.204.38@tcp:106: 00000100:00100000:0.0:1762166979.859334:0:8380:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcb384000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8380:1847765449759488:192.168.204.38@tcp:106: 00000100:00100000:2.0:1762166979.859580:0:28434:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011c7000 going to sleep for 11 seconds 00000100:00100000:0.0:1762166979.859580:0:8380:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7c77cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166979.860587:0:28434:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:28434:1847765449759360:192.168.204.38@tcp:106: 00000100:00100000:1.0:1762166979.860602:0:8380:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcb384000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8380:1847765449759488:192.168.204.38@tcp:106: 00010000:00010000:2.0:1762166979.860624:0:28434:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbac001 lrc: 1/0,0 mode: --/PR res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea437 expref: 21 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166979.860631:0:8380:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf000/0x2f180c4effbac008 lrc: 1/0,0 mode: --/PR res: [0x280000400:0xa8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea43e expref: 19 pid: 8380 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166979.860651:0:28434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbac001 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea437 expref: 21 pid: 28434 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166979.860653:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf000/0x2f180c4effbac008 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea43e expref: 19 pid: 8380 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166979.860680:0:28434:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa9a00, rc 0) 00010000:00010000:1.0:1762166979.860681:0:8380:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdf000, rc 0) 00000100:00100000:2.0:1762166979.860743:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+20:2416:x1847765450609280:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1530us (1703us total) trans 0 rc 301/301 00000100:00100000:1.0:1762166979.860754:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+18:2417:x1847765450609408:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1499us (1633us total) trans 0 rc 301/301 00000100:00100000:2.0:1762166979.860756:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19237 00000100:00100000:1.0:1762166979.860767:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19238 00000100:00100000:1.0:1762166979.862686:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.862775:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450609536 00000100:00100000:2.0:1762166979.862785:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450609536 00000100:00100000:2.0:1762166979.862860:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2516 00000100:00100000:2.0:1762166979.862870:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450609536:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:2.0:1762166979.862901:0:8388:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbac00f lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.862918:0:8388:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945cc355ac00/0x2f180c4effbabf6e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3ff expref: 20 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.862925:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166979.862927:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166979.862930:0:8388:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbac00f lrc: 4/1,0 mode: --/PR res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.862959:0:8388:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945cc355ac00/0x2f180c4effbabf6e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3ff expref: 20 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.862972:0:8388:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945cc355ac00/0x2f180c4effbabf6e lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3ff expref: 20 pid: 35247 timeout: 699 lvb_type: 0 00000100:00100000:2.0:1762166979.862985:0:8388:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5c380 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:8388:1847765449759616:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166979.863054:0:8388:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011c7000 going to sleep for 11 seconds 00000100:00100000:2.0:1762166979.864203:0:8388:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5c380 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:8388:1847765449759616:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166979.864234:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:2.0:1762166979.864234:0:8388:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbac00f lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166979.864395:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450609664 00000100:00100000:0.0:1762166979.864403:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450609664 00010000:00010000:0.0:1762166979.864446:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355ac00/0x2f180c4effbabf6e lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3ff expref: 21 pid: 35247 timeout: 699 lvb_type: 0 00000100:00100000:0.0:1762166979.864507:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9719 00000100:00100000:0.0:1762166979.864519:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4bd9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450609664:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166979.864537:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166979.864564:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945cc355ac00/0x2f180c4effbabf6e lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3ff expref: 21 pid: 35247 timeout: 699 lvb_type: 0 00010000:00010000:0.0:1762166979.864590:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945cc355ac00/0x2f180c4effbabf6e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3ff expref: 21 pid: 35247 timeout: 699 lvb_type: 0 00010000:00010000:0.0:1762166979.864618:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cc355ac00/0x2f180c4effbabf6e lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3ff expref: 21 pid: 35247 timeout: 699 lvb_type: 0 00010000:00010000:0.0:1762166979.864635:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166979.864638:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166979.864642:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbac00f lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.864653:0:9458:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbac00f lrc: 4/1,0 mode: PR/PR res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.864692:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166979.864747:0:8388:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbac00f lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166979.864760:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4bd9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450609664:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 238us (521us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166979.864765:0:8388:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbac00f lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166979.864779:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9719 00010000:00010000:2.0:1762166979.867156:0:8388:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbac00f lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.867173:0:8388:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbac00f lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.867182:0:8388:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbac00f lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.867189:0:8388:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa9000 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166979.867194:0:8388:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbac00f lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.867203:0:8388:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbac00f lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.867222:0:8388:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbac00f lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.867229:0:8388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbac00f lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166979.867307:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450609536:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 4434us (4626us total) trans 0 rc 200741/200741 00000100:00100000:2.0:1762166979.867317:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2516 00000100:00100000:0.0:1762166979.874727:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.874804:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450609792 00000100:00100000:2.0:1762166979.874817:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450609792 00000100:00100000:2.0:1762166979.874915:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 888 00000100:00100000:2.0:1762166979.874939:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7c33850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+538:61867:x1847765450609792:12345-192.168.204.38@tcp:103:lfs.0 00010000:00010000:2.0:1762166979.874968:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166979.875008:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbabfec lrc: 0/0,0 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea430 expref: 538 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.875032:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166979.875039:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166979.875118:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7c33850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+537:61867:x1847765450609792:12345-192.168.204.38@tcp:103:lfs.0 Request processed in 192us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166979.875127:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 888 00000100:00100000:1.0:1762166979.876316:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.876566:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450610048 00000100:00100000:0.0:1762166979.876635:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450610048 00000100:00100000:0.0:1762166979.876683:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11925 00000100:00100000:0.0:1762166979.876692:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+537:61867:x1847765450610048:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166979.876986:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+538:61867:x1847765450610048:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 294us (676us total) trans 4294992316 rc 0/0 00000100:00100000:0.0:1762166979.876994:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11925 00000100:00100000:3.0:1762166979.879887:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.880042:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450610304 00000100:00100000:0.0:1762166979.880056:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450610304 00000100:00100000:0.0:1762166979.880126:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30681 00000100:00100000:0.0:1762166979.880138:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4bdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+538:61766:x1847765450610304:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:0.0:1762166979.880177:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166979.880205:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbac016 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea445 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.880337:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbac01d lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166979.880356:0:6494:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbabfc9 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea422 expref: 539 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.880371:0:6494:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbac01d lrc: 4/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166979.880433:0:6494:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbabfc9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea422 expref: 539 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.880450:0:6494:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbabfc9 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea422 expref: 539 pid: 6494 timeout: 699 lvb_type: 0 00000100:00100000:0.0:1762166979.880470:0:6494:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcb384000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765449759744:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166979.880622:0:6494:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc350f600 going to sleep for 11 seconds 00000100:00100000:0.0:1762166979.881761:0:6494:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcb384000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765449759744:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166979.881786:0:6494:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbac01d lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000100:00100000:3.0:1762166979.882063:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.882115:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450610432 00000100:00100000:2.0:1762166979.882125:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450610432 00010000:00010000:2.0:1762166979.882162:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbabfc9 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea422 expref: 540 pid: 6494 timeout: 699 lvb_type: 0 00000100:00100000:2.0:1762166979.882205:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9720 00000100:00100000:2.0:1762166979.882218:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4bdb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+540:2418:x1847765450610432:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166979.882235:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166979.882244:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbabfc9 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea422 expref: 540 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:2.0:1762166979.882260:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbabfc9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea422 expref: 540 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:2.0:1762166979.882289:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbabfc9 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea422 expref: 540 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:2.0:1762166979.882309:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166979.882314:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbac01d lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166979.882324:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbac01d lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166979.882332:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbac01d lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166979.882369:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166979.882443:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4bdb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+539:2418:x1847765450610432:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 225us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166979.882453:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9720 00010000:00010000:0.0:1762166979.882474:0:6494:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbac01d lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166979.882513:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbac01d lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:0.0:1762166979.882540:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 200741 00010000:00010000:0.0:1762166979.882702:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbac016 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea445 expref: 540 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.882716:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbac01d lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea445 expref: 539 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.882723:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:0.0:1762166979.882727:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1762166979.882729:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bde000, rc 0) 00000100:00100000:0.0:1762166979.882769:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4bdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+539:61766:x1847765450610304:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 2635us (2894us total) trans 4294992317 rc 0/0 00000100:00100000:0.0:1762166979.882776:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30681 00000100:00100000:3.0:1762166979.884033:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.884077:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450610560 00000100:00100000:0.0:1762166979.884085:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450610560 00000100:00100000:0.0:1762166979.884145:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30682 00000100:00100000:0.0:1762166979.884156:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4bdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+539:61766:x1847765450610560:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:0.0:1762166979.884182:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166979.884201:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbac02b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea44c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.884289:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac032 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166979.884303:0:6494:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbac01d lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea445 expref: 540 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.884312:0:6494:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac032 lrc: 4/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166979.884345:0:6494:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbac01d lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea445 expref: 540 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.884359:0:6494:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbac01d lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea445 expref: 540 pid: 6494 timeout: 699 lvb_type: 0 00000100:00100000:0.0:1762166979.884375:0:6494:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcb384000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765449759872:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166979.884468:0:6494:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc350f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166979.885554:0:6494:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcb384000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765449759872:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166979.885576:0:6494:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac032 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000100:00100000:3.0:1762166979.885702:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.885752:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450610688 00000100:00100000:2.0:1762166979.885760:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450610688 00010000:00010000:2.0:1762166979.885797:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbac01d lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea445 expref: 541 pid: 6494 timeout: 699 lvb_type: 0 00000100:00100000:2.0:1762166979.885828:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9721 00000100:00100000:2.0:1762166979.885852:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4bda680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+541:2418:x1847765450610688:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166979.885867:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166979.885874:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbac01d lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea445 expref: 541 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:2.0:1762166979.885886:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbac01d lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea445 expref: 541 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:2.0:1762166979.885907:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbac01d lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea445 expref: 541 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:2.0:1762166979.885924:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166979.885928:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac032 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166979.885937:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac032 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166979.885945:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac032 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166979.885975:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166979.886031:0:6494:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac032 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000100:00100000:2.0:1762166979.886032:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4bda680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+540:2418:x1847765450610688:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 184us (332us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166979.886057:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac032 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000100:00100000:2.0:1762166979.886085:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9721 00000004:00200000:0.0:1762166979.886114:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 200741 00000004:00200000:0.0:1762166979.886119:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166979.886136:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac032 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166979.886165:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbac02b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea44c expref: 540 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.886177:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac032 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea44c expref: 539 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166979.886183:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:0.0:1762166979.886185:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166979.886187:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdf600, rc 0) 00000100:00100000:0.0:1762166979.886229:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4bdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+539:61766:x1847765450610560:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 2076us (2201us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166979.886234:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30682 00000100:00100000:3.0:1762166979.887691:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166979.887780:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450610816 00000100:00100000:1.0:1762166979.887790:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450610816 00000100:00100000:1.0:1762166979.887854:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19239 00000100:00100000:1.0:1762166979.887864:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4bd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+19:2416:x1847765450610816:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:1.0:1762166979.887880:0:8380:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166979.887903:0:8380:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cc355a200/0x2f180c4effbac039 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea453 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762166979.887926:0:8380:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa77:0x0] initial LVB size: 200741, mtime: 0x690888c3, atime: 0x690888c3, ctime: 0x690888c4, blocks: 0x60 00010000:00010000:1.0:1762166979.887942:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166979.887945:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166979.887954:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355a200/0x2f180c4effbac039 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea453 expref: 20 pid: 8380 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166979.887970:0:8380:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945cc355a200/0x2f180c4effbac039 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea453 expref: 20 pid: 8380 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166979.887984:0:8380:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355a200, rc 0) 00000100:00100000:1.0:1762166979.888029:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4bd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+20:2416:x1847765450610816:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 167us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166979.888034:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19239 00000100:00100000:2.0:1762166979.889469:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.889538:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450611072 00000100:00100000:0.0:1762166979.889546:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450611072 00000100:00100000:0.0:1762166979.889583:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11926 00000100:00100000:0.0:1762166979.889593:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+539:61766:x1847765450611072:12345-192.168.204.38@tcp:35:fsx.0 00000100:00100000:0.0:1762166979.889810:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+540:61766:x1847765450611072:12345-192.168.204.38@tcp:35:fsx.0 Request processed in 218us (356us total) trans 4294992318 rc 0/0 00000100:00100000:0.0:1762166979.889819:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11926 00000100:00100000:0.0:1762166979.891426:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166979.891575:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450611328 00000100:00100000:1.0:1762166979.891587:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450611328 00000100:00100000:1.0:1762166979.891661:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30683 00000100:00100000:1.0:1762166979.891673:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb384000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+540:61766:x1847765450611328:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:1.0:1762166979.891703:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166979.891707:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 1 00010000:00010000:1.0:1762166979.891745:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac032 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea44c expref: 540 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.891784:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbabfd7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea429 expref: 539 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.891802:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbabfa6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea41b expref: 538 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.891814:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:1.0:1762166979.891821:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166979.891853:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a000/0x2f180c4effbac040 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea45a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.891924:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbac047 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166979.891940:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbac047 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166979.891951:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbac047 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000040:00080000:1.0:1762166979.892257:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5921, 88 off463776 00000004:00080000:1.0:1762166979.892266:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 599040787867ns, next at 598687976533ns, rc = 0 00000040:00080000:1.0:1762166979.892312:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5920, 88 off463776 00000004:00080000:1.0:1762166979.892319:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 599040840831ns, next at 598688050423ns, rc = 0 00000040:00080000:1.0:1762166979.892350:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5921, 88 off463864 00000004:00080000:1.0:1762166979.892357:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 599040878669ns, next at 598688050423ns, rc = 0 00000040:00080000:1.0:1762166979.892370:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5922, 88 off463864 00000004:00080000:1.0:1762166979.892375:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 599040897767ns, next at 598687976533ns, rc = 0 00000040:00080000:1.0:1762166979.892401:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5922, 88 off463952 00000004:00080000:1.0:1762166979.892407:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 599040929129ns, next at 598688050423ns, rc = 0 00000040:00080000:1.0:1762166979.892440:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5923, 88 off463952 00000004:00080000:1.0:1762166979.892445:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 599040967481ns, next at 598687976533ns, rc = 0 00000040:00080000:1.0:1762166979.892464:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5924, 88 off464040 00000004:00080000:1.0:1762166979.892470:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 599040991584ns, next at 598687976533ns, rc = 0 00000040:00080000:1.0:1762166979.892528:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5923, 88 off464040 00000004:00080000:1.0:1762166979.892533:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 599041055784ns, next at 598688050423ns, rc = 0 00000001:00080000:2.0:1762166979.894596:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294992319 is committed 00000004:00080000:2.0:1762166979.894610:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3286 committed 00000004:00080000:2.0:1762166979.894627:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3283 committed 00010000:00010000:1.0:1762166979.894734:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbabf67 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x616:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166979.894750:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbabf67 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x616:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166979.894759:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbabf67 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x616:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166979.894768:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355b600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166979.894776:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbabf67 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x616:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166979.894788:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbabf67 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x616:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166979.894812:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x616:0x0].0x0 (ffff945bc812e900) 00000100:00100000:0.0:1762166979.894814:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcb385880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449760000:0@lo:2:osp-syn-0-1.0 00010000:00010000:1.0:1762166979.894819:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166979.894828:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbabf67 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x616:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166979.894848:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbabf67 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x616:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166979.894879:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbabf7c lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166979.894886:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbabf7c lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166979.894892:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbabf7c lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166979.894898:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355a800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166979.894903:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbabf7c lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166979.894909:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbabf7c lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00000100:00100000:0.0:1762166979.894923:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1762166979.894930:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:1.0:1762166979.894935:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166979.894939:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbabf7c lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166979.894946:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbabf7c lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00000100:00100000:1.0:1762166979.894982:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449760000 00000100:00100000:1.0:1762166979.894991:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449760000 00000100:00100000:0.0:1762166979.895001:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1762166979.895010:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc59d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449760128:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1762166979.895041:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1762166979.895069:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3282 committed 00000100:00100000:0.0:1762166979.895080:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc59d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449760256:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1762166979.895100:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166979.895250:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc70b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449760640:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166979.895313:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc70b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449760512:0@lo:2:osp-syn-1-1.0 00000004:00080000:2.0:1762166979.895362:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3285 committed 00000004:00080000:2.0:1762166979.895366:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3281 committed 00000004:00080000:2.0:1762166979.895368:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3284 committed 00000004:00080000:2.0:1762166979.895370:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3283 committed 00000004:00080000:2.0:1762166979.895377:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3280 committed 00000020:00080000:2.0:1762166979.895394:0:7412:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff945bc350f6c0 refcount 2 committed 0 result 0 batchid 58 00000020:00080000:2.0:1762166979.895398:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945bc49ab900 obd lustre-OST0001-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff945cc7c77780 00000020:00080000:2.0:1762166979.895401:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945bc49ab800 obd lustre-OST0000-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff945bc350f000 00000020:00080000:2.0:1762166979.895404:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945bc49ab200 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff945bc8098a00 00000020:00080000:2.0:1762166979.895407:0:7412:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000400:0x2:0x0].57 00000100:00100000:1.0:1762166979.895665:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449760128 00000100:00100000:1.0:1762166979.895671:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449760128 00000100:00100000:3.0:1762166979.895911:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449760256 00000100:00100000:3.0:1762166979.895916:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449760256 00000100:00100000:1.0:1762166979.895958:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19240 00000100:00100000:3.0:1762166979.895969:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19241 00000100:00100000:1.0:1762166979.895976:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc59d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+8:3633:x1847765449760000:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166979.895983:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc59d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+8:3633:x1847765449760128:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1762166979.895998:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc70b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449760768:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1762166979.896008:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19242 00000100:00100000:2.0:1762166979.896022:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc59d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+8:3635:x1847765449760256:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1762166979.896039:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166979.896066:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1762166979.896073:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc59d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449760384:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1762166979.896106:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:3.0:1762166979.896135:0:35247:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:0.0:1762166979.896137:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc70b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449760896:0@lo:2:osp-syn-1-1.0 00002000:00010000:3.0:1762166979.896143:0:35247:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166979 -> 1762166979 00002000:00010000:2.0:1762166979.896143:0:8383:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa8e:0x0] updating lvb size from disk: 204311 -> 204311 00002000:00010000:1.0:1762166979.896148:0:8380:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166979.896150:0:35247:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166979 -> 1762166979 00002000:00010000:2.0:1762166979.896151:0:8383:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa8e:0x0] updating lvb mtime from disk: 1762166979 -> 1762166979 00002000:00010000:1.0:1762166979.896154:0:8380:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb mtime from disk: 1762166966 -> 1762166966 00002000:00010000:3.0:1762166979.896159:0:35247:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:2.0:1762166979.896160:0:8383:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa8e:0x0] updating lvb atime from disk: 1762166979 -> 1762166979 00002000:00010000:1.0:1762166979.896161:0:8380:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1762166979.896170:0:35247:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00000100:00100000:0.0:1762166979.896176:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:2.0:1762166979.896177:0:8383:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa8e:0x0] updating lvb ctime from disk: 1762166979 -> 1762166979 00002000:00010000:1.0:1762166979.896177:0:8380:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb ctime from disk: 1762166966 -> 1762166966 00002000:00010000:2.0:1762166979.896189:0:8383:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa8e:0x0] updating lvb blocks from disk: 48 -> 48 00002000:00010000:1.0:1762166979.896189:0:8380:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb blocks from disk: 0 -> 0 00000020:00080000:0.0:1762166979.896249:0:7435:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 58 committed batchid 57 00000100:00100000:3.0:1762166979.896258:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc59d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+11:3633:x1847765449760128:12345-0@lo:2:osp-syn-0-1.0 Request processed in 273us (1213us total) trans 21474843387 rc 0/0 00000100:00100000:1.0:1762166979.896263:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc59d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+11:3633:x1847765449760000:12345-0@lo:2:osp-syn-0-1.0 Request processed in 293us (1346us total) trans 21474843388 rc 0/0 00000100:00100000:2.0:1762166979.896270:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc59d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+11:3635:x1847765449760256:12345-0@lo:2:osp-syn-0-1.0 Request processed in 250us (1165us total) trans 21474843389 rc 0/0 00000100:00100000:3.0:1762166979.896272:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19241 00000100:00100000:1.0:1762166979.896285:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19240 00000100:00100000:2.0:1762166979.896293:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19242 00000100:00100000:3.0:1762166979.896300:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449760768 00000100:00100000:3.0:1762166979.896306:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449760768 00000100:00100000:1.0:1762166979.896309:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449760384 00000100:00100000:1.0:1762166979.896316:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449760384 00000100:00100000:2.0:1762166979.896318:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449760896 00000100:00100000:2.0:1762166979.896324:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449760896 00000020:00080000:0.0:1762166979.896326:0:7435:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 57 00000100:00100000:1.0:1762166979.896368:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19243 00000100:00100000:0.0:1762166979.896382:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19244 00000100:00100000:1.0:1762166979.896384:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc59d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+7:3635:x1847765449760768:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166979.896395:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19245 00000100:00100000:0.0:1762166979.896401:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc59d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+9:3635:x1847765449760384:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166979.896410:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc59d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+7:3635:x1847765449760896:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:1.0:1762166979.896467:0:8380:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa8d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166979.896471:0:8380:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa8d:0x0] updating lvb mtime from disk: 1762166979 -> 1762166979 00002000:00010000:1.0:1762166979.896474:0:8380:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa8d:0x0] updating lvb atime from disk: 1762166979 -> 1762166979 00002000:00010000:1.0:1762166979.896522:0:8380:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa8d:0x0] updating lvb ctime from disk: 1762166979 -> 1762166979 00002000:00010000:1.0:1762166979.896526:0:8380:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa8d:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1762166979.896564:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc59d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+9:3635:x1847765449760768:12345-0@lo:2:osp-syn-1-1.0 Request processed in 186us (524us total) trans 17179876556 rc 0/0 00000100:00100000:1.0:1762166979.896575:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19243 00000100:00100000:3.0:1762166979.896581:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc59d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+9:3635:x1847765449760896:12345-0@lo:2:osp-syn-1-1.0 Request processed in 175us (413us total) trans 17179876557 rc 0/0 00000100:00100000:3.0:1762166979.896590:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19245 00002000:00010000:0.0:1762166979.896601:0:8382:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa8f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166979.896609:0:8382:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa8f:0x0] updating lvb mtime from disk: 1762166979 -> 1762166979 00002000:00010000:0.0:1762166979.896613:0:8382:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa8f:0x0] updating lvb atime from disk: 1762166979 -> 1762166979 00002000:00010000:0.0:1762166979.896616:0:8382:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa8f:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:0.0:1762166979.896619:0:8382:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa8f:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166979.896631:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1762166979.896657:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbac047 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea45a expref: 525 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.896670:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:1.0:1762166979.896676:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000100:00100000:2.0:1762166979.896684:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449760512 00000100:00100000:0.0:1762166979.896688:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc59d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+10:3635:x1847765449760384:12345-0@lo:2:osp-syn-0-1.0 Request processed in 289us (578us total) trans 21474843390 rc 0/0 00000100:00100000:2.0:1762166979.896692:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449760512 00010000:00010000:1.0:1762166979.896700:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a000/0x2f180c4effbac040 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea45a expref: 525 pid: 6494 timeout: 0 lvb_type: 3 00000100:00100000:0.0:1762166979.896709:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19244 00000004:00080000:3.0:1762166979.896719:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc59d5500/2, rc 0, transno 21474843387 00000100:00100000:3.0:1762166979.896729:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc59d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449760128:0@lo:2:osp-syn-0-1.0 00010000:00010000:1.0:1762166979.896739:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbac047 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea45a expref: 524 pid: 6494 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1762166979.896753:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bcb385880/2, rc 0, transno 21474843388 00000100:00100000:3.0:1762166979.896766:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcb385880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449760000:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1762166979.896766:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19246 00000100:00100000:0.0:1762166979.896792:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc70b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+8:3633:x1847765449760512:12345-0@lo:2:osp-syn-1-1.0 00010000:00010000:1.0:1762166979.896812:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:1.0:1762166979.896819:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1762166979.896821:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355b800, rc 0) 00000100:00100000:3.0:1762166979.896853:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:0.0:1762166979.896897:0:8382:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 200741 -> 200741 00000100:00100000:2.0:1762166979.896901:0:35248:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449760640 00000100:00100000:1.0:1762166979.896907:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb384000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+524:61766:x1847765450611328:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 5228us (5482us total) trans 4294992319 rc 0/0 00002000:00010000:0.0:1762166979.896909:0:8382:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166979 -> 1762166979 00000100:00100000:2.0:1762166979.896911:0:35248:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449760640 00002000:00010000:0.0:1762166979.896921:0:8382:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166979 -> 1762166979 00002000:00010000:0.0:1762166979.896927:0:8382:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00000100:00100000:1.0:1762166979.896937:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30683 00002000:00010000:0.0:1762166979.896938:0:8382:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 96 -> 96 00000100:00100000:2.0:1762166979.896963:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19247 00000100:00100000:2.0:1762166979.896983:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc70b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+10:3634:x1847765449760640:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1762166979.897006:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc70b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+10:3633:x1847765449760512:12345-0@lo:2:osp-syn-1-1.0 Request processed in 219us (380us total) trans 17179876558 rc 0/0 00000100:00100000:0.0:1762166979.897017:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19246 00000004:00080000:3.0:1762166979.897026:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc70b3480/2, rc 0, transno 17179876558 00000100:00100000:3.0:1762166979.897035:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc70b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449760512:0@lo:2:osp-syn-1-1.0 00002000:00010000:2.0:1762166979.897079:0:35248:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00000004:00080000:0.0:1762166979.897079:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc59d4a80/2, rc 0, transno 21474843390 00002000:00010000:2.0:1762166979.897091:0:35248:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166979 -> 1762166979 00000100:00100000:0.0:1762166979.897094:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc59d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449760384:0@lo:2:osp-syn-0-1.0 00002000:00010000:2.0:1762166979.897098:0:35248:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166979 -> 1762166979 00002000:00010000:2.0:1762166979.897107:0:35248:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:2.0:1762166979.897111:0:35248:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00000004:00080000:0.0:1762166979.897127:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc70b1880/2, rc 0, transno 17179876557 00000100:00100000:0.0:1762166979.897136:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc70b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449760896:0@lo:2:osp-syn-1-1.0 00000004:00080000:0.0:1762166979.897152:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc70b0a80/2, rc 0, transno 17179876556 00000100:00100000:0.0:1762166979.897157:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc70b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449760768:0@lo:2:osp-syn-1-1.0 00000004:00080000:0.0:1762166979.897180:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc59d6a00/2, rc 0, transno 21474843389 00000100:00100000:0.0:1762166979.897188:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc59d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449760256:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1762166979.897197:0:35248:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc70b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+10:3634:x1847765449760640:12345-0@lo:2:osp-syn-1-1.0 Request processed in 214us (335us total) trans 17179876559 rc 0/0 00000100:00100000:2.0:1762166979.897217:0:35248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19247 00000004:00080000:3.0:1762166979.897229:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc70b1500/2, rc 0, transno 17179876559 00000100:00100000:3.0:1762166979.897238:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc70b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449760640:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166979.899219:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.899274:0:35248:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450611456 00000100:00100000:2.0:1762166979.899280:0:35248:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450611456 00000100:00100000:2.0:1762166979.899315:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19248 00000100:00100000:2.0:1762166979.899323:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3d5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+20:61766:x1847765450611456:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:2.0:1762166979.899336:0:35248:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166979.899354:0:35248:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbac04e lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea461 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.899379:0:35248:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945cc355a200/0x2f180c4effbac039 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea453 expref: 21 pid: 8380 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166979.899392:0:35248:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166979.899394:0:35248:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166979.899398:0:35248:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbac04e lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [20480->65535] (req 20480->65535) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea461 expref: 21 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.899427:0:35248:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945cc355a200/0x2f180c4effbac039 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea453 expref: 21 pid: 8380 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166979.899441:0:35248:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945cc355a200/0x2f180c4effbac039 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea453 expref: 21 pid: 8380 timeout: 699 lvb_type: 1 00000100:00100000:2.0:1762166979.899453:0:35248:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:35248:1847765449761024:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166979.899553:0:35248:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011c7300 going to sleep for 11 seconds 00000100:00100000:2.0:1762166979.900544:0:35248:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:35248:1847765449761024:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166979.900567:0:35248:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbac04e lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [20480->65535] (req 20480->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea461 expref: 21 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.900587:0:35248:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa9800, rc 0) 00000100:00100000:2.0:1762166979.900629:0:35248:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3d5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+21:61766:x1847765450611456:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 1306us (1412us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166979.900637:0:35248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19248 00000100:00100000:3.0:1762166979.900803:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.900856:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450611584 00000100:00100000:2.0:1762166979.900863:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450611584 00010000:00010000:2.0:1762166979.900882:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355a200/0x2f180c4effbac039 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea453 expref: 21 pid: 8380 timeout: 699 lvb_type: 1 00000100:00100000:2.0:1762166979.900918:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9722 00000100:00100000:2.0:1762166979.900926:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc70b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450611584:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166979.900936:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166979.900950:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945cc355a200/0x2f180c4effbac039 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea453 expref: 21 pid: 8380 timeout: 699 lvb_type: 1 00010000:00010000:2.0:1762166979.900961:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945cc355a200/0x2f180c4effbac039 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea453 expref: 21 pid: 8380 timeout: 699 lvb_type: 1 00010000:00010000:2.0:1762166979.900978:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cc355a200/0x2f180c4effbac039 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea453 expref: 21 pid: 8380 timeout: 699 lvb_type: 1 00010000:00010000:2.0:1762166979.900989:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166979.900991:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166979.900996:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbac04e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 20480->65535) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea461 expref: 20 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.901006:0:9458:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbac04e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 20480->65535) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea461 expref: 20 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.901029:0:9458:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbac04e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 20480->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea461 expref: 20 pid: 35248 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166979.901038:0:9458:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:9458:1847765449761152:192.168.204.38@tcp:105: 00000100:00100000:2.0:1762166979.901084:0:9458:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011c7300 going to sleep for 11 seconds 00000100:00100000:2.0:1762166979.901942:0:9458:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:9458:1847765449761152:192.168.204.38@tcp:105: 00010000:00010000:2.0:1762166979.901958:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166979.901993:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc70b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450611584:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1068us (1264us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166979.902002:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9722 00000100:00100000:3.0:1762166979.902138:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166979.902226:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450611712 00000100:00100000:1.0:1762166979.902232:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450611712 00000100:00100000:1.0:1762166979.902272:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30684 00000100:00100000:1.0:1762166979.902281:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc70b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+524:61766:x1847765450611712:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:1.0:1762166979.902296:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166979.902309:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbac055 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea468 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.902333:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbac05c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166979.902344:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbac05c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166979.902353:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbac05c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166979.902451:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbac055 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea468 expref: 526 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.902464:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbac05c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea468 expref: 525 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.902472:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:1.0:1762166979.902512:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1762166979.902517:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355bc00, rc 0) 00000100:00100000:1.0:1762166979.902557:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc70b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+525:61766:x1847765450611712:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 277us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166979.902564:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30684 00000100:00100000:1.0:1762166979.903729:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.903773:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450611840 00000100:00100000:2.0:1762166979.903778:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450611840 00002000:00100000:2.0:1762166979.903809:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (20480->24575) req@ffff945cf1cd3100 x1847765450611840/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:10/0 lens 488/0 e 0 to 0 dl 1762166990 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166979.903820:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1cd3100 with x1847765450611840 ext(20480->24575) 00002000:00010000:2.0:1762166979.903824:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1cd3100 00000100:00100000:2.0:1762166979.903866:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2517 00000100:00100000:2.0:1762166979.903875:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450611840:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:2.0:1762166979.904004:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450611840:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 131us (276us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1762166979.904012:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2517 00002000:00100000:2.0:1762166979.904019:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (20480->24575) req@ffff945cf1cd3100 x1847765450611840/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:10/0 lens 488/4536 e 0 to 0 dl 1762166990 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166979.904027:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1cd3100 with x1847765450611840 ext(20480->24575) 00002000:00010000:2.0:1762166979.904030:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1cd3100 00000100:00100000:0.0:1762166979.905651:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.905747:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450611968 00000100:00100000:2.0:1762166979.905755:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450611968 00002000:00100000:2.0:1762166979.905783:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (61440->65535) req@ffff945bc59d6680 x1847765450611968/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:10/0 lens 488/0 e 0 to 0 dl 1762166990 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166979.905791:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc59d6680 with x1847765450611968 ext(61440->65535) 00002000:00010000:2.0:1762166979.905796:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc59d6680 00000100:00100000:2.0:1762166979.905820:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2518 00000100:00100000:2.0:1762166979.905828:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc59d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450611968:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:2.0:1762166979.905969:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc59d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450611968:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 139us (324us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1762166979.905977:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2518 00002000:00100000:2.0:1762166979.905983:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (61440->65535) req@ffff945bc59d6680 x1847765450611968/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:10/0 lens 488/4536 e 0 to 0 dl 1762166990 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166979.905990:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc59d6680 with x1847765450611968 ext(61440->65535) 00002000:00010000:2.0:1762166979.905993:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc59d6680 00000100:00100000:3.0:1762166979.907353:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166979.907436:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450612096 00000100:00100000:1.0:1762166979.907443:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450612096 00000100:00100000:1.0:1762166979.907513:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30685 00000100:00100000:1.0:1762166979.907522:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc70b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+525:61766:x1847765450612096:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:1.0:1762166979.907536:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166979.907552:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbac063 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea46f expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.907633:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbac06a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166979.907646:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbac06a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166979.907657:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbac06a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:1.0:1762166979.907681:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 1048577 00000004:00200000:1.0:1762166979.907685:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166979.907700:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbac06a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166979.907721:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbac063 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea46f expref: 527 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.907750:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbac06a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea46f expref: 526 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.907760:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:1.0:1762166979.907763:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166979.907767:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355ae00, rc 0) 00000100:00100000:1.0:1762166979.907829:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc70b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+526:61766:x1847765450612096:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 305us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166979.907844:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30685 00000100:00100000:1.0:1762166979.910221:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.910288:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450612224 00000100:00100000:2.0:1762166979.910295:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450612224 00002000:00100000:2.0:1762166979.910330:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (90112->155647) req@ffff945cf1cd2a00 x1847765450612224/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:10/0 lens 488/0 e 0 to 0 dl 1762166990 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166979.910339:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1cd2a00 with x1847765450612224 ext(90112->155647) 00002000:00010000:2.0:1762166979.910344:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1cd2a00 00000100:00100000:2.0:1762166979.910374:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2519 00000100:00100000:2.0:1762166979.910382:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:2416:x1847765450612224:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:2.0:1762166979.911546:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:2416:x1847765450612224:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 1161us (1326us total) trans 0 rc 65536/65536 00000100:00100000:2.0:1762166979.911556:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2519 00002000:00100000:2.0:1762166979.911564:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (90112->155647) req@ffff945cf1cd2a00 x1847765450612224/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:10/0 lens 488/440 e 0 to 0 dl 1762166990 ref 1 fl Complete:/600/0 rc 65536/65536 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166979.911573:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1cd2a00 with x1847765450612224 ext(90112->155647) 00002000:00010000:2.0:1762166979.911578:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1cd2a00 00000100:00100000:3.0:1762166979.912868:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.912960:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450612352 00000100:00100000:2.0:1762166979.912972:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450612352 00002000:00100000:2.0:1762166979.913022:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (155648->192511) req@ffff945bc70b3b80 x1847765450612352/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:10/0 lens 488/0 e 0 to 0 dl 1762166990 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166979.913033:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc70b3b80 with x1847765450612352 ext(155648->192511) 00002000:00010000:2.0:1762166979.913039:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc70b3b80 00000100:00100000:2.0:1762166979.913070:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2520 00000100:00100000:2.0:1762166979.913081:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc70b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:2417:x1847765450612352:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:2.0:1762166979.914135:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc70b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:2417:x1847765450612352:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 1053us (1273us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1762166979.914142:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2520 00002000:00100000:2.0:1762166979.914149:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (155648->192511) req@ffff945bc70b3b80 x1847765450612352/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:10/0 lens 488/440 e 0 to 0 dl 1762166990 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166979.914156:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc70b3b80 with x1847765450612352 ext(155648->192511) 00002000:00010000:2.0:1762166979.914159:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc70b3b80 00000100:00100000:0.0:1762166979.916014:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.916084:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450612480 00000100:00100000:2.0:1762166979.916094:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450612480 00000100:00100000:2.0:1762166979.916162:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2521 00000100:00100000:2.0:1762166979.916175:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc59d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450612480:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:2.0:1762166979.916678:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 200741 -> 200741 00002000:00010000:2.0:1762166979.916682:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166979 -> 1762166980 00002000:00010000:2.0:1762166979.916685:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166979 -> 1762166979 00002000:00010000:2.0:1762166979.916687:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:2.0:1762166979.916690:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 96 -> 176 00000100:00100000:2.0:1762166979.916759:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc59d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450612480:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 586us (751us total) trans 17179876560 rc 0/0 00000100:00100000:2.0:1762166979.916769:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2521 00000100:00100000:3.0:1762166979.918410:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166979.918622:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450612736 00000100:00100000:1.0:1762166979.918633:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450612736 00000100:00100000:1.0:1762166979.918682:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30686 00000100:00100000:1.0:1762166979.918690:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc70b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+526:61766:x1847765450612736:12345-192.168.204.38@tcp:36:fsx.0 00010000:00010000:1.0:1762166979.918756:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1762166979.918786:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbac06a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea46f expref: 526 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.918810:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbac047 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea45a expref: 525 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.918823:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:1.0:1762166979.918830:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166979.919056:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbac071 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:1.0:1762166979.919070:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbac071 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.919078:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbac071 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000001:00080000:1.0:1762166979.919116:0:6495:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992320 00000004:00010000:1.0:1762166979.919138:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000963fe747 reply state 000000002a15043e transno 4294992321 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbac071 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.919150:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbac071 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:1.0:1762166979.919157:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:1.0:1762166979.919160:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166979.919162:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166979.919243:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc70b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+527:61766:x1847765450612736:12345-192.168.204.38@tcp:36:fsx.0 Request processed in 554us (843us total) trans 4294992321 rc 0/0 00000100:00100000:1.0:1762166979.919249:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30686 00000020:00080000:1.0:1762166979.919253:0:6495:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1762166979.920239:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166979.920286:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450612864 00000100:00100000:3.0:1762166979.920292:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450612864 00000100:00100000:3.0:1762166979.920323:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30687 00000100:00100000:3.0:1762166979.920329:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+527:61766:x1847765450612864:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:3.0:1762166979.920346:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166979.920359:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effbac078 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea476 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166979.920398:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effbac078 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea476 expref: 528 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166979.920412:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effbac078 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea476 expref: 528 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166979.920430:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:3.0:1762166979.920433:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166979.920435:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8472000, rc 0) 00000100:00100000:3.0:1762166979.920501:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+528:61766:x1847765450612864:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 148us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166979.920510:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30687 00000100:00100000:0.0:1762166979.921754:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.921792:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.921850:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450613120 00000100:00100000:3.0:1762166979.921865:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450612992 00000100:00100000:0.0:1762166979.921865:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.921871:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450613120 00000100:00100000:3.0:1762166979.921874:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450612992 00002000:00010000:3.0:1762166979.921917:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (113845->18446744073709551615) 00002000:00100000:3.0:1762166979.921922:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc59d6d80 with x1847765450612992 ext(113845->18446744073709551615) 00000100:00100000:1.0:1762166979.921922:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450613248 00002000:00010000:2.0:1762166979.921930:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00000100:00100000:1.0:1762166979.921931:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450613248 00002000:00010000:3.0:1762166979.921939:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc59d6d80. 00002000:00100000:2.0:1762166979.921942:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc59d7100 with x1847765450613120 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166979.921959:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc59d7100. 00002000:00010000:1.0:1762166979.921963:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:1.0:1762166979.921970:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc59d5c00 with x1847765450613248 ext(0->18446744073709551615) 00000100:00100000:3.0:1762166979.921978:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2522 00002000:00010000:1.0:1762166979.921979:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc59d5c00. 00000100:00100000:3.0:1762166979.921995:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc59d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450612992:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:2.0:1762166979.922010:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2523 00000100:00100000:1.0:1762166979.922022:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2524 00000100:00100000:2.0:1762166979.922032:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc59d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450613120:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:1.0:1762166979.922044:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc59d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450613248:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:1.0:1762166979.922220:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166979.922221:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166979.922234:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166979 -> 1762166980 00002000:00010000:2.0:1762166979.922235:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166979 -> 1762166980 00002000:00010000:1.0:1762166979.922248:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166979 -> 1762166979 00002000:00010000:2.0:1762166979.922249:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166979 -> 1762166979 00002000:00010000:1.0:1762166979.922259:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:2.0:1762166979.922261:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:1.0:1762166979.922264:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:2.0:1762166979.922273:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00000100:00100000:1.0:1762166979.922320:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc59d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765450613248:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 282us (459us total) trans 17179876561 rc 0/0 00000100:00100000:1.0:1762166979.922341:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2524 00000100:00100000:2.0:1762166979.922344:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc59d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450613120:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 319us (588us total) trans 21474843391 rc 0/0 00002000:00010000:1.0:1762166979.922350:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00010000:3.0:1762166979.922356:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 200741 -> 113845 00002000:00100000:1.0:1762166979.922358:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc59d5c00 with x1847765450613248 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166979.922360:0:23943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00000100:00100000:2.0:1762166979.922369:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2523 00002000:00010000:3.0:1762166979.922370:0:23943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166979 -> 1762166979 00002000:00010000:1.0:1762166979.922374:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc59d5c00. 00002000:00010000:3.0:1762166979.922376:0:23943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:2.0:1762166979.922380:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00010000:3.0:1762166979.922381:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 176 -> 120 00002000:00100000:2.0:1762166979.922392:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc59d7100 with x1847765450613120 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166979.922400:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc59d7100. 00000100:00100000:3.0:1762166979.922424:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc59d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765450612992:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 432us (629us total) trans 17179876562 rc 0/0 00000100:00100000:3.0:1762166979.922433:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2522 00002000:00010000:3.0:1762166979.922438:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (113845->18446744073709551615) 00002000:00100000:3.0:1762166979.922441:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc59d6d80 with x1847765450612992 ext(113845->18446744073709551615) 00002000:00010000:3.0:1762166979.922447:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc59d6d80. 00000100:00100000:1.0:1762166979.923540:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166979.923604:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450613376 00000100:00100000:3.0:1762166979.923611:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450613376 00000100:00100000:3.0:1762166979.923647:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30688 00000100:00100000:3.0:1762166979.923654:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+528:61766:x1847765450613376:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:3.0:1762166979.923666:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166979.923680:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472a00/0x2f180c4effbac07f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea47d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166979.923751:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472c00/0x2f180c4effbac086 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166979.923761:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472c00/0x2f180c4effbac086 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166979.923770:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472c00/0x2f180c4effbac086 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000004:00200000:3.0:1762166979.923789:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 113845 00000004:00200000:3.0:1762166979.923793:0:6495:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166979.923805:0:6495:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472c00/0x2f180c4effbac086 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166979.923826:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472a00/0x2f180c4effbac07f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea47d expref: 530 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166979.923854:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472c00/0x2f180c4effbac086 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea47d expref: 529 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166979.923862:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:3.0:1762166979.923865:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166979.923869:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8472c00, rc 0) 00000100:00100000:3.0:1762166979.923911:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+529:61766:x1847765450613376:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 253us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166979.923918:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30688 00000100:00100000:0.0:1762166979.925567:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166979.925602:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450613632 00000100:00100000:3.0:1762166979.925645:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450613632 00000100:00100000:3.0:1762166979.925681:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30689 00000100:00100000:3.0:1762166979.925690:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc59d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+529:61766:x1847765450613632:12345-192.168.204.38@tcp:36:fsx.0 00010000:00010000:3.0:1762166979.925728:0:6495:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166979.925747:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472c00/0x2f180c4effbac086 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea47d expref: 529 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166979.925760:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:3.0:1762166979.925764:0:6495:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166979.925949:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473600/0x2f180c4effbac08d lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:3.0:1762166979.925962:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473600/0x2f180c4effbac08d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166979.925970:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473600/0x2f180c4effbac08d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00000001:00080000:3.0:1762166979.926015:0:6495:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992322 00000004:00010000:3.0:1762166979.926036:0:6495:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000cc4ca351 reply state 0000000044f3122c transno 4294992323 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473600/0x2f180c4effbac08d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166979.926049:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473600/0x2f180c4effbac08d lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166979.926055:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:3.0:1762166979.926057:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1762166979.926060:0:6495:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166979.926130:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc59d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1e11365-ba0b-405b-99c9-a704373217f2+531:61766:x1847765450613632:12345-192.168.204.38@tcp:36:fsx.0 Request processed in 442us (566us total) trans 4294992323 rc 0/0 00000100:00100000:3.0:1762166979.926138:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30689 00000020:00080000:3.0:1762166979.926143:0:6495:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1762166979.927225:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166979.927248:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166979.927267:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450613760 00000100:00100000:3.0:1762166979.927274:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450613760 00000100:00100000:0.0:1762166979.927297:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00002000:00010000:3.0:1762166979.927300:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (115778->18446744073709551615) 00002000:00100000:3.0:1762166979.927305:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc59d7480 with x1847765450613760 ext(115778->18446744073709551615) 00000100:00100000:2.0:1762166979.927312:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450613888 00002000:00010000:3.0:1762166979.927314:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc59d7480. 00000100:00100000:2.0:1762166979.927336:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450613888 00000100:00100000:1.0:1762166979.927374:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450614016 00002000:00010000:2.0:1762166979.927379:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00000100:00100000:1.0:1762166979.927381:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450614016 00002000:00100000:2.0:1762166979.927386:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc59d6300 with x1847765450613888 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166979.927400:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc59d6300. 00002000:00010000:1.0:1762166979.927404:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:1.0:1762166979.927411:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc59d5880 with x1847765450614016 ext(0->18446744073709551615) 00002000:00010000:1.0:1762166979.927420:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc59d5880. 00000100:00100000:3.0:1762166979.927423:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2525 00000100:00100000:3.0:1762166979.927440:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc59d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765450613760:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:2.0:1762166979.927446:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2526 00000100:00100000:2.0:1762166979.927466:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc59d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450613888:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:0.0:1762166979.927467:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2527 00000100:00100000:0.0:1762166979.927548:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc59d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765450614016:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:0.0:1762166979.927680:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166979.927685:0:23939:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00002000:00010000:0.0:1762166979.927688:0:23939:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166979 -> 1762166979 00002000:00010000:0.0:1762166979.927692:0:23939:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:0.0:1762166979.927695:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:2.0:1762166979.927710:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166979.927711:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 113845 -> 115778 00002000:00010000:3.0:1762166979.927725:0:23943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00002000:00010000:2.0:1762166979.927725:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00002000:00010000:3.0:1762166979.927741:0:23943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166979 -> 1762166979 00002000:00010000:2.0:1762166979.927741:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166979 -> 1762166979 00000100:00100000:0.0:1762166979.927756:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc59d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765450614016:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 210us (453us total) trans 17179876563 rc 0/0 00002000:00010000:3.0:1762166979.927757:0:23943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:2.0:1762166979.927757:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:3.0:1762166979.927776:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 120 -> 120 00002000:00010000:2.0:1762166979.927781:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00000100:00100000:0.0:1762166979.927782:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2527 00002000:00010000:0.0:1762166979.927791:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:0.0:1762166979.927794:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc59d5880 with x1847765450614016 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166979.927802:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc59d5880. 00000100:00100000:3.0:1762166979.927815:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc59d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765450613760:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 379us (590us total) trans 17179876564 rc 0/0 00000100:00100000:3.0:1762166979.927829:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2525 00002000:00010000:3.0:1762166979.927846:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (115778->18446744073709551615) 00000100:00100000:2.0:1762166979.927853:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc59d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450613888:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 392us (597us total) trans 21474843392 rc 0/0 00002000:00100000:3.0:1762166979.927857:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc59d7480 with x1847765450613760 ext(115778->18446744073709551615) 00002000:00010000:3.0:1762166979.927872:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc59d7480. 00000100:00100000:2.0:1762166979.927879:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2526 00002000:00010000:2.0:1762166979.927887:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:2.0:1762166979.927892:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc59d6300 with x1847765450613888 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166979.927900:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc59d6300. 00000100:00100000:1.0:1762166979.929981:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.930026:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450614144 00000100:00100000:2.0:1762166979.930031:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450614144 00002000:00100000:2.0:1762166979.930057:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (73728->118783) req@ffff945cf1cd1f80 x1847765450614144/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:10/0 lens 488/0 e 0 to 0 dl 1762166990 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166979.930064:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1cd1f80 with x1847765450614144 ext(73728->118783) 00002000:00010000:2.0:1762166979.930068:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1cd1f80 00000100:00100000:2.0:1762166979.930088:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2528 00000100:00100000:2.0:1762166979.930093:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+25:2416:x1847765450614144:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:2.0:1762166979.931267:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+25:2416:x1847765450614144:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 1168us (1287us total) trans 0 rc 45056/45056 00000100:00100000:2.0:1762166979.931276:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2528 00002000:00100000:2.0:1762166979.931286:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (73728->118783) req@ffff945cf1cd1f80 x1847765450614144/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:10/0 lens 488/440 e 0 to 0 dl 1762166990 ref 1 fl Complete:/600/0 rc 45056/45056 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166979.931295:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1cd1f80 with x1847765450614144 ext(73728->118783) 00002000:00010000:2.0:1762166979.931299:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1cd1f80 00000100:00100000:0.0:1762166979.933747:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.933805:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450614272 00000100:00100000:2.0:1762166979.933813:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450614272 00002000:00100000:2.0:1762166979.933855:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (20480->115777) req@ffff945bc59d4e00 x1847765450614272/t0(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:10/0 lens 504/0 e 0 to 0 dl 1762166990 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166979.933863:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc59d4e00 with x1847765450614272 ext(20480->115777) 00002000:00010000:2.0:1762166979.933866:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc59d4e00 00000100:00100000:2.0:1762166979.933888:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2529 00000100:00100000:2.0:1762166979.933894:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc59d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+25:2417:x1847765450614272:12345-192.168.204.38@tcp:4:fsx.0 00000100:00100000:2.0:1762166979.935618:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc59d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+27:2417:x1847765450614272:12345-192.168.204.38@tcp:4:fsx.0 Request processed in 1716us (1872us total) trans 17179876565 rc 0/0 00000100:00100000:2.0:1762166979.935631:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2529 00002000:00100000:2.0:1762166979.935641:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (20480->115777) req@ffff945bc59d4e00 x1847765450614272/t17179876565(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:10/0 lens 504/448 e 0 to 0 dl 1762166990 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166979.935651:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc59d4e00 with x1847765450614272 ext(20480->115777) 00002000:00010000:2.0:1762166979.935656:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc59d4e00 00000100:00100000:1.0:1762166979.938054:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.938130:0:35248:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450614400 00000100:00100000:2.0:1762166979.938139:0:35248:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450614400 00000100:00100000:2.0:1762166979.938191:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19249 00000100:00100000:2.0:1762166979.938200:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+27:2416:x1847765450614400:12345-192.168.204.38@tcp:16:fsx.0 00000001:00080000:1.0:1762166979.939791:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876565 is committed 00000001:00080000:1.0:1762166979.939845:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876559 is committed 00000100:00100000:2.0:1762166979.939989:0:35248:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+17:2416:x1847765450614400:12345-192.168.204.38@tcp:16:fsx.0 Request processed in 1787us (1939us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166979.939997:0:35248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19249 00000100:00100000:0.0:1762166979.941425:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166979.941507:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450614528 00000100:00100000:3.0:1762166979.941520:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450614528 00000100:00100000:2.0:1762166979.941632:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30690 00000100:00100000:2.0:1762166979.941647:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc59d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+531:61766:x1847765450614528:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:2.0:1762166979.941673:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166979.941694:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbac094 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea484 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.941782:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9400/0x2f180c4effbac09b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166979.941793:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9400/0x2f180c4effbac09b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166979.941801:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9400/0x2f180c4effbac09b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:2.0:1762166979.941821:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 115778 00000004:00200000:2.0:1762166979.941824:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166979.941854:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9400/0x2f180c4effbac09b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166979.941880:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbac094 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea484 expref: 533 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.941895:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9400/0x2f180c4effbac09b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea484 expref: 532 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.941903:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166979.941906:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166979.941910:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa9400, rc 0) 00000100:00100000:2.0:1762166979.941957:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc59d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+532:61766:x1847765450614528:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 317us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166979.941963:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30690 00000100:00100000:1.0:1762166979.944673:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.944742:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450614656 00000100:00100000:2.0:1762166979.944755:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450614656 00002000:00100000:2.0:1762166979.944821:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (65536->73727) req@ffff945cf1cd0700 x1847765450614656/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:10/0 lens 488/0 e 0 to 0 dl 1762166990 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166979.944845:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1cd0700 with x1847765450614656 ext(65536->73727) 00002000:00010000:2.0:1762166979.944851:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1cd0700 00000100:00100000:2.0:1762166979.944885:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2530 00000100:00100000:2.0:1762166979.944908:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450614656:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:2.0:1762166979.945113:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450614656:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 220us (452us total) trans 0 rc 8192/8192 00000100:00100000:2.0:1762166979.945122:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2530 00002000:00100000:2.0:1762166979.945129:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (65536->73727) req@ffff945cf1cd0700 x1847765450614656/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:10/0 lens 488/8632 e 0 to 0 dl 1762166990 ref 1 fl Complete:/600/0 rc 8192/8192 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166979.945154:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1cd0700 with x1847765450614656 ext(65536->73727) 00002000:00010000:2.0:1762166979.945159:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1cd0700 00000100:00100000:1.0:1762166979.947438:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.947545:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450614784 00000100:00100000:2.0:1762166979.947555:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450614784 00000100:00100000:2.0:1762166979.947631:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2531 00000100:00100000:2.0:1762166979.947641:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf7839c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450614784:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:2.0:1762166979.948128:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 115778 -> 115778 00002000:00010000:2.0:1762166979.948133:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00002000:00010000:2.0:1762166979.948136:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166979 -> 1762166979 00002000:00010000:2.0:1762166979.948138:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:2.0:1762166979.948141:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 120 -> 104 00000100:00100000:2.0:1762166979.948192:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf7839c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450614784:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 552us (772us total) trans 17179876566 rc 0/0 00000100:00100000:2.0:1762166979.948201:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2531 00000100:00100000:0.0:1762166979.950178:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.950271:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450614912 00000100:00100000:2.0:1762166979.950282:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450614912 00000100:00100000:2.0:1762166979.950356:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2532 00000100:00100000:2.0:1762166979.950369:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc59d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450614912:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:2.0:1762166979.950674:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 115778 -> 185835 00002000:00010000:2.0:1762166979.950679:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00002000:00010000:2.0:1762166979.950682:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166979 -> 1762166979 00002000:00010000:2.0:1762166979.950684:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:2.0:1762166979.950686:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 104 -> 176 00000100:00100000:2.0:1762166979.950751:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc59d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450614912:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 385us (590us total) trans 17179876567 rc 0/0 00000100:00100000:2.0:1762166979.950759:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2532 00000100:00100000:1.0:1762166979.952816:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.952875:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450615040 00000100:00100000:2.0:1762166979.952885:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450615040 00000100:00100000:2.0:1762166979.952948:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2533 00000100:00100000:2.0:1762166979.952960:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf7838000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450615040:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:2.0:1762166979.953104:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 185835 -> 185835 00002000:00010000:2.0:1762166979.953108:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00002000:00010000:2.0:1762166979.953110:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166979 -> 1762166979 00002000:00010000:2.0:1762166979.953113:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:2.0:1762166979.953115:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 176 -> 176 00000100:00100000:2.0:1762166979.953175:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf7838000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450615040:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 218us (368us total) trans 17179876568 rc 0/0 00000100:00100000:2.0:1762166979.953183:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2533 00000100:00100000:1.0:1762166979.954997:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.955056:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450615168 00000100:00100000:2.0:1762166979.955062:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450615168 00000100:00100000:2.0:1762166979.955110:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2534 00000100:00100000:2.0:1762166979.955119:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450615168:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:2.0:1762166979.955290:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 185835 -> 185835 00002000:00010000:2.0:1762166979.955294:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00002000:00010000:2.0:1762166979.955297:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166979 -> 1762166979 00002000:00010000:2.0:1762166979.955299:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:2.0:1762166979.955301:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 176 -> 176 00000100:00100000:2.0:1762166979.955348:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450615168:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 223us (354us total) trans 17179876569 rc 0/0 00000100:00100000:2.0:1762166979.955357:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2534 00000100:00100000:0.0:1762166979.957292:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.957337:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450615424 00000100:00100000:2.0:1762166979.957344:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450615424 00000100:00100000:2.0:1762166979.957387:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11927 00000100:00100000:2.0:1762166979.957396:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc59d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+532:61766:x1847765450615424:12345-192.168.204.38@tcp:35:fsx.0 00000100:00100000:2.0:1762166979.957620:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc59d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+533:61766:x1847765450615424:12345-192.168.204.38@tcp:35:fsx.0 Request processed in 226us (332us total) trans 4294992324 rc 0/0 00000100:00100000:2.0:1762166979.957625:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11927 00000100:00100000:1.0:1762166979.966280:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.966347:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450615680 00000100:00100000:2.0:1762166979.966357:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450615680 00000100:00100000:2.0:1762166979.966419:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30691 00000100:00100000:2.0:1762166979.966431:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf7838e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+533:61869:x1847765450615680:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166979.966459:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166979.966508:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbac0a2 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea48b expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.966586:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbac0a9 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166979.966598:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbac0a9 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166979.966609:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbac0a9 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166979.966621:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbac0b0 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166979.966627:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbac0b0 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166979.966633:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbac0b0 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166979.966741:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbac0b7 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166979.966750:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbac0b7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166979.966757:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbac0b7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:2.0:1762166979.966766:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 185835 00010000:00010000:2.0:1762166979.966862:0:6494:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbac0a9 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166979.966869:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbac0a9 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166979.966875:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbac0a9 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166979.966882:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbac0a9 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166979.966887:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa8800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166979.966891:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbac0a9 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166979.966898:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbac0a9 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166979.966908:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0x0 (ffff945bc4077a00) 00010000:00010000:2.0:1762166979.966911:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166979.966915:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbac0a9 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166979.966920:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbac0a9 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166979.966933:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbac0b0 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166979.966939:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbac0b0 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166979.966944:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbac0b0 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166979.966949:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa8000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166979.966952:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbac0b0 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166979.966958:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbac0b0 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166979.966965:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0xdd396665 (ffff945bc4077300) 00010000:00010000:2.0:1762166979.966967:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166979.966970:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbac0b0 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166979.966976:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbac0b0 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166979.967017:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbac0a2 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea48b expref: 536 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.967030:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbac0b7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea48b expref: 535 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.967038:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166979.967040:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166979.967043:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa9a00, rc 0) 00000100:00100000:2.0:1762166979.967099:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf7838e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+535:61869:x1847765450615680:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 670us (830us total) trans 4294992325 rc 0/0 00000100:00100000:2.0:1762166979.967107:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30691 00000100:00100000:1.0:1762166979.968437:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.968519:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450615808 00000100:00100000:2.0:1762166979.968537:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450615808 00000100:00100000:2.0:1762166979.968610:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 889 00000100:00100000:2.0:1762166979.968620:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+535:2418:x1847765450615808:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166979.968639:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166979.968664:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbac0b7 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea48b expref: 535 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.968687:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166979.968693:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166979.968748:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+534:2418:x1847765450615808:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 130us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166979.968756:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 889 00000100:00100000:1.0:1762166979.968900:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.968973:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450616064 00000100:00100000:2.0:1762166979.968978:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450616064 00000100:00100000:2.0:1762166979.969018:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11928 00000100:00100000:2.0:1762166979.969026:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+534:61869:x1847765450616064:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:2.0:1762166979.969240:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+535:61869:x1847765450616064:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 214us (340us total) trans 4294992326 rc 0/0 00000100:00100000:2.0:1762166979.969248:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11928 00000100:00100000:0.0:1762166979.970455:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.970562:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450616320 00000100:00100000:2.0:1762166979.970573:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450616320 00000100:00100000:2.0:1762166979.970628:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30692 00000100:00100000:2.0:1762166979.970638:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc59d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+535:61869:x1847765450616320:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166979.970663:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166979.970683:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbac0c5 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea492 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.970764:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbac0cc lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166979.970782:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbac0cc lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166979.970791:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbac0cc lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:2.0:1762166979.970799:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 185835 00010000:00010000:2.0:1762166979.970891:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbac0c5 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea492 expref: 538 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.970908:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbac0cc lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea492 expref: 537 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.970917:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166979.970919:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1762166979.970922:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa9e00, rc 0) 00000100:00100000:2.0:1762166979.970976:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc59d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+537:61869:x1847765450616320:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 339us (525us total) trans 4294992327 rc 0/0 00000100:00100000:2.0:1762166979.970984:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30692 00000100:00100000:1.0:1762166979.972709:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.972741:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450616576 00000100:00100000:2.0:1762166979.972746:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450616576 00000100:00100000:2.0:1762166979.972777:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30693 00000100:00100000:2.0:1762166979.972786:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf7838700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+537:61869:x1847765450616576:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166979.972800:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166979.972811:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbac0da lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea499 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.972879:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbac0e1 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166979.972889:0:6494:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9400/0x2f180c4effbac09b lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea484 expref: 538 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.972895:0:6494:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbac0e1 lrc: 4/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166979.972918:0:6494:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9400/0x2f180c4effbac09b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea484 expref: 538 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.972927:0:6494:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9400/0x2f180c4effbac09b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea484 expref: 538 pid: 6494 timeout: 699 lvb_type: 0 00000100:00100000:2.0:1762166979.972937:0:6494:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765449761280:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166979.973017:0:6494:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011c7300 going to sleep for 11 seconds 00000100:00100000:2.0:1762166979.974039:0:6494:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765449761280:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166979.974054:0:6494:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbac0e1 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000100:00100000:1.0:1762166979.974214:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.974252:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450616704 00000100:00100000:2.0:1762166979.974258:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450616704 00010000:00010000:2.0:1762166979.974277:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9400/0x2f180c4effbac09b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea484 expref: 539 pid: 6494 timeout: 699 lvb_type: 0 00000100:00100000:2.0:1762166979.974299:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9723 00000100:00100000:2.0:1762166979.974304:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf7839180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+539:2419:x1847765450616704:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166979.974313:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166979.974317:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9400/0x2f180c4effbac09b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea484 expref: 539 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:2.0:1762166979.974326:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9400/0x2f180c4effbac09b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea484 expref: 539 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:2.0:1762166979.974339:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9400/0x2f180c4effbac09b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea484 expref: 539 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:2.0:1762166979.974351:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166979.974355:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbac0e1 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166979.974363:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbac0e1 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166979.974369:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbac0e1 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166979.974397:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166979.974432:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf7839180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+538:2419:x1847765450616704:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 127us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166979.974440:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9723 00010000:00010000:1.0:1762166979.974453:0:6494:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbac0e1 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166979.974464:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbac0e1 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:1.0:1762166979.974515:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 185835 00010000:00010000:1.0:1762166979.974608:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbac0da lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea499 expref: 539 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.974617:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbac0e1 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea499 expref: 538 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.974623:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:1.0:1762166979.974625:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1762166979.974626:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa8000, rc 0) 00000100:00100000:1.0:1762166979.974654:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf7838700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+538:61869:x1847765450616576:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1871us (1949us total) trans 4294992328 rc 0/0 00000100:00100000:1.0:1762166979.974659:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30693 00000100:00100000:1.0:1762166979.975667:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.975726:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450616832 00000100:00100000:2.0:1762166979.975732:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450616832 00000100:00100000:2.0:1762166979.975768:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11929 00000100:00100000:2.0:1762166979.975777:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+538:61869:x1847765450616832:12345-192.168.204.38@tcp:33:lfs.0 00000100:00100000:2.0:1762166979.975889:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+538:61869:x1847765450616832:12345-192.168.204.38@tcp:33:lfs.0 Request processed in 113us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166979.975896:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11929 00000100:00100000:3.0:1762166979.976906:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.976935:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450617088 00000100:00100000:2.0:1762166979.976940:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450617088 00000100:00100000:2.0:1762166979.976964:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11930 00000100:00100000:2.0:1762166979.976970:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7be1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+538:61869:x1847765450617088:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:2.0:1762166979.977066:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7be1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+539:61869:x1847765450617088:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 97us (161us total) trans 4294992329 rc 0/0 00000100:00100000:2.0:1762166979.977072:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11930 00000100:00100000:0.0:1762166979.977914:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166979.977954:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450617344 00000100:00100000:1.0:1762166979.977960:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450617344 00000100:00100000:1.0:1762166979.977995:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30694 00000100:00100000:1.0:1762166979.978004:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc59d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+539:61869:x1847765450617344:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166979.978018:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166979.978021:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:1.0:1762166979.978040:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbac0e1 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea499 expref: 539 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.978059:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbac0cc lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea492 expref: 538 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.978071:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:1.0:1762166979.978073:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166979.978084:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbac0ef lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea4a0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.978132:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbac0f6 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166979.978140:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbac0f6 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166979.978145:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbac0f6 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:1.0:1762166979.978150:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 185835 00010000:00010000:1.0:1762166979.978192:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbac0ef lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea4a0 expref: 540 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.978200:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbac0f6 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea4a0 expref: 539 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.978205:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:1.0:1762166979.978207:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762166979.978209:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355b200, rc 0) 00000100:00100000:1.0:1762166979.978234:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc59d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+539:61869:x1847765450617344:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 233us (322us total) trans 4294992330 rc 0/0 00000100:00100000:1.0:1762166979.978238:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30694 00000100:00100000:1.0:1762166979.979064:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.979102:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450617600 00000100:00100000:2.0:1762166979.979107:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450617600 00000100:00100000:2.0:1762166979.979132:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11931 00000100:00100000:2.0:1762166979.979137:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+539:61869:x1847765450617600:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:2.0:1762166979.979165:0:19593:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x240000404:0x5eb:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbac0f6 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea4a0 expref: 539 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.979182:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbac104 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:2.0:1762166979.979188:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbac05c lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea468 expref: 539 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.979193:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effbac078 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea476 expref: 539 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.979198:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbac104 lrc: 5/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166979.979216:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effbac078 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea476 expref: 539 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.979224:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effbac078 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea476 expref: 539 pid: 6495 timeout: 699 lvb_type: 0 00000100:00100000:2.0:1762166979.979233:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449761408:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166979.979283:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbac05c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea468 expref: 539 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.979290:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbac05c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea468 expref: 539 pid: 6494 timeout: 699 lvb_type: 0 00000100:00100000:2.0:1762166979.979297:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449761536:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166979.979314:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011c7300 going to sleep for 11 seconds 00000100:00100000:2.0:1762166979.980160:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449761408:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166979.980168:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449761536:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166979.980181:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbac104 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:1.0:1762166979.980377:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166979.980416:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.980436:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450617728 00000100:00100000:2.0:1762166979.980443:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450617728 00010000:00010000:2.0:1762166979.980467:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbac05c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea468 expref: 540 pid: 6494 timeout: 699 lvb_type: 0 00000100:00100000:3.0:1762166979.980509:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450617856 00000100:00100000:3.0:1762166979.980515:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450617856 00000100:00100000:2.0:1762166979.980529:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9724 00010000:00010000:3.0:1762166979.980537:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effbac078 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea476 expref: 541 pid: 6495 timeout: 699 lvb_type: 0 00000100:00100000:2.0:1762166979.980540:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf7839f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+541:2418:x1847765450617728:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166979.980554:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166979.980560:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbac05c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea468 expref: 541 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:2.0:1762166979.980572:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbac05c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea468 expref: 541 pid: 6494 timeout: 699 lvb_type: 0 00000100:00100000:3.0:1762166979.980583:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9725 00010000:00010000:2.0:1762166979.980588:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbac05c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea468 expref: 541 pid: 6494 timeout: 699 lvb_type: 0 00000100:00100000:3.0:1762166979.980598:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7c31850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+541:2419:x1847765450617856:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166979.980605:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:3.0:1762166979.980610:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166979.980612:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbac104 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166979.980618:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effbac078 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea476 expref: 540 pid: 6495 timeout: 699 lvb_type: 0 00010000:00010000:2.0:1762166979.980623:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbac104 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166979.980633:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166979.980639:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effbac078 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea476 expref: 540 pid: 6495 timeout: 699 lvb_type: 0 00010000:00010000:3.0:1762166979.980656:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effbac078 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea476 expref: 540 pid: 6495 timeout: 699 lvb_type: 0 00010000:00010000:3.0:1762166979.980670:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00000100:00100000:2.0:1762166979.980670:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf7839f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+539:2418:x1847765450617728:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 132us (291us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166979.980680:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbac104 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:2.0:1762166979.980684:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9724 00010000:00010000:3.0:1762166979.980695:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbac104 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166979.980703:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbac104 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166979.980729:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166979.980748:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbac104 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166979.980756:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbac104 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:3.0:1762166979.980767:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7c31850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+538:2419:x1847765450617856:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 174us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166979.980776:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9725 00010000:00010000:2.0:1762166979.980969:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbac104 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166979.980977:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbac104 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166979.980984:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbac104 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166979.980990:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa8800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166979.980994:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbac104 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166979.981001:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbac104 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166979.981010:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166979.981013:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1762166979.981017:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbac104 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166979.981022:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbac104 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166979.981032:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166979.981034:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166979.981039:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbac0f6 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea4a0 expref: 537 pid: 6494 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166979.981128:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+537:61869:x1847765450617600:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 1990us (2065us total) trans 4294992331 rc -22/-22 00000100:00100000:2.0:1762166979.981137:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11931 00000100:00100000:0.0:1762166979.981861:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166979.981896:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450617984 00000100:00100000:1.0:1762166979.981901:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450617984 00000100:00100000:1.0:1762166979.981930:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30695 00000100:00100000:1.0:1762166979.981936:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+537:61869:x1847765450617984:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166979.981949:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166979.981957:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbac10b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea4a7 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.981986:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbac10b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea4a7 expref: 538 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.981993:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbac10b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea4a7 expref: 538 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166979.982003:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:1.0:1762166979.982005:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166979.982007:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355a200, rc 0) 00000100:00100000:1.0:1762166979.982035:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+538:61869:x1847765450617984:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 98us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166979.982043:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30695 00000100:00100000:1.0:1762166979.983471:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.983606:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450618240 00000100:00100000:2.0:1762166979.983611:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450618240 00000100:00100000:2.0:1762166979.983637:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30696 00000100:00100000:2.0:1762166979.983642:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+538:61869:x1847765450618240:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166979.983651:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166979.983662:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbac112 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea4ae expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.984015:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbac119 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x617:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166979.984023:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbac119 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x617:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166979.984029:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbac119 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x617:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:2.0:1762166979.984035:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x617:0x0]: returning size 0 00010000:00010000:2.0:1762166979.984066:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbac112 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea4ae expref: 541 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.984079:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbac119 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x617:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea4ae expref: 540 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.984085:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x617:0x0].0x0 (ffff945bc4077300) 00010000:00010000:2.0:1762166979.984087:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166979.984089:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa9a00, rc 0) 00000100:00100000:2.0:1762166979.984125:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+540:61869:x1847765450618240:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 482us (657us total) trans 4294992332 rc 0/0 00000100:00100000:2.0:1762166979.984132:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30696 00000100:00100000:3.0:1762166979.985462:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.985524:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450618496 00000100:00100000:2.0:1762166979.985531:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450618496 00000100:00100000:2.0:1762166979.985569:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30697 00000100:00100000:2.0:1762166979.985579:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc70b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+540:61869:x1847765450618496:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166979.985598:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166979.985611:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbac127 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea4b5 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.985677:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbac12e lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166979.985687:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbac12e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166979.985695:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbac12e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:2.0:1762166979.985705:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 185835 00010000:00010000:2.0:1762166979.985770:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbac127 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea4b5 expref: 543 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.985783:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbac12e lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea4b5 expref: 542 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.985790:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166979.985792:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166979.985794:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa9c00, rc 0) 00000100:00100000:2.0:1762166979.985847:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc70b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+542:61869:x1847765450618496:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 269us (388us total) trans 4294992333 rc 0/0 00000100:00100000:2.0:1762166979.985854:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30697 00000100:00100000:0.0:1762166979.986768:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.986806:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450618752 00000100:00100000:2.0:1762166979.986812:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450618752 00000100:00100000:2.0:1762166979.986851:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11932 00000100:00100000:2.0:1762166979.986860:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1dde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+542:61869:x1847765450618752:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:2.0:1762166979.986898:0:19593:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x240000404:0x5eb:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbac12e lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea4b5 expref: 542 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.986924:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbac13c lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:2.0:1762166979.986933:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbac10b lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea4a7 expref: 542 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.986940:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbac13c lrc: 4/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166979.986965:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbac10b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea4a7 expref: 542 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.986978:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbac10b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea4a7 expref: 542 pid: 6494 timeout: 699 lvb_type: 0 00000100:00100000:2.0:1762166979.986990:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449761664:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166979.987045:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a1540 going to sleep for 11 seconds 00000100:00100000:2.0:1762166979.987982:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449761664:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166979.988001:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:2.0:1762166979.988006:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbac13c lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:3.0:1762166979.988088:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450618880 00000100:00100000:3.0:1762166979.988099:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450618880 00010000:00010000:3.0:1762166979.988133:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbac10b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea4a7 expref: 543 pid: 6494 timeout: 699 lvb_type: 0 00000100:00100000:3.0:1762166979.988170:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9726 00000100:00100000:3.0:1762166979.988181:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+543:2418:x1847765450618880:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166979.988195:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166979.988202:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbac10b lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea4a7 expref: 543 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:3.0:1762166979.988215:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbac10b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea4a7 expref: 543 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:3.0:1762166979.988239:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbac10b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea4a7 expref: 543 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:3.0:1762166979.988256:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:3.0:1762166979.988261:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbac13c lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166979.988270:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbac13c lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166979.988277:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbac13c lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166979.988306:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166979.988333:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbac13c lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166979.988347:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbac13c lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:3.0:1762166979.988351:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+542:2418:x1847765450618880:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 171us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166979.988362:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9726 00010000:00010000:2.0:1762166979.988378:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14000/0x2f180c4effbac143 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x617:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:2.0:1762166979.988397:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbac119 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x617:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea4ae expref: 541 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.988405:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14000/0x2f180c4effbac143 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x617:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166979.988436:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbac119 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x617:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea4ae expref: 541 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.988450:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbac119 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x617:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea4ae expref: 541 pid: 6494 timeout: 699 lvb_type: 0 00000100:00100000:2.0:1762166979.988466:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449761792:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166979.988626:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a1540 going to sleep for 11 seconds 00000100:00100000:2.0:1762166979.989232:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449761792:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166979.989246:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14000/0x2f180c4effbac143 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x617:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:0.0:1762166979.989736:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166979.989815:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450619008 00000100:00100000:3.0:1762166979.989821:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450619008 00010000:00010000:3.0:1762166979.989850:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbac119 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x617:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea4ae expref: 542 pid: 6494 timeout: 699 lvb_type: 0 00000100:00100000:3.0:1762166979.989871:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9727 00000100:00100000:3.0:1762166979.989877:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+542:2419:x1847765450619008:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166979.989883:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166979.989888:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbac119 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x617:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea4ae expref: 542 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:3.0:1762166979.989898:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbac119 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x617:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea4ae expref: 542 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:3.0:1762166979.989908:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbac119 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x617:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea4ae expref: 542 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:3.0:1762166979.989917:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x617:0x0].0x0 (ffff945bc4077300) 00010000:00010000:3.0:1762166979.989921:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14000/0x2f180c4effbac143 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x617:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166979.989927:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14000/0x2f180c4effbac143 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x617:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166979.989933:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14000/0x2f180c4effbac143 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x617:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166979.989951:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166979.989967:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14000/0x2f180c4effbac143 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x617:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166979.989976:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14000/0x2f180c4effbac143 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x617:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:3.0:1762166979.989988:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+541:2419:x1847765450619008:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 110us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166979.989996:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9727 00000100:00100000:2.0:1762166979.990376:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449761920:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762166979.990417:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166979.990440:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc4446b40 going to sleep for 11 seconds 00000100:00100000:1.0:1762166979.990456:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449761920 00000100:00100000:1.0:1762166979.990460:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449761920 00000100:00100000:1.0:1762166979.990510:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1429 00000100:00100000:1.0:1762166979.990517:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449761920:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166979.990590:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449761920:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 74us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166979.990598:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1429 00000100:00100000:2.0:1762166979.990646:0:19593:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 17179876559 gen 2 00000004:00080000:2.0:1762166979.990654:0:19593:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 17179876555 committed transno 17179876559 00000004:00080000:2.0:1762166979.990669:0:19593:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc70b0a80, transno 17179876556 00000004:00080000:2.0:1762166979.990685:0:19593:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc70b1880, transno 17179876557 00000004:00080000:2.0:1762166979.990689:0:19593:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc70b3480, transno 17179876558 00000004:00080000:2.0:1762166979.990691:0:19593:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc70b1500, transno 17179876559 00000100:00100000:2.0:1762166979.990697:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449761920:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762166979.990738:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449762048:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762166979.990766:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166979.990790:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a1540 going to sleep for 11 seconds 00000004:00080000:3.0:1762166979.990796:0:9994:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0001: 0 changes, 0 in progress, 0 in flight, 4 done 00000100:00100000:1.0:1762166979.990810:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449762048 00000100:00100000:1.0:1762166979.990815:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449762048 00000100:00100000:1.0:1762166979.990848:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1430 00000100:00100000:1.0:1762166979.990854:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:19593:x1847765449762048:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166979.990919:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:19593:x1847765449762048:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 65us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166979.990927:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1430 00000100:00100000:2.0:1762166979.990944:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449762048:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762166979.990994:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449762176:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762166979.991015:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166979.991033:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cee171300 going to sleep for 11 seconds 00000100:00100000:1.0:1762166979.991049:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449762176 00000100:00100000:1.0:1762166979.991053:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449762176 00000100:00100000:1.0:1762166979.991073:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1431 00000100:00100000:1.0:1762166979.991077:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:19593:x1847765449762176:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166979.991118:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:19593:x1847765449762176:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 40us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166979.991124:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1431 00000100:00100000:2.0:1762166979.991141:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449762176:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762166979.991171:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449762304:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762166979.991191:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166979.991209:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cee171900 going to sleep for 11 seconds 00000100:00100000:1.0:1762166979.991229:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449762304 00000100:00100000:1.0:1762166979.991235:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449762304 00000100:00100000:1.0:1762166979.991255:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1432 00000100:00100000:1.0:1762166979.991259:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449762304:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166979.991301:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449762304:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 41us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166979.991306:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1432 00000100:00100000:2.0:1762166979.991321:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449762304:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762166979.991357:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449762432:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762166979.991379:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166979.991397:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cee171000 going to sleep for 11 seconds 00000100:00100000:1.0:1762166979.991414:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449762432 00000100:00100000:1.0:1762166979.991418:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449762432 00000100:00100000:1.0:1762166979.991437:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1433 00000100:00100000:1.0:1762166979.991440:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:19593:x1847765449762432:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166979.991515:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:19593:x1847765449762432:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 73us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166979.991521:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1433 00000100:00100000:2.0:1762166979.991542:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449762432:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762166979.991598:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449762560:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762166979.991621:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166979.991639:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cee171000 going to sleep for 11 seconds 00000100:00100000:1.0:1762166979.991645:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449762560 00000100:00100000:1.0:1762166979.991649:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449762560 00000100:00100000:1.0:1762166979.991676:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1434 00000100:00100000:1.0:1762166979.991680:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449762560:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166979.991719:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449762560:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 39us (98us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166979.991725:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1434 00000100:00100000:2.0:1762166979.991737:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449762560:0@lo:1000:mdt_rdpg00_003.0 00000040:00080000:2.0:1762166979.991886:0:19593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x2:0x0].58, 368 off70136 00000001:00080000:2.0:1762166979.991894:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992334 00000100:00100000:2.0:1762166979.991931:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449762688:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762166979.991952:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166979.991972:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cee171000 going to sleep for 11 seconds 00000100:00100000:3.0:1762166979.992001:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449762688 00000100:00100000:3.0:1762166979.992011:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449762688 00000100:00100000:3.0:1762166979.992070:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1435 00000100:00100000:3.0:1762166979.992081:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449762688:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166979.992265:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:19593:x1847765449762688:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 186us (311us total) trans 17179876570 rc 0/0 00000100:00100000:3.0:1762166979.992279:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1435 00000100:00100000:2.0:1762166979.992302:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449762688:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762166979.992327:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5ea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449762816:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762166979.992358:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166979.992384:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cee171000 going to sleep for 11 seconds 00000100:00100000:3.0:1762166979.992409:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449762816 00000100:00100000:3.0:1762166979.992416:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449762816 00000100:00100000:3.0:1762166979.992452:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1436 00000100:00100000:3.0:1762166979.992461:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:19593:x1847765449762816:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166979.992598:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:19593:x1847765449762816:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 138us (237us total) trans 21474843393 rc 0/0 00000100:00100000:3.0:1762166979.992605:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1436 00000100:00100000:2.0:1762166979.992641:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5ea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449762816:0@lo:1000:mdt_rdpg00_003.0 00000001:00080000:2.0:1762166979.992704:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992335 00010000:00010000:2.0:1762166979.992735:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14000/0x2f180c4effbac143 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x617:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166979.992742:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14000/0x2f180c4effbac143 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x617:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166979.992747:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14000/0x2f180c4effbac143 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x617:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166979.992751:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945d00f14000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166979.992754:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14000/0x2f180c4effbac143 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x617:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166979.992758:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14000/0x2f180c4effbac143 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x617:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166979.992773:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x617:0x0].0x0 (ffff945bc4077300) 00010000:00010000:2.0:1762166979.992776:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1762166979.992778:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14000/0x2f180c4effbac143 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x617:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166979.992782:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14000/0x2f180c4effbac143 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x617:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166979.992796:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbac13c lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166979.992799:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbac13c lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166979.992804:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbac13c lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166979.992809:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa8c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166979.992812:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbac13c lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166979.992817:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbac13c lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166979.992824:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166979.992826:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1762166979.992829:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbac13c lrc: 2/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166979.992844:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbac13c lrc: 0/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166979.992855:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166979.992858:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166979.992863:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbac12e lrc: 0/0,0 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea4b5 expref: 543 pid: 6494 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166979.992929:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1dde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+542:61869:x1847765450618752:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 6072us (6162us total) trans 4294992336 rc 0/0 00000100:00100000:2.0:1762166979.992935:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11932 00000020:00080000:2.0:1762166979.992937:0:19593:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1762166979.993920:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.993963:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450619136 00000100:00100000:2.0:1762166979.993968:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450619136 00000100:00100000:2.0:1762166979.994009:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30698 00000100:00100000:2.0:1762166979.994017:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+542:61869:x1847765450619136:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166979.994032:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166979.994048:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effbac14a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea4bc expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.994090:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effbac14a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea4bc expref: 543 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.994101:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effbac14a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea4bc expref: 543 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166979.994116:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166979.994118:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166979.994120:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc60b1400, rc 0) 00000100:00100000:2.0:1762166979.994157:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+543:61869:x1847765450619136:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 142us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166979.994164:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30698 00000100:00100000:1.0:1762166979.995532:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.995583:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450619392 00000100:00100000:2.0:1762166979.995591:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450619392 00000100:00100000:2.0:1762166979.995633:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11933 00000100:00100000:2.0:1762166979.995641:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf7838a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+543:61869:x1847765450619392:12345-192.168.204.38@tcp:35:lfs.0 00000004:00080000:2.0:1762166979.995898:0:19593:0:(mdd_object.c:3965:mdd_close()) Object [0x240000404:0x617:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1762166979.995964:0:19593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5925, 64 off464104 00000004:00080000:2.0:1762166979.995972:0:19593:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 599144494164ns, next at 600144491692ns, rc = 0 00000040:00080000:2.0:1762166979.996000:0:19593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5924, 64 off464104 00000004:00080000:2.0:1762166979.996005:0:19593:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 599144526879ns, next at 600144525370ns, rc = 0 00000001:00080000:2.0:1762166979.996010:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992337 00010000:00010000:2.0:1762166979.996042:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba000/0x2f180c4effbac151 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x617:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:2.0:1762166979.996053:0:19593:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba000/0x2f180c4effbac151 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x617:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166979.996061:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba000/0x2f180c4effbac151 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x617:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166979.996069:0:19593:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba000/0x2f180c4effbac151 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x617:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166979.996076:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba000/0x2f180c4effbac151 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x617:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166979.996081:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba000/0x2f180c4effbac151 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x617:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166979.996103:0:19593:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1762166979.996132:0:6482:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1762166979.996140:0:6482:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba000/0x2f180c4effbac151 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x617:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166979.996146:0:6482:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93ba000 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166979.996150:0:6482:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba000/0x2f180c4effbac151 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x617:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166979.996155:0:6482:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba000/0x2f180c4effbac151 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x617:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166979.996164:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x617:0x0].0x0 (ffff945bc4077a00) 00010000:00010000:0.0:1762166979.996166:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1762166979.996169:0:6482:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba000/0x2f180c4effbac151 lrc: 1/0,0 mode: --/PW res: [0x240000404:0x617:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166979.996173:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba000/0x2f180c4effbac151 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x617:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166979.996187:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166979.996189:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166979.996191:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1762166979.996260:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf7838a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+545:61869:x1847765450619392:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 618us (734us total) trans 4294992338 rc 0/0 00000100:00100000:2.0:1762166979.996271:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11933 00000020:00080000:2.0:1762166979.996276:0:19593:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1762166979.997012:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166979.997061:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450619648 00000100:00100000:2.0:1762166979.997067:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450619648 00000100:00100000:2.0:1762166979.997102:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11934 00000100:00100000:2.0:1762166979.997108:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+545:61869:x1847765450619648:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:2.0:1762166979.997329:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+546:61869:x1847765450619648:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 220us (319us total) trans 4294992339 rc 0/0 00000100:00100000:2.0:1762166979.997337:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11934 00000100:00100000:3.0:1762166980.005675:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.005725:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450619776 00000100:00100000:2.0:1762166980.005736:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450619776 00000100:00100000:2.0:1762166980.005795:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30699 00000100:00100000:2.0:1762166980.005804:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc70b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+546:61870:x1847765450619776:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166980.005850:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166980.005875:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb600/0x2f180c4effbac158 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea4c3 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.005967:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba000/0x2f180c4effbac15f lrc: 3/1,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166980.005984:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba000/0x2f180c4effbac15f lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.005997:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba000/0x2f180c4effbac15f lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.006012:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14000/0x2f180c4effbac166 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166980.006023:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14000/0x2f180c4effbac166 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.006030:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14000/0x2f180c4effbac166 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.006123:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194e00/0x2f180c4effbac16d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166980.006136:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194e00/0x2f180c4effbac16d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.006143:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194e00/0x2f180c4effbac16d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:2.0:1762166980.006186:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 185835 00000004:00200000:2.0:1762166980.006190:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166980.006207:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194e00/0x2f180c4effbac16d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.006218:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194e00/0x2f180c4effbac16d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.006225:0:6494:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba000/0x2f180c4effbac15f lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.006230:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba000/0x2f180c4effbac15f lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.006234:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba000/0x2f180c4effbac15f lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.006238:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba000/0x2f180c4effbac15f lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.006245:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93ba000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166980.006248:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba000/0x2f180c4effbac15f lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.006253:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba000/0x2f180c4effbac15f lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.006262:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0x0 (ffff945bc4077300) 00010000:00010000:2.0:1762166980.006264:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166980.006268:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba000/0x2f180c4effbac15f lrc: 3/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.006271:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba000/0x2f180c4effbac15f lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.006281:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14000/0x2f180c4effbac166 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.006285:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14000/0x2f180c4effbac166 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.006288:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14000/0x2f180c4effbac166 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.006291:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945d00f14000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166980.006292:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14000/0x2f180c4effbac166 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.006295:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14000/0x2f180c4effbac166 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.006298:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0xdd396665 (ffff945bc4077200) 00010000:00010000:2.0:1762166980.006300:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166980.006302:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14000/0x2f180c4effbac166 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.006305:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14000/0x2f180c4effbac166 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.006329:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb600/0x2f180c4effbac158 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea4c3 expref: 548 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.006338:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194e00/0x2f180c4effbac16d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea4c3 expref: 547 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.006343:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166980.006344:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166980.006346:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc7194e00, rc 0) 00000100:00100000:2.0:1762166980.006427:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc70b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+547:61870:x1847765450619776:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 623us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166980.006434:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30699 00000100:00100000:1.0:1762166980.008437:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.008532:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450620032 00000100:00100000:2.0:1762166980.008545:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450620032 00000100:00100000:2.0:1762166980.008612:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30700 00000100:00100000:2.0:1762166980.008623:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf7839180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+547:61870:x1847765450620032:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166980.008644:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166980.008662:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194800/0x2f180c4effbac174 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea4ca expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.008760:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194200/0x2f180c4effbac17b lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166980.008774:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194200/0x2f180c4effbac17b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.008784:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194200/0x2f180c4effbac17b lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:2.0:1762166980.008795:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 185835 00010000:00010000:2.0:1762166980.008934:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194800/0x2f180c4effbac174 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea4ca expref: 550 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.008953:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194200/0x2f180c4effbac17b lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea4ca expref: 549 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.008962:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166980.008964:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1762166980.008967:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc7194200, rc 0) 00000100:00100000:2.0:1762166980.009028:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf7839180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+549:61870:x1847765450620032:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 407us (599us total) trans 4294992340 rc 0/0 00000100:00100000:2.0:1762166980.009035:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30700 00000100:00100000:1.0:1762166980.010285:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.010336:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450620288 00000100:00100000:2.0:1762166980.010344:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450620288 00000100:00100000:2.0:1762166980.010385:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30701 00000100:00100000:2.0:1762166980.010391:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf7839f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+549:61870:x1847765450620288:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166980.010405:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166980.010416:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc3619200/0x2f180c4effbac189 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea4d1 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.010502:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc3618200/0x2f180c4effbac190 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166980.010515:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc3618200/0x2f180c4effbac190 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.010525:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc3618200/0x2f180c4effbac190 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:2.0:1762166980.010534:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 185835 00010000:00010000:2.0:1762166980.010588:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc3619200/0x2f180c4effbac189 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea4d1 expref: 552 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.010600:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc3618200/0x2f180c4effbac190 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea4d1 expref: 551 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.010604:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166980.010606:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166980.010608:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc3618200, rc 0) 00000100:00100000:2.0:1762166980.010644:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf7839f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+551:61870:x1847765450620288:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 254us (365us total) trans 4294992341 rc 0/0 00000100:00100000:2.0:1762166980.010649:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30701 00000100:00100000:3.0:1762166980.012264:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.012351:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450620416 00000100:00100000:0.0:1762166980.012365:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450620416 00000100:00100000:0.0:1762166980.012443:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 890 00000100:00100000:0.0:1762166980.012456:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc70b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+551:61870:x1847765450620416:12345-192.168.204.38@tcp:103:lfs.0 00010000:00010000:0.0:1762166980.012473:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166980.012534:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc3618200/0x2f180c4effbac190 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea4d1 expref: 551 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.012555:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:0.0:1762166980.012561:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166980.012619:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc70b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+550:61870:x1847765450620416:12345-192.168.204.38@tcp:103:lfs.0 Request processed in 167us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166980.012627:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 890 00000100:00100000:1.0:1762166980.013402:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.013453:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450620672 00000100:00100000:2.0:1762166980.013460:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450620672 00000100:00100000:2.0:1762166980.013513:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11935 00000100:00100000:2.0:1762166980.013522:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7be0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+550:61870:x1847765450620672:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:2.0:1762166980.013717:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7be0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+551:61870:x1847765450620672:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 198us (316us total) trans 4294992342 rc 0/0 00000100:00100000:2.0:1762166980.013722:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11935 00000100:00100000:1.0:1762166980.015378:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.015420:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450620928 00000100:00100000:2.0:1762166980.015427:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450620928 00000100:00100000:2.0:1762166980.015472:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30702 00000100:00100000:2.0:1762166980.015501:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+551:61766:x1847765450620928:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:2.0:1762166980.015518:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166980.015543:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc3618400/0x2f180c4effbac19e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea4d8 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.015646:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf185ca00/0x2f180c4effbac1a5 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166980.015663:0:6494:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194e00/0x2f180c4effbac16d lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea4c3 expref: 552 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.015670:0:6494:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf185ca00/0x2f180c4effbac1a5 lrc: 4/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.015702:0:6494:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194e00/0x2f180c4effbac16d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea4c3 expref: 552 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.015714:0:6494:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194e00/0x2f180c4effbac16d lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea4c3 expref: 552 pid: 6494 timeout: 699 lvb_type: 0 00000100:00100000:2.0:1762166980.015726:0:6494:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765449762944:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166980.015804:0:6494:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cee171000 going to sleep for 11 seconds 00000100:00100000:2.0:1762166980.016548:0:6494:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765449762944:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166980.016570:0:6494:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945cf185ca00/0x2f180c4effbac1a5 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000100:00100000:1.0:1762166980.016876:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.016918:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450621056 00000100:00100000:0.0:1762166980.016927:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450621056 00010000:00010000:0.0:1762166980.016958:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194e00/0x2f180c4effbac16d lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea4c3 expref: 553 pid: 6494 timeout: 699 lvb_type: 0 00000100:00100000:0.0:1762166980.016999:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9728 00000100:00100000:0.0:1762166980.017007:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+553:2418:x1847765450621056:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166980.017022:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166980.017028:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194e00/0x2f180c4effbac16d lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea4c3 expref: 553 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:0.0:1762166980.017040:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194e00/0x2f180c4effbac16d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea4c3 expref: 553 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:0.0:1762166980.017060:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194e00/0x2f180c4effbac16d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea4c3 expref: 553 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:0.0:1762166980.017076:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:0.0:1762166980.017081:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945cf185ca00/0x2f180c4effbac1a5 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.017091:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf185ca00/0x2f180c4effbac1a5 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.017098:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf185ca00/0x2f180c4effbac1a5 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.017122:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166980.017141:0:6494:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945cf185ca00/0x2f180c4effbac1a5 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.017149:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf185ca00/0x2f180c4effbac1a5 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000100:00100000:0.0:1762166980.017167:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+552:2418:x1847765450621056:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 160us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166980.017175:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9728 00000004:00200000:2.0:1762166980.017177:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 185835 00010000:00010000:2.0:1762166980.017296:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc3618400/0x2f180c4effbac19e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea4d8 expref: 553 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.017309:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf185ca00/0x2f180c4effbac1a5 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea4d8 expref: 552 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.017314:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166980.017315:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1762166980.017317:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf185ca00, rc 0) 00000100:00100000:2.0:1762166980.017351:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+552:61766:x1847765450620928:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 1851us (1975us total) trans 4294992343 rc 0/0 00000100:00100000:2.0:1762166980.017359:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30702 00000100:00100000:1.0:1762166980.018403:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.018443:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450621184 00000100:00100000:2.0:1762166980.018449:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450621184 00000100:00100000:2.0:1762166980.018522:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30703 00000100:00100000:2.0:1762166980.018528:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+552:61766:x1847765450621184:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:2.0:1762166980.018543:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166980.018563:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14000/0x2f180c4effbac1b3 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea4df expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.018636:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb600/0x2f180c4effbac1ba lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166980.018647:0:6494:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf185ca00/0x2f180c4effbac1a5 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea4d8 expref: 553 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.018654:0:6494:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb600/0x2f180c4effbac1ba lrc: 4/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.018681:0:6494:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945cf185ca00/0x2f180c4effbac1a5 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea4d8 expref: 553 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.018693:0:6494:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf185ca00/0x2f180c4effbac1a5 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea4d8 expref: 553 pid: 6494 timeout: 699 lvb_type: 0 00000100:00100000:2.0:1762166980.018706:0:6494:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765449763072:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166980.018761:0:6494:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cee171f00 going to sleep for 11 seconds 00000100:00100000:2.0:1762166980.019436:0:6494:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765449763072:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166980.019453:0:6494:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb600/0x2f180c4effbac1ba lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000100:00100000:1.0:1762166980.019572:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.019601:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450621312 00000100:00100000:0.0:1762166980.019606:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450621312 00010000:00010000:0.0:1762166980.019623:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf185ca00/0x2f180c4effbac1a5 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea4d8 expref: 554 pid: 6494 timeout: 699 lvb_type: 0 00000100:00100000:0.0:1762166980.019651:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9729 00000100:00100000:0.0:1762166980.019658:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf7838a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+554:2419:x1847765450621312:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166980.019667:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166980.019673:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945cf185ca00/0x2f180c4effbac1a5 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea4d8 expref: 554 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:0.0:1762166980.019683:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945cf185ca00/0x2f180c4effbac1a5 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea4d8 expref: 554 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:0.0:1762166980.019697:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf185ca00/0x2f180c4effbac1a5 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea4d8 expref: 554 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:0.0:1762166980.019719:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:0.0:1762166980.019723:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb600/0x2f180c4effbac1ba lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.019731:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb600/0x2f180c4effbac1ba lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.019738:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb600/0x2f180c4effbac1ba lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.019755:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166980.019771:0:6494:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb600/0x2f180c4effbac1ba lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.019778:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb600/0x2f180c4effbac1ba lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000100:00100000:0.0:1762166980.019785:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf7838a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+553:2419:x1847765450621312:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 125us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166980.019794:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9729 00000004:00200000:2.0:1762166980.019806:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 185835 00000004:00200000:2.0:1762166980.019810:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166980.019823:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb600/0x2f180c4effbac1ba lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.019856:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14000/0x2f180c4effbac1b3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea4df expref: 553 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.019872:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb600/0x2f180c4effbac1ba lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea4df expref: 552 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.019889:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166980.019892:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166980.019895:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93bb600, rc 0) 00000100:00100000:2.0:1762166980.019930:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+552:61766:x1847765450621184:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 1401us (1529us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166980.019937:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30703 00000100:00100000:1.0:1762166980.021249:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.021293:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450621440 00000100:00100000:2.0:1762166980.021298:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450621440 00000100:00100000:2.0:1762166980.021335:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30704 00000100:00100000:2.0:1762166980.021344:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+552:61766:x1847765450621440:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:2.0:1762166980.021359:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166980.021370:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba000/0x2f180c4effbac1c1 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea4e6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.021391:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9a00/0x2f180c4effbac1c8 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166980.021401:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9a00/0x2f180c4effbac1c8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.021410:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9a00/0x2f180c4effbac1c8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.021542:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba000/0x2f180c4effbac1c1 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea4e6 expref: 554 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.021558:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9a00/0x2f180c4effbac1c8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea4e6 expref: 553 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.021571:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166980.021573:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1762166980.021576:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc5db9a00, rc 0) 00000100:00100000:2.0:1762166980.021616:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+553:61766:x1847765450621440:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 273us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166980.021623:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30704 00000100:00100000:3.0:1762166980.022448:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.022533:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450621696 00000100:00100000:2.0:1762166980.022538:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450621696 00000100:00100000:2.0:1762166980.022563:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30705 00000100:00100000:2.0:1762166980.022570:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc70b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+553:61766:x1847765450621696:12345-192.168.204.38@tcp:36:fsx.0 00010000:00010000:2.0:1762166980.022598:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166980.022610:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb600/0x2f180c4effbac1ba lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea4df expref: 553 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.022619:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166980.022621:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166980.022752:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8400/0x2f180c4effbac1cf lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166980.022763:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8400/0x2f180c4effbac1cf lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.022771:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8400/0x2f180c4effbac1cf lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000001:00080000:2.0:1762166980.022806:0:6494:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992344 00000004:00010000:2.0:1762166980.022823:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000031ffb6a2 reply state 00000000fc9b6cca transno 4294992345 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8400/0x2f180c4effbac1cf lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.022848:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8400/0x2f180c4effbac1cf lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.022852:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166980.022854:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166980.022856:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166980.022903:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc70b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+555:61766:x1847765450621696:12345-192.168.204.38@tcp:36:fsx.0 Request processed in 334us (458us total) trans 4294992345 rc 0/0 00000100:00100000:2.0:1762166980.022908:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30705 00000020:00080000:2.0:1762166980.022911:0:6494:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1762166980.023793:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.023820:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.023855:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450621824 00000100:00100000:2.0:1762166980.023861:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450621824 00000100:00100000:1.0:1762166980.023868:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.023881:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450621952 00000100:00100000:3.0:1762166980.023887:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450621952 00002000:00010000:2.0:1762166980.023899:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (259220->18446744073709551615) 00002000:00100000:2.0:1762166980.023905:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4010380 with x1847765450621824 ext(259220->18446744073709551615) 00002000:00010000:3.0:1762166980.023908:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:3.0:1762166980.023913:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4011880 with x1847765450621952 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166980.023915:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4010380. 00002000:00010000:3.0:1762166980.023921:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc4011880. 00000100:00100000:0.0:1762166980.023925:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450622080 00000100:00100000:0.0:1762166980.023932:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450622080 00002000:00010000:0.0:1762166980.023953:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00000100:00100000:2.0:1762166980.023954:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2535 00002000:00100000:0.0:1762166980.023961:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4010000 with x1847765450622080 ext(0->18446744073709551615) 00000100:00100000:3.0:1762166980.023966:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2536 00000100:00100000:2.0:1762166980.023970:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4010380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+22:2416:x1847765450621824:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:0.0:1762166980.023971:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4010000. 00000100:00100000:3.0:1762166980.023981:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4011880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+20:2417:x1847765450621952:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:0.0:1762166980.023998:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2537 00000100:00100000:0.0:1762166980.024008:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4010000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+22:2416:x1847765450622080:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:3.0:1762166980.024082:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166980.024086:0:23943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00002000:00010000:3.0:1762166980.024089:0:23943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166979 -> 1762166979 00002000:00010000:3.0:1762166980.024092:0:23943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:3.0:1762166980.024094:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00002000:00010000:0.0:1762166980.024096:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166980.024100:0:23939:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00002000:00010000:0.0:1762166980.024103:0:23939:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166979 -> 1762166979 00002000:00010000:0.0:1762166980.024106:0:23939:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:0.0:1762166980.024109:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166980.024121:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4011880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+21:2417:x1847765450621952:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 146us (301us total) trans 21474843394 rc 0/0 00000100:00100000:3.0:1762166980.024128:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2536 00002000:00010000:3.0:1762166980.024130:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:3.0:1762166980.024133:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4011880 with x1847765450621952 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166980.024137:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc4011880. 00000100:00100000:0.0:1762166980.024139:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4010000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+24:2416:x1847765450622080:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 131us (272us total) trans 17179876571 rc 0/0 00002000:00010000:2.0:1762166980.024142:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 185835 -> 259220 00002000:00010000:2.0:1762166980.024149:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00002000:00010000:2.0:1762166980.024153:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166979 -> 1762166979 00000100:00100000:0.0:1762166980.024155:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2537 00002000:00010000:2.0:1762166980.024157:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:0.0:1762166980.024160:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00010000:2.0:1762166980.024161:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 176 -> 176 00002000:00100000:0.0:1762166980.024168:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4010000 with x1847765450622080 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166980.024174:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4010000. 00000100:00100000:2.0:1762166980.024195:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4010380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+23:2416:x1847765450621824:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 228us (401us total) trans 17179876572 rc 0/0 00000100:00080000:0.0:1762166980.024196:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1762166980.024203:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1762166980.024207:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2535 00002000:00010000:2.0:1762166980.024212:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (259220->18446744073709551615) 00002000:00100000:2.0:1762166980.024216:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4010380 with x1847765450621824 ext(259220->18446744073709551615) 00002000:00010000:2.0:1762166980.024222:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4010380. 00000100:00100000:1.0:1762166980.025091:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.025135:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450622208 00000100:00100000:2.0:1762166980.025140:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450622208 00000100:00100000:2.0:1762166980.025170:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30706 00000100:00100000:2.0:1762166980.025177:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4012d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+555:61766:x1847765450622208:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:2.0:1762166980.025191:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166980.025203:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9200/0x2f180c4effbac1d6 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea4ed expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.025262:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbac1dd lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166980.025271:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbac1dd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.025278:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbac1dd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:2.0:1762166980.025293:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 259220 00000004:00200000:2.0:1762166980.025297:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166980.025309:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbac1dd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.025332:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9200/0x2f180c4effbac1d6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea4ed expref: 557 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.025348:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbac1dd lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea4ed expref: 556 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.025356:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166980.025359:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166980.025362:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc5db9c00, rc 0) 00000100:00100000:2.0:1762166980.025402:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4012d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+556:61766:x1847765450622208:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 225us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166980.025409:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30706 00000100:00100000:3.0:1762166980.027612:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.027679:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450622336 00000100:00100000:1.0:1762166980.027692:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450622336 00002000:00100000:1.0:1762166980.027733:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (212992->217087) req@ffff945bc70b1500 x1847765450622336/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 488/0 e 0 to 0 dl 1762166991 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166980.027744:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc70b1500 with x1847765450622336 ext(212992->217087) 00002000:00010000:1.0:1762166980.027749:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc70b1500 00000100:00100000:1.0:1762166980.027786:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2538 00000100:00100000:1.0:1762166980.027796:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc70b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765450622336:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:1.0:1762166980.028005:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc70b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765450622336:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 210us (402us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1762166980.028013:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2538 00002000:00100000:1.0:1762166980.028021:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (212992->217087) req@ffff945bc70b1500 x1847765450622336/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 488/4536 e 0 to 0 dl 1762166991 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166980.028029:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc70b1500 with x1847765450622336 ext(212992->217087) 00002000:00010000:1.0:1762166980.028034:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc70b1500 00000100:00100000:1.0:1762166980.029072:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.029123:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450622464 00000100:00100000:0.0:1762166980.029129:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450622464 00002000:00100000:0.0:1762166980.029154:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (217088->221183) req@ffff945bc4012a00 x1847765450622464/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 488/0 e 0 to 0 dl 1762166991 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166980.029163:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4012a00 with x1847765450622464 ext(217088->221183) 00002000:00010000:0.0:1762166980.029167:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4012a00 00000100:00100000:0.0:1762166980.029188:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2539 00000100:00100000:0.0:1762166980.029197:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4012a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765450622464:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:0.0:1762166980.029302:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4012a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765450622464:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 106us (232us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1762166980.029310:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2539 00002000:00100000:0.0:1762166980.029317:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (217088->221183) req@ffff945bc4012a00 x1847765450622464/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 488/4536 e 0 to 0 dl 1762166991 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166980.029325:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4012a00 with x1847765450622464 ext(217088->221183) 00002000:00010000:0.0:1762166980.029329:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4012a00 00000100:00100000:3.0:1762166980.030715:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.030753:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450622592 00000100:00100000:0.0:1762166980.030758:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450622592 00002000:00100000:0.0:1762166980.030781:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (192512->258047) req@ffff945bc70b3100 x1847765450622592/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 504/0 e 0 to 0 dl 1762166991 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166980.030797:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc70b3100 with x1847765450622592 ext(192512->258047) 00002000:00010000:0.0:1762166980.030801:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc70b3100 00000100:00100000:0.0:1762166980.030821:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2540 00000100:00100000:0.0:1762166980.030827:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc70b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765450622592:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:1.0:1762166980.031797:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc70b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765450622592:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 969us (1118us total) trans 0 rc 57344/57344 00000100:00100000:1.0:1762166980.031803:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2540 00002000:00100000:1.0:1762166980.031808:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (192512->258047) req@ffff945bc70b3100 x1847765450622592/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 504/440 e 0 to 0 dl 1762166991 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166980.031814:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc70b3100 with x1847765450622592 ext(192512->258047) 00002000:00010000:1.0:1762166980.031816:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc70b3100 00000100:00100000:1.0:1762166980.033148:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.033190:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450622848 00000100:00100000:2.0:1762166980.033197:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450622848 00000100:00100000:2.0:1762166980.033248:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30707 00000100:00100000:2.0:1762166980.033259:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4013b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+556:61766:x1847765450622848:12345-192.168.204.38@tcp:36:fsx.0 00010000:00010000:2.0:1762166980.033305:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166980.033327:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbac1dd lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea4ed expref: 556 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.033345:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166980.033350:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166980.033539:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9800/0x2f180c4effbac1e4 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166980.033553:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9800/0x2f180c4effbac1e4 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.033563:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9800/0x2f180c4effbac1e4 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000001:00080000:2.0:1762166980.033605:0:6494:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992346 00000004:00010000:2.0:1762166980.033628:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000007d127aaf reply state 000000004be5b812 transno 4294992347 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9800/0x2f180c4effbac1e4 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.033640:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9800/0x2f180c4effbac1e4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.033651:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166980.033654:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166980.033657:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166980.033728:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4013b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+558:61766:x1847765450622848:12345-192.168.204.38@tcp:36:fsx.0 Request processed in 470us (579us total) trans 4294992347 rc 0/0 00000100:00100000:2.0:1762166980.033735:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30707 00000020:00080000:2.0:1762166980.033739:0:6494:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1762166980.034721:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.034747:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.034767:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.034788:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450622976 00000100:00100000:2.0:1762166980.034790:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450623104 00000100:00100000:1.0:1762166980.034797:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450622976 00000100:00100000:2.0:1762166980.034798:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450623104 00000100:00100000:0.0:1762166980.034822:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450623232 00000100:00100000:0.0:1762166980.034844:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450623232 00002000:00010000:2.0:1762166980.034851:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00010000:1.0:1762166980.034851:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (262144->18446744073709551615) 00002000:00100000:2.0:1762166980.034856:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc70b1180 with x1847765450623104 ext(0->18446744073709551615) 00002000:00100000:1.0:1762166980.034858:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc70b1f80 with x1847765450622976 ext(262144->18446744073709551615) 00002000:00010000:1.0:1762166980.034870:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc70b1f80. 00002000:00010000:2.0:1762166980.034871:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc70b1180. 00002000:00010000:0.0:1762166980.034871:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:0.0:1762166980.034882:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc70b2d80 with x1847765450623232 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166980.034892:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc70b2d80. 00000100:00100000:1.0:1762166980.034907:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2541 00000100:00100000:2.0:1762166980.034914:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2542 00000100:00100000:1.0:1762166980.034920:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc70b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765450622976:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:2.0:1762166980.034927:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc70b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450623104:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:3.0:1762166980.034943:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2543 00000100:00100000:3.0:1762166980.034958:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc70b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765450623232:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:3.0:1762166980.035068:0:14623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166980.035068:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166980.035070:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 259220 -> 262144 00002000:00010000:3.0:1762166980.035075:0:14623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00002000:00010000:2.0:1762166980.035076:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00002000:00010000:1.0:1762166980.035076:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00002000:00010000:3.0:1762166980.035083:0:14623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166979 -> 1762166979 00002000:00010000:2.0:1762166980.035083:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166979 -> 1762166979 00002000:00010000:1.0:1762166980.035083:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166979 -> 1762166979 00002000:00010000:2.0:1762166980.035090:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:3.0:1762166980.035091:0:14623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:1.0:1762166980.035092:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:2.0:1762166980.035093:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00002000:00010000:3.0:1762166980.035100:0:14623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:1.0:1762166980.035100:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 176 -> 176 00000100:00100000:2.0:1762166980.035147:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc70b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765450623104:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 226us (399us total) trans 21474843395 rc 0/0 00000100:00100000:2.0:1762166980.035153:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2542 00002000:00010000:2.0:1762166980.035156:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00000100:00100000:1.0:1762166980.035159:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc70b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765450622976:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 242us (441us total) trans 17179876574 rc 0/0 00000100:00100000:3.0:1762166980.035161:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc70b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765450623232:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 204us (388us total) trans 17179876573 rc 0/0 00002000:00100000:2.0:1762166980.035162:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc70b1180 with x1847765450623104 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166980.035171:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc70b1180. 00000100:00100000:1.0:1762166980.035176:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2541 00002000:00010000:1.0:1762166980.035182:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (262144->18446744073709551615) 00000100:00100000:3.0:1762166980.035186:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2543 00002000:00100000:1.0:1762166980.035187:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc70b1f80 with x1847765450622976 ext(262144->18446744073709551615) 00002000:00010000:3.0:1762166980.035191:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:3.0:1762166980.035197:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc70b2d80 with x1847765450623232 ext(0->18446744073709551615) 00002000:00010000:1.0:1762166980.035197:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc70b1f80. 00002000:00010000:3.0:1762166980.035208:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc70b2d80. 00000100:00100000:0.0:1762166980.037053:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.037106:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450623360 00000100:00100000:3.0:1762166980.037114:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450623360 00002000:00100000:3.0:1762166980.037148:0:14623:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xa77:0x0] (258048->262143) req@ffff945cf1ddf480 x1847765450623360/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 488/0 e 0 to 0 dl 1762166991 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166980.037157:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1ddf480 with x1847765450623360 ext(258048->262143) 00002000:00010000:3.0:1762166980.037161:0:14623:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1ddf480 00000100:00100000:3.0:1762166980.037180:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2544 00000100:00100000:3.0:1762166980.037187:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+25:2417:x1847765450623360:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:3.0:1762166980.037330:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+25:2417:x1847765450623360:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 144us (282us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1762166980.037340:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2544 00002000:00100000:3.0:1762166980.037348:0:14623:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xa77:0x0] (258048->262143) req@ffff945cf1ddf480 x1847765450623360/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 488/4536 e 0 to 0 dl 1762166991 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166980.037357:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1ddf480 with x1847765450623360 ext(258048->262143) 00002000:00010000:3.0:1762166980.037361:0:14623:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1ddf480 00000100:00100000:0.0:1762166980.038474:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.038556:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450623488 00000100:00100000:3.0:1762166980.038561:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450623488 00002000:00100000:3.0:1762166980.038583:0:14623:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xa77:0x0] (241664->262143) req@ffff945cf1ddea00 x1847765450623488/t0(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 488/0 e 0 to 0 dl 1762166991 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166980.038590:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1ddea00 with x1847765450623488 ext(241664->262143) 00002000:00010000:3.0:1762166980.038593:0:14623:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1ddea00 00000100:00100000:3.0:1762166980.038609:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2545 00000100:00100000:3.0:1762166980.038615:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+25:2419:x1847765450623488:12345-192.168.204.38@tcp:4:fsx.0 00000100:00100000:3.0:1762166980.039861:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+27:2419:x1847765450623488:12345-192.168.204.38@tcp:4:fsx.0 Request processed in 1244us (1387us total) trans 17179876575 rc 0/0 00000100:00100000:3.0:1762166980.039871:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2545 00002000:00100000:3.0:1762166980.039879:0:14623:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xa77:0x0] (241664->262143) req@ffff945cf1ddea00 x1847765450623488/t17179876575(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 488/448 e 0 to 0 dl 1762166991 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166980.039887:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1ddea00 with x1847765450623488 ext(241664->262143) 00002000:00010000:3.0:1762166980.039892:0:14623:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1ddea00 00000100:00100000:0.0:1762166980.040630:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.040668:0:35248:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450623616 00000100:00100000:2.0:1762166980.040673:0:35248:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450623616 00000100:00100000:2.0:1762166980.040704:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19250 00000100:00100000:2.0:1762166980.040710:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1dddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+27:2418:x1847765450623616:12345-192.168.204.38@tcp:16:fsx.0 00000001:00080000:1.0:1762166980.041604:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876575 is committed 00000001:00080000:1.0:1762166980.041626:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876570 is committed 00000100:00100000:2.0:1762166980.041711:0:35248:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1dddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450623616:12345-192.168.204.38@tcp:16:fsx.0 Request processed in 998us (1081us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166980.041720:0:35248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19250 00000100:00100000:0.0:1762166980.042527:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.042562:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450623744 00000100:00100000:2.0:1762166980.042568:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450623744 00000100:00100000:2.0:1762166980.042608:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30708 00000100:00100000:2.0:1762166980.042617:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1dded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+558:61766:x1847765450623744:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:2.0:1762166980.042639:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166980.042661:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9200/0x2f180c4effbac1eb lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea4f4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.042759:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8200/0x2f180c4effbac1f2 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166980.042776:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8200/0x2f180c4effbac1f2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.042789:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8200/0x2f180c4effbac1f2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:2.0:1762166980.042818:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 262144 00000004:00200000:2.0:1762166980.042823:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166980.042852:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8200/0x2f180c4effbac1f2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.042881:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9200/0x2f180c4effbac1eb lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea4f4 expref: 560 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.042905:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8200/0x2f180c4effbac1f2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea4f4 expref: 559 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.042915:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166980.042918:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166980.042923:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc5db8200, rc 0) 00000100:00100000:2.0:1762166980.042960:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1dded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+559:61766:x1847765450623744:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 344us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166980.042972:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30708 00000100:00100000:1.0:1762166980.044747:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.044782:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450623872 00000100:00100000:3.0:1762166980.044789:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450623872 00002000:00100000:3.0:1762166980.044828:0:14623:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xa77:0x0] (4096->69631) req@ffff945bc4011500 x1847765450623872/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 488/0 e 0 to 0 dl 1762166991 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166980.044850:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4011500 with x1847765450623872 ext(4096->69631) 00002000:00010000:3.0:1762166980.044855:0:14623:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4011500 00000100:00100000:3.0:1762166980.044881:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2546 00000100:00100000:3.0:1762166980.044892:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4011500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450623872:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:0.0:1762166980.045926:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4011500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450623872:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 1032us (1179us total) trans 0 rc 65536/65536 00000100:00100000:0.0:1762166980.045937:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2546 00002000:00100000:0.0:1762166980.045946:0:14623:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xa77:0x0] (4096->69631) req@ffff945bc4011500 x1847765450623872/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 488/440 e 0 to 0 dl 1762166991 ref 1 fl Complete:/600/0 rc 65536/65536 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166980.045956:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4011500 with x1847765450623872 ext(4096->69631) 00002000:00010000:0.0:1762166980.045960:0:14623:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4011500 00000100:00100000:0.0:1762166980.047225:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.047296:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450624000 00000100:00100000:3.0:1762166980.047311:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450624000 00002000:00100000:3.0:1762166980.047368:0:14623:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xa77:0x0] (73728->77823) req@ffff945cf1ddce00 x1847765450624000/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 488/0 e 0 to 0 dl 1762166991 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166980.047386:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1ddce00 with x1847765450624000 ext(73728->77823) 00002000:00010000:3.0:1762166980.047391:0:14623:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1ddce00 00000100:00100000:3.0:1762166980.047419:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2547 00000100:00100000:3.0:1762166980.047428:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450624000:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:3.0:1762166980.047682:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450624000:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 255us (460us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1762166980.047702:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2547 00002000:00100000:3.0:1762166980.047711:0:14623:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xa77:0x0] (73728->77823) req@ffff945cf1ddce00 x1847765450624000/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 488/4536 e 0 to 0 dl 1762166991 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166980.047721:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1ddce00 with x1847765450624000 ext(73728->77823) 00002000:00010000:3.0:1762166980.047724:0:14623:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1ddce00 00000100:00100000:1.0:1762166980.049455:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.049535:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450624128 00000100:00100000:3.0:1762166980.049544:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450624128 00000100:00100000:3.0:1762166980.049601:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2548 00000100:00100000:3.0:1762166980.049611:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4013800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450624128:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:3.0:1762166980.049861:0:14623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:3.0:1762166980.049864:0:14623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00002000:00010000:3.0:1762166980.049866:0:14623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166979 -> 1762166980 00002000:00010000:3.0:1762166980.049867:0:14623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:3.0:1762166980.049869:0:14623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 176 -> 208 00000100:00100000:3.0:1762166980.049907:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4013800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450624128:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 298us (457us total) trans 17179876576 rc 0/0 00000100:00100000:3.0:1762166980.049913:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2548 00000100:00100000:0.0:1762166980.051719:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.051750:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450624256 00000100:00100000:3.0:1762166980.051756:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450624256 00002000:00100000:3.0:1762166980.051777:0:14623:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xa77:0x0] (106496->110591) req@ffff945cf1ddd180 x1847765450624256/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 488/0 e 0 to 0 dl 1762166991 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166980.051785:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1ddd180 with x1847765450624256 ext(106496->110591) 00002000:00010000:3.0:1762166980.051789:0:14623:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1ddd180 00000100:00100000:3.0:1762166980.051805:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2549 00000100:00100000:3.0:1762166980.051809:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450624256:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:3.0:1762166980.051916:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450624256:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 106us (201us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1762166980.051921:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2549 00002000:00100000:3.0:1762166980.051926:0:14623:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xa77:0x0] (106496->110591) req@ffff945cf1ddd180 x1847765450624256/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 488/4536 e 0 to 0 dl 1762166991 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166980.051936:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1ddd180 with x1847765450624256 ext(106496->110591) 00002000:00010000:3.0:1762166980.051938:0:14623:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1ddd180 00000100:00100000:0.0:1762166980.053205:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.053270:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450624512 00000100:00100000:2.0:1762166980.053276:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450624512 00000100:00100000:2.0:1762166980.053316:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30709 00000100:00100000:2.0:1762166980.053327:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1dddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+559:61766:x1847765450624512:12345-192.168.204.38@tcp:36:fsx.0 00010000:00010000:2.0:1762166980.053367:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166980.053390:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8200/0x2f180c4effbac1f2 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea4f4 expref: 559 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.053407:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166980.053412:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166980.053575:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9200/0x2f180c4effbac1f9 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166980.053590:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9200/0x2f180c4effbac1f9 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.053599:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9200/0x2f180c4effbac1f9 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000001:00080000:2.0:1762166980.053642:0:6494:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992348 00000004:00010000:2.0:1762166980.053665:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000062757371 reply state 0000000089c80a04 transno 4294992349 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9200/0x2f180c4effbac1f9 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.053676:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9200/0x2f180c4effbac1f9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.053682:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166980.053685:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166980.053687:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166980.053751:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1dddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+561:61766:x1847765450624512:12345-192.168.204.38@tcp:36:fsx.0 Request processed in 427us (547us total) trans 4294992349 rc 0/0 00000100:00100000:2.0:1762166980.053759:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30709 00000020:00080000:2.0:1762166980.053763:0:6494:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1762166980.054741:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.054764:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.054799:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450624640 00000100:00100000:3.0:1762166980.054805:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450624640 00000100:00100000:1.0:1762166980.054810:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00002000:00010000:3.0:1762166980.054838:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (220072->18446744073709551615) 00000100:00100000:0.0:1762166980.054838:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450624768 00000100:00100000:0.0:1762166980.054844:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450624768 00000100:00100000:2.0:1762166980.054855:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450624896 00000100:00100000:2.0:1762166980.054860:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450624896 00002000:00010000:0.0:1762166980.054867:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:0.0:1762166980.054873:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4010e00 with x1847765450624768 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166980.054876:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:3.0:1762166980.054881:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4013480 with x1847765450624640 ext(220072->18446744073709551615) 00002000:00100000:2.0:1762166980.054882:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4010a80 with x1847765450624896 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166980.054885:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc4010e00. 00002000:00010000:3.0:1762166980.054890:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4013480. 00002000:00010000:2.0:1762166980.054892:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4010a80. 00000100:00100000:0.0:1762166980.054916:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2550 00000100:00100000:0.0:1762166980.054928:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4010e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765450624768:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:3.0:1762166980.054932:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2551 00000100:00100000:1.0:1762166980.054941:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2552 00000100:00100000:3.0:1762166980.054946:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4013480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450624640:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:1.0:1762166980.054953:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4010a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450624896:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:0.0:1762166980.055046:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166980.055047:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166980.055051:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00002000:00010000:1.0:1762166980.055053:0:23939:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00002000:00010000:0.0:1762166980.055055:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166979 -> 1762166979 00002000:00010000:1.0:1762166980.055058:0:23939:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166979 -> 1762166979 00002000:00010000:0.0:1762166980.055061:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:1.0:1762166980.055064:0:23939:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:0.0:1762166980.055066:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00002000:00010000:1.0:1762166980.055069:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1762166980.055111:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4010a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450624896:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 161us (304us total) trans 17179876577 rc 0/0 00000100:00100000:0.0:1762166980.055117:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4010e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765450624768:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 185us (344us total) trans 21474843396 rc 0/0 00000100:00100000:1.0:1762166980.055119:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2552 00002000:00010000:1.0:1762166980.055124:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:1.0:1762166980.055128:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4010a80 with x1847765450624896 ext(0->18446744073709551615) 00000100:00100000:0.0:1762166980.055133:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2550 00002000:00010000:1.0:1762166980.055134:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4010a80. 00002000:00010000:0.0:1762166980.055138:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00010000:3.0:1762166980.055140:0:14623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 262144 -> 220072 00002000:00100000:0.0:1762166980.055142:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4010e00 with x1847765450624768 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166980.055145:0:14623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00002000:00010000:3.0:1762166980.055150:0:14623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00002000:00010000:0.0:1762166980.055151:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc4010e00. 00002000:00010000:3.0:1762166980.055153:0:14623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:3.0:1762166980.055157:0:14623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 208 -> 168 00000100:00100000:3.0:1762166980.055184:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4013480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450624640:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 242us (443us total) trans 17179876578 rc 0/0 00000100:00100000:3.0:1762166980.055191:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2551 00002000:00010000:3.0:1762166980.055195:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (220072->18446744073709551615) 00002000:00100000:3.0:1762166980.055197:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4013480 with x1847765450624640 ext(220072->18446744073709551615) 00002000:00010000:3.0:1762166980.055211:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4013480. 00000100:00100000:0.0:1762166980.056183:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.056228:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450625024 00000100:00100000:2.0:1762166980.056233:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450625024 00000100:00100000:2.0:1762166980.056266:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30710 00000100:00100000:2.0:1762166980.056275:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+561:61766:x1847765450625024:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:2.0:1762166980.056288:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166980.056300:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbac200 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea4fb expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.056395:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbac207 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166980.056407:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbac207 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.056417:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbac207 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:2.0:1762166980.056438:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 220072 00000004:00200000:2.0:1762166980.056442:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166980.056455:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbac207 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.056494:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbac200 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea4fb expref: 563 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.056513:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbac207 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea4fb expref: 562 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.056522:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166980.056526:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166980.056529:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc5db9c00, rc 0) 00000100:00100000:2.0:1762166980.056564:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+562:61766:x1847765450625024:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 290us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166980.056571:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30710 00000100:00100000:2.0:1762166980.058271:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.058338:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450625280 00000100:00100000:1.0:1762166980.058344:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450625280 00000100:00100000:1.0:1762166980.058377:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30711 00000100:00100000:1.0:1762166980.058385:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+562:61766:x1847765450625280:12345-192.168.204.38@tcp:36:fsx.0 00010000:00010000:1.0:1762166980.058423:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166980.058440:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbac207 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea4fb expref: 562 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.058460:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:1.0:1762166980.058464:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166980.058633:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbac20e lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166980.058652:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbac20e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.058660:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbac20e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000001:00080000:1.0:1762166980.058703:0:6494:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992350 00000004:00010000:1.0:1762166980.058720:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000ec224e68 reply state 00000000c3a514dd transno 4294992351 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbac20e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.058727:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbac20e lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.058732:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:1.0:1762166980.058734:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166980.058735:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166980.058809:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+564:61766:x1847765450625280:12345-192.168.204.38@tcp:36:fsx.0 Request processed in 425us (540us total) trans 4294992351 rc 0/0 00000100:00100000:1.0:1762166980.058817:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30711 00000020:00080000:1.0:1762166980.058822:0:6494:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1762166980.059784:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.059821:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.059871:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.059907:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450625408 00000100:00100000:3.0:1762166980.059910:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450625536 00000100:00100000:3.0:1762166980.059920:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450625536 00000100:00100000:0.0:1762166980.059920:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450625408 00000100:00100000:2.0:1762166980.059926:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450625664 00000100:00100000:2.0:1762166980.059934:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450625664 00002000:00010000:0.0:1762166980.059964:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (119631->18446744073709551615) 00002000:00010000:3.0:1762166980.059966:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00010000:2.0:1762166980.059967:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:0.0:1762166980.059969:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4011f80 with x1847765450625408 ext(119631->18446744073709551615) 00002000:00100000:2.0:1762166980.059988:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc6227480 with x1847765450625664 ext(0->18446744073709551615) 00002000:00100000:3.0:1762166980.059989:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc6224380 with x1847765450625536 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166980.059993:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4011f80. 00002000:00010000:3.0:1762166980.060009:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc6224380. 00002000:00010000:2.0:1762166980.060009:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc6227480. 00000100:00100000:0.0:1762166980.060033:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2553 00000100:00100000:0.0:1762166980.060041:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4011f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450625408:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:3.0:1762166980.060071:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2554 00000100:00100000:2.0:1762166980.060080:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2555 00000100:00100000:3.0:1762166980.060087:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6224380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765450625536:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:2.0:1762166980.060096:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6227480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450625664:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:2.0:1762166980.060219:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166980.060220:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166980.060227:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00002000:00010000:2.0:1762166980.060230:0:23939:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00002000:00010000:3.0:1762166980.060232:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166979 -> 1762166979 00002000:00010000:3.0:1762166980.060238:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:3.0:1762166980.060243:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00002000:00010000:2.0:1762166980.060244:0:23939:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166979 -> 1762166979 00002000:00010000:2.0:1762166980.060250:0:23939:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:2.0:1762166980.060254:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166980.060302:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6224380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765450625536:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 221us (479us total) trans 21474843397 rc 0/0 00000100:00100000:2.0:1762166980.060311:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6227480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765450625664:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 214us (436us total) trans 17179876579 rc 0/0 00002000:00010000:0.0:1762166980.060326:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 220072 -> 119631 00000100:00100000:3.0:1762166980.060327:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2554 00002000:00010000:0.0:1762166980.060332:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00002000:00010000:0.0:1762166980.060335:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00002000:00010000:0.0:1762166980.060337:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:3.0:1762166980.060338:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00010000:0.0:1762166980.060340:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 168 -> 104 00002000:00100000:3.0:1762166980.060351:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc6224380 with x1847765450625536 ext(0->18446744073709551615) 00000100:00100000:2.0:1762166980.060352:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2555 00002000:00010000:2.0:1762166980.060364:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00010000:3.0:1762166980.060365:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc6224380. 00002000:00100000:2.0:1762166980.060376:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc6227480 with x1847765450625664 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166980.060386:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc6227480. 00000100:00100000:0.0:1762166980.060402:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4011f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765450625408:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 356us (613us total) trans 17179876580 rc 0/0 00000100:00100000:0.0:1762166980.060415:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2553 00002000:00010000:0.0:1762166980.060420:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (119631->18446744073709551615) 00002000:00100000:0.0:1762166980.060424:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4011f80 with x1847765450625408 ext(119631->18446744073709551615) 00002000:00010000:0.0:1762166980.060431:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4011f80. 00000100:00100000:0.0:1762166980.061522:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.061562:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450625792 00000100:00100000:1.0:1762166980.061567:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450625792 00000100:00100000:1.0:1762166980.061598:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30712 00000100:00100000:1.0:1762166980.061605:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1dde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+564:61766:x1847765450625792:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:1.0:1762166980.061620:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166980.061636:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbac215 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea502 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.061699:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbac21c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166980.061708:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbac21c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.061714:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbac21c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:1.0:1762166980.061728:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 119631 00000004:00200000:1.0:1762166980.061731:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166980.061741:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbac21c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.061764:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbac215 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea502 expref: 566 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.061777:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbac21c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea502 expref: 565 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.061783:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:1.0:1762166980.061785:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166980.061787:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355bc00, rc 0) 00000100:00100000:1.0:1762166980.061837:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1dde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+565:61766:x1847765450625792:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 223us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166980.061845:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30712 00000100:00100000:1.0:1762166980.063556:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.063607:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450625920 00000100:00100000:0.0:1762166980.063615:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450625920 00002000:00100000:0.0:1762166980.063657:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (24576->110591) req@ffff945bc6226a00 x1847765450625920/t0(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 488/0 e 0 to 0 dl 1762166991 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166980.063669:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc6226a00 with x1847765450625920 ext(24576->110591) 00002000:00010000:0.0:1762166980.063674:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc6226a00 00000100:00100000:0.0:1762166980.063702:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2556 00000100:00100000:0.0:1762166980.063711:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6226a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450625920:12345-192.168.204.38@tcp:4:fsx.0 00000100:00100000:0.0:1762166980.065644:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6226a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765450625920:12345-192.168.204.38@tcp:4:fsx.0 Request processed in 1926us (2084us total) trans 17179876581 rc 0/0 00000100:00100000:0.0:1762166980.065657:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2556 00002000:00100000:0.0:1762166980.065668:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (24576->110591) req@ffff945bc6226a00 x1847765450625920/t17179876581(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 488/448 e 0 to 0 dl 1762166991 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166980.065678:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc6226a00 with x1847765450625920 ext(24576->110591) 00002000:00010000:0.0:1762166980.065684:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc6226a00 00000100:00100000:3.0:1762166980.066602:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.066645:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450626048 00000100:00100000:0.0:1762166980.066653:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450626048 00000100:00100000:0.0:1762166980.066707:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2557 00000100:00100000:0.0:1762166980.066717:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc70b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+24:2418:x1847765450626048:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:0.0:1762166980.067038:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 119631 -> 119631 00002000:00010000:0.0:1762166980.067042:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00002000:00010000:0.0:1762166980.067045:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00002000:00010000:0.0:1762166980.067048:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:0.0:1762166980.067051:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 104 -> 216 00000100:00100000:0.0:1762166980.067087:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc70b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+25:2418:x1847765450626048:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 372us (487us total) trans 17179876582 rc 0/0 00000100:00100000:0.0:1762166980.067095:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2557 00000100:00100000:1.0:1762166980.068673:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.068717:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450626304 00000100:00100000:2.0:1762166980.068725:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450626304 00000100:00100000:2.0:1762166980.068770:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11936 00000100:00100000:2.0:1762166980.068780:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6226d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+565:61766:x1847765450626304:12345-192.168.204.38@tcp:35:fsx.0 00000100:00100000:2.0:1762166980.069040:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6226d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+566:61766:x1847765450626304:12345-192.168.204.38@tcp:35:fsx.0 Request processed in 262us (369us total) trans 4294992352 rc 0/0 00000100:00100000:2.0:1762166980.069048:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11936 00000100:00100000:3.0:1762166980.077645:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.077720:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450626560 00000100:00100000:1.0:1762166980.077733:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450626560 00000100:00100000:1.0:1762166980.077807:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30713 00000100:00100000:1.0:1762166980.077820:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc70b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+566:61871:x1847765450626560:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166980.077866:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166980.077899:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbac223 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea509 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.078036:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbac22a lrc: 3/1,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166980.078053:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbac22a lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.078065:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbac22a lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.078080:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbac231 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166980.078087:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbac231 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.078094:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbac231 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.078241:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbac238 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166980.078252:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbac238 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.078260:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbac238 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:1.0:1762166980.078273:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 119631 00010000:00010000:1.0:1762166980.078373:0:6494:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbac22a lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.078382:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbac22a lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.078392:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbac22a lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.078399:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbac22a lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.078405:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355a800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166980.078410:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbac22a lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.078418:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbac22a lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.078431:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0x0 (ffff945bc812e200) 00010000:00010000:1.0:1762166980.078435:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166980.078439:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbac22a lrc: 3/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.078445:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbac22a lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.078465:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbac231 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.078471:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbac231 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.078520:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbac231 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.078527:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355b200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166980.078530:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbac231 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.078539:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbac231 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.078546:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0xdd396665 (ffff945bc812e500) 00010000:00010000:1.0:1762166980.078549:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166980.078553:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbac231 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.078559:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbac231 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.078608:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbac223 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea509 expref: 569 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.078622:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbac238 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea509 expref: 568 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.078630:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:1.0:1762166980.078632:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166980.078635:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355b800, rc 0) 00000100:00100000:1.0:1762166980.078718:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc70b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+568:61871:x1847765450626560:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 901us (1083us total) trans 4294992353 rc 0/0 00000100:00100000:1.0:1762166980.078727:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30713 00000100:00100000:3.0:1762166980.080181:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.080235:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.080295:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450626688 00000100:00100000:2.0:1762166980.080302:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450626944 00000100:00100000:0.0:1762166980.080306:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450626688 00000100:00100000:2.0:1762166980.080308:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450626944 00000100:00100000:2.0:1762166980.080374:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11937 00000100:00100000:2.0:1762166980.080385:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc70b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+569:61871:x1847765450626944:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166980.080388:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 891 00000100:00100000:0.0:1762166980.080402:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc70b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+569:2419:x1847765450626688:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166980.080422:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166980.080447:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbac238 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea509 expref: 569 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.080466:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:0.0:1762166980.080471:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166980.080561:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc70b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+568:2419:x1847765450626688:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 162us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166980.080570:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 891 00000100:00100000:2.0:1762166980.080629:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc70b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+568:61871:x1847765450626944:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 246us (392us total) trans 4294992354 rc 0/0 00000100:00100000:2.0:1762166980.080638:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11937 00000100:00100000:2.0:1762166980.083058:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.083120:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450627200 00000100:00100000:1.0:1762166980.083130:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450627200 00000100:00100000:1.0:1762166980.083184:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30714 00000100:00100000:1.0:1762166980.083193:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+568:61871:x1847765450627200:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166980.083222:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166980.083246:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbac246 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea510 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.083359:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a400/0x2f180c4effbac24d lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166980.083376:0:6494:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbac21c lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea502 expref: 569 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.083385:0:6494:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a400/0x2f180c4effbac24d lrc: 4/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.083424:0:6494:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbac21c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea502 expref: 569 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.083439:0:6494:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbac21c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea502 expref: 569 pid: 6494 timeout: 699 lvb_type: 0 00000100:00100000:1.0:1762166980.083455:0:6494:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc6227800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765449763200:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166980.083617:0:6494:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc4076900 going to sleep for 11 seconds 00000100:00100000:1.0:1762166980.085135:0:6494:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc6227800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765449763200:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166980.085174:0:6494:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a400/0x2f180c4effbac24d lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000100:00100000:2.0:1762166980.085282:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.085350:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450627328 00000100:00100000:0.0:1762166980.085361:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450627328 00010000:00010000:0.0:1762166980.085415:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbac21c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea502 expref: 570 pid: 6494 timeout: 699 lvb_type: 0 00000100:00100000:0.0:1762166980.085464:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9730 00000100:00100000:0.0:1762166980.085502:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7c31050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+570:2418:x1847765450627328:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166980.085520:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166980.085528:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbac21c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea502 expref: 570 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:0.0:1762166980.085543:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbac21c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea502 expref: 570 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:0.0:1762166980.085566:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbac21c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea502 expref: 570 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:0.0:1762166980.085583:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:0.0:1762166980.085588:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a400/0x2f180c4effbac24d lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.085599:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a400/0x2f180c4effbac24d lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.085607:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a400/0x2f180c4effbac24d lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.085637:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166980.085680:0:6494:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a400/0x2f180c4effbac24d lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000100:00100000:0.0:1762166980.085692:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7c31050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+569:2418:x1847765450627328:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 217us (418us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166980.085693:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a400/0x2f180c4effbac24d lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000100:00100000:0.0:1762166980.085716:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9730 00000004:00200000:1.0:1762166980.085732:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 119631 00010000:00010000:1.0:1762166980.085908:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbac246 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea510 expref: 570 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.085927:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a400/0x2f180c4effbac24d lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea510 expref: 569 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.085935:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:1.0:1762166980.085938:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1762166980.085941:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355a400, rc 0) 00000100:00100000:1.0:1762166980.085982:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+569:61871:x1847765450627200:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2790us (2933us total) trans 4294992355 rc 0/0 00000100:00100000:1.0:1762166980.085991:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30714 00000100:00100000:2.0:1762166980.087293:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.087351:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450627456 00000100:00100000:0.0:1762166980.087360:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450627456 00000100:00100000:0.0:1762166980.087402:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11938 00000100:00100000:0.0:1762166980.087413:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb386680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+569:61871:x1847765450627456:12345-192.168.204.38@tcp:33:lfs.0 00000100:00100000:0.0:1762166980.087576:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb386680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+569:61871:x1847765450627456:12345-192.168.204.38@tcp:33:lfs.0 Request processed in 165us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166980.087584:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11938 00000100:00100000:3.0:1762166980.088447:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.088499:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450627712 00000100:00100000:0.0:1762166980.088505:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450627712 00000100:00100000:0.0:1762166980.088532:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11939 00000100:00100000:0.0:1762166980.088539:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc70b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+569:61871:x1847765450627712:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166980.088687:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc70b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+570:61871:x1847765450627712:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 148us (241us total) trans 4294992356 rc 0/0 00000100:00100000:0.0:1762166980.088695:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11939 00000100:00100000:0.0:1762166980.089840:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.089903:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450627968 00000100:00100000:1.0:1762166980.089910:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450627968 00000100:00100000:1.0:1762166980.089951:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30715 00000100:00100000:1.0:1762166980.089960:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+570:61871:x1847765450627968:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166980.089976:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166980.089980:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:1.0:1762166980.090005:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a400/0x2f180c4effbac24d lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea510 expref: 570 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.090025:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194200/0x2f180c4effbac17b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea4ca expref: 569 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.090038:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:1.0:1762166980.090043:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166980.090056:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbac25b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea517 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.090131:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbac262 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166980.090144:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbac262 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.090153:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbac262 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:1.0:1762166980.090161:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 119631 00010000:00010000:1.0:1762166980.090225:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbac25b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea517 expref: 571 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.090238:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbac262 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea517 expref: 570 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.090245:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:1.0:1762166980.090248:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762166980.090250:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355b200, rc 0) 00000100:00100000:1.0:1762166980.090289:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+570:61871:x1847765450627968:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 331us (471us total) trans 4294992357 rc 0/0 00000100:00100000:1.0:1762166980.090296:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30715 00000100:00100000:2.0:1762166980.091463:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.091565:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450628224 00000100:00100000:0.0:1762166980.091576:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450628224 00000100:00100000:0.0:1762166980.091636:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11940 00000100:00100000:0.0:1762166980.091646:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7be1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+570:61871:x1847765450628224:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:0.0:1762166980.091718:0:19593:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x240000404:0x5eb:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbac262 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea517 expref: 570 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.091758:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbac270 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166980.091778:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effbac14a lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea4bc expref: 570 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.091786:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9a00/0x2f180c4effbac1c8 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea4e6 expref: 570 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.091794:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbac270 lrc: 5/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166980.091855:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9a00/0x2f180c4effbac1c8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea4e6 expref: 570 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.091871:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9a00/0x2f180c4effbac1c8 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea4e6 expref: 570 pid: 6494 timeout: 699 lvb_type: 0 00000100:00100000:0.0:1762166980.091888:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1ddc380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449763328:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166980.091992:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effbac14a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea4bc expref: 570 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.092002:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effbac14a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea4bc expref: 570 pid: 6494 timeout: 699 lvb_type: 0 00000100:00100000:0.0:1762166980.092011:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1ddd880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449763456:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166980.092041:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc350f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166980.093248:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1ddc380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449763328:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166980.093263:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1ddd880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449763456:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166980.093295:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbac270 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:2.0:1762166980.093458:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.093522:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.093542:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450628480 00000100:00100000:0.0:1762166980.093551:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450628480 00010000:00010000:0.0:1762166980.093593:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effbac14a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea4bc expref: 571 pid: 6494 timeout: 699 lvb_type: 0 00000100:00100000:3.0:1762166980.093632:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450628352 00000100:00100000:3.0:1762166980.093640:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450628352 00000100:00100000:0.0:1762166980.093640:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9731 00000100:00100000:0.0:1762166980.093653:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb386d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+572:2419:x1847765450628480:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166980.093664:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9a00/0x2f180c4effbac1c8 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea4e6 expref: 572 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:0.0:1762166980.093667:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166980.093678:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effbac14a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea4bc expref: 572 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:0.0:1762166980.093689:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effbac14a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea4bc expref: 572 pid: 6494 timeout: 699 lvb_type: 0 00000100:00100000:3.0:1762166980.093707:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9732 00010000:00010000:0.0:1762166980.093713:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc60b1400/0x2f180c4effbac14a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea4bc expref: 572 pid: 6494 timeout: 699 lvb_type: 0 00000100:00100000:3.0:1762166980.093719:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb384380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+572:2419:x1847765450628352:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166980.093731:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166980.093734:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:3.0:1762166980.093738:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9a00/0x2f180c4effbac1c8 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea4e6 expref: 571 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:0.0:1762166980.093741:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbac270 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166980.093759:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbac270 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166980.093765:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166980.093770:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9a00/0x2f180c4effbac1c8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea4e6 expref: 571 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:3.0:1762166980.093786:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9a00/0x2f180c4effbac1c8 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea4e6 expref: 571 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:3.0:1762166980.093798:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:3.0:1762166980.093802:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbac270 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166980.093811:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbac270 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00000100:00100000:0.0:1762166980.093816:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb386d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+570:2419:x1847765450628480:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 163us (358us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166980.093823:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbac270 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00000100:00100000:0.0:1762166980.093845:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9731 00010000:00010000:3.0:1762166980.093864:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166980.093873:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbac270 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166980.093880:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbac270 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:3.0:1762166980.093890:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb384380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+569:2419:x1847765450628352:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 174us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166980.093898:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9732 00010000:00010000:0.0:1762166980.094069:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbac270 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166980.094077:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbac270 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166980.094083:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbac270 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166980.094089:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdec00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166980.094093:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbac270 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166980.094098:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbac270 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166980.094106:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:0.0:1762166980.094108:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166980.094112:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbac270 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166980.094117:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbac270 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166980.094126:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:0.0:1762166980.094129:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166980.094134:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbac262 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea517 expref: 568 pid: 6494 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166980.094231:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7be1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+568:61871:x1847765450628224:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 2586us (2772us total) trans 4294992358 rc -22/-22 00000100:00100000:0.0:1762166980.094240:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11940 00000100:00100000:2.0:1762166980.095428:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.095512:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450628608 00000100:00100000:1.0:1762166980.095518:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450628608 00000100:00100000:1.0:1762166980.095554:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30716 00000100:00100000:1.0:1762166980.095562:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb386680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+568:61871:x1847765450628608:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166980.095585:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166980.095600:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbac277 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea51e expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.095640:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbac277 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea51e expref: 569 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.095652:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbac277 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea51e expref: 569 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.095666:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:1.0:1762166980.095669:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166980.095672:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355b800, rc 0) 00000100:00100000:1.0:1762166980.095702:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb386680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+569:61871:x1847765450628608:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 141us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166980.095708:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30716 00000100:00100000:3.0:1762166980.097105:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.097145:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450628864 00000100:00100000:1.0:1762166980.097152:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450628864 00000100:00100000:1.0:1762166980.097192:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30717 00000100:00100000:1.0:1762166980.097203:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc70b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+569:61871:x1847765450628864:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166980.097218:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166980.097235:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbac27e lrc: 2/0,0 mode: --/CW res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea525 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.097735:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a000/0x2f180c4effbac285 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166980.097745:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a000/0x2f180c4effbac285 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x618:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.097752:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a000/0x2f180c4effbac285 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x618:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:1.0:1762166980.097765:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x618:0x0]: returning size 0 00010000:00010000:1.0:1762166980.097811:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbac27e lrc: 0/0,0 mode: --/CW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea525 expref: 572 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.097845:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a000/0x2f180c4effbac285 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x618:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea525 expref: 571 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.097853:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x618:0x0].0x0 (ffff945bc812e500) 00010000:00010000:1.0:1762166980.097856:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166980.097858:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355a000, rc 0) 00000100:00100000:1.0:1762166980.097903:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc70b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+571:61871:x1847765450628864:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 703us (800us total) trans 4294992359 rc 0/0 00000100:00100000:1.0:1762166980.097910:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30717 00000100:00100000:2.0:1762166980.099201:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.099234:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450629120 00000100:00100000:1.0:1762166980.099242:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450629120 00000100:00100000:1.0:1762166980.099274:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30718 00000100:00100000:1.0:1762166980.099279:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4bdb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+571:61871:x1847765450629120:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166980.099293:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166980.099302:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbac293 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea52c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.099366:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbac29a lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166980.099381:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbac29a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.099389:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbac29a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:1.0:1762166980.099398:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 119631 00010000:00010000:1.0:1762166980.099459:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbac293 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea52c expref: 574 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.099473:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbac29a lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea52c expref: 573 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.099506:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:1.0:1762166980.099510:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762166980.099514:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355a600, rc 0) 00000100:00100000:1.0:1762166980.099552:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4bdb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+573:61871:x1847765450629120:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 271us (352us total) trans 4294992360 rc 0/0 00000100:00100000:1.0:1762166980.099560:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30718 00000100:00100000:2.0:1762166980.100528:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.100589:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450629376 00000100:00100000:1.0:1762166980.100595:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450629376 00000100:00100000:1.0:1762166980.100629:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11941 00000100:00100000:1.0:1762166980.100638:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4bda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+573:61871:x1847765450629376:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:1.0:1762166980.100681:0:19593:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x240000404:0x5eb:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbac29a lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea52c expref: 573 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.100700:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbac2a8 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166980.100707:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbac277 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea51e expref: 573 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.100712:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbac2a8 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166980.100735:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbac277 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea51e expref: 573 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.100747:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbac277 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea51e expref: 573 pid: 6494 timeout: 699 lvb_type: 0 00000100:00100000:1.0:1762166980.100760:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc6227800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449763584:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166980.100818:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc4076780 going to sleep for 11 seconds 00000100:00100000:1.0:1762166980.101593:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc6227800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449763584:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166980.101612:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbac2a8 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:2.0:1762166980.101933:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.101998:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450629504 00000100:00100000:0.0:1762166980.102011:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450629504 00010000:00010000:0.0:1762166980.102053:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbac277 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea51e expref: 574 pid: 6494 timeout: 699 lvb_type: 0 00000100:00100000:0.0:1762166980.102092:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9733 00000100:00100000:0.0:1762166980.102106:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4bdb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+574:2419:x1847765450629504:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166980.102121:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166980.102128:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbac277 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea51e expref: 574 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:0.0:1762166980.102141:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbac277 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea51e expref: 574 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:0.0:1762166980.102162:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbac277 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea51e expref: 574 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:0.0:1762166980.102177:0:7421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:0.0:1762166980.102182:0:7421:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbac2a8 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166980.102192:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbac2a8 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166980.102203:0:7421:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbac2a8 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166980.102231:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166980.102249:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbac2a8 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166980.102256:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbac2a8 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166980.102267:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a400/0x2f180c4effbac2af lrc: 3/0,1 mode: --/EX res: [0x240000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166980.102276:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a000/0x2f180c4effbac285 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x618:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea525 expref: 573 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.102281:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a400/0x2f180c4effbac2af lrc: 4/0,1 mode: --/EX res: [0x240000404:0x618:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00000100:00100000:0.0:1762166980.102291:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4bdb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+573:2419:x1847765450629504:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 188us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166980.102303:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9733 00010000:00010000:1.0:1762166980.102306:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a000/0x2f180c4effbac285 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x618:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea525 expref: 573 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.102340:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a000/0x2f180c4effbac285 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x618:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea525 expref: 572 pid: 6494 timeout: 699 lvb_type: 0 00000100:00100000:1.0:1762166980.102350:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc6227800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449763712:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166980.102393:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc4076780 going to sleep for 11 seconds 00000100:00100000:1.0:1762166980.103119:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc6227800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449763712:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166980.103129:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a400/0x2f180c4effbac2af lrc: 3/0,1 mode: --/EX res: [0x240000404:0x618:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:2.0:1762166980.103571:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.103613:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450629632 00000100:00100000:0.0:1762166980.103625:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450629632 00010000:00010000:0.0:1762166980.103647:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a000/0x2f180c4effbac285 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x618:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea525 expref: 573 pid: 6494 timeout: 699 lvb_type: 0 00000100:00100000:0.0:1762166980.103674:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9734 00000100:00100000:0.0:1762166980.103680:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4bd9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+573:2419:x1847765450629632:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166980.103691:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166980.103696:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a000/0x2f180c4effbac285 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x618:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea525 expref: 573 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:0.0:1762166980.103704:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a000/0x2f180c4effbac285 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x618:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea525 expref: 573 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:0.0:1762166980.103716:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a000/0x2f180c4effbac285 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x618:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea525 expref: 573 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:0.0:1762166980.103728:0:7421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x618:0x0].0x0 (ffff945bc812e500) 00010000:00010000:0.0:1762166980.103733:0:7421:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a400/0x2f180c4effbac2af lrc: 3/0,1 mode: --/EX res: [0x240000404:0x618:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166980.103745:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a400/0x2f180c4effbac2af lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x618:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166980.103750:0:7421:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a400/0x2f180c4effbac2af lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x618:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166980.103775:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166980.103805:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a400/0x2f180c4effbac2af lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x618:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166980.103816:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a400/0x2f180c4effbac2af lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x618:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:0.0:1762166980.103819:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4bd9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+572:2419:x1847765450629632:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 136us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166980.103846:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9734 00000100:00100000:1.0:1762166980.104117:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc6227800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449763840:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166980.104155:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166980.104183:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc4076600 going to sleep for 11 seconds 00000100:00100000:3.0:1762166980.104217:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449763840 00000100:00100000:3.0:1762166980.104224:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449763840 00000100:00100000:3.0:1762166980.104263:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1437 00000100:00100000:3.0:1762166980.104274:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6227100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449763840:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166980.104383:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6227100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449763840:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 112us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166980.104391:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1437 00000100:00100000:1.0:1762166980.104432:0:19593:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 17179876570 gen 2 00000004:00080000:1.0:1762166980.104438:0:19593:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 17179876570 committed transno 17179876570 00000100:00100000:1.0:1762166980.104466:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc6227800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449763840:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166980.104559:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc6227800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449763968:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166980.104587:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166980.104607:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc4076600 going to sleep for 11 seconds 00000100:00100000:3.0:1762166980.104627:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449763968 00000100:00100000:3.0:1762166980.104633:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449763968 00000100:00100000:3.0:1762166980.104660:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1438 00000100:00100000:3.0:1762166980.104666:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6225f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:19593:x1847765449763968:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166980.104725:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6225f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:19593:x1847765449763968:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 59us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166980.104732:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1438 00000100:00100000:1.0:1762166980.104743:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc6227800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449763968:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166980.104786:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc6227800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449764096:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166980.104805:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166980.104838:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449764096 00000100:00100000:1.0:1762166980.104839:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc4076c00 going to sleep for 11 seconds 00000100:00100000:3.0:1762166980.104843:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449764096 00000100:00100000:3.0:1762166980.104867:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1439 00000100:00100000:3.0:1762166980.104873:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6224700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:19593:x1847765449764096:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166980.104949:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6224700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:19593:x1847765449764096:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 76us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166980.104956:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1439 00000100:00100000:1.0:1762166980.104988:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc6227800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449764096:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166980.105022:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc6227800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449764224:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166980.105044:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166980.105065:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc4076000 going to sleep for 11 seconds 00000100:00100000:3.0:1762166980.105069:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449764224 00000100:00100000:3.0:1762166980.105074:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449764224 00000100:00100000:3.0:1762166980.105097:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1440 00000100:00100000:3.0:1762166980.105104:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6224000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449764224:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166980.105152:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6224000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449764224:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 48us (106us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166980.105160:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1440 00000100:00100000:1.0:1762166980.105165:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc6227800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449764224:0@lo:1000:mdt_rdpg00_003.0 00000040:00080000:1.0:1762166980.105334:0:19593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x2:0x0].59, 280 off70416 00000001:00080000:1.0:1762166980.105347:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992361 00000100:00100000:1.0:1762166980.105391:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc6227800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449764352:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166980.105414:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166980.105434:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc4076480 going to sleep for 11 seconds 00000100:00100000:3.0:1762166980.105461:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449764352 00000100:00100000:3.0:1762166980.105466:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449764352 00000100:00100000:3.0:1762166980.105521:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1441 00000100:00100000:3.0:1762166980.105529:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6227b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449764352:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166980.105624:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6227b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:19593:x1847765449764352:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 94us (208us total) trans 17179876583 rc 0/0 00000100:00100000:3.0:1762166980.105632:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1441 00000100:00100000:1.0:1762166980.105640:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc6227800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449764352:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166980.105666:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc6224e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449764480:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166980.105688:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166980.105706:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc63999c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166980.105722:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449764480 00000100:00100000:3.0:1762166980.105725:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449764480 00000100:00100000:3.0:1762166980.105744:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1442 00000100:00100000:3.0:1762166980.105750:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6225500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:19593:x1847765449764480:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166980.105818:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6225500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+12:19593:x1847765449764480:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 68us (128us total) trans 21474843398 rc 0/0 00000100:00100000:3.0:1762166980.105826:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1442 00000100:00100000:1.0:1762166980.105843:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc6224e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449764480:0@lo:1000:mdt_rdpg00_003.0 00000001:00080000:1.0:1762166980.105895:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992362 00010000:00010000:1.0:1762166980.105914:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a400/0x2f180c4effbac2af lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x618:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166980.105924:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a400/0x2f180c4effbac2af lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x618:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166980.105931:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a400/0x2f180c4effbac2af lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x618:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166980.105938:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355a400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166980.105943:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a400/0x2f180c4effbac2af lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x618:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166980.105952:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a400/0x2f180c4effbac2af lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x618:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166980.105964:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x618:0x0].0x0 (ffff945bc812e500) 00010000:00010000:1.0:1762166980.105967:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1762166980.105971:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a400/0x2f180c4effbac2af lrc: 2/0,0 mode: --/EX res: [0x240000404:0x618:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166980.105977:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a400/0x2f180c4effbac2af lrc: 0/0,0 mode: --/EX res: [0x240000404:0x618:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166980.105993:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbac2a8 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166980.106000:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbac2a8 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166980.106005:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbac2a8 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166980.106010:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355ba00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166980.106012:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbac2a8 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166980.106018:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbac2a8 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166980.106023:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:1.0:1762166980.106025:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1762166980.106028:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbac2a8 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166980.106033:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbac2a8 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166980.106043:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:1.0:1762166980.106045:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762166980.106051:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbac29a lrc: 0/0,0 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea52c expref: 574 pid: 6494 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166980.106126:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4bda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+573:61871:x1847765450629376:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 5490us (5602us total) trans 4294992363 rc 0/0 00000100:00100000:1.0:1762166980.106134:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11941 00000020:00080000:1.0:1762166980.106138:0:19593:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1762166980.107132:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.107177:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450629760 00000100:00100000:1.0:1762166980.107184:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450629760 00000100:00100000:1.0:1762166980.107225:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30719 00000100:00100000:1.0:1762166980.107233:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4bd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+573:61871:x1847765450629760:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166980.107249:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166980.107264:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbac2b6 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea533 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.107308:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbac2b6 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea533 expref: 574 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.107321:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbac2b6 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea533 expref: 574 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.107343:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:1.0:1762166980.107347:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166980.107349:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355ae00, rc 0) 00000100:00100000:1.0:1762166980.107388:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4bd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+574:61871:x1847765450629760:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 156us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166980.107395:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30719 00000100:00100000:2.0:1762166980.108934:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.108985:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450630016 00000100:00100000:1.0:1762166980.108992:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450630016 00000100:00100000:1.0:1762166980.109026:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11942 00000100:00100000:1.0:1762166980.109036:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4bd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+574:61871:x1847765450630016:12345-192.168.204.38@tcp:35:lfs.0 00000004:00080000:1.0:1762166980.109260:0:19593:0:(mdd_object.c:3965:mdd_close()) Object [0x240000404:0x618:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1762166980.109318:0:19593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5925, 64 off464168 00000040:00080000:1.0:1762166980.109341:0:19593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5926, 64 off464168 00000001:00080000:1.0:1762166980.109348:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992364 00010000:00010000:1.0:1762166980.109381:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbac2bd lrc: 3/0,1 mode: --/PW res: [0x240000404:0x618:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166980.109397:0:19593:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbac2bd lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x618:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166980.109406:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbac2bd lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x618:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166980.109414:0:19593:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbac2bd lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x618:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166980.109420:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbac2bd lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x618:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166980.109427:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbac2bd lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x618:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166980.109447:0:19593:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1762166980.109516:0:7420:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1762166980.109525:0:7420:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbac2bd lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x618:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166980.109537:0:7420:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355a200 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166980.109542:0:7420:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbac2bd lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x618:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166980.109551:0:7420:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbac2bd lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x618:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166980.109564:0:7420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x618:0x0].0x0 (ffff945bc812e200) 00010000:00010000:3.0:1762166980.109567:0:7420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1762166980.109570:0:7420:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbac2bd lrc: 1/0,0 mode: --/PW res: [0x240000404:0x618:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166980.109577:0:7420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a200/0x2f180c4effbac2bd lrc: 0/0,0 mode: --/PW res: [0x240000404:0x618:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166980.109598:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166980.109600:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166980.109602:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166980.109648:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4bd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+576:61871:x1847765450630016:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 613us (716us total) trans 4294992365 rc 0/0 00000100:00100000:1.0:1762166980.109656:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11942 00000020:00080000:1.0:1762166980.109661:0:19593:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1762166980.110447:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.110529:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450630272 00000100:00100000:1.0:1762166980.110534:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450630272 00000100:00100000:1.0:1762166980.110562:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11943 00000100:00100000:1.0:1762166980.110568:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc70b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+576:61871:x1847765450630272:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:1.0:1762166980.110700:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc70b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+577:61871:x1847765450630272:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 131us (253us total) trans 4294992366 rc 0/0 00000100:00100000:1.0:1762166980.110707:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11943 00000100:00100000:2.0:1762166980.112894:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.112935:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450630528 00000100:00100000:1.0:1762166980.112942:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450630528 00000100:00100000:1.0:1762166980.112983:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30720 00000100:00100000:1.0:1762166980.112992:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4bd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+577:61766:x1847765450630528:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:1.0:1762166980.113008:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166980.113025:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355be00/0x2f180c4effbac2c4 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea53a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.113085:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbac2cb lrc: 3/1,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166980.113093:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbac2cb lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.113100:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbac2cb lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.113108:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbac2d2 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166980.113113:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbac2d2 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.113116:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbac2d2 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.113187:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbac2d9 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166980.113195:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbac2d9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.113201:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbac2d9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:1.0:1762166980.113212:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 119631 00010000:00010000:1.0:1762166980.113261:0:6494:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbac2cb lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.113265:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbac2cb lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.113270:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbac2cb lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.113273:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbac2cb lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.113276:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355b000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166980.113278:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbac2cb lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.113282:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbac2cb lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.113291:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:1.0:1762166980.113293:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166980.113296:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbac2cb lrc: 3/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.113299:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbac2cb lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.113306:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbac2d2 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.113308:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbac2d2 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.113312:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbac2d2 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.113315:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355ac00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166980.113317:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbac2d2 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.113320:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbac2d2 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.113323:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0xdd396665 (ffff945bc812e000) 00010000:00010000:1.0:1762166980.113325:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166980.113326:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbac2d2 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.113329:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbac2d2 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.113354:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355be00/0x2f180c4effbac2c4 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea53a expref: 580 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.113364:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbac2d9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea53a expref: 579 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.113368:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:1.0:1762166980.113370:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166980.113372:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355b400, rc 0) 00000100:00100000:1.0:1762166980.113402:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4bd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+579:61766:x1847765450630528:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 413us (512us total) trans 4294992367 rc 0/0 00000100:00100000:1.0:1762166980.113406:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30720 00000100:00100000:2.0:1762166980.115399:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.115448:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450630656 00000100:00100000:0.0:1762166980.115454:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450630656 00000100:00100000:0.0:1762166980.115555:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2558 00000100:00100000:0.0:1762166980.115565:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4bd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+25:2419:x1847765450630656:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:0.0:1762166980.115969:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 119631 -> 119631 00002000:00010000:0.0:1762166980.115974:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00002000:00010000:0.0:1762166980.115976:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00002000:00010000:0.0:1762166980.115979:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:0.0:1762166980.115981:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 216 -> 216 00000100:00100000:0.0:1762166980.116027:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4bd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765450630656:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 463us (630us total) trans 17179876584 rc 0/0 00000100:00100000:0.0:1762166980.116036:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2558 00000100:00100000:3.0:1762166980.119365:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.119416:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450630784 00000100:00100000:0.0:1762166980.119424:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450630784 00002000:00100000:0.0:1762166980.119461:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (73728->122879) req@ffff945bc70b1880 x1847765450630784/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 488/0 e 0 to 0 dl 1762166991 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166980.119468:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc70b1880 with x1847765450630784 ext(73728->122879) 00002000:00010000:0.0:1762166980.119475:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc70b1880 00000100:00100000:0.0:1762166980.119515:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2559 00000100:00100000:0.0:1762166980.119524:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc70b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+26:2418:x1847765450630784:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:0.0:1762166980.120790:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc70b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+26:2418:x1847765450630784:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 1263us (1428us total) trans 0 rc 49152/49152 00000100:00100000:0.0:1762166980.120801:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2559 00002000:00100000:0.0:1762166980.120811:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (73728->122879) req@ffff945bc70b1880 x1847765450630784/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 488/440 e 0 to 0 dl 1762166991 ref 1 fl Complete:/600/0 rc 49152/49152 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166980.120821:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc70b1880 with x1847765450630784 ext(73728->122879) 00002000:00010000:0.0:1762166980.120825:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc70b1880 00000100:00100000:2.0:1762166980.122582:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.122651:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450630912 00000100:00100000:1.0:1762166980.122667:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450630912 00000100:00100000:1.0:1762166980.122739:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30721 00000100:00100000:1.0:1762166980.122752:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4bda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+579:61766:x1847765450630912:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:1.0:1762166980.122778:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166980.122797:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355be00/0x2f180c4effbac2e7 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea541 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.122844:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbac2ee lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166980.122859:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbac2ee lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.122871:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbac2ee lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.122987:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355be00/0x2f180c4effbac2e7 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea541 expref: 581 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.123010:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbac2ee lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea541 expref: 580 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.123018:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:1.0:1762166980.123021:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1762166980.123025:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355ac00, rc 0) 00000100:00100000:1.0:1762166980.123099:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4bda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+580:61766:x1847765450630912:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 350us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166980.123107:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30721 00000100:00100000:3.0:1762166980.124278:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.124321:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450631168 00000100:00100000:1.0:1762166980.124327:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450631168 00000100:00100000:1.0:1762166980.124362:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30722 00000100:00100000:1.0:1762166980.124373:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc70b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+580:61766:x1847765450631168:12345-192.168.204.38@tcp:36:fsx.0 00010000:00010000:1.0:1762166980.124406:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166980.124423:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbac2d9 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea53a expref: 580 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.124436:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:1.0:1762166980.124439:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166980.124616:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbac2f5 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166980.124627:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbac2f5 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.124635:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbac2f5 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000001:00080000:1.0:1762166980.124682:0:6494:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992368 00000004:00010000:1.0:1762166980.124703:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000dcb43532 reply state 00000000e4fd4a30 transno 4294992369 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbac2f5 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.124714:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbac2f5 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.124721:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:1.0:1762166980.124723:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166980.124726:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166980.124788:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc70b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+582:61766:x1847765450631168:12345-192.168.204.38@tcp:36:fsx.0 Request processed in 417us (511us total) trans 4294992369 rc 0/0 00000100:00100000:1.0:1762166980.124796:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30722 00000020:00080000:1.0:1762166980.124800:0:6494:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1762166980.125810:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.125869:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450631296 00000100:00100000:0.0:1762166980.125880:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450631296 00002000:00010000:0.0:1762166980.125921:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (139552->18446744073709551615) 00002000:00100000:0.0:1762166980.125926:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4bd9f80 with x1847765450631296 ext(139552->18446744073709551615) 00002000:00010000:0.0:1762166980.125938:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4bd9f80. 00000100:00100000:0.0:1762166980.125972:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2560 00000100:00100000:0.0:1762166980.125983:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4bd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765450631296:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:3.0:1762166980.126006:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.126038:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.126062:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450631424 00000100:00100000:3.0:1762166980.126065:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450631552 00000100:00100000:1.0:1762166980.126070:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450631424 00000100:00100000:3.0:1762166980.126071:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450631552 00002000:00010000:3.0:1762166980.126100:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00010000:1.0:1762166980.126101:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:3.0:1762166980.126107:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5bc1500 with x1847765450631552 ext(0->18446744073709551615) 00002000:00100000:1.0:1762166980.126108:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5bc0a80 with x1847765450631424 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166980.126119:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5bc1500. 00002000:00010000:1.0:1762166980.126120:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc5bc0a80. 00000100:00100000:3.0:1762166980.126143:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2561 00000100:00100000:3.0:1762166980.126152:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+27:2419:x1847765450631552:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:1.0:1762166980.126163:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2562 00000100:00100000:1.0:1762166980.126174:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+24:2418:x1847765450631424:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:0.0:1762166980.126238:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 119631 -> 139552 00002000:00010000:0.0:1762166980.126244:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00002000:00010000:0.0:1762166980.126247:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00002000:00010000:0.0:1762166980.126251:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:0.0:1762166980.126253:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 216 -> 216 00002000:00010000:3.0:1762166980.126255:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166980.126260:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00002000:00010000:3.0:1762166980.126261:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166979 -> 1762166979 00002000:00010000:3.0:1762166980.126263:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:3.0:1762166980.126264:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:1.0:1762166980.126275:0:14623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166980.126280:0:14623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00002000:00010000:1.0:1762166980.126283:0:14623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166979 -> 1762166979 00002000:00010000:1.0:1762166980.126285:0:14623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:1.0:1762166980.126288:0:14623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00000100:00100000:0.0:1762166980.126326:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4bd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+29:2419:x1847765450631296:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 339us (509us total) trans 17179876585 rc 0/0 00000100:00100000:1.0:1762166980.126328:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+25:2418:x1847765450631424:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 150us (316us total) trans 21474843399 rc 0/0 00000100:00100000:3.0:1762166980.126329:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+29:2419:x1847765450631552:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 169us (280us total) trans 17179876586 rc 0/0 00000100:00100000:1.0:1762166980.126359:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2562 00002000:00010000:1.0:1762166980.126364:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00000100:00100000:3.0:1762166980.126369:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2561 00002000:00100000:1.0:1762166980.126369:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5bc0a80 with x1847765450631424 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166980.126377:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00010000:1.0:1762166980.126378:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc5bc0a80. 00002000:00100000:3.0:1762166980.126387:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5bc1500 with x1847765450631552 ext(0->18446744073709551615) 00000100:00100000:0.0:1762166980.126387:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2560 00002000:00010000:0.0:1762166980.126396:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (139552->18446744073709551615) 00002000:00010000:3.0:1762166980.126399:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5bc1500. 00002000:00100000:0.0:1762166980.126402:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4bd9f80 with x1847765450631296 ext(139552->18446744073709551615) 00002000:00010000:0.0:1762166980.126413:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4bd9f80. 00000100:00100000:2.0:1762166980.128632:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.128683:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450631680 00000100:00100000:0.0:1762166980.128689:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450631680 00002000:00100000:0.0:1762166980.128720:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (122880->126975) req@ffff945bc4bd9180 x1847765450631680/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 488/0 e 0 to 0 dl 1762166991 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166980.128729:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4bd9180 with x1847765450631680 ext(122880->126975) 00002000:00010000:0.0:1762166980.128734:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4bd9180 00000100:00100000:0.0:1762166980.128753:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2563 00000100:00100000:0.0:1762166980.128758:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4bd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+28:2417:x1847765450631680:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:0.0:1762166980.128931:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4bd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+28:2417:x1847765450631680:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 173us (303us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1762166980.128936:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2563 00002000:00100000:0.0:1762166980.128941:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (122880->126975) req@ffff945bc4bd9180 x1847765450631680/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 488/4536 e 0 to 0 dl 1762166991 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166980.128947:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4bd9180 with x1847765450631680 ext(122880->126975) 00002000:00010000:0.0:1762166980.128949:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4bd9180 00000100:00100000:2.0:1762166980.130196:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.130247:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450631808 00000100:00100000:0.0:1762166980.130251:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450631808 00002000:00100000:0.0:1762166980.130271:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (126976->131071) req@ffff945cf783d880 x1847765450631808/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 488/0 e 0 to 0 dl 1762166991 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166980.130279:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf783d880 with x1847765450631808 ext(126976->131071) 00002000:00010000:0.0:1762166980.130282:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf783d880 00000100:00100000:0.0:1762166980.130296:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2564 00000100:00100000:0.0:1762166980.130302:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+28:2416:x1847765450631808:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:0.0:1762166980.130399:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+28:2416:x1847765450631808:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 97us (206us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1762166980.130404:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2564 00002000:00100000:0.0:1762166980.130408:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (126976->131071) req@ffff945cf783d880 x1847765450631808/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 488/4536 e 0 to 0 dl 1762166991 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166980.130414:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf783d880 with x1847765450631808 ext(126976->131071) 00002000:00010000:0.0:1762166980.130417:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf783d880 00000100:00100000:2.0:1762166980.131701:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.131746:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450631936 00000100:00100000:0.0:1762166980.131751:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450631936 00002000:00100000:0.0:1762166980.131770:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (131072->143359) req@ffff945cf783dc00 x1847765450631936/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 488/0 e 0 to 0 dl 1762166991 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166980.131777:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf783dc00 with x1847765450631936 ext(131072->143359) 00002000:00010000:0.0:1762166980.131779:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf783dc00 00000100:00100000:0.0:1762166980.131796:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2565 00000100:00100000:0.0:1762166980.131801:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+28:2418:x1847765450631936:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:0.0:1762166980.131950:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+28:2418:x1847765450631936:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 147us (250us total) trans 0 rc 12288/12288 00000100:00100000:0.0:1762166980.131957:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2565 00002000:00100000:0.0:1762166980.131965:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (131072->143359) req@ffff945cf783dc00 x1847765450631936/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 488/12728 e 0 to 0 dl 1762166991 ref 1 fl Complete:/600/0 rc 12288/12288 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166980.131980:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf783dc00 with x1847765450631936 ext(131072->143359) 00002000:00010000:0.0:1762166980.131983:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf783dc00 00000100:00100000:2.0:1762166980.134122:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.134202:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450632064 00000100:00100000:0.0:1762166980.134212:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450632064 00002000:00100000:0.0:1762166980.134255:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (98304->139551) req@ffff945cf783c380 x1847765450632064/t0(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 488/0 e 0 to 0 dl 1762166991 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166980.134266:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf783c380 with x1847765450632064 ext(98304->139551) 00002000:00010000:0.0:1762166980.134271:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf783c380 00000100:00100000:0.0:1762166980.134300:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2566 00000100:00100000:0.0:1762166980.134313:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+28:2419:x1847765450632064:12345-192.168.204.38@tcp:4:fsx.0 00000100:00100000:0.0:1762166980.135821:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+30:2419:x1847765450632064:12345-192.168.204.38@tcp:4:fsx.0 Request processed in 1510us (1704us total) trans 17179876587 rc 0/0 00000100:00100000:0.0:1762166980.135842:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2566 00002000:00100000:0.0:1762166980.135852:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (98304->139551) req@ffff945cf783c380 x1847765450632064/t17179876587(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 488/448 e 0 to 0 dl 1762166991 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166980.135862:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf783c380 with x1847765450632064 ext(98304->139551) 00002000:00010000:0.0:1762166980.135867:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf783c380 00000100:00100000:2.0:1762166980.137034:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.137086:0:35248:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450632192 00000100:00100000:3.0:1762166980.137098:0:35248:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450632192 00000100:00100000:3.0:1762166980.137163:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19251 00000100:00100000:3.0:1762166980.137174:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+30:2418:x1847765450632192:12345-192.168.204.38@tcp:16:fsx.0 00000001:00080000:1.0:1762166980.138095:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876587 is committed 00000001:00080000:1.0:1762166980.138113:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876583 is committed 00000100:00100000:3.0:1762166980.138252:0:35248:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450632192:12345-192.168.204.38@tcp:16:fsx.0 Request processed in 1079us (1222us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166980.138259:0:35248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19251 00000100:00100000:2.0:1762166980.139549:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.139587:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450632320 00000100:00100000:1.0:1762166980.139593:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450632320 00000100:00100000:1.0:1762166980.139627:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30723 00000100:00100000:1.0:1762166980.139633:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+582:61766:x1847765450632320:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:1.0:1762166980.139650:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166980.139664:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbac2fc lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea548 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.139734:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355be00/0x2f180c4effbac303 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166980.139745:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355be00/0x2f180c4effbac303 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.139752:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355be00/0x2f180c4effbac303 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:1.0:1762166980.139770:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 139552 00000004:00200000:1.0:1762166980.139772:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166980.139785:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355be00/0x2f180c4effbac303 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.139810:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbac2fc lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea548 expref: 584 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.139822:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355be00/0x2f180c4effbac303 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea548 expref: 583 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.139838:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:1.0:1762166980.139840:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166980.139843:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355be00, rc 0) 00000100:00100000:1.0:1762166980.139873:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+583:61766:x1847765450632320:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 240us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166980.139880:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30723 00000100:00100000:2.0:1762166980.141872:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.141934:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450632448 00000100:00100000:0.0:1762166980.141948:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450632448 00002000:00100000:0.0:1762166980.142007:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (32768->73727) req@ffff945cf783d500 x1847765450632448/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 488/0 e 0 to 0 dl 1762166991 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166980.142019:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf783d500 with x1847765450632448 ext(32768->73727) 00002000:00010000:0.0:1762166980.142026:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf783d500 00000100:00100000:0.0:1762166980.142062:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2567 00000100:00100000:0.0:1762166980.142075:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450632448:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:0.0:1762166980.143241:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450632448:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 1168us (1369us total) trans 0 rc 40960/40960 00000100:00100000:0.0:1762166980.143248:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2567 00002000:00100000:0.0:1762166980.143255:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (32768->73727) req@ffff945cf783d500 x1847765450632448/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 488/440 e 0 to 0 dl 1762166991 ref 1 fl Complete:/600/0 rc 40960/40960 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166980.143262:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf783d500 with x1847765450632448 ext(32768->73727) 00002000:00010000:0.0:1762166980.143265:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf783d500 00000100:00100000:2.0:1762166980.146161:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.146212:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450632576 00000100:00100000:0.0:1762166980.146221:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450632576 00002000:00100000:0.0:1762166980.146262:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (61440->98303) req@ffff945cf783ed80 x1847765450632576/t0(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 488/0 e 0 to 0 dl 1762166991 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166980.146271:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf783ed80 with x1847765450632576 ext(61440->98303) 00002000:00010000:0.0:1762166980.146275:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf783ed80 00000100:00100000:0.0:1762166980.146298:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2568 00000100:00100000:0.0:1762166980.146305:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450632576:12345-192.168.204.38@tcp:4:fsx.0 00000100:00100000:0.0:1762166980.147701:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450632576:12345-192.168.204.38@tcp:4:fsx.0 Request processed in 1388us (1539us total) trans 17179876588 rc 0/0 00000100:00100000:0.0:1762166980.147713:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2568 00002000:00100000:0.0:1762166980.147724:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (61440->98303) req@ffff945cf783ed80 x1847765450632576/t17179876588(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 488/448 e 0 to 0 dl 1762166991 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166980.147731:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf783ed80 with x1847765450632576 ext(61440->98303) 00002000:00010000:0.0:1762166980.147737:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf783ed80 00000100:00100000:2.0:1762166980.148725:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.148776:0:35248:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450632704 00000100:00100000:3.0:1762166980.148785:0:35248:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450632704 00000100:00100000:3.0:1762166980.148847:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19252 00000100:00100000:3.0:1762166980.148860:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450632704:12345-192.168.204.38@tcp:16:fsx.0 00000001:00080000:1.0:1762166980.149617:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876588 is committed 00000100:00100000:3.0:1762166980.149716:0:35248:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450632704:12345-192.168.204.38@tcp:16:fsx.0 Request processed in 858us (990us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166980.149724:0:35248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19252 00000100:00100000:2.0:1762166980.152630:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.152675:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450632832 00000100:00100000:0.0:1762166980.152682:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450632832 00002000:00100000:0.0:1762166980.152713:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (4096->32767) req@ffff945bccb7fb80 x1847765450632832/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 488/0 e 0 to 0 dl 1762166991 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166980.152722:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bccb7fb80 with x1847765450632832 ext(4096->32767) 00002000:00010000:0.0:1762166980.152726:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bccb7fb80 00000100:00100000:0.0:1762166980.152747:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2569 00000100:00100000:0.0:1762166980.152753:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450632832:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:0.0:1762166980.153744:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450632832:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 989us (1118us total) trans 0 rc 28672/28672 00000100:00100000:0.0:1762166980.153754:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2569 00002000:00100000:0.0:1762166980.153762:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (4096->32767) req@ffff945bccb7fb80 x1847765450632832/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 488/440 e 0 to 0 dl 1762166991 ref 1 fl Complete:/600/0 rc 28672/28672 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166980.153772:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bccb7fb80 with x1847765450632832 ext(4096->32767) 00002000:00010000:0.0:1762166980.153776:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bccb7fb80 00000100:00100000:2.0:1762166980.156750:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.156800:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450632960 00000100:00100000:0.0:1762166980.156809:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450632960 00002000:00100000:0.0:1762166980.156856:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (16384->228542) req@ffff945bccb7df80 x1847765450632960/t0(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 520/0 e 0 to 0 dl 1762166991 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166980.156866:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bccb7df80 with x1847765450632960 ext(16384->228542) 00002000:00010000:0.0:1762166980.156871:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bccb7df80 00000100:00100000:0.0:1762166980.156899:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2570 00000100:00100000:0.0:1762166980.156908:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450632960:12345-192.168.204.38@tcp:4:fsx.0 00000100:00100000:0.0:1762166980.158567:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450632960:12345-192.168.204.38@tcp:4:fsx.0 Request processed in 1659us (1820us total) trans 17179876589 rc 0/0 00000100:00100000:0.0:1762166980.158574:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2570 00002000:00100000:0.0:1762166980.158580:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (16384->228542) req@ffff945bccb7df80 x1847765450632960/t17179876589(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 520/456 e 0 to 0 dl 1762166991 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166980.158587:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bccb7df80 with x1847765450632960 ext(16384->228542) 00002000:00010000:0.0:1762166980.158589:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bccb7df80 00000100:00100000:2.0:1762166980.159612:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.159655:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450633088 00000100:00100000:0.0:1762166980.159661:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450633088 00000100:00100000:0.0:1762166980.159695:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2571 00000100:00100000:0.0:1762166980.159700:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450633088:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:0.0:1762166980.159850:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 139552 -> 228543 00002000:00010000:0.0:1762166980.159853:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00002000:00010000:0.0:1762166980.159855:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00002000:00010000:0.0:1762166980.159857:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:0.0:1762166980.159858:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 216 -> 336 00000100:00100000:0.0:1762166980.159889:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450633088:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 187us (277us total) trans 17179876590 rc 0/0 00000100:00100000:0.0:1762166980.159895:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2571 00000100:00100000:2.0:1762166980.162225:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.162272:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450633216 00000100:00100000:0.0:1762166980.162279:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450633216 00002000:00100000:0.0:1762166980.162320:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (0->229375) req@ffff945bccb7ce00 x1847765450633216/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 504/0 e 0 to 0 dl 1762166991 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166980.162329:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bccb7ce00 with x1847765450633216 ext(0->229375) 00002000:00010000:0.0:1762166980.162334:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bccb7ce00 00000100:00100000:0.0:1762166980.162356:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2572 00000100:00100000:0.0:1762166980.162362:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450633216:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:0.0:1762166980.163539:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450633216:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 1173us (1319us total) trans 0 rc 65536/65536 00000100:00100000:0.0:1762166980.163548:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2572 00002000:00100000:0.0:1762166980.163556:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (0->229375) req@ffff945bccb7ce00 x1847765450633216/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 504/440 e 0 to 0 dl 1762166991 ref 1 fl Complete:/600/0 rc 65536/65536 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166980.163565:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bccb7ce00 with x1847765450633216 ext(0->229375) 00002000:00010000:0.0:1762166980.163568:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bccb7ce00 00000100:00100000:2.0:1762166980.165310:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.165354:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450633344 00000100:00100000:0.0:1762166980.165361:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450633344 00000100:00100000:0.0:1762166980.165408:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2573 00000100:00100000:0.0:1762166980.165418:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450633344:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:0.0:1762166980.165805:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 228543 -> 228543 00002000:00010000:0.0:1762166980.165809:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00002000:00010000:0.0:1762166980.165812:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00002000:00010000:0.0:1762166980.165814:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:0.0:1762166980.165816:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 336 -> 352 00000100:00100000:0.0:1762166980.165871:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450633344:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 454us (565us total) trans 17179876591 rc 0/0 00000100:00100000:0.0:1762166980.165879:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2573 00000100:00100000:2.0:1762166980.170567:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.170620:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450633472 00000100:00100000:0.0:1762166980.170637:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450633472 00002000:00100000:0.0:1762166980.170704:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (49152->94207) req@ffff945bccb7ed80 x1847765450633472/t0(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 488/0 e 0 to 0 dl 1762166991 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166980.170718:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bccb7ed80 with x1847765450633472 ext(49152->94207) 00002000:00010000:0.0:1762166980.170725:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bccb7ed80 00000100:00100000:0.0:1762166980.170770:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2574 00000100:00100000:0.0:1762166980.170783:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450633472:12345-192.168.204.38@tcp:4:fsx.0 00000100:00100000:0.0:1762166980.172418:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765450633472:12345-192.168.204.38@tcp:4:fsx.0 Request processed in 1633us (1856us total) trans 17179876592 rc 0/0 00000100:00100000:0.0:1762166980.172430:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2574 00002000:00100000:0.0:1762166980.172440:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (49152->94207) req@ffff945bccb7ed80 x1847765450633472/t17179876592(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 488/448 e 0 to 0 dl 1762166991 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166980.172449:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bccb7ed80 with x1847765450633472 ext(49152->94207) 00002000:00010000:0.0:1762166980.172454:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bccb7ed80 00000100:00100000:2.0:1762166980.173925:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.173983:0:35248:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450633600 00000100:00100000:3.0:1762166980.173993:0:35248:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450633600 00000100:00100000:3.0:1762166980.174043:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19253 00000100:00100000:3.0:1762166980.174053:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765450633600:12345-192.168.204.38@tcp:16:fsx.0 00000001:00080000:1.0:1762166980.175211:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876592 is committed 00000100:00100000:3.0:1762166980.175331:0:35248:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450633600:12345-192.168.204.38@tcp:16:fsx.0 Request processed in 1277us (1409us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166980.175344:0:35248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19253 00000100:00100000:2.0:1762166980.177789:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.177859:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450633728 00000100:00100000:0.0:1762166980.177867:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450633728 00002000:00100000:0.0:1762166980.177916:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (0->32767) req@ffff945bccb7d880 x1847765450633728/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 488/0 e 0 to 0 dl 1762166991 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166980.177928:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bccb7d880 with x1847765450633728 ext(0->32767) 00002000:00010000:0.0:1762166980.177934:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bccb7d880 00000100:00100000:0.0:1762166980.177961:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2575 00000100:00100000:0.0:1762166980.177971:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450633728:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:0.0:1762166980.179261:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450633728:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 1285us (1473us total) trans 0 rc 32768/32768 00000100:00100000:0.0:1762166980.179272:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2575 00002000:00100000:0.0:1762166980.179282:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (0->32767) req@ffff945bccb7d880 x1847765450633728/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 488/440 e 0 to 0 dl 1762166991 ref 1 fl Complete:/600/0 rc 32768/32768 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166980.179291:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bccb7d880 with x1847765450633728 ext(0->32767) 00002000:00010000:0.0:1762166980.179296:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bccb7d880 00000100:00100000:2.0:1762166980.181556:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.181641:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450633856 00000100:00100000:1.0:1762166980.181653:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450633856 00000100:00100000:1.0:1762166980.181719:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2576 00000100:00100000:1.0:1762166980.181732:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450633856:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:1.0:1762166980.182185:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 228543 -> 228543 00002000:00010000:1.0:1762166980.182189:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00002000:00010000:1.0:1762166980.182193:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00002000:00010000:1.0:1762166980.182195:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:1.0:1762166980.182196:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 352 -> 352 00000100:00100000:1.0:1762166980.182244:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450633856:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 517us (700us total) trans 17179876593 rc 0/0 00000100:00100000:1.0:1762166980.182251:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2576 00000100:00100000:2.0:1762166980.184288:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.184361:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450633984 00000100:00100000:1.0:1762166980.184371:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450633984 00002000:00100000:1.0:1762166980.184420:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (131072->167935) req@ffff945ceda2fb80 x1847765450633984/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 488/0 e 0 to 0 dl 1762166991 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166980.184431:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945ceda2fb80 with x1847765450633984 ext(131072->167935) 00002000:00010000:1.0:1762166980.184436:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945ceda2fb80 00000100:00100000:1.0:1762166980.184470:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2577 00000100:00100000:1.0:1762166980.184500:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450633984:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:1.0:1762166980.185837:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450633984:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 1345us (1543us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1762166980.185848:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2577 00002000:00100000:1.0:1762166980.185857:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (131072->167935) req@ffff945ceda2fb80 x1847765450633984/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 488/440 e 0 to 0 dl 1762166991 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166980.185866:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945ceda2fb80 with x1847765450633984 ext(131072->167935) 00002000:00010000:1.0:1762166980.185870:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945ceda2fb80 00000100:00100000:2.0:1762166980.188020:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.188074:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450634112 00000100:00100000:1.0:1762166980.188083:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450634112 00000100:00100000:1.0:1762166980.188143:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2578 00000100:00100000:1.0:1762166980.188151:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450634112:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:1.0:1762166980.188435:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 228543 -> 228543 00002000:00010000:1.0:1762166980.188439:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00002000:00010000:1.0:1762166980.188441:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00002000:00010000:1.0:1762166980.188443:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:1.0:1762166980.188446:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 352 -> 376 00000100:00100000:1.0:1762166980.188513:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450634112:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 362us (498us total) trans 17179876594 rc 0/0 00000100:00100000:1.0:1762166980.188525:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2578 00000100:00100000:2.0:1762166980.191058:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.191122:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450634368 00000100:00100000:1.0:1762166980.191131:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450634368 00000100:00100000:1.0:1762166980.191195:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30724 00000100:00100000:1.0:1762166980.191204:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+583:61766:x1847765450634368:12345-192.168.204.38@tcp:36:fsx.0 00010000:00010000:1.0:1762166980.191259:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166980.191284:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355be00/0x2f180c4effbac303 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea548 expref: 583 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.191301:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:1.0:1762166980.191307:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166980.191639:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbac30a lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166980.191655:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbac30a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.191665:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbac30a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000001:00080000:1.0:1762166980.191708:0:6494:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992370 00000004:00010000:1.0:1762166980.191731:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000f4fdf966 reply state 00000000bee30e7b transno 4294992371 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbac30a lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.191741:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbac30a lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.191747:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:1.0:1762166980.191750:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166980.191753:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166980.191846:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+585:61766:x1847765450634368:12345-192.168.204.38@tcp:36:fsx.0 Request processed in 642us (793us total) trans 4294992371 rc 0/0 00000100:00100000:1.0:1762166980.191855:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30724 00000020:00080000:1.0:1762166980.191861:0:6494:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1762166980.193561:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.193599:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.193610:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450634496 00000100:00100000:1.0:1762166980.193617:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450634496 00000100:00100000:2.0:1762166980.193630:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00002000:00010000:1.0:1762166980.193657:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (161102->18446744073709551615) 00000100:00100000:3.0:1762166980.193664:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450634624 00002000:00100000:1.0:1762166980.193664:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945ceda2df80 with x1847765450634496 ext(161102->18446744073709551615) 00000100:00100000:3.0:1762166980.193671:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450634624 00002000:00010000:1.0:1762166980.193677:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945ceda2df80. 00002000:00010000:3.0:1762166980.193692:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:3.0:1762166980.193697:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945ceda2c000 with x1847765450634624 ext(0->18446744073709551615) 00000100:00100000:1.0:1762166980.193702:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450634752 00002000:00010000:3.0:1762166980.193706:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945ceda2c000. 00000100:00100000:1.0:1762166980.193706:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450634752 00002000:00010000:1.0:1762166980.193720:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00000100:00100000:0.0:1762166980.193723:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2579 00002000:00100000:1.0:1762166980.193724:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945ceda2ca80 with x1847765450634752 ext(0->18446744073709551615) 00002000:00010000:1.0:1762166980.193733:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945ceda2ca80. 00000100:00100000:2.0:1762166980.193739:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2580 00000100:00100000:0.0:1762166980.193741:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450634496:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:3.0:1762166980.193756:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2581 00000100:00100000:2.0:1762166980.193757:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+25:2418:x1847765450634624:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:3.0:1762166980.193771:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450634752:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:3.0:1762166980.193891:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166980.193891:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166980.193899:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00002000:00010000:2.0:1762166980.193899:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00002000:00010000:2.0:1762166980.193904:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166979 -> 1762166979 00002000:00010000:3.0:1762166980.193905:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166979 -> 1762166979 00002000:00010000:2.0:1762166980.193910:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:3.0:1762166980.193911:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:2.0:1762166980.193916:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00002000:00010000:3.0:1762166980.193917:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166980.193980:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450634752:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 210us (346us total) trans 17179876595 rc 0/0 00000100:00100000:2.0:1762166980.193980:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+26:2418:x1847765450634624:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 228us (377us total) trans 21474843400 rc 0/0 00000100:00100000:3.0:1762166980.193995:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2581 00002000:00010000:3.0:1762166980.193999:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:3.0:1762166980.194002:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945ceda2ca80 with x1847765450634752 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166980.194008:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945ceda2ca80. 00002000:00010000:0.0:1762166980.194034:0:14623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 228543 -> 161102 00002000:00010000:0.0:1762166980.194039:0:14623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00002000:00010000:0.0:1762166980.194042:0:14623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00002000:00010000:0.0:1762166980.194044:0:14623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:0.0:1762166980.194047:0:14623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 376 -> 328 00000100:00100000:0.0:1762166980.194071:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450634496:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 336us (515us total) trans 17179876596 rc 0/0 00000100:00100000:0.0:1762166980.194077:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2579 00002000:00010000:0.0:1762166980.194080:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (161102->18446744073709551615) 00002000:00100000:0.0:1762166980.194083:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945ceda2df80 with x1847765450634496 ext(161102->18446744073709551615) 00002000:00010000:0.0:1762166980.194087:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945ceda2df80. 00000100:00100000:2.0:1762166980.194145:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2580 00002000:00010000:2.0:1762166980.194149:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:2.0:1762166980.194152:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945ceda2c000 with x1847765450634624 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166980.194158:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945ceda2c000. 00000100:00100000:2.0:1762166980.195914:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.195960:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450634880 00000100:00100000:1.0:1762166980.195968:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450634880 00000100:00100000:1.0:1762166980.196014:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30725 00000100:00100000:1.0:1762166980.196027:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+585:61766:x1847765450634880:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:1.0:1762166980.196049:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166980.196071:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a400/0x2f180c4effbac311 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea54f expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.196180:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbac318 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166980.196193:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbac318 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.196203:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbac318 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:1.0:1762166980.196232:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 161102 00000004:00200000:1.0:1762166980.196236:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166980.196252:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbac318 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.196273:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a400/0x2f180c4effbac311 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea54f expref: 587 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.196288:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbac318 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea54f expref: 586 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.196296:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:1.0:1762166980.196299:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166980.196302:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355ba00, rc 0) 00000100:00100000:1.0:1762166980.196359:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+586:61766:x1847765450634880:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 332us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166980.196366:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30725 00000100:00100000:1.0:1762166980.198766:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.198853:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450635008 00000100:00100000:2.0:1762166980.198862:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450635008 00002000:00100000:2.0:1762166980.198911:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (24576->53247) req@ffff945bc6226680 x1847765450635008/t0(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 488/0 e 0 to 0 dl 1762166991 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166980.198923:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc6226680 with x1847765450635008 ext(24576->53247) 00002000:00010000:2.0:1762166980.198929:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc6226680 00000100:00100000:2.0:1762166980.198965:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2582 00000100:00100000:2.0:1762166980.198976:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6226680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450635008:12345-192.168.204.38@tcp:4:fsx.0 00000100:00100000:1.0:1762166980.200848:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6226680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765450635008:12345-192.168.204.38@tcp:4:fsx.0 Request processed in 1852us (2065us total) trans 17179876598 rc 0/0 00000100:00100000:1.0:1762166980.200864:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2582 00002000:00100000:1.0:1762166980.200880:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (24576->53247) req@ffff945bc6226680 x1847765450635008/t17179876598(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 488/448 e 0 to 0 dl 1762166991 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166980.200891:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc6226680 with x1847765450635008 ext(24576->53247) 00002000:00010000:1.0:1762166980.200898:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc6226680 00000100:00100000:1.0:1762166980.201969:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.202034:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450635136 00000100:00100000:2.0:1762166980.202046:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450635136 00000100:00100000:2.0:1762166980.202111:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2583 00000100:00100000:2.0:1762166980.202129:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6224a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+24:2418:x1847765450635136:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:2.0:1762166980.202452:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 161102 -> 161102 00002000:00010000:2.0:1762166980.202457:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00002000:00010000:2.0:1762166980.202460:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00002000:00010000:2.0:1762166980.202462:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:2.0:1762166980.202464:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 328 -> 328 00000100:00100000:2.0:1762166980.202622:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6224a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+25:2418:x1847765450635136:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 501us (653us total) trans 17179876599 rc 0/0 00000100:00100000:2.0:1762166980.202631:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2583 00000100:00100000:2.0:1762166980.206574:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.206646:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450635264 00000100:00100000:1.0:1762166980.206656:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450635264 00002000:00100000:1.0:1762166980.206700:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (98304->143359) req@ffff945ceda2f100 x1847765450635264/t0(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 488/0 e 0 to 0 dl 1762166991 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166980.206710:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945ceda2f100 with x1847765450635264 ext(98304->143359) 00002000:00010000:1.0:1762166980.206716:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945ceda2f100 00000100:00100000:1.0:1762166980.206757:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2584 00000100:00100000:1.0:1762166980.206767:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+25:2418:x1847765450635264:12345-192.168.204.38@tcp:4:fsx.0 00000100:00100000:2.0:1762166980.208549:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+28:2418:x1847765450635264:12345-192.168.204.38@tcp:4:fsx.0 Request processed in 1777us (1975us total) trans 17179876601 rc 0/0 00000100:00100000:2.0:1762166980.208562:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2584 00002000:00100000:2.0:1762166980.208572:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (98304->143359) req@ffff945ceda2f100 x1847765450635264/t17179876601(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 488/448 e 0 to 0 dl 1762166991 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166980.208583:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945ceda2f100 with x1847765450635264 ext(98304->143359) 00002000:00010000:2.0:1762166980.208588:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945ceda2f100 00000100:00100000:2.0:1762166980.209720:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.209779:0:35248:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450635392 00000100:00100000:3.0:1762166980.209788:0:35248:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450635392 00000100:00100000:3.0:1762166980.209844:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19254 00000100:00100000:3.0:1762166980.209855:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+28:2419:x1847765450635392:12345-192.168.204.38@tcp:16:fsx.0 00000001:00080000:1.0:1762166980.210824:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876601 is committed 00000100:00100000:3.0:1762166980.210979:0:35248:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450635392:12345-192.168.204.38@tcp:16:fsx.0 Request processed in 1125us (1261us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166980.210990:0:35248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19254 00000100:00100000:1.0:1762166980.213314:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.213405:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450635648 00000100:00100000:2.0:1762166980.213414:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450635648 00000100:00100000:2.0:1762166980.213466:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30726 00000100:00100000:2.0:1762166980.213497:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6226d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+586:61766:x1847765450635648:12345-192.168.204.38@tcp:36:fsx.0 00010000:00010000:2.0:1762166980.213546:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166980.213573:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbac318 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea54f expref: 586 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.213590:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166980.213595:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166980.213764:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9a00/0x2f180c4effbac31f lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166980.213780:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9a00/0x2f180c4effbac31f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.213790:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9a00/0x2f180c4effbac31f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000001:00080000:2.0:1762166980.213850:0:6494:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992372 00000004:00010000:2.0:1762166980.213875:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000f15d8cfb reply state 000000005393b132 transno 4294992373 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9a00/0x2f180c4effbac31f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.213893:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9a00/0x2f180c4effbac31f lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.213900:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166980.213902:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166980.213905:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166980.213984:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6226d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+588:61766:x1847765450635648:12345-192.168.204.38@tcp:36:fsx.0 Request processed in 509us (674us total) trans 4294992373 rc 0/0 00000100:00100000:2.0:1762166980.213993:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30726 00000020:00080000:2.0:1762166980.213999:0:6494:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1762166980.215393:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.215421:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.215452:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450635776 00000100:00100000:2.0:1762166980.215460:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450635776 00000100:00100000:0.0:1762166980.215502:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450635904 00000100:00100000:0.0:1762166980.215508:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450635904 00002000:00010000:2.0:1762166980.215511:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (126785->18446744073709551615) 00002000:00100000:2.0:1762166980.215517:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc2d5ed80 with x1847765450635776 ext(126785->18446744073709551615) 00002000:00010000:2.0:1762166980.215526:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc2d5ed80. 00002000:00010000:0.0:1762166980.215527:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:0.0:1762166980.215533:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5804380 with x1847765450635904 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166980.215540:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc5804380. 00000100:00100000:2.0:1762166980.215557:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2585 00000100:00100000:0.0:1762166980.215567:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2586 00000100:00100000:2.0:1762166980.215573:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450635776:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:1.0:1762166980.215647:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.215647:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5804380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765450635904:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:3.0:1762166980.215694:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450636032 00000100:00100000:3.0:1762166980.215701:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450636032 00002000:00010000:3.0:1762166980.215722:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:3.0:1762166980.215726:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5805880 with x1847765450636032 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166980.215734:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5805880. 00000100:00100000:3.0:1762166980.215764:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2587 00000100:00100000:3.0:1762166980.215776:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5805880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450636032:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:0.0:1762166980.215821:0:14623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166980.215842:0:14623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00002000:00010000:0.0:1762166980.215845:0:14623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166979 -> 1762166979 00002000:00010000:0.0:1762166980.215848:0:14623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:0.0:1762166980.215851:0:14623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00002000:00010000:3.0:1762166980.215883:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166980.215888:0:23939:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00002000:00010000:3.0:1762166980.215892:0:23939:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166979 -> 1762166979 00002000:00010000:3.0:1762166980.215895:0:23939:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:3.0:1762166980.215897:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1762166980.215940:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5804380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+27:2419:x1847765450635904:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 357us (512us total) trans 21474843401 rc 0/0 00000100:00100000:3.0:1762166980.215960:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5805880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450636032:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 179us (308us total) trans 17179876603 rc 0/0 00000100:00100000:0.0:1762166980.215961:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2586 00002000:00010000:0.0:1762166980.215975:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00000100:00100000:3.0:1762166980.215984:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2587 00002000:00100000:0.0:1762166980.215984:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5804380 with x1847765450635904 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166980.215992:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 161102 -> 126785 00002000:00010000:3.0:1762166980.215994:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00010000:0.0:1762166980.215997:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc5804380. 00002000:00010000:2.0:1762166980.216000:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00002000:00100000:3.0:1762166980.216001:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5805880 with x1847765450636032 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166980.216008:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00002000:00010000:2.0:1762166980.216013:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:3.0:1762166980.216014:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5805880. 00002000:00010000:2.0:1762166980.216016:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 328 -> 256 00000100:00100000:2.0:1762166980.216058:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450635776:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 487us (662us total) trans 17179876602 rc 0/0 00000100:00100000:2.0:1762166980.216066:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2585 00002000:00010000:2.0:1762166980.216070:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (126785->18446744073709551615) 00002000:00100000:2.0:1762166980.216072:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc2d5ed80 with x1847765450635776 ext(126785->18446744073709551615) 00002000:00010000:2.0:1762166980.216077:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc2d5ed80. 00000100:00100000:1.0:1762166980.217153:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.217195:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450636160 00000100:00100000:2.0:1762166980.217201:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450636160 00000100:00100000:2.0:1762166980.217242:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30727 00000100:00100000:2.0:1762166980.217250:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5806d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+588:61766:x1847765450636160:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:2.0:1762166980.217266:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166980.217281:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbac326 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea556 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.217348:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbac32d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166980.217360:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbac32d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.217371:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbac32d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:2.0:1762166980.217392:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 126785 00000004:00200000:2.0:1762166980.217396:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166980.217410:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbac32d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.217431:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbac326 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea556 expref: 590 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.217446:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbac32d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea556 expref: 589 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.217455:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166980.217458:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166980.217461:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc5db9c00, rc 0) 00000100:00100000:2.0:1762166980.217516:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5806d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+589:61766:x1847765450636160:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 266us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166980.217524:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30727 00000100:00100000:1.0:1762166980.219084:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.219126:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450636416 00000100:00100000:2.0:1762166980.219132:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450636416 00000100:00100000:2.0:1762166980.219167:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30728 00000100:00100000:2.0:1762166980.219173:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5805f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+589:61766:x1847765450636416:12345-192.168.204.38@tcp:36:fsx.0 00010000:00010000:2.0:1762166980.219203:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166980.219219:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbac32d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea556 expref: 589 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.219230:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166980.219232:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166980.219347:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8200/0x2f180c4effbac334 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166980.219359:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8200/0x2f180c4effbac334 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.219367:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8200/0x2f180c4effbac334 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000001:00080000:2.0:1762166980.219405:0:6494:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992374 00000004:00010000:2.0:1762166980.219426:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000cdd97630 reply state 000000000326cc3d transno 4294992375 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8200/0x2f180c4effbac334 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.219437:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8200/0x2f180c4effbac334 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.219447:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166980.219450:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166980.219452:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166980.219531:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5805f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+591:61766:x1847765450636416:12345-192.168.204.38@tcp:36:fsx.0 Request processed in 355us (449us total) trans 4294992375 rc 0/0 00000100:00100000:2.0:1762166980.219537:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30728 00000020:00080000:2.0:1762166980.219541:0:6494:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1762166980.220589:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.220613:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.220628:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450636544 00000100:00100000:2.0:1762166980.220634:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450636544 00002000:00010000:2.0:1762166980.220660:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (146235->18446744073709551615) 00002000:00100000:2.0:1762166980.220665:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5804700 with x1847765450636544 ext(146235->18446744073709551615) 00002000:00010000:2.0:1762166980.220673:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5804700. 00000100:00100000:3.0:1762166980.220683:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450636672 00000100:00100000:3.0:1762166980.220689:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450636672 00000100:00100000:2.0:1762166980.220704:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2588 00002000:00010000:3.0:1762166980.220708:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:3.0:1762166980.220714:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5806300 with x1847765450636672 ext(0->18446744073709551615) 00000100:00100000:2.0:1762166980.220718:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5804700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450636544:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:3.0:1762166980.220723:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc5806300. 00000100:00100000:1.0:1762166980.220751:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.220757:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2589 00000100:00100000:3.0:1762166980.220771:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450636800 00000100:00100000:3.0:1762166980.220777:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450636800 00000100:00100000:0.0:1762166980.220784:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5806300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+27:2419:x1847765450636672:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:3.0:1762166980.220846:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:3.0:1762166980.220850:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5805180 with x1847765450636800 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166980.220855:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5805180. 00000100:00100000:3.0:1762166980.220880:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2590 00000100:00100000:3.0:1762166980.220892:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5805180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450636800:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:2.0:1762166980.220905:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 126785 -> 146235 00002000:00010000:2.0:1762166980.220911:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00002000:00010000:2.0:1762166980.220926:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00002000:00010000:2.0:1762166980.220930:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:2.0:1762166980.220933:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 256 -> 256 00002000:00010000:0.0:1762166980.220946:0:14623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166980.220951:0:14623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00002000:00010000:0.0:1762166980.220955:0:14623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166979 -> 1762166979 00002000:00010000:0.0:1762166980.220958:0:14623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:0.0:1762166980.220960:0:14623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00002000:00010000:3.0:1762166980.220981:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166980.220988:0:23939:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00000100:00100000:2.0:1762166980.220988:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5804700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450636544:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 269us (392us total) trans 17179876604 rc 0/0 00002000:00010000:3.0:1762166980.220995:0:23939:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166979 -> 1762166979 00002000:00010000:3.0:1762166980.221000:0:23939:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00000100:00100000:2.0:1762166980.221004:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2588 00002000:00010000:3.0:1762166980.221005:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1762166980.221014:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5806300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+28:2419:x1847765450636672:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 237us (392us total) trans 21474843402 rc 0/0 00002000:00010000:2.0:1762166980.221016:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (146235->18446744073709551615) 00002000:00100000:2.0:1762166980.221030:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5804700 with x1847765450636544 ext(146235->18446744073709551615) 00000100:00100000:0.0:1762166980.221040:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2589 00002000:00010000:2.0:1762166980.221043:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5804700. 00002000:00010000:0.0:1762166980.221046:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00000100:00100000:3.0:1762166980.221054:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5805180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765450636800:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 158us (300us total) trans 17179876605 rc 0/0 00002000:00100000:0.0:1762166980.221057:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5806300 with x1847765450636672 ext(0->18446744073709551615) 00000100:00100000:3.0:1762166980.221074:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2590 00002000:00010000:0.0:1762166980.221074:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc5806300. 00002000:00010000:3.0:1762166980.221085:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:3.0:1762166980.221089:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5805180 with x1847765450636800 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166980.221157:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5805180. 00000100:00100000:1.0:1762166980.223413:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.223459:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450636928 00000100:00100000:3.0:1762166980.223465:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450636928 00002000:00100000:3.0:1762166980.223522:0:23939:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xa77:0x0] (126976->131071) req@ffff945bc5807800 x1847765450636928/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 488/0 e 0 to 0 dl 1762166991 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166980.223532:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5807800 with x1847765450636928 ext(126976->131071) 00002000:00010000:3.0:1762166980.223537:0:23939:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5807800 00000100:00100000:3.0:1762166980.223556:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2591 00000100:00100000:3.0:1762166980.223564:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5807800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450636928:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:3.0:1762166980.223721:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5807800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450636928:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 157us (310us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1762166980.223727:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2591 00002000:00100000:3.0:1762166980.223734:0:23939:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xa77:0x0] (126976->131071) req@ffff945bc5807800 x1847765450636928/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 488/4536 e 0 to 0 dl 1762166991 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166980.223741:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5807800 with x1847765450636928 ext(126976->131071) 00002000:00010000:3.0:1762166980.223745:0:23939:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5807800 00000100:00100000:1.0:1762166980.225559:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.225658:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450637056 00000100:00100000:3.0:1762166980.225665:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450637056 00002000:00100000:3.0:1762166980.225688:0:23939:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xa77:0x0] (131072->135167) req@ffff945bc5806a00 x1847765450637056/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 488/0 e 0 to 0 dl 1762166991 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166980.225695:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5806a00 with x1847765450637056 ext(131072->135167) 00002000:00010000:3.0:1762166980.225698:0:23939:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5806a00 00000100:00100000:3.0:1762166980.225719:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2592 00000100:00100000:3.0:1762166980.225724:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5806a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450637056:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:3.0:1762166980.225834:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5806a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450637056:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 101us (272us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1762166980.225841:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2592 00002000:00100000:3.0:1762166980.225847:0:23939:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xa77:0x0] (131072->135167) req@ffff945bc5806a00 x1847765450637056/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 488/4536 e 0 to 0 dl 1762166991 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166980.225852:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5806a00 with x1847765450637056 ext(131072->135167) 00002000:00010000:3.0:1762166980.225855:0:23939:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5806a00 00000100:00100000:1.0:1762166980.227535:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.227576:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450637184 00000100:00100000:3.0:1762166980.227586:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450637184 00002000:00100000:3.0:1762166980.227625:0:23939:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xa77:0x0] (135168->139263) req@ffff945bc5804a80 x1847765450637184/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 488/0 e 0 to 0 dl 1762166991 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166980.227634:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5804a80 with x1847765450637184 ext(135168->139263) 00002000:00010000:3.0:1762166980.227638:0:23939:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5804a80 00000100:00100000:3.0:1762166980.227660:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2593 00000100:00100000:3.0:1762166980.227666:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5804a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450637184:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:3.0:1762166980.227843:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5804a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450637184:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 177us (318us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1762166980.227856:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2593 00002000:00100000:3.0:1762166980.227864:0:23939:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xa77:0x0] (135168->139263) req@ffff945bc5804a80 x1847765450637184/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 488/4536 e 0 to 0 dl 1762166991 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166980.227872:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5804a80 with x1847765450637184 ext(135168->139263) 00002000:00010000:3.0:1762166980.227875:0:23939:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5804a80 00000100:00100000:1.0:1762166980.229420:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.229519:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450637312 00000100:00100000:3.0:1762166980.229525:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450637312 00002000:00100000:3.0:1762166980.229561:0:23939:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xa77:0x0] (139264->143359) req@ffff945bc5804000 x1847765450637312/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 488/0 e 0 to 0 dl 1762166991 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166980.229571:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5804000 with x1847765450637312 ext(139264->143359) 00002000:00010000:3.0:1762166980.229575:0:23939:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5804000 00000100:00100000:3.0:1762166980.229605:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2594 00000100:00100000:3.0:1762166980.229615:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5804000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450637312:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:3.0:1762166980.229738:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5804000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450637312:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 125us (323us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1762166980.229743:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2594 00002000:00100000:3.0:1762166980.229747:0:23939:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xa77:0x0] (139264->143359) req@ffff945bc5804000 x1847765450637312/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 488/4536 e 0 to 0 dl 1762166991 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166980.229753:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5804000 with x1847765450637312 ext(139264->143359) 00002000:00010000:3.0:1762166980.229756:0:23939:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5804000 00000100:00100000:1.0:1762166980.231398:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.231461:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450637440 00000100:00100000:3.0:1762166980.231469:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450637440 00002000:00100000:3.0:1762166980.231522:0:23939:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xa77:0x0] (143360->147455) req@ffff945bc5805c00 x1847765450637440/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 488/0 e 0 to 0 dl 1762166991 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166980.231535:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5805c00 with x1847765450637440 ext(143360->147455) 00002000:00010000:3.0:1762166980.231540:0:23939:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5805c00 00000100:00100000:3.0:1762166980.231565:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2595 00000100:00100000:3.0:1762166980.231575:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5805c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450637440:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:3.0:1762166980.231695:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5805c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450637440:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 124us (304us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1762166980.231701:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2595 00002000:00100000:3.0:1762166980.231706:0:23939:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xa77:0x0] (143360->147455) req@ffff945bc5805c00 x1847765450637440/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 488/4536 e 0 to 0 dl 1762166991 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166980.231712:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5805c00 with x1847765450637440 ext(143360->147455) 00002000:00010000:3.0:1762166980.231715:0:23939:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5805c00 00000100:00100000:1.0:1762166980.233458:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.233504:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450637568 00000100:00100000:3.0:1762166980.233513:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450637568 00002000:00100000:3.0:1762166980.233546:0:23939:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xa77:0x0] (110592->146234) req@ffff945bc5806680 x1847765450637568/t0(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 488/0 e 0 to 0 dl 1762166991 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166980.233556:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5806680 with x1847765450637568 ext(110592->146234) 00002000:00010000:3.0:1762166980.233559:0:23939:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5806680 00000100:00100000:3.0:1762166980.233584:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2596 00000100:00100000:3.0:1762166980.233594:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5806680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450637568:12345-192.168.204.38@tcp:4:fsx.0 00000100:00100000:3.0:1762166980.235027:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5806680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765450637568:12345-192.168.204.38@tcp:4:fsx.0 Request processed in 1429us (1567us total) trans 17179876606 rc 0/0 00000100:00100000:3.0:1762166980.235037:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2596 00002000:00100000:3.0:1762166980.235047:0:23939:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xa77:0x0] (110592->146234) req@ffff945bc5806680 x1847765450637568/t17179876606(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 488/448 e 0 to 0 dl 1762166991 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166980.235064:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5806680 with x1847765450637568 ext(110592->146234) 00002000:00010000:3.0:1762166980.235068:0:23939:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5806680 00000100:00100000:1.0:1762166980.236073:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.236129:0:35248:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450637696 00000100:00100000:3.0:1762166980.236137:0:35248:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450637696 00000100:00100000:3.0:1762166980.236183:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19255 00000100:00100000:3.0:1762166980.236192:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5807480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765450637696:12345-192.168.204.38@tcp:16:fsx.0 00000001:00080000:1.0:1762166980.237207:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876606 is committed 00000100:00100000:3.0:1762166980.237343:0:35248:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5807480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450637696:12345-192.168.204.38@tcp:16:fsx.0 Request processed in 1150us (1271us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166980.237352:0:35248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19255 00000100:00100000:1.0:1762166980.238732:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.238796:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450637824 00000100:00100000:2.0:1762166980.238806:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450637824 00000100:00100000:2.0:1762166980.238869:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30729 00000100:00100000:2.0:1762166980.238881:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5805500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+591:61766:x1847765450637824:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:2.0:1762166980.238905:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166980.238928:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbac33b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea55d expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.239040:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbac342 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 15 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166980.239057:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbac342 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.239069:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbac342 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:2.0:1762166980.239101:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 146235 00000004:00200000:2.0:1762166980.239106:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166980.239127:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbac342 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.239156:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbac33b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea55d expref: 593 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.239173:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbac342 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea55d expref: 592 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.239183:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166980.239187:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166980.239191:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc5db8e00, rc 0) 00000100:00100000:2.0:1762166980.239244:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5805500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+592:61766:x1847765450637824:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 367us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166980.239252:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30729 00000100:00100000:1.0:1762166980.241052:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.241106:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450638080 00000100:00100000:2.0:1762166980.241114:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450638080 00000100:00100000:2.0:1762166980.241176:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30730 00000100:00100000:2.0:1762166980.241186:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5807b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+592:61766:x1847765450638080:12345-192.168.204.38@tcp:36:fsx.0 00010000:00010000:2.0:1762166980.241232:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166980.241251:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbac342 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea55d expref: 592 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.241269:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166980.241273:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166980.241507:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb600/0x2f180c4effbac349 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166980.241521:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb600/0x2f180c4effbac349 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.241528:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb600/0x2f180c4effbac349 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000001:00080000:2.0:1762166980.241568:0:6494:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992376 00000004:00010000:2.0:1762166980.241598:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000ae1ffd20 reply state 00000000e359c405 transno 4294992377 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb600/0x2f180c4effbac349 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.241610:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb600/0x2f180c4effbac349 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.241616:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166980.241619:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166980.241622:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166980.241694:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5807b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+594:61766:x1847765450638080:12345-192.168.204.38@tcp:36:fsx.0 Request processed in 510us (649us total) trans 4294992377 rc 0/0 00000100:00100000:2.0:1762166980.241700:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30730 00000020:00080000:2.0:1762166980.241704:0:6494:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1762166980.242904:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.242940:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450638208 00000100:00100000:3.0:1762166980.242948:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450638208 00000100:00100000:1.0:1762166980.242972:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00002000:00010000:3.0:1762166980.242984:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (10341->18446744073709551615) 00002000:00100000:3.0:1762166980.242991:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc558b800 with x1847765450638208 ext(10341->18446744073709551615) 00002000:00010000:3.0:1762166980.243003:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc558b800. 00000100:00100000:1.0:1762166980.243008:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.243034:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450638336 00000100:00100000:0.0:1762166980.243039:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450638336 00002000:00010000:0.0:1762166980.243059:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00000100:00100000:2.0:1762166980.243060:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450638464 00000100:00100000:2.0:1762166980.243067:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450638464 00002000:00100000:0.0:1762166980.243067:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc558bb80 with x1847765450638336 ext(0->18446744073709551615) 00000100:00100000:3.0:1762166980.243068:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2597 00002000:00010000:0.0:1762166980.243079:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc558bb80. 00000100:00100000:3.0:1762166980.243080:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450638208:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:2.0:1762166980.243090:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:2.0:1762166980.243095:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc558b480 with x1847765450638464 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166980.243104:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc558b480. 00000100:00100000:0.0:1762166980.243111:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2598 00000100:00100000:0.0:1762166980.243122:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+28:2419:x1847765450638336:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:1.0:1762166980.243159:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2599 00000100:00100000:1.0:1762166980.243172:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450638464:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:0.0:1762166980.243229:0:14623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166980.243232:0:14623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00002000:00010000:0.0:1762166980.243234:0:14623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166979 -> 1762166979 00002000:00010000:0.0:1762166980.243236:0:14623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:0.0:1762166980.243238:0:14623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00000100:00100000:0.0:1762166980.243277:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+29:2419:x1847765450638336:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 158us (307us total) trans 21474843403 rc 0/0 00002000:00010000:1.0:1762166980.243280:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:0.0:1762166980.243282:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2598 00002000:00010000:1.0:1762166980.243286:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00002000:00010000:0.0:1762166980.243288:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00010000:1.0:1762166980.243292:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166979 -> 1762166979 00002000:00100000:0.0:1762166980.243293:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc558bb80 with x1847765450638336 ext(0->18446744073709551615) 00002000:00010000:1.0:1762166980.243296:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:0.0:1762166980.243302:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc558bb80. 00002000:00010000:1.0:1762166980.243303:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1762166980.243336:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450638464:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 167us (327us total) trans 17179876607 rc 0/0 00000100:00100000:1.0:1762166980.243345:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2599 00002000:00010000:1.0:1762166980.243348:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:1.0:1762166980.243352:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc558b480 with x1847765450638464 ext(0->18446744073709551615) 00002000:00010000:1.0:1762166980.243357:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc558b480. 00002000:00010000:3.0:1762166980.243608:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 146235 -> 10341 00002000:00010000:3.0:1762166980.243613:0:23939:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00002000:00010000:3.0:1762166980.243615:0:23939:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00002000:00010000:3.0:1762166980.243618:0:23939:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:3.0:1762166980.243620:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 256 -> 32 00000100:00100000:3.0:1762166980.243651:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450638208:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 574us (752us total) trans 17179876608 rc 0/0 00000100:00100000:3.0:1762166980.243660:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2597 00002000:00010000:3.0:1762166980.243663:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (10341->18446744073709551615) 00002000:00100000:3.0:1762166980.243665:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc558b800 with x1847765450638208 ext(10341->18446744073709551615) 00002000:00010000:3.0:1762166980.243668:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc558b800. 00000100:00100000:1.0:1762166980.245019:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.245082:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450638592 00000100:00100000:2.0:1762166980.245093:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450638592 00000100:00100000:2.0:1762166980.245165:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30731 00000100:00100000:2.0:1762166980.245177:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+594:61766:x1847765450638592:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:2.0:1762166980.245201:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166980.245221:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14000/0x2f180c4effbac350 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 15 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea564 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.245326:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbac357 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166980.245340:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbac357 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 16 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.245353:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbac357 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 16 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:2.0:1762166980.245383:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 10341 00000004:00200000:2.0:1762166980.245388:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166980.245407:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbac357 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 16 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.245439:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14000/0x2f180c4effbac350 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea564 expref: 596 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.245458:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbac357 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea564 expref: 595 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.245467:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166980.245470:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166980.245474:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc5db9c00, rc 0) 00000100:00100000:2.0:1762166980.245560:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+595:61766:x1847765450638592:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 386us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166980.245567:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30731 00000100:00100000:1.0:1762166980.247363:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.247419:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450638720 00000100:00100000:3.0:1762166980.247429:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450638720 00000100:00100000:3.0:1762166980.247527:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2600 00000100:00100000:3.0:1762166980.247539:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5588e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450638720:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:3.0:1762166980.247769:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 10341 -> 10341 00002000:00010000:3.0:1762166980.247773:0:23939:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00002000:00010000:3.0:1762166980.247775:0:23939:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00002000:00010000:3.0:1762166980.247778:0:23939:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:3.0:1762166980.247780:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 32 -> 32 00000100:00100000:3.0:1762166980.247841:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5588e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450638720:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 304us (484us total) trans 17179876609 rc 0/0 00000100:00100000:3.0:1762166980.247849:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2600 00000100:00100000:1.0:1762166980.249983:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.250023:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450638848 00000100:00100000:3.0:1762166980.250031:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450638848 00000100:00100000:3.0:1762166980.250102:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2601 00000100:00100000:3.0:1762166980.250118:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450638848:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:3.0:1762166980.250281:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 10341 -> 10341 00002000:00010000:3.0:1762166980.250285:0:23939:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00002000:00010000:3.0:1762166980.250287:0:23939:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00002000:00010000:3.0:1762166980.250290:0:23939:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:3.0:1762166980.250292:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 32 -> 32 00000100:00100000:3.0:1762166980.250350:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450638848:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 238us (376us total) trans 17179876610 rc 0/0 00000100:00100000:3.0:1762166980.250357:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2601 00000100:00100000:1.0:1762166980.252098:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.252142:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450638976 00000100:00100000:3.0:1762166980.252152:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450638976 00000100:00100000:3.0:1762166980.252231:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2602 00000100:00100000:3.0:1762166980.252243:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5588380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450638976:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:3.0:1762166980.252597:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 10341 -> 10341 00002000:00010000:3.0:1762166980.252601:0:23939:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00002000:00010000:3.0:1762166980.252603:0:23939:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00002000:00010000:3.0:1762166980.252606:0:23939:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:3.0:1762166980.252607:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 32 -> 32 00000100:00100000:3.0:1762166980.252656:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5588380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765450638976:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 417us (568us total) trans 17179876611 rc 0/0 00000100:00100000:3.0:1762166980.252662:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2602 00000100:00100000:1.0:1762166980.255462:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.255540:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450639232 00000100:00100000:2.0:1762166980.255549:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450639232 00000100:00100000:2.0:1762166980.255595:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30732 00000100:00100000:2.0:1762166980.255604:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5589c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+595:61766:x1847765450639232:12345-192.168.204.38@tcp:36:fsx.0 00010000:00010000:2.0:1762166980.255653:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166980.255681:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbac357 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 16 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea564 expref: 595 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.255696:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166980.255699:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166980.255868:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbac35e lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 15 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166980.255884:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbac35e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.255896:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbac35e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000001:00080000:2.0:1762166980.255939:0:6494:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992378 00000004:00010000:2.0:1762166980.255959:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000000eed8c8 reply state 000000006f5d8313 transno 4294992379 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbac35e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.255968:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbac35e lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.255972:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166980.255975:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166980.255978:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166980.256058:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5589c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+597:61766:x1847765450639232:12345-192.168.204.38@tcp:36:fsx.0 Request processed in 455us (602us total) trans 4294992379 rc 0/0 00000100:00100000:2.0:1762166980.256066:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30732 00000020:00080000:2.0:1762166980.256072:0:6494:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1762166980.257690:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.257724:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.257763:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.257784:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450639360 00000100:00100000:2.0:1762166980.257791:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450639360 00000100:00100000:3.0:1762166980.257795:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450639488 00000100:00100000:3.0:1762166980.257801:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450639488 00002000:00010000:2.0:1762166980.257818:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (247325->18446744073709551615) 00000100:00100000:0.0:1762166980.257820:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450639616 00002000:00010000:3.0:1762166980.257821:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:2.0:1762166980.257834:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5589f80 with x1847765450639360 ext(247325->18446744073709551615) 00002000:00100000:3.0:1762166980.257838:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc558ad80 with x1847765450639488 ext(0->18446744073709551615) 00000100:00100000:0.0:1762166980.257839:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450639616 00002000:00010000:3.0:1762166980.257849:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc558ad80. 00002000:00010000:2.0:1762166980.257849:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5589f80. 00002000:00010000:0.0:1762166980.257860:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:0.0:1762166980.257865:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5589180 with x1847765450639616 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166980.257873:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5589180. 00000100:00100000:3.0:1762166980.257877:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2603 00000100:00100000:3.0:1762166980.257885:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+29:2418:x1847765450639488:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:2.0:1762166980.257890:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2604 00000100:00100000:2.0:1762166980.257901:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5589f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765450639360:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:0.0:1762166980.257908:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2605 00000100:00100000:0.0:1762166980.257919:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5589180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765450639616:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:3.0:1762166980.258000:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166980.258002:0:14623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166980.258006:0:14623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00002000:00010000:3.0:1762166980.258010:0:23939:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00002000:00010000:0.0:1762166980.258010:0:14623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166979 -> 1762166979 00002000:00010000:0.0:1762166980.258017:0:14623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:3.0:1762166980.258018:0:23939:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166979 -> 1762166979 00002000:00010000:0.0:1762166980.258021:0:14623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:3.0:1762166980.258025:0:23939:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:3.0:1762166980.258029:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00002000:00010000:2.0:1762166980.258052:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 10341 -> 247325 00002000:00010000:2.0:1762166980.258056:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00002000:00010000:2.0:1762166980.258058:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00002000:00010000:2.0:1762166980.258060:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:2.0:1762166980.258062:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 32 -> 32 00000100:00100000:0.0:1762166980.258067:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5589180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+25:2418:x1847765450639616:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 149us (302us total) trans 17179876612 rc 0/0 00000100:00100000:3.0:1762166980.258071:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+30:2418:x1847765450639488:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 186us (345us total) trans 21474843404 rc 0/0 00000100:00100000:0.0:1762166980.258081:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2605 00002000:00010000:0.0:1762166980.258086:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00000100:00100000:2.0:1762166980.258087:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5589f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+25:2419:x1847765450639360:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 189us (399us total) trans 17179876613 rc 0/0 00000100:00100000:3.0:1762166980.258090:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2603 00002000:00100000:0.0:1762166980.258094:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5589180 with x1847765450639616 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166980.258097:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:3.0:1762166980.258102:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc558ad80 with x1847765450639488 ext(0->18446744073709551615) 00000100:00100000:2.0:1762166980.258102:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2604 00002000:00010000:0.0:1762166980.258103:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5589180. 00002000:00010000:2.0:1762166980.258107:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (247325->18446744073709551615) 00002000:00010000:3.0:1762166980.258111:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc558ad80. 00002000:00100000:2.0:1762166980.258112:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5589f80 with x1847765450639360 ext(247325->18446744073709551615) 00002000:00010000:2.0:1762166980.258120:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5589f80. 00000100:00100000:1.0:1762166980.259124:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.259168:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450639744 00000100:00100000:2.0:1762166980.259173:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450639744 00000100:00100000:2.0:1762166980.259208:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30733 00000100:00100000:2.0:1762166980.259213:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+597:61766:x1847765450639744:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:2.0:1762166980.259224:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166980.259241:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194200/0x2f180c4effbac365 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea56b expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.259314:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194e00/0x2f180c4effbac36c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 17 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166980.259326:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194e00/0x2f180c4effbac36c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 17 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.259336:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194e00/0x2f180c4effbac36c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 17 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:2.0:1762166980.259358:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 247325 00000004:00200000:2.0:1762166980.259362:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166980.259376:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194e00/0x2f180c4effbac36c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 17 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.259412:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194200/0x2f180c4effbac365 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea56b expref: 599 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.259430:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194e00/0x2f180c4effbac36c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 16 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea56b expref: 598 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.259437:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166980.259439:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166980.259443:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc7194e00, rc 0) 00000100:00100000:2.0:1762166980.259507:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+598:61766:x1847765450639744:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 292us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166980.259513:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30733 00000100:00100000:1.0:1762166980.261747:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.261821:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450640000 00000100:00100000:0.0:1762166980.261841:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450640000 00000100:00100000:0.0:1762166980.261888:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11944 00000100:00100000:0.0:1762166980.261898:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+598:61766:x1847765450640000:12345-192.168.204.38@tcp:35:fsx.0 00000100:00100000:0.0:1762166980.262156:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+599:61766:x1847765450640000:12345-192.168.204.38@tcp:35:fsx.0 Request processed in 260us (412us total) trans 4294992380 rc 0/0 00000100:00100000:0.0:1762166980.262164:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11944 00000100:00100000:1.0:1762166980.270469:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.270536:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450640256 00000100:00100000:2.0:1762166980.270546:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450640256 00000100:00100000:2.0:1762166980.270593:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30734 00000100:00100000:2.0:1762166980.270600:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+599:61872:x1847765450640256:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166980.270620:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166980.270638:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194200/0x2f180c4effbac373 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea572 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.270697:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194800/0x2f180c4effbac37a lrc: 3/1,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166980.270707:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194800/0x2f180c4effbac37a lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.270715:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194800/0x2f180c4effbac37a lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.270724:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbac381 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166980.270731:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbac381 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.270739:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbac381 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.270851:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14000/0x2f180c4effbac388 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 17 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166980.270861:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14000/0x2f180c4effbac388 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 17 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.270867:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14000/0x2f180c4effbac388 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 17 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:2.0:1762166980.270875:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 247325 00010000:00010000:2.0:1762166980.270957:0:6494:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194800/0x2f180c4effbac37a lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.270962:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194800/0x2f180c4effbac37a lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.270966:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194800/0x2f180c4effbac37a lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.270969:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194800/0x2f180c4effbac37a lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.270973:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc7194800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166980.270975:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194800/0x2f180c4effbac37a lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.270980:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194800/0x2f180c4effbac37a lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.270991:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0x0 (ffff945bc4077300) 00010000:00010000:2.0:1762166980.270994:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166980.270998:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194800/0x2f180c4effbac37a lrc: 3/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.271004:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194800/0x2f180c4effbac37a lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.271017:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbac381 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.271023:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbac381 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.271028:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbac381 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.271033:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc5db9c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166980.271036:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbac381 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.271040:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbac381 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.271045:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0xdd396665 (ffff945bc4077200) 00010000:00010000:2.0:1762166980.271047:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166980.271049:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbac381 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.271059:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbac381 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.271096:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194200/0x2f180c4effbac373 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea572 expref: 602 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.271113:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14000/0x2f180c4effbac388 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 17 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea572 expref: 601 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.271120:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166980.271122:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166980.271125:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945d00f14000, rc 0) 00000100:00100000:2.0:1762166980.271177:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+601:61872:x1847765450640256:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 577us (715us total) trans 4294992381 rc 0/0 00000100:00100000:2.0:1762166980.271182:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30734 00000100:00100000:1.0:1762166980.272539:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.272598:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450640384 00000100:00100000:0.0:1762166980.272605:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450640384 00000100:00100000:0.0:1762166980.272655:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 892 00000100:00100000:0.0:1762166980.272665:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+601:2418:x1847765450640384:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166980.272678:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166980.272696:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945d00f14000/0x2f180c4effbac388 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 18 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea572 expref: 601 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.272712:0:7421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:0.0:1762166980.272717:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166980.272761:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+600:2418:x1847765450640384:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 99us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166980.272770:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 892 00000100:00100000:1.0:1762166980.272841:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.272981:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450640640 00000100:00100000:3.0:1762166980.272986:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450640640 00000100:00100000:3.0:1762166980.273016:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30735 00000100:00100000:3.0:1762166980.273023:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+600:61872:x1847765450640640:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166980.273040:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166980.273068:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472c00/0x2f180c4effbac396 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea579 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.273418:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effbac39d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166980.273429:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effbac39d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.273438:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effbac39d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:3.0:1762166980.273446:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x619:0x0]: returning size 0 00010000:00010000:3.0:1762166980.273499:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472c00/0x2f180c4effbac396 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea579 expref: 603 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.273519:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effbac39d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea579 expref: 602 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.273528:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x619:0x0].0x0 (ffff945cd1d8c800) 00010000:00010000:3.0:1762166980.273530:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166980.273533:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8472000, rc 0) 00000100:00100000:3.0:1762166980.273575:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+602:61872:x1847765450640640:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 552us (733us total) trans 4294992382 rc 0/0 00000100:00100000:3.0:1762166980.273581:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30735 00000100:00100000:2.0:1762166980.275264:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.275327:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450640896 00000100:00100000:3.0:1762166980.275334:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450640896 00000100:00100000:3.0:1762166980.275425:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30736 00000100:00100000:3.0:1762166980.275435:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+602:61872:x1847765450640896:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166980.275460:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166980.275504:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472a00/0x2f180c4effbac3ab lrc: 2/0,0 mode: --/CR res: [0x240000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea580 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.275586:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472800/0x2f180c4effbac3b2 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166980.275600:0:6494:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effbac39d lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea579 expref: 603 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.275610:0:6494:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472800/0x2f180c4effbac3b2 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.275640:0:6494:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effbac39d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea579 expref: 603 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.275654:0:6494:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effbac39d lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea579 expref: 603 pid: 6494 timeout: 699 lvb_type: 0 00000100:00100000:3.0:1762166980.275674:0:6494:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bc3800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765449764608:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166980.275748:0:6494:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7c49cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166980.277012:0:6494:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bc3800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765449764608:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166980.277056:0:6494:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472800/0x2f180c4effbac3b2 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000100:00100000:2.0:1762166980.277072:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.277131:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450641024 00000100:00100000:0.0:1762166980.277141:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450641024 00010000:00010000:0.0:1762166980.277182:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effbac39d lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea579 expref: 604 pid: 6494 timeout: 699 lvb_type: 0 00000100:00100000:0.0:1762166980.277222:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9735 00000100:00100000:0.0:1762166980.277232:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+604:2419:x1847765450641024:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166980.277248:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166980.277255:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effbac39d lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea579 expref: 604 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:0.0:1762166980.277267:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effbac39d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea579 expref: 604 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:0.0:1762166980.277290:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472000/0x2f180c4effbac39d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x619:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea579 expref: 604 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:0.0:1762166980.277307:0:7421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x619:0x0].0x0 (ffff945cd1d8c800) 00010000:00010000:0.0:1762166980.277312:0:7421:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472800/0x2f180c4effbac3b2 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.277322:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472800/0x2f180c4effbac3b2 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.277329:0:7421:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472800/0x2f180c4effbac3b2 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.277366:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166980.277434:0:6494:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472800/0x2f180c4effbac3b2 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000100:00100000:0.0:1762166980.277437:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+603:2419:x1847765450641024:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 205us (368us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166980.277451:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472800/0x2f180c4effbac3b2 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000100:00100000:0.0:1762166980.277456:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9735 00000004:00200000:3.0:1762166980.277510:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x619:0x0]: returning size 0 00000004:00080000:3.0:1762166980.277767:0:6494:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xa90:0x0], index 0: 0 00000004:00080000:3.0:1762166980.277776:0:6494:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xa8f:0x0], index 1: 0 00010000:00010000:3.0:1762166980.277915:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472800/0x2f180c4effbac3b2 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.277925:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472800/0x2f180c4effbac3b2 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.277931:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472800/0x2f180c4effbac3b2 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.277938:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8472800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166980.277942:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472800/0x2f180c4effbac3b2 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.277950:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472800/0x2f180c4effbac3b2 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.277965:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x619:0x0].0x0 (ffff945cd1d8c800) 00010000:00010000:3.0:1762166980.277968:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166980.277973:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472800/0x2f180c4effbac3b2 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.277979:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472800/0x2f180c4effbac3b2 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.278044:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472a00/0x2f180c4effbac3ab lrc: 1/0,0 mode: --/CR res: [0x240000404:0x619:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea580 expref: 603 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.278054:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x619:0x0].0x0 (ffff945cd1d8c800) 00010000:00010000:3.0:1762166980.278057:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1762166980.278060:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472a00/0x2f180c4effbac3ab lrc: 0/0,0 mode: --/CR res: [0x240000404:0x619:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea580 expref: 603 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.278076:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8472a00, rc 0) 00000100:00100000:3.0:1762166980.278122:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+602:61872:x1847765450640896:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2688us (2863us total) trans 4294992383 rc 301/301 00000100:00100000:3.0:1762166980.278130:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30736 00000100:00100000:2.0:1762166980.279406:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.279465:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450641280 00000100:00100000:0.0:1762166980.279475:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450641280 00000100:00100000:0.0:1762166980.279580:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11945 00000100:00100000:0.0:1762166980.279590:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7be1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+602:61872:x1847765450641280:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166980.279853:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7be1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+603:61872:x1847765450641280:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 264us (452us total) trans 4294992384 rc 0/0 00000100:00100000:0.0:1762166980.279862:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11945 00000100:00100000:1.0:1762166980.281161:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.281211:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450641408 00000100:00100000:3.0:1762166980.281221:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450641408 00000100:00100000:3.0:1762166980.281270:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30737 00000100:00100000:3.0:1762166980.281277:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+603:61872:x1847765450641408:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166980.281303:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166980.281323:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473000/0x2f180c4effbac3c0 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea587 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.281400:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473a00/0x2f180c4effbac3c7 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166980.281414:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473a00/0x2f180c4effbac3c7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x619:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.281425:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473a00/0x2f180c4effbac3c7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x619:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:3.0:1762166980.281463:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x619:0x0]: returning size 0 00000004:00200000:3.0:1762166980.281469:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166980.281515:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473a00/0x2f180c4effbac3c7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x619:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.281556:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473000/0x2f180c4effbac3c0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea587 expref: 605 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.281574:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473a00/0x2f180c4effbac3c7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x619:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea587 expref: 604 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.281583:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x619:0x0].0x0 (ffff945cd1d8cb00) 00010000:00010000:3.0:1762166980.281586:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1762166980.281588:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8473a00, rc 0) 00000100:00100000:3.0:1762166980.281649:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+604:61872:x1847765450641408:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 371us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166980.281657:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30737 00000100:00100000:1.0:1762166980.282865:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.282914:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.282934:0:35248:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450641536 00000100:00100000:3.0:1762166980.282942:0:35248:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450641536 00000100:00100000:0.0:1762166980.282962:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450641664 00000100:00100000:0.0:1762166980.282968:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450641664 00000100:00100000:3.0:1762166980.283003:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19256 00000100:00100000:3.0:1762166980.283017:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+30:2419:x1847765450641536:12345-192.168.204.38@tcp:101:lfs.0 00000100:00100000:0.0:1762166980.283025:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19257 00010000:00010000:3.0:1762166980.283037:0:35248:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166980.283062:0:35248:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc8473c00/0x2f180c4effbac3ce lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea58e expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166980.283087:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+24:2418:x1847765450641664:12345-192.168.204.38@tcp:101:lfs.0 00002000:00010000:3.0:1762166980.283089:0:35248:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa90:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1762166980.283112:0:8382:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166980.283113:0:35248:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166980.283116:0:35248:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166980.283124:0:35248:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8473c00/0x2f180c4effbac3ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea58e expref: 31 pid: 35248 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166980.283132:0:8382:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbac3d5 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa8f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea595 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.283140:0:35248:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc8473c00/0x2f180c4effbac3ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea58e expref: 31 pid: 35248 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166980.283162:0:35248:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8473c00, rc 0) 00002000:00010000:0.0:1762166980.283168:0:8382:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa8f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1762166980.283186:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166980.283189:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166980.283199:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbac3d5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea595 expref: 25 pid: 8382 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166980.283216:0:8382:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbac3d5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea595 expref: 25 pid: 8382 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1762166980.283226:0:35248:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+31:2419:x1847765450641536:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 208us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166980.283245:0:35248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19256 00010000:00010000:0.0:1762166980.283245:0:8382:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdec00, rc 0) 00000100:00100000:0.0:1762166980.283291:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+25:2418:x1847765450641664:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 257us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166980.283299:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19257 00000100:00100000:2.0:1762166980.284842:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.284884:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450641920 00000100:00100000:3.0:1762166980.284891:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450641920 00000100:00100000:3.0:1762166980.284932:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30738 00000100:00100000:3.0:1762166980.284939:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+604:61872:x1847765450641920:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166980.284955:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166980.284971:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472c00/0x2f180c4effbac3dc lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 17 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea59c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.285081:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effbac3e3 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 18 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166980.285100:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effbac3e3 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 18 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.285108:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effbac3e3 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 18 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:3.0:1762166980.285118:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 247325 00010000:00010000:3.0:1762166980.285209:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472c00/0x2f180c4effbac3dc lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 18 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea59c expref: 607 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.285225:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effbac3e3 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 17 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea59c expref: 606 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.285233:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:3.0:1762166980.285236:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166980.285239:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8472400, rc 0) 00000100:00100000:3.0:1762166980.285281:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+606:61872:x1847765450641920:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 342us (455us total) trans 4294992385 rc 0/0 00000100:00100000:3.0:1762166980.285288:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30738 00000100:00100000:1.0:1762166980.286725:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.286778:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.286797:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450642048 00000100:00100000:1.0:1762166980.286810:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.286811:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450642048 00000100:00100000:3.0:1762166980.286845:0:35248:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450642176 00000100:00100000:3.0:1762166980.286855:0:35248:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450642176 00000100:00100000:0.0:1762166980.286885:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19258 00000100:00100000:2.0:1762166980.286886:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450642304 00000100:00100000:2.0:1762166980.286895:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450642304 00000100:00100000:0.0:1762166980.286902:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+26:2416:x1847765450642048:12345-192.168.204.38@tcp:1:lfs.0 00000100:00100000:3.0:1762166980.286920:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19259 00000100:00100000:3.0:1762166980.286934:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+31:2417:x1847765450642176:12345-192.168.204.38@tcp:1:lfs.0 00000100:00100000:1.0:1762166980.286941:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19260 00000100:00100000:1.0:1762166980.286955:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+26:2416:x1847765450642304:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:0.0:1762166980.286955:0:8382:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac3f1 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.286979:0:35248:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba000/0x2f180c4effbac3f8 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.286993:0:8382:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbac04e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 20480->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea461 expref: 26 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.286995:0:28874:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945cc355a400/0x2f180c4effbac3ff lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.287004:0:35248:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8600/0x2f180c4effbabf8a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea40d expref: 31 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.287038:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166980.287046:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166980.287055:0:28874:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbabf91 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea414 expref: 26 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.287056:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac3f1 lrc: 4/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.287057:0:35248:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166980.287063:0:35248:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166980.287070:0:35248:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba000/0x2f180c4effbac3f8 lrc: 4/1,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.287113:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166980.287116:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166980.287119:0:28874:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355a400/0x2f180c4effbac3ff lrc: 4/1,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.287160:0:35248:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8600/0x2f180c4effbabf8a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea40d expref: 31 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.287160:0:8382:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbac04e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 20480->65535) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea461 expref: 26 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.287161:0:28874:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbabf91 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea414 expref: 26 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.287214:0:8382:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbac04e lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 20480->65535) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea461 expref: 26 pid: 35248 timeout: 699 lvb_type: 0 00010000:00010000:3.0:1762166980.287215:0:35248:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8600/0x2f180c4effbabf8a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea40d expref: 31 pid: 28434 timeout: 699 lvb_type: 0 00010000:00010000:1.0:1762166980.287215:0:28874:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbabf91 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea414 expref: 26 pid: 28434 timeout: 699 lvb_type: 0 00000100:00100000:0.0:1762166980.287278:0:8382:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1ddd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8382:1847765449764736:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166980.287285:0:35248:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bc3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:35248:1847765449764864:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166980.287285:0:28874:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28874:1847765449764992:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166980.287422:0:28874:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc4076900 going to sleep for 11 seconds 00000100:00100000:3.0:1762166980.287423:0:35248:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccac7a240 going to sleep for 11 seconds 00000100:00100000:0.0:1762166980.287423:0:8382:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf3a33780 going to sleep for 11 seconds 00000100:00100000:0.0:1762166980.288622:0:8382:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1ddd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8382:1847765449764736:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166980.288631:0:35248:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bc3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:35248:1847765449764864:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166980.288646:0:35248:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba000/0x2f180c4effbac3f8 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.288646:0:8382:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac3f1 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166980.288675:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.288719:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450642560 00000100:00100000:0.0:1762166980.288725:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450642560 00000100:00100000:1.0:1762166980.288730:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:0.0:1762166980.288754:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbac04e lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 20480->65535) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea461 expref: 27 pid: 35248 timeout: 699 lvb_type: 0 00000100:00100000:2.0:1762166980.288790:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450642432 00000100:00100000:0.0:1762166980.288796:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9736 00000100:00100000:2.0:1762166980.288797:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450642432 00000100:00100000:0.0:1762166980.288811:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7c30450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+27:2419:x1847765450642560:12345-192.168.204.38@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1762166980.288816:0:28874:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28874:1847765449764992:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166980.288835:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8600/0x2f180c4effbabf8a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea40d expref: 32 pid: 28434 timeout: 699 lvb_type: 0 00010000:00010000:0.0:1762166980.288837:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166980.288844:0:28874:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945cc355a400/0x2f180c4effbac3ff lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.288864:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbac04e lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 20480->65535) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea461 expref: 27 pid: 35248 timeout: 699 lvb_type: 0 00000100:00100000:1.0:1762166980.288866:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.288872:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9737 00000100:00100000:3.0:1762166980.288884:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450642688 00000100:00100000:2.0:1762166980.288886:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+32:2418:x1847765450642432:12345-192.168.204.38@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1762166980.288888:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450642688 00010000:00010000:0.0:1762166980.288888:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbac04e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 20480->65535) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea461 expref: 27 pid: 35248 timeout: 699 lvb_type: 0 00010000:00010000:2.0:1762166980.288900:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166980.288909:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbabf91 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea414 expref: 28 pid: 28434 timeout: 699 lvb_type: 0 00010000:00010000:0.0:1762166980.288915:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbac04e lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 20480->65535) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea461 expref: 28 pid: 35248 timeout: 699 lvb_type: 0 00010000:00010000:2.0:1762166980.288918:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8600/0x2f180c4effbabf8a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea40d expref: 32 pid: 28434 timeout: 699 lvb_type: 0 00010000:00010000:0.0:1762166980.288940:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166980.288944:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166980.288946:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8600/0x2f180c4effbabf8a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea40d expref: 32 pid: 28434 timeout: 699 lvb_type: 0 00010000:00010000:0.0:1762166980.288950:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac3f1 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166980.288958:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9738 00000100:00100000:3.0:1762166980.288967:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+27:2419:x1847765450642688:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166980.288969:0:7421:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac3f1 lrc: 4/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.288971:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa8600/0x2f180c4effbabf8a lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea40d expref: 32 pid: 28434 timeout: 699 lvb_type: 0 00010000:00010000:3.0:1762166980.288981:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166980.288996:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbabf91 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea414 expref: 27 pid: 28434 timeout: 699 lvb_type: 0 00010000:00010000:2.0:1762166980.289001:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166980.289004:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166980.289005:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166980.289011:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba000/0x2f180c4effbac3f8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.289012:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbabf91 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea414 expref: 27 pid: 28434 timeout: 699 lvb_type: 0 00010000:00010000:1.0:1762166980.289019:0:8382:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac3f1 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.289033:0:9458:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba000/0x2f180c4effbac3f8 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.289039:0:8382:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac3f1 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.289044:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbabf91 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea414 expref: 27 pid: 28434 timeout: 699 lvb_type: 0 00000100:00100000:0.0:1762166980.289045:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7c30450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+27:2419:x1847765450642560:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 237us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166980.289061:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9736 00010000:00010000:2.0:1762166980.289063:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166980.289068:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166980.289071:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166980.289074:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945cc355a400/0x2f180c4effbac3ff lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.289077:0:8382:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac3f1 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.289085:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355a400/0x2f180c4effbac3ff lrc: 4/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.289091:0:8382:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac3f1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166980.289095:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+31:2418:x1847765450642432:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 211us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166980.289111:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9737 00010000:00010000:1.0:1762166980.289111:0:8382:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac3f1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.289113:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166980.289123:0:8382:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdf600 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166980.289129:0:8382:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac3f1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.289138:0:8382:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac3f1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166980.289139:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+25:2419:x1847765450642688:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 172us (276us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166980.289142:0:35248:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba000/0x2f180c4effbac3f8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166980.289158:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9738 00010000:00010000:2.0:1762166980.289166:0:35248:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba000/0x2f180c4effbac3f8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.289169:0:8382:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac3f1 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.289182:0:8382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac3f1 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.289186:0:35248:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba000/0x2f180c4effbac3f8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.289187:0:28874:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945cc355a400/0x2f180c4effbac3ff lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.289209:0:28874:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cc355a400/0x2f180c4effbac3ff lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.289214:0:35248:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba000/0x2f180c4effbac3f8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.289225:0:35248:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba000/0x2f180c4effbac3f8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.289228:0:28874:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945cc355a400/0x2f180c4effbac3ff lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.289234:0:35248:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93ba000 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166980.289239:0:35248:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba000/0x2f180c4effbac3f8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166980.289247:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+24:2416:x1847765450642048:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 2349us (2523us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166980.289250:0:35248:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba000/0x2f180c4effbac3f8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166980.289261:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19258 00010000:00010000:2.0:1762166980.289267:0:35248:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba000/0x2f180c4effbac3f8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.289275:0:35248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc93ba000/0x2f180c4effbac3f8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.289312:0:28874:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355a400/0x2f180c4effbac3ff lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.289321:0:28874:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945cc355a400/0x2f180c4effbac3ff lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.289328:0:28874:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355a400 already unused, calling callback (ffffffffc0cd9320) 00000100:00100000:2.0:1762166980.289335:0:35248:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+30:2417:x1847765450642176:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 2403us (2555us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166980.289336:0:28874:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc355a400/0x2f180c4effbac3ff lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166980.289347:0:35248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19259 00010000:00010000:3.0:1762166980.289392:0:28874:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc355a400/0x2f180c4effbac3ff lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.289400:0:28874:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945cc355a400/0x2f180c4effbac3ff lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.289405:0:28874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cc355a400/0x2f180c4effbac3ff lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166980.289440:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+23:2416:x1847765450642304:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 2491us (2631us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166980.289524:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19260 00000100:00100000:0.0:1762166980.290528:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.290553:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.290596:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450642816 00000100:00100000:0.0:1762166980.290602:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450642816 00000100:00100000:2.0:1762166980.290611:0:35248:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450643072 00000100:00100000:2.0:1762166980.290624:0:35248:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450643072 00000100:00100000:0.0:1762166980.290644:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19261 00000100:00100000:0.0:1762166980.290657:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765450642816:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166980.290671:0:28874:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166980.290689:0:28874:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbac406 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea5a3 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166980.290701:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19262 00002000:00010000:0.0:1762166980.290710:0:28874:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa77:0x0] initial LVB size: 247325, mtime: 0x690888c4, atime: 0x690888c4, ctime: 0x690888c4, blocks: 0x20 00000100:00100000:2.0:1762166980.290719:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+24:2418:x1847765450643072:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166980.290729:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166980.290734:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166980.290738:0:35248:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166980.290744:0:28874:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbac406 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5a3 expref: 25 pid: 28874 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1762166980.290761:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:2.0:1762166980.290763:0:35248:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc42d1200/0x2f180c4effbac40d lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea5b1 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.290780:0:28874:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbac406 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5a3 expref: 25 pid: 28874 timeout: 0 lvb_type: 1 00002000:00010000:2.0:1762166980.290793:0:35248:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa79:0x0] initial LVB size: 0, mtime: 0x690888c4, atime: 0x690888c3, ctime: 0x690888c4, blocks: 0x0 00010000:00010000:0.0:1762166980.290801:0:28874:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdfe00, rc 0) 00010000:00010000:2.0:1762166980.290810:0:35248:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166980.290813:0:35248:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166980.290821:0:35248:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc42d1200/0x2f180c4effbac40d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5b1 expref: 26 pid: 35248 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1762166980.290836:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450642944 00000100:00100000:3.0:1762166980.290844:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450642944 00010000:00010000:2.0:1762166980.290857:0:35248:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc42d1200/0x2f180c4effbac40d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5b1 expref: 26 pid: 35248 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1762166980.290858:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765450642816:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 204us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166980.290875:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19263 00000100:00100000:3.0:1762166980.290891:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+30:2419:x1847765450642944:12345-192.168.204.38@tcp:101:lfs.0 00000100:00100000:0.0:1762166980.290893:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19261 00010000:00010000:2.0:1762166980.290894:0:35248:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc42d1200, rc 0) 00010000:00010000:3.0:1762166980.290911:0:8382:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166980.290931:0:8382:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4a14000/0x2f180c4effbac414 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea5aa expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166980.290949:0:8382:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa7a:0x0] initial LVB size: 0, mtime: 0x690888c4, atime: 0x690888c3, ctime: 0x690888c4, blocks: 0x1800 00000100:00100000:2.0:1762166980.290955:0:35248:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+25:2418:x1847765450643072:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 241us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166980.290965:0:35248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19262 00010000:00010000:3.0:1762166980.290970:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166980.290973:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166980.290980:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4a14000/0x2f180c4effbac414 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5aa expref: 31 pid: 8382 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166980.290992:0:8382:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc4a14000/0x2f180c4effbac414 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5aa expref: 31 pid: 8382 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166980.290999:0:8382:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4a14000, rc 0) 00000100:00100000:3.0:1762166980.291027:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+31:2419:x1847765450642944:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 139us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166980.291032:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19263 00000100:00100000:1.0:1762166980.315639:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.315708:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450643200 00000100:00100000:3.0:1762166980.315718:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450643200 00000100:00100000:3.0:1762166980.315789:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19264 00000100:00100000:3.0:1762166980.315807:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+25:2418:x1847765450643200:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:3.0:1762166980.315980:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+25:2418:x1847765450643200:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 180us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166980.315989:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19264 00000100:00100000:0.0:1762166980.317196:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.317245:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450643328 00000100:00100000:3.0:1762166980.317251:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450643328 00000100:00100000:3.0:1762166980.317294:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30739 00000100:00100000:3.0:1762166980.317303:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+606:61872:x1847765450643328:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166980.317322:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166980.317354:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847e000/0x2f180c4effbac41b lrc: 2/0,0 mode: --/PR res: [0x240000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea5b8 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.317387:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847f600/0x2f180c4effbac422 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:3.0:1762166980.317400:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847f600/0x2f180c4effbac422 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x619:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.317411:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847f600/0x2f180c4effbac422 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x619:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.317614:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847e000/0x2f180c4effbac41b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x619:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5b8 expref: 608 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.317627:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847f600/0x2f180c4effbac422 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x619:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5b8 expref: 607 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.317633:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x619:0x0].0x0 (ffff945cd1d8cb00) 00010000:00010000:2.0:1762166980.317635:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1762166980.317638:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc847f600, rc 0) 00000100:00100000:2.0:1762166980.317670:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+607:61872:x1847765450643328:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 370us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166980.317675:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30739 00000100:00100000:0.0:1762166980.318764:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.318793:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450643584 00000100:00100000:2.0:1762166980.318809:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450643584 00000100:00100000:2.0:1762166980.318858:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30740 00000100:00100000:2.0:1762166980.318867:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+607:61872:x1847765450643584:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:2.0:1762166980.318900:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166980.318915:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473a00/0x2f180c4effbac3c7 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x619:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea587 expref: 607 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.318924:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x619:0x0].0x0 (ffff945cd1d8cb00) 00010000:00010000:2.0:1762166980.318926:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166980.319076:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba000/0x2f180c4effbac429 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166980.319087:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba000/0x2f180c4effbac429 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.319092:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba000/0x2f180c4effbac429 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000001:00080000:2.0:1762166980.319124:0:6494:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992386 00000004:00010000:2.0:1762166980.319142:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000008bb67c37 reply state 0000000097a87de0 transno 4294992387 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba000/0x2f180c4effbac429 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.319153:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba000/0x2f180c4effbac429 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.319158:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x619:0x0].0x0 (ffff945cd1d8cb00) 00010000:00010000:2.0:1762166980.319161:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166980.319163:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166980.319250:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+609:61872:x1847765450643584:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 384us (485us total) trans 4294992387 rc 0/0 00000100:00100000:2.0:1762166980.319256:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30740 00000020:00080000:2.0:1762166980.319261:0:6494:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1762166980.319997:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.320037:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450643712 00000100:00100000:2.0:1762166980.320042:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450643712 00000100:00100000:2.0:1762166980.320064:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30741 00000100:00100000:2.0:1762166980.320069:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5768000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+609:61872:x1847765450643712:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166980.320080:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166980.320090:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbac430 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea5bf expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.320113:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbac430 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5bf expref: 610 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.320119:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbac430 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5bf expref: 610 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.320129:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x619:0x0].0x0 (ffff945cd1d8cb00) 00010000:00010000:2.0:1762166980.320130:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166980.320132:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc5db9c00, rc 0) 00000100:00100000:2.0:1762166980.320159:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5768000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+610:61872:x1847765450643712:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 89us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166980.320165:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30741 00000100:00100000:0.0:1762166980.321060:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.321098:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450643840 00000100:00100000:3.0:1762166980.321104:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450643840 00000100:00100000:3.0:1762166980.321141:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19265 00000100:00100000:3.0:1762166980.321150:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1dde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+31:61872:x1847765450643840:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166980.321160:0:8382:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166980.321171:0:8382:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cf3cb4200/0x2f180c4effbac437 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea5c6 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.321194:0:8382:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc8473c00/0x2f180c4effbac3ce lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea58e expref: 32 pid: 35248 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166980.321203:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166980.321205:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166980.321209:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cf3cb4200/0x2f180c4effbac437 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5c6 expref: 32 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.321238:0:8382:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc8473c00/0x2f180c4effbac3ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea58e expref: 32 pid: 35248 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166980.321251:0:8382:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc8473c00/0x2f180c4effbac3ce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea58e expref: 32 pid: 35248 timeout: 699 lvb_type: 1 00000100:00100000:3.0:1762166980.321264:0:8382:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bc3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8382:1847765449765120:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166980.321333:0:8382:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccac7a240 going to sleep for 11 seconds 00000100:00100000:3.0:1762166980.322210:0:8382:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bc3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8382:1847765449765120:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166980.322234:0:8382:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945cf3cb4200/0x2f180c4effbac437 lrc: 3/0,0 mode: --/PW res: [0x280000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5c6 expref: 32 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.322252:0:8382:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cb4200, rc 0) 00000100:00100000:3.0:1762166980.322288:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1dde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+32:61872:x1847765450643840:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1140us (1228us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166980.322295:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19265 00000100:00100000:1.0:1762166980.322446:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.322494:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450643968 00000100:00100000:3.0:1762166980.322499:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450643968 00010000:00010000:3.0:1762166980.322519:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc8473c00/0x2f180c4effbac3ce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea58e expref: 32 pid: 35248 timeout: 699 lvb_type: 1 00000100:00100000:3.0:1762166980.322562:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9739 00000100:00100000:3.0:1762166980.322572:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc576bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+32:2419:x1847765450643968:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166980.322585:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166980.322591:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc8473c00/0x2f180c4effbac3ce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa90:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea58e expref: 32 pid: 35248 timeout: 699 lvb_type: 1 00010000:00010000:3.0:1762166980.322602:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc8473c00/0x2f180c4effbac3ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa90:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea58e expref: 32 pid: 35248 timeout: 699 lvb_type: 1 00010000:00010000:3.0:1762166980.322619:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc8473c00/0x2f180c4effbac3ce lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa90:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea58e expref: 32 pid: 35248 timeout: 699 lvb_type: 1 00010000:00010000:3.0:1762166980.322631:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166980.322634:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166980.322638:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945cf3cb4200/0x2f180c4effbac437 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5c6 expref: 31 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.322647:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cf3cb4200/0x2f180c4effbac437 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5c6 expref: 31 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.322670:0:8398:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff945cf3cb4200/0x2f180c4effbac437 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5c6 expref: 31 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166980.322680:0:8398:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bc3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8398:1847765449765248:192.168.204.38@tcp:105: 00000100:00100000:3.0:1762166980.322730:0:8398:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccac7a240 going to sleep for 11 seconds 00000100:00100000:3.0:1762166980.323653:0:8398:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bc3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8398:1847765449765248:192.168.204.38@tcp:105: 00010000:00010000:3.0:1762166980.323669:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166980.323707:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc576bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+31:2419:x1847765450643968:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1137us (1262us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166980.323716:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9739 00000100:00100000:1.0:1762166980.323734:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.323782:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450644096 00000100:00100000:2.0:1762166980.323789:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450644096 00000100:00100000:2.0:1762166980.323841:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19266 00000100:00100000:2.0:1762166980.323851:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc576aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+25:61872:x1847765450644096:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166980.323865:0:8382:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166980.323879:0:8382:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc847e000/0x2f180c4effbac43e lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea5cd expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.323898:0:8382:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbac3d5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea595 expref: 26 pid: 8382 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166980.323905:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166980.323907:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166980.323911:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc847e000/0x2f180c4effbac43e lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xa8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5cd expref: 26 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.323946:0:8382:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbac3d5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea595 expref: 26 pid: 8382 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166980.323958:0:8382:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbac3d5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea595 expref: 26 pid: 8382 timeout: 699 lvb_type: 1 00000100:00100000:2.0:1762166980.323968:0:8382:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda2f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8382:1847765449765376:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166980.324016:0:8382:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a16c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166980.324872:0:8382:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda2f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8382:1847765449765376:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166980.324888:0:8382:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc847e000/0x2f180c4effbac43e lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xa8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5cd expref: 26 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.324900:0:8382:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc847e000, rc 0) 00000100:00100000:2.0:1762166980.324935:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc576aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+26:61872:x1847765450644096:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1087us (1208us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166980.324943:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19266 00000100:00100000:0.0:1762166980.325113:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.325184:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450644224 00000100:00100000:3.0:1762166980.325190:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450644224 00010000:00010000:3.0:1762166980.325226:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbac3d5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea595 expref: 26 pid: 8382 timeout: 699 lvb_type: 1 00000100:00100000:3.0:1762166980.325258:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9740 00000100:00100000:3.0:1762166980.325271:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb386d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765450644224:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166980.325281:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166980.325287:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbac3d5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea595 expref: 26 pid: 8382 timeout: 699 lvb_type: 1 00010000:00010000:3.0:1762166980.325299:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbac3d5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea595 expref: 26 pid: 8382 timeout: 699 lvb_type: 1 00010000:00010000:3.0:1762166980.325320:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbac3d5 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea595 expref: 26 pid: 8382 timeout: 699 lvb_type: 1 00010000:00010000:3.0:1762166980.325330:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166980.325332:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166980.325336:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc847e000/0x2f180c4effbac43e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5cd expref: 25 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.325351:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc847e000/0x2f180c4effbac43e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5cd expref: 25 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.325372:0:8398:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff945bc847e000/0x2f180c4effbac43e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5cd expref: 25 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166980.325382:0:8398:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bc3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8398:1847765449765504:192.168.204.38@tcp:105: 00000100:00100000:3.0:1762166980.325426:0:8398:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccac7a240 going to sleep for 11 seconds 00000100:00100000:3.0:1762166980.326295:0:8398:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bc3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8398:1847765449765504:192.168.204.38@tcp:105: 00010000:00010000:3.0:1762166980.326304:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166980.326328:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb386d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+25:2419:x1847765450644224:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1061us (1224us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166980.326334:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9740 00000100:00100000:0.0:1762166980.326596:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.326640:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450644352 00000100:00100000:2.0:1762166980.326645:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450644352 00002000:00010000:2.0:1762166980.326669:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2704 (0->18446744073709551615) 00002000:00100000:2.0:1762166980.326674:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bcb384380 with x1847765450644352 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166980.326681:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bcb384380. 00000100:00100000:2.0:1762166980.326705:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2606 00000100:00100000:2.0:1762166980.326714:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb384380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+31:2418:x1847765450644352:12345-192.168.204.38@tcp:10:lfs.0 00000100:00100000:1.0:1762166980.326784:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.326813:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450644480 00000100:00100000:3.0:1762166980.326857:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450644480 00002000:00010000:3.0:1762166980.326869:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2703 (0->18446744073709551615) 00002000:00100000:3.0:1762166980.326871:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc576a680 with x1847765450644480 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166980.326875:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc576a680. 00000100:00100000:3.0:1762166980.326894:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2607 00002000:00010000:2.0:1762166980.326899:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa90:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:3.0:1762166980.326900:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc576a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+25:2418:x1847765450644480:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:2.0:1762166980.326905:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa90:0x0] updating lvb mtime from disk: 0 -> 1762166980 00002000:00010000:2.0:1762166980.326909:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa90:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1762166980.326912:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa90:0x0] updating lvb ctime from disk: 0 -> 1762166980 00002000:00010000:2.0:1762166980.326915:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa90:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1762166980.326954:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb384380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+32:2418:x1847765450644352:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 241us (359us total) trans 21474843405 rc 0/0 00000100:00100000:2.0:1762166980.326963:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2606 00002000:00010000:2.0:1762166980.326967:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2704 (0->18446744073709551615) 00002000:00100000:2.0:1762166980.326970:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bcb384380 with x1847765450644352 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166980.326975:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bcb384380. 00002000:00010000:3.0:1762166980.326995:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa8f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166980.326998:0:23939:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa8f:0x0] updating lvb mtime from disk: 0 -> 1762166980 00002000:00010000:3.0:1762166980.327001:0:23939:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa8f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1762166980.327003:0:23939:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa8f:0x0] updating lvb ctime from disk: 0 -> 1762166980 00002000:00010000:3.0:1762166980.327006:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa8f:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166980.327031:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc576a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+26:2418:x1847765450644480:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 130us (247us total) trans 17179876614 rc 0/0 00000100:00100000:3.0:1762166980.327039:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2607 00002000:00010000:3.0:1762166980.327043:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2703 (0->18446744073709551615) 00002000:00100000:3.0:1762166980.327046:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc576a680 with x1847765450644480 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166980.327051:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc576a680. 00000100:00100000:0.0:1762166980.328170:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.328218:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450644608 00000100:00100000:2.0:1762166980.328223:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450644608 00000100:00100000:2.0:1762166980.328255:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19267 00000100:00100000:2.0:1762166980.328263:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4bdb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765450644608:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:2.0:1762166980.328329:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4bdb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765450644608:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 66us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166980.328340:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19267 00000100:00100000:0.0:1762166980.329521:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.329552:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450644736 00000100:00100000:3.0:1762166980.329557:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450644736 00000100:00100000:3.0:1762166980.329586:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19268 00000100:00100000:3.0:1762166980.329594:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4bd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+26:2418:x1847765450644736:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:3.0:1762166980.329641:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4bd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+26:2418:x1847765450644736:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 47us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166980.329646:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19268 00000100:00100000:1.0:1762166980.330900:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.330943:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450644864 00000100:00100000:3.0:1762166980.330950:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450644864 00000100:00100000:3.0:1762166980.330999:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2608 00000100:00100000:3.0:1762166980.331006:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc576ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+26:2417:x1847765450644864:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:3.0:1762166980.331032:0:23939:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945cf3cb4e00/0x2f180c4effbac445 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.331043:0:23939:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166980.331044:0:23939:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166980.331048:0:23939:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cf3cb4e00/0x2f180c4effbac445 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.331058:0:23939:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cf3cb4e00/0x2f180c4effbac445 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.331129:0:23939:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945cf3cb4e00/0x2f180c4effbac445 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.331135:0:23939:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945cf3cb4e00/0x2f180c4effbac445 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.331140:0:23939:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945cf3cb4e00/0x2f180c4effbac445 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.331144:0:23939:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cb4e00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166980.331148:0:23939:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945cf3cb4e00/0x2f180c4effbac445 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.331156:0:23939:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945cf3cb4e00/0x2f180c4effbac445 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.331169:0:23939:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945cf3cb4e00/0x2f180c4effbac445 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.331176:0:23939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cf3cb4e00/0x2f180c4effbac445 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166980.331233:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc576ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+26:2417:x1847765450644864:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 227us (341us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1762166980.331241:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2608 00000100:00100000:0.0:1762166980.332528:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.332563:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450644992 00000100:00100000:3.0:1762166980.332569:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450644992 00000100:00100000:3.0:1762166980.332609:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2609 00000100:00100000:3.0:1762166980.332619:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4bda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+32:2417:x1847765450644992:12345-192.168.204.38@tcp:4:lfs.0 00010000:00010000:3.0:1762166980.332643:0:23939:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945cf3cac200/0x2f180c4effbac44c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.332655:0:23939:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945cf3cb4200/0x2f180c4effbac437 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5c6 expref: 32 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.332662:0:23939:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166980.332664:0:23939:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166980.332666:0:23939:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cf3cac200/0x2f180c4effbac44c lrc: 4/0,1 mode: --/PW res: [0x280000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.332697:0:23939:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945cf3cb4200/0x2f180c4effbac437 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5c6 expref: 32 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.332710:0:23939:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945cf3cb4200/0x2f180c4effbac437 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5c6 expref: 32 pid: 8382 timeout: 699 lvb_type: 0 00000100:00100000:3.0:1762166980.332724:0:23939:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bc3800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0000_UUID:23939:1847765449765632:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166980.332788:0:23939:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccac7a240 going to sleep for 11 seconds 00000100:00100000:3.0:1762166980.333770:0:23939:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bc3800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0000_UUID:23939:1847765449765632:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166980.333802:0:23939:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945cf3cac200/0x2f180c4effbac44c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166980.333803:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.333863:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450645120 00000100:00100000:1.0:1762166980.333871:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450645120 00010000:00010000:1.0:1762166980.333890:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945cf3cb4200/0x2f180c4effbac437 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5c6 expref: 33 pid: 8382 timeout: 699 lvb_type: 0 00000100:00100000:1.0:1762166980.333924:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9741 00000100:00100000:1.0:1762166980.333932:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4bd9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+33:2418:x1847765450645120:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166980.333944:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166980.333966:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945cf3cb4200/0x2f180c4effbac437 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa90:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5c6 expref: 33 pid: 8382 timeout: 699 lvb_type: 0 00010000:00010000:1.0:1762166980.333981:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945cf3cb4200/0x2f180c4effbac437 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa90:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5c6 expref: 33 pid: 8382 timeout: 699 lvb_type: 0 00010000:00010000:1.0:1762166980.334000:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cf3cb4200/0x2f180c4effbac437 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa90:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5c6 expref: 33 pid: 8382 timeout: 699 lvb_type: 0 00010000:00010000:1.0:1762166980.334010:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166980.334011:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166980.334014:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945cf3cac200/0x2f180c4effbac44c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.334020:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cf3cac200/0x2f180c4effbac44c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.334040:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166980.334059:0:23939:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945cf3cac200/0x2f180c4effbac44c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.334072:0:23939:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cf3cac200/0x2f180c4effbac44c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166980.334075:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4bd9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+32:2418:x1847765450645120:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 143us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166980.334113:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9741 00000001:00080000:2.0:1762166980.335371:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843406 is committed 00000001:00080000:2.0:1762166980.335400:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843398 is committed 00002000:00010000:3.0:1762166980.335513:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa90:0x0] updating lvb size from disk: 0 -> 4096 00002000:00010000:3.0:1762166980.335518:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa90:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1762166980.335529:0:23939:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945cf3cac200/0x2f180c4effbac44c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.335545:0:23939:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945cf3cac200/0x2f180c4effbac44c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.335554:0:23939:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945cf3cac200/0x2f180c4effbac44c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.335561:0:23939:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cac200 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166980.335566:0:23939:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945cf3cac200/0x2f180c4effbac44c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.335576:0:23939:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945cf3cac200/0x2f180c4effbac44c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.335594:0:23939:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945cf3cac200/0x2f180c4effbac44c lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.335602:0:23939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cf3cac200/0x2f180c4effbac44c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23939 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166980.335670:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4bda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+16:2417:x1847765450644992:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 3052us (3142us total) trans 21474843406 rc 0/0 00000100:00100000:3.0:1762166980.335678:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2609 00000100:00100000:0.0:1762166980.337042:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.337085:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450645248 00000100:00100000:3.0:1762166980.337093:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450645248 00000100:00100000:3.0:1762166980.337131:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19269 00000100:00100000:3.0:1762166980.337137:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc70b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+26:2416:x1847765450645248:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:3.0:1762166980.337228:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc70b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+26:2416:x1847765450645248:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 90us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166980.337236:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19269 00000100:00100000:0.0:1762166980.338450:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.338540:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450645504 00000100:00100000:2.0:1762166980.338549:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450645504 00000100:00100000:2.0:1762166980.338593:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30742 00000100:00100000:2.0:1762166980.338602:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+610:61872:x1847765450645504:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:2.0:1762166980.338800:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194800/0x2f180c4effbac453 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166980.338817:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194800/0x2f180c4effbac453 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.338841:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194800/0x2f180c4effbac453 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000001:00080000:2.0:1762166980.338884:0:6494:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992388 00000004:00010000:2.0:1762166980.338907:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000b265a38a reply state 0000000057380e1e transno 4294992389 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194800/0x2f180c4effbac453 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.338919:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194800/0x2f180c4effbac453 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.338926:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x619:0x0].0x0 (ffff945cd1d8cb00) 00010000:00010000:2.0:1762166980.338929:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166980.338932:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166980.339005:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+613:61872:x1847765450645504:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 404us (558us total) trans 4294992389 rc 0/0 00000100:00100000:2.0:1762166980.339014:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30742 00000020:00080000:2.0:1762166980.339019:0:6494:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1762166980.339841:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.339878:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450645632 00000100:00100000:3.0:1762166980.339885:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450645632 00000100:00100000:3.0:1762166980.339922:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19270 00000100:00100000:3.0:1762166980.339932:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+16:61872:x1847765450645632:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166980.339948:0:8382:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166980.339963:0:8382:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cf3cada00/0x2f180c4effbac45a lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea5d4 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166980.339981:0:8382:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa90:0x0] initial LVB size: 4096, mtime: 0x690888c4, atime: 0x0, ctime: 0x690888c4, blocks: 0x8 00010000:00010000:3.0:1762166980.339997:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166980.339999:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166980.340005:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cf3cada00/0x2f180c4effbac45a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5d4 expref: 17 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.340017:0:8382:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945cf3cada00/0x2f180c4effbac45a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5d4 expref: 17 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.340026:0:8382:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cada00, rc 0) 00000100:00100000:3.0:1762166980.340063:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+17:61872:x1847765450645632:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 135us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166980.340069:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19270 00000100:00100000:0.0:1762166980.340832:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.340901:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450645760 00000100:00100000:3.0:1762166980.340906:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450645760 00002000:00010000:3.0:1762166980.340932:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2704 (247325->18446744073709551615) 00002000:00100000:3.0:1762166980.340937:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf783ad80 with x1847765450645760 ext(247325->18446744073709551615) 00002000:00010000:3.0:1762166980.340944:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945cf783ad80. 00000100:00100000:3.0:1762166980.340978:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2610 00000100:00100000:3.0:1762166980.340988:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450645760:12345-192.168.204.38@tcp:10:lfs.0 00000100:00100000:2.0:1762166980.341011:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.341040:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450645888 00000100:00100000:1.0:1762166980.341049:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450645888 00002000:00010000:1.0:1762166980.341082:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2703 (0->18446744073709551615) 00002000:00100000:1.0:1762166980.341086:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5764700 with x1847765450645888 ext(0->18446744073709551615) 00002000:00010000:1.0:1762166980.341097:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5764700. 00000100:00100000:1.0:1762166980.341132:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2611 00000100:00100000:1.0:1762166980.341142:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+26:2418:x1847765450645888:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:3.0:1762166980.341263:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa90:0x0] updating lvb size from disk: 4096 -> 247325 00002000:00010000:3.0:1762166980.341269:0:23939:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa90:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00002000:00010000:3.0:1762166980.341272:0:23939:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa90:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1762166980.341274:0:23939:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa90:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:3.0:1762166980.341277:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa90:0x0] updating lvb blocks from disk: 8 -> 8 00002000:00010000:1.0:1762166980.341280:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa8f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166980.341286:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa8f:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00002000:00010000:1.0:1762166980.341289:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa8f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1762166980.341291:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa8f:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:1.0:1762166980.341292:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa8f:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166980.341322:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450645760:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 333us (496us total) trans 21474843407 rc 0/0 00000100:00100000:1.0:1762166980.341330:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+27:2418:x1847765450645888:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 188us (320us total) trans 17179876615 rc 0/0 00000100:00100000:3.0:1762166980.341340:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2610 00002000:00010000:3.0:1762166980.341346:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2704 (247325->18446744073709551615) 00000100:00100000:1.0:1762166980.341352:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2611 00002000:00100000:3.0:1762166980.341356:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf783ad80 with x1847765450645760 ext(247325->18446744073709551615) 00002000:00010000:1.0:1762166980.341358:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2703 (0->18446744073709551615) 00002000:00100000:1.0:1762166980.341368:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5764700 with x1847765450645888 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166980.341372:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945cf783ad80. 00002000:00010000:1.0:1762166980.341382:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5764700. 00000100:00100000:0.0:1762166980.342790:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.342831:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450646016 00000100:00100000:1.0:1762166980.342837:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450646016 00000100:00100000:1.0:1762166980.342874:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2612 00000100:00100000:1.0:1762166980.342879:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf7838a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+27:2418:x1847765450646016:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:1.0:1762166980.342901:0:23942:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945cc355a800/0x2f180c4effbac461 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.342910:0:23942:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166980.342911:0:23942:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166980.342915:0:23942:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355a800/0x2f180c4effbac461 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [245760->249855] (req 245760->249855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.342924:0:23942:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cc355a800/0x2f180c4effbac461 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [245760->249855] (req 245760->249855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.343007:0:23942:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945cc355a800/0x2f180c4effbac461 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [245760->249855] (req 245760->249855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.343020:0:23942:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355a800/0x2f180c4effbac461 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [245760->249855] (req 245760->249855) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.343028:0:23942:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945cc355a800/0x2f180c4effbac461 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [245760->249855] (req 245760->249855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.343036:0:23942:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355a800 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166980.343040:0:23942:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc355a800/0x2f180c4effbac461 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [245760->249855] (req 245760->249855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.343048:0:23942:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc355a800/0x2f180c4effbac461 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [245760->249855] (req 245760->249855) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.343063:0:23942:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945cc355a800/0x2f180c4effbac461 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [245760->249855] (req 245760->249855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.343071:0:23942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cc355a800/0x2f180c4effbac461 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [245760->249855] (req 245760->249855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166980.343122:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf7838a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+27:2418:x1847765450646016:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 242us (333us total) trans 0 rc 1565/1565 00000100:00100000:1.0:1762166980.343130:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2612 00000100:00100000:0.0:1762166980.344323:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.344368:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450646144 00000100:00100000:1.0:1762166980.344375:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450646144 00000100:00100000:1.0:1762166980.344415:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2613 00000100:00100000:1.0:1762166980.344426:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450646144:12345-192.168.204.38@tcp:4:lfs.0 00010000:00010000:1.0:1762166980.344454:0:23942:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945cc355bc00/0x2f180c4effbac468 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.344469:0:23942:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945cf3cada00/0x2f180c4effbac45a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5d4 expref: 18 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.344506:0:23942:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166980.344508:0:23942:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166980.344512:0:23942:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cc355bc00/0x2f180c4effbac468 lrc: 4/0,1 mode: --/PW res: [0x280000400:0xa90:0x0].0x0 rrc: 3 type: EXT [245760->249855] (req 245760->249855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.344545:0:23942:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945cf3cada00/0x2f180c4effbac45a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5d4 expref: 18 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.344559:0:23942:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945cf3cada00/0x2f180c4effbac45a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5d4 expref: 18 pid: 8382 timeout: 699 lvb_type: 0 00000100:00100000:1.0:1762166980.344574:0:23942:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc576b800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_009:lustre-OST0000_UUID:23942:1847765449765760:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166980.344638:0:23942:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc4076900 going to sleep for 11 seconds 00000100:00100000:1.0:1762166980.345577:0:23942:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc576b800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_009:lustre-OST0000_UUID:23942:1847765449765760:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166980.345596:0:23942:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945cc355bc00/0x2f180c4effbac468 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa90:0x0].0x0 rrc: 3 type: EXT [245760->249855] (req 245760->249855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166980.345859:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.345899:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450646272 00000100:00100000:1.0:1762166980.345904:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450646272 00010000:00010000:1.0:1762166980.345921:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945cf3cada00/0x2f180c4effbac45a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5d4 expref: 19 pid: 8382 timeout: 699 lvb_type: 0 00000100:00100000:1.0:1762166980.345959:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9742 00000100:00100000:1.0:1762166980.345969:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450646272:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166980.345978:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166980.345992:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945cf3cada00/0x2f180c4effbac45a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa90:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5d4 expref: 19 pid: 8382 timeout: 699 lvb_type: 0 00010000:00010000:1.0:1762166980.346000:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945cf3cada00/0x2f180c4effbac45a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa90:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5d4 expref: 19 pid: 8382 timeout: 699 lvb_type: 0 00010000:00010000:1.0:1762166980.346014:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cf3cada00/0x2f180c4effbac45a lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa90:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5d4 expref: 19 pid: 8382 timeout: 699 lvb_type: 0 00010000:00010000:1.0:1762166980.346023:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166980.346024:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166980.346027:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945cc355bc00/0x2f180c4effbac468 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa90:0x0].0x0 rrc: 3 type: EXT [245760->249855] (req 245760->249855) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.346033:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cc355bc00/0x2f180c4effbac468 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa90:0x0].0x0 rrc: 3 type: EXT [245760->249855] (req 245760->249855) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.346052:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166980.346079:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450646272:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 114us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166980.346084:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9742 00010000:00010000:2.0:1762166980.346086:0:23942:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945cc355bc00/0x2f180c4effbac468 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa90:0x0].0x0 rrc: 2 type: EXT [245760->249855] (req 245760->249855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.346098:0:23942:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cc355bc00/0x2f180c4effbac468 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa90:0x0].0x0 rrc: 2 type: EXT [245760->249855] (req 245760->249855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00000001:00080000:3.0:1762166980.347331:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843408 is committed 00002000:00010000:2.0:1762166980.347425:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa90:0x0] updating lvb blocks from disk: 8 -> 16 00010000:00010000:2.0:1762166980.347436:0:23942:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945cc355bc00/0x2f180c4effbac468 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa90:0x0].0x0 rrc: 2 type: EXT [245760->249855] (req 245760->249855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.347446:0:23942:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945cc355bc00/0x2f180c4effbac468 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa90:0x0].0x0 rrc: 2 type: EXT [245760->249855] (req 245760->249855) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.347453:0:23942:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945cc355bc00/0x2f180c4effbac468 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa90:0x0].0x0 rrc: 2 type: EXT [245760->249855] (req 245760->249855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.347459:0:23942:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355bc00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166980.347463:0:23942:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945cc355bc00/0x2f180c4effbac468 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa90:0x0].0x0 rrc: 2 type: EXT [245760->249855] (req 245760->249855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.347471:0:23942:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945cc355bc00/0x2f180c4effbac468 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa90:0x0].0x0 rrc: 2 type: EXT [245760->249855] (req 245760->249855) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.347503:0:23942:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945cc355bc00/0x2f180c4effbac468 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa90:0x0].0x0 rrc: 2 type: EXT [245760->249855] (req 245760->249855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.347510:0:23942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cc355bc00/0x2f180c4effbac468 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa90:0x0].0x0 rrc: 2 type: EXT [245760->249855] (req 245760->249855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166980.347571:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+16:2419:x1847765450646144:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 3146us (3249us total) trans 21474843408 rc 0/0 00000100:00100000:2.0:1762166980.347581:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2613 00000100:00100000:0.0:1762166980.348668:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.348708:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450646400 00000100:00100000:2.0:1762166980.348716:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450646400 00000100:00100000:2.0:1762166980.348749:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30743 00000100:00100000:2.0:1762166980.348755:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+613:61872:x1847765450646400:12345-192.168.204.38@tcp:44:lfs.0 00000001:00080000:1.0:1762166980.349610:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294992389 is committed 00010000:00010000:3.0:1762166980.349647:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbac071 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00000020:00080000:1.0:1762166980.349657:0:7412:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff945bc4076600 refcount 2 committed 0 result 0 batchid 60 00010000:00010000:3.0:1762166980.349660:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbac071 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00000020:00080000:1.0:1762166980.349662:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cf1d0e700 obd lustre-OST0001-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff945bc4076000 00000020:00080000:1.0:1762166980.349669:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cf1d0ef00 obd lustre-OST0000-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff945bc4076780 00000020:00080000:1.0:1762166980.349673:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cf1d0ee00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff945bc4908e00 00000020:00080000:1.0:1762166980.349678:0:7412:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000400:0x2:0x0].59 00010000:00010000:3.0:1762166980.349685:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbac071 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166980.349692:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355b600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166980.349696:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbac071 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166980.349703:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbac071 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166980.349719:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00000004:00080000:1.0:1762166980.349719:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3287 committed 00000020:00080000:0.0:1762166980.349723:0:7435:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 57 00010000:00010000:3.0:1762166980.349725:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166980.349731:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbac071 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000004:00080000:1.0:1762166980.349732:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3284 committed 00010000:00010000:3.0:1762166980.349741:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbac071 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000020:00080000:1.0:1762166980.349745:0:7412:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff945d011c7300 refcount 2 committed 0 result 0 batchid 59 00000020:00080000:1.0:1762166980.349749:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945bc2d82700 obd lustre-OST0001-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff945cee171300 00000020:00080000:1.0:1762166980.349751:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945bc2d82800 obd lustre-OST0000-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff945bc4446b40 00000020:00080000:1.0:1762166980.349753:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945bc2d82c00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff945bc621b800 00000020:00080000:1.0:1762166980.349755:0:7412:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000400:0x2:0x0].58 00010000:00010000:3.0:1762166980.349760:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473600/0x2f180c4effbac08d lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166980.349768:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473600/0x2f180c4effbac08d lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166980.349774:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473600/0x2f180c4effbac08d lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166980.349779:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8473600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166980.349783:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473600/0x2f180c4effbac08d lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 00000020:00080000:1.0:1762166980.349787:0:7412:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0001: 58 batchid updated 00010000:00010000:3.0:1762166980.349790:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473600/0x2f180c4effbac08d lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166980.349803:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:3.0:1762166980.349807:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166980.349810:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473600/0x2f180c4effbac08d lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00010000:00010000:3.0:1762166980.349817:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8473600/0x2f180c4effbac08d lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 00000100:00100000:2.0:1762166980.349836:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5765f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449765888:0@lo:6:osp-syn-0-1.0 00000020:00080000:1.0:1762166980.349837:0:7435:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 60 committed batchid 58 00010000:00010000:3.0:1762166980.349841:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8400/0x2f180c4effbac1cf lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00000100:00100000:0.0:1762166980.349841:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449766016:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1762166980.349855:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8400/0x2f180c4effbac1cf lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.349861:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8400/0x2f180c4effbac1cf lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.349867:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc5db8400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166980.349871:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8400/0x2f180c4effbac1cf lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.349878:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8400/0x2f180c4effbac1cf lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00000100:00100000:2.0:1762166980.349886:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1762166980.349889:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:3.0:1762166980.349893:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166980.349897:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8400/0x2f180c4effbac1cf lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.349903:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8400/0x2f180c4effbac1cf lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00000100:00100000:0.0:1762166980.349915:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1762166980.349916:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9800/0x2f180c4effbac1e4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.349926:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9800/0x2f180c4effbac1e4 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.349932:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9800/0x2f180c4effbac1e4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.349938:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc5db9800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166980.349942:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9800/0x2f180c4effbac1e4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00000100:00100000:2.0:1762166980.349942:0:35248:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449765888 00000100:00100000:2.0:1762166980.349947:0:35248:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449765888 00000020:00080000:1.0:1762166980.349949:0:7435:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 58 cancel update log [0x240000400:0x2:0x0].57: rc = 0 00010000:00010000:3.0:1762166980.349955:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9800/0x2f180c4effbac1e4 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00000020:00080000:1.0:1762166980.349962:0:7435:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 58 00010000:00010000:3.0:1762166980.349966:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:3.0:1762166980.349971:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166980.349974:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9800/0x2f180c4effbac1e4 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.349980:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9800/0x2f180c4effbac1e4 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00000100:00100000:2.0:1762166980.349980:0:35248:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449766016 00000100:00100000:2.0:1762166980.349984:0:35248:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449766016 00000100:00100000:1.0:1762166980.349994:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19271 00010000:00010000:3.0:1762166980.349998:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9200/0x2f180c4effbac1f9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00000100:00100000:1.0:1762166980.350008:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5767100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1847765449765888:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1762166980.350009:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9200/0x2f180c4effbac1f9 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00000100:00100000:2.0:1762166980.350014:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19272 00010000:00010000:3.0:1762166980.350023:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9200/0x2f180c4effbac1f9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00000100:00100000:2.0:1762166980.350027:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3634:x1847765449766016:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:1.0:1762166980.350033:0:8382:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:2703 count 1 00010000:00010000:3.0:1762166980.350037:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc5db9200 already unused, calling callback (ffffffffc18e2310) 00002000:00080000:2.0:1762166980.350043:0:35248:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:2702 count 1 00010000:00010000:3.0:1762166980.350045:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9200/0x2f180c4effbac1f9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00000100:00100000:0.0:1762166980.350045:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+539:61872:x1847765450646400:12345-192.168.204.38@tcp:44:lfs.0 Request processed in 1285us (1373us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166980.350052:0:8382:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945cc355b800/0x2f180c4effbac46f lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166980.350062:0:35248:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa8e:0x0] initial LVB size: 200741, mtime: 0x690888c3, atime: 0x690888c3, ctime: 0x690888c4, blocks: 0x30 00010000:00010000:2.0:1762166980.350073:0:35248:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc7194200/0x2f180c4effbac476 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166980.350075:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30743 00010000:00010000:3.0:1762166980.350078:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9200/0x2f180c4effbac1f9 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.350084:0:8382:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdea00/0x2f180c4effbabf21 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3f8 expref: 15 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.350089:0:35248:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166980.350093:0:35248:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166980.350099:0:35248:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc7194200/0x2f180c4effbac476 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.350100:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:1.0:1762166980.350101:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166980.350105:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166980.350108:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166980.350111:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cc355b800/0x2f180c4effbac46f lrc: 4/0,1 mode: --/PW res: [0x280000400:0xa8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.350115:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9200/0x2f180c4effbac1f9 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.350117:0:35248:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc7194200/0x2f180c4effbac476 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.350134:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9200/0x2f180c4effbac1f9 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.350137:0:35248:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc7194200/0x2f180c4effbac476 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.350151:0:35248:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc7194200/0x2f180c4effbac476 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.350151:0:8382:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdea00/0x2f180c4effbabf21 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3f8 expref: 15 pid: 28434 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.350154:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbac20e lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.350173:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbac20e lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.350184:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbac20e lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.350184:0:8382:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdea00/0x2f180c4effbabf21 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3f8 expref: 15 pid: 28434 timeout: 699 lvb_type: 0 00010000:00010000:2.0:1762166980.350188:0:35248:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1762166980.350197:0:6483:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1762166980.350201:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355aa00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166980.350206:0:6483:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc7194200/0x2f180c4effbac476 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.350208:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbac20e lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00000100:00100000:1.0:1762166980.350212:0:8382:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc576b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8382:1847765449766144:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166980.350227:0:6483:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc7194200 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166980.350231:0:6483:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc7194200/0x2f180c4effbac476 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.350241:0:6483:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc7194200/0x2f180c4effbac476 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.350255:0:6483:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc7194200/0x2f180c4effbac476 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.350262:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc7194200/0x2f180c4effbac476 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.350275:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbac20e lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00000100:00100000:1.0:1762166980.350275:0:8382:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc4076900 going to sleep for 11 seconds 00010000:00010000:0.0:1762166980.350282:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166980.350286:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166980.350290:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:0.0:1762166980.350290:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166980.350295:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166980.350299:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbac20e lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.350305:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbac20e lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.350319:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbac2f5 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.350325:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbac2f5 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.350332:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbac2f5 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.350337:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355b000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166980.350341:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbac2f5 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.350347:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbac2f5 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.350355:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:3.0:1762166980.350358:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166980.350361:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbac2f5 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.350366:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbac2f5 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.350421:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbac30a lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.350427:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbac30a lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.350433:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbac30a lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.350438:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355b400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166980.350442:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbac30a lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.350448:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbac30a lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.350456:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:3.0:1762166980.350459:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166980.350462:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbac30a lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.350467:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbac30a lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.350503:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9a00/0x2f180c4effbac31f lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.350510:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9a00/0x2f180c4effbac31f lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.350516:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9a00/0x2f180c4effbac31f lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.350522:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc5db9a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166980.350526:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9a00/0x2f180c4effbac31f lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.350531:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9a00/0x2f180c4effbac31f lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.350542:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:3.0:1762166980.350545:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166980.350548:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9a00/0x2f180c4effbac31f lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.350557:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9a00/0x2f180c4effbac31f lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.350571:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8200/0x2f180c4effbac334 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.350577:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8200/0x2f180c4effbac334 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.350582:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8200/0x2f180c4effbac334 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.350588:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc5db8200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166980.350591:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8200/0x2f180c4effbac334 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.350597:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8200/0x2f180c4effbac334 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.350606:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00000100:00100000:2.0:1762166980.350607:0:35248:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+6:3634:x1847765449766016:12345-0@lo:6:osp-syn-1-1.0 Request processed in 581us (692us total) trans 17179876616 rc 0/0 00010000:00010000:3.0:1762166980.350612:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166980.350616:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8200/0x2f180c4effbac334 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00000100:00100000:2.0:1762166980.350621:0:35248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19272 00010000:00010000:3.0:1762166980.350627:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8200/0x2f180c4effbac334 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00000100:00100000:0.0:1762166980.350638:0:3634:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 17179876583 gen 2 00010000:00010000:3.0:1762166980.350642:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb600/0x2f180c4effbac349 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00000004:00080000:0.0:1762166980.350645:0:3634:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 17179876583 committed transno 17179876583 00010000:00010000:3.0:1762166980.350652:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb600/0x2f180c4effbac349 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00000100:00100000:0.0:1762166980.350669:0:3634:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff945bc55dce00 x1847765449766016/t17179876616(17179876616) o6->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 544/432 e 0 to 0 dl 1762166996 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1762166980.350680:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc55dce00/2, rc 0, transno 17179876616 00000100:00100000:0.0:1762166980.350698:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449766016:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1762166980.350733:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb600/0x2f180c4effbac349 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.350739:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bb600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166980.350741:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb600/0x2f180c4effbac349 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.350747:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb600/0x2f180c4effbac349 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.350754:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:3.0:1762166980.350757:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166980.350760:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb600/0x2f180c4effbac349 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.350765:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb600/0x2f180c4effbac349 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.350776:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbac35e lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.350781:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbac35e lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.350787:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbac35e lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.350792:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc5db8e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166980.350794:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbac35e lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.350800:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbac35e lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.350806:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:3.0:1762166980.350808:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166980.350811:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbac35e lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.350817:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbac35e lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.350838:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba000/0x2f180c4effbac429 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.350844:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba000/0x2f180c4effbac429 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.350909:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba000/0x2f180c4effbac429 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.350914:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93ba000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166980.350917:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba000/0x2f180c4effbac429 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.350923:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba000/0x2f180c4effbac429 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.350933:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x619:0x0].0x0 (ffff945cd1d8cb00) 00010000:00010000:3.0:1762166980.350936:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166980.350939:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba000/0x2f180c4effbac429 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.350945:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba000/0x2f180c4effbac429 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.350957:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194800/0x2f180c4effbac453 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.350963:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194800/0x2f180c4effbac453 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.350973:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194800/0x2f180c4effbac453 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.350978:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc7194800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166980.350981:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194800/0x2f180c4effbac453 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.350987:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194800/0x2f180c4effbac453 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.350996:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x619:0x0].0x0 (ffff945cd1d8cb00) 00010000:00010000:3.0:1762166980.350999:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166980.351002:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194800/0x2f180c4effbac453 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00000100:00100000:1.0:1762166980.351004:0:8382:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc576b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8382:1847765449766144:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166980.351014:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194800/0x2f180c4effbac453 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.351019:0:8382:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945cc355b800/0x2f180c4effbac46f lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166980.351228:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.351258:0:35248:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450646656 00000100:00100000:2.0:1762166980.351264:0:35248:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450646656 00000100:00100000:2.0:1762166980.351294:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19273 00000100:00100000:2.0:1762166980.351302:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+27:2417:x1847765450646656:12345-192.168.204.38@tcp:16:lfs.0 00000100:00100000:1.0:1762166980.351442:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.351506:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450646528 00000100:00100000:0.0:1762166980.351511:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450646528 00000100:00100000:1.0:1762166980.351528:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.351538:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19274 00000100:00100000:0.0:1762166980.351544:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc576b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+16:2417:x1847765450646528:12345-192.168.204.38@tcp:16:lfs.0 00000100:00100000:2.0:1762166980.351557:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450646784 00000100:00100000:2.0:1762166980.351563:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450646784 00010000:00010000:2.0:1762166980.351587:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdea00/0x2f180c4effbabf21 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3f8 expref: 17 pid: 28434 timeout: 699 lvb_type: 0 00000100:00100000:0.0:1762166980.351610:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc576b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+17:2417:x1847765450646528:12345-192.168.204.38@tcp:16:lfs.0 Request processed in 63us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166980.351616:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9743 00000100:00100000:0.0:1762166980.351623:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19274 00000100:00100000:2.0:1762166980.351627:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7c31c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450646784:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166980.351637:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166980.351643:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdea00/0x2f180c4effbabf21 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3f8 expref: 16 pid: 28434 timeout: 699 lvb_type: 0 00010000:00010000:2.0:1762166980.351661:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdea00/0x2f180c4effbabf21 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3f8 expref: 16 pid: 28434 timeout: 699 lvb_type: 0 00010000:00010000:2.0:1762166980.351679:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdea00/0x2f180c4effbabf21 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea3f8 expref: 16 pid: 28434 timeout: 699 lvb_type: 0 00010000:00010000:2.0:1762166980.351689:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166980.351691:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166980.351694:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945cc355b800/0x2f180c4effbac46f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.351701:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cc355b800/0x2f180c4effbac46f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.351725:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166980.351743:0:8382:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945cc355b800/0x2f180c4effbac46f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166980.351754:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7c31c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+15:2418:x1847765450646784:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 128us (226us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166980.351762:0:8382:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cc355b800/0x2f180c4effbac46f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166980.351766:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9743 00010000:00010000:1.0:1762166980.351777:0:8382:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945cc355b800/0x2f180c4effbac46f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.351791:0:8382:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945cc355b800/0x2f180c4effbac46f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.351813:0:8382:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1762166980.351915:0:10256:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1762166980.351922:0:10256:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945cc355b800/0x2f180c4effbac46f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.351931:0:10256:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355b800 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166980.351935:0:10256:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945cc355b800/0x2f180c4effbac46f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.351944:0:10256:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945cc355b800/0x2f180c4effbac46f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.351956:0:10256:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945cc355b800/0x2f180c4effbac46f lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.351964:0:10256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cc355b800/0x2f180c4effbac46f lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.352030:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166980.352032:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5767100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3633:x1847765449765888:12345-0@lo:6:osp-syn-0-1.0 Request processed in 2028us (2144us total) trans 21474843409 rc 0/0 00000100:00100000:1.0:1762166980.352042:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19271 00000100:00100000:3.0:1762166980.352044:0:3633:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 21474843398 gen 2 00000004:00080000:3.0:1762166980.352050:0:3633:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 21474843386 committed transno 21474843398 00010000:00010000:2.0:1762166980.352051:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166980.352055:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1762166980.352066:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc59d5500, transno 21474843387 00000004:00080000:3.0:1762166980.352148:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bcb385880, transno 21474843388 00000004:00080000:3.0:1762166980.352152:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc59d6a00, transno 21474843389 00000004:00080000:3.0:1762166980.352155:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc59d4a80, transno 21474843390 00000004:00080000:3.0:1762166980.352158:0:3633:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 21474843393 committed transno 21474843398 00000004:00080000:3.0:1762166980.352170:0:3633:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 21474843398 committed transno 21474843398 00000100:00100000:3.0:1762166980.352181:0:3633:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff945bc5765f80 x1847765449765888/t21474843409(21474843409) o6->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 544/432 e 0 to 0 dl 1762166996 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1762166980.352190:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc5765f80/2, rc 0, transno 21474843409 00000100:00100000:3.0:1762166980.352195:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5765f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449765888:0@lo:6:osp-syn-0-1.0 00000004:00080000:2.0:1762166980.352231:0:9158:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0001: 1 changes, 1 in progress, 0 in flight, 3 done 00000001:00080000:2.0:1762166980.352580:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876616 is committed 00000001:00080000:2.0:1762166980.352585:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876615 is committed 00000100:00100000:0.0:1762166980.352671:0:35248:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+18:2417:x1847765450646656:12345-192.168.204.38@tcp:16:lfs.0 Request processed in 1367us (1441us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166980.352680:0:35248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19273 00000100:00100000:1.0:1762166980.358073:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.358097:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.358118:0:35248:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450646912 00000100:00100000:1.0:1762166980.358127:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.358127:0:35248:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450646912 00000100:00100000:3.0:1762166980.358150:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450647040 00000100:00100000:3.0:1762166980.358157:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450647040 00000100:00100000:0.0:1762166980.358178:0:35248:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450647168 00000100:00100000:0.0:1762166980.358182:0:35248:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450647168 00000100:00100000:2.0:1762166980.358224:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19275 00000100:00100000:1.0:1762166980.358240:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19276 00000100:00100000:2.0:1762166980.358254:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5768e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+19:2416:x1847765450646912:12345-192.168.204.38@tcp:1:lfs.0 00000100:00100000:0.0:1762166980.358254:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19277 00000100:00100000:1.0:1762166980.358256:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5769180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+15:2417:x1847765450647040:12345-192.168.204.38@tcp:1:lfs.0 00000100:00100000:0.0:1762166980.358280:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5769c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+19:2416:x1847765450647168:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:0.0:1762166980.358315:0:35248:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde200/0x2f180c4effbac47d lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.358322:0:28874:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc7194800/0x2f180c4effbac484 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.358324:0:9168:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945cc355ba00/0x2f180c4effbac48b lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.358330:0:35248:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166980.358338:0:35248:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166980.358350:0:35248:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde200/0x2f180c4effbac47d lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.358368:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166980.358370:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166980.358375:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166980.358376:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166980.358382:0:35248:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde200/0x2f180c4effbac47d lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.358383:0:28874:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc7194800/0x2f180c4effbac484 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.358385:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cc355ba00/0x2f180c4effbac48b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.358433:0:28874:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc7194800/0x2f180c4effbac484 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.358435:0:9168:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cc355ba00/0x2f180c4effbac48b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.358451:0:35248:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde200/0x2f180c4effbac47d lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.358511:0:35248:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde200/0x2f180c4effbac47d lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.358517:0:35248:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde200/0x2f180c4effbac47d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.358522:0:35248:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bde200 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166980.358527:0:35248:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde200/0x2f180c4effbac47d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.358532:0:35248:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde200/0x2f180c4effbac47d lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.358534:0:28874:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc7194800/0x2f180c4effbac484 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.358535:0:9168:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945cc355ba00/0x2f180c4effbac48b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.358568:0:35248:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde200/0x2f180c4effbac47d lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.358584:0:28874:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc7194800/0x2f180c4effbac484 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.358615:0:35248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde200/0x2f180c4effbac47d lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.358631:0:28874:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc7194800/0x2f180c4effbac484 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.358633:0:9168:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945cc355ba00/0x2f180c4effbac48b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.358651:0:28874:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc7194800 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166980.358657:0:28874:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc7194800/0x2f180c4effbac484 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.358662:0:9168:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945cc355ba00/0x2f180c4effbac48b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.358665:0:28874:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc7194800/0x2f180c4effbac484 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166980.358698:0:35248:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5769c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+19:2416:x1847765450647168:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 419us (563us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166980.358701:0:9168:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355ba00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166980.358706:0:28874:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc7194800/0x2f180c4effbac484 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.358707:0:9168:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945cc355ba00/0x2f180c4effbac48b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166980.358707:0:35248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19277 00010000:00010000:2.0:1762166980.358735:0:28874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc7194800/0x2f180c4effbac484 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.358744:0:9168:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945cc355ba00/0x2f180c4effbac48b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.358761:0:9168:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945cc355ba00/0x2f180c4effbac48b lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.358768:0:9168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cc355ba00/0x2f180c4effbac48b lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166980.358807:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5768e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+18:2416:x1847765450646912:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 566us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166980.358817:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5769180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+15:2417:x1847765450647040:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 565us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166980.358821:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19275 00000100:00100000:1.0:1762166980.358845:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19276 00000100:00100000:1.0:1762166980.359812:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.359857:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450647424 00000100:00100000:0.0:1762166980.359864:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450647424 00000100:00100000:0.0:1762166980.359906:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30744 00000100:00100000:0.0:1762166980.359917:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5768380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+529:61872:x1847765450647424:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:0.0:1762166980.359980:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbac492 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166980.359991:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbac492 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.360000:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbac492 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00010000:0.0:1762166980.360122:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000e2feedc2 reply state 00000000cebbfbbd transno 4294992390 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbac492 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.360132:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbac492 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.360137:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x619:0x0].0x0 (ffff945cd1d8cb00) 00010000:00010000:0.0:1762166980.360139:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762166980.360141:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166980.360214:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5768380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+531:61872:x1847765450647424:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 300us (401us total) trans 4294992390 rc 0/0 00000100:00100000:0.0:1762166980.360221:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30744 00000100:00100000:3.0:1762166980.361074:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.361113:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450647552 00000100:00100000:1.0:1762166980.361118:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450647552 00000100:00100000:1.0:1762166980.361149:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19278 00000100:00100000:1.0:1762166980.361155:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+15:2419:x1847765450647552:12345-192.168.204.38@tcp:2:lfs.0 00000100:00100000:3.0:1762166980.361202:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.361231:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450647680 00000100:00100000:2.0:1762166980.361240:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450647680 00000100:00100000:1.0:1762166980.361291:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+16:2419:x1847765450647552:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 134us (215us total) trans 21474843410 rc 0/0 00000100:00100000:2.0:1762166980.361296:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19279 00000100:00100000:1.0:1762166980.361310:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19278 00000100:00100000:2.0:1762166980.361319:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450647680:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:2.0:1762166980.361461:0:28874:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa8f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166980.361468:0:28874:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa8f:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00002000:00010000:2.0:1762166980.361471:0:28874:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa8f:0x0] updating lvb atime from disk: 0 -> 1762166980 00002000:00010000:2.0:1762166980.361474:0:28874:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa8f:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:2.0:1762166980.361505:0:28874:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa8f:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1762166980.361548:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450647680:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 239us (345us total) trans 17179876617 rc 0/0 00000100:00100000:2.0:1762166980.361557:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19279 00000100:00100000:3.0:1762166980.362211:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.362267:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450647936 00000100:00100000:0.0:1762166980.362275:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450647936 00000100:00100000:0.0:1762166980.362319:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30745 00000100:00100000:0.0:1762166980.362329:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+531:61872:x1847765450647936:12345-192.168.204.38@tcp:55:lfs.0 00010000:00010000:0.0:1762166980.362383:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbac499 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166980.362399:0:6494:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847f600/0x2f180c4effbac422 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x619:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5b8 expref: 531 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.362408:0:6494:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbac499 lrc: 4/0,1 mode: --/PW res: [0x240000404:0x619:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.362441:0:6494:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847f600/0x2f180c4effbac422 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x619:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5b8 expref: 531 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.362454:0:6494:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847f600/0x2f180c4effbac422 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x619:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5b8 expref: 531 pid: 6494 timeout: 699 lvb_type: 0 00000100:00100000:0.0:1762166980.362469:0:6494:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55ddc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765449766272:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166980.362631:0:6494:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1fe26c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166980.363383:0:6494:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55ddc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765449766272:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166980.363399:0:6494:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbac499 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x619:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000100:00100000:3.0:1762166980.363612:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.363646:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450648064 00000100:00100000:2.0:1762166980.363652:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450648064 00010000:00010000:2.0:1762166980.363676:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847f600/0x2f180c4effbac422 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x619:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5b8 expref: 532 pid: 6494 timeout: 699 lvb_type: 0 00000100:00100000:2.0:1762166980.363703:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9744 00000100:00100000:2.0:1762166980.363710:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+532:2419:x1847765450648064:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166980.363720:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166980.363724:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847f600/0x2f180c4effbac422 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x619:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5b8 expref: 532 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:2.0:1762166980.363733:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847f600/0x2f180c4effbac422 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x619:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5b8 expref: 532 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:2.0:1762166980.363746:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847f600/0x2f180c4effbac422 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x619:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5b8 expref: 532 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:2.0:1762166980.363757:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x619:0x0].0x0 (ffff945cd1d8cb00) 00010000:00010000:2.0:1762166980.363760:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbac499 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x619:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.363765:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbac499 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x619:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.363769:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbac499 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x619:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.363782:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166980.363799:0:6494:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbac499 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x619:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.363808:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbac499 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x619:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000100:00100000:2.0:1762166980.363810:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+531:2419:x1847765450648064:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 99us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166980.363841:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9744 00010000:00010000:1.0:1762166980.363860:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbac499 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x619:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.363868:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbac499 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x619:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.363872:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbac499 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x619:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.363877:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdee00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166980.363880:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbac499 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x619:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.363885:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbac499 lrc: 4/0,0 mode: PW/PW res: [0x240000404:0x619:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.363892:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x619:0x0].0x0 (ffff945cd1d8cb00) 00010000:00010000:1.0:1762166980.363895:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1762166980.363898:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbac499 lrc: 2/0,0 mode: --/PW res: [0x240000404:0x619:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.363902:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbac499 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x619:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00000100:00100000:1.0:1762166980.363943:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+530:61872:x1847765450647936:12345-192.168.204.38@tcp:55:lfs.0 Request processed in 1616us (1733us total) trans 0 rc -22/-22 00000100:00100000:1.0:1762166980.363951:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30745 00000100:00100000:3.0:1762166980.364660:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.364698:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450648320 00000100:00100000:1.0:1762166980.364704:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450648320 00000100:00100000:1.0:1762166980.364746:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30746 00000100:00100000:1.0:1762166980.364760:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+530:61872:x1847765450648320:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:1.0:1762166980.364797:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166980.364811:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194e00/0x2f180c4effbac36c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea56b expref: 530 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.364834:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:1.0:1762166980.364838:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166980.364874:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbac4a0 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166980.364884:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbac4a0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.364893:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbac4a0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00010000:1.0:1762166980.364995:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000000eb320ea reply state 00000000c9496523 transno 4294992391 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbac4a0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.365011:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbac4a0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.365016:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:1.0:1762166980.365019:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166980.365021:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166980.365085:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+531:61872:x1847765450648320:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 328us (425us total) trans 4294992391 rc 0/0 00000100:00100000:1.0:1762166980.365093:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30746 00000100:00100000:3.0:1762166980.365838:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.365874:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450648448 00000100:00100000:2.0:1762166980.365878:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450648448 00000100:00100000:3.0:1762166980.365890:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.365919:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.365922:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450648704 00000100:00100000:2.0:1762166980.365926:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450648704 00000100:00100000:1.0:1762166980.365937:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450648576 00000100:00100000:1.0:1762166980.365941:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450648576 00000100:00100000:2.0:1762166980.365957:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19280 00000100:00100000:3.0:1762166980.365967:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19281 00000100:00100000:2.0:1762166980.365968:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc3553480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450648448:12345-192.168.204.38@tcp:2:lfs.0 00000100:00100000:0.0:1762166980.365980:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19282 00000100:00100000:3.0:1762166980.365984:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc3550700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450648704:12345-192.168.204.38@tcp:2:lfs.0 00000100:00100000:0.0:1762166980.365996:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc3551c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+16:2418:x1847765450648576:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:2.0:1762166980.366071:0:28874:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 247325 -> 247325 00002000:00010000:2.0:1762166980.366076:0:28874:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00002000:00010000:2.0:1762166980.366079:0:28874:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00002000:00010000:3.0:1762166980.366081:0:9165:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166980.366083:0:28874:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:3.0:1762166980.366086:0:9165:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00002000:00010000:2.0:1762166980.366088:0:28874:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 32 -> 32 00002000:00010000:0.0:1762166980.366090:0:35248:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166980.366091:0:9165:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166979 -> 1762166980 00002000:00010000:0.0:1762166980.366097:0:35248:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00002000:00010000:3.0:1762166980.366098:0:9165:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:0.0:1762166980.366102:0:35248:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166979 -> 1762166980 00002000:00010000:3.0:1762166980.366104:0:9165:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:0.0:1762166980.366107:0:35248:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:0.0:1762166980.366110:0:35248:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00000100:00100000:2.0:1762166980.366126:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc3553480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765450648448:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 161us (298us total) trans 17179876618 rc 0/0 00000100:00100000:2.0:1762166980.366134:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19280 00000100:00100000:3.0:1762166980.366140:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc3550700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765450648704:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 159us (246us total) trans 17179876619 rc 0/0 00000100:00100000:3.0:1762166980.366153:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19281 00000100:00100000:0.0:1762166980.366153:0:35248:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc3551c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450648576:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 152us (222us total) trans 21474843411 rc 0/0 00000100:00100000:0.0:1762166980.366167:0:35248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19282 00000100:00100000:3.0:1762166980.366950:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.366992:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450648960 00000100:00100000:0.0:1762166980.366998:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450648960 00000100:00100000:0.0:1762166980.367033:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11946 00000100:00100000:0.0:1762166980.367041:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc3553100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+531:61872:x1847765450648960:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:0.0:1762166980.367092:0:19593:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x240000404:0x5eb:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effbac3e3 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea59c expref: 531 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.367119:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac4a7 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166980.367129:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbac2b6 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea533 expref: 531 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.367136:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbac2ee lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea541 expref: 531 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.367142:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac4a7 lrc: 5/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166980.367168:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbac2ee lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea541 expref: 531 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.367179:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbac2ee lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea541 expref: 531 pid: 6494 timeout: 699 lvb_type: 0 00000100:00100000:0.0:1762166980.367191:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55df480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449766400:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166980.367258:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbac2b6 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea533 expref: 531 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.367268:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbac2b6 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea533 expref: 531 pid: 6494 timeout: 699 lvb_type: 0 00000100:00100000:0.0:1762166980.367276:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55de680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449766528:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166980.367304:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1fe2180 going to sleep for 11 seconds 00000100:00100000:0.0:1762166980.368007:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55df480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449766400:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166980.368189:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55de680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449766528:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166980.368201:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:0.0:1762166980.368211:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac4a7 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:2.0:1762166980.368273:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450649088 00000100:00100000:2.0:1762166980.368278:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450649088 00010000:00010000:2.0:1762166980.368300:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbac2ee lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea541 expref: 532 pid: 6494 timeout: 699 lvb_type: 0 00000100:00100000:2.0:1762166980.368325:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9745 00000100:00100000:2.0:1762166980.368336:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc3553b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+532:2419:x1847765450649088:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166980.368347:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166980.368353:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbac2ee lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea541 expref: 532 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:2.0:1762166980.368364:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbac2ee lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea541 expref: 532 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:2.0:1762166980.368380:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbac2ee lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea541 expref: 532 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:2.0:1762166980.368394:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166980.368399:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac4a7 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166980.368406:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac4a7 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:1.0:1762166980.368411:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:2.0:1762166980.368417:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166980.368451:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450649216 00000100:00100000:3.0:1762166980.368457:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450649216 00000100:00100000:2.0:1762166980.368457:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc3553b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+531:2419:x1847765450649088:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 123us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166980.368466:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9745 00010000:00010000:3.0:1762166980.368504:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbac2b6 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea533 expref: 531 pid: 6494 timeout: 699 lvb_type: 0 00000100:00100000:3.0:1762166980.368540:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9746 00000100:00100000:3.0:1762166980.368551:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc576b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+531:2418:x1847765450649216:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166980.368561:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166980.368566:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbac2b6 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea533 expref: 531 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:3.0:1762166980.368576:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbac2b6 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea533 expref: 531 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:3.0:1762166980.368590:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbac2b6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea533 expref: 531 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:3.0:1762166980.368606:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:3.0:1762166980.368610:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac4a7 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166980.368658:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac4a7 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166980.368665:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac4a7 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166980.368689:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166980.368714:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac4a7 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:3.0:1762166980.368727:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc576b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+530:2418:x1847765450649216:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 176us (315us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166980.368727:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac4a7 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:3.0:1762166980.368751:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9746 00010000:00010000:0.0:1762166980.368751:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbac4ae lrc: 3/0,1 mode: --/EX res: [0x240000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166980.368766:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbac430 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5bf expref: 529 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.368775:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbac4ae lrc: 4/0,1 mode: --/EX res: [0x240000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166980.368801:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbac430 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5bf expref: 529 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.368810:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbac430 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5bf expref: 529 pid: 6494 timeout: 699 lvb_type: 0 00000100:00100000:0.0:1762166980.368821:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55de680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449766656:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166980.368880:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1fe2180 going to sleep for 11 seconds 00000100:00100000:1.0:1762166980.369601:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55de680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449766656:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166980.369614:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbac4ae lrc: 3/0,1 mode: --/EX res: [0x240000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:1.0:1762166980.369720:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.369748:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450649344 00000100:00100000:3.0:1762166980.369753:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450649344 00010000:00010000:3.0:1762166980.369799:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbac430 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5bf expref: 530 pid: 6494 timeout: 699 lvb_type: 0 00000100:00100000:3.0:1762166980.369838:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9747 00000100:00100000:3.0:1762166980.369846:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5768a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+530:2419:x1847765450649344:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166980.369859:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166980.369865:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbac430 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5bf expref: 530 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:3.0:1762166980.369876:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbac430 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5bf expref: 530 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:3.0:1762166980.369895:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbac430 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x619:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5bf expref: 530 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:3.0:1762166980.369907:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x619:0x0].0x0 (ffff945cd1d8cb00) 00010000:00010000:3.0:1762166980.369912:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbac4ae lrc: 3/0,1 mode: --/EX res: [0x240000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166980.369919:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbac4ae lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166980.369926:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbac4ae lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166980.369945:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166980.369964:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbac4ae lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:3.0:1762166980.369973:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5768a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+529:2419:x1847765450649344:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 127us (253us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166980.369975:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbac4ae lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:3.0:1762166980.369982:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9747 00000100:00100000:1.0:1762166980.370245:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc576a300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449766784:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166980.370275:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166980.370294:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc40760c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166980.370315:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449766784 00000100:00100000:3.0:1762166980.370321:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449766784 00000100:00100000:3.0:1762166980.370366:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1443 00000100:00100000:3.0:1762166980.370377:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc576b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449766784:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166980.370454:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc576b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449766784:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 78us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166980.370462:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1443 00000100:00100000:1.0:1762166980.370499:0:19593:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 17179876616 gen 2 00000004:00080000:1.0:1762166980.370505:0:19593:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc55dce00, transno 17179876616 00000100:00100000:1.0:1762166980.370521:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc576a300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449766784:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166980.370562:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc576a300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449766912:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166980.370588:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166980.370608:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc40760c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166980.370611:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449766912 00000100:00100000:3.0:1762166980.370617:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449766912 00000100:00100000:3.0:1762166980.370647:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1444 00000100:00100000:3.0:1762166980.370657:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5769500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:19593:x1847765449766912:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166980.370722:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5769500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:19593:x1847765449766912:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 68us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166980.370729:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1444 00000100:00100000:1.0:1762166980.370753:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc576a300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449766912:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166980.370798:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc576a300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449767040:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166980.370819:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166980.370844:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc4076c00 going to sleep for 11 seconds 00000100:00100000:3.0:1762166980.370849:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449767040 00000100:00100000:3.0:1762166980.370854:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449767040 00000100:00100000:3.0:1762166980.370884:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1445 00000100:00100000:3.0:1762166980.370892:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5768700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:19593:x1847765449767040:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166980.370944:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5768700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:19593:x1847765449767040:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 52us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166980.370950:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc576a300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449767040:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166980.370953:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1445 00000100:00100000:1.0:1762166980.370981:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc576a300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449767168:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166980.370995:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166980.371008:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc4076000 going to sleep for 11 seconds 00000100:00100000:3.0:1762166980.371016:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449767168 00000100:00100000:3.0:1762166980.371022:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449767168 00000100:00100000:3.0:1762166980.371047:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1446 00000100:00100000:3.0:1762166980.371056:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5769f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449767168:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166980.371102:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5769f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449767168:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 48us (104us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166980.371109:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1446 00000100:00100000:1.0:1762166980.371118:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc576a300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449767168:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166980.371147:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc576a300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449767296:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166980.371163:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166980.371177:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc350f000 going to sleep for 11 seconds 00000100:00100000:3.0:1762166980.371186:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449767296 00000100:00100000:3.0:1762166980.371192:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449767296 00000100:00100000:3.0:1762166980.371218:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1447 00000100:00100000:3.0:1762166980.371225:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc576bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:19593:x1847765449767296:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166980.371295:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc576bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:19593:x1847765449767296:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 70us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166980.371302:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1447 00000100:00100000:1.0:1762166980.371331:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc576a300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449767296:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166980.371362:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc576a300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449767424:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166980.371378:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166980.371392:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc350fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1762166980.371401:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449767424 00000100:00100000:3.0:1762166980.371405:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449767424 00000100:00100000:3.0:1762166980.371429:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1448 00000100:00100000:3.0:1762166980.371436:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4532a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449767424:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166980.371537:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc576a300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449767424:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166980.371539:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4532a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449767424:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 102us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166980.371549:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1448 00000040:00080000:1.0:1762166980.371634:0:19593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x2:0x0].60, 456 off70872 00000001:00080000:1.0:1762166980.371639:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992392 00000100:00100000:1.0:1762166980.371666:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4531180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449767552:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166980.371686:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166980.371705:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc350fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1762166980.371723:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449767552 00000100:00100000:2.0:1762166980.371729:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449767552 00000100:00100000:2.0:1762166980.371760:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1449 00000100:00100000:2.0:1762166980.371768:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4530700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449767552:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762166980.371877:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4530700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:19593:x1847765449767552:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 110us (189us total) trans 17179876620 rc 0/0 00000100:00100000:2.0:1762166980.371885:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1449 00000100:00100000:1.0:1762166980.371897:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4531180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449767552:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166980.371921:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4532d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449767680:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166980.371940:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166980.371955:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc350fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1762166980.371969:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449767680 00000100:00100000:2.0:1762166980.371974:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449767680 00000100:00100000:2.0:1762166980.371999:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1450 00000100:00100000:2.0:1762166980.372008:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4531f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:19593:x1847765449767680:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762166980.372098:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4531f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:19593:x1847765449767680:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 90us (153us total) trans 21474843412 rc 0/0 00000100:00100000:1.0:1762166980.372105:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4532d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449767680:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762166980.372107:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1450 00000001:00080000:1.0:1762166980.372149:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992393 00010000:00010000:1.0:1762166980.372164:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbac4ae lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166980.372171:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbac4ae lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166980.372175:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbac4ae lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166980.372178:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdf200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166980.372181:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbac4ae lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166980.372186:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbac4ae lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166980.372194:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x619:0x0].0x0 (ffff945cd1d8cb00) 00010000:00010000:1.0:1762166980.372196:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1762166980.372198:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbac4ae lrc: 2/0,0 mode: --/EX res: [0x240000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166980.372202:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbac4ae lrc: 0/0,0 mode: --/EX res: [0x240000404:0x619:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166980.372213:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac4a7 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166980.372219:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac4a7 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166980.372224:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac4a7 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166980.372229:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdf600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166980.372232:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac4a7 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166980.372237:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac4a7 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166980.372244:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:1.0:1762166980.372247:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1762166980.372250:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac4a7 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166980.372256:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac4a7 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166980.372265:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:1.0:1762166980.372267:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762166980.372270:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8472400/0x2f180c4effbac3e3 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea59c expref: 531 pid: 6494 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166980.372325:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc3553100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+530:61872:x1847765450648960:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 5286us (5378us total) trans 4294992394 rc 0/0 00000100:00100000:1.0:1762166980.372335:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11946 00000020:00080000:1.0:1762166980.372338:0:19593:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1762166980.373142:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.373183:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450649472 00000100:00100000:2.0:1762166980.373189:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450649472 00000100:00100000:2.0:1762166980.373234:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30747 00000100:00100000:2.0:1762166980.373246:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4531880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+530:61872:x1847765450649472:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166980.373260:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166980.373274:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194800/0x2f180c4effbac4b5 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea5db expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.373305:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194800/0x2f180c4effbac4b5 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5db expref: 531 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.373318:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194800/0x2f180c4effbac4b5 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5db expref: 531 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.373330:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166980.373332:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166980.373333:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc7194800, rc 0) 00000100:00100000:2.0:1762166980.373356:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4531880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+531:61872:x1847765450649472:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 114us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166980.373361:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30747 00000100:00100000:0.0:1762166980.374467:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.374546:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450649728 00000100:00100000:1.0:1762166980.374554:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450649728 00000100:00100000:1.0:1762166980.374600:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11947 00000100:00100000:1.0:1762166980.374608:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+531:61872:x1847765450649728:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:1.0:1762166980.374739:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+532:61872:x1847765450649728:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 132us (288us total) trans 4294992395 rc 0/0 00000100:00100000:1.0:1762166980.374747:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11947 00000100:00100000:0.0:1762166980.375610:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.375662:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450649984 00000100:00100000:1.0:1762166980.375670:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450649984 00000100:00100000:1.0:1762166980.375703:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11948 00000100:00100000:1.0:1762166980.375711:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+532:61872:x1847765450649984:12345-192.168.204.38@tcp:35:lfs.0 00000004:00080000:1.0:1762166980.375834:0:19593:0:(mdd_object.c:3965:mdd_close()) Object [0x240000404:0x619:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:1.0:1762166980.375894:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbac4bc lrc: 3/0,1 mode: --/PW res: [0x240000404:0x619:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166980.375905:0:19593:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbac4bc lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x619:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166980.375912:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbac4bc lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x619:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166980.375917:0:19593:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbac4bc lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x619:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166980.375922:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbac4bc lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x619:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166980.375926:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbac4bc lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x619:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166980.375943:0:19593:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1762166980.375971:0:10257:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1762166980.375979:0:10257:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbac4bc lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x619:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166980.375987:0:10257:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355ba00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166980.375991:0:10257:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbac4bc lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x619:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166980.375997:0:10257:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbac4bc lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x619:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166980.376008:0:10257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x619:0x0].0x0 (ffff945cd1d8cb00) 00010000:00010000:3.0:1762166980.376010:0:10257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1762166980.376013:0:10257:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbac4bc lrc: 1/0,0 mode: --/PW res: [0x240000404:0x619:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166980.376017:0:10257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ba00/0x2f180c4effbac4bc lrc: 0/0,0 mode: --/PW res: [0x240000404:0x619:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166980.376026:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166980.376028:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166980.376030:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166980.376049:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+533:61872:x1847765450649984:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 339us (443us total) trans 4294992396 rc 0/0 00000100:00100000:1.0:1762166980.376056:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11948 00000100:00100000:3.0:1762166980.384639:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.384718:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450650112 00000100:00100000:2.0:1762166980.384731:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450650112 00000100:00100000:2.0:1762166980.384798:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30748 00000100:00100000:2.0:1762166980.384812:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc3552a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+533:61873:x1847765450650112:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166980.384856:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166980.384884:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194e00/0x2f180c4effbac4c3 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea5e2 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.384989:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194200/0x2f180c4effbac4ca lrc: 3/1,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166980.385005:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194200/0x2f180c4effbac4ca lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.385017:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194200/0x2f180c4effbac4ca lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.385031:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847f600/0x2f180c4effbac4d1 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166980.385038:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847f600/0x2f180c4effbac4d1 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.385044:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847f600/0x2f180c4effbac4d1 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.385137:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fb800/0x2f180c4effbac4d8 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166980.385146:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fb800/0x2f180c4effbac4d8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.385153:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fb800/0x2f180c4effbac4d8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:2.0:1762166980.385200:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 247325 00000004:00200000:2.0:1762166980.385205:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166980.385225:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fb800/0x2f180c4effbac4d8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.385238:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fb800/0x2f180c4effbac4d8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.385248:0:6494:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194200/0x2f180c4effbac4ca lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.385255:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194200/0x2f180c4effbac4ca lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.385261:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194200/0x2f180c4effbac4ca lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.385272:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194200/0x2f180c4effbac4ca lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.385278:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc7194200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166980.385282:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194200/0x2f180c4effbac4ca lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.385289:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194200/0x2f180c4effbac4ca lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.385302:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0x0 (ffff945bc809b100) 00010000:00010000:2.0:1762166980.385305:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166980.385310:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194200/0x2f180c4effbac4ca lrc: 3/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.385316:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194200/0x2f180c4effbac4ca lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.385333:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847f600/0x2f180c4effbac4d1 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.385339:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847f600/0x2f180c4effbac4d1 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.385343:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847f600/0x2f180c4effbac4d1 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.385348:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc847f600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166980.385350:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847f600/0x2f180c4effbac4d1 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.385355:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847f600/0x2f180c4effbac4d1 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.385366:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0xdd396665 (ffff945bc809bd00) 00010000:00010000:2.0:1762166980.385368:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166980.385371:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847f600/0x2f180c4effbac4d1 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.385376:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847f600/0x2f180c4effbac4d1 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.385408:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194e00/0x2f180c4effbac4c3 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5e2 expref: 535 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.385425:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fb800/0x2f180c4effbac4d8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5e2 expref: 534 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.385430:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166980.385432:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166980.385434:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcc8fb800, rc 0) 00000100:00100000:2.0:1762166980.385522:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc3552a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+534:61873:x1847765450650112:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 714us (898us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166980.385528:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30748 00000100:00100000:0.0:1762166980.387191:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.387241:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450650368 00000100:00100000:2.0:1762166980.387247:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450650368 00000100:00100000:2.0:1762166980.387285:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30749 00000100:00100000:2.0:1762166980.387297:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+534:61873:x1847765450650368:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166980.387312:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166980.387324:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa200/0x2f180c4effbac4df lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea5e9 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.387408:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fac00/0x2f180c4effbac4e6 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166980.387417:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fac00/0x2f180c4effbac4e6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.387426:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fac00/0x2f180c4effbac4e6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:2.0:1762166980.387435:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 247325 00010000:00010000:2.0:1762166980.387574:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa200/0x2f180c4effbac4df lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5e9 expref: 537 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.387593:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fac00/0x2f180c4effbac4e6 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5e9 expref: 536 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.387600:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166980.387603:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1762166980.387606:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcc8fac00, rc 0) 00000100:00100000:2.0:1762166980.387649:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+536:61873:x1847765450650368:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 357us (463us total) trans 4294992397 rc 0/0 00000100:00100000:2.0:1762166980.387656:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30749 00000100:00100000:1.0:1762166980.388892:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.388932:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450650624 00000100:00100000:2.0:1762166980.388937:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450650624 00000100:00100000:2.0:1762166980.388971:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30750 00000100:00100000:2.0:1762166980.388979:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4533100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+536:61873:x1847765450650624:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166980.388992:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166980.389002:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa000/0x2f180c4effbac4f4 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea5f0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.389052:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fb600/0x2f180c4effbac4fb lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166980.389062:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fb600/0x2f180c4effbac4fb lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.389069:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fb600/0x2f180c4effbac4fb lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:2.0:1762166980.389077:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 247325 00010000:00010000:2.0:1762166980.389126:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa000/0x2f180c4effbac4f4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5f0 expref: 539 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.389139:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fb600/0x2f180c4effbac4fb lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5f0 expref: 538 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.389146:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166980.389148:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166980.389151:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcc8fb600, rc 0) 00000100:00100000:2.0:1762166980.389188:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4533100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+538:61873:x1847765450650624:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 210us (297us total) trans 4294992398 rc 0/0 00000100:00100000:2.0:1762166980.389195:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30750 00000100:00100000:3.0:1762166980.413535:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.413724:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450650752 00000100:00100000:2.0:1762166980.413740:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450650752 00000100:00100000:2.0:1762166980.413821:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2614 00000100:00100000:2.0:1762166980.413844:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc3552680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450650752:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:2.0:1762166980.413880:0:23942:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bcc8fa000/0x2f180c4effbac509 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.413901:0:23942:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166980.413904:0:23942:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166980.413909:0:23942:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bcc8fa000/0x2f180c4effbac509 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->249855] (req 0->249855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.413922:0:23942:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bcc8fa000/0x2f180c4effbac509 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->249855] (req 0->249855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.415798:0:23942:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bcc8fa000/0x2f180c4effbac509 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->249855] (req 0->249855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.415810:0:23942:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bcc8fa000/0x2f180c4effbac509 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->249855] (req 0->249855) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.415816:0:23942:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bcc8fa000/0x2f180c4effbac509 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->249855] (req 0->249855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.415820:0:23942:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcc8fa000 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166980.415843:0:23942:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bcc8fa000/0x2f180c4effbac509 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->249855] (req 0->249855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.415850:0:23942:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bcc8fa000/0x2f180c4effbac509 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->249855] (req 0->249855) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.415865:0:23942:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bcc8fa000/0x2f180c4effbac509 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->249855] (req 0->249855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.415869:0:23942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bcc8fa000/0x2f180c4effbac509 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->249855] (req 0->249855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166980.415936:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc3552680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450650752:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 2094us (2483us total) trans 0 rc 247325/247325 00000100:00100000:2.0:1762166980.415945:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2614 00000100:00100000:1.0:1762166980.418779:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.418854:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450650880 00000100:00100000:2.0:1762166980.418864:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450650880 00000100:00100000:2.0:1762166980.418939:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2615 00000100:00100000:2.0:1762166980.418950:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4530000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450650880:12345-192.168.204.38@tcp:3:lfs.0 00002000:00010000:2.0:1762166980.418995:0:23942:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa90:0x0] initial LVB size: 247325, mtime: 0x690888c4, atime: 0x690888c4, ctime: 0x690888c4, blocks: 0x10 00010000:00010000:2.0:1762166980.419005:0:23942:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bcc8fa200/0x2f180c4effbac510 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.419018:0:23942:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166980.419020:0:23942:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166980.419024:0:23942:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bcc8fa200/0x2f180c4effbac510 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->249855] (req 0->249855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.419036:0:23942:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bcc8fa200/0x2f180c4effbac510 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->249855] (req 0->249855) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.420618:0:23942:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bcc8fa200/0x2f180c4effbac510 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->249855] (req 0->249855) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.420628:0:23942:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bcc8fa200/0x2f180c4effbac510 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->249855] (req 0->249855) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.420637:0:23942:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bcc8fa200/0x2f180c4effbac510 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->249855] (req 0->249855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.420649:0:23942:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcc8fa200 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166980.420654:0:23942:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bcc8fa200/0x2f180c4effbac510 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->249855] (req 0->249855) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.420664:0:23942:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bcc8fa200/0x2f180c4effbac510 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->249855] (req 0->249855) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.420680:0:23942:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bcc8fa200/0x2f180c4effbac510 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->249855] (req 0->249855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.420687:0:23942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bcc8fa200/0x2f180c4effbac510 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->249855] (req 0->249855) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166980.420757:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4530000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450650880:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 1808us (1985us total) trans 0 rc 247325/247325 00000100:00100000:2.0:1762166980.420766:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2615 00000100:00100000:0.0:1762166980.427797:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.427869:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450651008 00000100:00100000:3.0:1762166980.427878:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450651008 00000100:00100000:3.0:1762166980.427938:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 893 00000100:00100000:3.0:1762166980.427952:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+538:61873:x1847765450651008:12345-192.168.204.38@tcp:103:lfs.0 00010000:00010000:3.0:1762166980.427967:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166980.427988:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fb600/0x2f180c4effbac4fb lrc: 0/0,0 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5f0 expref: 538 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.428007:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:3.0:1762166980.428012:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166980.428066:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+537:61873:x1847765450651008:12345-192.168.204.38@tcp:103:lfs.0 Request processed in 120us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166980.428074:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 893 00000100:00100000:1.0:1762166980.429151:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.429425:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450651264 00000100:00100000:0.0:1762166980.429431:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450651264 00000100:00100000:0.0:1762166980.429466:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11949 00000100:00100000:0.0:1762166980.429474:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4530380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+537:61873:x1847765450651264:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166980.429684:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4530380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+538:61873:x1847765450651264:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 210us (533us total) trans 4294992399 rc 0/0 00000100:00100000:0.0:1762166980.429690:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11949 00000100:00100000:1.0:1762166980.431787:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.431851:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450651520 00000100:00100000:2.0:1762166980.431857:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450651520 00000100:00100000:2.0:1762166980.431898:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30751 00000100:00100000:2.0:1762166980.431908:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4531500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+538:61766:x1847765450651520:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:2.0:1762166980.431924:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166980.431942:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa000/0x2f180c4effbac517 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea5f7 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.432029:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa400/0x2f180c4effbac51e lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166980.432047:0:6494:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fb800/0x2f180c4effbac4d8 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5e2 expref: 539 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.432056:0:6494:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa400/0x2f180c4effbac51e lrc: 4/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.432089:0:6494:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fb800/0x2f180c4effbac4d8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5e2 expref: 539 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.432100:0:6494:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fb800/0x2f180c4effbac4d8 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5e2 expref: 539 pid: 6494 timeout: 699 lvb_type: 0 00000100:00100000:2.0:1762166980.432113:0:6494:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5766a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765449767808:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166980.432191:0:6494:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a1540 going to sleep for 11 seconds 00000100:00100000:1.0:1762166980.433143:0:6494:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5766a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765449767808:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166980.433166:0:6494:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa400/0x2f180c4effbac51e lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000100:00100000:1.0:1762166980.433333:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.433430:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450651648 00000100:00100000:3.0:1762166980.433444:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450651648 00010000:00010000:3.0:1762166980.433515:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fb800/0x2f180c4effbac4d8 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5e2 expref: 540 pid: 6494 timeout: 699 lvb_type: 0 00000100:00100000:3.0:1762166980.433555:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9748 00000100:00100000:3.0:1762166980.433567:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4533b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+540:2418:x1847765450651648:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166980.433582:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166980.433590:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fb800/0x2f180c4effbac4d8 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5e2 expref: 540 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:3.0:1762166980.433605:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fb800/0x2f180c4effbac4d8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5e2 expref: 540 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:3.0:1762166980.433629:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fb800/0x2f180c4effbac4d8 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5e2 expref: 540 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:3.0:1762166980.433651:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:3.0:1762166980.433656:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa400/0x2f180c4effbac51e lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.433666:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa400/0x2f180c4effbac51e lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.433673:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa400/0x2f180c4effbac51e lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.433700:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166980.433739:0:6494:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa400/0x2f180c4effbac51e lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.433746:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa400/0x2f180c4effbac51e lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000100:00100000:3.0:1762166980.433752:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4533b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+539:2418:x1847765450651648:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 189us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166980.433760:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9748 00000004:00200000:1.0:1762166980.433768:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 247325 00010000:00010000:1.0:1762166980.433923:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa000/0x2f180c4effbac517 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5f7 expref: 540 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.433938:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa400/0x2f180c4effbac51e lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5f7 expref: 539 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.433951:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:1.0:1762166980.433954:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1762166980.433957:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcc8fa400, rc 0) 00000100:00100000:1.0:1762166980.433996:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4531500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+539:61766:x1847765450651520:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 2090us (2213us total) trans 4294992400 rc 0/0 00000100:00100000:1.0:1762166980.434005:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30751 00010000:00010000:0.0:1762166980.434614:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166980.434957:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.435006:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450651776 00000100:00100000:2.0:1762166980.435012:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450651776 00000100:00100000:2.0:1762166980.435046:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30752 00000100:00100000:2.0:1762166980.435054:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4531c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+539:61766:x1847765450651776:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:2.0:1762166980.435073:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166980.435086:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fba00/0x2f180c4effbac52c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea5fe expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.435180:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fb600/0x2f180c4effbac533 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166980.435193:0:6494:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa400/0x2f180c4effbac51e lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5f7 expref: 540 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.435206:0:6494:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fb600/0x2f180c4effbac533 lrc: 4/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.435233:0:6494:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa400/0x2f180c4effbac51e lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5f7 expref: 540 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.435242:0:6494:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa400/0x2f180c4effbac51e lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5f7 expref: 540 pid: 6494 timeout: 699 lvb_type: 0 00000100:00100000:2.0:1762166980.435252:0:6494:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5766d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765449767936:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166980.435302:0:6494:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a1c00 going to sleep for 11 seconds 00000100:00100000:1.0:1762166980.436096:0:6494:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5766d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765449767936:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166980.436127:0:6494:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fb600/0x2f180c4effbac533 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000100:00100000:1.0:1762166980.436368:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.436415:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450651904 00000100:00100000:3.0:1762166980.436462:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450651904 00010000:00010000:3.0:1762166980.436530:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa400/0x2f180c4effbac51e lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5f7 expref: 541 pid: 6494 timeout: 699 lvb_type: 0 00000100:00100000:3.0:1762166980.436564:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9749 00000100:00100000:3.0:1762166980.436574:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc4e3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+541:2419:x1847765450651904:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166980.436587:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166980.436595:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa400/0x2f180c4effbac51e lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5f7 expref: 541 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:3.0:1762166980.436609:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa400/0x2f180c4effbac51e lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5f7 expref: 541 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:3.0:1762166980.436633:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa400/0x2f180c4effbac51e lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5f7 expref: 541 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:3.0:1762166980.436648:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:3.0:1762166980.436653:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fb600/0x2f180c4effbac533 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.436661:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fb600/0x2f180c4effbac533 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.436668:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fb600/0x2f180c4effbac533 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.436695:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166980.436733:0:6494:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fb600/0x2f180c4effbac533 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000100:00100000:3.0:1762166980.436741:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc4e3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+540:2419:x1847765450651904:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 167us (370us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166980.436747:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fb600/0x2f180c4effbac533 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000100:00100000:3.0:1762166980.436754:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9749 00000004:00200000:1.0:1762166980.436796:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 247325 00000004:00200000:1.0:1762166980.436807:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166980.436836:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fb600/0x2f180c4effbac533 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.436865:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fba00/0x2f180c4effbac52c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5fe expref: 540 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.436879:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fb600/0x2f180c4effbac533 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5fe expref: 539 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.436891:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:1.0:1762166980.436894:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166980.436896:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcc8fb600, rc 0) 00000100:00100000:1.0:1762166980.436934:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4531c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+539:61766:x1847765450651776:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 1880us (1978us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166980.436941:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30752 00000100:00100000:1.0:1762166980.438159:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.438221:0:35248:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450652032 00000100:00100000:0.0:1762166980.438227:0:35248:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450652032 00000100:00100000:0.0:1762166980.438267:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19283 00000100:00100000:0.0:1762166980.438278:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4533b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+17:2417:x1847765450652032:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:0.0:1762166980.438292:0:35248:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1762166980.438293:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:0.0:1762166980.438310:0:35248:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdea00/0x2f180c4effbac53a lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea605 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166980.438321:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450652160 00000100:00100000:3.0:1762166980.438330:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450652160 00002000:00010000:0.0:1762166980.438331:0:35248:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa90:0x0] initial LVB size: 247325, mtime: 0x690888c4, atime: 0x690888c4, ctime: 0x690888c4, blocks: 0x10 00010000:00010000:0.0:1762166980.438350:0:35248:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166980.438352:0:35248:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166980.438359:0:35248:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdea00/0x2f180c4effbac53a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea605 expref: 18 pid: 35248 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166980.438372:0:35248:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdea00/0x2f180c4effbac53a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea605 expref: 18 pid: 35248 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166980.438388:0:35248:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdea00, rc 0) 00000100:00100000:3.0:1762166980.438413:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19284 00000100:00100000:3.0:1762166980.438421:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc576b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+21:2416:x1847765450652160:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:3.0:1762166980.438434:0:9165:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1762166980.438435:0:35248:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4533b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+18:2417:x1847765450652032:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 157us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166980.438446:0:35248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19283 00010000:00010000:3.0:1762166980.438449:0:9165:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cf3cada00/0x2f180c4effbac541 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea60c expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166980.438543:0:9165:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cc3553b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9165:1847765449768064:192.168.204.38@tcp:106: 00000100:00100000:3.0:1762166980.438644:0:9165:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc4446b40 going to sleep for 11 seconds 00000100:00100000:3.0:1762166980.439521:0:9165:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cc3553b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9165:1847765449768064:192.168.204.38@tcp:106: 00010000:00010000:3.0:1762166980.439549:0:9165:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945cf3cada00/0x2f180c4effbac541 lrc: 1/0,0 mode: --/PR res: [0x2c0000400:0xa8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea60c expref: 22 pid: 9165 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166980.439566:0:9165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cf3cada00/0x2f180c4effbac541 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea60c expref: 22 pid: 9165 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166980.439589:0:9165:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cada00, rc 0) 00000100:00100000:3.0:1762166980.439630:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc576b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+21:2416:x1847765450652160:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 1209us (1338us total) trans 0 rc 301/301 00000100:00100000:3.0:1762166980.439638:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19284 00000100:00100000:1.0:1762166980.440799:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.440891:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450652288 00000100:00100000:2.0:1762166980.440899:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450652288 00000100:00100000:2.0:1762166980.440945:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30753 00000100:00100000:2.0:1762166980.440955:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+539:61766:x1847765450652288:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:2.0:1762166980.440970:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166980.440984:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa200/0x2f180c4effbac548 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea613 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.441009:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847f600/0x2f180c4effbac54f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166980.441020:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847f600/0x2f180c4effbac54f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.441029:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847f600/0x2f180c4effbac54f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.441128:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa200/0x2f180c4effbac548 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea613 expref: 541 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.441142:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847f600/0x2f180c4effbac54f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea613 expref: 540 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.441150:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166980.441153:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1762166980.441155:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc847f600, rc 0) 00000100:00100000:2.0:1762166980.441196:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+540:61766:x1847765450652288:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 243us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166980.441203:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30753 00000100:00100000:1.0:1762166980.442260:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.442302:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450652544 00000100:00100000:2.0:1762166980.442308:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450652544 00000100:00100000:2.0:1762166980.442340:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30754 00000100:00100000:2.0:1762166980.442350:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc576a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+540:61766:x1847765450652544:12345-192.168.204.38@tcp:36:fsx.0 00010000:00010000:2.0:1762166980.442383:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166980.442396:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fb600/0x2f180c4effbac533 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5fe expref: 540 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.442409:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166980.442413:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166980.442585:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194e00/0x2f180c4effbac556 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166980.442596:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194e00/0x2f180c4effbac556 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.442603:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194e00/0x2f180c4effbac556 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000001:00080000:2.0:1762166980.442644:0:6494:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992401 00000004:00010000:2.0:1762166980.442660:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000002755666c reply state 0000000090f22975 transno 4294992402 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194e00/0x2f180c4effbac556 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.442670:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194e00/0x2f180c4effbac556 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.442677:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166980.442679:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166980.442681:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166980.442734:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc576a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+542:61766:x1847765450652544:12345-192.168.204.38@tcp:36:fsx.0 Request processed in 387us (476us total) trans 4294992402 rc 0/0 00000100:00100000:2.0:1762166980.442742:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30754 00000020:00080000:2.0:1762166980.442749:0:6494:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1762166980.443604:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.443645:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450652800 00000100:00100000:0.0:1762166980.443650:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450652800 00000100:00100000:0.0:1762166980.443678:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11950 00000100:00100000:0.0:1762166980.443683:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7be0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+542:61766:x1847765450652800:12345-192.168.204.38@tcp:35:fsx.0 00000100:00100000:0.0:1762166980.443785:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7be0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+543:61766:x1847765450652800:12345-192.168.204.38@tcp:35:fsx.0 Request processed in 102us (181us total) trans 4294992403 rc 0/0 00000100:00100000:0.0:1762166980.443792:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11950 00000100:00100000:1.0:1762166980.444699:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.444754:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450653056 00000100:00100000:2.0:1762166980.444762:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450653056 00000100:00100000:2.0:1762166980.444809:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30755 00000100:00100000:2.0:1762166980.444819:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+543:61766:x1847765450653056:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:2.0:1762166980.444851:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166980.444854:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:2.0:1762166980.444879:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fac00/0x2f180c4effbac4e6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5e9 expref: 543 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.444900:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194800/0x2f180c4effbac4b5 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5db expref: 542 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.444912:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166980.444916:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166980.444929:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194200/0x2f180c4effbac55d lrc: 2/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea61a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.444976:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa29a00/0x2f180c4effbac564 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166980.444989:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa29a00/0x2f180c4effbac564 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.444998:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa29a00/0x2f180c4effbac564 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000040:00080000:2.0:1762166980.445245:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5927, 88 off464256 00000004:00080000:2.0:1762166980.445254:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 599593775651ns, next at 600144491692ns, rc = 0 00000040:00080000:2.0:1762166980.445300:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5926, 88 off464256 00000004:00080000:2.0:1762166980.445307:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 599593828846ns, next at 600144525370ns, rc = 0 00000040:00080000:2.0:1762166980.445329:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5927, 88 off464344 00000004:00080000:2.0:1762166980.445334:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 599593856457ns, next at 600144525370ns, rc = 0 00000040:00080000:2.0:1762166980.445344:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5928, 88 off464344 00000004:00080000:2.0:1762166980.445348:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 599593870561ns, next at 600144491692ns, rc = 0 00000040:00080000:2.0:1762166980.445366:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5928, 88 off464432 00000004:00080000:2.0:1762166980.445371:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 599593893407ns, next at 600144525370ns, rc = 0 00000040:00080000:2.0:1762166980.445392:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5929, 88 off464432 00000004:00080000:2.0:1762166980.445397:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 599593919140ns, next at 600144491692ns, rc = 0 00000001:00080000:1.0:1762166980.446628:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294992404 is committed 00000004:00080000:1.0:1762166980.446637:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3287 committed 00000004:00080000:1.0:1762166980.446646:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3290 committed 00000004:00080000:1.0:1762166980.446657:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3286 committed 00010000:00010000:3.0:1762166980.446658:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbac492 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00000004:00080000:1.0:1762166980.446661:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3289 committed 00000004:00080000:1.0:1762166980.446666:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3288 committed 00010000:00010000:3.0:1762166980.446670:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbac492 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00000004:00080000:1.0:1762166980.446671:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3285 committed 00010000:00010000:3.0:1762166980.446680:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbac492 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.446688:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bde000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166980.446693:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbac492 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.446701:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbac492 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00000020:00080000:1.0:1762166980.446704:0:7412:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff945bc40760c0 refcount 2 committed 0 result 0 batchid 61 00000020:00080000:1.0:1762166980.446710:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cf1d0e500 obd lustre-OST0001-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff945bc4076000 00010000:00010000:3.0:1762166980.446716:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x619:0x0].0x0 (ffff945cd1d8cb00) 00000020:00080000:1.0:1762166980.446717:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cf1d0ea00 obd lustre-OST0000-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff945bc4076840 00010000:00010000:3.0:1762166980.446722:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000020:00080000:1.0:1762166980.446724:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cf1d0e000 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff945bc5c44a00 00010000:00010000:3.0:1762166980.446728:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbac492 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00000020:00080000:1.0:1762166980.446729:0:7412:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000400:0x2:0x0].60 00010000:00010000:3.0:1762166980.446744:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbac492 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x619:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00000020:00080000:1.0:1762166980.446760:0:7412:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0001: 60 batchid updated 00010000:00010000:3.0:1762166980.446767:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbac4a0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00000020:00080000:1.0:1762166980.446783:0:7435:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 61 committed batchid 60 00010000:00010000:3.0:1762166980.446784:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbac4a0 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.446792:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbac4a0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.446797:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355a600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166980.446800:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbac4a0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.446805:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbac4a0 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.446814:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:3.0:1762166980.446818:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166980.446831:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbac4a0 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.446839:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbac4a0 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00000100:00100000:0.0:1762166980.446846:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449768320:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1762166980.446857:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194e00/0x2f180c4effbac556 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.446865:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194e00/0x2f180c4effbac556 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.446872:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194e00/0x2f180c4effbac556 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.446884:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa29a00/0x2f180c4effbac564 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea61a expref: 527 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.446896:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc7194e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166980.446897:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166980.446903:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1762166980.446907:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194e00/0x2f180c4effbac556 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00000020:00080000:1.0:1762166980.446910:0:7435:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 59 cancel update log [0x240000400:0x2:0x0].58: rc = 0 00010000:00010000:2.0:1762166980.446917:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194200/0x2f180c4effbac55d lrc: 0/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea61a expref: 527 pid: 6494 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1762166980.446922:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194e00/0x2f180c4effbac556 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00000100:00100000:0.0:1762166980.446923:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1762166980.446942:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:3.0:1762166980.446946:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000020:00080000:1.0:1762166980.446949:0:7435:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 60 cancel update log [0x240000400:0x2:0x0].59: rc = 0 00010000:00010000:3.0:1762166980.446950:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194e00/0x2f180c4effbac556 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.446954:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa29a00/0x2f180c4effbac564 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea61a expref: 526 pid: 6494 timeout: 0 lvb_type: 0 00000020:00080000:1.0:1762166980.446961:0:7435:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 60 00000100:00100000:0.0:1762166980.446966:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5767480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449768832:0@lo:2:osp-syn-0-1.0 00010000:00010000:3.0:1762166980.446969:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194e00/0x2f180c4effbac556 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.446991:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166980.446995:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000100:00100000:3.0:1762166980.446998:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5764380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449768448:0@lo:2:osp-syn-0-1.0 00010000:00010000:2.0:1762166980.447001:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa29a00, rc 0) 00000100:00100000:0.0:1762166980.447003:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166980.447037:0:35248:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449768320 00000100:00100000:1.0:1762166980.447044:0:35248:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449768320 00000100:00100000:3.0:1762166980.447049:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166980.447053:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1762166980.447062:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+525:61766:x1847765450653056:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 2243us (2369us total) trans 4294992404 rc 0/0 00000100:00100000:0.0:1762166980.447066:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5766680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449768192:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1762166980.447076:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449768960:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1762166980.447077:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30755 00000100:00100000:1.0:1762166980.447084:0:35248:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449768832 00000100:00100000:1.0:1762166980.447089:0:35248:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449768832 00000100:00100000:0.0:1762166980.447106:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166980.447121:0:35248:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449768448 00000100:00100000:1.0:1762166980.447126:0:35248:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449768448 00000100:00100000:3.0:1762166980.447130:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449768192 00000100:00100000:3.0:1762166980.447136:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449768192 00000100:00100000:0.0:1762166980.447140:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449768704:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1762166980.447165:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19285 00000100:00100000:0.0:1762166980.447171:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166980.447179:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3d5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+6:3636:x1847765449768320:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1762166980.447182:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449768704 00000100:00100000:3.0:1762166980.447188:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449768704 00002000:00080000:1.0:1762166980.447208:0:35248:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:2701 count 1 00000100:00100000:0.0:1762166980.447209:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449768576:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166980.447219:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19286 00000100:00100000:3.0:1762166980.447230:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+9:3636:x1847765449768832:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1762166980.447232:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19287 00010000:00010000:1.0:1762166980.447233:0:35248:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945cc355b000/0x2f180c4effbac56b lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa8d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166980.447244:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166980.447250:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc3553b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+9:3633:x1847765449768448:12345-0@lo:2:osp-syn-0-1.0 00010000:00010000:1.0:1762166980.447262:0:35248:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc8472600/0x2f180c4effbabcf1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea326 expref: 20 pid: 8380 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166980.447262:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449769088:0@lo:2:osp-syn-0-1.0 00010000:00010000:1.0:1762166980.447278:0:35248:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166980.447280:0:35248:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166980.447285:0:35248:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355b000/0x2f180c4effbac56b lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0xa8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166980.447292:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166980.447322:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449768576 00000100:00100000:0.0:1762166980.447327:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449768576 00010000:00010000:1.0:1762166980.447328:0:35248:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc8472600/0x2f180c4effbabcf1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea326 expref: 20 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.447347:0:35248:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc8472600/0x2f180c4effbabcf1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea326 expref: 20 pid: 8380 timeout: 699 lvb_type: 0 00000100:00100000:0.0:1762166980.447351:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449769088 00002000:00010000:2.0:1762166980.447355:0:35472:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:0.0:1762166980.447356:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449769088 00002000:00010000:2.0:1762166980.447362:0:35472:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb mtime from disk: 1762166966 -> 1762166966 00002000:00010000:2.0:1762166980.447368:0:35472:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1762166980.447374:0:28874:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166980.447374:0:35472:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb ctime from disk: 1762166966 -> 1762166966 00000100:00100000:0.0:1762166980.447379:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19288 00000100:00100000:1.0:1762166980.447381:0:35248:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf3db7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:35248:1847765449769216:192.168.204.38@tcp:104: 00002000:00010000:3.0:1762166980.447384:0:28874:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00002000:00010000:2.0:1762166980.447384:0:35472:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:3.0:1762166980.447393:0:28874:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00000100:00100000:0.0:1762166980.447393:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+12:3636:x1847765449768192:12345-0@lo:6:osp-syn-0-1.0 00002000:00010000:3.0:1762166980.447398:0:28874:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:3.0:1762166980.447403:0:28874:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00002000:00080000:0.0:1762166980.447413:0:9168:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:2702 count 1 00010000:00010000:0.0:1762166980.447432:0:9168:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdec00/0x2f180c4effbac572 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa8e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166980.447443:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc3553b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+12:3633:x1847765449768448:12345-0@lo:2:osp-syn-0-1.0 Request processed in 197us (391us total) trans 21474843413 rc 0/0 00010000:00010000:0.0:1762166980.447449:0:9168:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf400/0x2f180c4effbabddf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea357 expref: 17 pid: 9165 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1762166980.447456:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19287 00000100:00100000:1.0:1762166980.447459:0:35248:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc350f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166980.447461:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+12:3636:x1847765449768832:12345-0@lo:2:osp-syn-0-1.0 Request processed in 231us (459us total) trans 21474843414 rc 0/0 00010000:00010000:0.0:1762166980.447468:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166980.447472:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1762166980.447500:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19286 00010000:00010000:0.0:1762166980.447504:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdec00/0x2f180c4effbac572 lrc: 4/0,1 mode: --/PW res: [0x280000400:0xa8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166980.447515:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19289 00000100:00100000:1.0:1762166980.447524:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19290 00000100:00100000:2.0:1762166980.447529:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+8:3636:x1847765449768704:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166980.447536:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19291 00010000:00010000:0.0:1762166980.447536:0:9168:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf400/0x2f180c4effbabddf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea357 expref: 17 pid: 9165 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1762166980.447541:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4530380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+8:3634:x1847765449768576:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166980.447554:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6224e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+10:3634:x1847765449769088:12345-0@lo:2:osp-syn-0-1.0 00010000:00010000:0.0:1762166980.447559:0:9168:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf400/0x2f180c4effbabddf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea357 expref: 17 pid: 9165 timeout: 699 lvb_type: 1 00000100:00100000:0.0:1762166980.447573:0:9168:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc6227800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9168:1847765449769344:192.168.204.38@tcp:104: 00002000:00010000:2.0:1762166980.447614:0:35472:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:0.0:1762166980.447614:0:9168:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1fe20c0 going to sleep for 11 seconds 00002000:00010000:2.0:1762166980.447621:0:35472:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00002000:00010000:2.0:1762166980.447624:0:35472:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00002000:00010000:2.0:1762166980.447628:0:35472:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:2.0:1762166980.447630:0:35472:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:3.0:1762166980.447636:0:28874:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa90:0x0] updating lvb size from disk: 247325 -> 247325 00000100:00100000:0.0:1762166980.447636:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:3.0:1762166980.447643:0:28874:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa90:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00002000:00010000:1.0:1762166980.447644:0:28434:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 247325 -> 247325 00002000:00010000:3.0:1762166980.447646:0:28874:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa90:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00002000:00010000:3.0:1762166980.447653:0:28874:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa90:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:1.0:1762166980.447653:0:28434:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00002000:00010000:3.0:1762166980.447661:0:28874:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa90:0x0] updating lvb blocks from disk: 16 -> 16 00002000:00010000:1.0:1762166980.447661:0:28434:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00002000:00010000:1.0:1762166980.447668:0:28434:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00000100:00100000:2.0:1762166980.447669:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+10:3636:x1847765449768704:12345-0@lo:2:osp-syn-1-1.0 Request processed in 144us (499us total) trans 17179876621 rc 0/0 00002000:00010000:1.0:1762166980.447674:0:28434:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 32 -> 32 00000100:00100000:2.0:1762166980.447681:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19289 00000004:00080000:0.0:1762166980.447694:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc5764380/2, rc 0, transno 21474843413 00000100:00100000:2.0:1762166980.447702:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449768960 00000100:00100000:0.0:1762166980.447703:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5764380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449768448:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1762166980.447708:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449768960 00000100:00100000:3.0:1762166980.447709:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6224e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+11:3634:x1847765449769088:12345-0@lo:2:osp-syn-0-1.0 Request processed in 158us (416us total) trans 21474843415 rc 0/0 00000100:00100000:3.0:1762166980.447722:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19291 00000100:00100000:1.0:1762166980.447724:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4530380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+10:3634:x1847765449768576:12345-0@lo:2:osp-syn-1-1.0 Request processed in 185us (479us total) trans 17179876622 rc 0/0 00000100:00100000:1.0:1762166980.447734:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19290 00000100:00100000:2.0:1762166980.447741:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19292 00000004:00080000:0.0:1762166980.447742:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc55df480/2, rc 0, transno 17179876622 00000100:00100000:0.0:1762166980.447750:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449768576:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1762166980.447754:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+9:3633:x1847765449768960:12345-0@lo:2:osp-syn-1-1.0 00000004:00080000:0.0:1762166980.447766:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc5765500/2, rc 0, transno 21474843415 00000100:00100000:0.0:1762166980.447771:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449769088:0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1762166980.447788:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc55dfb80/2, rc 0, transno 17179876621 00000100:00100000:3.0:1762166980.447796:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449768704:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1762166980.447813:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc5767480/2, rc 0, transno 21474843414 00002000:00010000:2.0:1762166980.447814:0:35472:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa8f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166980.447819:0:35472:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa8f:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00000100:00100000:3.0:1762166980.447820:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5767480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449768832:0@lo:2:osp-syn-0-1.0 00002000:00010000:2.0:1762166980.447835:0:35472:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa8f:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00002000:00010000:2.0:1762166980.447840:0:35472:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa8f:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:2.0:1762166980.447843:0:35472:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa8f:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1762166980.447883:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+10:3633:x1847765449768960:12345-0@lo:2:osp-syn-1-1.0 Request processed in 133us (247us total) trans 17179876623 rc 0/0 00000100:00100000:2.0:1762166980.447891:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19292 00000004:00080000:0.0:1762166980.447901:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc55dd880/2, rc 0, transno 17179876623 00000100:00100000:0.0:1762166980.447908:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449768960:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1762166980.448751:0:35248:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3db7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:35248:1847765449769216:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166980.448771:0:9168:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc6227800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9168:1847765449769344:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166980.448773:0:35248:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945cc355b000/0x2f180c4effbac56b lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.448792:0:9168:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdec00/0x2f180c4effbac572 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166980.448891:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.448919:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.448930:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450653312 00000100:00100000:2.0:1762166980.448935:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450653312 00000100:00100000:0.0:1762166980.448948:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.448967:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19293 00000100:00100000:2.0:1762166980.448977:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+21:61766:x1847765450653312:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:2.0:1762166980.448988:0:35472:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1762166980.448991:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450653184 00000100:00100000:3.0:1762166980.448993:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450653440 00000100:00100000:1.0:1762166980.448998:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450653184 00000100:00100000:3.0:1762166980.448999:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450653440 00010000:00010000:2.0:1762166980.449000:0:35472:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28a00/0x2f180c4effbac579 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea621 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.449024:0:35472:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbac406 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5a3 expref: 23 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166980.449027:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf400/0x2f180c4effbabddf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea357 expref: 18 pid: 9165 timeout: 699 lvb_type: 1 00010000:00010000:1.0:1762166980.449027:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc8472600/0x2f180c4effbabcf1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea326 expref: 23 pid: 8380 timeout: 699 lvb_type: 0 00010000:00010000:2.0:1762166980.449046:0:35472:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166980.449049:0:35472:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166980.449056:0:35472:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28a00/0x2f180c4effbac579 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea621 expref: 23 pid: 35472 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166980.449064:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9750 00000100:00100000:1.0:1762166980.449073:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765450653184:12345-192.168.204.38@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1762166980.449078:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9751 00010000:00010000:2.0:1762166980.449082:0:35472:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbac406 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5a3 expref: 23 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166980.449086:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1762166980.449092:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bbad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+18:2417:x1847765450653440:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166980.449095:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc8472600/0x2f180c4effbabcf1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea326 expref: 23 pid: 8380 timeout: 699 lvb_type: 0 00010000:00010000:2.0:1762166980.449107:0:35472:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbac406 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5a3 expref: 23 pid: 28874 timeout: 699 lvb_type: 1 00010000:00010000:3.0:1762166980.449112:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166980.449120:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf400/0x2f180c4effbabddf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea357 expref: 18 pid: 9165 timeout: 699 lvb_type: 1 00010000:00010000:1.0:1762166980.449123:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc8472600/0x2f180c4effbabcf1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea326 expref: 23 pid: 8380 timeout: 699 lvb_type: 0 00010000:00010000:3.0:1762166980.449145:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf400/0x2f180c4effbabddf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea357 expref: 18 pid: 9165 timeout: 699 lvb_type: 1 00000100:00100000:2.0:1762166980.449151:0:35472:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5764a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:35472:1847765449769472:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166980.449160:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc8472600/0x2f180c4effbabcf1 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa8d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea326 expref: 23 pid: 8380 timeout: 699 lvb_type: 0 00010000:00010000:3.0:1762166980.449174:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf400/0x2f180c4effbabddf lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa8e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea357 expref: 18 pid: 9165 timeout: 699 lvb_type: 1 00010000:00010000:1.0:1762166980.449175:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166980.449179:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166980.449185:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945cc355b000/0x2f180c4effbac56b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.449191:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166980.449195:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166980.449201:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdec00/0x2f180c4effbac572 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.449207:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355b000/0x2f180c4effbac56b lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xa8d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166980.449208:0:35472:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a1c00 going to sleep for 11 seconds 00010000:00010000:3.0:1762166980.449213:0:9458:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdec00/0x2f180c4effbac572 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa8e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.449246:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166980.449247:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166980.449259:0:35248:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945cc355b000/0x2f180c4effbac56b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.449270:0:35248:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cc355b000/0x2f180c4effbac56b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166980.449275:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bbad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+17:2417:x1847765450653440:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 187us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166980.449286:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765450653184:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 212us (363us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166980.449289:0:35248:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945cc355b000/0x2f180c4effbac56b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166980.449293:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9751 00000100:00100000:1.0:1762166980.449307:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9750 00010000:00010000:2.0:1762166980.449317:0:35248:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355b000/0x2f180c4effbac56b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.449320:0:9168:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdec00/0x2f180c4effbac572 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.449337:0:35248:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1762166980.449351:0:7420:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1762166980.449359:0:7420:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945cc355b000/0x2f180c4effbac56b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.449368:0:7420:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355b000 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166980.449373:0:7420:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc355b000/0x2f180c4effbac56b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.449381:0:7420:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc355b000/0x2f180c4effbac56b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.449400:0:7420:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945cc355b000/0x2f180c4effbac56b lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xa8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.449404:0:9168:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdec00/0x2f180c4effbac572 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.449408:0:7420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cc355b000/0x2f180c4effbac56b lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.449418:0:9168:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdec00/0x2f180c4effbac572 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.449425:0:9168:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdec00/0x2f180c4effbac572 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.449427:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166980.449429:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166980.449431:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166980.449439:0:9168:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1762166980.449443:0:6483:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1762166980.449447:0:6483:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdec00/0x2f180c4effbac572 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.449454:0:6483:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdec00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166980.449458:0:6483:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdec00/0x2f180c4effbac572 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.449465:0:6483:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdec00/0x2f180c4effbac572 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.449508:0:6483:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdec00/0x2f180c4effbac572 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.449518:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdec00/0x2f180c4effbac572 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.449542:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166980.449544:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166980.449546:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1762166980.449585:0:35248:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3d5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+10:3636:x1847765449768320:12345-0@lo:6:osp-syn-1-1.0 Request processed in 2408us (2665us total) trans 17179876624 rc 0/0 00000100:00100000:2.0:1762166980.449594:0:35248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19285 00000004:00080000:0.0:1762166980.449598:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc55dce00/2, rc 0, transno 17179876624 00000100:00100000:0.0:1762166980.449606:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449768320:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1762166980.450012:0:35472:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5764a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:35472:1847765449769472:192.168.204.38@tcp:104: 00000004:00080000:0.0:1762166980.450023:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc5766680/2, rc 0, transno 21474843416 00000100:00100000:0.0:1762166980.450031:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5766680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449768192:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1762166980.450038:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+11:3636:x1847765449768192:12345-0@lo:6:osp-syn-0-1.0 Request processed in 2648us (2934us total) trans 21474843416 rc 0/0 00010000:00010000:2.0:1762166980.450038:0:35472:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28a00/0x2f180c4effbac579 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea621 expref: 21 pid: 35472 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166980.450049:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19288 00010000:00010000:2.0:1762166980.450063:0:35472:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa28a00, rc 0) 00000100:00100000:1.0:1762166980.450098:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.450107:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+21:61766:x1847765450653312:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 1132us (1215us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166980.450116:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19293 00000100:00100000:3.0:1762166980.450130:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450653568 00000100:00100000:3.0:1762166980.450136:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450653568 00010000:00010000:3.0:1762166980.450210:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbac406 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5a3 expref: 21 pid: 28874 timeout: 699 lvb_type: 1 00000100:00100000:3.0:1762166980.450230:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9752 00000100:00100000:3.0:1762166980.450235:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450653568:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166980.450242:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166980.450252:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbac406 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5a3 expref: 21 pid: 28874 timeout: 699 lvb_type: 1 00010000:00010000:3.0:1762166980.450259:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbac406 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5a3 expref: 21 pid: 28874 timeout: 699 lvb_type: 1 00010000:00010000:3.0:1762166980.450268:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbac406 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5a3 expref: 21 pid: 28874 timeout: 699 lvb_type: 1 00010000:00010000:3.0:1762166980.450278:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166980.450279:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166980.450283:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28a00/0x2f180c4effbac579 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea621 expref: 20 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.450288:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28a00/0x2f180c4effbac579 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea621 expref: 20 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.450304:0:8398:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28a00/0x2f180c4effbac579 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea621 expref: 20 pid: 35472 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166980.450311:0:8398:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cc3550380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8398:1847765449769600:192.168.204.38@tcp:105: 00000100:00100000:3.0:1762166980.450342:0:8398:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc4446b40 going to sleep for 11 seconds 00000100:00100000:3.0:1762166980.451156:0:8398:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cc3550380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8398:1847765449769600:192.168.204.38@tcp:105: 00010000:00010000:3.0:1762166980.451167:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166980.451257:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450653568:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1019us (1158us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166980.451266:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9752 00000100:00100000:1.0:1762166980.451312:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.451357:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450653696 00000100:00100000:2.0:1762166980.451362:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450653696 00000100:00100000:2.0:1762166980.451401:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19294 00000100:00100000:2.0:1762166980.451409:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+17:61766:x1847765450653696:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:2.0:1762166980.451422:0:35472:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166980.451435:0:35472:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29000/0x2f180c4effbac580 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea628 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.451454:0:35472:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4a14000/0x2f180c4effbac414 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5aa expref: 18 pid: 8382 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166980.451468:0:35472:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166980.451471:0:35472:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166980.451507:0:35472:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29000/0x2f180c4effbac580 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea628 expref: 18 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.451533:0:35472:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc4a14000/0x2f180c4effbac414 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5aa expref: 18 pid: 8382 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166980.451548:0:35472:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc4a14000/0x2f180c4effbac414 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5aa expref: 18 pid: 8382 timeout: 699 lvb_type: 1 00000100:00100000:2.0:1762166980.451560:0:35472:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5764a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:35472:1847765449769728:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166980.451616:0:35472:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a1c00 going to sleep for 11 seconds 00000100:00100000:2.0:1762166980.452374:0:35472:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5764a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:35472:1847765449769728:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166980.452409:0:35472:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29000/0x2f180c4effbac580 lrc: 3/0,0 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea628 expref: 18 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.452428:0:35472:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcaa29000, rc 0) 00000100:00100000:2.0:1762166980.452518:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+18:61766:x1847765450653696:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 1108us (1205us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166980.452530:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19294 00000100:00100000:0.0:1762166980.452650:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.452686:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450653824 00000100:00100000:3.0:1762166980.452692:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450653824 00010000:00010000:3.0:1762166980.452714:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4a14000/0x2f180c4effbac414 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5aa expref: 18 pid: 8382 timeout: 699 lvb_type: 1 00000100:00100000:3.0:1762166980.452745:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9753 00000100:00100000:3.0:1762166980.452754:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bbb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450653824:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166980.452765:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166980.452780:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc4a14000/0x2f180c4effbac414 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5aa expref: 18 pid: 8382 timeout: 699 lvb_type: 1 00010000:00010000:3.0:1762166980.452792:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc4a14000/0x2f180c4effbac414 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5aa expref: 18 pid: 8382 timeout: 699 lvb_type: 1 00010000:00010000:3.0:1762166980.452810:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4a14000/0x2f180c4effbac414 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5aa expref: 18 pid: 8382 timeout: 699 lvb_type: 1 00010000:00010000:3.0:1762166980.452835:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166980.452838:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166980.452844:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29000/0x2f180c4effbac580 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea628 expref: 17 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.452853:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29000/0x2f180c4effbac580 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea628 expref: 17 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.452877:0:8398:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29000/0x2f180c4effbac580 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea628 expref: 17 pid: 35472 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166980.452887:0:8398:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cc3550380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8398:1847765449769856:192.168.204.38@tcp:105: 00000100:00100000:3.0:1762166980.452931:0:8398:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc4446b40 going to sleep for 11 seconds 00000100:00100000:3.0:1762166980.454348:0:8398:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cc3550380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8398:1847765449769856:192.168.204.38@tcp:105: 00010000:00010000:3.0:1762166980.454364:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166980.454398:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.454413:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bbb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450653824:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1659us (1764us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166980.454424:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9753 00000100:00100000:2.0:1762166980.454698:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450653952 00000100:00100000:2.0:1762166980.454708:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450653952 00000100:00100000:2.0:1762166980.454766:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19295 00000100:00100000:2.0:1762166980.454776:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+20:61766:x1847765450653952:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:2.0:1762166980.454792:0:35472:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166980.454811:0:35472:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc7194e00/0x2f180c4effbac587 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea62f expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.454852:0:35472:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc42d1200/0x2f180c4effbac40d lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5b1 expref: 21 pid: 35248 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166980.454862:0:35472:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166980.454864:0:35472:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166980.454869:0:35472:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc7194e00/0x2f180c4effbac587 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea62f expref: 21 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.454900:0:35472:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc42d1200/0x2f180c4effbac40d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5b1 expref: 21 pid: 35248 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166980.454914:0:35472:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc42d1200/0x2f180c4effbac40d lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5b1 expref: 21 pid: 35248 timeout: 699 lvb_type: 1 00000100:00100000:2.0:1762166980.454927:0:35472:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5764a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:35472:1847765449769984:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166980.455000:0:35472:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a1c00 going to sleep for 11 seconds 00000100:00100000:2.0:1762166980.456045:0:35472:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5764a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:35472:1847765449769984:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166980.456061:0:35472:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc7194e00/0x2f180c4effbac587 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea62f expref: 21 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.456070:0:35472:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc7194e00, rc 0) 00000100:00100000:2.0:1762166980.456102:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+21:61766:x1847765450653952:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 1330us (1707us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166980.456108:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19295 00000100:00100000:0.0:1762166980.456226:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.456307:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450654080 00000100:00100000:3.0:1762166980.456312:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450654080 00010000:00010000:3.0:1762166980.456332:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc42d1200/0x2f180c4effbac40d lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5b1 expref: 21 pid: 35248 timeout: 699 lvb_type: 1 00000100:00100000:3.0:1762166980.456368:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9754 00000100:00100000:3.0:1762166980.456376:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450654080:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166980.456386:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166980.456403:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc42d1200/0x2f180c4effbac40d lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5b1 expref: 21 pid: 35248 timeout: 699 lvb_type: 1 00010000:00010000:3.0:1762166980.456415:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc42d1200/0x2f180c4effbac40d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5b1 expref: 21 pid: 35248 timeout: 699 lvb_type: 1 00010000:00010000:3.0:1762166980.456441:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc42d1200/0x2f180c4effbac40d lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5b1 expref: 21 pid: 35248 timeout: 699 lvb_type: 1 00010000:00010000:3.0:1762166980.456454:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166980.456456:0:8398:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166980.456461:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc7194e00/0x2f180c4effbac587 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea62f expref: 20 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.456468:0:8398:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc7194e00/0x2f180c4effbac587 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea62f expref: 20 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.456519:0:8398:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff945bc7194e00/0x2f180c4effbac587 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea62f expref: 20 pid: 35472 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166980.456530:0:8398:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cc3550380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8398:1847765449770112:192.168.204.38@tcp:105: 00000100:00100000:3.0:1762166980.456580:0:8398:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc4446b40 going to sleep for 11 seconds 00000100:00100000:3.0:1762166980.457290:0:8398:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cc3550380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8398:1847765449770112:192.168.204.38@tcp:105: 00010000:00010000:3.0:1762166980.457298:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166980.457321:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450654080:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 947us (1097us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166980.457328:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9754 00000100:00100000:0.0:1762166980.457508:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.457568:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.457597:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450654208 00000100:00100000:3.0:1762166980.457605:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450654336 00000100:00100000:2.0:1762166980.457606:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450654208 00000100:00100000:0.0:1762166980.457626:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00002000:00010000:2.0:1762166980.457648:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (247947->18446744073709551615) 00000100:00100000:3.0:1762166980.457651:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450654336 00002000:00100000:2.0:1762166980.457659:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5bba680 with x1847765450654208 ext(247947->18446744073709551615) 00002000:00010000:2.0:1762166980.457673:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5bba680. 00002000:00010000:3.0:1762166980.457686:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:3.0:1762166980.457692:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5bb9c00 with x1847765450654336 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166980.457701:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc5bb9c00. 00000100:00100000:1.0:1762166980.457711:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450654464 00000100:00100000:2.0:1762166980.457719:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2616 00000100:00100000:1.0:1762166980.457719:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450654464 00000100:00100000:0.0:1762166980.457734:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2617 00000100:00100000:2.0:1762166980.457740:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450654208:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:1.0:1762166980.457747:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00000100:00100000:0.0:1762166980.457749:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450654336:12345-192.168.204.38@tcp:10:fsx.0 00002000:00100000:1.0:1762166980.457751:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5bb8700 with x1847765450654464 ext(0->18446744073709551615) 00002000:00010000:1.0:1762166980.457758:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5bb8700. 00000100:00100000:1.0:1762166980.457790:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2618 00000100:00100000:1.0:1762166980.457799:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450654464:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:1.0:1762166980.457923:0:14623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166980.457923:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166980.457927:0:14623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00002000:00010000:0.0:1762166980.457927:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00002000:00010000:1.0:1762166980.457931:0:14623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00002000:00010000:0.0:1762166980.457931:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00002000:00010000:1.0:1762166980.457935:0:14623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:0.0:1762166980.457935:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:2.0:1762166980.457939:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 247325 -> 247947 00002000:00010000:1.0:1762166980.457940:0:14623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:0.0:1762166980.457940:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00002000:00010000:2.0:1762166980.457948:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00002000:00010000:2.0:1762166980.457951:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00002000:00010000:2.0:1762166980.457954:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:2.0:1762166980.457956:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 32 -> 32 00000100:00100000:1.0:1762166980.457991:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765450654464:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 192us (364us total) trans 17179876625 rc 0/0 00000100:00100000:0.0:1762166980.457991:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450654336:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 247us (422us total) trans 21474843417 rc 0/0 00000100:00100000:2.0:1762166980.457993:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765450654208:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 262us (512us total) trans 17179876626 rc 0/0 00000100:00100000:0.0:1762166980.458008:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2617 00002000:00010000:0.0:1762166980.458013:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00000100:00100000:2.0:1762166980.458017:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2616 00002000:00100000:0.0:1762166980.458018:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5bb9c00 with x1847765450654336 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166980.458025:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (247947->18446744073709551615) 00000100:00100000:1.0:1762166980.458025:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2618 00002000:00010000:0.0:1762166980.458027:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc5bb9c00. 00002000:00100000:2.0:1762166980.458033:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5bba680 with x1847765450654208 ext(247947->18446744073709551615) 00002000:00010000:1.0:1762166980.458033:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:1.0:1762166980.458039:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5bb8700 with x1847765450654464 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166980.458044:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5bba680. 00002000:00010000:1.0:1762166980.458048:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5bb8700. 00000100:00100000:0.0:1762166980.459210:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.459263:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450654592 00000100:00100000:2.0:1762166980.459268:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450654592 00000100:00100000:2.0:1762166980.459303:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30756 00000100:00100000:2.0:1762166980.459308:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+525:61766:x1847765450654592:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:2.0:1762166980.459325:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166980.459343:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194200/0x2f180c4effbac58e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea636 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.459443:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194800/0x2f180c4effbac595 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166980.459459:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194800/0x2f180c4effbac595 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.459472:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194800/0x2f180c4effbac595 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:2.0:1762166980.459525:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 247949 00000004:00200000:2.0:1762166980.459529:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166980.459544:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194800/0x2f180c4effbac595 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.459566:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194200/0x2f180c4effbac58e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea636 expref: 527 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.459582:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194800/0x2f180c4effbac595 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea636 expref: 526 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.459591:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166980.459595:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166980.459599:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc7194800, rc 0) 00000100:00100000:2.0:1762166980.459632:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+526:61766:x1847765450654592:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 324us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166980.459639:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30756 00000100:00100000:3.0:1762166980.462032:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.462122:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450654848 00000100:00100000:0.0:1762166980.462132:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450654848 00000100:00100000:0.0:1762166980.462179:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11951 00000100:00100000:0.0:1762166980.462189:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc3550380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+526:61766:x1847765450654848:12345-192.168.204.38@tcp:35:fsx.0 00000100:00100000:0.0:1762166980.462401:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc3550380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+527:61766:x1847765450654848:12345-192.168.204.38@tcp:35:fsx.0 Request processed in 213us (377us total) trans 4294992405 rc 0/0 00000100:00100000:0.0:1762166980.462409:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11951 00000100:00100000:0.0:1762166980.471528:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.471596:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450655104 00000100:00100000:2.0:1762166980.471607:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450655104 00000100:00100000:2.0:1762166980.471666:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30757 00000100:00100000:2.0:1762166980.471675:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+527:61874:x1847765450655104:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166980.471696:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166980.471717:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194200/0x2f180c4effbac59c lrc: 2/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea63d expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.471797:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7ba00/0x2f180c4effbac5a3 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166980.471810:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7ba00/0x2f180c4effbac5a3 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.471831:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7ba00/0x2f180c4effbac5a3 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.471845:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7b600/0x2f180c4effbac5aa lrc: 3/1,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166980.471852:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7b600/0x2f180c4effbac5aa lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.471858:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7b600/0x2f180c4effbac5aa lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.471976:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7b000/0x2f180c4effbac5b1 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166980.471986:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7b000/0x2f180c4effbac5b1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.471992:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7b000/0x2f180c4effbac5b1 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:2.0:1762166980.472001:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 247949 00010000:00010000:2.0:1762166980.472082:0:6494:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7ba00/0x2f180c4effbac5a3 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.472089:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7ba00/0x2f180c4effbac5a3 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.472095:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7ba00/0x2f180c4effbac5a3 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.472101:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7ba00/0x2f180c4effbac5a3 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.472107:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8c7ba00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166980.472111:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7ba00/0x2f180c4effbac5a3 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.472118:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7ba00/0x2f180c4effbac5a3 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.472129:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0x0 (ffff945bc809b100) 00010000:00010000:2.0:1762166980.472132:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166980.472136:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7ba00/0x2f180c4effbac5a3 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.472142:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7ba00/0x2f180c4effbac5a3 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.472155:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7b600/0x2f180c4effbac5aa lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.472161:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7b600/0x2f180c4effbac5aa lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.472166:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7b600/0x2f180c4effbac5aa lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.472170:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8c7b600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166980.472173:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7b600/0x2f180c4effbac5aa lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.472178:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7b600/0x2f180c4effbac5aa lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.472185:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0xdd396665 (ffff945bc809bd00) 00010000:00010000:2.0:1762166980.472187:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166980.472190:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7b600/0x2f180c4effbac5aa lrc: 2/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.472195:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7b600/0x2f180c4effbac5aa lrc: 0/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.472235:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194200/0x2f180c4effbac59c lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea63d expref: 530 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.472250:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7b000/0x2f180c4effbac5b1 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea63d expref: 529 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.472257:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166980.472260:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166980.472262:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8c7b000, rc 0) 00000100:00100000:2.0:1762166980.472320:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+529:61874:x1847765450655104:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 646us (799us total) trans 4294992406 rc 0/0 00000100:00100000:2.0:1762166980.472328:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30757 00000100:00100000:1.0:1762166980.473749:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.473794:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450655232 00000100:00100000:3.0:1762166980.473800:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450655232 00000100:00100000:3.0:1762166980.473854:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 894 00000100:00100000:3.0:1762166980.473862:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+529:2416:x1847765450655232:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166980.473873:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166980.473888:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7b000/0x2f180c4effbac5b1 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea63d expref: 529 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.473901:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:3.0:1762166980.473905:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166980.473937:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+528:2416:x1847765450655232:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 76us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166980.473944:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 894 00000100:00100000:3.0:1762166980.474185:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.474253:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450655488 00000100:00100000:0.0:1762166980.474257:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450655488 00000100:00100000:0.0:1762166980.474291:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11952 00000100:00100000:0.0:1762166980.474299:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc3551880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+528:61874:x1847765450655488:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166980.474428:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc3551880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+529:61874:x1847765450655488:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 129us (242us total) trans 4294992407 rc 0/0 00000100:00100000:0.0:1762166980.474435:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11952 00000100:00100000:0.0:1762166980.475618:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.475672:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450655744 00000100:00100000:2.0:1762166980.475678:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450655744 00000100:00100000:2.0:1762166980.475718:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30758 00000100:00100000:2.0:1762166980.475727:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+529:61874:x1847765450655744:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166980.475756:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166980.475776:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7a600/0x2f180c4effbac5bf lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea644 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.475861:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7ac00/0x2f180c4effbac5c6 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166980.475873:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7ac00/0x2f180c4effbac5c6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.475883:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7ac00/0x2f180c4effbac5c6 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:2.0:1762166980.475892:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 247949 00010000:00010000:2.0:1762166980.475961:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7a600/0x2f180c4effbac5bf lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea644 expref: 532 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.475974:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7ac00/0x2f180c4effbac5c6 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea644 expref: 531 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.475982:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166980.475985:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1762166980.475988:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8c7ac00, rc 0) 00000100:00100000:2.0:1762166980.476030:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+531:61874:x1847765450655744:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 305us (413us total) trans 4294992408 rc 0/0 00000100:00100000:2.0:1762166980.476038:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30758 00000100:00100000:1.0:1762166980.477771:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.477812:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450656000 00000100:00100000:2.0:1762166980.477818:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450656000 00000100:00100000:2.0:1762166980.477864:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30759 00000100:00100000:2.0:1762166980.477874:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+531:61874:x1847765450656000:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166980.477889:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166980.477900:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7b600/0x2f180c4effbac5d4 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea64b expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.477988:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7ba00/0x2f180c4effbac5db lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166980.478002:0:6494:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194800/0x2f180c4effbac595 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea636 expref: 532 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.478011:0:6494:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7ba00/0x2f180c4effbac5db lrc: 4/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.478044:0:6494:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194800/0x2f180c4effbac595 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea636 expref: 532 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.478058:0:6494:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194800/0x2f180c4effbac595 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea636 expref: 532 pid: 6494 timeout: 699 lvb_type: 0 00000100:00100000:2.0:1762166980.478073:0:6494:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5764a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765449770240:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166980.478148:0:6494:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a1c00 going to sleep for 11 seconds 00000100:00100000:2.0:1762166980.479029:0:6494:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5764a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765449770240:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166980.479046:0:6494:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7ba00/0x2f180c4effbac5db lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000100:00100000:1.0:1762166980.479230:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.479271:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450656128 00000100:00100000:3.0:1762166980.479278:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450656128 00010000:00010000:3.0:1762166980.479342:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194800/0x2f180c4effbac595 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea636 expref: 533 pid: 6494 timeout: 699 lvb_type: 0 00000100:00100000:3.0:1762166980.479377:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9755 00000100:00100000:3.0:1762166980.479386:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945d0207fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+533:2419:x1847765450656128:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166980.479397:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166980.479402:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194800/0x2f180c4effbac595 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea636 expref: 533 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:3.0:1762166980.479414:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194800/0x2f180c4effbac595 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea636 expref: 533 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:3.0:1762166980.479431:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194800/0x2f180c4effbac595 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea636 expref: 533 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:3.0:1762166980.479444:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:3.0:1762166980.479448:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7ba00/0x2f180c4effbac5db lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.479456:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7ba00/0x2f180c4effbac5db lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.479467:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7ba00/0x2f180c4effbac5db lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.479510:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166980.479531:0:6494:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7ba00/0x2f180c4effbac5db lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.479542:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7ba00/0x2f180c4effbac5db lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000100:00100000:3.0:1762166980.479547:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945d0207fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+532:2419:x1847765450656128:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 159us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166980.479564:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9755 00000004:00200000:2.0:1762166980.479584:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 247949 00010000:00010000:2.0:1762166980.479681:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7b600/0x2f180c4effbac5d4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea64b expref: 533 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.479695:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7ba00/0x2f180c4effbac5db lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea64b expref: 532 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.479703:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166980.479706:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1762166980.479709:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8c7ba00, rc 0) 00000100:00100000:2.0:1762166980.479743:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+532:61874:x1847765450656000:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1870us (1974us total) trans 4294992409 rc 0/0 00000100:00100000:2.0:1762166980.479751:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30759 00000100:00100000:1.0:1762166980.481065:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.481111:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450656256 00000100:00100000:0.0:1762166980.481116:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450656256 00000100:00100000:0.0:1762166980.481147:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11953 00000100:00100000:0.0:1762166980.481152:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+532:61874:x1847765450656256:12345-192.168.204.38@tcp:33:lfs.0 00000100:00100000:0.0:1762166980.481237:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+532:61874:x1847765450656256:12345-192.168.204.38@tcp:33:lfs.0 Request processed in 85us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166980.481241:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11953 00000100:00100000:3.0:1762166980.481910:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.481961:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450656512 00000100:00100000:0.0:1762166980.481966:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450656512 00000100:00100000:0.0:1762166980.481995:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11954 00000100:00100000:0.0:1762166980.482004:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc3550000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+532:61874:x1847765450656512:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166980.482119:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc3550000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+533:61874:x1847765450656512:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 116us (209us total) trans 4294992410 rc 0/0 00000100:00100000:0.0:1762166980.482126:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11954 00000100:00100000:1.0:1762166980.482918:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.482957:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450656768 00000100:00100000:2.0:1762166980.482961:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450656768 00000100:00100000:2.0:1762166980.482992:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30760 00000100:00100000:2.0:1762166980.482998:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+533:61874:x1847765450656768:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166980.483008:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166980.483010:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:2.0:1762166980.483025:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7ba00/0x2f180c4effbac5db lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea64b expref: 533 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.483038:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7ac00/0x2f180c4effbac5c6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea644 expref: 532 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.483048:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166980.483052:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166980.483064:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7aa00/0x2f180c4effbac5e9 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea652 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.483121:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7b000/0x2f180c4effbac5f0 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166980.483132:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7b000/0x2f180c4effbac5f0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.483140:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7b000/0x2f180c4effbac5f0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:2.0:1762166980.483149:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 247949 00010000:00010000:2.0:1762166980.483210:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7aa00/0x2f180c4effbac5e9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea652 expref: 534 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.483222:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7b000/0x2f180c4effbac5f0 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea652 expref: 533 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.483229:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166980.483232:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166980.483234:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8c7b000, rc 0) 00000100:00100000:2.0:1762166980.483270:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+533:61874:x1847765450656768:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 272us (355us total) trans 4294992411 rc 0/0 00000100:00100000:2.0:1762166980.483275:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30760 00000100:00100000:1.0:1762166980.484068:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.484106:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450657024 00000100:00100000:0.0:1762166980.484110:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450657024 00000100:00100000:0.0:1762166980.484137:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11955 00000100:00100000:0.0:1762166980.484144:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7be2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+533:61874:x1847765450657024:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:0.0:1762166980.484179:0:19593:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x240000404:0x5eb:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7b000/0x2f180c4effbac5f0 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea652 expref: 533 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.484199:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac5fe lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166980.484208:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847f600/0x2f180c4effbac54f lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea613 expref: 533 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.484216:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa29a00/0x2f180c4effbac564 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea61a expref: 533 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.484223:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac5fe lrc: 5/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166980.484249:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa29a00/0x2f180c4effbac564 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea61a expref: 533 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.484259:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa29a00/0x2f180c4effbac564 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea61a expref: 533 pid: 6494 timeout: 699 lvb_type: 0 00000100:00100000:0.0:1762166980.484272:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bb9880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449770368:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166980.484331:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847f600/0x2f180c4effbac54f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea613 expref: 533 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.484337:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847f600/0x2f180c4effbac54f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea613 expref: 533 pid: 6494 timeout: 699 lvb_type: 0 00000100:00100000:0.0:1762166980.484343:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bbb480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449770496:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166980.484362:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1fe26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166980.485021:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bb9880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449770368:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166980.485037:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bbb480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449770496:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166980.485055:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac5fe lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:1.0:1762166980.485249:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.485272:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.485293:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450657280 00000100:00100000:3.0:1762166980.485302:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450657280 00000100:00100000:0.0:1762166980.485311:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450657152 00000100:00100000:0.0:1762166980.485318:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450657152 00010000:00010000:3.0:1762166980.485338:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847f600/0x2f180c4effbac54f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea613 expref: 535 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:0.0:1762166980.485342:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa29a00/0x2f180c4effbac564 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea61a expref: 535 pid: 6494 timeout: 699 lvb_type: 0 00000100:00100000:3.0:1762166980.485415:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9756 00000100:00100000:3.0:1762166980.485426:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+535:2419:x1847765450657280:12345-192.168.204.38@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1762166980.485437:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9757 00010000:00010000:3.0:1762166980.485446:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166980.485454:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847f600/0x2f180c4effbac54f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea613 expref: 535 pid: 6494 timeout: 699 lvb_type: 0 00000100:00100000:0.0:1762166980.485465:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+535:2418:x1847765450657152:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166980.485471:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847f600/0x2f180c4effbac54f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea613 expref: 535 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:0.0:1762166980.485519:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166980.485529:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa29a00/0x2f180c4effbac564 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea61a expref: 535 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:3.0:1762166980.485531:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847f600/0x2f180c4effbac54f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea613 expref: 535 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:0.0:1762166980.485576:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa29a00/0x2f180c4effbac564 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea61a expref: 534 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:3.0:1762166980.485583:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:3.0:1762166980.485588:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac5fe lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166980.485595:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac5fe lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166980.485600:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166980.485611:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcaa29a00/0x2f180c4effbac564 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea61a expref: 534 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:0.0:1762166980.485622:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:0.0:1762166980.485625:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac5fe lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166980.485631:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac5fe lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166980.485635:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac5fe lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00000100:00100000:3.0:1762166980.485642:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+533:2419:x1847765450657280:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 217us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166980.485651:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9756 00010000:00010000:0.0:1762166980.485669:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166980.485690:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac5fe lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166980.485698:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac5fe lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:0.0:1762166980.485703:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+532:2418:x1847765450657152:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 255us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166980.485710:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9757 00010000:00010000:2.0:1762166980.485870:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac5fe lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166980.485876:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac5fe lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166980.485880:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac5fe lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166980.485884:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdf600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166980.485887:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac5fe lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166980.485891:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac5fe lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166980.485897:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166980.485898:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1762166980.485900:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac5fe lrc: 2/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166980.485904:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac5fe lrc: 0/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166980.485911:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166980.485912:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166980.485915:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7b000/0x2f180c4effbac5f0 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea652 expref: 531 pid: 6494 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166980.485986:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7be2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+531:61874:x1847765450657024:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 1843us (1919us total) trans 4294992412 rc -22/-22 00000100:00100000:2.0:1762166980.485993:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11955 00000100:00100000:1.0:1762166980.486652:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.486695:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450657408 00000100:00100000:2.0:1762166980.486701:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450657408 00000100:00100000:2.0:1762166980.486741:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30761 00000100:00100000:2.0:1762166980.486751:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+531:61874:x1847765450657408:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166980.486764:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166980.486778:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7a600/0x2f180c4effbac605 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea659 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.486808:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7a600/0x2f180c4effbac605 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea659 expref: 532 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.486815:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7a600/0x2f180c4effbac605 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea659 expref: 532 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.486839:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b100) 00010000:00010000:2.0:1762166980.486841:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166980.486842:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8c7a600, rc 0) 00000100:00100000:2.0:1762166980.486870:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+532:61874:x1847765450657408:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 123us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166980.486874:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30761 00000100:00100000:3.0:1762166980.487972:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.488004:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450657664 00000100:00100000:2.0:1762166980.488009:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450657664 00000100:00100000:2.0:1762166980.488034:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30762 00000100:00100000:2.0:1762166980.488040:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc3551180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+532:61874:x1847765450657664:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166980.488048:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166980.488056:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194200/0x2f180c4effbac60c lrc: 2/0,0 mode: --/CW res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea660 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.488359:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5ae4800/0x2f180c4effbac613 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x61a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166980.488368:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5ae4800/0x2f180c4effbac613 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x61a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.488373:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5ae4800/0x2f180c4effbac613 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x61a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:2.0:1762166980.488379:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x61a:0x0]: returning size 0 00010000:00010000:2.0:1762166980.488412:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194200/0x2f180c4effbac60c lrc: 0/0,0 mode: --/CW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea660 expref: 535 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.488427:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5ae4800/0x2f180c4effbac613 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x61a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea660 expref: 534 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.488432:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x61a:0x0].0x0 (ffff945bc809ba00) 00010000:00010000:2.0:1762166980.488434:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166980.488435:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc5ae4800, rc 0) 00000100:00100000:2.0:1762166980.488466:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc3551180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+534:61874:x1847765450657664:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 427us (496us total) trans 4294992413 rc 0/0 00000100:00100000:2.0:1762166980.488470:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30762 00000100:00100000:1.0:1762166980.489681:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.489739:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450657920 00000100:00100000:2.0:1762166980.489747:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450657920 00000100:00100000:2.0:1762166980.489801:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30763 00000100:00100000:2.0:1762166980.489812:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+534:61874:x1847765450657920:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166980.489842:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166980.489857:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5ae4a00/0x2f180c4effbac621 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea667 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.489942:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7b600/0x2f180c4effbac628 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166980.489955:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7b600/0x2f180c4effbac628 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.489965:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7b600/0x2f180c4effbac628 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:2.0:1762166980.489975:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 247949 00010000:00010000:2.0:1762166980.490058:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5ae4a00/0x2f180c4effbac621 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea667 expref: 537 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.490072:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7b600/0x2f180c4effbac628 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea667 expref: 536 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.490080:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b100) 00010000:00010000:2.0:1762166980.490083:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166980.490086:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8c7b600, rc 0) 00000100:00100000:2.0:1762166980.490128:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+536:61874:x1847765450657920:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 320us (449us total) trans 4294992414 rc 0/0 00000100:00100000:2.0:1762166980.490136:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30763 00000100:00100000:1.0:1762166980.490975:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.491015:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450658176 00000100:00100000:2.0:1762166980.491019:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450658176 00000100:00100000:2.0:1762166980.491048:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11956 00000100:00100000:2.0:1762166980.491053:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+536:61874:x1847765450658176:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:2.0:1762166980.491089:0:19593:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x240000404:0x5eb:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7b600/0x2f180c4effbac628 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea667 expref: 536 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.491107:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc7d17000/0x2f180c4effbac636 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:2.0:1762166980.491117:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7a600/0x2f180c4effbac605 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea659 expref: 536 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.491123:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc7d17000/0x2f180c4effbac636 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166980.491151:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7a600/0x2f180c4effbac605 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea659 expref: 536 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.491163:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7a600/0x2f180c4effbac605 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea659 expref: 536 pid: 6494 timeout: 699 lvb_type: 0 00000100:00100000:2.0:1762166980.491177:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5764a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449770624:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166980.491245:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc4eeae40 going to sleep for 11 seconds 00000100:00100000:3.0:1762166980.492089:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.492093:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5764a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449770624:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166980.492112:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945cc7d17000/0x2f180c4effbac636 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:0.0:1762166980.492140:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450658304 00000100:00100000:0.0:1762166980.492150:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450658304 00010000:00010000:0.0:1762166980.492185:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7a600/0x2f180c4effbac605 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea659 expref: 537 pid: 6494 timeout: 699 lvb_type: 0 00000100:00100000:0.0:1762166980.492222:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9758 00000100:00100000:0.0:1762166980.492233:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc3550380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+537:2418:x1847765450658304:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166980.492246:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166980.492254:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7a600/0x2f180c4effbac605 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea659 expref: 537 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:0.0:1762166980.492267:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7a600/0x2f180c4effbac605 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea659 expref: 537 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:0.0:1762166980.492285:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7a600/0x2f180c4effbac605 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea659 expref: 537 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:0.0:1762166980.492300:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b100) 00010000:00010000:0.0:1762166980.492304:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc7d17000/0x2f180c4effbac636 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166980.492313:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc7d17000/0x2f180c4effbac636 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166980.492319:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc7d17000/0x2f180c4effbac636 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166980.492348:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166980.492380:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945cc7d17000/0x2f180c4effbac636 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166980.492387:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc7d17000/0x2f180c4effbac636 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:0.0:1762166980.492395:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc3550380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+536:2418:x1847765450658304:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 165us (307us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166980.492401:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc7d16400/0x2f180c4effbac63d lrc: 3/0,1 mode: --/EX res: [0x240000404:0x61a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00000100:00100000:0.0:1762166980.492407:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9758 00010000:00010000:2.0:1762166980.492413:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5ae4800/0x2f180c4effbac613 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x61a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea660 expref: 536 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.492422:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc7d16400/0x2f180c4effbac63d lrc: 4/0,1 mode: --/EX res: [0x240000404:0x61a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166980.492445:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5ae4800/0x2f180c4effbac613 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x61a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea660 expref: 535 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.492455:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5ae4800/0x2f180c4effbac613 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x61a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea660 expref: 535 pid: 6494 timeout: 699 lvb_type: 0 00000100:00100000:2.0:1762166980.492465:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5764a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449770752:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166980.492570:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc4eeae40 going to sleep for 11 seconds 00000100:00100000:2.0:1762166980.493204:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5764a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449770752:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166980.493220:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945cc7d16400/0x2f180c4effbac63d lrc: 3/0,1 mode: --/EX res: [0x240000404:0x61a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:1.0:1762166980.493376:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.493417:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450658432 00000100:00100000:0.0:1762166980.493423:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450658432 00010000:00010000:0.0:1762166980.493441:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5ae4800/0x2f180c4effbac613 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x61a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea660 expref: 536 pid: 6494 timeout: 699 lvb_type: 0 00000100:00100000:0.0:1762166980.493469:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9759 00000100:00100000:0.0:1762166980.493521:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+536:2418:x1847765450658432:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166980.493533:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166980.493539:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5ae4800/0x2f180c4effbac613 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x61a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea660 expref: 536 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:0.0:1762166980.493550:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5ae4800/0x2f180c4effbac613 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x61a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea660 expref: 536 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:0.0:1762166980.493563:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5ae4800/0x2f180c4effbac613 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x61a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea660 expref: 536 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:0.0:1762166980.493574:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x61a:0x0].0x0 (ffff945bc809ba00) 00010000:00010000:0.0:1762166980.493577:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc7d16400/0x2f180c4effbac63d lrc: 3/0,1 mode: --/EX res: [0x240000404:0x61a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166980.493585:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc7d16400/0x2f180c4effbac63d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x61a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166980.493591:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc7d16400/0x2f180c4effbac63d lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x61a:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166980.493610:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166980.493625:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945cc7d16400/0x2f180c4effbac63d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x61a:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166980.493634:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc7d16400/0x2f180c4effbac63d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x61a:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:0.0:1762166980.493644:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+535:2418:x1847765450658432:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 166us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166980.493652:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9759 00000100:00100000:2.0:1762166980.493891:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5764a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449770880:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762166980.493931:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166980.493951:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cee171000 going to sleep for 11 seconds 00000100:00100000:0.0:1762166980.493971:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449770880 00000100:00100000:0.0:1762166980.493976:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449770880 00000100:00100000:0.0:1762166980.494007:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1451 00000100:00100000:0.0:1762166980.494015:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5767100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:19593:x1847765449770880:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166980.494085:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5767100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:19593:x1847765449770880:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 71us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166980.494093:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1451 00000100:00100000:2.0:1762166980.494116:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5764a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449770880:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762166980.494154:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5764a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449771008:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762166980.494176:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166980.494197:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cee171000 going to sleep for 11 seconds 00000100:00100000:0.0:1762166980.494207:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449771008 00000100:00100000:0.0:1762166980.494213:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449771008 00000100:00100000:0.0:1762166980.494238:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1452 00000100:00100000:0.0:1762166980.494245:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5767b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:19593:x1847765449771008:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166980.494299:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5767b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:19593:x1847765449771008:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 55us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166980.494307:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1452 00000100:00100000:2.0:1762166980.494326:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5764a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449771008:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762166980.494369:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5764a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449771136:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762166980.494392:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166980.494412:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc2d6af00 going to sleep for 11 seconds 00000100:00100000:0.0:1762166980.494429:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449771136 00000100:00100000:0.0:1762166980.494433:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449771136 00000100:00100000:0.0:1762166980.494454:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1453 00000100:00100000:0.0:1762166980.494459:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5764e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:19593:x1847765449771136:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166980.494515:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5764e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:19593:x1847765449771136:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 56us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166980.494521:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1453 00000100:00100000:2.0:1762166980.494535:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5764a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449771136:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762166980.494565:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5764a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449771264:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762166980.494587:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166980.494606:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cff1fa300 going to sleep for 11 seconds 00000100:00100000:0.0:1762166980.494617:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449771264 00000100:00100000:0.0:1762166980.494622:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449771264 00000100:00100000:0.0:1762166980.494646:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1454 00000100:00100000:0.0:1762166980.494652:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5765c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:19593:x1847765449771264:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166980.494715:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5765c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:19593:x1847765449771264:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 63us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166980.494723:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1454 00000100:00100000:2.0:1762166980.494734:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5764a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449771264:0@lo:1000:mdt_rdpg00_003.0 00000040:00080000:2.0:1762166980.494856:0:19593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x2:0x0].61, 280 off71152 00000001:00080000:2.0:1762166980.494863:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992415 00000100:00100000:2.0:1762166980.494892:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5764a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449771392:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762166980.494907:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166980.494921:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cee171300 going to sleep for 11 seconds 00000100:00100000:0.0:1762166980.494933:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449771392 00000100:00100000:0.0:1762166980.494936:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449771392 00000100:00100000:0.0:1762166980.494955:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1455 00000100:00100000:0.0:1762166980.494959:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5767800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:19593:x1847765449771392:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166980.495030:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5767800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:19593:x1847765449771392:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 70us (121us total) trans 17179876627 rc 0/0 00000100:00100000:0.0:1762166980.495034:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1455 00000100:00100000:2.0:1762166980.495056:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5764a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449771392:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762166980.495073:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5765880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449771520:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762166980.495088:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166980.495104:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc2d6af00 going to sleep for 11 seconds 00000100:00100000:1.0:1762166980.495120:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449771520 00000100:00100000:1.0:1762166980.495124:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449771520 00000100:00100000:1.0:1762166980.495147:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1456 00000100:00100000:1.0:1762166980.495153:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5766d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:19593:x1847765449771520:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166980.495222:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5766d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+12:19593:x1847765449771520:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 69us (131us total) trans 21474843418 rc 0/0 00000100:00100000:1.0:1762166980.495230:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1456 00000100:00100000:2.0:1762166980.495241:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5765880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449771520:0@lo:1000:mdt_rdpg00_003.0 00000001:00080000:2.0:1762166980.495280:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992416 00010000:00010000:2.0:1762166980.495300:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc7d16400/0x2f180c4effbac63d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x61a:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166980.495308:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc7d16400/0x2f180c4effbac63d lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x61a:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166980.495315:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc7d16400/0x2f180c4effbac63d lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x61a:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166980.495320:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc7d16400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166980.495323:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc7d16400/0x2f180c4effbac63d lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x61a:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166980.495328:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc7d16400/0x2f180c4effbac63d lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x61a:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166980.495335:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x61a:0x0].0x0 (ffff945bc809ba00) 00010000:00010000:2.0:1762166980.495337:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1762166980.495339:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc7d16400/0x2f180c4effbac63d lrc: 2/0,0 mode: --/EX res: [0x240000404:0x61a:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166980.495343:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc7d16400/0x2f180c4effbac63d lrc: 0/0,0 mode: --/EX res: [0x240000404:0x61a:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166980.495352:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc7d17000/0x2f180c4effbac636 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166980.495356:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc7d17000/0x2f180c4effbac636 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166980.495359:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc7d17000/0x2f180c4effbac636 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166980.495361:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc7d17000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166980.495363:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc7d17000/0x2f180c4effbac636 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166980.495366:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc7d17000/0x2f180c4effbac636 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166980.495372:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b100) 00010000:00010000:2.0:1762166980.495374:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1762166980.495375:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc7d17000/0x2f180c4effbac636 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166980.495378:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc7d17000/0x2f180c4effbac636 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166980.495384:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b100) 00010000:00010000:2.0:1762166980.495386:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166980.495389:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7b600/0x2f180c4effbac628 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea667 expref: 537 pid: 6494 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166980.495440:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+536:61874:x1847765450658176:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 4385us (4465us total) trans 4294992417 rc 0/0 00000100:00100000:2.0:1762166980.495448:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11956 00000020:00080000:2.0:1762166980.495451:0:19593:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1762166980.496343:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.496385:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450658560 00000100:00100000:2.0:1762166980.496390:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450658560 00000100:00100000:2.0:1762166980.496420:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30764 00000100:00100000:2.0:1762166980.496425:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+536:61874:x1847765450658560:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166980.496437:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166980.496448:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7b000/0x2f180c4effbac644 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea66e expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.496474:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7b000/0x2f180c4effbac644 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea66e expref: 537 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.496505:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7b000/0x2f180c4effbac644 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea66e expref: 537 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.496517:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166980.496519:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166980.496522:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc8c7b000, rc 0) 00000100:00100000:2.0:1762166980.496549:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+537:61874:x1847765450658560:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 124us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166980.496553:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30764 00000100:00100000:3.0:1762166980.497795:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.497837:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450658816 00000100:00100000:2.0:1762166980.497842:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450658816 00000100:00100000:2.0:1762166980.497868:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11957 00000100:00100000:2.0:1762166980.497874:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc3551880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+537:61874:x1847765450658816:12345-192.168.204.38@tcp:35:lfs.0 00000004:00080000:2.0:1762166980.498035:0:19593:0:(mdd_object.c:3965:mdd_close()) Object [0x240000404:0x61a:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1762166980.498080:0:19593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5929, 64 off464496 00000040:00080000:2.0:1762166980.498097:0:19593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5930, 64 off464496 00000001:00080000:2.0:1762166980.498101:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992418 00010000:00010000:2.0:1762166980.498124:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7aa00/0x2f180c4effbac64b lrc: 3/0,1 mode: --/PW res: [0x240000404:0x61a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:2.0:1762166980.498133:0:19593:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7aa00/0x2f180c4effbac64b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x61a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166980.498140:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7aa00/0x2f180c4effbac64b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x61a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166980.498146:0:19593:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7aa00/0x2f180c4effbac64b lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x61a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166980.498152:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7aa00/0x2f180c4effbac64b lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x61a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166980.498160:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7aa00/0x2f180c4effbac64b lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x61a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166980.498180:0:19593:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1762166980.498213:0:10256:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1762166980.498220:0:10256:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7aa00/0x2f180c4effbac64b lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x61a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166980.498229:0:10256:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8c7aa00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166980.498233:0:10256:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7aa00/0x2f180c4effbac64b lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x61a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166980.498242:0:10256:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7aa00/0x2f180c4effbac64b lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x61a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166980.498253:0:10256:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x61a:0x0].0x0 (ffff945bc809bc00) 00010000:00010000:0.0:1762166980.498256:0:10256:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1762166980.498261:0:10256:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7aa00/0x2f180c4effbac64b lrc: 1/0,0 mode: --/PW res: [0x240000404:0x61a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166980.498267:0:10256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7aa00/0x2f180c4effbac64b lrc: 0/0,0 mode: --/PW res: [0x240000404:0x61a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 19593 initiator: MDT1 00000100:00100000:2.0:1762166980.498284:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc3551880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+539:61874:x1847765450658816:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 409us (490us total) trans 4294992419 rc 0/0 00010000:00010000:0.0:1762166980.498284:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166980.498288:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166980.498291:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1762166980.498292:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11957 00000020:00080000:2.0:1762166980.498297:0:19593:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1762166980.499057:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.499096:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450659072 00000100:00100000:2.0:1762166980.499101:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450659072 00000100:00100000:2.0:1762166980.499128:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11958 00000100:00100000:2.0:1762166980.499134:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+539:61874:x1847765450659072:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:2.0:1762166980.499240:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+540:61874:x1847765450659072:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 107us (185us total) trans 4294992420 rc 0/0 00000100:00100000:2.0:1762166980.499245:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11958 00000100:00100000:1.0:1762166980.500966:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.501010:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450659328 00000100:00100000:2.0:1762166980.501016:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450659328 00000100:00100000:2.0:1762166980.501050:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30765 00000100:00100000:2.0:1762166980.501055:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+540:61766:x1847765450659328:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:2.0:1762166980.501069:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166980.501082:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7ac00/0x2f180c4effbac652 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea675 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.501126:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7ba00/0x2f180c4effbac659 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166980.501133:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7ba00/0x2f180c4effbac659 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.501140:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7ba00/0x2f180c4effbac659 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.501151:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945d02174400/0x2f180c4effbac660 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166980.501157:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945d02174400/0x2f180c4effbac660 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.501163:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945d02174400/0x2f180c4effbac660 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.501238:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945d02174e00/0x2f180c4effbac667 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166980.501246:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945d02174e00/0x2f180c4effbac667 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.501254:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945d02174e00/0x2f180c4effbac667 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:2.0:1762166980.501262:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 247947 00010000:00010000:2.0:1762166980.501314:0:6494:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7ba00/0x2f180c4effbac659 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.501321:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7ba00/0x2f180c4effbac659 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.501327:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7ba00/0x2f180c4effbac659 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.501332:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7ba00/0x2f180c4effbac659 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.501337:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc8c7ba00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166980.501349:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7ba00/0x2f180c4effbac659 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.501356:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7ba00/0x2f180c4effbac659 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.501365:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0x0 (ffff945bc809b300) 00010000:00010000:2.0:1762166980.501368:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166980.501375:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7ba00/0x2f180c4effbac659 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.501381:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7ba00/0x2f180c4effbac659 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.501391:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945d02174400/0x2f180c4effbac660 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.501395:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945d02174400/0x2f180c4effbac660 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.501399:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945d02174400/0x2f180c4effbac660 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.501401:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945d02174400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166980.501403:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945d02174400/0x2f180c4effbac660 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.501406:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945d02174400/0x2f180c4effbac660 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.501410:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0xdd396665 (ffff945bc809b500) 00010000:00010000:2.0:1762166980.501411:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166980.501413:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945d02174400/0x2f180c4effbac660 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.501419:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945d02174400/0x2f180c4effbac660 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.501445:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7ac00/0x2f180c4effbac652 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea675 expref: 543 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.501453:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945d02174e00/0x2f180c4effbac667 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea675 expref: 542 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.501458:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166980.501459:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166980.501461:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945d02174e00, rc 0) 00000100:00100000:2.0:1762166980.501529:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+542:61766:x1847765450659328:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 473us (569us total) trans 4294992421 rc 0/0 00000100:00100000:2.0:1762166980.501534:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30765 00000100:00100000:3.0:1762166980.503141:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.503214:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450659456 00000100:00100000:1.0:1762166980.503223:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450659456 00000100:00100000:1.0:1762166980.503286:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2619 00000100:00100000:1.0:1762166980.503295:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc3550000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+22:2416:x1847765450659456:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:1.0:1762166980.503570:0:14623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 247947 -> 247947 00002000:00010000:1.0:1762166980.503573:0:14623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00002000:00010000:1.0:1762166980.503575:0:14623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00002000:00010000:1.0:1762166980.503577:0:14623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:1.0:1762166980.503579:0:14623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 32 -> 48 00000100:00100000:1.0:1762166980.503625:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc3550000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+24:2416:x1847765450659456:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 332us (486us total) trans 17179876628 rc 0/0 00000100:00100000:1.0:1762166980.503630:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2619 00000100:00100000:1.0:1762166980.505214:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.505278:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450659584 00000100:00100000:0.0:1762166980.505282:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450659584 00002000:00100000:0.0:1762166980.505310:0:14623:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xa77:0x0] (36864->65535) req@ffff945cf3db7100 x1847765450659584/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 488/0 e 0 to 0 dl 1762166991 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166980.505319:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf3db7100 with x1847765450659584 ext(36864->65535) 00002000:00010000:0.0:1762166980.505327:0:14623:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf3db7100 00000100:00100000:0.0:1762166980.505350:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2620 00000100:00100000:0.0:1762166980.505360:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765450659584:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:1.0:1762166980.506505:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765450659584:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 1143us (1288us total) trans 0 rc 28672/28672 00000100:00100000:1.0:1762166980.506516:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2620 00002000:00100000:1.0:1762166980.506527:0:14623:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xa77:0x0] (36864->65535) req@ffff945cf3db7100 x1847765450659584/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 488/440 e 0 to 0 dl 1762166991 ref 1 fl Complete:/600/0 rc 28672/28672 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166980.506537:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf3db7100 with x1847765450659584 ext(36864->65535) 00002000:00010000:1.0:1762166980.506542:0:14623:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf3db7100 00000100:00100000:2.0:1762166980.507870:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.507925:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450659712 00000100:00100000:0.0:1762166980.507934:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450659712 00000100:00100000:0.0:1762166980.507978:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30766 00000100:00100000:0.0:1762166980.507987:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5766a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+542:61766:x1847765450659712:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:0.0:1762166980.508008:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166980.508028:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac675 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea67c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.508062:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbac67c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166980.508076:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbac67c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.508088:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbac67c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.508202:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac675 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea67c expref: 544 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.508219:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbac67c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea67c expref: 543 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.508229:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:0.0:1762166980.508232:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1762166980.508236:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdf200, rc 0) 00000100:00100000:0.0:1762166980.508278:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5766a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+543:61766:x1847765450659712:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 292us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166980.508285:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30766 00000100:00100000:0.0:1762166980.509259:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.509312:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450659968 00000100:00100000:2.0:1762166980.509322:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450659968 00000100:00100000:2.0:1762166980.509380:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30767 00000100:00100000:2.0:1762166980.509391:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+543:61766:x1847765450659968:12345-192.168.204.38@tcp:36:fsx.0 00010000:00010000:2.0:1762166980.509431:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166980.509451:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945d02174e00/0x2f180c4effbac667 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea675 expref: 543 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.509471:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166980.509474:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166980.509620:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5ae4a00/0x2f180c4effbac683 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166980.509630:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5ae4a00/0x2f180c4effbac683 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.509636:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5ae4a00/0x2f180c4effbac683 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000001:00080000:2.0:1762166980.509663:0:6494:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992422 00000004:00010000:2.0:1762166980.509678:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000002ba408d reply state 0000000013b9015a transno 4294992423 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5ae4a00/0x2f180c4effbac683 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.509685:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5ae4a00/0x2f180c4effbac683 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.509689:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166980.509691:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166980.509692:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166980.509759:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+545:61766:x1847765450659968:12345-192.168.204.38@tcp:36:fsx.0 Request processed in 370us (501us total) trans 4294992423 rc 0/0 00000100:00100000:2.0:1762166980.509767:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30767 00000020:00080000:2.0:1762166980.509773:0:6494:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1762166980.510597:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.510636:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450660096 00000100:00100000:0.0:1762166980.510643:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450660096 00000100:00100000:1.0:1762166980.510655:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00002000:00010000:0.0:1762166980.510671:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (80019->18446744073709551615) 00002000:00100000:0.0:1762166980.510676:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf3db7b80 with x1847765450660096 ext(80019->18446744073709551615) 00002000:00010000:0.0:1762166980.510687:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf3db7b80. 00000100:00100000:2.0:1762166980.510698:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450660224 00000100:00100000:2.0:1762166980.510705:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450660224 00000100:00100000:1.0:1762166980.510715:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00002000:00010000:2.0:1762166980.510727:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00000100:00100000:0.0:1762166980.510730:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450660352 00002000:00100000:2.0:1762166980.510733:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf3db4000 with x1847765450660224 ext(0->18446744073709551615) 00000100:00100000:0.0:1762166980.510738:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450660352 00002000:00010000:2.0:1762166980.510746:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945cf3db4000. 00000100:00100000:3.0:1762166980.510763:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2621 00002000:00010000:0.0:1762166980.510764:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:0.0:1762166980.510772:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf3db7480 with x1847765450660352 ext(0->18446744073709551615) 00000100:00100000:1.0:1762166980.510779:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2622 00002000:00010000:0.0:1762166980.510781:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf3db7480. 00000100:00100000:3.0:1762166980.510786:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+25:2418:x1847765450660096:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:1.0:1762166980.510798:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450660224:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:2.0:1762166980.510811:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2623 00000100:00100000:2.0:1762166980.510836:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+25:2418:x1847765450660352:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:1.0:1762166980.510933:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166980.510938:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166980.510938:0:23939:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00002000:00010000:2.0:1762166980.510952:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00002000:00010000:1.0:1762166980.510952:0:23939:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00002000:00010000:1.0:1762166980.510965:0:23939:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:2.0:1762166980.510966:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00002000:00010000:1.0:1762166980.510978:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00002000:00010000:2.0:1762166980.510979:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:2.0:1762166980.510997:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1762166980.511036:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450660224:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 245us (380us total) trans 21474843419 rc 0/0 00000100:00100000:1.0:1762166980.511047:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2622 00000100:00100000:2.0:1762166980.511050:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+27:2418:x1847765450660352:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 221us (329us total) trans 17179876629 rc 0/0 00002000:00010000:1.0:1762166980.511051:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:1.0:1762166980.511058:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf3db4000 with x1847765450660224 ext(0->18446744073709551615) 00002000:00010000:1.0:1762166980.511068:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945cf3db4000. 00000100:00100000:2.0:1762166980.511074:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2623 00002000:00010000:2.0:1762166980.511081:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:2.0:1762166980.511085:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf3db7480 with x1847765450660352 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166980.511094:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf3db7480. 00002000:00010000:3.0:1762166980.511199:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 247947 -> 80019 00002000:00010000:3.0:1762166980.511205:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00002000:00010000:3.0:1762166980.511208:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00002000:00010000:3.0:1762166980.511210:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:3.0:1762166980.511212:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 48 -> 24 00000100:00100000:3.0:1762166980.511254:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+26:2418:x1847765450660096:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 477us (657us total) trans 17179876630 rc 0/0 00000100:00100000:3.0:1762166980.511263:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2621 00002000:00010000:3.0:1762166980.511268:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (80019->18446744073709551615) 00002000:00100000:3.0:1762166980.511272:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf3db7b80 with x1847765450660096 ext(80019->18446744073709551615) 00002000:00010000:3.0:1762166980.511277:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf3db7b80. 00000100:00100000:1.0:1762166980.511996:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.512037:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450660480 00000100:00100000:2.0:1762166980.512058:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450660480 00000100:00100000:2.0:1762166980.512088:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30768 00000100:00100000:2.0:1762166980.512094:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7c72450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+545:61766:x1847765450660480:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:2.0:1762166980.512108:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166980.512119:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5ae4800/0x2f180c4effbac68a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea683 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.512173:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42f6200/0x2f180c4effbac691 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166980.512180:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42f6200/0x2f180c4effbac691 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.512186:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42f6200/0x2f180c4effbac691 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:2.0:1762166980.512200:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 80019 00000004:00200000:2.0:1762166980.512203:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166980.512213:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42f6200/0x2f180c4effbac691 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.512228:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5ae4800/0x2f180c4effbac68a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea683 expref: 547 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.512238:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42f6200/0x2f180c4effbac691 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea683 expref: 546 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.512243:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166980.512245:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166980.512247:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc42f6200, rc 0) 00000100:00100000:2.0:1762166980.512285:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7c72450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+546:61766:x1847765450660480:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 190us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166980.512292:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30768 00000100:00100000:2.0:1762166980.513337:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.513391:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450660608 00000100:00100000:3.0:1762166980.513399:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450660608 00000100:00100000:3.0:1762166980.513443:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2624 00000100:00100000:3.0:1762166980.513453:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765450660608:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:3.0:1762166980.513605:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 80019 -> 80019 00002000:00010000:3.0:1762166980.513607:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00002000:00010000:3.0:1762166980.513609:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00002000:00010000:3.0:1762166980.513611:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:3.0:1762166980.513612:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 24 -> 24 00000100:00100000:3.0:1762166980.513643:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+27:2419:x1847765450660608:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 193us (308us total) trans 17179876631 rc 0/0 00000100:00100000:3.0:1762166980.513648:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2624 00000100:00100000:0.0:1762166980.514740:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.514778:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450660736 00000100:00100000:3.0:1762166980.514784:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450660736 00000100:00100000:3.0:1762166980.514817:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2625 00000100:00100000:3.0:1762166980.514835:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+27:2418:x1847765450660736:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:3.0:1762166980.514962:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 80019 -> 80019 00002000:00010000:3.0:1762166980.514966:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00002000:00010000:3.0:1762166980.514968:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00002000:00010000:3.0:1762166980.514970:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:3.0:1762166980.514972:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 24 -> 40 00000100:00100000:3.0:1762166980.515006:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+28:2418:x1847765450660736:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 172us (265us total) trans 17179876632 rc 0/0 00000100:00100000:3.0:1762166980.515016:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2625 00000100:00100000:1.0:1762166980.517126:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.517170:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450660864 00000100:00100000:3.0:1762166980.517175:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450660864 00002000:00100000:3.0:1762166980.517199:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (36864->53247) req@ffff945cf3db4e00 x1847765450660864/t0(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 16872/0 e 0 to 0 dl 1762166991 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166980.517207:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf3db4e00 with x1847765450660864 ext(36864->53247) 00002000:00010000:3.0:1762166980.517211:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf3db4e00 00000100:00100000:3.0:1762166980.517231:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2626 00000100:00100000:3.0:1762166980.517239:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+28:2419:x1847765450660864:12345-192.168.204.38@tcp:4:fsx.0 00000100:00100000:3.0:1762166980.517739:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+30:2419:x1847765450660864:12345-192.168.204.38@tcp:4:fsx.0 Request processed in 501us (615us total) trans 17179876633 rc 0/0 00000100:00100000:3.0:1762166980.517745:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2626 00002000:00100000:3.0:1762166980.517751:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (36864->53247) req@ffff945cf3db4e00 x1847765450660864/t17179876633(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 16872/448 e 0 to 0 dl 1762166991 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166980.517757:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf3db4e00 with x1847765450660864 ext(36864->53247) 00002000:00010000:3.0:1762166980.517760:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf3db4e00 00000100:00100000:2.0:1762166980.518555:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.518613:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450660992 00000100:00100000:0.0:1762166980.518620:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450660992 00000100:00100000:0.0:1762166980.518659:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19296 00000100:00100000:0.0:1762166980.518665:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5765180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+30:2419:x1847765450660992:12345-192.168.204.38@tcp:16:fsx.0 00000001:00080000:2.0:1762166980.519570:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876633 is committed 00000001:00080000:2.0:1762166980.519587:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876627 is committed 00000100:00100000:0.0:1762166980.519694:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5765180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450660992:12345-192.168.204.38@tcp:16:fsx.0 Request processed in 1028us (1142us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166980.519701:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19296 00000100:00100000:0.0:1762166980.521150:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.521189:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450661120 00000100:00100000:3.0:1762166980.521197:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450661120 00000100:00100000:3.0:1762166980.521243:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2627 00000100:00100000:3.0:1762166980.521251:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450661120:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:3.0:1762166980.521461:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 80019 -> 80019 00002000:00010000:3.0:1762166980.521466:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00002000:00010000:3.0:1762166980.521469:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00002000:00010000:3.0:1762166980.521471:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:3.0:1762166980.521474:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 40 -> 80 00000100:00100000:3.0:1762166980.521570:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450661120:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 319us (419us total) trans 17179876634 rc 0/0 00000100:00100000:3.0:1762166980.521578:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2627 00000100:00100000:1.0:1762166980.522927:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.522968:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450661248 00000100:00100000:3.0:1762166980.522973:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450661248 00000100:00100000:3.0:1762166980.523012:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2628 00000100:00100000:3.0:1762166980.523021:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450661248:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:3.0:1762166980.523121:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 80019 -> 80019 00002000:00010000:3.0:1762166980.523124:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00002000:00010000:3.0:1762166980.523125:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00002000:00010000:3.0:1762166980.523127:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:3.0:1762166980.523128:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 80 -> 168 00000100:00100000:3.0:1762166980.523162:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450661248:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 144us (239us total) trans 17179876635 rc 0/0 00000100:00100000:3.0:1762166980.523167:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2628 00000100:00100000:2.0:1762166980.524611:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.524660:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450661504 00000100:00100000:0.0:1762166980.524669:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450661504 00000100:00100000:0.0:1762166980.524720:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30769 00000100:00100000:0.0:1762166980.524731:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+546:61766:x1847765450661504:12345-192.168.204.38@tcp:36:fsx.0 00010000:00010000:0.0:1762166980.524776:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166980.524803:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42f6200/0x2f180c4effbac691 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea683 expref: 546 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.524816:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:0.0:1762166980.524819:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166980.524973:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbac698 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166980.524983:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbac698 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.524989:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbac698 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000001:00080000:0.0:1762166980.525018:0:6494:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992424 00000004:00010000:0.0:1762166980.525032:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000006fd9df05 reply state 00000000724c5c89 transno 4294992425 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbac698 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.525040:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbac698 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.525043:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:0.0:1762166980.525045:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762166980.525047:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166980.525122:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+548:61766:x1847765450661504:12345-192.168.204.38@tcp:36:fsx.0 Request processed in 394us (514us total) trans 4294992425 rc 0/0 00000100:00100000:0.0:1762166980.525127:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30769 00000020:00080000:0.0:1762166980.525131:0:6494:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1762166980.526015:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.526039:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.526057:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.526070:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450661632 00000100:00100000:3.0:1762166980.526077:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450661632 00000100:00100000:2.0:1762166980.526089:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450661760 00000100:00100000:2.0:1762166980.526096:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450661760 00002000:00010000:3.0:1762166980.526103:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (163873->18446744073709551615) 00000100:00100000:1.0:1762166980.526111:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450661888 00002000:00100000:3.0:1762166980.526112:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5bb9f80 with x1847765450661632 ext(163873->18446744073709551615) 00002000:00010000:2.0:1762166980.526119:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00000100:00100000:1.0:1762166980.526122:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450661888 00002000:00010000:3.0:1762166980.526124:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5bb9f80. 00002000:00100000:2.0:1762166980.526125:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5bb8e00 with x1847765450661760 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166980.526135:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc5bb8e00. 00002000:00010000:1.0:1762166980.526144:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:1.0:1762166980.526148:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5bb8a80 with x1847765450661888 ext(0->18446744073709551615) 00000100:00100000:3.0:1762166980.526152:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2629 00002000:00010000:1.0:1762166980.526157:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5bb8a80. 00000100:00100000:3.0:1762166980.526166:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450661632:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:2.0:1762166980.526167:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2630 00000100:00100000:0.0:1762166980.526181:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2631 00000100:00100000:2.0:1762166980.526183:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450661760:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:0.0:1762166980.526197:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450661888:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:0.0:1762166980.526285:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166980.526288:0:23943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00002000:00010000:0.0:1762166980.526291:0:23943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00002000:00010000:0.0:1762166980.526293:0:23943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:0.0:1762166980.526294:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:2.0:1762166980.526299:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166980.526304:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00002000:00010000:2.0:1762166980.526308:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00002000:00010000:2.0:1762166980.526311:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:2.0:1762166980.526315:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00000100:00100000:0.0:1762166980.526331:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450661888:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 140us (273us total) trans 17179876636 rc 0/0 00000100:00100000:0.0:1762166980.526337:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2631 00002000:00010000:0.0:1762166980.526340:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:0.0:1762166980.526342:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5bb8a80 with x1847765450661888 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166980.526347:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5bb8a80. 00000100:00100000:2.0:1762166980.526349:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450661760:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 168us (305us total) trans 21474843420 rc 0/0 00000100:00100000:2.0:1762166980.526360:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2630 00002000:00010000:3.0:1762166980.526362:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 80019 -> 163873 00002000:00010000:2.0:1762166980.526365:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00010000:3.0:1762166980.526368:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00002000:00100000:2.0:1762166980.526370:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5bb8e00 with x1847765450661760 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166980.526372:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00002000:00010000:3.0:1762166980.526377:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:2.0:1762166980.526379:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc5bb8e00. 00002000:00010000:3.0:1762166980.526381:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 168 -> 80 00000100:00100000:3.0:1762166980.526409:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450661632:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 248us (394us total) trans 17179876637 rc 0/0 00000100:00100000:3.0:1762166980.526421:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2629 00002000:00010000:3.0:1762166980.526424:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (163873->18446744073709551615) 00002000:00100000:3.0:1762166980.526428:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5bb9f80 with x1847765450661632 ext(163873->18446744073709551615) 00002000:00010000:3.0:1762166980.526433:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5bb9f80. 00000100:00100000:1.0:1762166980.527811:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.527871:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450662016 00000100:00100000:3.0:1762166980.527878:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450662016 00002000:00100000:3.0:1762166980.527907:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (126976->131071) req@ffff945cf3db4a80 x1847765450662016/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 488/0 e 0 to 0 dl 1762166991 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166980.527915:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf3db4a80 with x1847765450662016 ext(126976->131071) 00002000:00010000:3.0:1762166980.527919:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf3db4a80 00000100:00100000:3.0:1762166980.527941:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2632 00000100:00100000:3.0:1762166980.527946:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450662016:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:3.0:1762166980.528102:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450662016:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 155us (292us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1762166980.528107:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2632 00002000:00100000:3.0:1762166980.528112:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (126976->131071) req@ffff945cf3db4a80 x1847765450662016/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 488/4536 e 0 to 0 dl 1762166991 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166980.528118:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf3db4a80 with x1847765450662016 ext(126976->131071) 00002000:00010000:3.0:1762166980.528120:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf3db4a80 00000100:00100000:1.0:1762166980.529338:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.529366:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450662144 00000100:00100000:3.0:1762166980.529371:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450662144 00002000:00100000:3.0:1762166980.529388:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (131072->135167) req@ffff945cf3db6300 x1847765450662144/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 488/0 e 0 to 0 dl 1762166991 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166980.529394:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf3db6300 with x1847765450662144 ext(131072->135167) 00002000:00010000:3.0:1762166980.529397:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf3db6300 00000100:00100000:3.0:1762166980.529415:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2633 00000100:00100000:3.0:1762166980.529420:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450662144:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:3.0:1762166980.529550:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450662144:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 126us (212us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1762166980.529559:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2633 00002000:00100000:3.0:1762166980.529566:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (131072->135167) req@ffff945cf3db6300 x1847765450662144/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 488/4536 e 0 to 0 dl 1762166991 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166980.529575:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf3db6300 with x1847765450662144 ext(131072->135167) 00002000:00010000:3.0:1762166980.529579:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf3db6300 00000100:00100000:0.0:1762166980.530845:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.530892:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450662272 00000100:00100000:3.0:1762166980.530899:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450662272 00002000:00100000:3.0:1762166980.530922:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (106496->167935) req@ffff945bc5bbb480 x1847765450662272/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 504/0 e 0 to 0 dl 1762166991 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166980.530930:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5bbb480 with x1847765450662272 ext(106496->167935) 00002000:00010000:3.0:1762166980.530933:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5bbb480 00000100:00100000:3.0:1762166980.530950:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2634 00000100:00100000:3.0:1762166980.530956:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450662272:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:3.0:1762166980.531828:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450662272:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 863us (978us total) trans 0 rc 53248/53248 00000100:00100000:3.0:1762166980.531835:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2634 00002000:00100000:3.0:1762166980.531840:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (106496->167935) req@ffff945bc5bbb480 x1847765450662272/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 504/440 e 0 to 0 dl 1762166991 ref 1 fl Complete:/600/0 rc 53248/53248 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166980.531847:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5bbb480 with x1847765450662272 ext(106496->167935) 00002000:00010000:3.0:1762166980.531850:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5bbb480 00000100:00100000:1.0:1762166980.534381:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.534420:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450662400 00000100:00100000:3.0:1762166980.534425:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450662400 00002000:00100000:3.0:1762166980.534449:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (126976->163872) req@ffff945cf3db4380 x1847765450662400/t0(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 488/0 e 0 to 0 dl 1762166991 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166980.534455:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf3db4380 with x1847765450662400 ext(126976->163872) 00002000:00010000:3.0:1762166980.534458:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf3db4380 00000100:00100000:3.0:1762166980.534508:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2635 00000100:00100000:3.0:1762166980.534521:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450662400:12345-192.168.204.38@tcp:4:fsx.0 00000100:00100000:3.0:1762166980.535774:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765450662400:12345-192.168.204.38@tcp:4:fsx.0 Request processed in 1255us (1393us total) trans 17179876638 rc 0/0 00000100:00100000:3.0:1762166980.535782:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2635 00002000:00100000:3.0:1762166980.535790:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (126976->163872) req@ffff945cf3db4380 x1847765450662400/t17179876638(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 488/448 e 0 to 0 dl 1762166991 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166980.535796:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf3db4380 with x1847765450662400 ext(126976->163872) 00002000:00010000:3.0:1762166980.535800:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf3db4380 00000100:00100000:1.0:1762166980.536554:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.536602:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450662528 00000100:00100000:0.0:1762166980.536608:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450662528 00000100:00100000:0.0:1762166980.536643:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19297 00000100:00100000:0.0:1762166980.536649:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765450662528:12345-192.168.204.38@tcp:16:fsx.0 00000001:00080000:2.0:1762166980.537462:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876638 is committed 00000100:00100000:0.0:1762166980.537545:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450662528:12345-192.168.204.38@tcp:16:fsx.0 Request processed in 895us (992us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166980.537551:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19297 00000100:00100000:1.0:1762166980.538369:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.538417:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450662656 00000100:00100000:0.0:1762166980.538421:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450662656 00000100:00100000:0.0:1762166980.538449:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30770 00000100:00100000:0.0:1762166980.538454:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+548:61766:x1847765450662656:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:0.0:1762166980.538468:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166980.538501:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbac69f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea68a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.538564:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbac6a6 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166980.538575:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbac6a6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.538585:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbac6a6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:0.0:1762166980.538609:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 163873 00000004:00200000:0.0:1762166980.538613:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166980.538628:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbac6a6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.538647:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbac69f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea68a expref: 550 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.538658:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbac6a6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea68a expref: 549 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.538664:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:0.0:1762166980.538666:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166980.538668:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdf400, rc 0) 00000100:00100000:0.0:1762166980.538694:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+549:61766:x1847765450662656:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 240us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166980.538701:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30770 00000100:00100000:1.0:1762166980.539982:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.540035:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450662784 00000100:00100000:3.0:1762166980.540046:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450662784 00000100:00100000:3.0:1762166980.540115:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2636 00000100:00100000:3.0:1762166980.540125:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450662784:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:3.0:1762166980.540454:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 163873 -> 163873 00002000:00010000:3.0:1762166980.540459:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00002000:00010000:3.0:1762166980.540461:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00002000:00010000:3.0:1762166980.540464:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:3.0:1762166980.540466:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 80 -> 240 00000100:00100000:2.0:1762166980.540615:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450662784:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 491us (632us total) trans 17179876639 rc 0/0 00000100:00100000:2.0:1762166980.540621:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2636 00000100:00100000:1.0:1762166980.541802:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.541857:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450662912 00000100:00100000:2.0:1762166980.541862:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450662912 00000100:00100000:2.0:1762166980.541896:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2637 00000100:00100000:2.0:1762166980.541902:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450662912:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:2.0:1762166980.542062:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 163873 -> 163873 00002000:00010000:2.0:1762166980.542066:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00002000:00010000:2.0:1762166980.542069:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00002000:00010000:2.0:1762166980.542072:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:2.0:1762166980.542074:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 240 -> 256 00000100:00100000:2.0:1762166980.542116:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450662912:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 212us (314us total) trans 17179876640 rc 0/0 00000100:00100000:2.0:1762166980.542124:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2637 00000100:00100000:1.0:1762166980.543577:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.543608:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450663168 00000100:00100000:0.0:1762166980.543616:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450663168 00000100:00100000:0.0:1762166980.543660:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11959 00000100:00100000:0.0:1762166980.543669:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+549:61766:x1847765450663168:12345-192.168.204.38@tcp:35:fsx.0 00000100:00100000:0.0:1762166980.543895:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+550:61766:x1847765450663168:12345-192.168.204.38@tcp:35:fsx.0 Request processed in 228us (321us total) trans 4294992426 rc 0/0 00000100:00100000:0.0:1762166980.543900:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11959 00000100:00100000:1.0:1762166980.550865:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.550918:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450663424 00000100:00100000:0.0:1762166980.550928:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450663424 00000100:00100000:0.0:1762166980.550984:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30771 00000100:00100000:0.0:1762166980.550996:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+550:61875:x1847765450663424:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166980.551020:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166980.551041:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbac6ad lrc: 2/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea691 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.551106:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbac6b4 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166980.551118:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbac6b4 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.551128:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbac6b4 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.551138:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbac6bb lrc: 3/1,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166980.551144:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbac6bb lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.551150:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbac6bb lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.551252:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbac6c2 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166980.551261:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbac6c2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.551268:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbac6c2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:0.0:1762166980.551276:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 163873 00010000:00010000:0.0:1762166980.551346:0:6494:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbac6b4 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.551352:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbac6b4 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.551358:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbac6b4 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.551363:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbac6b4 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.551369:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bde000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166980.551373:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbac6b4 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.551379:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbac6b4 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.551390:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0x0 (ffff945bc4afe100) 00010000:00010000:0.0:1762166980.551393:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166980.551398:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbac6b4 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.551404:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbac6b4 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.551448:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbac6bb lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.551454:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbac6bb lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.551459:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbac6bb lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.551465:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bde400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166980.551469:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbac6bb lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.551474:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbac6bb lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.551513:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0xdd396665 (ffff945bc4afe600) 00010000:00010000:0.0:1762166980.551515:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166980.551518:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbac6bb lrc: 2/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.551524:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbac6bb lrc: 0/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.551563:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbac6ad lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea691 expref: 553 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.551585:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbac6c2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea691 expref: 552 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.551596:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:0.0:1762166980.551599:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166980.551603:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bde600, rc 0) 00000100:00100000:0.0:1762166980.551655:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+552:61875:x1847765450663424:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 662us (799us total) trans 4294992427 rc 0/0 00000100:00100000:0.0:1762166980.551664:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30771 00000100:00100000:1.0:1762166980.552810:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.552853:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450663552 00000100:00100000:0.0:1762166980.552858:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450663552 00000100:00100000:0.0:1762166980.552887:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 895 00000100:00100000:0.0:1762166980.552894:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+552:2418:x1847765450663552:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166980.552903:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166980.552914:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbac6c2 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea691 expref: 552 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.552923:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:0.0:1762166980.552926:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166980.552950:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+551:2418:x1847765450663552:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 57us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166980.552958:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 895 00000100:00100000:1.0:1762166980.553015:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.553056:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450663808 00000100:00100000:0.0:1762166980.553063:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450663808 00000100:00100000:0.0:1762166980.553100:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30772 00000100:00100000:0.0:1762166980.553107:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+551:61875:x1847765450663808:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166980.553119:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166980.553129:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbac6d0 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea698 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.553436:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbac6d7 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x61b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166980.553445:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbac6d7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x61b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.553452:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbac6d7 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x61b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:0.0:1762166980.553459:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x61b:0x0]: returning size 0 00010000:00010000:0.0:1762166980.553524:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbac6d0 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea698 expref: 554 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.553541:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbac6d7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x61b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea698 expref: 553 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.553549:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x61b:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:0.0:1762166980.553551:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166980.553554:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdf000, rc 0) 00000100:00100000:0.0:1762166980.553588:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+553:61875:x1847765450663808:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 480us (573us total) trans 4294992428 rc 0/0 00000100:00100000:0.0:1762166980.553595:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30772 00000100:00100000:2.0:1762166980.554690:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.554735:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450664064 00000100:00100000:0.0:1762166980.554742:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450664064 00000100:00100000:0.0:1762166980.554782:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30773 00000100:00100000:0.0:1762166980.554792:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5766a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+553:61875:x1847765450664064:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166980.554803:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166980.554811:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbac6e5 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x61b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea69f expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.554869:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac6ec lrc: 3/0,1 mode: --/EX res: [0x240000404:0x61b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166980.554880:0:6494:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbac6d7 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x61b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea698 expref: 554 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.554888:0:6494:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac6ec lrc: 4/0,1 mode: --/EX res: [0x240000404:0x61b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.554915:0:6494:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbac6d7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x61b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea698 expref: 554 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.554927:0:6494:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbac6d7 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x61b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea698 expref: 554 pid: 6494 timeout: 699 lvb_type: 0 00000100:00100000:0.0:1762166980.554940:0:6494:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bbad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765449771648:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166980.555007:0:6494:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1fe2600 going to sleep for 11 seconds 00000100:00100000:0.0:1762166980.555760:0:6494:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bbad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765449771648:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166980.555776:0:6494:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac6ec lrc: 3/0,1 mode: --/EX res: [0x240000404:0x61b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000100:00100000:2.0:1762166980.555935:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.555981:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450664192 00000100:00100000:3.0:1762166980.555988:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450664192 00010000:00010000:3.0:1762166980.556017:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbac6d7 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x61b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea698 expref: 555 pid: 6494 timeout: 699 lvb_type: 0 00000100:00100000:3.0:1762166980.556046:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9760 00000100:00100000:3.0:1762166980.556054:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4012680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+555:2418:x1847765450664192:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166980.556064:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166980.556069:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbac6d7 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x61b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea698 expref: 555 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:3.0:1762166980.556079:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbac6d7 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x61b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea698 expref: 555 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:3.0:1762166980.556095:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbac6d7 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x61b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea698 expref: 555 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:3.0:1762166980.556107:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x61b:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:3.0:1762166980.556110:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac6ec lrc: 3/0,1 mode: --/EX res: [0x240000404:0x61b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.556117:0:8398:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac6ec lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x61b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.556121:0:8398:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac6ec lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x61b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.556140:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166980.556163:0:6494:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac6ec lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x61b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.556173:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac6ec lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x61b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000100:00100000:3.0:1762166980.556180:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4012680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e1e11365-ba0b-405b-99c9-a704373217f2+554:2418:x1847765450664192:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 127us (249us total) trans 0 rc 0/0 00000004:00200000:0.0:1762166980.556183:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x61b:0x0]: returning size 0 00000100:00100000:3.0:1762166980.556196:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9760 00000004:00080000:0.0:1762166980.556314:0:6494:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xa90:0x0], index 1: 0 00000004:00080000:0.0:1762166980.556323:0:6494:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xa91:0x0], index 0: 0 00010000:00010000:0.0:1762166980.556388:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac6ec lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x61b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.556400:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac6ec lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x61b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.556406:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac6ec lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x61b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.556412:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdf600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166980.556415:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac6ec lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x61b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.556421:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac6ec lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x61b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.556431:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x61b:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:0.0:1762166980.556434:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166980.556437:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac6ec lrc: 2/0,0 mode: --/EX res: [0x240000404:0x61b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.556443:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac6ec lrc: 0/0,0 mode: --/EX res: [0x240000404:0x61b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.556473:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbac6e5 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x61b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea69f expref: 554 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.556525:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x61b:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:0.0:1762166980.556529:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1762166980.556534:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbac6e5 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x61b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea69f expref: 554 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.556550:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdec00, rc 0) 00000100:00100000:0.0:1762166980.556592:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5766a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+553:61875:x1847765450664064:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1803us (1907us total) trans 4294992429 rc 301/301 00000100:00100000:0.0:1762166980.556601:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30773 00000100:00100000:2.0:1762166980.557459:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.557542:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450664448 00000100:00100000:0.0:1762166980.557549:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450664448 00000100:00100000:0.0:1762166980.557590:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11960 00000100:00100000:0.0:1762166980.557598:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7be0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+553:61875:x1847765450664448:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166980.557739:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7be0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+554:61875:x1847765450664448:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 141us (282us total) trans 4294992430 rc 0/0 00000100:00100000:0.0:1762166980.557746:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11960 00000100:00100000:1.0:1762166980.558882:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.558924:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450664576 00000100:00100000:0.0:1762166980.558928:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450664576 00000100:00100000:0.0:1762166980.558954:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30774 00000100:00100000:0.0:1762166980.558959:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+554:61875:x1847765450664576:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166980.558968:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166980.558980:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbac6fa lrc: 2/0,0 mode: --/CR res: [0x240000404:0x61b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea6a6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.559015:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbac701 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x61b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166980.559023:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbac701 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x61b:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.559029:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbac701 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x61b:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:0.0:1762166980.559046:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x61b:0x0]: returning size 0 00000004:00200000:0.0:1762166980.559049:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166980.559057:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbac701 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x61b:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.559071:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbac6fa lrc: 0/0,0 mode: --/CR res: [0x240000404:0x61b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6a6 expref: 556 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.559080:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbac701 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x61b:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6a6 expref: 555 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.559084:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x61b:0x0].0x0 (ffff945bc4afe700) 00010000:00010000:0.0:1762166980.559086:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1762166980.559088:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdee00, rc 0) 00000100:00100000:0.0:1762166980.559114:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+555:61875:x1847765450664576:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 155us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166980.559118:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30774 00000100:00100000:1.0:1762166980.560073:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.560105:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.560122:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450664704 00000100:00100000:0.0:1762166980.560127:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450664704 00000100:00100000:3.0:1762166980.560138:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450664832 00000100:00100000:3.0:1762166980.560143:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450664832 00000100:00100000:0.0:1762166980.560157:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19298 00000100:00100000:0.0:1762166980.560164:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+19:2416:x1847765450664704:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166980.560171:0:35472:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166980.560182:0:35472:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbac708 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea6ad expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166980.560198:0:35472:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa90:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:3.0:1762166980.560199:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19299 00010000:00010000:0.0:1762166980.560211:0:35472:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166980.560214:0:35472:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1762166980.560216:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+20:2416:x1847765450664832:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166980.560221:0:35472:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbac708 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6ad expref: 20 pid: 35472 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166980.560228:0:9168:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166980.560233:0:35472:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbac708 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6ad expref: 20 pid: 35472 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166980.560240:0:35472:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdf800, rc 0) 00010000:00010000:3.0:1762166980.560245:0:9168:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cf3cada00/0x2f180c4effbac70f lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa91:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea6b4 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166980.560262:0:9168:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa91:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1762166980.560267:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+20:2416:x1847765450664704:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 104us (196us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166980.560273:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1762166980.560273:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19298 00010000:00010000:3.0:1762166980.560278:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166980.560286:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cf3cada00/0x2f180c4effbac70f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6b4 expref: 21 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166980.560299:0:9168:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945cf3cada00/0x2f180c4effbac70f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6b4 expref: 21 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166980.560308:0:9168:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cada00, rc 0) 00000100:00100000:3.0:1762166980.560333:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+21:2416:x1847765450664832:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 124us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166980.560340:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19299 00000100:00100000:2.0:1762166980.561356:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.561393:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450665088 00000100:00100000:0.0:1762166980.561398:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450665088 00000100:00100000:0.0:1762166980.561428:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30775 00000100:00100000:0.0:1762166980.561436:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4011c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+555:61875:x1847765450665088:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166980.561445:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166980.561455:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbac716 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea6bb expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.561536:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42f6200/0x2f180c4effbac71d lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166980.561548:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42f6200/0x2f180c4effbac71d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.561557:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42f6200/0x2f180c4effbac71d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:0.0:1762166980.561565:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 163873 00010000:00010000:0.0:1762166980.561649:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbac716 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6bb expref: 558 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.561661:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42f6200/0x2f180c4effbac71d lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6bb expref: 557 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.561673:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:0.0:1762166980.561676:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166980.561678:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc42f6200, rc 0) 00000100:00100000:0.0:1762166980.561710:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4011c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+557:61875:x1847765450665088:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 275us (354us total) trans 4294992431 rc 0/0 00000100:00100000:0.0:1762166980.561717:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30775 00000100:00100000:1.0:1762166980.563091:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.563143:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.563182:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450665216 00000100:00100000:0.0:1762166980.563188:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450665216 00000100:00100000:0.0:1762166980.563220:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450665344 00000100:00100000:0.0:1762166980.563224:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450665344 00000100:00100000:1.0:1762166980.563247:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19300 00000100:00100000:0.0:1762166980.563261:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19301 00000100:00100000:1.0:1762166980.563263:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450665216:12345-192.168.204.38@tcp:1:lfs.0 00000100:00100000:0.0:1762166980.563275:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450665344:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:1.0:1762166980.563296:0:35247:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945cc355ac00/0x2f180c4effbac72b lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.563300:0:35472:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbac732 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.563321:0:35247:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28a00/0x2f180c4effbac579 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea621 expref: 20 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.563327:0:35472:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29000/0x2f180c4effbac580 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea628 expref: 21 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.563331:0:35247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166980.563335:0:35247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166980.563338:0:35472:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166980.563339:0:35247:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355ac00/0x2f180c4effbac72b lrc: 4/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.563342:0:35472:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166980.563348:0:35472:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbac732 lrc: 4/1,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166980.563353:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:0.0:1762166980.563385:0:35472:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29000/0x2f180c4effbac580 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea628 expref: 21 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.563387:0:35247:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28a00/0x2f180c4effbac579 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea621 expref: 20 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.563415:0:35472:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29000/0x2f180c4effbac580 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea628 expref: 21 pid: 35472 timeout: 699 lvb_type: 0 00010000:00010000:1.0:1762166980.563416:0:35247:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28a00/0x2f180c4effbac579 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea621 expref: 20 pid: 35472 timeout: 699 lvb_type: 0 00000100:00100000:1.0:1762166980.563449:0:35247:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1e6c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:35247:1847765449771904:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166980.563449:0:35472:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bbad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:35472:1847765449771776:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166980.563462:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450665472 00000100:00100000:3.0:1762166980.563473:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450665472 00000100:00100000:1.0:1762166980.563581:0:35247:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc350fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1762166980.563581:0:35472:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1fe20c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166980.563589:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19302 00000100:00100000:3.0:1762166980.563607:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4011180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450665472:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:3.0:1762166980.563656:0:9168:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac200/0x2f180c4effbac739 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.563675:0:9168:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc7194e00/0x2f180c4effbac587 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea62f expref: 21 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.563683:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166980.563686:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166980.563690:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac200/0x2f180c4effbac739 lrc: 4/1,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.563721:0:9168:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc7194e00/0x2f180c4effbac587 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea62f expref: 21 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.563733:0:9168:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc7194e00/0x2f180c4effbac587 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea62f expref: 21 pid: 35472 timeout: 699 lvb_type: 0 00000100:00100000:3.0:1762166980.563789:0:9168:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cc3553480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9168:1847765449772032:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166980.563863:0:9168:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cee17e6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166980.564602:0:35247:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1e6c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:35247:1847765449771904:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166980.564624:0:35472:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bbad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:35472:1847765449771776:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166980.564625:0:35247:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945cc355ac00/0x2f180c4effbac72b lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.564731:0:35472:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbac732 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166980.564801:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.564842:0:9168:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cc3553480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9168:1847765449772032:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166980.564883:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450665600 00010000:00010000:0.0:1762166980.564885:0:9168:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac200/0x2f180c4effbac739 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166980.564889:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450665600 00000100:00100000:2.0:1762166980.564907:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:1.0:1762166980.564922:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29000/0x2f180c4effbac580 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea628 expref: 22 pid: 35472 timeout: 699 lvb_type: 0 00000100:00100000:0.0:1762166980.564936:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450665856 00000100:00100000:0.0:1762166980.564943:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450665856 00000100:00100000:2.0:1762166980.564954:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.564972:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450665728 00010000:00010000:0.0:1762166980.564972:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc7194e00/0x2f180c4effbac587 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea62f expref: 22 pid: 35472 timeout: 699 lvb_type: 0 00000100:00100000:1.0:1762166980.564979:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450665728 00000100:00100000:3.0:1762166980.564993:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9761 00010000:00010000:1.0:1762166980.565006:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28a00/0x2f180c4effbac579 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea621 expref: 23 pid: 35472 timeout: 699 lvb_type: 0 00000100:00100000:3.0:1762166980.565007:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945d0207f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765450665600:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166980.565029:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1762166980.565042:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9762 00000100:00100000:0.0:1762166980.565058:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9763 00010000:00010000:3.0:1762166980.565063:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29000/0x2f180c4effbac580 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea628 expref: 22 pid: 35472 timeout: 699 lvb_type: 0 00000100:00100000:2.0:1762166980.565066:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4012300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765450665856:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166980.565084:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1762166980.565084:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4013100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765450665728:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166980.565097:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29000/0x2f180c4effbac580 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea628 expref: 22 pid: 35472 timeout: 699 lvb_type: 0 00010000:00010000:2.0:1762166980.565108:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc7194e00/0x2f180c4effbac587 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea62f expref: 23 pid: 35472 timeout: 699 lvb_type: 0 00010000:00010000:0.0:1762166980.565108:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166980.565123:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bcaa29000/0x2f180c4effbac580 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea628 expref: 22 pid: 35472 timeout: 699 lvb_type: 0 00010000:00010000:2.0:1762166980.565132:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc7194e00/0x2f180c4effbac587 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea62f expref: 23 pid: 35472 timeout: 699 lvb_type: 0 00010000:00010000:0.0:1762166980.565138:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28a00/0x2f180c4effbac579 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea621 expref: 23 pid: 35472 timeout: 699 lvb_type: 0 00010000:00010000:3.0:1762166980.565144:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166980.565150:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166980.565160:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbac732 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.565175:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc7194e00/0x2f180c4effbac587 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea62f expref: 23 pid: 35472 timeout: 699 lvb_type: 0 00010000:00010000:3.0:1762166980.565189:0:7421:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbac732 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.565191:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28a00/0x2f180c4effbac579 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea621 expref: 23 pid: 35472 timeout: 699 lvb_type: 0 00010000:00010000:2.0:1762166980.565208:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166980.565215:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166980.565224:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac200/0x2f180c4effbac739 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.565238:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac200/0x2f180c4effbac739 lrc: 4/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.565243:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166980.565245:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bcaa28a00/0x2f180c4effbac579 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea621 expref: 22 pid: 35472 timeout: 699 lvb_type: 0 00010000:00010000:0.0:1762166980.565270:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166980.565273:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166980.565275:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166980.565283:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945cc355ac00/0x2f180c4effbac72b lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.565285:0:35472:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbac732 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166980.565292:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945d0207f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450665600:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 284us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166980.565313:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4012300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450665856:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 252us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166980.565328:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9761 00010000:00010000:1.0:1762166980.565338:0:35472:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbac732 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.565338:0:9458:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355ac00/0x2f180c4effbac72b lrc: 4/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166980.565355:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9762 00010000:00010000:1.0:1762166980.565366:0:35472:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbac732 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.565377:0:35472:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbac732 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.565387:0:35472:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbac732 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.565388:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166980.565397:0:35472:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdfe00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166980.565403:0:35472:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbac732 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.565415:0:35472:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbac732 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.565432:0:35472:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbac732 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166980.565438:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4013100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450665728:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 363us (490us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166980.565447:0:35472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbac732 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166980.565457:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9763 00010000:00010000:3.0:1762166980.565458:0:9168:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac200/0x2f180c4effbac739 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.565469:0:9168:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac200/0x2f180c4effbac739 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.565526:0:9168:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac200/0x2f180c4effbac739 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.565534:0:9168:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac200/0x2f180c4effbac739 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.565544:0:35247:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945cc355ac00/0x2f180c4effbac72b lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.565555:0:35247:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cc355ac00/0x2f180c4effbac72b lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.565572:0:35247:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945cc355ac00/0x2f180c4effbac72b lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166980.565587:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450665344:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 2310us (2438us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166980.565614:0:35247:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355ac00/0x2f180c4effbac72b lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.565615:0:9168:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac200/0x2f180c4effbac739 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166980.565616:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19301 00010000:00010000:0.0:1762166980.565653:0:35247:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945cc355ac00/0x2f180c4effbac72b lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.565656:0:9168:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cac200 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166980.565665:0:9168:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac200/0x2f180c4effbac739 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.565667:0:35247:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355ac00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166980.565678:0:35247:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc355ac00/0x2f180c4effbac72b lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.565682:0:9168:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac200/0x2f180c4effbac739 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.565709:0:35247:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc355ac00/0x2f180c4effbac72b lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.565721:0:35247:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945cc355ac00/0x2f180c4effbac72b lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.565727:0:35247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cc355ac00/0x2f180c4effbac72b lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.565762:0:9168:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac200/0x2f180c4effbac739 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.565772:0:9168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac200/0x2f180c4effbac739 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166980.565786:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450665216:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 2528us (2695us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166980.565796:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19300 00000100:00100000:2.0:1762166980.565862:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4011180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450665472:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 2259us (2511us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166980.565872:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19302 00000100:00100000:2.0:1762166980.566981:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.567030:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450665984 00000100:00100000:0.0:1762166980.567036:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450665984 00000100:00100000:0.0:1762166980.567067:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19303 00000100:00100000:0.0:1762166980.567074:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4012d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+18:2417:x1847765450665984:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166980.567084:0:9168:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166980.567096:0:9168:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbac740 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea6c2 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166980.567111:0:9168:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa77:0x0] initial LVB size: 163873, mtime: 0x690888c4, atime: 0x690888c4, ctime: 0x690888c4, blocks: 0x100 00010000:00010000:0.0:1762166980.567123:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166980.567127:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1762166980.567130:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:0.0:1762166980.567138:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbac740 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6c2 expref: 19 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166980.567154:0:9168:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbac740 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6c2 expref: 19 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166980.567164:0:9168:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdfc00, rc 0) 00000100:00100000:1.0:1762166980.567170:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450666112 00000100:00100000:1.0:1762166980.567174:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450666112 00000100:00100000:2.0:1762166980.567186:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.567226:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450666240 00000100:00100000:0.0:1762166980.567231:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4012d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+19:2417:x1847765450665984:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 154us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166980.567233:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450666240 00000100:00100000:3.0:1762166980.567243:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19304 00000100:00100000:0.0:1762166980.567254:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19303 00000100:00100000:3.0:1762166980.567261:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4013b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+20:2416:x1847765450666112:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166980.567275:0:35472:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166980.567296:0:35472:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc847f600/0x2f180c4effbac747 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea6c9 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166980.567299:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19305 00000100:00100000:1.0:1762166980.567318:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4012680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+19:2416:x1847765450666240:12345-192.168.204.38@tcp:101:lfs.0 00002000:00010000:3.0:1762166980.567324:0:35472:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa7a:0x0] initial LVB size: 0, mtime: 0x690888c4, atime: 0x690888c4, ctime: 0x690888c4, blocks: 0x1800 00010000:00010000:1.0:1762166980.567330:0:35247:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166980.567343:0:35247:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cc355b400/0x2f180c4effbac74e lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea6d0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762166980.567359:0:35247:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa79:0x0] initial LVB size: 0, mtime: 0x690888c4, atime: 0x690888c4, ctime: 0x690888c4, blocks: 0x0 00010000:00010000:1.0:1762166980.567369:0:35247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166980.567372:0:35247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166980.567377:0:35247:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355b400/0x2f180c4effbac74e lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6d0 expref: 20 pid: 35247 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166980.567382:0:35472:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166980.567388:0:35472:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166980.567397:0:35472:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc847f600/0x2f180c4effbac747 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6c9 expref: 21 pid: 35472 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166980.567398:0:35247:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945cc355b400/0x2f180c4effbac74e lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6d0 expref: 20 pid: 35247 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166980.567436:0:35247:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355b400, rc 0) 00010000:00010000:3.0:1762166980.567440:0:35472:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc847f600/0x2f180c4effbac747 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6c9 expref: 21 pid: 35472 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166980.567455:0:35472:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc847f600, rc 0) 00000100:00100000:1.0:1762166980.567501:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4012680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+20:2416:x1847765450666240:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 186us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166980.567511:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19305 00000100:00100000:3.0:1762166980.567530:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4013b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+21:2416:x1847765450666112:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 274us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166980.567541:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19304 00000100:00100000:2.0:1762166980.599218:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.599282:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450666368 00000100:00100000:3.0:1762166980.599292:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450666368 00000100:00100000:3.0:1762166980.599350:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19306 00000100:00100000:3.0:1762166980.599360:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5589500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450666368:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:3.0:1762166980.599510:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5589500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450666368:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 120us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166980.599521:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19306 00000100:00100000:2.0:1762166980.600636:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.600692:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450666496 00000100:00100000:0.0:1762166980.600698:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450666496 00000100:00100000:0.0:1762166980.600738:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30776 00000100:00100000:0.0:1762166980.600747:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+557:61875:x1847765450666496:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166980.600764:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166980.600782:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbac755 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x61b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea6d7 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.600813:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac75c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x61b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166980.600839:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac75c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x61b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.600849:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac75c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x61b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.600961:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbac755 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x61b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6d7 expref: 559 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.600975:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac75c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x61b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6d7 expref: 558 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.600983:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x61b:0x0].0x0 (ffff945bc4afe700) 00010000:00010000:0.0:1762166980.600986:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1762166980.600990:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdf600, rc 0) 00000100:00100000:0.0:1762166980.601024:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+558:61875:x1847765450666496:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 278us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166980.601031:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30776 00000100:00100000:0.0:1762166980.601889:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.601929:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450666752 00000100:00100000:2.0:1762166980.601935:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450666752 00000100:00100000:2.0:1762166980.601970:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30777 00000100:00100000:2.0:1762166980.601981:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+558:61875:x1847765450666752:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:2.0:1762166980.602011:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166980.602027:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbac701 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x61b:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6a6 expref: 558 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.602039:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x61b:0x0].0x0 (ffff945bc4afe700) 00010000:00010000:2.0:1762166980.602043:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166980.602200:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945d02174400/0x2f180c4effbac763 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x61b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:2.0:1762166980.602221:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945d02174400/0x2f180c4effbac763 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x61b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.602229:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945d02174400/0x2f180c4effbac763 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x61b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000001:00080000:2.0:1762166980.602278:0:6494:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992432 00000004:00010000:2.0:1762166980.602298:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000000298f1e4 reply state 00000000aeab55de transno 4294992433 ns: mdt-lustre-MDT0001_UUID lock: ffff945d02174400/0x2f180c4effbac763 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x61b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.602310:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945d02174400/0x2f180c4effbac763 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x61b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.602316:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x61b:0x0].0x0 (ffff945bc4afe700) 00010000:00010000:2.0:1762166980.602318:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166980.602321:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166980.602376:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+560:61875:x1847765450666752:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 398us (486us total) trans 4294992433 rc 0/0 00000100:00100000:2.0:1762166980.602383:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30777 00000020:00080000:2.0:1762166980.602388:0:6494:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1762166980.603114:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.603142:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450666880 00000100:00100000:0.0:1762166980.603146:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450666880 00000100:00100000:0.0:1762166980.603169:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30778 00000100:00100000:0.0:1762166980.603174:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5589880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+560:61875:x1847765450666880:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166980.603184:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166980.603190:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbac76a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x61b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea6de expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.603219:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbac76a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x61b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6de expref: 561 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.603227:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbac76a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x61b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6de expref: 561 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.603237:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x61b:0x0].0x0 (ffff945bc4afe700) 00010000:00010000:0.0:1762166980.603239:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166980.603240:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bde600, rc 0) 00000100:00100000:0.0:1762166980.603263:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5589880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+561:61875:x1847765450666880:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 89us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166980.603273:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30778 00000100:00100000:0.0:1762166980.604052:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.604083:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450667008 00000100:00100000:2.0:1762166980.604087:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450667008 00000100:00100000:2.0:1762166980.604114:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19307 00000100:00100000:2.0:1762166980.604120:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+20:61875:x1847765450667008:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166980.604127:0:35472:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166980.604135:0:35472:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945d02174e00/0x2f180c4effbac771 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea6e5 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.604152:0:35472:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbac708 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6ad expref: 21 pid: 35472 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166980.604158:0:35472:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166980.604160:0:35472:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166980.604163:0:35472:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945d02174e00/0x2f180c4effbac771 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6e5 expref: 21 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.604184:0:35472:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbac708 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6ad expref: 21 pid: 35472 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166980.604192:0:35472:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbac708 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6ad expref: 21 pid: 35472 timeout: 699 lvb_type: 1 00000100:00100000:2.0:1762166980.604201:0:35472:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc558a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:35472:1847765449772160:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166980.604264:0:35472:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a1540 going to sleep for 11 seconds 00000100:00100000:2.0:1762166980.604904:0:35472:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc558a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:35472:1847765449772160:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166980.604923:0:35472:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945d02174e00/0x2f180c4effbac771 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6e5 expref: 21 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.604931:0:35472:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945d02174e00, rc 0) 00000100:00100000:2.0:1762166980.604961:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+21:61875:x1847765450667008:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 842us (910us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166980.604966:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19307 00000100:00100000:1.0:1762166980.605232:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.605274:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450667136 00000100:00100000:0.0:1762166980.605285:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450667136 00010000:00010000:0.0:1762166980.605314:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbac708 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6ad expref: 21 pid: 35472 timeout: 699 lvb_type: 1 00000100:00100000:0.0:1762166980.605345:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9764 00000100:00100000:0.0:1762166980.605353:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450667136:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166980.605365:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166980.605369:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbac708 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6ad expref: 21 pid: 35472 timeout: 699 lvb_type: 1 00010000:00010000:0.0:1762166980.605379:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbac708 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6ad expref: 21 pid: 35472 timeout: 699 lvb_type: 1 00010000:00010000:0.0:1762166980.605396:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbac708 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6ad expref: 21 pid: 35472 timeout: 699 lvb_type: 1 00010000:00010000:0.0:1762166980.605407:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166980.605409:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166980.605414:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945d02174e00/0x2f180c4effbac771 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6e5 expref: 20 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.605425:0:9458:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945d02174e00/0x2f180c4effbac771 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6e5 expref: 20 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.605456:0:9458:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff945d02174e00/0x2f180c4effbac771 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6e5 expref: 20 pid: 35472 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166980.605465:0:9458:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bba300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:9458:1847765449772288:192.168.204.38@tcp:105: 00000100:00100000:0.0:1762166980.605564:0:9458:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1fe2600 going to sleep for 11 seconds 00000100:00100000:3.0:1762166980.606466:0:9458:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bba300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:9458:1847765449772288:192.168.204.38@tcp:105: 00010000:00010000:3.0:1762166980.606511:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166980.606559:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450667136:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1205us (1327us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166980.606567:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9764 00000100:00100000:1.0:1762166980.606591:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.606629:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450667264 00000100:00100000:2.0:1762166980.606636:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450667264 00000100:00100000:2.0:1762166980.606677:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19308 00000100:00100000:2.0:1762166980.606688:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+21:61875:x1847765450667264:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166980.606699:0:35472:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166980.606722:0:35472:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cc7d17000/0x2f180c4effbac778 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa91:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea6ec expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.606749:0:35472:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945cf3cada00/0x2f180c4effbac70f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa91:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6b4 expref: 22 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166980.606756:0:35472:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166980.606758:0:35472:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166980.606761:0:35472:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cc7d17000/0x2f180c4effbac778 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xa91:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6ec expref: 22 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.606782:0:35472:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945cf3cada00/0x2f180c4effbac70f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa91:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6b4 expref: 22 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166980.606792:0:35472:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945cf3cada00/0x2f180c4effbac70f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa91:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6b4 expref: 22 pid: 9168 timeout: 699 lvb_type: 1 00000100:00100000:2.0:1762166980.606802:0:35472:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc558a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:35472:1847765449772416:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166980.606860:0:35472:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a1540 going to sleep for 11 seconds 00000100:00100000:2.0:1762166980.607457:0:35472:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc558a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:35472:1847765449772416:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166980.607471:0:35472:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945cc7d17000/0x2f180c4effbac778 lrc: 3/0,0 mode: --/PW res: [0x280000400:0xa91:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6ec expref: 22 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.607502:0:35472:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc7d17000, rc 0) 00000100:00100000:2.0:1762166980.607536:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+22:61875:x1847765450667264:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 851us (949us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166980.607543:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19308 00000100:00100000:1.0:1762166980.607624:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.607662:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450667392 00000100:00100000:3.0:1762166980.607667:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450667392 00010000:00010000:3.0:1762166980.607732:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945cf3cada00/0x2f180c4effbac70f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa91:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6b4 expref: 22 pid: 9168 timeout: 699 lvb_type: 1 00000100:00100000:3.0:1762166980.607766:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9765 00000100:00100000:3.0:1762166980.607776:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765450667392:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166980.607786:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166980.607791:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945cf3cada00/0x2f180c4effbac70f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa91:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6b4 expref: 22 pid: 9168 timeout: 699 lvb_type: 1 00010000:00010000:3.0:1762166980.607801:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945cf3cada00/0x2f180c4effbac70f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa91:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6b4 expref: 22 pid: 9168 timeout: 699 lvb_type: 1 00010000:00010000:3.0:1762166980.607827:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cf3cada00/0x2f180c4effbac70f lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa91:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6b4 expref: 22 pid: 9168 timeout: 699 lvb_type: 1 00010000:00010000:3.0:1762166980.607839:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166980.607841:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166980.607847:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945cc7d17000/0x2f180c4effbac778 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa91:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6ec expref: 21 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.607856:0:9458:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cc7d17000/0x2f180c4effbac778 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa91:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6ec expref: 21 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.607881:0:9458:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff945cc7d17000/0x2f180c4effbac778 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa91:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6ec expref: 21 pid: 35472 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166980.607888:0:9458:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cc3550380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:9458:1847765449772544:192.168.204.38@tcp:105: 00000100:00100000:3.0:1762166980.607919:0:9458:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cee17e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166980.608738:0:9458:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cc3550380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:9458:1847765449772544:192.168.204.38@tcp:105: 00010000:00010000:3.0:1762166980.608750:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166980.608793:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450667392:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1018us (1169us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166980.608808:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9765 00000100:00100000:1.0:1762166980.608930:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.608960:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.608981:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450667520 00000100:00100000:2.0:1762166980.608986:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450667520 00000100:00100000:3.0:1762166980.608992:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450667648 00000100:00100000:3.0:1762166980.608998:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450667648 00002000:00010000:2.0:1762166980.609005:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2704 (0->18446744073709551615) 00002000:00100000:2.0:1762166980.609008:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1e6ce00 with x1847765450667520 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166980.609014:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1e6ce00. 00002000:00010000:3.0:1762166980.609016:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2705 (0->18446744073709551615) 00002000:00100000:3.0:1762166980.609021:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1e6f480 with x1847765450667648 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166980.609027:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945cf1e6f480. 00000100:00100000:2.0:1762166980.609038:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2638 00000100:00100000:2.0:1762166980.609045:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450667520:12345-192.168.204.38@tcp:10:lfs.0 00000100:00100000:3.0:1762166980.609063:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2639 00000100:00100000:3.0:1762166980.609080:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450667648:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:2.0:1762166980.609213:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166980.609214:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166980.609217:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb mtime from disk: 0 -> 1762166980 00002000:00010000:3.0:1762166980.609220:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb mtime from disk: 0 -> 1762166980 00002000:00010000:2.0:1762166980.609220:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1762166980.609227:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1762166980.609227:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb ctime from disk: 0 -> 1762166980 00002000:00010000:2.0:1762166980.609233:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:3.0:1762166980.609234:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb ctime from disk: 0 -> 1762166980 00002000:00010000:3.0:1762166980.609238:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1762166980.609265:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450667520:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 220us (340us total) trans 17179876641 rc 0/0 00000100:00100000:3.0:1762166980.609269:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765450667648:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 192us (305us total) trans 21474843421 rc 0/0 00000100:00100000:2.0:1762166980.609274:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2638 00002000:00010000:2.0:1762166980.609280:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2704 (0->18446744073709551615) 00002000:00100000:2.0:1762166980.609285:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1e6ce00 with x1847765450667520 ext(0->18446744073709551615) 00000100:00100000:3.0:1762166980.609289:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2639 00002000:00010000:2.0:1762166980.609292:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1e6ce00. 00002000:00010000:3.0:1762166980.609296:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2705 (0->18446744073709551615) 00002000:00100000:3.0:1762166980.609302:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1e6f480 with x1847765450667648 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166980.609310:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945cf1e6f480. 00000100:00100000:0.0:1762166980.610556:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.610600:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450667776 00000100:00100000:2.0:1762166980.610606:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450667776 00000100:00100000:2.0:1762166980.610636:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19309 00000100:00100000:2.0:1762166980.610642:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+21:2416:x1847765450667776:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:2.0:1762166980.610704:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+21:2416:x1847765450667776:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 63us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166980.610709:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19309 00000100:00100000:0.0:1762166980.611847:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.611900:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450667904 00000100:00100000:2.0:1762166980.611907:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450667904 00000100:00100000:2.0:1762166980.611955:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19310 00000100:00100000:2.0:1762166980.611964:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450667904:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:2.0:1762166980.612075:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450667904:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 112us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166980.612082:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19310 00000100:00100000:1.0:1762166980.613213:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.613264:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450668032 00000100:00100000:3.0:1762166980.613269:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450668032 00000100:00100000:3.0:1762166980.613313:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2640 00000100:00100000:3.0:1762166980.613322:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450668032:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:3.0:1762166980.613357:0:23942:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac200/0x2f180c4effbac77f lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.613374:0:23942:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166980.613376:0:23942:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166980.613382:0:23942:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac200/0x2f180c4effbac77f lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.613401:0:23942:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac200/0x2f180c4effbac77f lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.613533:0:23942:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac200/0x2f180c4effbac77f lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.613542:0:23942:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac200/0x2f180c4effbac77f lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.613551:0:23942:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac200/0x2f180c4effbac77f lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.613558:0:23942:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cac200 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166980.613563:0:23942:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac200/0x2f180c4effbac77f lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.613572:0:23942:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac200/0x2f180c4effbac77f lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.613593:0:23942:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac200/0x2f180c4effbac77f lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.613601:0:23942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac200/0x2f180c4effbac77f lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166980.613641:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450668032:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 320us (429us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1762166980.613649:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2640 00000100:00100000:0.0:1762166980.614711:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.614745:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450668160 00000100:00100000:3.0:1762166980.614752:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450668160 00000100:00100000:3.0:1762166980.614792:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2641 00000100:00100000:3.0:1762166980.614800:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450668160:12345-192.168.204.38@tcp:4:lfs.0 00010000:00010000:3.0:1762166980.614831:0:23942:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc5ae4800/0x2f180c4effbac786 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.614842:0:23942:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945d02174e00/0x2f180c4effbac771 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6e5 expref: 21 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.614847:0:23942:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166980.614848:0:23942:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166980.614850:0:23942:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc5ae4800/0x2f180c4effbac786 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.614878:0:23942:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945d02174e00/0x2f180c4effbac771 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6e5 expref: 21 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.614893:0:23942:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945d02174e00/0x2f180c4effbac771 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6e5 expref: 21 pid: 35472 timeout: 699 lvb_type: 0 00000100:00100000:3.0:1762166980.614905:0:23942:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cc3550380 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_009:lustre-OST0001_UUID:23942:1847765449772672:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166980.614965:0:23942:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cee17e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166980.615916:0:23942:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cc3550380 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_009:lustre-OST0001_UUID:23942:1847765449772672:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166980.615941:0:23942:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc5ae4800/0x2f180c4effbac786 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166980.615958:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.616026:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450668288 00000100:00100000:1.0:1762166980.616031:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450668288 00010000:00010000:1.0:1762166980.616058:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945d02174e00/0x2f180c4effbac771 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6e5 expref: 22 pid: 35472 timeout: 699 lvb_type: 0 00000100:00100000:1.0:1762166980.616088:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9766 00000100:00100000:1.0:1762166980.616096:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765450668288:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166980.616108:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166980.616128:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945d02174e00/0x2f180c4effbac771 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6e5 expref: 22 pid: 35472 timeout: 699 lvb_type: 0 00010000:00010000:1.0:1762166980.616141:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945d02174e00/0x2f180c4effbac771 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6e5 expref: 22 pid: 35472 timeout: 699 lvb_type: 0 00010000:00010000:1.0:1762166980.616162:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945d02174e00/0x2f180c4effbac771 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6e5 expref: 22 pid: 35472 timeout: 699 lvb_type: 0 00010000:00010000:1.0:1762166980.616176:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166980.616179:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166980.616183:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc5ae4800/0x2f180c4effbac786 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.616191:0:9458:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc5ae4800/0x2f180c4effbac786 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.616218:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166980.616242:0:23942:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc5ae4800/0x2f180c4effbac786 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.616252:0:23942:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc5ae4800/0x2f180c4effbac786 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166980.616263:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450668288:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 164us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166980.616272:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9766 00000001:00080000:2.0:1762166980.617438:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876642 is committed 00002000:00010000:3.0:1762166980.617535:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb size from disk: 0 -> 4096 00002000:00010000:3.0:1762166980.617539:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1762166980.617545:0:23942:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc5ae4800/0x2f180c4effbac786 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.617552:0:23942:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc5ae4800/0x2f180c4effbac786 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.617557:0:23942:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc5ae4800/0x2f180c4effbac786 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.617564:0:23942:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc5ae4800 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166980.617567:0:23942:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc5ae4800/0x2f180c4effbac786 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.617573:0:23942:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc5ae4800/0x2f180c4effbac786 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.617584:0:23942:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc5ae4800/0x2f180c4effbac786 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.617588:0:23942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc5ae4800/0x2f180c4effbac786 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166980.617643:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450668160:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 2843us (2933us total) trans 17179876642 rc 0/0 00000100:00100000:3.0:1762166980.617650:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2641 00000100:00100000:0.0:1762166980.618731:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.618769:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450668416 00000100:00100000:2.0:1762166980.618776:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450668416 00000100:00100000:2.0:1762166980.618831:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19311 00000100:00100000:2.0:1762166980.618841:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+17:2416:x1847765450668416:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:2.0:1762166980.618939:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+17:2416:x1847765450668416:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 100us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166980.618943:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19311 00000100:00100000:0.0:1762166980.620212:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.620256:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450668544 00000100:00100000:2.0:1762166980.620261:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450668544 00000100:00100000:2.0:1762166980.620291:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19312 00000100:00100000:2.0:1762166980.620300:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450668544:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:2.0:1762166980.620356:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450668544:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 57us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166980.620362:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19312 00000100:00100000:1.0:1762166980.621585:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.621657:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450668672 00000100:00100000:3.0:1762166980.621664:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450668672 00000100:00100000:3.0:1762166980.621713:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2642 00000100:00100000:3.0:1762166980.621727:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450668672:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:3.0:1762166980.621759:0:23942:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945cf3cada00/0x2f180c4effbac78d lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.621770:0:23942:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166980.621771:0:23942:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166980.621775:0:23942:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cf3cada00/0x2f180c4effbac78d lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [126976->167935] (req 126976->167935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.621787:0:23942:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cf3cada00/0x2f180c4effbac78d lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [126976->167935] (req 126976->167935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.622816:0:23942:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945cf3cada00/0x2f180c4effbac78d lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [126976->167935] (req 126976->167935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.622836:0:23942:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945cf3cada00/0x2f180c4effbac78d lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [126976->167935] (req 126976->167935) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.622841:0:23942:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945cf3cada00/0x2f180c4effbac78d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [126976->167935] (req 126976->167935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.622845:0:23942:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cada00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166980.622848:0:23942:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945cf3cada00/0x2f180c4effbac78d lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [126976->167935] (req 126976->167935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.622853:0:23942:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945cf3cada00/0x2f180c4effbac78d lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [126976->167935] (req 126976->167935) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.622864:0:23942:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945cf3cada00/0x2f180c4effbac78d lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [126976->167935] (req 126976->167935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.622868:0:23942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cf3cada00/0x2f180c4effbac78d lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [126976->167935] (req 126976->167935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166980.622911:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450668672:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 1190us (1333us total) trans 0 rc 36897/36897 00000100:00100000:3.0:1762166980.622923:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2642 00000100:00100000:0.0:1762166980.624106:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.624146:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450668800 00000100:00100000:3.0:1762166980.624155:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450668800 00000100:00100000:3.0:1762166980.624220:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2643 00000100:00100000:3.0:1762166980.624230:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450668800:12345-192.168.204.38@tcp:4:lfs.0 00002000:00010000:3.0:1762166980.624275:0:23942:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa90:0x0] initial LVB size: 4096, mtime: 0x690888c4, atime: 0x0, ctime: 0x690888c4, blocks: 0x8 00010000:00010000:3.0:1762166980.624284:0:23942:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac200/0x2f180c4effbac794 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.624297:0:23942:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166980.624299:0:23942:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166980.624305:0:23942:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac200/0x2f180c4effbac794 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [126976->167935] (req 126976->167935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.624316:0:23942:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac200/0x2f180c4effbac794 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [126976->167935] (req 126976->167935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00000001:00080000:2.0:1762166980.626690:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876643 is committed 00002000:00010000:3.0:1762166980.626773:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb size from disk: 4096 -> 163873 00002000:00010000:3.0:1762166980.626782:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb blocks from disk: 8 -> 88 00010000:00010000:3.0:1762166980.626794:0:23942:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac200/0x2f180c4effbac794 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [126976->167935] (req 126976->167935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.626805:0:23942:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac200/0x2f180c4effbac794 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [126976->167935] (req 126976->167935) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.626814:0:23942:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac200/0x2f180c4effbac794 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [126976->167935] (req 126976->167935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.626842:0:23942:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cac200 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166980.626847:0:23942:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac200/0x2f180c4effbac794 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [126976->167935] (req 126976->167935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.626856:0:23942:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac200/0x2f180c4effbac794 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [126976->167935] (req 126976->167935) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.626872:0:23942:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac200/0x2f180c4effbac794 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [126976->167935] (req 126976->167935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.626879:0:23942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac200/0x2f180c4effbac794 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [126976->167935] (req 126976->167935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166980.626967:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450668800:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 2735us (2860us total) trans 17179876643 rc 0/0 00000100:00100000:3.0:1762166980.626977:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2643 00000100:00100000:0.0:1762166980.628138:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.628188:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450668928 00000100:00100000:2.0:1762166980.628197:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450668928 00000100:00100000:2.0:1762166980.628255:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30779 00000100:00100000:2.0:1762166980.628265:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+561:61875:x1847765450668928:12345-192.168.204.38@tcp:44:lfs.0 00000001:00080000:1.0:1762166980.629359:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294992433 is committed 00010000:00010000:3.0:1762166980.629392:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5ae4a00/0x2f180c4effbac683 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00000020:00080000:1.0:1762166980.629398:0:7412:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff945cee171000 refcount 2 committed 0 result 0 batchid 62 00000020:00080000:1.0:1762166980.629407:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945bc2d82b00 obd lustre-OST0001-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff945cc4eeae40 00010000:00010000:3.0:1762166980.629408:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5ae4a00/0x2f180c4effbac683 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00000020:00080000:1.0:1762166980.629413:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945bc2d82600 obd lustre-OST0000-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff945cee171900 00000020:00080000:1.0:1762166980.629421:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945bc2d82700 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff945bc8e78c00 00010000:00010000:3.0:1762166980.629422:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5ae4a00/0x2f180c4effbac683 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00000020:00080000:1.0:1762166980.629427:0:7412:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000400:0x2:0x0].61 00010000:00010000:3.0:1762166980.629434:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc5ae4a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166980.629439:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5ae4a00/0x2f180c4effbac683 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.629451:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5ae4a00/0x2f180c4effbac683 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.629465:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00000020:00080000:1.0:1762166980.629466:0:7412:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0001: 61 batchid updated 00010000:00010000:3.0:1762166980.629472:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000020:00080000:2.0:1762166980.629496:0:7435:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 62 committed batchid 61 00010000:00010000:3.0:1762166980.629504:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5ae4a00/0x2f180c4effbac683 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.629517:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5ae4a00/0x2f180c4effbac683 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.629539:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbac698 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.629547:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbac698 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.629553:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbac698 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.629558:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bde800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166980.629561:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbac698 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.629569:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbac698 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.629579:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:3.0:1762166980.629582:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000020:00080000:2.0:1762166980.629583:0:7435:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 61 cancel update log [0x240000400:0x2:0x0].60: rc = 0 00010000:00010000:3.0:1762166980.629586:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbac698 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00000020:00080000:2.0:1762166980.629591:0:7435:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 61 00010000:00010000:3.0:1762166980.629595:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbac698 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.629610:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945d02174400/0x2f180c4effbac763 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x61b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.629616:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945d02174400/0x2f180c4effbac763 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x61b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.629622:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945d02174400/0x2f180c4effbac763 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x61b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.629629:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945d02174400 already unused, calling callback (ffffffffc18e2310) 00000100:00100000:0.0:1762166980.629631:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+530:61875:x1847765450668928:12345-192.168.204.38@tcp:44:lfs.0 Request processed in 1360us (1488us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166980.629633:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945d02174400/0x2f180c4effbac763 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x61b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.629646:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945d02174400/0x2f180c4effbac763 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x61b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00000100:00100000:0.0:1762166980.629649:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30779 00010000:00010000:3.0:1762166980.629662:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x61b:0x0].0x0 (ffff945bc4afe700) 00010000:00010000:3.0:1762166980.629665:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166980.629668:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945d02174400/0x2f180c4effbac763 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x61b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.629674:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945d02174400/0x2f180c4effbac763 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x61b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00000100:00100000:0.0:1762166980.630752:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.630784:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.630809:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450669056 00000100:00100000:2.0:1762166980.630827:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450669056 00000100:00100000:1.0:1762166980.630841:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450669184 00000100:00100000:1.0:1762166980.630846:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450669184 00000100:00100000:2.0:1762166980.630866:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19313 00000100:00100000:2.0:1762166980.630874:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450669056:12345-192.168.204.38@tcp:16:lfs.0 00000100:00100000:1.0:1762166980.630888:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19314 00000100:00100000:1.0:1762166980.630896:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765450669184:12345-192.168.204.38@tcp:16:lfs.0 00000100:00100000:2.0:1762166980.630934:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450669056:12345-192.168.204.38@tcp:16:lfs.0 Request processed in 60us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166980.630941:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19313 00000001:00080000:3.0:1762166980.631801:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843421 is committed 00000001:00080000:3.0:1762166980.631811:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843418 is committed 00000100:00100000:1.0:1762166980.631915:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+16:2418:x1847765450669184:12345-192.168.204.38@tcp:16:lfs.0 Request processed in 1019us (1130us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166980.631923:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19314 00000100:00100000:0.0:1762166980.637983:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.638022:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450669312 00000100:00100000:1.0:1762166980.638030:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450669312 00000100:00100000:0.0:1762166980.638070:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.638081:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450669440 00000100:00100000:1.0:1762166980.638086:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450669440 00000100:00100000:0.0:1762166980.638104:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.638122:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450669568 00000100:00100000:1.0:1762166980.638126:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450669568 00000100:00100000:2.0:1762166980.638136:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19315 00000100:00100000:0.0:1762166980.638149:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19316 00000100:00100000:2.0:1762166980.638155:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+18:2416:x1847765450669312:12345-192.168.204.38@tcp:1:lfs.0 00000100:00100000:3.0:1762166980.638161:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19317 00000100:00100000:0.0:1762166980.638171:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+16:2417:x1847765450669440:12345-192.168.204.38@tcp:1:lfs.0 00000100:00100000:3.0:1762166980.638178:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+18:2416:x1847765450669568:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:2.0:1762166980.638204:0:35472:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945cc7d16400/0x2f180c4effbac79b lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.638205:0:35248:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac200/0x2f180c4effbac7a9 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.638207:0:9165:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde200/0x2f180c4effbac7a2 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.638235:0:35248:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166980.638235:0:35472:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166980.638235:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166980.638238:0:35248:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166980.638240:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166980.638241:0:35472:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166980.638243:0:35248:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac200/0x2f180c4effbac7a9 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.638246:0:9165:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde200/0x2f180c4effbac7a2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.638247:0:35472:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc7d16400/0x2f180c4effbac79b lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.638255:0:35248:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac200/0x2f180c4effbac7a9 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.638272:0:9165:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde200/0x2f180c4effbac7a2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.638274:0:35472:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cc7d16400/0x2f180c4effbac79b lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.638286:0:35248:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac200/0x2f180c4effbac7a9 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.638299:0:35248:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac200/0x2f180c4effbac7a9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.638302:0:9165:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde200/0x2f180c4effbac7a2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.638305:0:35248:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac200/0x2f180c4effbac7a9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.638305:0:35472:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945cc7d16400/0x2f180c4effbac79b lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.638324:0:9165:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde200/0x2f180c4effbac7a2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.638327:0:35248:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cac200 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166980.638332:0:35248:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac200/0x2f180c4effbac7a9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.638332:0:35472:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945cc7d16400/0x2f180c4effbac79b lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.638339:0:9165:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde200/0x2f180c4effbac7a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.638351:0:35248:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac200/0x2f180c4effbac7a9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.638355:0:9165:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bde200 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166980.638361:0:9165:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde200/0x2f180c4effbac7a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.638377:0:35248:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac200/0x2f180c4effbac7a9 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.638384:0:9165:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde200/0x2f180c4effbac7a2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.638390:0:35472:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945cc7d16400/0x2f180c4effbac79b lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.638413:0:35472:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc7d16400 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166980.638415:0:35248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac200/0x2f180c4effbac7a9 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.638416:0:9165:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde200/0x2f180c4effbac7a2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.638418:0:35472:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc7d16400/0x2f180c4effbac79b lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.638442:0:35472:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc7d16400/0x2f180c4effbac79b lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.638447:0:9165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde200/0x2f180c4effbac7a2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.638460:0:35472:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945cc7d16400/0x2f180c4effbac79b lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.638470:0:35472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cc7d16400/0x2f180c4effbac79b lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166980.638521:0:35248:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+18:2416:x1847765450669568:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 348us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166980.638527:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+16:2417:x1847765450669440:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 365us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166980.638533:0:35248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19317 00000100:00100000:2.0:1762166980.638546:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+17:2416:x1847765450669312:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 396us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166980.638546:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19316 00000100:00100000:2.0:1762166980.638558:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19315 00000100:00100000:2.0:1762166980.639545:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.639580:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450669824 00000100:00100000:0.0:1762166980.639585:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450669824 00000100:00100000:0.0:1762166980.639621:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30780 00000100:00100000:0.0:1762166980.639629:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+529:61875:x1847765450669824:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:0.0:1762166980.639687:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbac7b0 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x61b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166980.639699:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbac7b0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x61b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.639707:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbac7b0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x61b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00010000:0.0:1762166980.639832:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000153947b6 reply state 000000001428ca2c transno 4294992434 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbac7b0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x61b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.639844:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbac7b0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x61b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.639850:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x61b:0x0].0x0 (ffff945bc4afe700) 00010000:00010000:0.0:1762166980.639853:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762166980.639857:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166980.639918:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+531:61875:x1847765450669824:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 289us (374us total) trans 4294992434 rc 0/0 00000100:00100000:0.0:1762166980.639927:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30780 00000100:00100000:1.0:1762166980.640805:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.640841:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450669952 00000100:00100000:2.0:1762166980.640845:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450669952 00000100:00100000:2.0:1762166980.640871:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19318 00000100:00100000:2.0:1762166980.640876:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450669952:12345-192.168.204.38@tcp:2:lfs.0 00000100:00100000:3.0:1762166980.640917:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.640946:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450670080 00000100:00100000:0.0:1762166980.640952:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450670080 00000100:00100000:2.0:1762166980.640970:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450669952:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 93us (166us total) trans 17179876644 rc 0/0 00000100:00100000:2.0:1762166980.640976:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19318 00000100:00100000:0.0:1762166980.640984:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19319 00000100:00100000:0.0:1762166980.640994:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc3550380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+16:2419:x1847765450670080:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:0.0:1762166980.641069:0:9165:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166980.641072:0:9165:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00002000:00010000:0.0:1762166980.641075:0:9165:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb atime from disk: 0 -> 1762166980 00002000:00010000:0.0:1762166980.641078:0:9165:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:0.0:1762166980.641080:0:9165:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1762166980.641112:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc3550380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450670080:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 120us (197us total) trans 21474843422 rc 0/0 00000100:00100000:0.0:1762166980.641119:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19319 00000100:00100000:3.0:1762166980.641896:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.641930:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450670336 00000100:00100000:0.0:1762166980.641935:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450670336 00000100:00100000:0.0:1762166980.641963:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30781 00000100:00100000:0.0:1762166980.641970:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc3550700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+531:61875:x1847765450670336:12345-192.168.204.38@tcp:55:lfs.0 00010000:00010000:0.0:1762166980.641999:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbac7b7 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x61b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166980.642009:0:6494:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac75c lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x61b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6d7 expref: 531 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.642016:0:6494:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbac7b7 lrc: 4/0,1 mode: --/PW res: [0x240000404:0x61b:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.642045:0:6494:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac75c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x61b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6d7 expref: 531 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.642059:0:6494:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac75c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x61b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6d7 expref: 531 pid: 6494 timeout: 699 lvb_type: 0 00000100:00100000:0.0:1762166980.642071:0:6494:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc47b4380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765449772800:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166980.642132:0:6494:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1fe20c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166980.642880:0:6494:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc47b4380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765449772800:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166980.642895:0:6494:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbac7b7 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x61b:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000100:00100000:3.0:1762166980.643050:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.643097:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450670464 00000100:00100000:1.0:1762166980.643101:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450670464 00010000:00010000:1.0:1762166980.643121:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac75c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x61b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6d7 expref: 532 pid: 6494 timeout: 699 lvb_type: 0 00000100:00100000:1.0:1762166980.643147:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9767 00000100:00100000:1.0:1762166980.643155:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc3551c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+532:2419:x1847765450670464:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166980.643165:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166980.643170:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac75c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x61b:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6d7 expref: 532 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:1.0:1762166980.643181:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac75c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x61b:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6d7 expref: 532 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:1.0:1762166980.643196:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac75c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x61b:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6d7 expref: 532 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:1.0:1762166980.643208:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x61b:0x0].0x0 (ffff945bc4afe700) 00010000:00010000:1.0:1762166980.643211:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbac7b7 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x61b:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.643218:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbac7b7 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x61b:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.643225:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbac7b7 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x61b:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.643244:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166980.643262:0:6494:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbac7b7 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x61b:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.643270:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbac7b7 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x61b:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000100:00100000:1.0:1762166980.643276:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc3551c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+531:2419:x1847765450670464:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 120us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166980.643285:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9767 00010000:00010000:0.0:1762166980.643296:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbac7b7 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x61b:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.643304:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbac7b7 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x61b:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.643311:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbac7b7 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x61b:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.643316:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bde400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166980.643320:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbac7b7 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x61b:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.643325:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbac7b7 lrc: 4/0,0 mode: PW/PW res: [0x240000404:0x61b:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.643338:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x61b:0x0].0x0 (ffff945bc4afe700) 00010000:00010000:0.0:1762166980.643341:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1762166980.643345:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbac7b7 lrc: 2/0,0 mode: --/PW res: [0x240000404:0x61b:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.643351:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbac7b7 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x61b:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00000100:00100000:0.0:1762166980.643396:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc3550700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+530:61875:x1847765450670336:12345-192.168.204.38@tcp:55:lfs.0 Request processed in 1426us (1500us total) trans 0 rc -22/-22 00000100:00100000:0.0:1762166980.643404:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30781 00000100:00100000:3.0:1762166980.644410:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.644505:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450670720 00000100:00100000:0.0:1762166980.644519:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450670720 00000100:00100000:0.0:1762166980.644591:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30782 00000100:00100000:0.0:1762166980.644603:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc3553100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+530:61875:x1847765450670720:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:0.0:1762166980.644658:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166980.644683:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbac6a6 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea68a expref: 530 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.644702:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:0.0:1762166980.644707:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166980.644764:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbac7be lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166980.644778:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbac7be lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.644788:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbac7be lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00010000:0.0:1762166980.644930:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000379142e6 reply state 00000000cebbfbbd transno 4294992435 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbac7be lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.644944:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbac7be lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.644951:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:0.0:1762166980.644953:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762166980.644956:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166980.645055:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc3553100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+531:61875:x1847765450670720:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 454us (646us total) trans 4294992435 rc 0/0 00000100:00100000:0.0:1762166980.645063:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30782 00000100:00100000:1.0:1762166980.645935:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.645958:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.645988:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.645991:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450670848 00000100:00100000:0.0:1762166980.645999:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450670848 00000100:00100000:0.0:1762166980.646049:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450670976 00000100:00100000:0.0:1762166980.646053:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450670976 00000100:00100000:2.0:1762166980.646055:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450671104 00000100:00100000:3.0:1762166980.646065:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19320 00000100:00100000:2.0:1762166980.646065:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450671104 00000100:00100000:3.0:1762166980.646084:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450670848:12345-192.168.204.38@tcp:2:lfs.0 00000100:00100000:1.0:1762166980.646088:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19321 00000100:00100000:1.0:1762166980.646098:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450670976:12345-192.168.204.38@tcp:2:lfs.0 00000100:00100000:0.0:1762166980.646109:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19322 00000100:00100000:0.0:1762166980.646124:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450671104:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:3.0:1762166980.646217:0:35248:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 163873 -> 163873 00002000:00010000:1.0:1762166980.646217:0:9168:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166980.646223:0:35248:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00002000:00010000:1.0:1762166980.646223:0:9168:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00002000:00010000:3.0:1762166980.646227:0:35248:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00002000:00010000:1.0:1762166980.646227:0:9168:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00002000:00010000:3.0:1762166980.646231:0:35248:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:1.0:1762166980.646231:0:9168:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:0.0:1762166980.646231:0:9165:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166980.646244:0:35248:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 256 -> 256 00002000:00010000:1.0:1762166980.646244:0:9168:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00002000:00010000:0.0:1762166980.646244:0:9165:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00002000:00010000:0.0:1762166980.646257:0:9165:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00002000:00010000:0.0:1762166980.646263:0:9165:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:0.0:1762166980.646266:0:9165:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166980.646304:0:35248:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450670848:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 222us (367us total) trans 17179876645 rc 0/0 00000100:00100000:1.0:1762166980.646304:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450670976:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 204us (341us total) trans 21474843423 rc 0/0 00000100:00100000:0.0:1762166980.646307:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450671104:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 185us (316us total) trans 17179876646 rc 0/0 00000100:00100000:3.0:1762166980.646328:0:35248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19320 00000100:00100000:0.0:1762166980.646340:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19322 00000100:00100000:1.0:1762166980.646363:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19321 00000100:00100000:2.0:1762166980.647581:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.647626:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450671360 00000100:00100000:0.0:1762166980.647634:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450671360 00000100:00100000:0.0:1762166980.647675:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11961 00000100:00100000:0.0:1762166980.647685:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5589c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+531:61875:x1847765450671360:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:0.0:1762166980.647753:0:19593:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x240000404:0x5eb:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42f6200/0x2f180c4effbac71d lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6bb expref: 531 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.647787:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbac7c5 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166980.647800:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7b000/0x2f180c4effbac644 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea66e expref: 531 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.647808:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbac67c lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea67c expref: 531 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.647816:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbac7c5 lrc: 5/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166980.647866:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbac67c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea67c expref: 531 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.647882:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbac67c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea67c expref: 531 pid: 6494 timeout: 699 lvb_type: 0 00000100:00100000:0.0:1762166980.647900:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc47b4380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449772928:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166980.647979:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7b000/0x2f180c4effbac644 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea66e expref: 531 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.647985:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7b000/0x2f180c4effbac644 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea66e expref: 531 pid: 6494 timeout: 699 lvb_type: 0 00000100:00100000:0.0:1762166980.647992:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc47b5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449773056:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166980.648011:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1fe2180 going to sleep for 11 seconds 00000100:00100000:0.0:1762166980.649143:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc47b4380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449772928:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166980.649157:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc47b5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449773056:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166980.649179:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbac7c5 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:2.0:1762166980.649381:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.649433:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450671488 00000100:00100000:1.0:1762166980.649438:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450671488 00010000:00010000:1.0:1762166980.649466:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7b000/0x2f180c4effbac644 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea66e expref: 532 pid: 6494 timeout: 699 lvb_type: 0 00000100:00100000:3.0:1762166980.649472:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.649524:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450671616 00000100:00100000:1.0:1762166980.649528:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450671616 00010000:00010000:1.0:1762166980.649542:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbac67c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea67c expref: 533 pid: 6494 timeout: 699 lvb_type: 0 00000100:00100000:0.0:1762166980.649552:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9768 00000100:00100000:0.0:1762166980.649563:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945d0207ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+533:2419:x1847765450671488:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166980.649576:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1762166980.649582:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9769 00010000:00010000:0.0:1762166980.649586:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7b000/0x2f180c4effbac644 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea66e expref: 533 pid: 6494 timeout: 699 lvb_type: 0 00000100:00100000:1.0:1762166980.649598:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc3553480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+533:2418:x1847765450671616:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166980.649603:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7b000/0x2f180c4effbac644 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea66e expref: 533 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:1.0:1762166980.649610:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166980.649618:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbac67c lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea67c expref: 533 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:0.0:1762166980.649625:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc8c7b000/0x2f180c4effbac644 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea66e expref: 533 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:1.0:1762166980.649635:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbac67c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea67c expref: 533 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:0.0:1762166980.649654:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:0.0:1762166980.649661:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbac7c5 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166980.649670:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbac7c5 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166980.649680:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166980.649691:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbac67c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea67c expref: 532 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:1.0:1762166980.649706:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:1.0:1762166980.649710:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbac7c5 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:0.0:1762166980.649719:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945d0207ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+531:2419:x1847765450671488:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 156us (337us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166980.649721:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbac7c5 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00000100:00100000:0.0:1762166980.649732:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9768 00010000:00010000:1.0:1762166980.649734:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbac7c5 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166980.649768:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166980.649807:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbac7c5 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:1.0:1762166980.649808:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc3553480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+530:2418:x1847765450671616:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 214us (338us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166980.649834:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbac7c5 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:1.0:1762166980.649843:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9769 00010000:00010000:3.0:1762166980.649858:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac200/0x2f180c4effbac7cc lrc: 3/0,1 mode: --/EX res: [0x240000404:0x61b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:3.0:1762166980.649869:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbac76a lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x61b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6de expref: 529 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.649877:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac200/0x2f180c4effbac7cc lrc: 4/0,1 mode: --/EX res: [0x240000404:0x61b:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166980.649901:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbac76a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x61b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6de expref: 529 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.649912:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbac76a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x61b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6de expref: 529 pid: 6494 timeout: 699 lvb_type: 0 00000100:00100000:3.0:1762166980.649923:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cc3551880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449773184:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166980.649969:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cee17e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166980.651085:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cc3551880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449773184:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166980.651105:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac200/0x2f180c4effbac7cc lrc: 3/0,1 mode: --/EX res: [0x240000404:0x61b:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:2.0:1762166980.651112:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.651147:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450671744 00000100:00100000:1.0:1762166980.651152:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450671744 00010000:00010000:1.0:1762166980.651169:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbac76a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x61b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6de expref: 530 pid: 6494 timeout: 699 lvb_type: 0 00000100:00100000:1.0:1762166980.651201:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9770 00000100:00100000:1.0:1762166980.651209:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+530:2418:x1847765450671744:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166980.651220:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166980.651226:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbac76a lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x61b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6de expref: 530 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:1.0:1762166980.651243:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbac76a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x61b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6de expref: 530 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:1.0:1762166980.651259:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbac76a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x61b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6de expref: 530 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:1.0:1762166980.651271:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x61b:0x0].0x0 (ffff945bc4afe700) 00010000:00010000:1.0:1762166980.651275:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac200/0x2f180c4effbac7cc lrc: 3/0,1 mode: --/EX res: [0x240000404:0x61b:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166980.651281:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac200/0x2f180c4effbac7cc lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x61b:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166980.651286:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac200/0x2f180c4effbac7cc lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x61b:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166980.651303:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166980.651328:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac200/0x2f180c4effbac7cc lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x61b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166980.651336:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac200/0x2f180c4effbac7cc lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x61b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:1.0:1762166980.651339:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+529:2418:x1847765450671744:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 131us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166980.651346:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9770 00000100:00100000:3.0:1762166980.651811:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cc3551880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449773312:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166980.651869:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166980.651901:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc9a5e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166980.651924:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449773312 00000100:00100000:1.0:1762166980.651930:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449773312 00000100:00100000:1.0:1762166980.651966:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1457 00000100:00100000:1.0:1762166980.651973:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc3552d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449773312:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166980.652057:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc3552d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449773312:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 84us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166980.652065:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1457 00000100:00100000:3.0:1762166980.652082:0:19593:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 17179876627 gen 2 00000004:00080000:3.0:1762166980.652090:0:19593:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 17179876620 committed transno 17179876627 00000004:00080000:3.0:1762166980.652110:0:19593:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc55dfb80, transno 17179876621 00000004:00080000:3.0:1762166980.652126:0:19593:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc55df480, transno 17179876622 00000004:00080000:3.0:1762166980.652129:0:19593:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc55dd880, transno 17179876623 00000004:00080000:3.0:1762166980.652132:0:19593:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc55dce00, transno 17179876624 00000004:00080000:3.0:1762166980.652136:0:19593:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 17179876627 committed transno 17179876627 00000100:00100000:3.0:1762166980.652157:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cc3551880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449773312:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166980.652193:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cc3551880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449773440:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166980.652215:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166980.652236:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc9a5e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166980.652255:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449773440 00000100:00100000:1.0:1762166980.652262:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449773440 00000100:00100000:1.0:1762166980.652299:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1458 00000004:00080000:0.0:1762166980.652304:0:9994:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0001: 1 changes, 0 in progress, 0 in flight, 4 done 00000100:00100000:1.0:1762166980.652310:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc3553800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449773440:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166980.652380:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc3553800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449773440:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 73us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166980.652386:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1458 00000100:00100000:3.0:1762166980.652409:0:19593:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 21474843418 gen 2 00000004:00080000:3.0:1762166980.652414:0:19593:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc5765f80, transno 21474843409 00000004:00080000:3.0:1762166980.652428:0:19593:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 21474843412 committed transno 21474843418 00000004:00080000:3.0:1762166980.652440:0:19593:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc5764380, transno 21474843413 00000004:00080000:3.0:1762166980.652445:0:19593:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc5767480, transno 21474843414 00000004:00080000:3.0:1762166980.652448:0:19593:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc5765500, transno 21474843415 00000004:00080000:3.0:1762166980.652452:0:19593:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc5766680, transno 21474843416 00000004:00080000:3.0:1762166980.652464:0:19593:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 21474843418 committed transno 21474843418 00000100:00100000:3.0:1762166980.652508:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cc3551880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449773440:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166980.652563:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cc3551880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449773568:0@lo:1000:mdt_rdpg00_003.0 00000004:00080000:2.0:1762166980.652585:0:9158:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0001: 1 changes, 0 in progress, 0 in flight, 5 done 00000100:00100000:3.0:1762166980.652602:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166980.652624:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc4eeae40 going to sleep for 11 seconds 00000100:00100000:1.0:1762166980.652649:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449773568 00000100:00100000:1.0:1762166980.652654:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449773568 00000100:00100000:1.0:1762166980.652682:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1459 00000100:00100000:1.0:1762166980.652690:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc3550e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449773568:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166980.652747:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc3550e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449773568:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 59us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166980.652755:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1459 00000100:00100000:3.0:1762166980.652761:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cc3551880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449773568:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166980.652792:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cc3551880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449773696:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166980.652812:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166980.652865:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cee17e6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166980.652877:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449773696 00000100:00100000:1.0:1762166980.652884:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449773696 00000100:00100000:1.0:1762166980.652912:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1460 00000100:00100000:1.0:1762166980.652918:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc3552a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449773696:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166980.652990:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc3552a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449773696:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 72us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166980.652997:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1460 00000100:00100000:3.0:1762166980.653002:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cc3551880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449773696:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166980.653041:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cc3551880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449773824:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166980.653061:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166980.653077:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc56bf540 going to sleep for 11 seconds 00000100:00100000:1.0:1762166980.653081:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449773824 00000100:00100000:1.0:1762166980.653085:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449773824 00000100:00100000:1.0:1762166980.653112:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1461 00000100:00100000:1.0:1762166980.653118:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc3551180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449773824:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166980.653178:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc3551180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449773824:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 59us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166980.653185:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1461 00000100:00100000:3.0:1762166980.653211:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cc3551880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449773824:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166980.653248:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cc3551880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449773952:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166980.653268:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166980.653285:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc56bf840 going to sleep for 11 seconds 00000100:00100000:1.0:1762166980.653287:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449773952 00000100:00100000:1.0:1762166980.653293:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449773952 00000100:00100000:1.0:1762166980.653318:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1462 00000100:00100000:1.0:1762166980.653324:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc3551c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449773952:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166980.653383:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc3551c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449773952:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 58us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166980.653390:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1462 00000100:00100000:3.0:1762166980.653399:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cc3551880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449773952:0@lo:1000:mdt_rdpg00_003.0 00000040:00080000:3.0:1762166980.653568:0:19593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x2:0x0].62, 456 off71608 00000001:00080000:3.0:1762166980.653577:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992436 00000100:00100000:3.0:1762166980.653621:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cc3551880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449774080:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166980.653643:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166980.653664:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc56bf840 going to sleep for 11 seconds 00000100:00100000:1.0:1762166980.653681:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449774080 00000100:00100000:1.0:1762166980.653686:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449774080 00000100:00100000:1.0:1762166980.653718:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1463 00000100:00100000:1.0:1762166980.653726:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5765f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449774080:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166980.653854:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5765f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:19593:x1847765449774080:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 128us (209us total) trans 17179876647 rc 0/0 00000100:00100000:1.0:1762166980.653862:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1463 00000100:00100000:3.0:1762166980.653881:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cc3551880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449774080:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166980.653899:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5764380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449774208:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166980.653915:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166980.653928:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc56bf840 going to sleep for 11 seconds 00000100:00100000:1.0:1762166980.653937:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449774208 00000100:00100000:1.0:1762166980.653943:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449774208 00000100:00100000:1.0:1762166980.653971:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1464 00000100:00100000:1.0:1762166980.653978:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5767480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449774208:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166980.654075:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5767480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:19593:x1847765449774208:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 96us (156us total) trans 21474843424 rc 0/0 00000100:00100000:3.0:1762166980.654081:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5764380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449774208:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166980.654086:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1464 00000001:00080000:3.0:1762166980.654121:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992437 00010000:00010000:3.0:1762166980.654138:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac200/0x2f180c4effbac7cc lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x61b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166980.654149:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac200/0x2f180c4effbac7cc lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x61b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166980.654154:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac200/0x2f180c4effbac7cc lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x61b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166980.654158:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cac200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166980.654161:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac200/0x2f180c4effbac7cc lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x61b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166980.654167:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac200/0x2f180c4effbac7cc lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x61b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166980.654180:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x61b:0x0].0x0 (ffff945bc4afe700) 00010000:00010000:3.0:1762166980.654182:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166980.654185:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac200/0x2f180c4effbac7cc lrc: 2/0,0 mode: --/EX res: [0x240000404:0x61b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166980.654189:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac200/0x2f180c4effbac7cc lrc: 0/0,0 mode: --/EX res: [0x240000404:0x61b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166980.654198:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbac7c5 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166980.654201:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbac7c5 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166980.654204:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbac7c5 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166980.654208:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bde000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166980.654209:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbac7c5 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166980.654215:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbac7c5 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166980.654220:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:3.0:1762166980.654221:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1762166980.654223:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbac7c5 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166980.654225:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbac7c5 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166980.654232:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:3.0:1762166980.654234:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166980.654238:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42f6200/0x2f180c4effbac71d lrc: 0/0,0 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6bb expref: 531 pid: 6494 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166980.654307:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5589c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+530:61875:x1847765450671360:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 6626us (6732us total) trans 4294992438 rc 0/0 00000100:00100000:3.0:1762166980.654312:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11961 00000020:00080000:3.0:1762166980.654315:0:19593:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1762166980.655516:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.655565:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450671872 00000100:00100000:0.0:1762166980.655571:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450671872 00000100:00100000:0.0:1762166980.655616:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30783 00000100:00100000:0.0:1762166980.655625:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf7838e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+530:61875:x1847765450671872:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166980.655645:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166980.655664:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbac7d3 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea6f3 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.655714:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbac7d3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6f3 expref: 531 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.655728:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbac7d3 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6f3 expref: 531 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.655745:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:0.0:1762166980.655747:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166980.655750:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdfe00, rc 0) 00000100:00100000:0.0:1762166980.655791:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf7838e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+531:61875:x1847765450671872:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 168us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166980.655798:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30783 00000100:00100000:2.0:1762166980.657081:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.657121:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450672128 00000100:00100000:3.0:1762166980.657129:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450672128 00000100:00100000:3.0:1762166980.657179:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11962 00000100:00100000:3.0:1762166980.657188:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf7838700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+531:61875:x1847765450672128:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:3.0:1762166980.657369:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf7838700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+532:61875:x1847765450672128:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 182us (293us total) trans 4294992439 rc 0/0 00000100:00100000:3.0:1762166980.657378:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11962 00000100:00100000:3.0:1762166980.658076:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.658125:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450672384 00000100:00100000:0.0:1762166980.658132:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450672384 00000100:00100000:0.0:1762166980.658184:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11963 00000100:00100000:0.0:1762166980.658193:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5765500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+532:61875:x1847765450672384:12345-192.168.204.38@tcp:35:lfs.0 00000004:00080000:0.0:1762166980.658336:0:19593:0:(mdd_object.c:3965:mdd_close()) Object [0x240000404:0x61b:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:0.0:1762166980.658409:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbac7da lrc: 3/0,1 mode: --/PW res: [0x240000404:0x61b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166980.658426:0:19593:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbac7da lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x61b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166980.658439:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbac7da lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x61b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166980.658449:0:19593:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbac7da lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x61b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166980.658456:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbac7da lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x61b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166980.658463:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbac7da lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x61b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166980.658516:0:19593:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1762166980.658519:0:10257:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1762166980.658528:0:10257:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbac7da lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x61b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166980.658536:0:10257:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bde400 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166980.658541:0:10257:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbac7da lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x61b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166980.658551:0:10257:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbac7da lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x61b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166980.658566:0:10257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x61b:0x0].0x0 (ffff945bc4afe700) 00010000:00010000:3.0:1762166980.658568:0:10257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1762166980.658572:0:10257:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbac7da lrc: 1/0,0 mode: --/PW res: [0x240000404:0x61b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166980.658579:0:10257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbac7da lrc: 0/0,0 mode: --/PW res: [0x240000404:0x61b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 19593 initiator: MDT1 00000100:00100000:0.0:1762166980.658697:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5765500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+533:61875:x1847765450672384:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 504us (621us total) trans 4294992440 rc 0/0 00010000:00010000:2.0:1762166980.658698:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166980.658709:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166980.658709:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11963 00010000:00010000:2.0:1762166980.658718:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1762166980.666976:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.667030:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450672512 00000100:00100000:0.0:1762166980.667038:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450672512 00000100:00100000:0.0:1762166980.667088:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30784 00000100:00100000:0.0:1762166980.667096:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+533:61876:x1847765450672512:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166980.667117:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166980.667135:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbac7e1 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea6fa expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.667188:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbac7e8 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166980.667201:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbac7e8 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.667211:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbac7e8 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.667223:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbac7ef lrc: 3/1,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166980.667230:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbac7ef lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.667236:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbac7ef lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.667299:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbac7f6 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166980.667305:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbac7f6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.667309:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbac7f6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:0.0:1762166980.667340:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 163873 00000004:00200000:0.0:1762166980.667343:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166980.667356:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbac7f6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.667363:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbac7f6 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.667369:0:6494:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbac7e8 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.667373:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbac7e8 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.667377:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbac7e8 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.667381:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbac7e8 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.667384:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdf000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166980.667387:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbac7e8 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.667391:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbac7e8 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.667403:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0x0 (ffff945bc4afe200) 00010000:00010000:0.0:1762166980.667405:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166980.667408:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbac7e8 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.667411:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbac7e8 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.667419:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbac7ef lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.667422:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbac7ef lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.667426:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbac7ef lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.667429:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdec00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166980.667431:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbac7ef lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.667434:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbac7ef lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.667437:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0xdd396665 (ffff945bc4afe000) 00010000:00010000:0.0:1762166980.667439:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166980.667440:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbac7ef lrc: 2/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.667443:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbac7ef lrc: 0/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.667463:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbac7e1 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6fa expref: 535 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.667471:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbac7f6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6fa expref: 534 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.667500:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:0.0:1762166980.667502:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166980.667504:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdee00, rc 0) 00000100:00100000:0.0:1762166980.667558:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+534:61876:x1847765450672512:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 462us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166980.667565:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30784 00000100:00100000:3.0:1762166980.668845:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.668901:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450672768 00000100:00100000:0.0:1762166980.668908:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450672768 00000100:00100000:0.0:1762166980.668944:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30785 00000100:00100000:0.0:1762166980.668953:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5766680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+534:61876:x1847765450672768:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166980.668964:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166980.668973:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbac7fd lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea701 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.669030:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbac804 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166980.669041:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbac804 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.669048:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbac804 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:0.0:1762166980.669056:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 163873 00010000:00010000:0.0:1762166980.669138:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbac7fd lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea701 expref: 537 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.669150:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbac804 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea701 expref: 536 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.669157:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:0.0:1762166980.669160:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1762166980.669162:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bde400, rc 0) 00000100:00100000:0.0:1762166980.669199:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5766680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+536:61876:x1847765450672768:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 247us (362us total) trans 4294992441 rc 0/0 00000100:00100000:0.0:1762166980.669206:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30785 00000100:00100000:3.0:1762166980.670178:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.670230:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450673024 00000100:00100000:0.0:1762166980.670236:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450673024 00000100:00100000:0.0:1762166980.670272:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30786 00000100:00100000:0.0:1762166980.670280:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5765880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+536:61876:x1847765450673024:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166980.670294:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166980.670302:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbac812 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea708 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.670347:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbac819 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166980.670357:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbac819 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.670364:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbac819 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:0.0:1762166980.670372:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 163873 00010000:00010000:0.0:1762166980.670420:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbac812 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea708 expref: 539 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.670432:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbac819 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea708 expref: 538 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.670439:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:0.0:1762166980.670442:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166980.670444:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bde600, rc 0) 00000100:00100000:0.0:1762166980.670523:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5765880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+538:61876:x1847765450673024:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 244us (348us total) trans 4294992442 rc 0/0 00000100:00100000:0.0:1762166980.670530:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30786 00000100:00100000:2.0:1762166980.692641:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.692732:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450673152 00000100:00100000:3.0:1762166980.692750:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450673152 00000100:00100000:3.0:1762166980.692850:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2644 00000100:00100000:3.0:1762166980.692864:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf7839180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+20:2417:x1847765450673152:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:3.0:1762166980.692910:0:23942:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac200/0x2f180c4effbac827 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.692929:0:23942:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166980.692932:0:23942:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166980.692939:0:23942:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac200/0x2f180c4effbac827 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.692959:0:23942:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac200/0x2f180c4effbac827 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.694363:0:23942:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac200/0x2f180c4effbac827 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.694379:0:23942:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac200/0x2f180c4effbac827 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.694387:0:23942:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac200/0x2f180c4effbac827 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.694395:0:23942:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cac200 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166980.694399:0:23942:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac200/0x2f180c4effbac827 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.694407:0:23942:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac200/0x2f180c4effbac827 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.694423:0:23942:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac200/0x2f180c4effbac827 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.694430:0:23942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac200/0x2f180c4effbac827 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166980.694550:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf7839180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+20:2417:x1847765450673152:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 1685us (1916us total) trans 0 rc 163873/163873 00000100:00100000:1.0:1762166980.694561:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2644 00000100:00100000:0.0:1762166980.696690:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.696740:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450673280 00000100:00100000:1.0:1762166980.696748:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450673280 00000100:00100000:1.0:1762166980.696811:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2645 00000100:00100000:1.0:1762166980.696832:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450673280:12345-192.168.204.38@tcp:3:lfs.0 00002000:00010000:1.0:1762166980.696877:0:23942:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa90:0x0] initial LVB size: 163873, mtime: 0x690888c4, atime: 0x690888c4, ctime: 0x690888c4, blocks: 0x58 00010000:00010000:1.0:1762166980.696885:0:23942:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945cc355ba00/0x2f180c4effbac82e lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.696897:0:23942:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166980.696899:0:23942:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166980.696905:0:23942:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355ba00/0x2f180c4effbac82e lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.696917:0:23942:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cc355ba00/0x2f180c4effbac82e lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.698231:0:23942:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945cc355ba00/0x2f180c4effbac82e lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.698240:0:23942:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355ba00/0x2f180c4effbac82e lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.698246:0:23942:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945cc355ba00/0x2f180c4effbac82e lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.698251:0:23942:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355ba00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166980.698253:0:23942:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc355ba00/0x2f180c4effbac82e lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.698258:0:23942:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc355ba00/0x2f180c4effbac82e lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.698268:0:23942:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945cc355ba00/0x2f180c4effbac82e lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.698272:0:23942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cc355ba00/0x2f180c4effbac82e lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->167935] (req 0->167935) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166980.698316:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450673280:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 1497us (1631us total) trans 0 rc 163873/163873 00000100:00100000:1.0:1762166980.698324:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2645 00000100:00100000:3.0:1762166980.704550:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.704593:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450673408 00000100:00100000:1.0:1762166980.704603:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450673408 00000100:00100000:1.0:1762166980.704656:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 896 00000100:00100000:1.0:1762166980.704666:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5764a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+538:61876:x1847765450673408:12345-192.168.204.38@tcp:103:lfs.0 00010000:00010000:1.0:1762166980.704680:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166980.704702:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbac819 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea708 expref: 538 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.704717:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:1.0:1762166980.704722:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166980.704764:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5764a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+537:61876:x1847765450673408:12345-192.168.204.38@tcp:103:lfs.0 Request processed in 100us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166980.704772:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 896 00000100:00100000:0.0:1762166980.705744:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.705793:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450673664 00000100:00100000:3.0:1762166980.705799:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450673664 00000100:00100000:3.0:1762166980.705840:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11964 00000100:00100000:3.0:1762166980.705849:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+537:61876:x1847765450673664:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:3.0:1762166980.706023:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+538:61876:x1847765450673664:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 175us (280us total) trans 4294992443 rc 0/0 00000100:00100000:3.0:1762166980.706030:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11964 00000100:00100000:2.0:1762166980.707881:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.707937:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450673920 00000100:00100000:0.0:1762166980.707943:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450673920 00000100:00100000:0.0:1762166980.707979:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30787 00000100:00100000:0.0:1762166980.707988:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf7839f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+538:61766:x1847765450673920:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:0.0:1762166980.708003:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166980.708019:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbac835 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea70f expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.708113:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbac83c lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166980.708127:0:6494:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbac7f6 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6fa expref: 539 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.708139:0:6494:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbac83c lrc: 4/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.708170:0:6494:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbac7f6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6fa expref: 539 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.708183:0:6494:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbac7f6 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6fa expref: 539 pid: 6494 timeout: 699 lvb_type: 0 00000100:00100000:0.0:1762166980.708195:0:6494:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc47b4700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765449774336:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166980.708281:0:6494:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1fe20c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166980.709224:0:6494:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc47b4700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765449774336:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166980.709258:0:6494:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbac83c lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000100:00100000:2.0:1762166980.709927:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.709971:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450674048 00000100:00100000:1.0:1762166980.709977:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450674048 00010000:00010000:1.0:1762166980.710002:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbac7f6 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6fa expref: 540 pid: 6494 timeout: 699 lvb_type: 0 00000100:00100000:1.0:1762166980.710039:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9771 00000100:00100000:1.0:1762166980.710046:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+540:2418:x1847765450674048:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166980.710055:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166980.710060:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbac7f6 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6fa expref: 540 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:1.0:1762166980.710069:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbac7f6 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6fa expref: 540 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:1.0:1762166980.710083:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbac7f6 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6fa expref: 540 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:1.0:1762166980.710094:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:1.0:1762166980.710097:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbac83c lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.710102:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbac83c lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.710107:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbac83c lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.710126:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166980.710143:0:6494:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbac83c lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.710152:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbac83c lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000100:00100000:1.0:1762166980.710157:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+539:2418:x1847765450674048:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 110us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166980.710166:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9771 00000004:00200000:0.0:1762166980.710180:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 163873 00010000:00010000:0.0:1762166980.710282:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbac835 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea70f expref: 540 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.710296:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbac83c lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea70f expref: 539 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.710304:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:0.0:1762166980.710306:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1762166980.710308:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdf200, rc 0) 00000100:00100000:0.0:1762166980.710351:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf7839f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+539:61766:x1847765450673920:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 2365us (2471us total) trans 4294992444 rc 0/0 00000100:00100000:0.0:1762166980.710359:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30787 00000100:00100000:2.0:1762166980.711474:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.711532:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450674176 00000100:00100000:0.0:1762166980.711537:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450674176 00000100:00100000:0.0:1762166980.711559:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30788 00000100:00100000:0.0:1762166980.711565:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+539:61766:x1847765450674176:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:0.0:1762166980.711583:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166980.711597:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbac84a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea716 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.711660:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac851 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166980.711671:0:6494:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbac83c lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea70f expref: 540 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.711679:0:6494:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac851 lrc: 4/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.711700:0:6494:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbac83c lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea70f expref: 540 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.711708:0:6494:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbac83c lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea70f expref: 540 pid: 6494 timeout: 699 lvb_type: 0 00000100:00100000:0.0:1762166980.711716:0:6494:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc47b4700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765449774464:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166980.711758:0:6494:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1fe2600 going to sleep for 11 seconds 00000100:00100000:0.0:1762166980.712541:0:6494:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc47b4700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765449774464:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166980.712556:0:6494:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac851 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000100:00100000:2.0:1762166980.712807:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.712848:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450674304 00000100:00100000:1.0:1762166980.712854:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450674304 00010000:00010000:1.0:1762166980.712872:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbac83c lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea70f expref: 541 pid: 6494 timeout: 699 lvb_type: 0 00000100:00100000:1.0:1762166980.712903:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9772 00000100:00100000:1.0:1762166980.712912:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+541:2419:x1847765450674304:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166980.712922:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166980.712927:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbac83c lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea70f expref: 541 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:1.0:1762166980.712944:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbac83c lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea70f expref: 541 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:1.0:1762166980.712958:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbac83c lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea70f expref: 541 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:1.0:1762166980.712969:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:1.0:1762166980.712973:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac851 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.712980:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac851 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.712986:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac851 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.713005:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166980.713024:0:6494:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac851 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.713031:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac851 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000100:00100000:1.0:1762166980.713039:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+540:2419:x1847765450674304:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 125us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166980.713047:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9772 00000004:00200000:0.0:1762166980.713072:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 163873 00000004:00200000:0.0:1762166980.713078:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166980.713093:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac851 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.713116:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbac84a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea716 expref: 540 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.713133:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac851 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea716 expref: 539 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.713140:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:0.0:1762166980.713142:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166980.713144:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdf600, rc 0) 00000100:00100000:0.0:1762166980.713177:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+539:61766:x1847765450674176:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 1611us (1702us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166980.713184:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30788 00000100:00100000:2.0:1762166980.714271:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.714302:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.714333:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450674432 00000100:00100000:1.0:1762166980.714339:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450674432 00000100:00100000:0.0:1762166980.714360:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450674560 00000100:00100000:0.0:1762166980.714366:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450674560 00000100:00100000:1.0:1762166980.714383:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19323 00000100:00100000:1.0:1762166980.714394:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3d59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+20:2416:x1847765450674432:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:1.0:1762166980.714406:0:9168:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1762166980.714414:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19324 00010000:00010000:1.0:1762166980.714423:0:9168:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cc355ba00/0x2f180c4effbac858 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea71d expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166980.714424:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+18:2417:x1847765450674560:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:0.0:1762166980.714439:0:9165:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:1.0:1762166980.714451:0:9168:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa90:0x0] initial LVB size: 163873, mtime: 0x690888c4, atime: 0x690888c4, ctime: 0x690888c4, blocks: 0x58 00010000:00010000:0.0:1762166980.714465:0:9165:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde600/0x2f180c4effbac85f lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa91:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea724 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.714467:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166980.714471:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166980.714519:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355ba00/0x2f180c4effbac858 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea71d expref: 21 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166980.714536:0:9168:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945cc355ba00/0x2f180c4effbac858 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea71d expref: 21 pid: 9168 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1762166980.714539:0:9165:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc47b4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9165:1847765449774592:192.168.204.38@tcp:106: 00010000:00010000:1.0:1762166980.714555:0:9168:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355ba00, rc 0) 00000100:00100000:1.0:1762166980.714600:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3d59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+21:2416:x1847765450674432:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 208us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166980.714600:0:9165:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1fe2600 going to sleep for 11 seconds 00000100:00100000:1.0:1762166980.714610:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19323 00000100:00100000:0.0:1762166980.715804:0:9165:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc47b4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9165:1847765449774592:192.168.204.38@tcp:106: 00010000:00010000:0.0:1762166980.715831:0:9165:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde600/0x2f180c4effbac85f lrc: 1/0,0 mode: --/PR res: [0x280000400:0xa91:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea724 expref: 19 pid: 9165 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166980.715842:0:9165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde600/0x2f180c4effbac85f lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa91:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea724 expref: 19 pid: 9165 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166980.715852:0:9165:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bde600, rc 0) 00000100:00100000:0.0:1762166980.715881:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+18:2417:x1847765450674560:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 1461us (1580us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166980.715886:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19324 00000100:00100000:3.0:1762166980.717572:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.717617:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450674688 00000100:00100000:1.0:1762166980.717626:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450674688 00002000:00100000:1.0:1762166980.717660:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa90:0x0] (114688->126975) req@ffff945bc5765180 x1847765450674688/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 488/0 e 0 to 0 dl 1762166991 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166980.717670:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5765180 with x1847765450674688 ext(114688->126975) 00002000:00010000:1.0:1762166980.717675:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5765180 00000100:00100000:1.0:1762166980.717697:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2646 00000100:00100000:1.0:1762166980.717705:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5765180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+21:2417:x1847765450674688:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:1.0:1762166980.717870:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5765180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+21:2417:x1847765450674688:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 165us (306us total) trans 0 rc 12288/12288 00000100:00100000:1.0:1762166980.717877:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2646 00002000:00100000:1.0:1762166980.717884:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa90:0x0] (114688->126975) req@ffff945bc5765180 x1847765450674688/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 488/12728 e 0 to 0 dl 1762166991 ref 1 fl Complete:/600/0 rc 12288/12288 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166980.717898:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5765180 with x1847765450674688 ext(114688->126975) 00002000:00010000:1.0:1762166980.717902:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5765180 00000100:00100000:2.0:1762166980.719523:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.719573:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450674816 00000100:00100000:0.0:1762166980.719579:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450674816 00000100:00100000:0.0:1762166980.719612:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19325 00000100:00100000:0.0:1762166980.719623:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+18:2416:x1847765450674816:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:0.0:1762166980.719635:0:9165:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166980.719649:0:9165:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf000/0x2f180c4effbac866 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa91:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea72b expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166980.719693:0:9165:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc47b4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9165:1847765449774720:192.168.204.38@tcp:106: 00000100:00100000:0.0:1762166980.719749:0:9165:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1fe2600 going to sleep for 11 seconds 00000100:00100000:0.0:1762166980.720696:0:9165:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc47b4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9165:1847765449774720:192.168.204.38@tcp:106: 00010000:00010000:0.0:1762166980.720719:0:9165:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf000/0x2f180c4effbac866 lrc: 1/0,0 mode: --/PR res: [0x280000400:0xa91:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea72b expref: 19 pid: 9165 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166980.720735:0:9165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf000/0x2f180c4effbac866 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa91:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea72b expref: 19 pid: 9165 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166980.720745:0:9165:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdf000, rc 0) 00000100:00100000:0.0:1762166980.720779:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+18:2416:x1847765450674816:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 1158us (1259us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166980.720790:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19325 00000100:00100000:3.0:1762166980.722637:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.722675:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450674944 00000100:00100000:1.0:1762166980.722681:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450674944 00002000:00100000:1.0:1762166980.722711:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa90:0x0] (0->167935) req@ffff945bc5bc3b80 x1847765450674944/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 504/0 e 0 to 0 dl 1762166991 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166980.722721:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5bc3b80 with x1847765450674944 ext(0->167935) 00002000:00010000:1.0:1762166980.722725:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5bc3b80 00000100:00100000:1.0:1762166980.722748:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2647 00000100:00100000:1.0:1762166980.722756:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+21:2416:x1847765450674944:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:1.0:1762166980.724033:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+21:2416:x1847765450674944:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 1275us (1396us total) trans 0 rc 155648/155648 00000100:00100000:1.0:1762166980.724042:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2647 00002000:00100000:1.0:1762166980.724051:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa90:0x0] (0->167935) req@ffff945bc5bc3b80 x1847765450674944/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 504/440 e 0 to 0 dl 1762166991 ref 1 fl Complete:/600/0 rc 155648/155648 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166980.724071:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5bc3b80 with x1847765450674944 ext(0->167935) 00002000:00010000:1.0:1762166980.724075:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5bc3b80 00000100:00100000:2.0:1762166980.725720:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.725833:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450675072 00000100:00100000:0.0:1762166980.725847:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450675072 00000100:00100000:0.0:1762166980.725911:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19326 00000100:00100000:0.0:1762166980.725924:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450675072:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:0.0:1762166980.725943:0:9165:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166980.725965:0:9165:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde800/0x2f180c4effbac86d lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa91:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea732 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166980.726032:0:9165:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc47b4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9165:1847765449774848:192.168.204.38@tcp:106: 00000100:00100000:0.0:1762166980.726135:0:9165:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1fe2600 going to sleep for 11 seconds 00000100:00100000:0.0:1762166980.727033:0:9165:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc47b4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9165:1847765449774848:192.168.204.38@tcp:106: 00010000:00010000:0.0:1762166980.727059:0:9165:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde800/0x2f180c4effbac86d lrc: 1/0,0 mode: --/PR res: [0x280000400:0xa91:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea732 expref: 19 pid: 9165 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166980.727079:0:9165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde800/0x2f180c4effbac86d lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa91:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea732 expref: 19 pid: 9165 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166980.727088:0:9165:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bde800, rc 0) 00000100:00100000:0.0:1762166980.727138:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450675072:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 1217us (1429us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166980.727146:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19326 00000100:00100000:2.0:1762166980.728954:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.729013:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450675200 00000100:00100000:0.0:1762166980.729025:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450675200 00000100:00100000:0.0:1762166980.729075:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19327 00000100:00100000:0.0:1762166980.729088:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450675200:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:0.0:1762166980.729107:0:9165:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166980.729134:0:9165:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf000/0x2f180c4effbac874 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa91:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea739 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166980.729188:0:9165:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc47b4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9165:1847765449774976:192.168.204.38@tcp:106: 00000100:00100000:0.0:1762166980.729259:0:9165:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1fe2600 going to sleep for 11 seconds 00000100:00100000:0.0:1762166980.730127:0:9165:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc47b4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9165:1847765449774976:192.168.204.38@tcp:106: 00010000:00010000:0.0:1762166980.730154:0:9165:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf000/0x2f180c4effbac874 lrc: 1/0,0 mode: --/PR res: [0x280000400:0xa91:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea739 expref: 19 pid: 9165 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166980.730172:0:9165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf000/0x2f180c4effbac874 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa91:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea739 expref: 19 pid: 9165 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166980.730184:0:9165:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdf000, rc 0) 00000100:00100000:0.0:1762166980.730225:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450675200:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 1140us (1276us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166980.730234:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19327 00000100:00100000:3.0:1762166980.731598:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.731642:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450675456 00000100:00100000:0.0:1762166980.731651:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450675456 00000100:00100000:0.0:1762166980.731693:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11965 00000100:00100000:0.0:1762166980.731702:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7be0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+539:61766:x1847765450675456:12345-192.168.204.38@tcp:35:fsx.0 00000100:00100000:0.0:1762166980.731949:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7be0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+540:61766:x1847765450675456:12345-192.168.204.38@tcp:35:fsx.0 Request processed in 249us (355us total) trans 4294992445 rc 0/0 00000100:00100000:0.0:1762166980.731954:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11965 00000100:00100000:2.0:1762166980.733000:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.733036:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450675712 00000100:00100000:0.0:1762166980.733040:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450675712 00000100:00100000:0.0:1762166980.733080:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30789 00000100:00100000:0.0:1762166980.733093:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+540:61766:x1847765450675712:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:0.0:1762166980.733111:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166980.733115:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 1 00010000:00010000:0.0:1762166980.733140:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac851 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea716 expref: 540 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.733159:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbac804 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea701 expref: 539 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.733171:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbac7d3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6f3 expref: 538 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.733181:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:0.0:1762166980.733185:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166980.733197:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbac87b lrc: 2/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea740 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.733239:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbac882 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166980.733253:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbac882 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.733264:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbac882 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000040:00080000:0.0:1762166980.733519:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5931, 88 off464584 00000004:00080000:0.0:1762166980.733536:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 599882057716ns, next at 600144491692ns, rc = 0 00000040:00080000:0.0:1762166980.733582:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5930, 88 off464584 00000004:00080000:0.0:1762166980.733588:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 599882109819ns, next at 600144525370ns, rc = 0 00000040:00080000:0.0:1762166980.733610:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5931, 88 off464672 00000004:00080000:0.0:1762166980.733614:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 599882136027ns, next at 600144525370ns, rc = 0 00000040:00080000:0.0:1762166980.733624:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5932, 88 off464672 00000004:00080000:0.0:1762166980.733628:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 599882150706ns, next at 600144491692ns, rc = 0 00000040:00080000:0.0:1762166980.733648:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5933, 88 off464760 00000004:00080000:0.0:1762166980.733654:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 599882175629ns, next at 600144491692ns, rc = 0 00000040:00080000:0.0:1762166980.733665:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5932, 88 off464760 00000004:00080000:0.0:1762166980.733670:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 599882191866ns, next at 600144525370ns, rc = 0 00000001:00080000:1.0:1762166980.734786:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294992446 is committed 00000004:00080000:1.0:1762166980.734797:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3293 committed 00000004:00080000:1.0:1762166980.734811:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3290 committed 00000004:00080000:1.0:1762166980.734830:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3289 committed 00010000:00010000:3.0:1762166980.734832:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbac7b0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x61b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00000004:00080000:1.0:1762166980.734833:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3292 committed 00000004:00080000:1.0:1762166980.734836:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3291 committed 00000004:00080000:1.0:1762166980.734838:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3288 committed 00010000:00010000:3.0:1762166980.734843:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbac7b0 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x61b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.734851:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbac7b0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x61b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.734857:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdfa00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166980.734863:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbac7b0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x61b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00000020:00080000:1.0:1762166980.734867:0:7412:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff945cc9a5e9c0 refcount 2 committed 0 result 0 batchid 63 00010000:00010000:3.0:1762166980.734870:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbac7b0 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x61b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00000020:00080000:1.0:1762166980.734870:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cf399c000 obd lustre-OST0001-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff945cc4eeae40 00000020:00080000:1.0:1762166980.734873:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cf39b2600 obd lustre-OST0000-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff945cc9a5e0c0 00000020:00080000:1.0:1762166980.734878:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cc9df1700 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff945bc49f3000 00000020:00080000:1.0:1762166980.734885:0:7412:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000400:0x2:0x0].62 00010000:00010000:3.0:1762166980.734890:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x61b:0x0].0x0 (ffff945bc4afe700) 00010000:00010000:3.0:1762166980.734893:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166980.734897:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbac7b0 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x61b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.734903:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbac7b0 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x61b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00000020:00080000:1.0:1762166980.734908:0:7412:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0001: 62 batchid updated 00000020:00080000:1.0:1762166980.734928:0:7435:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 63 committed batchid 62 00010000:00010000:3.0:1762166980.734936:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbac7be lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.734947:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbac7be lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.734953:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbac7be lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.734960:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bde200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166980.734964:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbac7be lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.734973:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbac7be lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00000100:00100000:2.0:1762166980.734975:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449775104:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1762166980.734993:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:3.0:1762166980.734997:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166980.735000:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbac7be lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.735005:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbac7be lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00000100:00100000:0.0:1762166980.735008:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc47b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449775232:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1762166980.735030:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1762166980.735039:0:7435:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 62 cancel update log [0x240000400:0x2:0x0].61: rc = 0 00000100:00100000:3.0:1762166980.735047:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449775360:0@lo:2:osp-syn-0-1.0 00000020:00080000:1.0:1762166980.735052:0:7435:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 62 00000100:00100000:2.0:1762166980.735066:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449775616:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1762166980.735078:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166980.735109:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc47b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449775488:0@lo:2:osp-syn-1-1.0 00010000:00010000:1.0:1762166980.735115:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbac882 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea740 expref: 525 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.735124:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00000100:00100000:2.0:1762166980.735125:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449775104 00000100:00100000:2.0:1762166980.735131:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449775104 00010000:00010000:1.0:1762166980.735132:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1762166980.735151:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbac87b lrc: 0/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea740 expref: 525 pid: 6494 timeout: 0 lvb_type: 3 00000100:00100000:0.0:1762166980.735154:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449775744:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166980.735164:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166980.735166:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449775232 00000100:00100000:2.0:1762166980.735175:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449775232 00000100:00100000:2.0:1762166980.735200:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449775488 00000100:00100000:2.0:1762166980.735202:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449775488 00010000:00010000:1.0:1762166980.735204:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbac882 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea740 expref: 524 pid: 6494 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166980.735208:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc47b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449776000:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1762166980.735218:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166980.735226:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19328 00010000:00010000:1.0:1762166980.735234:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00000100:00100000:2.0:1762166980.735236:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3635:x1847765449775104:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1762166980.735239:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1762166980.735244:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bde600, rc 0) 00000100:00100000:3.0:1762166980.735248:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:2.0:1762166980.735261:0:9165:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:2704 count 1 00010000:00010000:2.0:1762166980.735283:0:9165:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945cc7d16400/0x2f180c4effbac889 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166980.735293:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449775744 00000100:00100000:1.0:1762166980.735298:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+524:61766:x1847765450675712:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 2208us (2295us total) trans 4294992446 rc 0/0 00010000:00010000:2.0:1762166980.735299:0:9165:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdea00/0x2f180c4effbac53a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea605 expref: 17 pid: 35248 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1762166980.735303:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449775744 00000100:00100000:3.0:1762166980.735306:0:35248:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449776000 00000100:00100000:3.0:1762166980.735314:0:35248:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449776000 00010000:00010000:2.0:1762166980.735321:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1762166980.735321:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30789 00010000:00010000:2.0:1762166980.735326:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166980.735330:0:9165:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cc7d16400/0x2f180c4effbac889 lrc: 4/0,1 mode: --/PW res: [0x280000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166980.735358:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19329 00010000:00010000:2.0:1762166980.735364:0:9165:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdea00/0x2f180c4effbac53a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea605 expref: 17 pid: 35248 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1762166980.735370:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166980.735372:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19330 00000100:00100000:0.0:1762166980.735381:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+8:3636:x1847765449775232:12345-0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1762166980.735391:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+8:3634:x1847765449775488:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1762166980.735394:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc47b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449775872:0@lo:2:osp-syn-1-1.0 00010000:00010000:2.0:1762166980.735395:0:9165:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdea00/0x2f180c4effbac53a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea605 expref: 17 pid: 35248 timeout: 699 lvb_type: 1 00000100:00100000:2.0:1762166980.735413:0:9165:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9165:1847765449776128:192.168.204.38@tcp:104: 00002000:00080000:0.0:1762166980.735415:0:8382:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:2703 count 1 00000100:00100000:1.0:1762166980.735424:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1762166980.735440:0:8382:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbac890 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa8f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166980.735454:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449775360 00010000:00010000:0.0:1762166980.735456:0:8382:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc847e000/0x2f180c4effbac43e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5cd expref: 20 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166980.735461:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449775360 00010000:00010000:0.0:1762166980.735465:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00000100:00100000:2.0:1762166980.735466:0:9165:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a1540 going to sleep for 11 seconds 00010000:00010000:0.0:1762166980.735468:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1762166980.735525:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449775872 00010000:00010000:0.0:1762166980.735528:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbac890 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0xa8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166980.735530:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19331 00000100:00100000:1.0:1762166980.735531:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449775872 00002000:00010000:3.0:1762166980.735537:0:35248:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 163873 -> 163873 00002000:00010000:3.0:1762166980.735550:0:35248:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00000100:00100000:2.0:1762166980.735551:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+8:3636:x1847765449775744:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:3.0:1762166980.735559:0:35248:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00000100:00100000:1.0:1762166980.735559:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19332 00002000:00010000:3.0:1762166980.735572:0:35248:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:3.0:1762166980.735576:0:35248:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 256 -> 256 00000100:00100000:1.0:1762166980.735579:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+10:3634:x1847765449776000:12345-0@lo:2:osp-syn-1-1.0 00010000:00010000:0.0:1762166980.735617:0:8382:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc847e000/0x2f180c4effbac43e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5cd expref: 20 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166980.735618:0:35248:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+10:3634:x1847765449775488:12345-0@lo:2:osp-syn-1-1.0 Request processed in 228us (457us total) trans 17179876648 rc 0/0 00000100:00100000:3.0:1762166980.735644:0:35248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19330 00010000:00010000:0.0:1762166980.735655:0:8382:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc847e000/0x2f180c4effbac43e lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5cd expref: 20 pid: 8382 timeout: 699 lvb_type: 0 00002000:00010000:2.0:1762166980.735656:0:35247:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166980.735656:0:9168:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb size from disk: 163873 -> 163873 00000100:00100000:3.0:1762166980.735666:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19333 00002000:00010000:1.0:1762166980.735669:0:9168:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00002000:00010000:2.0:1762166980.735671:0:35247:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00000100:00100000:3.0:1762166980.735690:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+9:3633:x1847765449775360:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:2.0:1762166980.735690:0:35247:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00002000:00010000:1.0:1762166980.735690:0:9168:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00002000:00010000:2.0:1762166980.735699:0:35247:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:1.0:1762166980.735699:0:9168:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00000100:00100000:0.0:1762166980.735703:0:8382:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc47b4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8382:1847765449776256:192.168.204.38@tcp:104: 00002000:00010000:1.0:1762166980.735713:0:9168:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb blocks from disk: 88 -> 88 00002000:00010000:2.0:1762166980.735714:0:35247:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:3.0:1762166980.735754:0:35248:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166980.735759:0:35248:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb mtime from disk: 1762166966 -> 1762166966 00002000:00010000:3.0:1762166980.735762:0:35248:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1762166980.735764:0:35248:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb ctime from disk: 1762166966 -> 1762166966 00002000:00010000:3.0:1762166980.735768:0:35248:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1762166980.735782:0:8382:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cff1fa840 going to sleep for 11 seconds 00000100:00100000:1.0:1762166980.735783:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+10:3634:x1847765449776000:12345-0@lo:2:osp-syn-1-1.0 Request processed in 202us (530us total) trans 17179876649 rc 0/0 00000100:00100000:2.0:1762166980.735793:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+10:3636:x1847765449775744:12345-0@lo:2:osp-syn-0-1.0 Request processed in 248us (575us total) trans 21474843425 rc 0/0 00000100:00100000:1.0:1762166980.735801:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19332 00000100:00100000:2.0:1762166980.735826:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19331 00000100:00100000:3.0:1762166980.735831:0:35248:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+10:3633:x1847765449775360:12345-0@lo:2:osp-syn-0-1.0 Request processed in 131us (448us total) trans 21474843426 rc 0/0 00000100:00100000:0.0:1762166980.735839:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19334 00000100:00100000:3.0:1762166980.735855:0:35248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19333 00000100:00100000:0.0:1762166980.735859:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+9:3633:x1847765449775872:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1762166980.735880:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1762166980.735911:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf1cd0380/2, rc 0, transno 21474843426 00000004:00080000:1.0:1762166980.735911:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf1cd3480/2, rc 0, transno 21474843425 00000100:00100000:3.0:1762166980.735918:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449775360:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1762166980.735918:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449775744:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1762166980.735924:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449775616 00000100:00100000:2.0:1762166980.735930:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449775616 00000004:00080000:3.0:1762166980.735953:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc47b4700/2, rc 0, transno 17179876648 00000100:00100000:3.0:1762166980.735959:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc47b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449775488:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1762166980.735969:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19335 00002000:00010000:0.0:1762166980.735973:0:28434:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00000004:00080000:3.0:1762166980.735975:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc47b7b80/2, rc 0, transno 17179876649 00000100:00100000:2.0:1762166980.735986:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+9:3635:x1847765449775616:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:0.0:1762166980.735986:0:28434:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00000100:00100000:3.0:1762166980.735988:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc47b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449776000:0@lo:2:osp-syn-1-1.0 00002000:00010000:0.0:1762166980.736000:0:28434:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00002000:00010000:0.0:1762166980.736007:0:28434:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:0.0:1762166980.736011:0:28434:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1762166980.736077:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+10:3633:x1847765449775872:12345-0@lo:2:osp-syn-1-1.0 Request processed in 224us (651us total) trans 17179876650 rc 0/0 00002000:00010000:2.0:1762166980.736079:0:35472:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166980.736093:0:35472:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00000004:00080000:3.0:1762166980.736094:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc47b4a80/2, rc 0, transno 17179876650 00000100:00100000:0.0:1762166980.736101:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19334 00002000:00010000:2.0:1762166980.736105:0:35472:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00000100:00100000:3.0:1762166980.736108:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc47b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449775872:0@lo:2:osp-syn-1-1.0 00002000:00010000:2.0:1762166980.736110:0:35472:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:2.0:1762166980.736117:0:35472:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00000100:00100000:2.0:1762166980.736166:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+10:3635:x1847765449775616:12345-0@lo:2:osp-syn-0-1.0 Request processed in 188us (288us total) trans 21474843427 rc 0/0 00000100:00100000:2.0:1762166980.736173:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19335 00000004:00080000:0.0:1762166980.736220:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf1cd3800/2, rc 0, transno 21474843427 00000100:00100000:0.0:1762166980.736228:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449775616:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1762166980.737377:0:9165:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9165:1847765449776128:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166980.737402:0:8382:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc47b4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8382:1847765449776256:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166980.737411:0:9165:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945cc7d16400/0x2f180c4effbac889 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.737424:0:8382:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbac890 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166980.737532:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.737644:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450675968 00000100:00100000:3.0:1762166980.737650:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450675968 00010000:00010000:3.0:1762166980.737677:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc847e000/0x2f180c4effbac43e lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5cd expref: 21 pid: 8382 timeout: 699 lvb_type: 0 00000100:00100000:0.0:1762166980.737707:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.737735:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450675840 00000100:00100000:3.0:1762166980.737742:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450675840 00010000:00010000:3.0:1762166980.737759:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdea00/0x2f180c4effbac53a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea605 expref: 18 pid: 35248 timeout: 699 lvb_type: 1 00000100:00100000:1.0:1762166980.737764:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9773 00000100:00100000:1.0:1762166980.737781:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce77b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450675968:12345-192.168.204.38@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1762166980.737786:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9774 00010000:00010000:1.0:1762166980.737799:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1762166980.737800:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945d0207f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450675840:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166980.737810:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc847e000/0x2f180c4effbac43e lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5cd expref: 21 pid: 8382 timeout: 699 lvb_type: 0 00010000:00010000:2.0:1762166980.737827:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166980.737834:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc847e000/0x2f180c4effbac43e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5cd expref: 21 pid: 8382 timeout: 699 lvb_type: 0 00010000:00010000:2.0:1762166980.737836:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdea00/0x2f180c4effbac53a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa90:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea605 expref: 18 pid: 35248 timeout: 699 lvb_type: 1 00010000:00010000:2.0:1762166980.737862:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdea00/0x2f180c4effbac53a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa90:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea605 expref: 18 pid: 35248 timeout: 699 lvb_type: 1 00010000:00010000:1.0:1762166980.737864:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc847e000/0x2f180c4effbac43e lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa8f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea5cd expref: 21 pid: 8382 timeout: 699 lvb_type: 0 00010000:00010000:1.0:1762166980.737887:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166980.737890:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdea00/0x2f180c4effbac53a lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa90:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea605 expref: 18 pid: 35248 timeout: 699 lvb_type: 1 00010000:00010000:1.0:1762166980.737890:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166980.737896:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbac890 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.737904:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166980.737908:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166980.737908:0:6479:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbac890 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xa8f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.737914:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945cc7d16400/0x2f180c4effbac889 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.737925:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cc7d16400/0x2f180c4effbac889 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.737942:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166980.737959:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166980.737975:0:8382:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbac890 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166980.737985:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce77b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450675968:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 206us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166980.737994:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945d0207f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450675840:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 191us (281us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166980.738010:0:8382:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbac890 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166980.738020:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9773 00010000:00010000:0.0:1762166980.738027:0:8382:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbac890 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.738035:0:8382:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbac890 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.738056:0:9165:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945cc7d16400/0x2f180c4effbac889 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.738059:0:8382:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1762166980.738073:0:9165:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cc7d16400/0x2f180c4effbac889 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.738083:0:9165:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945cc7d16400/0x2f180c4effbac889 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.738091:0:9165:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945cc7d16400/0x2f180c4effbac889 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.738109:0:9165:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1762166980.738150:0:6482:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1762166980.738157:0:6482:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbac890 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.738166:0:6482:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdec00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166980.738172:0:6482:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbac890 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.738186:0:6482:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbac890 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.738199:0:6482:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbac890 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xa8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.738206:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbac890 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.738240:0:6482:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166980.738243:0:6482:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945cc7d16400/0x2f180c4effbac889 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.738250:0:6482:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc7d16400 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166980.738253:0:6482:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945cc7d16400/0x2f180c4effbac889 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.738261:0:6482:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945cc7d16400/0x2f180c4effbac889 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.738273:0:6482:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945cc7d16400/0x2f180c4effbac889 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.738281:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cc7d16400/0x2f180c4effbac889 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.738310:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166980.738313:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166980.738316:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166980.738334:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+10:3636:x1847765449775232:12345-0@lo:6:osp-syn-1-1.0 Request processed in 2960us (3260us total) trans 17179876651 rc 0/0 00010000:00010000:1.0:1762166980.738337:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166980.738348:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19329 00000004:00080000:1.0:1762166980.738374:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc47b4380/2, rc 0, transno 17179876651 00000100:00100000:1.0:1762166980.738382:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc47b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449775232:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1762166980.738445:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.738530:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450676096 00000100:00100000:0.0:1762166980.738537:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450676096 00000100:00100000:0.0:1762166980.738582:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19336 00000100:00100000:0.0:1762166980.738594:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+20:61766:x1847765450676096:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:0.0:1762166980.738609:0:8382:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166980.738625:0:8382:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbac897 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea747 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.738650:0:8382:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbac740 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6c2 expref: 21 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166980.738658:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166980.738661:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166980.738665:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbac897 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [8192->16383] (req 8192->16383) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea747 expref: 21 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.738696:0:8382:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbac740 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6c2 expref: 21 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166980.738710:0:8382:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbac740 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6c2 expref: 21 pid: 9168 timeout: 699 lvb_type: 1 00000100:00100000:0.0:1762166980.738726:0:8382:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc47b6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8382:1847765449776384:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166980.738739:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+10:3635:x1847765449775104:12345-0@lo:6:osp-syn-0-1.0 Request processed in 3503us (3707us total) trans 21474843428 rc 0/0 00000100:00100000:3.0:1762166980.738748:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19328 00000004:00080000:1.0:1762166980.738765:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc2d5ea00/2, rc 0, transno 21474843428 00000100:00100000:1.0:1762166980.738773:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449775104:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1762166980.738807:0:8382:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cff1fa300 going to sleep for 11 seconds 00000100:00100000:2.0:1762166980.738835:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9774 00000100:00100000:0.0:1762166980.739796:0:8382:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc47b6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8382:1847765449776384:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166980.739812:0:8382:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbac897 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [8192->16383] (req 8192->16383) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea747 expref: 21 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.739835:0:8382:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdf000, rc 0) 00000100:00100000:0.0:1762166980.739865:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+21:61766:x1847765450676096:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 1276us (1422us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166980.739870:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19336 00000100:00100000:1.0:1762166980.739995:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.740026:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450676224 00000100:00100000:2.0:1762166980.740031:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450676224 00010000:00010000:2.0:1762166980.740047:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbac740 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6c2 expref: 21 pid: 9168 timeout: 699 lvb_type: 1 00000100:00100000:2.0:1762166980.740067:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9775 00000100:00100000:2.0:1762166980.740074:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450676224:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166980.740080:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166980.740090:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbac740 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6c2 expref: 21 pid: 9168 timeout: 699 lvb_type: 1 00010000:00010000:2.0:1762166980.740098:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbac740 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6c2 expref: 21 pid: 9168 timeout: 699 lvb_type: 1 00010000:00010000:2.0:1762166980.740112:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbac740 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6c2 expref: 21 pid: 9168 timeout: 699 lvb_type: 1 00010000:00010000:2.0:1762166980.740122:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166980.740124:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166980.740129:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbac897 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->16383) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea747 expref: 20 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.740137:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbac897 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->16383) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea747 expref: 20 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.740163:0:6481:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbac897 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->16383) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea747 expref: 20 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166980.740176:0:6481:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcce77b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6481:1847765449776512:192.168.204.38@tcp:105: 00000100:00100000:2.0:1762166980.740226:0:6481:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a1c00 going to sleep for 11 seconds 00000100:00100000:2.0:1762166980.741068:0:6481:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcce77b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6481:1847765449776512:192.168.204.38@tcp:105: 00010000:00010000:2.0:1762166980.741077:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166980.741104:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450676224:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1031us (1111us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166980.741115:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9775 00000100:00100000:1.0:1762166980.741252:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.741300:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450676352 00000100:00100000:3.0:1762166980.741311:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450676352 00000100:00100000:3.0:1762166980.741367:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2648 00000100:00100000:3.0:1762166980.741378:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450676352:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:3.0:1762166980.741584:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 163873 -> 163873 00002000:00010000:3.0:1762166980.741589:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00002000:00010000:3.0:1762166980.741591:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00002000:00010000:3.0:1762166980.741594:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:3.0:1762166980.741596:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 256 -> 256 00000100:00100000:3.0:1762166980.741641:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450676352:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 266us (388us total) trans 17179876652 rc 0/0 00000100:00100000:3.0:1762166980.741649:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2648 00000100:00100000:1.0:1762166980.742543:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.742588:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450676480 00000100:00100000:0.0:1762166980.742595:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450676480 00000100:00100000:0.0:1762166980.742637:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30790 00000100:00100000:0.0:1762166980.742644:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+524:61766:x1847765450676480:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:0.0:1762166980.742665:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166980.742684:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbac89e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea74e expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.742776:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbac8a5 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166980.742791:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbac8a5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.742801:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbac8a5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:0.0:1762166980.742841:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 163873 00000004:00200000:0.0:1762166980.742847:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166980.742865:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbac8a5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.742891:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbac89e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea74e expref: 526 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.742908:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbac8a5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea74e expref: 525 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.742916:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:0.0:1762166980.742919:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166980.742922:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bde000, rc 0) 00000100:00100000:0.0:1762166980.742963:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+525:61766:x1847765450676480:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 319us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166980.742970:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30790 00000100:00100000:0.0:1762166980.744377:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.744434:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450676608 00000100:00100000:3.0:1762166980.744440:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450676608 00000100:00100000:3.0:1762166980.744518:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2649 00000100:00100000:3.0:1762166980.744531:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450676608:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:3.0:1762166980.744907:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 163873 -> 163873 00002000:00010000:3.0:1762166980.744912:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00002000:00010000:3.0:1762166980.744915:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00002000:00010000:3.0:1762166980.744917:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:3.0:1762166980.744920:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 256 -> 224 00000100:00100000:3.0:1762166980.744968:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765450676608:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 440us (593us total) trans 17179876653 rc 0/0 00000100:00100000:3.0:1762166980.744977:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2649 00000100:00100000:1.0:1762166980.746646:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.746692:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450676736 00000100:00100000:0.0:1762166980.746699:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450676736 00000100:00100000:0.0:1762166980.746748:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30791 00000100:00100000:0.0:1762166980.746756:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+525:61766:x1847765450676736:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:0.0:1762166980.746773:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166980.746792:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbac8ac lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea755 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.746837:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbac8b3 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166980.746851:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbac8b3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.746862:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbac8b3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.746976:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbac8ac lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea755 expref: 527 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.746991:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbac8b3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea755 expref: 526 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.747000:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:0.0:1762166980.747003:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1762166980.747006:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bde400, rc 0) 00000100:00100000:0.0:1762166980.747049:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+526:61766:x1847765450676736:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 295us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166980.747056:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30791 00000100:00100000:1.0:1762166980.749578:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.749619:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450676864 00000100:00100000:3.0:1762166980.749627:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450676864 00002000:00100000:3.0:1762166980.749667:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (184320->245698) req@ffff945cf79ebb80 x1847765450676864/t0(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 488/0 e 0 to 0 dl 1762166991 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166980.749677:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf79ebb80 with x1847765450676864 ext(184320->245698) 00002000:00010000:3.0:1762166980.749682:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf79ebb80 00000100:00100000:3.0:1762166980.749711:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2650 00000100:00100000:3.0:1762166980.749719:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765450676864:12345-192.168.204.38@tcp:4:fsx.0 00000100:00100000:0.0:1762166980.751464:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+24:2418:x1847765450676864:12345-192.168.204.38@tcp:4:fsx.0 Request processed in 1740us (1890us total) trans 17179876654 rc 0/0 00000100:00100000:0.0:1762166980.751473:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2650 00002000:00100000:0.0:1762166980.751508:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (184320->245698) req@ffff945cf79ebb80 x1847765450676864/t17179876654(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 488/448 e 0 to 0 dl 1762166991 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166980.751515:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf79ebb80 with x1847765450676864 ext(184320->245698) 00002000:00010000:0.0:1762166980.751519:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf79ebb80 00000100:00100000:0.0:1762166980.752637:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.752678:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450676992 00000100:00100000:3.0:1762166980.752685:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450676992 00000100:00100000:3.0:1762166980.752725:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2651 00000100:00100000:3.0:1762166980.752732:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765450676992:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:3.0:1762166980.753000:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 163873 -> 245699 00002000:00010000:3.0:1762166980.753003:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00002000:00010000:3.0:1762166980.753005:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00002000:00010000:3.0:1762166980.753007:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:3.0:1762166980.753009:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 224 -> 344 00000100:00100000:3.0:1762166980.753040:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+25:2419:x1847765450676992:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 309us (407us total) trans 17179876655 rc 0/0 00000100:00100000:3.0:1762166980.753046:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2651 00000100:00100000:1.0:1762166980.755128:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.755170:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450677120 00000100:00100000:3.0:1762166980.755179:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450677120 00002000:00100000:3.0:1762166980.755219:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (0->225279) req@ffff945cf79e9f80 x1847765450677120/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 504/0 e 0 to 0 dl 1762166991 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166980.755230:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf79e9f80 with x1847765450677120 ext(0->225279) 00002000:00010000:3.0:1762166980.755236:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf79e9f80 00000100:00100000:3.0:1762166980.755264:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2652 00000100:00100000:3.0:1762166980.755273:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+25:2419:x1847765450677120:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:3.0:1762166980.756691:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+25:2419:x1847765450677120:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 1416us (1565us total) trans 0 rc 221184/221184 00000100:00100000:3.0:1762166980.756703:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2652 00002000:00100000:3.0:1762166980.756711:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (0->225279) req@ffff945cf79e9f80 x1847765450677120/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 504/440 e 0 to 0 dl 1762166991 ref 1 fl Complete:/600/0 rc 221184/221184 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166980.756720:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf79e9f80 with x1847765450677120 ext(0->225279) 00002000:00010000:3.0:1762166980.756724:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf79e9f80 00000100:00100000:0.0:1762166980.758836:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.758896:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450677248 00000100:00100000:3.0:1762166980.758903:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450677248 00002000:00100000:3.0:1762166980.758936:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (24576->192511) req@ffff945bc47b4000 x1847765450677248/t0(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 504/0 e 0 to 0 dl 1762166991 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166980.758943:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc47b4000 with x1847765450677248 ext(24576->192511) 00002000:00010000:3.0:1762166980.758947:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc47b4000 00000100:00100000:3.0:1762166980.758974:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2653 00000100:00100000:3.0:1762166980.758985:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+25:2418:x1847765450677248:12345-192.168.204.38@tcp:4:fsx.0 00000100:00100000:3.0:1762166980.760686:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+28:2418:x1847765450677248:12345-192.168.204.38@tcp:4:fsx.0 Request processed in 1701us (1852us total) trans 17179876657 rc 0/0 00000100:00100000:3.0:1762166980.760695:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2653 00002000:00100000:3.0:1762166980.760702:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (24576->192511) req@ffff945bc47b4000 x1847765450677248/t17179876657(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 504/448 e 0 to 0 dl 1762166991 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166980.760709:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc47b4000 with x1847765450677248 ext(24576->192511) 00002000:00010000:3.0:1762166980.760713:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc47b4000 00000100:00100000:0.0:1762166980.761637:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.761688:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450677376 00000100:00100000:1.0:1762166980.761696:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450677376 00000100:00100000:1.0:1762166980.761734:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19337 00000100:00100000:1.0:1762166980.761741:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+28:2419:x1847765450677376:12345-192.168.204.38@tcp:16:fsx.0 00000001:00080000:2.0:1762166980.762835:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876657 is committed 00000001:00080000:2.0:1762166980.762857:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876651 is committed 00000100:00100000:1.0:1762166980.762987:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450677376:12345-192.168.204.38@tcp:16:fsx.0 Request processed in 1243us (1351us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166980.762997:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19337 00000100:00100000:0.0:1762166980.764858:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.764895:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450677632 00000100:00100000:1.0:1762166980.764904:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450677632 00000100:00100000:1.0:1762166980.764944:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30792 00000100:00100000:1.0:1762166980.764951:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+526:61766:x1847765450677632:12345-192.168.204.38@tcp:36:fsx.0 00010000:00010000:1.0:1762166980.765003:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1762166980.765032:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbac8a5 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea74e expref: 526 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.765051:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbac882 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea740 expref: 525 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.765062:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:1.0:1762166980.765067:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166980.765286:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbac8ba lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166980.765302:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbac8ba lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.765310:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbac8ba lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000001:00080000:1.0:1762166980.765345:0:6494:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992447 00000004:00010000:1.0:1762166980.765362:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000e16ac489 reply state 00000000ac104575 transno 4294992448 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbac8ba lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.765370:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbac8ba lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.765374:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:1.0:1762166980.765376:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166980.765378:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166980.765441:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+527:61766:x1847765450677632:12345-192.168.204.38@tcp:36:fsx.0 Request processed in 491us (587us total) trans 4294992448 rc 0/0 00000100:00100000:1.0:1762166980.765449:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30792 00000020:00080000:1.0:1762166980.765452:0:6494:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1762166980.766289:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.766341:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450677760 00000100:00100000:0.0:1762166980.766347:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450677760 00000100:00100000:0.0:1762166980.766387:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30793 00000100:00100000:0.0:1762166980.766397:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+527:61766:x1847765450677760:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:0.0:1762166980.766419:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166980.766432:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbac8c1 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea75c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.766471:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbac8c1 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea75c expref: 528 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.766507:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbac8c1 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea75c expref: 528 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.766527:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:0.0:1762166980.766529:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166980.766533:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bde800, rc 0) 00000100:00100000:0.0:1762166980.766581:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+528:61766:x1847765450677760:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 181us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166980.766588:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30793 00000100:00100000:0.0:1762166980.767615:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.767654:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450677888 00000100:00100000:1.0:1762166980.767659:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450677888 00000100:00100000:1.0:1762166980.767697:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19338 00000100:00100000:1.0:1762166980.767706:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+17:61766:x1847765450677888:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:1.0:1762166980.767718:0:8382:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166980.767731:0:8382:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cc355a600/0x2f180c4effbac8c8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea763 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.767755:0:8382:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc847f600/0x2f180c4effbac747 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6c9 expref: 18 pid: 35472 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166980.767764:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166980.767766:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166980.767771:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cc355a600/0x2f180c4effbac8c8 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea763 expref: 18 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.767804:0:8382:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc847f600/0x2f180c4effbac747 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6c9 expref: 18 pid: 35472 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166980.767834:0:8382:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc847f600/0x2f180c4effbac747 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6c9 expref: 18 pid: 35472 timeout: 699 lvb_type: 1 00000100:00100000:1.0:1762166980.767852:0:8382:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8382:1847765449776640:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166980.767944:0:8382:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc350f000 going to sleep for 11 seconds 00000100:00100000:1.0:1762166980.768654:0:8382:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8382:1847765449776640:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166980.768672:0:8382:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945cc355a600/0x2f180c4effbac8c8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea763 expref: 18 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.768683:0:8382:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355a600, rc 0) 00000100:00100000:1.0:1762166980.768710:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+18:61766:x1847765450677888:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 1006us (1096us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166980.768717:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19338 00000100:00100000:0.0:1762166980.768798:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.768841:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450678016 00000100:00100000:2.0:1762166980.768847:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450678016 00010000:00010000:2.0:1762166980.768872:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc847f600/0x2f180c4effbac747 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6c9 expref: 18 pid: 35472 timeout: 699 lvb_type: 1 00000100:00100000:2.0:1762166980.768901:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9776 00000100:00100000:2.0:1762166980.768906:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450678016:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166980.768914:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166980.768931:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc847f600/0x2f180c4effbac747 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6c9 expref: 18 pid: 35472 timeout: 699 lvb_type: 1 00010000:00010000:2.0:1762166980.768940:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc847f600/0x2f180c4effbac747 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6c9 expref: 18 pid: 35472 timeout: 699 lvb_type: 1 00010000:00010000:2.0:1762166980.768955:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc847f600/0x2f180c4effbac747 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6c9 expref: 18 pid: 35472 timeout: 699 lvb_type: 1 00010000:00010000:2.0:1762166980.768964:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166980.768965:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166980.768970:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945cc355a600/0x2f180c4effbac8c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea763 expref: 17 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.768981:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cc355a600/0x2f180c4effbac8c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea763 expref: 17 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.768997:0:6481:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff945cc355a600/0x2f180c4effbac8c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea763 expref: 17 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166980.769003:0:6481:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcce75180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6481:1847765449776768:192.168.204.38@tcp:105: 00000100:00100000:2.0:1762166980.769036:0:6481:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a1c00 going to sleep for 11 seconds 00000100:00100000:3.0:1762166980.769750:0:6481:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcce75180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6481:1847765449776768:192.168.204.38@tcp:105: 00010000:00010000:3.0:1762166980.769802:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166980.769847:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450678016:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 938us (1046us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166980.769857:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9776 00000100:00100000:0.0:1762166980.769906:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.769942:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450678144 00000100:00100000:1.0:1762166980.769947:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450678144 00000100:00100000:1.0:1762166980.769975:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19339 00000100:00100000:1.0:1762166980.769983:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+17:61766:x1847765450678144:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:1.0:1762166980.769995:0:8382:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166980.770009:0:8382:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cc355ae00/0x2f180c4effbac8cf lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea76a expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.770029:0:8382:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945cc355b400/0x2f180c4effbac74e lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6d0 expref: 18 pid: 35247 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166980.770036:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166980.770038:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166980.770041:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355ae00/0x2f180c4effbac8cf lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea76a expref: 18 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.770066:0:8382:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945cc355b400/0x2f180c4effbac74e lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6d0 expref: 18 pid: 35247 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166980.770085:0:8382:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945cc355b400/0x2f180c4effbac74e lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6d0 expref: 18 pid: 35247 timeout: 699 lvb_type: 1 00000100:00100000:1.0:1762166980.770092:0:8382:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8382:1847765449776896:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166980.770125:0:8382:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc350f000 going to sleep for 11 seconds 00000100:00100000:1.0:1762166980.770764:0:8382:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8382:1847765449776896:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166980.770778:0:8382:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945cc355ae00/0x2f180c4effbac8cf lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea76a expref: 18 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.770788:0:8382:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355ae00, rc 0) 00000100:00100000:1.0:1762166980.770833:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+18:61766:x1847765450678144:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 850us (928us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166980.770840:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19339 00000100:00100000:0.0:1762166980.770928:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.770987:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450678272 00000100:00100000:3.0:1762166980.770992:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450678272 00010000:00010000:3.0:1762166980.771011:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355b400/0x2f180c4effbac74e lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6d0 expref: 18 pid: 35247 timeout: 699 lvb_type: 1 00000100:00100000:3.0:1762166980.771039:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9777 00000100:00100000:3.0:1762166980.771046:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450678272:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166980.771056:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166980.771072:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945cc355b400/0x2f180c4effbac74e lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6d0 expref: 18 pid: 35247 timeout: 699 lvb_type: 1 00010000:00010000:3.0:1762166980.771083:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945cc355b400/0x2f180c4effbac74e lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6d0 expref: 18 pid: 35247 timeout: 699 lvb_type: 1 00010000:00010000:3.0:1762166980.771099:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cc355b400/0x2f180c4effbac74e lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6d0 expref: 18 pid: 35247 timeout: 699 lvb_type: 1 00010000:00010000:3.0:1762166980.771107:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166980.771108:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166980.771111:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945cc355ae00/0x2f180c4effbac8cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea76a expref: 17 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.771117:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355ae00/0x2f180c4effbac8cf lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea76a expref: 17 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.771138:0:6481:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff945cc355ae00/0x2f180c4effbac8cf lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea76a expref: 17 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166980.771148:0:6481:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bc0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6481:1847765449777024:192.168.204.38@tcp:105: 00000100:00100000:3.0:1762166980.771186:0:6481:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc56bff00 going to sleep for 11 seconds 00000100:00100000:3.0:1762166980.772059:0:6481:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bc0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6481:1847765449777024:192.168.204.38@tcp:105: 00000100:00100000:0.0:1762166980.772110:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:3.0:1762166980.772111:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166980.772159:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.772181:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450678400 00000100:00100000:1.0:1762166980.772187:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450678400 00000100:00100000:0.0:1762166980.772189:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450678528 00000100:00100000:3.0:1762166980.772190:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450678272:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1105us (1224us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166980.772196:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450678528 00000100:00100000:3.0:1762166980.772203:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9777 00000100:00100000:2.0:1762166980.772210:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00002000:00010000:1.0:1762166980.772217:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (114379->18446744073709551615) 00002000:00010000:0.0:1762166980.772218:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:1.0:1762166980.772224:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf783a680 with x1847765450678400 ext(114379->18446744073709551615) 00002000:00100000:0.0:1762166980.772226:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf783bb80 with x1847765450678528 ext(0->18446744073709551615) 00002000:00010000:1.0:1762166980.772235:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf783a680. 00002000:00010000:0.0:1762166980.772237:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945cf783bb80. 00000100:00100000:2.0:1762166980.772239:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450678656 00000100:00100000:2.0:1762166980.772245:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450678656 00002000:00010000:2.0:1762166980.772264:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00000100:00100000:1.0:1762166980.772264:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2654 00002000:00100000:2.0:1762166980.772271:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bcce76680 with x1847765450678656 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166980.772278:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bcce76680. 00000100:00100000:3.0:1762166980.772280:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2655 00000100:00100000:1.0:1762166980.772280:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450678400:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:3.0:1762166980.772296:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450678528:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:0.0:1762166980.772314:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2656 00000100:00100000:0.0:1762166980.772327:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450678656:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:3.0:1762166980.772423:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166980.772426:0:23943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00002000:00010000:3.0:1762166980.772428:0:23943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00002000:00010000:3.0:1762166980.772430:0:23943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:3.0:1762166980.772432:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00002000:00010000:0.0:1762166980.772439:0:14623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166980.772443:0:14623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00002000:00010000:0.0:1762166980.772446:0:14623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00002000:00010000:0.0:1762166980.772449:0:14623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00000100:00100000:3.0:1762166980.772452:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450678528:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 161us (295us total) trans 21474843429 rc 0/0 00002000:00010000:0.0:1762166980.772454:0:14623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166980.772463:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2655 00002000:00010000:3.0:1762166980.772466:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:3.0:1762166980.772468:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf783bb80 with x1847765450678528 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166980.772472:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945cf783bb80. 00000100:00100000:0.0:1762166980.772516:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450678656:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 191us (309us total) trans 17179876658 rc 0/0 00000100:00100000:0.0:1762166980.772525:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2656 00002000:00010000:0.0:1762166980.772537:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:0.0:1762166980.772543:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bcce76680 with x1847765450678656 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166980.772549:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bcce76680. 00002000:00010000:1.0:1762166980.772685:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 245699 -> 114379 00002000:00010000:1.0:1762166980.772689:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00002000:00010000:1.0:1762166980.772692:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00002000:00010000:1.0:1762166980.772695:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:1.0:1762166980.772697:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 344 -> 176 00000100:00100000:1.0:1762166980.772729:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450678400:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 454us (621us total) trans 17179876659 rc 0/0 00000100:00100000:1.0:1762166980.772737:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2654 00002000:00010000:1.0:1762166980.772741:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (114379->18446744073709551615) 00002000:00100000:1.0:1762166980.772744:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf783a680 with x1847765450678400 ext(114379->18446744073709551615) 00002000:00010000:1.0:1762166980.772748:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf783a680. 00000100:00100000:3.0:1762166980.773733:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.773778:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450678784 00000100:00100000:0.0:1762166980.773784:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450678784 00000100:00100000:0.0:1762166980.773831:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30794 00000100:00100000:0.0:1762166980.773839:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+528:61766:x1847765450678784:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:0.0:1762166980.773852:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166980.773869:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbac8d6 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea771 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.773950:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbac8dd lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166980.773963:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbac8dd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.773974:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbac8dd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:0.0:1762166980.774000:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 114379 00000004:00200000:0.0:1762166980.774005:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166980.774021:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbac8dd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.774044:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbac8d6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea771 expref: 530 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.774059:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbac8dd lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea771 expref: 529 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.774067:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:0.0:1762166980.774070:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166980.774074:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdf200, rc 0) 00000100:00100000:0.0:1762166980.774107:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+529:61766:x1847765450678784:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 268us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166980.774114:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30794 00000100:00100000:2.0:1762166980.775713:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.775766:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450678912 00000100:00100000:1.0:1762166980.775772:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450678912 00000100:00100000:1.0:1762166980.775823:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2657 00000100:00100000:1.0:1762166980.775834:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+19:2417:x1847765450678912:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:1.0:1762166980.775971:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 114379 -> 114379 00002000:00010000:1.0:1762166980.775974:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00002000:00010000:1.0:1762166980.775975:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00002000:00010000:1.0:1762166980.775977:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:1.0:1762166980.775978:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 176 -> 184 00000100:00100000:1.0:1762166980.776008:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+20:2417:x1847765450678912:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 177us (299us total) trans 17179876660 rc 0/0 00000100:00100000:1.0:1762166980.776013:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2657 00000100:00100000:3.0:1762166980.779270:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.779312:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450679040 00000100:00100000:1.0:1762166980.779319:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450679040 00000100:00100000:1.0:1762166980.779358:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2658 00000100:00100000:1.0:1762166980.779365:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450679040:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:1.0:1762166980.779602:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 114379 -> 114379 00002000:00010000:1.0:1762166980.779606:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00002000:00010000:1.0:1762166980.779609:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00002000:00010000:1.0:1762166980.779610:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:1.0:1762166980.779613:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 184 -> 168 00000100:00100000:1.0:1762166980.779663:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450679040:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 298us (396us total) trans 17179876661 rc 0/0 00000100:00100000:1.0:1762166980.779671:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2658 00000100:00100000:3.0:1762166980.781148:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.781193:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450679168 00000100:00100000:1.0:1762166980.781197:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450679168 00002000:00100000:1.0:1762166980.781221:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (159744->195181) req@ffff945bc5bc3480 x1847765450679168/t0(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 488/0 e 0 to 0 dl 1762166991 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166980.781228:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5bc3480 with x1847765450679168 ext(159744->195181) 00002000:00010000:1.0:1762166980.781233:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5bc3480 00000100:00100000:1.0:1762166980.781253:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2659 00000100:00100000:1.0:1762166980.781260:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450679168:12345-192.168.204.38@tcp:4:fsx.0 00000100:00100000:1.0:1762166980.782673:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765450679168:12345-192.168.204.38@tcp:4:fsx.0 Request processed in 1409us (1523us total) trans 17179876662 rc 0/0 00000100:00100000:1.0:1762166980.782683:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2659 00002000:00100000:1.0:1762166980.782692:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (159744->195181) req@ffff945bc5bc3480 x1847765450679168/t17179876662(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 488/448 e 0 to 0 dl 1762166991 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166980.782702:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5bc3480 with x1847765450679168 ext(159744->195181) 00002000:00010000:1.0:1762166980.782707:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5bc3480 00000100:00100000:3.0:1762166980.783552:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.783586:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450679296 00000100:00100000:1.0:1762166980.783592:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450679296 00000100:00100000:1.0:1762166980.783628:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2660 00000100:00100000:1.0:1762166980.783634:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765450679296:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:1.0:1762166980.783794:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 114379 -> 195182 00002000:00010000:1.0:1762166980.783798:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00002000:00010000:1.0:1762166980.783800:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00002000:00010000:1.0:1762166980.783802:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:1.0:1762166980.783804:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 168 -> 240 00000100:00100000:1.0:1762166980.783853:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765450679296:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 218us (303us total) trans 17179876663 rc 0/0 00000100:00100000:1.0:1762166980.783860:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2660 00000100:00100000:3.0:1762166980.785230:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.785270:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450679424 00000100:00100000:1.0:1762166980.785274:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450679424 00000100:00100000:1.0:1762166980.785312:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2661 00000100:00100000:1.0:1762166980.785319:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765450679424:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:1.0:1762166980.785454:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 195182 -> 195182 00002000:00010000:1.0:1762166980.785457:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00002000:00010000:1.0:1762166980.785458:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00002000:00010000:1.0:1762166980.785460:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:1.0:1762166980.785461:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 240 -> 312 00000100:00100000:1.0:1762166980.785520:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+25:2419:x1847765450679424:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 200us (296us total) trans 17179876664 rc 0/0 00000100:00100000:1.0:1762166980.785527:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2661 00000100:00100000:2.0:1762166980.787030:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.787071:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450679552 00000100:00100000:1.0:1762166980.787076:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450679552 00002000:00100000:1.0:1762166980.787103:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (86016->196607) req@ffff945bcce74380 x1847765450679552/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 504/0 e 0 to 0 dl 1762166991 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166980.787119:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bcce74380 with x1847765450679552 ext(86016->196607) 00002000:00010000:1.0:1762166980.787125:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bcce74380 00000100:00100000:1.0:1762166980.787147:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2662 00000100:00100000:1.0:1762166980.787155:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+25:2418:x1847765450679552:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:1.0:1762166980.788309:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+25:2418:x1847765450679552:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 1153us (1277us total) trans 0 rc 81920/81920 00000100:00100000:1.0:1762166980.788315:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2662 00002000:00100000:1.0:1762166980.788321:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (86016->196607) req@ffff945bcce74380 x1847765450679552/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 504/440 e 0 to 0 dl 1762166991 ref 1 fl Complete:/600/0 rc 81920/81920 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166980.788327:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bcce74380 with x1847765450679552 ext(86016->196607) 00002000:00010000:1.0:1762166980.788330:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bcce74380 00000100:00100000:3.0:1762166980.790394:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.790443:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450679680 00000100:00100000:1.0:1762166980.790452:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450679680 00002000:00100000:1.0:1762166980.790514:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (16384->36863) req@ffff945bc5bc2680 x1847765450679680/t0(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 488/0 e 0 to 0 dl 1762166991 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166980.790522:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5bc2680 with x1847765450679680 ext(16384->36863) 00002000:00010000:1.0:1762166980.790527:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5bc2680 00000100:00100000:1.0:1762166980.790553:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2663 00000100:00100000:1.0:1762166980.790563:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+25:2419:x1847765450679680:12345-192.168.204.38@tcp:4:fsx.0 00000100:00100000:1.0:1762166980.791603:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+27:2419:x1847765450679680:12345-192.168.204.38@tcp:4:fsx.0 Request processed in 1040us (1212us total) trans 17179876665 rc 0/0 00000100:00100000:1.0:1762166980.791613:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2663 00002000:00100000:1.0:1762166980.791623:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (16384->36863) req@ffff945bc5bc2680 x1847765450679680/t17179876665(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 488/448 e 0 to 0 dl 1762166991 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166980.791633:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5bc2680 with x1847765450679680 ext(16384->36863) 00002000:00010000:1.0:1762166980.791638:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5bc2680 00000100:00100000:3.0:1762166980.792331:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.792371:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450679808 00000100:00100000:1.0:1762166980.792375:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450679808 00000100:00100000:1.0:1762166980.792410:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19340 00000100:00100000:1.0:1762166980.792419:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+27:2418:x1847765450679808:12345-192.168.204.38@tcp:16:fsx.0 00000001:00080000:2.0:1762166980.793283:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876665 is committed 00000100:00100000:1.0:1762166980.793382:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450679808:12345-192.168.204.38@tcp:16:fsx.0 Request processed in 964us (1051us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166980.793391:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19340 00000100:00100000:3.0:1762166980.795535:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.795578:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450679936 00000100:00100000:1.0:1762166980.795589:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450679936 00000100:00100000:1.0:1762166980.795647:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2664 00000100:00100000:1.0:1762166980.795654:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450679936:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:1.0:1762166980.795862:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 195182 -> 195182 00002000:00010000:1.0:1762166980.795866:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166980 -> 1762166981 00002000:00010000:1.0:1762166980.795869:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166980 -> 1762166981 00002000:00010000:1.0:1762166980.795871:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166980 -> 1762166981 00002000:00010000:1.0:1762166980.795874:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 312 -> 344 00000100:00100000:1.0:1762166980.795924:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450679936:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 270us (397us total) trans 17179876666 rc 0/0 00000100:00100000:1.0:1762166980.795932:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2664 00000100:00100000:2.0:1762166980.797701:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.797768:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450680064 00000100:00100000:1.0:1762166980.797776:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450680064 00000100:00100000:1.0:1762166980.797841:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2665 00000100:00100000:1.0:1762166980.797851:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450680064:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:1.0:1762166980.798108:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 195182 -> 195182 00002000:00010000:1.0:1762166980.798113:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00010000:1.0:1762166980.798115:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166981 -> 1762166981 00002000:00010000:1.0:1762166980.798117:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00002000:00010000:1.0:1762166980.798119:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 344 -> 344 00000100:00100000:1.0:1762166980.798170:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450680064:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 321us (471us total) trans 17179876667 rc 0/0 00000100:00100000:1.0:1762166980.798179:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2665 00000100:00100000:3.0:1762166980.800896:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.800980:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450680320 00000100:00100000:0.0:1762166980.800993:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450680320 00000100:00100000:0.0:1762166980.801064:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30795 00000100:00100000:0.0:1762166980.801076:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+529:61766:x1847765450680320:12345-192.168.204.38@tcp:36:fsx.0 00010000:00010000:0.0:1762166980.801130:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166980.801158:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbac8dd lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea771 expref: 529 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.801176:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:0.0:1762166980.801181:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166980.801363:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbac8e4 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166980.801377:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbac8e4 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.801387:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbac8e4 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000001:00080000:0.0:1762166980.801435:0:6494:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992449 00000004:00010000:0.0:1762166980.801456:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000009ff762b8 reply state 00000000da6a848e transno 4294992450 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbac8e4 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.801467:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbac8e4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.801473:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:0.0:1762166980.801524:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762166980.801527:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166980.801613:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+531:61766:x1847765450680320:12345-192.168.204.38@tcp:36:fsx.0 Request processed in 539us (725us total) trans 4294992450 rc 0/0 00000100:00100000:0.0:1762166980.801621:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30795 00000020:00080000:0.0:1762166980.801629:0:6494:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1762166980.802888:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.802938:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.802966:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.802998:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450680448 00000100:00100000:1.0:1762166980.803006:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450680448 00002000:00010000:1.0:1762166980.803038:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (148474->18446744073709551615) 00000100:00100000:0.0:1762166980.803040:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450680576 00000100:00100000:2.0:1762166980.803041:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450680704 00002000:00100000:1.0:1762166980.803044:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5bc1c00 with x1847765450680448 ext(148474->18446744073709551615) 00000100:00100000:2.0:1762166980.803052:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450680704 00000100:00100000:0.0:1762166980.803053:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450680576 00002000:00010000:1.0:1762166980.803057:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5bc1c00. 00000100:00100000:1.0:1762166980.803091:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2666 00002000:00010000:0.0:1762166980.803092:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00010000:2.0:1762166980.803094:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:0.0:1762166980.803099:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc7b22d80 with x1847765450680576 ext(0->18446744073709551615) 00002000:00100000:2.0:1762166980.803102:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc7b22680 with x1847765450680704 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166980.803110:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc7b22d80. 00000100:00100000:1.0:1762166980.803115:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450680448:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:2.0:1762166980.803118:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc7b22680. 00000100:00100000:0.0:1762166980.803144:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2667 00000100:00100000:0.0:1762166980.803153:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450680576:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:3.0:1762166980.803168:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2668 00000100:00100000:3.0:1762166980.803183:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450680704:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:3.0:1762166980.803294:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166980.803297:0:23943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166980 -> 1762166981 00002000:00010000:3.0:1762166980.803300:0:23943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00002000:00010000:3.0:1762166980.803303:0:23943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166980 -> 1762166981 00002000:00010000:3.0:1762166980.803305:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:0.0:1762166980.803318:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166980.803324:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166980 -> 1762166981 00002000:00010000:0.0:1762166980.803328:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00002000:00010000:0.0:1762166980.803331:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166980 -> 1762166981 00002000:00010000:0.0:1762166980.803342:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00000100:00100000:3.0:1762166980.803348:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450680704:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 171us (379us total) trans 17179876668 rc 0/0 00000100:00100000:3.0:1762166980.803358:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2668 00002000:00010000:3.0:1762166980.803362:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:3.0:1762166980.803365:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc7b22680 with x1847765450680704 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166980.803373:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc7b22680. 00000100:00100000:0.0:1762166980.803394:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450680576:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 240us (453us total) trans 21474843430 rc 0/0 00000100:00100000:0.0:1762166980.803406:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2667 00002000:00010000:0.0:1762166980.803409:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:0.0:1762166980.803412:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc7b22d80 with x1847765450680576 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166980.803419:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc7b22d80. 00002000:00010000:1.0:1762166980.803422:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 195182 -> 148474 00002000:00010000:1.0:1762166980.803430:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00010000:1.0:1762166980.803433:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166981 -> 1762166981 00002000:00010000:1.0:1762166980.803437:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00002000:00010000:1.0:1762166980.803441:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 344 -> 256 00000100:00100000:1.0:1762166980.803514:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450680448:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 373us (624us total) trans 17179876669 rc 0/0 00000100:00100000:1.0:1762166980.803523:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2666 00002000:00010000:1.0:1762166980.803528:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (148474->18446744073709551615) 00002000:00100000:1.0:1762166980.803531:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5bc1c00 with x1847765450680448 ext(148474->18446744073709551615) 00002000:00010000:1.0:1762166980.803536:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5bc1c00. 00000100:00100000:2.0:1762166980.804750:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.804806:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450680832 00000100:00100000:0.0:1762166980.804812:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450680832 00000100:00100000:0.0:1762166980.804859:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30796 00000100:00100000:0.0:1762166980.804869:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+531:61766:x1847765450680832:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:0.0:1762166980.804886:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166980.804900:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbac8eb lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea778 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.804969:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbac8f2 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166980.804980:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbac8f2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.804990:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbac8f2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:0.0:1762166980.805010:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 148474 00000004:00200000:0.0:1762166980.805014:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166980.805028:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbac8f2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.805050:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbac8eb lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea778 expref: 533 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.805066:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbac8f2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea778 expref: 532 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.805073:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:0.0:1762166980.805076:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166980.805079:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bde000, rc 0) 00000100:00100000:0.0:1762166980.805117:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+532:61766:x1847765450680832:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 250us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166980.805124:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30796 00000100:00100000:2.0:1762166980.807181:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.807279:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450681088 00000100:00100000:0.0:1762166980.807292:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450681088 00000100:00100000:0.0:1762166980.807364:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11966 00000100:00100000:0.0:1762166980.807374:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+532:61766:x1847765450681088:12345-192.168.204.38@tcp:35:fsx.0 00000100:00100000:0.0:1762166980.807725:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+533:61766:x1847765450681088:12345-192.168.204.38@tcp:35:fsx.0 Request processed in 352us (556us total) trans 4294992451 rc 0/0 00000100:00100000:0.0:1762166980.807734:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11966 00000100:00100000:3.0:1762166980.816599:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.816654:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450681216 00000100:00100000:0.0:1762166980.816668:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450681216 00000100:00100000:0.0:1762166980.816739:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30797 00000100:00100000:0.0:1762166980.816751:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+533:61877:x1847765450681216:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166980.816778:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166980.816801:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbac8f9 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea77f expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.816894:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbac900 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166980.816912:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbac900 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.816926:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbac900 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.816940:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbac907 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166980.816948:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbac907 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.816955:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbac907 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.817055:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbac90e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166980.817065:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbac90e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.817072:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbac90e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:0.0:1762166980.817117:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 148474 00000004:00200000:0.0:1762166980.817123:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166980.817145:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbac90e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.817158:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbac90e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.817167:0:6494:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbac900 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.817174:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbac900 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.817180:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbac900 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.817187:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbac900 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.817193:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdf200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166980.817198:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbac900 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.817206:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbac900 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.817219:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0x0 (ffff945bc4afe200) 00010000:00010000:0.0:1762166980.817222:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166980.817227:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbac900 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.817231:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbac900 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.817242:0:6494:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbac907 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.817246:0:6494:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbac907 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.817249:0:6494:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbac907 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.817252:0:6494:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdfa00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166980.817254:0:6494:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbac907 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.817257:0:6494:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbac907 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.817260:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0xdd396665 (ffff945bc4afe000) 00010000:00010000:0.0:1762166980.817262:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166980.817264:0:6494:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbac907 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.817269:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbac907 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.817302:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbac8f9 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea77f expref: 535 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.817319:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbac90e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea77f expref: 534 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.817327:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:0.0:1762166980.817329:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166980.817333:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bde200, rc 0) 00000100:00100000:0.0:1762166980.817404:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+534:61877:x1847765450681216:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 655us (818us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166980.817413:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30797 00000100:00100000:2.0:1762166980.819098:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.819167:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450681344 00000100:00100000:3.0:1762166980.819176:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450681344 00000100:00100000:3.0:1762166980.819234:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 897 00000100:00100000:3.0:1762166980.819243:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce76a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+534:2418:x1847765450681344:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166980.819258:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166980.819279:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbac90e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea77f expref: 534 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.819294:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:3.0:1762166980.819298:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166980.819343:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce76a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+533:2418:x1847765450681344:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 101us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166980.819351:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 897 00000100:00100000:2.0:1762166980.819664:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.819725:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450681600 00000100:00100000:0.0:1762166980.819745:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450681600 00000100:00100000:0.0:1762166980.819825:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30798 00000100:00100000:0.0:1762166980.819841:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+533:61877:x1847765450681600:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166980.819862:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166980.819881:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbac915 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea786 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.819981:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbac91c lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166980.819996:0:6494:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbac8f2 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea778 expref: 534 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.820006:0:6494:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbac91c lrc: 4/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.820040:0:6494:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbac8f2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea778 expref: 534 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.820057:0:6494:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbac8f2 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea778 expref: 534 pid: 6494 timeout: 699 lvb_type: 0 00000100:00100000:0.0:1762166980.820070:0:6494:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf7838700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765449777152:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166980.820171:0:6494:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cff1fa840 going to sleep for 11 seconds 00000100:00100000:1.0:1762166980.821145:0:6494:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf7838700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765449777152:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166980.821165:0:6494:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbac91c lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000100:00100000:2.0:1762166980.821436:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.821507:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450681728 00000100:00100000:3.0:1762166980.821514:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450681728 00010000:00010000:3.0:1762166980.821540:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbac8f2 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea778 expref: 535 pid: 6494 timeout: 699 lvb_type: 0 00000100:00100000:3.0:1762166980.821584:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9778 00000100:00100000:3.0:1762166980.821594:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce77100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+535:2419:x1847765450681728:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166980.821605:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166980.821612:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbac8f2 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea778 expref: 535 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:3.0:1762166980.821624:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbac8f2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea778 expref: 535 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:3.0:1762166980.821689:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbac8f2 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea778 expref: 535 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:3.0:1762166980.821704:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:3.0:1762166980.821708:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbac91c lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.821716:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbac91c lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.821722:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbac91c lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.821753:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166980.821794:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce77100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+534:2419:x1847765450681728:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 202us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166980.821802:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9778 00010000:00010000:1.0:1762166980.821880:0:6494:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbac91c lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.821887:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbac91c lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:1.0:1762166980.821904:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 148474 00010000:00010000:1.0:1762166980.822029:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbac915 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea786 expref: 535 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.822044:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbac91c lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea786 expref: 534 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.822052:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:1.0:1762166980.822055:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1762166980.822058:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdec00, rc 0) 00000100:00100000:1.0:1762166980.822100:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+534:61877:x1847765450681600:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2265us (2439us total) trans 4294992452 rc 0/0 00000100:00100000:1.0:1762166980.822107:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30798 00000100:00100000:2.0:1762166980.823560:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.823703:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450681856 00000100:00100000:1.0:1762166980.823713:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450681856 00000100:00100000:1.0:1762166980.823773:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30799 00000100:00100000:1.0:1762166980.823783:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+534:61877:x1847765450681856:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166980.823805:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166980.823831:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbac92a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea78d expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.823906:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbac931 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166980.823916:0:6494:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbac91c lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea786 expref: 535 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.823921:0:6494:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbac931 lrc: 4/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.823947:0:6494:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbac91c lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea786 expref: 535 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.823959:0:6494:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbac91c lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea786 expref: 535 pid: 6494 timeout: 699 lvb_type: 0 00000100:00100000:1.0:1762166980.823972:0:6494:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79eaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765449777280:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166980.824041:0:6494:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc350fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1762166980.825054:0:6494:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79eaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6494:1847765449777280:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166980.825069:0:6494:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbac931 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000100:00100000:2.0:1762166980.825298:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.825338:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450681984 00000100:00100000:3.0:1762166980.825343:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450681984 00010000:00010000:3.0:1762166980.825362:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbac91c lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea786 expref: 536 pid: 6494 timeout: 699 lvb_type: 0 00000100:00100000:3.0:1762166980.825394:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9779 00000100:00100000:3.0:1762166980.825519:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+536:2419:x1847765450681984:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166980.825532:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166980.825539:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbac91c lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea786 expref: 536 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:3.0:1762166980.825558:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbac91c lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea786 expref: 536 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:3.0:1762166980.825577:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbac91c lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea786 expref: 536 pid: 6494 timeout: 699 lvb_type: 0 00010000:00010000:3.0:1762166980.825592:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:3.0:1762166980.825596:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbac931 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.825603:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbac931 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.825609:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbac931 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.825631:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166980.825654:0:6494:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbac931 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.825664:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbac931 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000100:00100000:3.0:1762166980.825671:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+535:2419:x1847765450681984:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 268us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166980.825681:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9779 00000004:00200000:1.0:1762166980.825703:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 148474 00000004:00200000:1.0:1762166980.825708:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166980.825724:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbac931 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.825754:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbac92a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea78d expref: 535 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.825769:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbac931 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea78d expref: 534 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.825778:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:1.0:1762166980.825781:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166980.825783:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355ac00, rc 0) 00000100:00100000:1.0:1762166980.825836:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+534:61877:x1847765450681856:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2055us (2284us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166980.825844:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30799 00000100:00100000:2.0:1762166980.827207:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.827262:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450682240 00000100:00100000:1.0:1762166980.827268:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450682240 00000100:00100000:1.0:1762166980.827306:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30800 00000100:00100000:1.0:1762166980.827315:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+534:61877:x1847765450682240:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166980.827333:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166980.827348:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbac938 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea794 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.827422:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbac93f lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166980.827436:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbac93f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.827444:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbac93f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:1.0:1762166980.827452:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 148474 00010000:00010000:1.0:1762166980.827578:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbac938 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea794 expref: 537 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.827590:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbac93f lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea794 expref: 536 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.827597:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:1.0:1762166980.827600:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762166980.827602:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355b600, rc 0) 00000100:00100000:1.0:1762166980.827645:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+536:61877:x1847765450682240:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 331us (443us total) trans 4294992453 rc 0/0 00000100:00100000:1.0:1762166980.827651:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30800 00000100:00100000:2.0:1762166980.828719:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.828833:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450682496 00000100:00100000:1.0:1762166980.828846:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450682496 00000100:00100000:2.0:1762166980.828875:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.828908:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.828924:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450682368 00000100:00100000:1.0:1762166980.828930:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450682368 00000100:00100000:3.0:1762166980.828935:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450682624 00000100:00100000:3.0:1762166980.828943:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450682624 00000100:00100000:0.0:1762166980.828964:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19341 00000100:00100000:0.0:1762166980.828979:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450682496:12345-192.168.204.38@tcp:1:lfs.0 00000100:00100000:1.0:1762166980.828989:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19342 00000100:00100000:1.0:1762166980.829004:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450682368:12345-192.168.204.38@tcp:1:lfs.0 00000100:00100000:3.0:1762166980.829013:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19343 00010000:00010000:0.0:1762166980.829015:0:35472:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfa00/0x2f180c4effbac94d lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166980.829029:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450682624:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:0.0:1762166980.829034:0:35472:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945cc355a600/0x2f180c4effbac8c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea763 expref: 19 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.829045:0:35472:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166980.829049:0:35472:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166980.829054:0:35472:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfa00/0x2f180c4effbac94d lrc: 4/0,1 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.829056:0:8382:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945cc355bc00/0x2f180c4effbac954 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.829058:0:9165:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc5ae4800/0x2f180c4effbac95b lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.829119:0:9165:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945cc355ae00/0x2f180c4effbac8cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea76a expref: 22 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.829120:0:8382:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbac897 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->16383) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea747 expref: 22 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.829134:0:35472:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945cc355a600/0x2f180c4effbac8c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea763 expref: 19 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.829165:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166980.829170:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166980.829171:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166980.829175:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355bc00/0x2f180c4effbac954 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.829176:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166980.829180:0:35472:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945cc355a600/0x2f180c4effbac8c8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea763 expref: 19 pid: 8382 timeout: 699 lvb_type: 0 00010000:00010000:3.0:1762166980.829183:0:9165:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc5ae4800/0x2f180c4effbac95b lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166980.829233:0:35472:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf7838700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:35472:1847765449777408:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166980.829246:0:8382:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbac897 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->16383) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea747 expref: 22 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.829263:0:8382:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbac897 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->16383) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea747 expref: 22 pid: 8382 timeout: 699 lvb_type: 0 00000100:00100000:1.0:1762166980.829281:0:8382:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8382:1847765449777536:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166980.829307:0:9165:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945cc355ae00/0x2f180c4effbac8cf lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea76a expref: 22 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166980.829309:0:35472:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cff1fa300 going to sleep for 11 seconds 00010000:00010000:2.0:1762166980.829325:0:9165:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945cc355ae00/0x2f180c4effbac8cf lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea76a expref: 22 pid: 8382 timeout: 699 lvb_type: 0 00000100:00100000:2.0:1762166980.829340:0:9165:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a29500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9165:1847765449777664:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166980.829349:0:8382:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc350f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166980.829383:0:9165:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a1c00 going to sleep for 11 seconds 00000100:00100000:1.0:1762166980.830336:0:8382:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8382:1847765449777536:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166980.830357:0:8382:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945cc355bc00/0x2f180c4effbac954 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166980.830359:0:35472:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf7838700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:35472:1847765449777408:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166980.830379:0:35472:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfa00/0x2f180c4effbac94d lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166980.830398:0:9165:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a29500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9165:1847765449777664:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166980.830414:0:9165:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc5ae4800/0x2f180c4effbac95b lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166980.830567:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.830595:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.830618:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450682752 00000100:00100000:3.0:1762166980.830624:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450682752 00000100:00100000:1.0:1762166980.830637:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450682880 00000100:00100000:1.0:1762166980.830643:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450682880 00010000:00010000:3.0:1762166980.830646:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945cc355a600/0x2f180c4effbac8c8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea763 expref: 20 pid: 8382 timeout: 699 lvb_type: 0 00010000:00010000:1.0:1762166980.830665:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355ae00/0x2f180c4effbac8cf lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea76a expref: 23 pid: 8382 timeout: 699 lvb_type: 0 00000100:00100000:3.0:1762166980.830681:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9780 00000100:00100000:3.0:1762166980.830693:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cceb49c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450682752:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166980.830704:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1762166980.830723:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9781 00010000:00010000:3.0:1762166980.830732:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945cc355a600/0x2f180c4effbac8c8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea763 expref: 20 pid: 8382 timeout: 699 lvb_type: 0 00000100:00100000:0.0:1762166980.830738:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+23:2417:x1847765450682880:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166980.830753:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166980.830758:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945cc355a600/0x2f180c4effbac8c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea763 expref: 20 pid: 8382 timeout: 699 lvb_type: 0 00010000:00010000:0.0:1762166980.830771:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945cc355ae00/0x2f180c4effbac8cf lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea76a expref: 23 pid: 8382 timeout: 699 lvb_type: 0 00010000:00010000:3.0:1762166980.830782:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cc355a600/0x2f180c4effbac8c8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea763 expref: 20 pid: 8382 timeout: 699 lvb_type: 0 00010000:00010000:0.0:1762166980.830787:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945cc355ae00/0x2f180c4effbac8cf lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea76a expref: 23 pid: 8382 timeout: 699 lvb_type: 0 00010000:00010000:3.0:1762166980.830803:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166980.830806:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166980.830810:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfa00/0x2f180c4effbac94d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.830827:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cc355ae00/0x2f180c4effbac8cf lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea76a expref: 23 pid: 8382 timeout: 699 lvb_type: 0 00010000:00010000:0.0:1762166980.830839:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166980.830842:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166980.830845:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc5ae4800/0x2f180c4effbac95b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.830853:0:7421:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc5ae4800/0x2f180c4effbac95b lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.830878:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166980.830913:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfa00/0x2f180c4effbac94d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.830916:0:9165:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc5ae4800/0x2f180c4effbac95b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166980.830921:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+22:2417:x1847765450682880:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 187us (322us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166980.830939:0:9165:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc5ae4800/0x2f180c4effbac95b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166980.830941:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9781 00010000:00010000:3.0:1762166980.830955:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166980.830962:0:9165:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc5ae4800/0x2f180c4effbac95b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.830971:0:9165:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc5ae4800/0x2f180c4effbac95b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.830980:0:9165:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc5ae4800/0x2f180c4effbac95b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166980.830987:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cceb49c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450682752:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 294us (417us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166980.830995:0:9165:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc5ae4800 already unused, calling callback (ffffffffc0cd9320) 00000100:00100000:0.0:1762166980.830995:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:2.0:1762166980.831003:0:9165:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc5ae4800/0x2f180c4effbac95b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166980.831005:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9780 00000100:00100000:0.0:1762166980.831015:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450683008 00010000:00010000:2.0:1762166980.831019:0:9165:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc5ae4800/0x2f180c4effbac95b lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166980.831021:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450683008 00010000:00010000:2.0:1762166980.831036:0:9165:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc5ae4800/0x2f180c4effbac95b lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.831038:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbac897 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->16383) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea747 expref: 22 pid: 8382 timeout: 699 lvb_type: 0 00010000:00010000:2.0:1762166980.831056:0:9165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc5ae4800/0x2f180c4effbac95b lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166980.831079:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9782 00000100:00100000:0.0:1762166980.831090:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf7838700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765450683008:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166980.831098:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166980.831108:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbac897 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 8192->16383) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea747 expref: 22 pid: 8382 timeout: 699 lvb_type: 0 00000100:00100000:2.0:1762166980.831116:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450682624:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 2089us (2203us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166980.831124:0:35472:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfa00/0x2f180c4effbac94d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.831127:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbac897 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 8192->16383) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea747 expref: 22 pid: 8382 timeout: 699 lvb_type: 0 00000100:00100000:2.0:1762166980.831129:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19343 00010000:00010000:3.0:1762166980.831148:0:35472:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfa00/0x2f180c4effbac94d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.831159:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbac897 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 8192->16383) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea747 expref: 21 pid: 8382 timeout: 699 lvb_type: 0 00010000:00010000:3.0:1762166980.831178:0:35472:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfa00/0x2f180c4effbac94d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.831184:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166980.831187:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166980.831193:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945cc355bc00/0x2f180c4effbac954 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.831197:0:35472:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfa00/0x2f180c4effbac94d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.831205:0:7421:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355bc00/0x2f180c4effbac954 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.831232:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166980.831254:0:35472:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfa00/0x2f180c4effbac94d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.831255:0:8382:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945cc355bc00/0x2f180c4effbac954 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166980.831264:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf7838700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450683008:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 174us (271us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166980.831270:0:35472:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdfa00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166980.831277:0:35472:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfa00/0x2f180c4effbac94d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.831281:0:8382:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cc355bc00/0x2f180c4effbac954 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166980.831285:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9782 00010000:00010000:3.0:1762166980.831293:0:35472:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfa00/0x2f180c4effbac94d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.831307:0:8382:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945cc355bc00/0x2f180c4effbac954 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.831309:0:35472:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfa00/0x2f180c4effbac94d lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.831330:0:8382:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355bc00/0x2f180c4effbac954 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.831331:0:35472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfa00/0x2f180c4effbac94d lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.831354:0:8382:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945cc355bc00/0x2f180c4effbac954 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.831361:0:8382:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355bc00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166980.831365:0:8382:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc355bc00/0x2f180c4effbac954 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.831373:0:8382:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc355bc00/0x2f180c4effbac954 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.831386:0:8382:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945cc355bc00/0x2f180c4effbac954 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.831393:0:8382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cc355bc00/0x2f180c4effbac954 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166980.831447:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450682368:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 2448us (2572us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166980.831454:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19342 00000100:00100000:2.0:1762166980.831528:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450682496:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 2552us (2809us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166980.831536:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19341 00000100:00100000:1.0:1762166980.832463:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.832567:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450683264 00000100:00100000:0.0:1762166980.832578:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450683264 00000100:00100000:0.0:1762166980.832638:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30801 00000100:00100000:0.0:1762166980.832648:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+536:61877:x1847765450683264:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:0.0:1762166980.832705:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1762166980.832728:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbac8c1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea75c expref: 536 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.832887:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbac931 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea78d expref: 535 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.832899:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:0.0:1762166980.832904:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166980.832934:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbac962 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:0.0:1762166980.832945:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbac962 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:0.0:1762166980.832955:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbac962 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000040:00080000:0.0:1762166980.833220:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5934, 88 off464848 00000004:00080000:0.0:1762166980.833230:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 599981751346ns, next at 600144491692ns, rc = 0 00000040:00080000:0.0:1762166980.833284:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5933, 88 off464848 00000004:00080000:0.0:1762166980.833290:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 599981812139ns, next at 600144525370ns, rc = 0 00000040:00080000:0.0:1762166980.833324:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5934, 88 off464936 00000004:00080000:0.0:1762166980.833329:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 599981851539ns, next at 600144525370ns, rc = 0 00000040:00080000:0.0:1762166980.833341:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5935, 88 off464936 00000004:00080000:0.0:1762166980.833345:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 599981867793ns, next at 600144491692ns, rc = 0 00000040:00080000:0.0:1762166980.833366:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5936, 88 off465024 00000004:00080000:0.0:1762166980.833371:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 599981893750ns, next at 600144491692ns, rc = 0 00000040:00080000:0.0:1762166980.833403:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5935, 88 off465024 00000004:00080000:0.0:1762166980.833409:0:6494:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 599981930996ns, next at 600144525370ns, rc = 0 00000001:00080000:3.0:1762166980.834587:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294992454 is committed 00000004:00080000:3.0:1762166980.834596:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3296 committed 00010000:00010000:2.0:1762166980.834610:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbac8ba lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00000004:00080000:3.0:1762166980.834612:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3293 committed 00000004:00080000:3.0:1762166980.834620:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3292 committed 00010000:00010000:2.0:1762166980.834621:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbac8ba lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00000004:00080000:3.0:1762166980.834622:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3295 committed 00000004:00080000:3.0:1762166980.834624:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3294 committed 00000004:00080000:3.0:1762166980.834627:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3291 committed 00010000:00010000:2.0:1762166980.834629:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbac8ba lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.834634:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355b800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166980.834638:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbac8ba lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00000020:00080000:3.0:1762166980.834642:0:7412:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0001: 63 batchid updated 00010000:00010000:2.0:1762166980.834645:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbac8ba lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.834659:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166980.834662:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166980.834666:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbac8ba lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.834675:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbac8ba lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.834692:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbac8e4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.834697:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbac8e4 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00000100:00100000:3.0:1762166980.834701:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449777920:0@lo:2:osp-syn-1-1.0 00010000:00010000:2.0:1762166980.834705:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbac8e4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.834714:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdee00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166980.834719:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbac8e4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.834725:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbac8e4 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00010000:00010000:2.0:1762166980.834736:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166980.834739:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166980.834742:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbac8e4 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00000100:00100000:0.0:1762166980.834745:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449778048:0@lo:2:osp-syn-0-1.0 00010000:00010000:2.0:1762166980.834749:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbac8e4 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00000100:00100000:3.0:1762166980.834754:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1762166980.834760:0:7435:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 63 00000100:00100000:2.0:1762166980.834776:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449777920 00000100:00100000:2.0:1762166980.834782:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449777920 00000100:00100000:0.0:1762166980.834787:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166980.834790:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449778432:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1762166980.834827:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1762166980.834832:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166980.834835:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449778048 00000100:00100000:0.0:1762166980.834838:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449778176:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1762166980.834840:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449778048 00000100:00100000:3.0:1762166980.834853:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1762166980.834862:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5764a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449777792:0@lo:2:osp-syn-0-1.0 00000020:00080000:1.0:1762166980.834862:0:7435:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 63 cancel update log [0x240000400:0x2:0x0].62: rc = 0 00000100:00100000:2.0:1762166980.834865:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449778432 00000100:00100000:2.0:1762166980.834869:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449778432 00000100:00100000:0.0:1762166980.834874:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1762166980.834880:0:7435:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 63 00000100:00100000:3.0:1762166980.834898:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166980.834900:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449778176 00000100:00100000:2.0:1762166980.834903:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449778176 00000100:00100000:1.0:1762166980.834907:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449777792 00000100:00100000:1.0:1762166980.834913:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449777792 00000100:00100000:3.0:1762166980.834920:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4011180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449778304:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1762166980.834928:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19344 00000100:00100000:0.0:1762166980.834934:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19345 00000100:00100000:2.0:1762166980.834939:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+7:3636:x1847765449777920:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166980.834941:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166980.834948:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4012d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+11:3633:x1847765449778048:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1762166980.834955:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449778304 00000100:00100000:1.0:1762166980.834960:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449778304 00000100:00100000:1.0:1762166980.834981:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19346 00000100:00100000:3.0:1762166980.834988:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19347 00000100:00100000:1.0:1762166980.834993:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+7:3636:x1847765449778432:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166980.835002:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4012680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+7:3633:x1847765449778176:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:1.0:1762166980.835074:0:8382:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb size from disk: 163873 -> 163873 00002000:00010000:1.0:1762166980.835079:0:8382:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00002000:00010000:1.0:1762166980.835082:0:8382:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00002000:00010000:1.0:1762166980.835085:0:8382:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:1.0:1762166980.835088:0:8382:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb blocks from disk: 88 -> 88 00000100:00100000:2.0:1762166980.835100:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+10:3636:x1847765449777920:12345-0@lo:2:osp-syn-1-1.0 Request processed in 163us (346us total) trans 17179876670 rc 0/0 00000100:00100000:0.0:1762166980.835103:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4012d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+13:3633:x1847765449778048:12345-0@lo:2:osp-syn-0-1.0 Request processed in 157us (314us total) trans 21474843431 rc 0/0 00000100:00100000:3.0:1762166980.835108:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4012680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+10:3633:x1847765449778176:12345-0@lo:2:osp-syn-1-1.0 Request processed in 108us (236us total) trans 17179876672 rc 0/0 00000100:00100000:2.0:1762166980.835112:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19344 00000100:00100000:0.0:1762166980.835119:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19345 00000100:00100000:1.0:1762166980.835124:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+10:3636:x1847765449778432:12345-0@lo:2:osp-syn-1-1.0 Request processed in 135us (292us total) trans 17179876671 rc 0/0 00000100:00100000:3.0:1762166980.835130:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19347 00000100:00100000:1.0:1762166980.835138:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19346 00000100:00100000:0.0:1762166980.835145:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19348 00000100:00100000:2.0:1762166980.835153:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19349 00000100:00100000:0.0:1762166980.835158:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+12:3636:x1847765449777792:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1762166980.835164:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+12:3636:x1847765449778304:12345-0@lo:2:osp-syn-0-1.0 00000004:00010000:1.0:1762166980.835203:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000020c04e54 reply state 000000004fea499b transno 4294992454 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbac962 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.835218:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbac962 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00002000:00010000:0.0:1762166980.835220:0:28874:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166980.835227:0:28874:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb mtime from disk: 1762166966 -> 1762166966 00002000:00010000:2.0:1762166980.835229:0:35472:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb size from disk: 0 -> 0 00010000:00010000:1.0:1762166980.835232:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00002000:00010000:0.0:1762166980.835232:0:28874:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1762166980.835233:0:35472:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb mtime from disk: 1762166980 -> 1762166980 00002000:00010000:0.0:1762166980.835238:0:28874:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb ctime from disk: 1762166966 -> 1762166966 00002000:00010000:2.0:1762166980.835242:0:35472:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00010000:00010000:1.0:1762166980.835242:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00002000:00010000:0.0:1762166980.835242:0:28874:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1762166980.835248:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00002000:00010000:2.0:1762166980.835249:0:35472:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb ctime from disk: 1762166980 -> 1762166980 00002000:00010000:2.0:1762166980.835252:0:35472:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1762166980.835278:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+14:3636:x1847765449777792:12345-0@lo:2:osp-syn-0-1.0 Request processed in 124us (381us total) trans 21474843432 rc 0/0 00000100:00100000:0.0:1762166980.835285:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19348 00000100:00100000:2.0:1762166980.835290:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+14:3636:x1847765449778304:12345-0@lo:2:osp-syn-0-1.0 Request processed in 127us (345us total) trans 21474843433 rc 0/0 00000100:00100000:2.0:1762166980.835298:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19349 00010000:00080000:1.0:1762166980.835321:0:6494:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1762166980.835322:0:3633:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 17179876651 gen 2 00000004:00080000:0.0:1762166980.835329:0:3633:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 17179876647 committed transno 17179876651 00000100:00100000:1.0:1762166980.835335:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+526:61877:x1847765450683264:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 2688us (2873us total) trans 4294992454 rc 0/0 00000100:00100000:1.0:1762166980.835346:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30801 00010000:00010000:3.0:1762166980.835353:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbac962 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00000004:00080000:2.0:1762166980.835361:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc5764a80/2, rc 0, transno 21474843432 00000004:00080000:0.0:1762166980.835364:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc47b4700, transno 17179876648 00010000:00010000:3.0:1762166980.835365:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbac962 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00000100:00100000:2.0:1762166980.835370:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5764a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449777792:0@lo:2:osp-syn-0-1.0 00000004:00080000:0.0:1762166980.835378:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc47b7b80, transno 17179876649 00010000:00010000:3.0:1762166980.835382:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbac962 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00000004:00080000:0.0:1762166980.835384:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc47b4a80, transno 17179876650 00000004:00080000:2.0:1762166980.835390:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc4011180/2, rc 0, transno 21474843433 00000004:00080000:0.0:1762166980.835391:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc47b4380, transno 17179876651 00010000:00010000:3.0:1762166980.835393:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdf200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166980.835400:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbac962 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00000100:00100000:2.0:1762166980.835400:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4011180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449778304:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1762166980.835404:0:3633:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff945cf79ea300 x1847765449778176/t17179876672(17179876672) o2->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 440/432 e 0 to 0 dl 1762166996 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-1.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1762166980.835419:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbac962 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00000004:00080000:0.0:1762166980.835422:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf79ea300/2, rc 0, transno 17179876672 00000004:00080000:2.0:1762166980.835426:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf79e9180/2, rc 0, transno 17179876671 00000100:00100000:0.0:1762166980.835432:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449778176:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1762166980.835435:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449778432:0@lo:2:osp-syn-1-1.0 00010000:00010000:3.0:1762166980.835448:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00000004:00080000:2.0:1762166980.835451:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf79e9500/2, rc 0, transno 17179876670 00010000:00010000:3.0:1762166980.835453:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:2.0:1762166980.835456:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449777920:0@lo:2:osp-syn-1-1.0 00010000:00010000:3.0:1762166980.835459:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbac962 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00000004:00080000:0.0:1762166980.835463:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc5765500/2, rc 0, transno 21474843431 00010000:00010000:3.0:1762166980.835469:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbac962 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00000004:00080000:1.0:1762166980.835471:0:9994:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0001: 0 changes, 4 in progress, 0 in flight, 3 done 00000100:00100000:0.0:1762166980.835472:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449778048:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166980.836753:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.836972:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450683392 00000100:00100000:1.0:1762166980.836978:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450683392 00000100:00100000:1.0:1762166980.837016:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30802 00000100:00100000:1.0:1762166980.837026:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+525:61877:x1847765450683392:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166980.837042:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166980.837056:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbac969 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea79b expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.837096:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbac969 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea79b expref: 526 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.837109:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbac969 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea79b expref: 526 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.837125:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:1.0:1762166980.837128:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166980.837130:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355b000, rc 0) 00000100:00100000:1.0:1762166980.837169:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+526:61877:x1847765450683392:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 145us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166980.837177:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30802 00000100:00100000:2.0:1762166980.838966:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.839024:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450683520 00000100:00100000:1.0:1762166980.839031:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450683520 00000100:00100000:1.0:1762166980.839070:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30803 00000100:00100000:1.0:1762166980.839079:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+526:61877:x1847765450683520:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166980.839095:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166980.839109:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbac970 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea7a2 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.839179:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbac977 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166980.839190:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbac977 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.839199:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbac977 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:1.0:1762166980.839224:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 148474 00000004:00200000:1.0:1762166980.839228:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166980.839244:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbac977 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.839262:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbac970 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea7a2 expref: 528 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.839272:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbac977 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea7a2 expref: 527 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.839277:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:1.0:1762166980.839279:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166980.839281:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355aa00, rc 0) 00000100:00100000:1.0:1762166980.839321:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+527:61877:x1847765450683520:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 236us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166980.839331:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30803 00000100:00100000:0.0:1762166980.840909:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.840942:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.840971:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.840987:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450683648 00000100:00100000:1.0:1762166980.840994:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450683648 00000100:00100000:2.0:1762166980.841006:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450683776 00000100:00100000:2.0:1762166980.841012:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450683776 00000100:00100000:1.0:1762166980.841032:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450683904 00000100:00100000:1.0:1762166980.841036:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450683904 00000100:00100000:2.0:1762166980.841059:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19350 00000100:00100000:0.0:1762166980.841071:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19351 00000100:00100000:2.0:1762166980.841072:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4013b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450683648:12345-192.168.204.38@tcp:101:lfs.0 00000100:00100000:1.0:1762166980.841083:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19352 00010000:00010000:2.0:1762166980.841089:0:35247:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1762166980.841090:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4012300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450683776:12345-192.168.204.38@tcp:101:lfs.0 00000100:00100000:1.0:1762166980.841099:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4013100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450683904:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166980.841104:0:35248:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166980.841109:0:9165:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166980.841112:0:35247:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc56eb800/0x2f180c4effbac97e lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea7a9 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.841122:0:35248:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde800/0x2f180c4effbac985 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea7b0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.841126:0:9165:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cc355b200/0x2f180c4effbac98c lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea7b7 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166980.841147:0:35247:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa77:0x0] initial LVB size: 148474, mtime: 0x690888c5, atime: 0x690888c5, ctime: 0x690888c5, blocks: 0x100 00002000:00010000:0.0:1762166980.841154:0:35248:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa7a:0x0] initial LVB size: 0, mtime: 0x690888c5, atime: 0x690888c4, ctime: 0x690888c5, blocks: 0x1800 00002000:00010000:1.0:1762166980.841165:0:9165:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa79:0x0] initial LVB size: 0, mtime: 0x690888c5, atime: 0x690888c4, ctime: 0x690888c5, blocks: 0x0 00010000:00010000:2.0:1762166980.841176:0:35247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166980.841178:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166980.841180:0:35247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166980.841182:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166980.841183:0:35248:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166980.841187:0:35248:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166980.841193:0:35247:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc56eb800/0x2f180c4effbac97e lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea7a9 expref: 22 pid: 35247 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166980.841193:0:9165:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355b200/0x2f180c4effbac98c lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea7b7 expref: 22 pid: 9165 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166980.841195:0:35248:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde800/0x2f180c4effbac985 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea7b0 expref: 19 pid: 35248 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166980.841224:0:35247:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc56eb800/0x2f180c4effbac97e lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea7a9 expref: 22 pid: 35247 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166980.841226:0:9165:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945cc355b200/0x2f180c4effbac98c lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea7b7 expref: 22 pid: 9165 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166980.841228:0:35248:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde800/0x2f180c4effbac985 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea7b0 expref: 19 pid: 35248 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166980.841249:0:35247:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc56eb800, rc 0) 00010000:00010000:1.0:1762166980.841253:0:9165:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355b200, rc 0) 00010000:00010000:0.0:1762166980.841255:0:35248:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bde800, rc 0) 00000100:00100000:2.0:1762166980.841305:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4013b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450683648:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 232us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166980.841306:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4013100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450683904:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 209us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166980.841309:0:35248:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4012300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450683776:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 225us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166980.841327:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19350 00000100:00100000:0.0:1762166980.841335:0:35248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19351 00000100:00100000:1.0:1762166980.841345:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19352 00000100:00100000:3.0:1762166980.864897:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.864966:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450684032 00000100:00100000:2.0:1762166980.864976:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450684032 00000100:00100000:2.0:1762166980.865034:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19353 00000100:00100000:2.0:1762166980.865044:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+21:2416:x1847765450684032:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:2.0:1762166980.865144:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+21:2416:x1847765450684032:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 103us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166980.865150:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19353 00000100:00100000:3.0:1762166980.866374:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.866445:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450684160 00000100:00100000:2.0:1762166980.866459:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450684160 00000100:00100000:2.0:1762166980.866538:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19354 00000100:00100000:2.0:1762166980.866547:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+21:2417:x1847765450684160:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:2.0:1762166980.866649:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+21:2417:x1847765450684160:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 104us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166980.866656:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19354 00000100:00100000:0.0:1762166980.868061:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.868114:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450684288 00000100:00100000:1.0:1762166980.868119:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450684288 00000100:00100000:1.0:1762166980.868160:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2669 00000100:00100000:1.0:1762166980.868172:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+21:2416:x1847765450684288:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:1.0:1762166980.868210:0:23942:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945cc355bc00/0x2f180c4effbac993 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.868225:0:23942:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166980.868227:0:23942:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166980.868231:0:23942:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355bc00/0x2f180c4effbac993 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.868242:0:23942:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cc355bc00/0x2f180c4effbac993 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.868327:0:23942:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945cc355bc00/0x2f180c4effbac993 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.868336:0:23942:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355bc00/0x2f180c4effbac993 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.868343:0:23942:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945cc355bc00/0x2f180c4effbac993 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.868350:0:23942:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355bc00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166980.868354:0:23942:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc355bc00/0x2f180c4effbac993 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.868361:0:23942:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc355bc00/0x2f180c4effbac993 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.868376:0:23942:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945cc355bc00/0x2f180c4effbac993 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.868383:0:23942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cc355bc00/0x2f180c4effbac993 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166980.868433:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+21:2416:x1847765450684288:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 267us (377us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1762166980.868438:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2669 00000100:00100000:3.0:1762166980.870002:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.870044:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450684416 00000100:00100000:1.0:1762166980.870051:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450684416 00000100:00100000:1.0:1762166980.870092:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2670 00000100:00100000:1.0:1762166980.870099:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+21:2417:x1847765450684416:12345-192.168.204.38@tcp:4:lfs.0 00010000:00010000:1.0:1762166980.870116:0:23942:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945cc355a600/0x2f180c4effbac99a lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.870128:0:23942:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945cc355ba00/0x2f180c4effbac858 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea71d expref: 21 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166980.870134:0:23942:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166980.870136:0:23942:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166980.870139:0:23942:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355a600/0x2f180c4effbac99a lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.870167:0:23942:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945cc355ba00/0x2f180c4effbac858 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea71d expref: 21 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166980.870179:0:23942:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945cc355ba00/0x2f180c4effbac858 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea71d expref: 21 pid: 9168 timeout: 700 lvb_type: 1 00000100:00100000:1.0:1762166980.870192:0:23942:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79e8000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_009:lustre-OST0001_UUID:23942:1847765449778560:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166980.870261:0:23942:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc350f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166980.871019:0:23942:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79e8000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_009:lustre-OST0001_UUID:23942:1847765449778560:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166980.871036:0:23942:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945cc355a600/0x2f180c4effbac99a lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166980.871273:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.871317:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450684544 00000100:00100000:0.0:1762166980.871323:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450684544 00010000:00010000:0.0:1762166980.871354:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355ba00/0x2f180c4effbac858 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea71d expref: 22 pid: 9168 timeout: 700 lvb_type: 1 00000100:00100000:0.0:1762166980.871384:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9783 00000100:00100000:0.0:1762166980.871390:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b20e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450684544:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166980.871397:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166980.871411:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945cc355ba00/0x2f180c4effbac858 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea71d expref: 22 pid: 9168 timeout: 700 lvb_type: 1 00010000:00010000:0.0:1762166980.871422:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945cc355ba00/0x2f180c4effbac858 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea71d expref: 22 pid: 9168 timeout: 700 lvb_type: 1 00010000:00010000:0.0:1762166980.871440:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cc355ba00/0x2f180c4effbac858 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea71d expref: 22 pid: 9168 timeout: 700 lvb_type: 1 00010000:00010000:0.0:1762166980.871450:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166980.871452:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166980.871455:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945cc355a600/0x2f180c4effbac99a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.871463:0:7421:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355a600/0x2f180c4effbac99a lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.871507:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166980.871538:0:23942:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945cc355a600/0x2f180c4effbac99a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.871551:0:23942:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cc355a600/0x2f180c4effbac99a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166980.871557:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b20e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450684544:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 160us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166980.871567:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9783 00000001:00080000:2.0:1762166980.872634:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876673 is committed 00000001:00080000:2.0:1762166980.872645:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876672 is committed 00002000:00010000:1.0:1762166980.872731:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb mtime from disk: 1762166980 -> 1762166981 00002000:00010000:1.0:1762166980.872735:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb ctime from disk: 1762166980 -> 1762166981 00010000:00010000:1.0:1762166980.872744:0:23942:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945cc355a600/0x2f180c4effbac99a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.872752:0:23942:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355a600/0x2f180c4effbac99a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.872757:0:23942:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945cc355a600/0x2f180c4effbac99a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.872762:0:23942:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355a600 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166980.872764:0:23942:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc355a600/0x2f180c4effbac99a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.872770:0:23942:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc355a600/0x2f180c4effbac99a lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.872781:0:23942:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945cc355a600/0x2f180c4effbac99a lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.872787:0:23942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cc355a600/0x2f180c4effbac99a lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166980.872857:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+16:2417:x1847765450684416:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 2757us (2860us total) trans 17179876673 rc 0/0 00000100:00100000:1.0:1762166980.872864:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2670 00000100:00100000:3.0:1762166980.874150:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.874200:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450684672 00000100:00100000:2.0:1762166980.874204:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450684672 00000100:00100000:2.0:1762166980.874238:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19355 00000100:00100000:2.0:1762166980.874247:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+16:2417:x1847765450684672:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:2.0:1762166980.874328:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+16:2417:x1847765450684672:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 82us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166980.874338:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19355 00000100:00100000:3.0:1762166980.875507:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.875558:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450684928 00000100:00100000:1.0:1762166980.875570:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450684928 00000100:00100000:1.0:1762166980.875637:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30804 00000100:00100000:1.0:1762166980.875645:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+527:61877:x1847765450684928:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:1.0:1762166980.875698:0:6494:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166980.875719:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbac977 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea7a2 expref: 527 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.875734:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:1.0:1762166980.875739:0:6494:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166980.875943:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbac9a1 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166980.875958:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbac9a1 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.875968:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbac9a1 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000001:00080000:1.0:1762166980.876017:0:6494:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992455 00000004:00010000:1.0:1762166980.876036:0:6494:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000e42bcd40 reply state 00000000958d88bf transno 4294992456 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbac9a1 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.876049:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbac9a1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.876053:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:1.0:1762166980.876056:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166980.876057:0:6494:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166980.876122:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+529:61877:x1847765450684928:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 478us (621us total) trans 4294992456 rc 0/0 00000100:00100000:1.0:1762166980.876128:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30804 00000020:00080000:1.0:1762166980.876133:0:6494:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1762166980.876780:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.876810:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450685056 00000100:00100000:2.0:1762166980.876824:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450685056 00000100:00100000:2.0:1762166980.876848:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19356 00000100:00100000:2.0:1762166980.876853:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+16:61877:x1847765450685056:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166980.876861:0:9165:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166980.876873:0:9165:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc56eb000/0x2f180c4effbac9a8 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea7be expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166980.876886:0:9165:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa90:0x0] initial LVB size: 163873, mtime: 0x690888c5, atime: 0x690888c4, ctime: 0x690888c5, blocks: 0x58 00010000:00010000:2.0:1762166980.876895:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166980.876897:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166980.876900:0:9165:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc56eb000/0x2f180c4effbac9a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea7be expref: 17 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.876909:0:9165:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc56eb000/0x2f180c4effbac9a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea7be expref: 17 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.876920:0:9165:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc56eb000, rc 0) 00000100:00100000:2.0:1762166980.876946:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+17:61877:x1847765450685056:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 92us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166980.876953:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19356 00000100:00100000:3.0:1762166980.877630:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.877659:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450685184 00000100:00100000:2.0:1762166980.877663:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450685184 00000100:00100000:2.0:1762166980.877685:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19357 00000100:00100000:2.0:1762166980.877691:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+19:61877:x1847765450685184:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166980.877698:0:9165:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166980.877706:0:9165:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc56eae00/0x2f180c4effbac9af lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa91:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea7c5 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.877718:0:9165:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945cc7d17000/0x2f180c4effbac778 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa91:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6ec expref: 20 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.877723:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166980.877724:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166980.877727:0:9165:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc56eae00/0x2f180c4effbac9af lrc: 4/0,0 mode: --/PW res: [0x280000400:0xa91:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea7c5 expref: 20 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.877744:0:9165:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945cc7d17000/0x2f180c4effbac778 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa91:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6ec expref: 20 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.877751:0:9165:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945cc7d17000/0x2f180c4effbac778 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa91:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6ec expref: 20 pid: 35472 timeout: 700 lvb_type: 0 00000100:00100000:2.0:1762166980.877763:0:9165:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a28700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9165:1847765449778688:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166980.877806:0:9165:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a1c00 going to sleep for 11 seconds 00000100:00100000:2.0:1762166980.878571:0:9165:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a28700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9165:1847765449778688:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166980.878585:0:9165:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc56eae00/0x2f180c4effbac9af lrc: 3/0,0 mode: --/PW res: [0x280000400:0xa91:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea7c5 expref: 20 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.878597:0:9165:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc56eae00, rc 0) 00000100:00100000:2.0:1762166980.878635:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+20:61877:x1847765450685184:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 943us (1004us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166980.878642:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19357 00000100:00100000:3.0:1762166980.878705:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.878771:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450685312 00000100:00100000:1.0:1762166980.878778:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450685312 00010000:00010000:1.0:1762166980.878806:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945cc7d17000/0x2f180c4effbac778 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa91:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6ec expref: 20 pid: 35472 timeout: 700 lvb_type: 0 00000100:00100000:1.0:1762166980.878849:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9784 00000100:00100000:1.0:1762166980.878863:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450685312:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166980.878876:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166980.878893:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945cc7d17000/0x2f180c4effbac778 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa91:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6ec expref: 20 pid: 35472 timeout: 700 lvb_type: 0 00010000:00010000:1.0:1762166980.878907:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945cc7d17000/0x2f180c4effbac778 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa91:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6ec expref: 20 pid: 35472 timeout: 700 lvb_type: 0 00010000:00010000:1.0:1762166980.878942:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cc7d17000/0x2f180c4effbac778 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa91:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea6ec expref: 20 pid: 35472 timeout: 700 lvb_type: 0 00010000:00010000:1.0:1762166980.878963:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166980.878966:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166980.878971:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc56eae00/0x2f180c4effbac9af lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa91:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea7c5 expref: 19 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.878981:0:7421:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc56eae00/0x2f180c4effbac9af lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa91:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea7c5 expref: 19 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.879014:0:7421:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff945bc56eae00/0x2f180c4effbac9af lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa91:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea7c5 expref: 19 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166980.879028:0:7421:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79e8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7421:1847765449778816:192.168.204.38@tcp:105: 00000100:00100000:1.0:1762166980.879090:0:7421:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc350f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166980.879875:0:7421:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79e8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7421:1847765449778816:192.168.204.38@tcp:105: 00010000:00010000:1.0:1762166980.879897:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166980.879926:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450685312:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1070us (1227us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166980.879933:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9784 00000100:00100000:3.0:1762166980.880222:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.880250:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.880265:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450685440 00000100:00100000:1.0:1762166980.880271:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450685440 00000100:00100000:0.0:1762166980.880284:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450685568 00000100:00100000:0.0:1762166980.880289:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450685568 00002000:00010000:1.0:1762166980.880291:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2704 (4096->18446744073709551615) 00002000:00100000:1.0:1762166980.880295:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1cd0e00 with x1847765450685440 ext(4096->18446744073709551615) 00002000:00010000:1.0:1762166980.880300:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1cd0e00. 00002000:00010000:0.0:1762166980.880305:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2705 (0->18446744073709551615) 00002000:00100000:0.0:1762166980.880310:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bcce76a00 with x1847765450685568 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166980.880316:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bcce76a00. 00000100:00100000:1.0:1762166980.880323:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2671 00000100:00100000:1.0:1762166980.880331:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450685440:12345-192.168.204.38@tcp:10:lfs.0 00000100:00100000:0.0:1762166980.880340:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2672 00000100:00100000:0.0:1762166980.880350:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450685568:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:0.0:1762166980.880458:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166980.880460:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb mtime from disk: 1762166980 -> 1762166981 00002000:00010000:0.0:1762166980.880462:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00002000:00010000:0.0:1762166980.880464:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb ctime from disk: 1762166980 -> 1762166981 00002000:00010000:0.0:1762166980.880465:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1762166980.880519:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450685568:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 170us (266us total) trans 21474843434 rc 0/0 00000100:00100000:0.0:1762166980.880527:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2672 00002000:00010000:0.0:1762166980.880530:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2705 (0->18446744073709551615) 00002000:00100000:0.0:1762166980.880533:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bcce76a00 with x1847765450685568 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166980.880538:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bcce76a00. 00002000:00010000:1.0:1762166980.880598:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb size from disk: 163873 -> 4096 00002000:00010000:1.0:1762166980.880602:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00010000:1.0:1762166980.880605:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00002000:00010000:1.0:1762166980.880611:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00002000:00010000:1.0:1762166980.880613:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb blocks from disk: 88 -> 8 00000100:00100000:1.0:1762166980.880651:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450685440:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 320us (428us total) trans 17179876674 rc 0/0 00000100:00100000:1.0:1762166980.880659:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2671 00002000:00010000:1.0:1762166980.880662:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2704 (4096->18446744073709551615) 00002000:00100000:1.0:1762166980.880665:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1cd0e00 with x1847765450685440 ext(4096->18446744073709551615) 00002000:00010000:1.0:1762166980.880671:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1cd0e00. 00000100:00100000:3.0:1762166980.881631:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.881662:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450685696 00000100:00100000:1.0:1762166980.881666:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450685696 00000100:00100000:1.0:1762166980.881692:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30805 00000100:00100000:1.0:1762166980.881697:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+529:61877:x1847765450685696:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166980.881708:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166980.881719:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbac9b6 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea7cc expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.881792:0:6494:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbac9bd lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 00010000:00010000:1.0:1762166980.881804:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbac9bd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.881827:0:6494:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbac9bd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00000004:00200000:1.0:1762166980.881855:0:6494:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 4096 00000004:00200000:1.0:1762166980.881859:0:6494:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166980.881873:0:6494:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbac9bd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 00010000:00010000:1.0:1762166980.881895:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbac9b6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea7cc expref: 531 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.881908:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbac9bd lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea7cc expref: 530 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.881916:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:1.0:1762166980.881919:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166980.881921:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355ae00, rc 0) 00000100:00100000:1.0:1762166980.881950:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e1e11365-ba0b-405b-99c9-a704373217f2+530:61877:x1847765450685696:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 252us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166980.881957:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30805 00000100:00100000:3.0:1762166980.882605:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcce75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765449779200:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1762166980.882617:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1e6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765449778944:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1762166980.882630:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf79e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765449779072:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1762166980.882660:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166980.882670:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166980.882696:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449779200 00000100:00100000:1.0:1762166980.882701:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449779200 00000100:00100000:0.0:1762166980.882717:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449779456:0@lo:400:kworker.0 00000100:00100000:3.0:1762166980.882728:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449779712:0@lo:400:kworker.0 00000100:00100000:1.0:1762166980.882743:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1465 00000100:00100000:1.0:1762166980.882754:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1847765449779200:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1762166980.882757:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166980.882776:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:1.0:1762166980.882785:0:7427:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445224448 avail 1298984960 00000100:00100000:0.0:1762166980.882797:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3633:1847765449779968:0@lo:400:kworker.0 00000100:00100000:3.0:1762166980.882832:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3635:1847765449780224:0@lo:400:kworker.0 00000100:00100000:1.0:1762166980.882843:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1847765449779200:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166980.882853:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1465 00000100:00100000:0.0:1762166980.882860:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166980.882864:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449779712 00000100:00100000:2.0:1762166980.882873:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449779712 00000100:00100000:1.0:1762166980.882874:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449779456 00000100:00100000:3.0:1762166980.882877:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5309af7-bf8a-40d1-8f22-842c4953c1ea:3636:1847765449779328:0@lo:400:kworker.0 00000100:00100000:1.0:1762166980.882881:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449779456 00000100:00100000:0.0:1762166980.882892:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765449780480:0@lo:400:kworker.0 00000100:00100000:3.0:1762166980.882921:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166980.882927:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1466 00000100:00100000:0.0:1762166980.882927:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166980.882937:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3633:x1847765449779456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1762166980.882944:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449780480 00000100:00100000:2.0:1762166980.882950:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449780480 00000100:00100000:3.0:1762166980.882978:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449779840:0@lo:400:kworker.0 00000100:00100000:1.0:1762166980.882981:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3633:x1847765449779456:12345-0@lo:400:kworker.0 Request processed in 47us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166980.882989:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449779456:0@lo:400:kworker.0 00000100:00100000:1.0:1762166980.882991:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1466 00000100:00100000:2.0:1762166980.882996:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:2.0:1762166980.883006:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+13:3635:x1847765449779712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1762166980.883012:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1762166980.883024:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3633:1847765449779584:0@lo:400:kworker.0 00000100:00100000:1.0:1762166980.883025:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166980.883064:0:8384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449778944 00000100:00100000:1.0:1762166980.883069:0:8384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449778944 00000100:00100000:0.0:1762166980.883080:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166980.883081:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166980.883092:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+13:3635:x1847765449779712:12345-0@lo:400:kworker.0 Request processed in 85us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166980.883104:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:1.0:1762166980.883108:0:8384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449779072 00000100:00100000:0.0:1762166980.883111:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1847765449780096:0@lo:400:kworker.0 00000100:00100000:1.0:1762166980.883114:0:8384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449779072 00000100:00100000:3.0:1762166980.883121:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1847765449780352:0@lo:400:kworker.0 00000100:00100000:2.0:1762166980.883129:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449779840 00000100:00100000:2.0:1762166980.883134:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449779840 00000100:00100000:1.0:1762166980.883144:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1762166980.883144:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166980.883156:0:8384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1847765449778944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1762166980.883173:0:8384:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 484840768 pending 0 free 3921125376 avail 3689574400 00000100:00100000:2.0:1762166980.883174:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:3.0:1762166980.883183:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166980.883191:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3633:1847765449780608:0@lo:400:kworker.0 00000100:00100000:2.0:1762166980.883195:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3633:x1847765449780480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1762166980.883213:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1762166980.883222:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449780736:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1762166980.883232:0:8384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3633:x1847765449778944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166980.883245:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1762166980.883252:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166980.883266:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166980.883274:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3633:x1847765449780480:12345-0@lo:400:kworker.0 Request processed in 79us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166980.883274:0:8384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1762166980.883291:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765449780480:0@lo:400:kworker.0 00000100:00100000:2.0:1762166980.883299:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:1.0:1762166980.883300:0:8384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3634:x1847765449779072:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1762166980.883308:0:32222:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449779328 00000100:00100000:3.0:1762166980.883314:0:32222:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449779328 00000100:00100000:0.0:1762166980.883324:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1e6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765449778944:0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1762166980.883325:0:8384:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 73728 granted 484914496 pending 0 free 3918143488 avail 3686621184 00000100:00100000:2.0:1762166980.883335:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:2.0:1762166980.883347:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1847765449779840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1762166980.883372:0:32222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1762166980.883379:0:8384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1847765449779072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166980.883386:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449780736 00000100:00100000:3.0:1762166980.883388:0:32222:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc34e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+23:3636:x1847765449779328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1762166980.883388:0:8384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1762166980.883389:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449780736 00000100:00100000:2.0:1762166980.883405:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1847765449779840:12345-0@lo:400:kworker.0 Request processed in 59us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166980.883414:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:0.0:1762166980.883424:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1467 00000100:00100000:0.0:1762166980.883438:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3636:x1847765449780736:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1762166980.883444:0:32222:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc34e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5309af7-bf8a-40d1-8f22-842c4953c1ea+23:3636:x1847765449779328:12345-0@lo:400:kworker.0 Request processed in 62us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166980.883454:0:32222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000004:00000024:0.0:1762166980.883458:0:6499:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445859328 avail 1299619840 00000100:00100000:2.0:1762166980.883463:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449779968 00000100:00100000:2.0:1762166980.883472:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449779968 00000100:00100000:3.0:1762166980.883514:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449779584 00000100:00100000:1.0:1762166980.883514:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf79e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765449779072:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1762166980.883519:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449779584 00000100:00100000:0.0:1762166980.883521:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3636:x1847765449780736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166980.883530:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1467 00000100:00080000:0.0:1762166980.883562:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1762166980.883570:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1762166980.883571:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449780096 00000100:00100000:1.0:1762166980.883576:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449780096 00000100:00080000:0.0:1762166980.883578:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1762166980.883580:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449780352 00000100:00100000:3.0:1762166980.883582:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449780608 00000100:00100000:2.0:1762166980.883587:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449780352 00000100:00100000:3.0:1762166980.883589:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449780608 00000100:00100000:1.0:1762166980.883595:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 663 00000100:00100000:0.0:1762166980.883602:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 664 00000100:00100000:1.0:1762166980.883606:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1847765449779968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1762166980.883617:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1847765449779584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1762166980.883623:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 665 00000100:00100000:2.0:1762166980.883635:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 666 00000100:00100000:3.0:1762166980.883638:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1847765449780608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1762166980.883653:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1847765449780352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1762166980.883662:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1847765449779968:12345-0@lo:400:kworker.0 Request processed in 53us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166980.883662:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1847765449779584:12345-0@lo:400:kworker.0 Request processed in 49us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166980.883681:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 663 00000100:00100000:3.0:1762166980.883686:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1847765449780608:12345-0@lo:400:kworker.0 Request processed in 48us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166980.883687:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 664 00000100:00100000:3.0:1762166980.883700:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 665 00000100:00080000:0.0:1762166980.883720:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1762166980.883736:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1847765449780352:12345-0@lo:400:kworker.0 Request processed in 88us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166980.883738:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 667 00000100:00100000:2.0:1762166980.883757:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 666 00000100:00100000:3.0:1762166980.883768:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1847765449780096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1762166980.883772:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166980.883791:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449780224 00000100:00100000:2.0:1762166980.883798:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449780224 00000100:00100000:1.0:1762166980.883803:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3633:1847765449779584:0@lo:400:kworker.0 00000100:00100000:0.0:1762166980.883828:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449779712:0@lo:400:kworker.0 00000100:00100000:1.0:1762166980.883840:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3633:1847765449780608:0@lo:400:kworker.0 00000100:00100000:0.0:1762166980.883842:0:3635:0:(client.c:3071:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294992083 gen 2 00000004:00080000:0.0:1762166980.883847:0:3635:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294992083 committed transno 4294992083 00000100:00100000:3.0:1762166980.883852:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1847765449780096:12345-0@lo:400:kworker.0 Request processed in 94us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166980.883866:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 668 00000100:00100000:1.0:1762166980.883867:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3633:1847765449779968:0@lo:400:kworker.0 00000100:00100000:3.0:1762166980.883876:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 667 00000100:00100000:2.0:1762166980.883880:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1847765449780224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1762166980.883887:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcce75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765449779200:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1762166980.883898:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1847765449780096:0@lo:400:kworker.0 00000100:00100000:2.0:1762166980.883932:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1847765449780224:12345-0@lo:400:kworker.0 Request processed in 59us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166980.883938:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3635:1847765449780224:0@lo:400:kworker.0 00000100:00080000:1.0:1762166980.883943:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1762166980.883945:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 668 00000100:00100000:3.0:1762166980.883977:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449780736:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1762166980.883984:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5309af7-bf8a-40d1-8f22-842c4953c1ea:3636:1847765449779328:0@lo:400:kworker.0 00000100:00100000:3.0:1762166980.883992:0:3636:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 17179876672 gen 2 00000004:00080000:3.0:1762166980.883995:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf79e9500, transno 17179876670 00000004:00080000:3.0:1762166980.884001:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf79e9180, transno 17179876671 00000004:00080000:3.0:1762166980.884003:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf79ea300, transno 17179876672 00000100:00100000:3.0:1762166980.884006:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449779840:0@lo:400:kworker.0 00000100:00100000:3.0:1762166980.884015:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1847765449780352:0@lo:400:kworker.0 00000100:00100000:0.0:1762166980.884038:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.884085:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450685952 00000004:00080000:1.0:1762166980.884088:0:9994:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0001: 0 changes, 0 in progress, 0 in flight, 3 done 00000100:00100000:2.0:1762166980.884092:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450685952 00000100:00100000:2.0:1762166980.884137:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30806 00000100:00100000:2.0:1762166980.884147:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+530:61877:x1847765450685952:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:2.0:1762166980.884193:0:30829:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166980.884212:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ae00/0x2f180c4effbac9bd lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea7cc expref: 530 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.884225:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166980.884229:0:30829:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166980.884399:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4410c00/0x2f180c4effbac9c4 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166980.884411:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4410c00/0x2f180c4effbac9c4 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166980.884421:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4410c00/0x2f180c4effbac9c4 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000001:00080000:2.0:1762166980.884467:0:30829:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992457 00000004:00010000:2.0:1762166980.884537:0:30829:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000ac602ea8 reply state 000000000b0ef928 transno 4294992458 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4410c00/0x2f180c4effbac9c4 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166980.884550:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4410c00/0x2f180c4effbac9c4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166980.884557:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166980.884560:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166980.884562:0:30829:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166980.884639:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+532:61877:x1847765450685952:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 494us (602us total) trans 4294992458 rc 0/0 00000100:00100000:2.0:1762166980.884647:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30806 00000020:00080000:2.0:1762166980.884651:0:30829:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1762166980.885633:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.885667:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450686080 00000100:00100000:1.0:1762166980.885674:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450686080 00002000:00010000:1.0:1762166980.885694:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2704 (148474->18446744073709551615) 00002000:00100000:1.0:1762166980.885698:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc7d20380 with x1847765450686080 ext(148474->18446744073709551615) 00002000:00010000:1.0:1762166980.885706:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc7d20380. 00000100:00100000:3.0:1762166980.885716:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.885776:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450686208 00000100:00100000:1.0:1762166980.885782:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450686208 00000100:00100000:0.0:1762166980.885793:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2673 00002000:00010000:1.0:1762166980.885798:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2705 (0->18446744073709551615) 00002000:00100000:1.0:1762166980.885804:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc7d20000 with x1847765450686208 ext(0->18446744073709551615) 00000100:00100000:0.0:1762166980.885808:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450686080:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:1.0:1762166980.885812:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc7d20000. 00000100:00100000:1.0:1762166980.885849:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2674 00000100:00100000:1.0:1762166980.885859:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450686208:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:1.0:1762166980.885959:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166980.885959:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb size from disk: 4096 -> 148474 00002000:00010000:0.0:1762166980.885964:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00010000:1.0:1762166980.885966:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00010000:0.0:1762166980.885967:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00002000:00010000:1.0:1762166980.885973:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00002000:00010000:0.0:1762166980.885974:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00002000:00010000:0.0:1762166980.885981:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb blocks from disk: 8 -> 8 00002000:00010000:1.0:1762166980.885982:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00002000:00010000:1.0:1762166980.885988:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1762166980.886020:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450686080:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 219us (389us total) trans 17179876675 rc 0/0 00000100:00100000:1.0:1762166980.886023:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450686208:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 164us (304us total) trans 21474843435 rc 0/0 00000100:00100000:0.0:1762166980.886031:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2673 00002000:00010000:0.0:1762166980.886035:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2704 (148474->18446744073709551615) 00002000:00100000:0.0:1762166980.886039:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc7d20380 with x1847765450686080 ext(148474->18446744073709551615) 00000100:00100000:1.0:1762166980.886040:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2674 00002000:00010000:0.0:1762166980.886044:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc7d20380. 00002000:00010000:1.0:1762166980.886046:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2705 (0->18446744073709551615) 00002000:00100000:1.0:1762166980.886051:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc7d20000 with x1847765450686208 ext(0->18446744073709551615) 00002000:00010000:1.0:1762166980.886058:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc7d20000. 00000100:00100000:3.0:1762166980.892185:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.892239:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450686336 00000100:00100000:2.0:1762166980.892251:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450686336 00000100:00100000:2.0:1762166980.892324:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30807 00000100:00100000:2.0:1762166980.892338:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+532:61877:x1847765450686336:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166980.892368:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166980.892391:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc98f5200/0x2f180c4effbac9cb lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea7d3 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.892524:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc98f4800/0x2f180c4effbac9d2 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166980.892539:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc98f4800/0x2f180c4effbac9d2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166980.892549:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc98f4800/0x2f180c4effbac9d2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000004:00200000:2.0:1762166980.892576:0:30829:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 148474 00000004:00200000:2.0:1762166980.892580:0:30829:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166980.892601:0:30829:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc98f4800/0x2f180c4effbac9d2 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166980.892628:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc98f5200/0x2f180c4effbac9cb lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea7d3 expref: 534 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.892645:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc98f4800/0x2f180c4effbac9d2 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea7d3 expref: 533 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.892652:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166980.892654:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166980.892657:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc98f4800, rc 0) 00000100:00100000:2.0:1762166980.892711:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+533:61877:x1847765450686336:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 379us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166980.892719:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30807 00000100:00100000:2.0:1762166980.893894:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.893948:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450686592 00000100:00100000:1.0:1762166980.893958:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450686592 00000100:00100000:1.0:1762166980.894009:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30808 00000100:00100000:1.0:1762166980.894019:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+533:61877:x1847765450686592:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:1.0:1762166980.894061:0:30829:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166980.894080:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc98f4800/0x2f180c4effbac9d2 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea7d3 expref: 533 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.894093:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:1.0:1762166980.894096:0:30829:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166980.894249:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbac9d9 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:1.0:1762166980.894260:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbac9d9 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166980.894269:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbac9d9 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000001:00080000:1.0:1762166980.894305:0:30829:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992459 00000004:00010000:1.0:1762166980.894321:0:30829:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000cfae6173 reply state 00000000c65f5e51 transno 4294992460 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbac9d9 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166980.894329:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbac9d9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166980.894333:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:1.0:1762166980.894334:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166980.894336:0:30829:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166980.894396:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+535:61877:x1847765450686592:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 379us (503us total) trans 4294992460 rc 0/0 00000100:00100000:1.0:1762166980.894402:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30808 00000020:00080000:1.0:1762166980.894407:0:30829:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1762166980.895391:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.895427:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450686720 00000100:00100000:1.0:1762166980.895432:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450686720 00002000:00010000:1.0:1762166980.895449:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2704 (148474->18446744073709551615) 00002000:00100000:1.0:1762166980.895452:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc7d20700 with x1847765450686720 ext(148474->18446744073709551615) 00002000:00010000:1.0:1762166980.895460:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc7d20700. 00000100:00100000:1.0:1762166980.895509:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2675 00000100:00100000:1.0:1762166980.895521:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450686720:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:1.0:1762166980.895615:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb size from disk: 148474 -> 148474 00002000:00010000:1.0:1762166980.895619:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00010000:1.0:1762166980.895622:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00002000:00010000:1.0:1762166980.895625:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00002000:00010000:1.0:1762166980.895627:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1762166980.895657:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.895665:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450686720:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 144us (272us total) trans 17179876676 rc 0/0 00000100:00100000:1.0:1762166980.895672:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2675 00002000:00010000:1.0:1762166980.895675:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2704 (148474->18446744073709551615) 00002000:00100000:1.0:1762166980.895677:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc7d20700 with x1847765450686720 ext(148474->18446744073709551615) 00002000:00010000:1.0:1762166980.895681:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc7d20700. 00000100:00100000:1.0:1762166980.895695:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450686848 00000100:00100000:1.0:1762166980.895697:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450686848 00002000:00010000:1.0:1762166980.895710:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2705 (0->18446744073709551615) 00002000:00100000:1.0:1762166980.895713:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4a2b480 with x1847765450686848 ext(0->18446744073709551615) 00002000:00010000:1.0:1762166980.895718:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc4a2b480. 00000100:00100000:1.0:1762166980.895739:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2676 00000100:00100000:1.0:1762166980.895755:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450686848:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:1.0:1762166980.895808:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166980.895811:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00010000:1.0:1762166980.895824:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00002000:00010000:1.0:1762166980.895826:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00002000:00010000:1.0:1762166980.895828:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1762166980.895852:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450686848:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 106us (199us total) trans 21474843436 rc 0/0 00000100:00100000:1.0:1762166980.895857:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2676 00002000:00010000:1.0:1762166980.895859:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2705 (0->18446744073709551615) 00002000:00100000:1.0:1762166980.895861:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4a2b480 with x1847765450686848 ext(0->18446744073709551615) 00002000:00010000:1.0:1762166980.895864:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc4a2b480. 00000100:00100000:2.0:1762166980.896871:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.896906:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450687104 00000100:00100000:1.0:1762166980.896912:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450687104 00000100:00100000:1.0:1762166980.896949:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30809 00000100:00100000:1.0:1762166980.896956:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+535:61877:x1847765450687104:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:1.0:1762166980.896997:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbac9e0 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:1.0:1762166980.897008:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbac9e0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166980.897016:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbac9e0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000004:00010000:1.0:1762166980.897066:0:30829:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000000549eee reply state 000000007d6bfc31 transno 4294992461 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbac9e0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166980.897074:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbac9e0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166980.897081:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:1.0:1762166980.897083:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166980.897086:0:30829:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166980.897134:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+537:61877:x1847765450687104:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 178us (265us total) trans 4294992461 rc 0/0 00000100:00100000:1.0:1762166980.897138:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30809 00000100:00100000:3.0:1762166980.897853:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.897904:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450687232 00000100:00100000:0.0:1762166980.897911:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450687232 00000100:00100000:0.0:1762166980.897957:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19358 00000100:00100000:0.0:1762166980.897968:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450687232:12345-192.168.204.38@tcp:2:lfs.0 00000100:00100000:3.0:1762166980.897978:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.898067:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450687360 00000100:00100000:1.0:1762166980.898075:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450687360 00002000:00010000:0.0:1762166980.898094:0:35472:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 148474 -> 148474 00002000:00010000:0.0:1762166980.898107:0:35472:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00000100:00100000:3.0:1762166980.898109:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00002000:00010000:0.0:1762166980.898119:0:35472:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166981 -> 1762166981 00000100:00100000:1.0:1762166980.898122:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450687488 00002000:00010000:0.0:1762166980.898122:0:35472:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00002000:00010000:0.0:1762166980.898130:0:35472:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 256 -> 256 00000100:00100000:1.0:1762166980.898134:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450687488 00000100:00100000:2.0:1762166980.898164:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19359 00000100:00100000:2.0:1762166980.898177:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765450687360:12345-192.168.204.38@tcp:2:lfs.0 00000100:00100000:3.0:1762166980.898184:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19360 00000100:00100000:3.0:1762166980.898200:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3d59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450687488:12345-192.168.204.38@tcp:2:lfs.0 00000100:00100000:0.0:1762166980.898210:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450687232:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 236us (347us total) trans 17179876677 rc 0/0 00000100:00100000:0.0:1762166980.898222:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19358 00002000:00010000:2.0:1762166980.898267:0:8380:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166980.898271:0:8380:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00010000:2.0:1762166980.898273:0:8380:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166980 -> 1762166981 00002000:00010000:2.0:1762166980.898275:0:8380:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00002000:00010000:2.0:1762166980.898277:0:8380:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00002000:00010000:3.0:1762166980.898300:0:35247:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166980.898305:0:35247:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00010000:3.0:1762166980.898308:0:35247:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166980 -> 1762166981 00002000:00010000:3.0:1762166980.898311:0:35247:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00002000:00010000:3.0:1762166980.898314:0:35247:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1762166980.898317:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765450687360:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 144us (354us total) trans 21474843437 rc 0/0 00000100:00100000:2.0:1762166980.898330:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19359 00000100:00100000:3.0:1762166980.898417:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3d59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450687488:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 224us (322us total) trans 17179876678 rc 0/0 00000100:00100000:3.0:1762166980.898424:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19360 00000100:00100000:1.0:1762166980.899403:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.899452:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450687744 00000100:00100000:0.0:1762166980.899459:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450687744 00000100:00100000:0.0:1762166980.899529:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11967 00000100:00100000:0.0:1762166980.899539:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+537:61877:x1847765450687744:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:0.0:1762166980.899578:0:19593:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x240000404:0x5eb:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbac93f lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea794 expref: 537 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.899610:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac9e7 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166980.899620:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbac969 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea79b expref: 537 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.899626:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac9e7 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166980.899655:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbac969 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea79b expref: 537 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.899665:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbac969 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea79b expref: 537 pid: 6494 timeout: 700 lvb_type: 0 00000100:00100000:0.0:1762166980.899677:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf3db5500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449780864:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166980.899768:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cff1fa300 going to sleep for 11 seconds 00000100:00100000:3.0:1762166980.900613:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3db5500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449780864:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166980.900631:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac9e7 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:1.0:1762166980.900666:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.900712:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450687872 00000100:00100000:0.0:1762166980.900717:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450687872 00010000:00010000:0.0:1762166980.900735:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbac969 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea79b expref: 538 pid: 6494 timeout: 700 lvb_type: 0 00000100:00100000:0.0:1762166980.900758:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9785 00000100:00100000:0.0:1762166980.900763:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+538:2418:x1847765450687872:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166980.900772:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166980.900777:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbac969 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea79b expref: 538 pid: 6494 timeout: 700 lvb_type: 0 00010000:00010000:0.0:1762166980.900786:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbac969 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea79b expref: 538 pid: 6494 timeout: 700 lvb_type: 0 00010000:00010000:0.0:1762166980.900800:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b000/0x2f180c4effbac969 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea79b expref: 538 pid: 6494 timeout: 700 lvb_type: 0 00010000:00010000:0.0:1762166980.900811:0:7421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:0.0:1762166980.900827:0:7421:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac9e7 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166980.900833:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac9e7 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166980.900837:0:7421:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac9e7 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166980.900855:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166980.900880:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+537:2418:x1847765450687872:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 115us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166980.900886:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9785 00010000:00010000:3.0:1762166980.900887:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac9e7 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166980.900896:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac9e7 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000040:00080000:3.0:1762166980.901160:0:19593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5937, 88 off465112 00000004:00080000:3.0:1762166980.901168:0:19593:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 600049689977ns, next at 600144491692ns, rc = 0 00000040:00080000:3.0:1762166980.901212:0:19593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5936, 88 off465112 00000004:00080000:3.0:1762166980.901217:0:19593:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 600049739465ns, next at 600144525370ns, rc = 0 00000040:00080000:3.0:1762166980.901237:0:19593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5937, 88 off465200 00000004:00080000:3.0:1762166980.901240:0:19593:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 600049763037ns, next at 600144525370ns, rc = 0 00000040:00080000:3.0:1762166980.901252:0:19593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5938, 88 off465200 00000004:00080000:3.0:1762166980.901257:0:19593:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 600049779445ns, next at 600144491692ns, rc = 0 00000040:00080000:3.0:1762166980.901281:0:19593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5939, 88 off465288 00000004:00080000:3.0:1762166980.901285:0:19593:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 600049807536ns, next at 600144491692ns, rc = 0 00000040:00080000:3.0:1762166980.901292:0:19593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5938, 88 off465288 00000004:00080000:3.0:1762166980.901295:0:19593:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 600049817056ns, next at 600144525370ns, rc = 0 00000001:00080000:1.0:1762166980.902083:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294992462 is committed 00000004:00080000:1.0:1762166980.902091:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3299 committed 00010000:00010000:3.0:1762166980.902103:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbac9a1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 00000004:00080000:1.0:1762166980.902103:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3296 committed 00010000:00010000:3.0:1762166980.902116:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbac9a1 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 00000004:00080000:1.0:1762166980.902116:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3295 committed 00010000:00010000:3.0:1762166980.902121:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbac9a1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.902127:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355ac00 already unused, calling callback (ffffffffc18e2310) 00000004:00080000:1.0:1762166980.902130:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3298 committed 00010000:00010000:3.0:1762166980.902132:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbac9a1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.902141:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbac9a1 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 00000004:00080000:1.0:1762166980.902141:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3297 committed 00000004:00080000:1.0:1762166980.902148:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3294 committed 00010000:00010000:3.0:1762166980.902153:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:3.0:1762166980.902157:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166980.902160:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbac9a1 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.902165:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355ac00/0x2f180c4effbac9a1 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 00010000:00010000:3.0:1762166980.902179:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4410c00/0x2f180c4effbac9c4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166980.902182:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4410c00/0x2f180c4effbac9c4 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166980.902188:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4410c00/0x2f180c4effbac9c4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166980.902191:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4410c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166980.902194:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4410c00/0x2f180c4effbac9c4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166980.902201:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4410c00/0x2f180c4effbac9c4 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166980.902206:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:3.0:1762166980.902208:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166980.902210:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4410c00/0x2f180c4effbac9c4 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166980.902214:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4410c00/0x2f180c4effbac9c4 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166980.902224:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbac9d9 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166980.902227:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbac9d9 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166980.902232:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbac9d9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166980.902236:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355bc00 already unused, calling callback (ffffffffc18e2310) 00000100:00100000:0.0:1762166980.902236:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf3db7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449780992:0@lo:2:osp-syn-0-1.0 00010000:00010000:3.0:1762166980.902241:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbac9d9 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166980.902248:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbac9d9 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 30829 initiator: MDT1 00000100:00100000:2.0:1762166980.902248:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf3db5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449781248:0@lo:2:osp-syn-0-1.0 00010000:00010000:3.0:1762166980.902261:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:3.0:1762166980.902263:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166980.902265:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbac9d9 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166980.902268:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbac9d9 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166980.902276:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbac9e0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166980.902280:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbac9e0 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166980.902283:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbac9e0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00000100:00100000:0.0:1762166980.902289:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1762166980.902292:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355aa00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166980.902295:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbac9e0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00000100:00100000:2.0:1762166980.902299:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449781120:0@lo:2:osp-syn-1-1.0 00010000:00010000:3.0:1762166980.902301:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbac9e0 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166980.902313:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:3.0:1762166980.902314:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166980.902317:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbac9e0 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166980.902320:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbac9e0 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00000100:00100000:0.0:1762166980.902325:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcce74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449781504:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1762166980.902330:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449780992 00000100:00100000:1.0:1762166980.902337:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449780992 00000100:00100000:2.0:1762166980.902338:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00010000:3.0:1762166980.902352:0:19593:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000073d24d40 reply state 00000000a047d8f9 transno 4294992462 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac9e7 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166980.902360:0:19593:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac9e7 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166980.902365:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00000100:00100000:0.0:1762166980.902369:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166980.902370:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449781632:0@lo:2:osp-syn-1-1.0 00010000:00010000:3.0:1762166980.902371:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1762166980.902373:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449781120 00000100:00100000:3.0:1762166980.902377:0:19593:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166980.902379:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449781120 00010000:00010000:3.0:1762166980.902384:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:3.0:1762166980.902389:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00000100:00100000:0.0:1762166980.902395:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:3.0:1762166980.902397:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbac93f lrc: 0/0,0 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea794 expref: 525 pid: 6494 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166980.902405:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449781376:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1762166980.902406:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449781504 00000100:00100000:1.0:1762166980.902411:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449781504 00000100:00100000:2.0:1762166980.902412:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166980.902442:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449781632 00000100:00100000:0.0:1762166980.902443:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166980.902448:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449781632 00010000:00080000:3.0:1762166980.902466:0:19593:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1762166980.902497:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+525:61877:x1847765450687744:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 2961us (3095us total) trans 4294992462 rc 0/0 00000100:00100000:3.0:1762166980.902505:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11967 00000100:00100000:2.0:1762166980.902511:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449781376 00000100:00100000:2.0:1762166980.902517:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449781376 00000100:00100000:0.0:1762166980.902518:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19361 00000100:00100000:1.0:1762166980.902529:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19362 00000100:00100000:0.0:1762166980.902534:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+14:3636:x1847765449780992:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166980.902538:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19363 00000100:00100000:1.0:1762166980.902544:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+7:3633:x1847765449781120:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166980.902551:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+14:3636:x1847765449781504:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1762166980.902563:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19364 00000100:00100000:2.0:1762166980.902573:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+7:3633:x1847765449781632:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:0.0:1762166980.902626:0:35248:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166980.902630:0:35248:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb mtime from disk: 1762166966 -> 1762166966 00002000:00010000:0.0:1762166980.902632:0:35248:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1762166980.902634:0:35248:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb ctime from disk: 1762166966 -> 1762166966 00002000:00010000:0.0:1762166980.902636:0:35248:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:1.0:1762166980.902642:0:35247:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 148474 -> 148474 00002000:00010000:3.0:1762166980.902644:0:28434:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166980.902647:0:35247:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00010000:3.0:1762166980.902649:0:28434:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00010000:1.0:1762166980.902652:0:35247:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166981 -> 1762166981 00002000:00010000:3.0:1762166980.902654:0:28434:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00002000:00010000:1.0:1762166980.902657:0:35247:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00002000:00010000:3.0:1762166980.902659:0:28434:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00002000:00010000:1.0:1762166980.902661:0:35247:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 256 -> 256 00002000:00010000:3.0:1762166980.902664:0:28434:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1762166980.902667:0:35248:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+16:3636:x1847765449780992:12345-0@lo:2:osp-syn-0-1.0 Request processed in 139us (380us total) trans 21474843438 rc 0/0 00002000:00010000:2.0:1762166980.902671:0:8380:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb size from disk: 148474 -> 148474 00000100:00100000:0.0:1762166980.902674:0:35248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19361 00002000:00010000:2.0:1762166980.902678:0:8380:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00010000:2.0:1762166980.902683:0:8380:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00002000:00010000:2.0:1762166980.902686:0:8380:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00002000:00010000:2.0:1762166980.902689:0:8380:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1762166980.902693:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19365 00000100:00100000:0.0:1762166980.902700:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+9:3636:x1847765449781376:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166980.902705:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+15:3636:x1847765449781504:12345-0@lo:2:osp-syn-0-1.0 Request processed in 157us (338us total) trans 21474843439 rc 0/0 00000100:00100000:3.0:1762166980.902711:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19363 00000100:00100000:1.0:1762166980.902716:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+9:3633:x1847765449781120:12345-0@lo:2:osp-syn-1-1.0 Request processed in 177us (378us total) trans 17179876679 rc 0/0 00000100:00100000:1.0:1762166980.902726:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19362 00000100:00100000:2.0:1762166980.902733:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+10:3633:x1847765449781632:12345-0@lo:2:osp-syn-1-1.0 Request processed in 161us (323us total) trans 17179876680 rc 0/0 00010000:00010000:3.0:1762166980.902734:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac9e7 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00002000:00010000:0.0:1762166980.902743:0:35248:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00010000:00010000:3.0:1762166980.902746:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac9e7 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT1 00000100:00100000:2.0:1762166980.902749:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19364 00002000:00010000:0.0:1762166980.902749:0:35248:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00010000:0.0:1762166980.902756:0:35248:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166981 -> 1762166981 00010000:00010000:3.0:1762166980.902757:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac9e7 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00002000:00010000:0.0:1762166980.902759:0:35248:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00002000:00010000:0.0:1762166980.902765:0:35248:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00010000:3.0:1762166980.902767:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdf600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166980.902771:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac9e7 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166980.902776:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac9e7 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166980.902783:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:3.0:1762166980.902785:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166980.902787:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac9e7 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00000100:00100000:0.0:1762166980.902791:0:35248:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+8:3636:x1847765449781376:12345-0@lo:2:osp-syn-1-1.0 Request processed in 91us (349us total) trans 17179876681 rc 0/0 00010000:00010000:3.0:1762166980.902794:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbac9e7 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00000100:00100000:0.0:1762166980.902799:0:35248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19365 00000100:00100000:0.0:1762166980.902844:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166980.902867:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449781248 00000100:00100000:1.0:1762166980.902873:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449781248 00000004:00080000:0.0:1762166980.902899:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc4a28700/2, rc 0, transno 17179876681 00000100:00100000:0.0:1762166980.902905:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449781376:0@lo:2:osp-syn-1-1.0 00000004:00080000:2.0:1762166980.902909:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc4a2b100/2, rc 0, transno 17179876679 00000100:00100000:1.0:1762166980.902909:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19366 00000100:00100000:2.0:1762166980.902919:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449781120:0@lo:2:osp-syn-1-1.0 00000004:00080000:0.0:1762166980.902922:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf3db7800/2, rc 0, transno 21474843438 00000100:00100000:1.0:1762166980.902925:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+15:3634:x1847765449781248:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1762166980.902931:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3db7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449780992:0@lo:2:osp-syn-0-1.0 00000004:00080000:2.0:1762166980.902941:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc4a28000/2, rc 0, transno 17179876680 00000100:00100000:2.0:1762166980.902949:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449781632:0@lo:2:osp-syn-1-1.0 00000004:00080000:0.0:1762166980.902949:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bcce74a80/2, rc 0, transno 21474843439 00000100:00100000:0.0:1762166980.902958:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcce74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449781504:0@lo:2:osp-syn-0-1.0 00002000:00010000:1.0:1762166980.902987:0:9168:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166980.902991:0:9168:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00010000:1.0:1762166980.902993:0:9168:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166981 -> 1762166981 00002000:00010000:1.0:1762166980.902995:0:9168:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00002000:00010000:1.0:1762166980.902998:0:9168:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00000100:00100000:1.0:1762166980.903035:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+16:3634:x1847765449781248:12345-0@lo:2:osp-syn-0-1.0 Request processed in 115us (189us total) trans 21474843440 rc 0/0 00000100:00100000:1.0:1762166980.903043:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19366 00000004:00080000:0.0:1762166980.903057:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf3db5500/2, rc 0, transno 21474843440 00000100:00100000:0.0:1762166980.903064:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3db5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449781248:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1762166980.903629:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.903669:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450688000 00000100:00100000:2.0:1762166980.903675:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450688000 00000100:00100000:2.0:1762166980.903707:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30810 00000100:00100000:2.0:1762166980.903716:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+524:61877:x1847765450688000:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166980.903730:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166980.903744:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4b200/0x2f180c4effbac9ee lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea7da expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.903782:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4b200/0x2f180c4effbac9ee lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea7da expref: 525 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.903795:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4b200/0x2f180c4effbac9ee lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea7da expref: 525 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.903809:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166980.903824:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166980.903828:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc3d4b200, rc 0) 00000100:00100000:2.0:1762166980.903861:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+525:61877:x1847765450688000:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 147us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166980.903868:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30810 00000100:00100000:3.0:1762166980.904849:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.904891:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450688256 00000100:00100000:0.0:1762166980.904896:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450688256 00000100:00100000:0.0:1762166980.904938:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11968 00000100:00100000:0.0:1762166980.904947:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+525:61877:x1847765450688256:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166980.905103:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+526:61877:x1847765450688256:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 157us (255us total) trans 4294992463 rc 0/0 00000100:00100000:0.0:1762166980.905112:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11968 00000100:00100000:1.0:1762166980.912062:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.912133:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450688384 00000100:00100000:2.0:1762166980.912144:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450688384 00000100:00100000:2.0:1762166980.912200:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30811 00000100:00100000:2.0:1762166980.912212:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+526:61878:x1847765450688384:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166980.912241:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166980.912268:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4a000/0x2f180c4effbac9f5 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea7e1 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.912331:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4a400/0x2f180c4effbac9fc lrc: 3/1,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166980.912343:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4a400/0x2f180c4effbac9fc lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166980.912352:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4a400/0x2f180c4effbac9fc lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166980.912361:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4ac00/0x2f180c4effbaca03 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166980.912365:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4ac00/0x2f180c4effbaca03 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166980.912369:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4ac00/0x2f180c4effbaca03 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166980.912441:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc98f4800/0x2f180c4effbaca0a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166980.912449:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc98f4800/0x2f180c4effbaca0a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166980.912453:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc98f4800/0x2f180c4effbaca0a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000004:00200000:2.0:1762166980.912512:0:30829:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 148474 00000004:00200000:2.0:1762166980.912516:0:30829:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166980.912533:0:30829:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc98f4800/0x2f180c4effbaca0a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166980.912543:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc98f4800/0x2f180c4effbaca0a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166980.912551:0:30829:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4a400/0x2f180c4effbac9fc lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166980.912556:0:30829:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4a400/0x2f180c4effbac9fc lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166980.912560:0:30829:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4a400/0x2f180c4effbac9fc lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166980.912564:0:30829:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4a400/0x2f180c4effbac9fc lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166980.912568:0:30829:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc3d4a400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166980.912571:0:30829:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4a400/0x2f180c4effbac9fc lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166980.912575:0:30829:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4a400/0x2f180c4effbac9fc lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166980.912584:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0x0 (ffff945bc809b900) 00010000:00010000:2.0:1762166980.912587:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166980.912590:0:30829:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4a400/0x2f180c4effbac9fc lrc: 3/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166980.912594:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4a400/0x2f180c4effbac9fc lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166980.912604:0:30829:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4ac00/0x2f180c4effbaca03 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166980.912607:0:30829:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4ac00/0x2f180c4effbaca03 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166980.912611:0:30829:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4ac00/0x2f180c4effbaca03 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166980.912614:0:30829:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc3d4ac00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166980.912616:0:30829:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4ac00/0x2f180c4effbaca03 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166980.912619:0:30829:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4ac00/0x2f180c4effbaca03 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166980.912622:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0xdd396665 (ffff945bc809ba00) 00010000:00010000:2.0:1762166980.912623:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166980.912625:0:30829:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4ac00/0x2f180c4effbaca03 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166980.912627:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4ac00/0x2f180c4effbaca03 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166980.912648:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4a000/0x2f180c4effbac9f5 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea7e1 expref: 528 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.912661:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc98f4800/0x2f180c4effbaca0a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea7e1 expref: 527 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.912666:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166980.912668:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166980.912669:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc98f4800, rc 0) 00000100:00100000:2.0:1762166980.912721:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+527:61878:x1847765450688384:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 514us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166980.912727:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30811 00000100:00100000:1.0:1762166980.913895:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.913941:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450688640 00000100:00100000:2.0:1762166980.913947:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450688640 00000100:00100000:2.0:1762166980.913983:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30812 00000100:00100000:2.0:1762166980.913991:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+527:61878:x1847765450688640:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166980.914000:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166980.914007:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc98f5200/0x2f180c4effbaca11 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea7e8 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.914083:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eef800/0x2f180c4effbaca18 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166980.914094:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eef800/0x2f180c4effbaca18 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166980.914103:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eef800/0x2f180c4effbaca18 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000004:00200000:2.0:1762166980.914112:0:30829:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 148474 00010000:00010000:2.0:1762166980.914214:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc98f5200/0x2f180c4effbaca11 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea7e8 expref: 530 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.914229:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eef800/0x2f180c4effbaca18 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea7e8 expref: 529 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.914237:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166980.914240:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1762166980.914242:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc6eef800, rc 0) 00000100:00100000:2.0:1762166980.914282:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+529:61878:x1847765450688640:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 292us (389us total) trans 4294992464 rc 0/0 00000100:00100000:2.0:1762166980.914289:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30812 00000100:00100000:3.0:1762166980.915141:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.915176:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450688896 00000100:00100000:2.0:1762166980.915182:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450688896 00000100:00100000:2.0:1762166980.915225:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30813 00000100:00100000:2.0:1762166980.915235:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+529:61878:x1847765450688896:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166980.915248:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166980.915258:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eef600/0x2f180c4effbaca26 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea7ef expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.915302:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eefa00/0x2f180c4effbaca2d lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166980.915313:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eefa00/0x2f180c4effbaca2d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166980.915321:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eefa00/0x2f180c4effbaca2d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000004:00200000:2.0:1762166980.915331:0:30829:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 148474 00010000:00010000:2.0:1762166980.915384:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eef600/0x2f180c4effbaca26 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea7ef expref: 532 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.915398:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eefa00/0x2f180c4effbaca2d lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea7ef expref: 531 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.915406:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166980.915408:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166980.915411:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc6eefa00, rc 0) 00000100:00100000:2.0:1762166980.915449:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+531:61878:x1847765450688896:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 216us (308us total) trans 4294992465 rc 0/0 00000100:00100000:2.0:1762166980.915456:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30813 00000100:00100000:1.0:1762166980.939030:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.939168:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450689024 00000100:00100000:3.0:1762166980.939181:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450689024 00000100:00100000:3.0:1762166980.939247:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2677 00000100:00100000:3.0:1762166980.939255:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+22:2416:x1847765450689024:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:3.0:1762166980.939283:0:23942:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945cc7d17000/0x2f180c4effbaca3b lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.939294:0:23942:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166980.939296:0:23942:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166980.939301:0:23942:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc7d17000/0x2f180c4effbaca3b lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->151551] (req 0->151551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.939310:0:23942:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cc7d17000/0x2f180c4effbaca3b lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->151551] (req 0->151551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.940572:0:23942:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945cc7d17000/0x2f180c4effbaca3b lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->151551] (req 0->151551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.940585:0:23942:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945cc7d17000/0x2f180c4effbaca3b lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->151551] (req 0->151551) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.940593:0:23942:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945cc7d17000/0x2f180c4effbaca3b lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->151551] (req 0->151551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.940600:0:23942:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc7d17000 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166980.940605:0:23942:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc7d17000/0x2f180c4effbaca3b lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->151551] (req 0->151551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.940614:0:23942:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc7d17000/0x2f180c4effbaca3b lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->151551] (req 0->151551) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.940629:0:23942:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945cc7d17000/0x2f180c4effbaca3b lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->151551] (req 0->151551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.940637:0:23942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cc7d17000/0x2f180c4effbaca3b lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->151551] (req 0->151551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166980.940698:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+22:2416:x1847765450689024:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 1441us (1681us total) trans 0 rc 148474/148474 00000100:00100000:3.0:1762166980.940706:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2677 00000100:00100000:0.0:1762166980.942401:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.942431:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450689152 00000100:00100000:3.0:1762166980.942437:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450689152 00000100:00100000:3.0:1762166980.942469:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2678 00000100:00100000:3.0:1762166980.942498:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765450689152:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:3.0:1762166980.942514:0:23942:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945cc7d16400/0x2f180c4effbaca42 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.942525:0:23942:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc56eb000/0x2f180c4effbac9a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea7be expref: 22 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.942531:0:23942:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166980.942532:0:23942:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166980.942534:0:23942:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc7d16400/0x2f180c4effbaca42 lrc: 4/1,0 mode: --/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->151551] (req 0->151551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.942555:0:23942:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc56eb000/0x2f180c4effbac9a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea7be expref: 22 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.942564:0:23942:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc56eb000/0x2f180c4effbac9a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea7be expref: 22 pid: 9165 timeout: 700 lvb_type: 0 00000100:00100000:3.0:1762166980.942573:0:23942:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7d21f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_009:lustre-OST0001_UUID:23942:1847765449781760:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166980.942635:0:23942:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc56bf840 going to sleep for 11 seconds 00000100:00100000:3.0:1762166980.943276:0:23942:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7d21f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_009:lustre-OST0001_UUID:23942:1847765449781760:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166980.943288:0:23942:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945cc7d16400/0x2f180c4effbaca42 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->151551] (req 0->151551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166980.943502:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.943541:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450689280 00000100:00100000:1.0:1762166980.943546:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450689280 00010000:00010000:1.0:1762166980.943566:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc56eb000/0x2f180c4effbac9a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea7be expref: 23 pid: 9165 timeout: 700 lvb_type: 0 00000100:00100000:1.0:1762166980.943597:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9786 00000100:00100000:1.0:1762166980.943606:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765450689280:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166980.943618:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166980.943637:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc56eb000/0x2f180c4effbac9a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea7be expref: 23 pid: 9165 timeout: 700 lvb_type: 0 00010000:00010000:1.0:1762166980.943649:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc56eb000/0x2f180c4effbac9a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea7be expref: 23 pid: 9165 timeout: 700 lvb_type: 0 00010000:00010000:1.0:1762166980.943667:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc56eb000/0x2f180c4effbac9a8 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea7be expref: 23 pid: 9165 timeout: 700 lvb_type: 0 00010000:00010000:1.0:1762166980.943678:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166980.943680:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166980.943683:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945cc7d16400/0x2f180c4effbaca42 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->151551] (req 0->151551) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.943695:0:7421:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc7d16400/0x2f180c4effbaca42 lrc: 4/1,0 mode: PR/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->151551] (req 0->151551) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.943718:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166980.943741:0:23942:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945cc7d16400/0x2f180c4effbaca42 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->151551] (req 0->151551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.943752:0:23942:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cc7d16400/0x2f180c4effbaca42 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->151551] (req 0->151551) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166980.943753:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765450689280:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 148us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166980.943773:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9786 00010000:00010000:3.0:1762166980.944933:0:23942:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945cc7d16400/0x2f180c4effbaca42 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->151551] (req 0->151551) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.944944:0:23942:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945cc7d16400/0x2f180c4effbaca42 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->151551] (req 0->151551) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.944952:0:23942:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945cc7d16400/0x2f180c4effbaca42 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->151551] (req 0->151551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.944959:0:23942:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc7d16400 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166980.944963:0:23942:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc7d16400/0x2f180c4effbaca42 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->151551] (req 0->151551) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.944971:0:23942:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc7d16400/0x2f180c4effbaca42 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->151551] (req 0->151551) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.944982:0:23942:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945cc7d16400/0x2f180c4effbaca42 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->151551] (req 0->151551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.944990:0:23942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cc7d16400/0x2f180c4effbaca42 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->151551] (req 0->151551) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166980.945044:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450689152:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 2567us (2644us total) trans 0 rc 148474/148474 00000100:00100000:3.0:1762166980.945052:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2678 00000100:00100000:1.0:1762166980.950767:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.950826:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450689408 00000100:00100000:0.0:1762166980.950834:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450689408 00000100:00100000:0.0:1762166980.950878:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 898 00000100:00100000:0.0:1762166980.950884:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cceb49450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+531:61878:x1847765450689408:12345-192.168.204.38@tcp:103:lfs.0 00010000:00010000:0.0:1762166980.950896:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166980.950913:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eefa00/0x2f180c4effbaca2d lrc: 0/0,0 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea7ef expref: 531 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.950927:0:7421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:0.0:1762166980.950932:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166980.950979:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cceb49450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+530:61878:x1847765450689408:12345-192.168.204.38@tcp:103:lfs.0 Request processed in 94us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166980.950986:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 898 00000100:00100000:2.0:1762166980.951687:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.951726:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450689664 00000100:00100000:0.0:1762166980.951731:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450689664 00000100:00100000:0.0:1762166980.951761:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11969 00000100:00100000:0.0:1762166980.951768:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+530:61878:x1847765450689664:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166980.951960:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+531:61878:x1847765450689664:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 192us (274us total) trans 4294992466 rc 0/0 00000100:00100000:0.0:1762166980.951968:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11969 00000100:00100000:3.0:1762166980.953594:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.953644:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450689920 00000100:00100000:2.0:1762166980.953650:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450689920 00000100:00100000:2.0:1762166980.953686:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30814 00000100:00100000:2.0:1762166980.953692:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+531:61766:x1847765450689920:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:2.0:1762166980.953701:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166980.953713:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eee000/0x2f180c4effbaca49 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea7f6 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.953767:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eefe00/0x2f180c4effbaca50 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166980.953777:0:30829:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc98f4800/0x2f180c4effbaca0a lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea7e1 expref: 532 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.953782:0:30829:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eefe00/0x2f180c4effbaca50 lrc: 4/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166980.953803:0:30829:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc98f4800/0x2f180c4effbaca0a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea7e1 expref: 532 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.953824:0:30829:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc98f4800/0x2f180c4effbaca0a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea7e1 expref: 532 pid: 30829 timeout: 700 lvb_type: 0 00000100:00100000:2.0:1762166980.953836:0:30829:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a2b800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:30829:1847765449781888:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166980.953883:0:30829:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a1600 going to sleep for 11 seconds 00000100:00100000:2.0:1762166980.954648:0:30829:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a2b800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:30829:1847765449781888:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166980.954662:0:30829:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eefe00/0x2f180c4effbaca50 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000100:00100000:3.0:1762166980.954727:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.954785:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450690048 00000100:00100000:0.0:1762166980.954791:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450690048 00010000:00010000:0.0:1762166980.954810:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc98f4800/0x2f180c4effbaca0a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea7e1 expref: 533 pid: 30829 timeout: 700 lvb_type: 0 00000100:00100000:0.0:1762166980.954845:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9787 00000100:00100000:0.0:1762166980.954851:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d21500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+533:2419:x1847765450690048:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166980.954858:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166980.954862:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc98f4800/0x2f180c4effbaca0a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea7e1 expref: 533 pid: 30829 timeout: 700 lvb_type: 0 00010000:00010000:0.0:1762166980.954870:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc98f4800/0x2f180c4effbaca0a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea7e1 expref: 533 pid: 30829 timeout: 700 lvb_type: 0 00010000:00010000:0.0:1762166980.954881:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc98f4800/0x2f180c4effbaca0a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea7e1 expref: 533 pid: 30829 timeout: 700 lvb_type: 0 00010000:00010000:0.0:1762166980.954890:0:7421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:0.0:1762166980.954892:0:7421:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eefe00/0x2f180c4effbaca50 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166980.954897:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eefe00/0x2f180c4effbaca50 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166980.954901:0:7421:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eefe00/0x2f180c4effbaca50 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166980.954916:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166980.954938:0:30829:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eefe00/0x2f180c4effbaca50 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000100:00100000:0.0:1762166980.954940:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d21500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+532:2419:x1847765450690048:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 89us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166980.954948:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9787 00010000:00010000:2.0:1762166980.954957:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eefe00/0x2f180c4effbaca50 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000004:00200000:2.0:1762166980.954973:0:30829:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 148474 00010000:00010000:2.0:1762166980.955055:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eee000/0x2f180c4effbaca49 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea7f6 expref: 533 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.955067:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eefe00/0x2f180c4effbaca50 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea7f6 expref: 532 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.955074:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166980.955076:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1762166980.955079:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc6eefe00, rc 0) 00000100:00100000:2.0:1762166980.955114:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+532:61766:x1847765450689920:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 1422us (1520us total) trans 4294992467 rc 0/0 00000100:00100000:2.0:1762166980.955125:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30814 00000100:00100000:3.0:1762166980.955883:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.955918:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450690176 00000100:00100000:2.0:1762166980.955923:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450690176 00000100:00100000:2.0:1762166980.955954:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30815 00000100:00100000:2.0:1762166980.955963:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+532:61766:x1847765450690176:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:2.0:1762166980.955975:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166980.955984:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eef600/0x2f180c4effbaca5e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea7fd expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.956034:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc98f5200/0x2f180c4effbaca65 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166980.956045:0:30829:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eefe00/0x2f180c4effbaca50 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea7f6 expref: 533 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.956051:0:30829:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc98f5200/0x2f180c4effbaca65 lrc: 4/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166980.956071:0:30829:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eefe00/0x2f180c4effbaca50 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea7f6 expref: 533 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.956081:0:30829:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eefe00/0x2f180c4effbaca50 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea7f6 expref: 533 pid: 30829 timeout: 700 lvb_type: 0 00000100:00100000:2.0:1762166980.956090:0:30829:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a2b800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:30829:1847765449782016:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166980.956133:0:30829:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a1c00 going to sleep for 11 seconds 00000100:00100000:2.0:1762166980.956714:0:30829:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a2b800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:30829:1847765449782016:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166980.956727:0:30829:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc98f5200/0x2f180c4effbaca65 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000100:00100000:3.0:1762166980.957040:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.957082:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450690304 00000100:00100000:0.0:1762166980.957089:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450690304 00010000:00010000:0.0:1762166980.957106:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eefe00/0x2f180c4effbaca50 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea7f6 expref: 534 pid: 30829 timeout: 700 lvb_type: 0 00000100:00100000:0.0:1762166980.957127:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9788 00000100:00100000:0.0:1762166980.957131:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d23480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+534:2419:x1847765450690304:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166980.957137:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166980.957141:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eefe00/0x2f180c4effbaca50 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea7f6 expref: 534 pid: 30829 timeout: 700 lvb_type: 0 00010000:00010000:0.0:1762166980.957148:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eefe00/0x2f180c4effbaca50 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea7f6 expref: 534 pid: 30829 timeout: 700 lvb_type: 0 00010000:00010000:0.0:1762166980.957157:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eefe00/0x2f180c4effbaca50 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea7f6 expref: 534 pid: 30829 timeout: 700 lvb_type: 0 00010000:00010000:0.0:1762166980.957165:0:7421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:0.0:1762166980.957167:0:7421:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc98f5200/0x2f180c4effbaca65 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166980.957172:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc98f5200/0x2f180c4effbaca65 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166980.957178:0:7421:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc98f5200/0x2f180c4effbaca65 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166980.957191:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166980.957212:0:30829:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc98f5200/0x2f180c4effbaca65 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000100:00100000:0.0:1762166980.957217:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d23480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+533:2419:x1847765450690304:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 83us (210us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166980.957223:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc98f5200/0x2f180c4effbaca65 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000100:00100000:0.0:1762166980.957230:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9788 00000004:00200000:2.0:1762166980.957253:0:30829:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 148474 00000004:00200000:2.0:1762166980.957258:0:30829:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166980.957270:0:30829:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc98f5200/0x2f180c4effbaca65 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166980.957291:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eef600/0x2f180c4effbaca5e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea7fd expref: 533 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.957303:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc98f5200/0x2f180c4effbaca65 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea7fd expref: 532 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.957310:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166980.957312:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166980.957315:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc98f5200, rc 0) 00000100:00100000:2.0:1762166980.957351:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+532:61766:x1847765450690176:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 1390us (1468us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166980.957359:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30815 00000100:00100000:3.0:1762166980.958370:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.958436:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450690432 00000100:00100000:1.0:1762166980.958446:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450690432 00000100:00100000:1.0:1762166980.958525:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19367 00000100:00100000:1.0:1762166980.958541:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+21:2417:x1847765450690432:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:1.0:1762166980.958558:0:9168:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166980.958579:0:9168:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cc355a600/0x2f180c4effbaca6c lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea804 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762166980.958603:0:9168:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa90:0x0] initial LVB size: 148474, mtime: 0x690888c5, atime: 0x690888c4, ctime: 0x690888c5, blocks: 0x8 00010000:00010000:1.0:1762166980.958622:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166980.958624:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166980.958633:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355a600/0x2f180c4effbaca6c lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea804 expref: 22 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166980.958649:0:9168:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945cc355a600/0x2f180c4effbaca6c lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea804 expref: 22 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166980.958662:0:9168:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355a600, rc 0) 00000100:00100000:1.0:1762166980.958716:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+22:2417:x1847765450690432:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 181us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166980.958724:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19367 00000100:00100000:1.0:1762166980.959984:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.960042:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450690560 00000100:00100000:3.0:1762166980.960052:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450690560 00002000:00100000:3.0:1762166980.960086:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa90:0x0] (53248->61439) req@ffff945cf79e9180 x1847765450690560/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 488/0 e 0 to 0 dl 1762166991 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166980.960093:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf79e9180 with x1847765450690560 ext(53248->61439) 00002000:00010000:3.0:1762166980.960097:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf79e9180 00000100:00100000:3.0:1762166980.960114:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2679 00000100:00100000:3.0:1762166980.960120:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450690560:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:3.0:1762166980.960250:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450690560:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 130us (267us total) trans 0 rc 8192/8192 00000100:00100000:3.0:1762166980.960255:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2679 00002000:00100000:3.0:1762166980.960259:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa90:0x0] (53248->61439) req@ffff945cf79e9180 x1847765450690560/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 488/8632 e 0 to 0 dl 1762166991 ref 1 fl Complete:/600/0 rc 8192/8192 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166980.960265:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf79e9180 with x1847765450690560 ext(53248->61439) 00002000:00010000:3.0:1762166980.960268:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf79e9180 00000100:00100000:2.0:1762166980.961380:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.961412:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450690816 00000100:00100000:0.0:1762166980.961417:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450690816 00000100:00100000:0.0:1762166980.961443:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11970 00000100:00100000:0.0:1762166980.961448:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff2fd850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+532:61766:x1847765450690816:12345-192.168.204.38@tcp:35:fsx.0 00000100:00100000:0.0:1762166980.961614:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff2fd850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+533:61766:x1847765450690816:12345-192.168.204.38@tcp:35:fsx.0 Request processed in 165us (236us total) trans 4294992468 rc 0/0 00000100:00100000:0.0:1762166980.961619:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11970 00000100:00100000:0.0:1762166980.962433:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.962473:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450691072 00000100:00100000:2.0:1762166980.962500:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450691072 00000100:00100000:2.0:1762166980.962538:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30816 00000100:00100000:2.0:1762166980.962547:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+533:61766:x1847765450691072:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:2.0:1762166980.962559:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166980.962562:0:30829:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 1 00010000:00010000:2.0:1762166980.962580:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eef800/0x2f180c4effbaca18 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea7e8 expref: 533 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.962594:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4b200/0x2f180c4effbac9ee lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea7da expref: 532 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.962600:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc98f5200/0x2f180c4effbaca65 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea7fd expref: 531 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.962606:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166980.962609:0:30829:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166980.962616:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4ac00/0x2f180c4effbaca73 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea80b expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.962641:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4a400/0x2f180c4effbaca7a lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166980.962648:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4a400/0x2f180c4effbaca7a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166980.962654:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4a400/0x2f180c4effbaca7a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000040:00080000:2.0:1762166980.962798:0:30829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5940, 88 off465376 00000004:00080000:2.0:1762166980.962803:0:30829:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 600111324834ns, next at 600144491692ns, rc = 0 00000040:00080000:2.0:1762166980.962850:0:30829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5939, 88 off465376 00000004:00080000:2.0:1762166980.962854:0:30829:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 600111376299ns, next at 600144525370ns, rc = 0 00000040:00080000:2.0:1762166980.962875:0:30829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5940, 88 off465464 00000004:00080000:2.0:1762166980.962879:0:30829:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 600111401115ns, next at 600144525370ns, rc = 0 00000040:00080000:2.0:1762166980.962891:0:30829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5941, 88 off465464 00000004:00080000:2.0:1762166980.962894:0:30829:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 600111417015ns, next at 600144491692ns, rc = 0 00000040:00080000:2.0:1762166980.962907:0:30829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5942, 88 off465552 00000004:00080000:2.0:1762166980.962911:0:30829:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 600111432467ns, next at 600144491692ns, rc = 0 00000040:00080000:2.0:1762166980.962918:0:30829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5941, 88 off465552 00000004:00080000:2.0:1762166980.962920:0:30829:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 600111442787ns, next at 600144525370ns, rc = 0 00000001:00080000:1.0:1762166980.963821:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294992469 is committed 00000004:00080000:1.0:1762166980.963829:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3302 committed 00000004:00080000:1.0:1762166980.963840:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3299 committed 00000004:00080000:1.0:1762166980.963847:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3298 committed 00000004:00080000:1.0:1762166980.963849:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3301 committed 00000004:00080000:1.0:1762166980.963850:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3300 committed 00000004:00080000:1.0:1762166980.963851:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3297 committed 00000100:00100000:1.0:1762166980.963940:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449782272:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1762166980.963972:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcce75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449782144:0@lo:2:osp-syn-0-1.0 00010000:00010000:3.0:1762166980.963985:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4a400/0x2f180c4effbaca7a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea80b expref: 526 pid: 30829 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166980.963998:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449782400:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1762166980.964000:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1762166980.964004:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:3.0:1762166980.964015:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1762166980.964038:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4ac00/0x2f180c4effbaca73 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea80b expref: 526 pid: 30829 timeout: 0 lvb_type: 3 00000100:00100000:0.0:1762166980.964043:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449782272 00000100:00100000:0.0:1762166980.964053:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449782272 00010000:00010000:3.0:1762166980.964072:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4a400/0x2f180c4effbaca7a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea80b expref: 525 pid: 30829 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166980.964073:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449782784:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1762166980.964090:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166980.964092:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19368 00000100:00100000:0.0:1762166980.964107:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+8:3635:x1847765449782272:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1762166980.964129:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1762166980.964140:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:3.0:1762166980.964146:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1762166980.964150:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc3d4a400, rc 0) 00000100:00100000:2.0:1762166980.964168:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449782528:0@lo:2:osp-syn-0-1.0 00002000:00010000:0.0:1762166980.964206:0:9168:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 148474 -> 148474 00000100:00100000:3.0:1762166980.964216:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+525:61766:x1847765450691072:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 1658us (1770us total) trans 4294992469 rc 0/0 00002000:00010000:0.0:1762166980.964216:0:9168:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00000100:00100000:2.0:1762166980.964217:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:0.0:1762166980.964226:0:9168:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166981 -> 1762166981 00002000:00010000:0.0:1762166980.964234:0:9168:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00002000:00010000:0.0:1762166980.964243:0:9168:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 256 -> 256 00000100:00100000:3.0:1762166980.964250:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30816 00000100:00100000:2.0:1762166980.964294:0:35248:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449782400 00000100:00100000:2.0:1762166980.964301:0:35248:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449782400 00000100:00100000:0.0:1762166980.964308:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+9:3635:x1847765449782272:12345-0@lo:2:osp-syn-1-1.0 Request processed in 201us (305us total) trans 17179876682 rc 0/0 00000100:00100000:0.0:1762166980.964315:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19368 00000100:00100000:0.0:1762166980.964338:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449782784 00000100:00100000:2.0:1762166980.964341:0:35248:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449782528 00000100:00100000:0.0:1762166980.964343:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449782784 00000100:00100000:2.0:1762166980.964347:0:35248:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449782528 00000004:00080000:1.0:1762166980.964350:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc4a2b800/2, rc 0, transno 17179876682 00000100:00100000:1.0:1762166980.964360:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449782272:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1762166980.964393:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19369 00000100:00100000:2.0:1762166980.964403:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19370 00000100:00100000:0.0:1762166980.964408:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+17:3636:x1847765449782400:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1762166980.964424:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+9:3635:x1847765449782784:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166980.964425:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19371 00000100:00100000:3.0:1762166980.964454:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+17:3633:x1847765449782528:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:0.0:1762166980.964530:0:9168:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166980.964535:0:9168:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00010000:0.0:1762166980.964538:0:9168:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166981 -> 1762166981 00002000:00010000:0.0:1762166980.964541:0:9168:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00002000:00010000:0.0:1762166980.964545:0:9168:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00000100:00100000:1.0:1762166980.964569:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:2.0:1762166980.964579:0:35248:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb size from disk: 148474 -> 148474 00002000:00010000:2.0:1762166980.964585:0:35248:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00010000:2.0:1762166980.964588:0:35248:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00002000:00010000:2.0:1762166980.964591:0:35248:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00002000:00010000:2.0:1762166980.964593:0:35248:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1762166980.964605:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+18:3636:x1847765449782400:12345-0@lo:2:osp-syn-0-1.0 Request processed in 201us (528us total) trans 21474843441 rc 0/0 00000100:00100000:1.0:1762166980.964610:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449782656:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1762166980.964622:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19369 00000100:00100000:0.0:1762166980.964644:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449782144 00000100:00100000:2.0:1762166980.964645:0:35248:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+10:3635:x1847765449782784:12345-0@lo:2:osp-syn-1-1.0 Request processed in 231us (518us total) trans 17179876683 rc 0/0 00000100:00100000:0.0:1762166980.964648:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449782144 00000100:00100000:2.0:1762166980.964661:0:35248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19370 00002000:00010000:3.0:1762166980.964669:0:9165:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:1.0:1762166980.964670:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:3.0:1762166980.964673:0:9165:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00010000:3.0:1762166980.964677:0:9165:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00002000:00010000:3.0:1762166980.964680:0:9165:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00002000:00010000:3.0:1762166980.964683:0:9165:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1762166980.964691:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449782656 00000100:00100000:0.0:1762166980.964695:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449782656 00000100:00100000:2.0:1762166980.964710:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19372 00000100:00100000:2.0:1762166980.964728:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+19:3634:x1847765449782144:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1762166980.964747:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19373 00000100:00100000:3.0:1762166980.964756:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+19:3633:x1847765449782528:12345-0@lo:2:osp-syn-0-1.0 Request processed in 300us (538us total) trans 21474843442 rc 0/0 00000100:00100000:3.0:1762166980.964771:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19371 00000100:00100000:0.0:1762166980.964782:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+10:3634:x1847765449782656:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:2.0:1762166980.964827:0:35248:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166980.964830:0:35248:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb mtime from disk: 1762166966 -> 1762166966 00002000:00010000:2.0:1762166980.964832:0:35248:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1762166980.964836:0:35248:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb ctime from disk: 1762166966 -> 1762166966 00002000:00010000:2.0:1762166980.964838:0:35248:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb blocks from disk: 0 -> 0 00000004:00080000:3.0:1762166980.964854:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf783fb80/2, rc 0, transno 21474843441 00000100:00100000:3.0:1762166980.964862:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449782400:0@lo:2:osp-syn-0-1.0 00002000:00010000:0.0:1762166980.964863:0:9168:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166980.964869:0:9168:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00010000:0.0:1762166980.964871:0:9168:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166981 -> 1762166981 00002000:00010000:0.0:1762166980.964872:0:9168:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00002000:00010000:0.0:1762166980.964875:0:9168:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1762166980.964891:0:35248:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+19:3634:x1847765449782144:12345-0@lo:2:osp-syn-0-1.0 Request processed in 172us (325us total) trans 21474843443 rc 0/0 00000100:00100000:2.0:1762166980.964904:0:35248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19372 00000004:00080000:1.0:1762166980.964936:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bcce75c00/2, rc 0, transno 21474843443 00000004:00080000:3.0:1762166980.964944:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc4a2aa00/2, rc 0, transno 17179876683 00000100:00100000:1.0:1762166980.964949:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcce75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449782144:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1762166980.964951:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+11:3634:x1847765449782656:12345-0@lo:2:osp-syn-1-1.0 Request processed in 179us (275us total) trans 17179876684 rc 0/0 00000100:00100000:3.0:1762166980.964954:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449782784:0@lo:2:osp-syn-1-1.0 00000004:00080000:2.0:1762166980.964975:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf783f100/2, rc 0, transno 21474843442 00000100:00100000:0.0:1762166980.964977:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19373 00000004:00080000:1.0:1762166980.964979:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc4a2a300/2, rc 0, transno 17179876684 00000100:00100000:2.0:1762166980.964986:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449782528:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1762166980.964992:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449782656:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1762166980.965399:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.965436:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450691200 00000100:00100000:0.0:1762166980.965440:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450691200 00000100:00100000:0.0:1762166980.965468:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19374 00000100:00100000:0.0:1762166980.965510:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+22:61766:x1847765450691200:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:0.0:1762166980.965521:0:35247:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166980.965533:0:35247:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbaca81 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea812 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.965558:0:35247:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc56eb800/0x2f180c4effbac97e lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea7a9 expref: 23 pid: 35247 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166980.965566:0:35247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166980.965568:0:35247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166980.965573:0:35247:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbaca81 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [180224->196607] (req 180224->196607) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea812 expref: 23 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.965599:0:35247:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc56eb800/0x2f180c4effbac97e lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea7a9 expref: 23 pid: 35247 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166980.965609:0:35247:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc56eb800/0x2f180c4effbac97e lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea7a9 expref: 23 pid: 35247 timeout: 700 lvb_type: 1 00000100:00100000:0.0:1762166980.965617:0:35247:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:35247:1847765449782912:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166980.965668:0:35247:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc4eeae40 going to sleep for 11 seconds 00000100:00100000:0.0:1762166980.966340:0:35247:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:35247:1847765449782912:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166980.966372:0:35247:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbaca81 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [180224->196607] (req 180224->196607) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea812 expref: 23 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.966387:0:35247:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdfa00, rc 0) 00000100:00100000:0.0:1762166980.966427:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+23:61766:x1847765450691200:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 951us (1029us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166980.966435:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19374 00000100:00100000:3.0:1762166980.966613:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.966653:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450691328 00000100:00100000:0.0:1762166980.966660:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450691328 00010000:00010000:0.0:1762166980.966683:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc56eb800/0x2f180c4effbac97e lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea7a9 expref: 23 pid: 35247 timeout: 700 lvb_type: 1 00000100:00100000:0.0:1762166980.966712:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9789 00000100:00100000:0.0:1762166980.966719:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d20e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765450691328:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166980.966730:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166980.966740:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc56eb800/0x2f180c4effbac97e lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea7a9 expref: 23 pid: 35247 timeout: 700 lvb_type: 1 00010000:00010000:0.0:1762166980.966749:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc56eb800/0x2f180c4effbac97e lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea7a9 expref: 23 pid: 35247 timeout: 700 lvb_type: 1 00010000:00010000:0.0:1762166980.966765:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc56eb800/0x2f180c4effbac97e lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea7a9 expref: 23 pid: 35247 timeout: 700 lvb_type: 1 00010000:00010000:0.0:1762166980.966773:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166980.966775:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166980.966780:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbaca81 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 180224->196607) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea812 expref: 22 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.966787:0:7421:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbaca81 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 180224->196607) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea812 expref: 22 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.966807:0:7421:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbaca81 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 180224->196607) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea812 expref: 22 pid: 35247 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166980.966825:0:7421:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7421:1847765449783040:192.168.204.38@tcp:105: 00000100:00100000:0.0:1762166980.966861:0:7421:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc4eeae40 going to sleep for 11 seconds 00000100:00100000:0.0:1762166980.967506:0:7421:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7421:1847765449783040:192.168.204.38@tcp:105: 00010000:00010000:0.0:1762166980.967518:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166980.967555:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d20e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450691328:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 836us (941us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166980.967563:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9789 00000100:00100000:3.0:1762166980.967642:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.967678:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450691456 00000100:00100000:0.0:1762166980.967683:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450691456 00000100:00100000:0.0:1762166980.967727:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2680 00000100:00100000:0.0:1762166980.967736:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450691456:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:0.0:1762166980.967911:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 148474 -> 148474 00002000:00010000:0.0:1762166980.967914:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00010000:0.0:1762166980.967915:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166981 -> 1762166981 00002000:00010000:0.0:1762166980.967917:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00002000:00010000:0.0:1762166980.967919:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 256 -> 288 00000100:00100000:0.0:1762166980.967942:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765450691456:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 208us (300us total) trans 17179876685 rc 0/0 00000100:00100000:0.0:1762166980.967949:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2680 00000100:00100000:1.0:1762166980.968734:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.968776:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450691584 00000100:00100000:3.0:1762166980.968781:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450691584 00000100:00100000:3.0:1762166980.968825:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30817 00000100:00100000:3.0:1762166980.968834:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc558a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+525:61766:x1847765450691584:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:3.0:1762166980.968851:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166980.968867:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc7d16400/0x2f180c4effbaca88 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea819 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.968946:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc7d17000/0x2f180c4effbaca8f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:3.0:1762166980.968959:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc7d17000/0x2f180c4effbaca8f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166980.968971:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc7d17000/0x2f180c4effbaca8f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000004:00200000:3.0:1762166980.969001:0:30829:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 194464 00000004:00200000:3.0:1762166980.969006:0:30829:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166980.969022:0:30829:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945cc7d17000/0x2f180c4effbaca8f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166980.969041:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc7d16400/0x2f180c4effbaca88 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea819 expref: 527 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.969051:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc7d17000/0x2f180c4effbaca8f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea819 expref: 526 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.969056:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:3.0:1762166980.969059:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166980.969061:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc7d17000, rc 0) 00000100:00100000:3.0:1762166980.969087:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc558a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+526:61766:x1847765450691584:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 256us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166980.969092:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30817 00000100:00100000:1.0:1762166980.970746:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.970784:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450691712 00000100:00100000:0.0:1762166980.970790:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450691712 00002000:00100000:0.0:1762166980.970841:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (98304->102399) req@ffff945bc5589c00 x1847765450691712/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 488/0 e 0 to 0 dl 1762166991 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166980.970852:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5589c00 with x1847765450691712 ext(98304->102399) 00002000:00010000:0.0:1762166980.970859:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5589c00 00000100:00100000:0.0:1762166980.970884:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2681 00000100:00100000:0.0:1762166980.970896:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5589c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765450691712:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:0.0:1762166980.971063:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5589c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765450691712:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 171us (319us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1762166980.971071:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2681 00002000:00100000:0.0:1762166980.971079:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (98304->102399) req@ffff945bc5589c00 x1847765450691712/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 488/4536 e 0 to 0 dl 1762166991 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166980.971088:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5589c00 with x1847765450691712 ext(98304->102399) 00002000:00010000:0.0:1762166980.971092:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5589c00 00000100:00100000:0.0:1762166980.971948:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.971977:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450691840 00000100:00100000:3.0:1762166980.971981:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450691840 00002000:00100000:3.0:1762166980.971998:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (102400->106495) req@ffff945cf783e680 x1847765450691840/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 488/0 e 0 to 0 dl 1762166991 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166980.972005:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf783e680 with x1847765450691840 ext(102400->106495) 00002000:00010000:3.0:1762166980.972007:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf783e680 00000100:00100000:3.0:1762166980.972022:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2682 00000100:00100000:3.0:1762166980.972027:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+23:2417:x1847765450691840:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:3.0:1762166980.972091:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+23:2417:x1847765450691840:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 64us (143us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1762166980.972097:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2682 00002000:00100000:3.0:1762166980.972102:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (102400->106495) req@ffff945cf783e680 x1847765450691840/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 488/4536 e 0 to 0 dl 1762166991 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166980.972110:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf783e680 with x1847765450691840 ext(102400->106495) 00002000:00010000:3.0:1762166980.972114:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf783e680 00000100:00100000:1.0:1762166980.973224:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.973247:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450691968 00000100:00100000:3.0:1762166980.973253:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450691968 00002000:00100000:3.0:1762166980.973275:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (77824->143359) req@ffff945bc5589500 x1847765450691968/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 504/0 e 0 to 0 dl 1762166991 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166980.973283:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5589500 with x1847765450691968 ext(77824->143359) 00002000:00010000:3.0:1762166980.973287:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5589500 00000100:00100000:3.0:1762166980.973308:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2683 00000100:00100000:3.0:1762166980.973316:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5589500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765450691968:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:3.0:1762166980.974164:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5589500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765450691968:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 847us (941us total) trans 0 rc 57344/57344 00000100:00100000:3.0:1762166980.974171:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2683 00002000:00100000:3.0:1762166980.974178:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (77824->143359) req@ffff945bc5589500 x1847765450691968/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 504/440 e 0 to 0 dl 1762166991 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166980.974188:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5589500 with x1847765450691968 ext(77824->143359) 00002000:00010000:3.0:1762166980.974192:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5589500 00000100:00100000:0.0:1762166980.976133:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.976170:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450692096 00000100:00100000:3.0:1762166980.976178:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450692096 00002000:00100000:3.0:1762166980.976223:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (4096->69631) req@ffff945cf783e300 x1847765450692096/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 488/0 e 0 to 0 dl 1762166991 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166980.976233:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf783e300 with x1847765450692096 ext(4096->69631) 00002000:00010000:3.0:1762166980.976236:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf783e300 00000100:00100000:3.0:1762166980.976259:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2684 00000100:00100000:3.0:1762166980.976268:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765450692096:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:3.0:1762166980.977059:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765450692096:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 793us (931us total) trans 0 rc 65536/65536 00000100:00100000:3.0:1762166980.977065:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2684 00002000:00100000:3.0:1762166980.977071:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (4096->69631) req@ffff945cf783e300 x1847765450692096/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 488/440 e 0 to 0 dl 1762166991 ref 1 fl Complete:/600/0 rc 65536/65536 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166980.977077:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf783e300 with x1847765450692096 ext(4096->69631) 00002000:00010000:3.0:1762166980.977079:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf783e300 00000100:00100000:1.0:1762166980.978008:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.978041:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450692224 00000100:00100000:3.0:1762166980.978046:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450692224 00002000:00100000:3.0:1762166980.978064:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (69632->77823) req@ffff945bc5bbaa00 x1847765450692224/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 488/0 e 0 to 0 dl 1762166991 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166980.978070:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5bbaa00 with x1847765450692224 ext(69632->77823) 00002000:00010000:3.0:1762166980.978073:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5bbaa00 00000100:00100000:3.0:1762166980.978087:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2685 00000100:00100000:3.0:1762166980.978093:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765450692224:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:3.0:1762166980.978174:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765450692224:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 81us (168us total) trans 0 rc 8192/8192 00000100:00100000:3.0:1762166980.978178:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2685 00002000:00100000:3.0:1762166980.978183:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (69632->77823) req@ffff945bc5bbaa00 x1847765450692224/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 488/8632 e 0 to 0 dl 1762166991 ref 1 fl Complete:/600/0 rc 8192/8192 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166980.978188:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5bbaa00 with x1847765450692224 ext(69632->77823) 00002000:00010000:3.0:1762166980.978191:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5bbaa00 00000100:00100000:0.0:1762166980.979976:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.980063:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450692480 00000100:00100000:3.0:1762166980.980071:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450692480 00000100:00100000:3.0:1762166980.980108:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30818 00000100:00100000:3.0:1762166980.980116:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+526:61766:x1847765450692480:12345-192.168.204.38@tcp:36:fsx.0 00010000:00010000:3.0:1762166980.980162:0:30829:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1762166980.980188:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4a400/0x2f180c4effbaca7a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea80b expref: 526 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.980212:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc7d17000/0x2f180c4effbaca8f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea819 expref: 525 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.980229:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:3.0:1762166980.980235:0:30829:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166980.980439:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc7d16400/0x2f180c4effbaca96 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:3.0:1762166980.980451:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc7d16400/0x2f180c4effbaca96 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166980.980458:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc7d16400/0x2f180c4effbaca96 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000001:00080000:3.0:1762166980.980528:0:30829:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992470 00000004:00010000:3.0:1762166980.980552:0:30829:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000051a6cf61 reply state 00000000c6eac482 transno 4294992471 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc7d16400/0x2f180c4effbaca96 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166980.980565:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc7d16400/0x2f180c4effbaca96 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166980.980572:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:3.0:1762166980.980576:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1762166980.980579:0:30829:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166980.980648:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+527:61766:x1847765450692480:12345-192.168.204.38@tcp:36:fsx.0 Request processed in 532us (676us total) trans 4294992471 rc 0/0 00000100:00100000:3.0:1762166980.980657:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30818 00000020:00080000:3.0:1762166980.980662:0:30829:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1762166980.981241:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.981269:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450692608 00000100:00100000:3.0:1762166980.981275:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450692608 00000100:00100000:3.0:1762166980.981304:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30819 00000100:00100000:3.0:1762166980.981312:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+527:61766:x1847765450692608:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:3.0:1762166980.981327:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166980.981339:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4410c00/0x2f180c4effbaca9d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea820 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.981373:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4410c00/0x2f180c4effbaca9d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea820 expref: 528 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.981381:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4410c00/0x2f180c4effbaca9d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea820 expref: 528 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.981393:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:3.0:1762166980.981395:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166980.981397:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4410c00, rc 0) 00000100:00100000:3.0:1762166980.981422:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+528:61766:x1847765450692608:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 113us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166980.981426:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30819 00000100:00100000:1.0:1762166980.982218:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.982254:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450692736 00000100:00100000:0.0:1762166980.982258:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450692736 00000100:00100000:0.0:1762166980.982285:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19375 00000100:00100000:0.0:1762166980.982292:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+23:61766:x1847765450692736:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:0.0:1762166980.982300:0:35247:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166980.982310:0:35247:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde200/0x2f180c4effbacaa4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea827 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.982332:0:35247:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde800/0x2f180c4effbac985 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea7b0 expref: 24 pid: 35248 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166980.982341:0:35247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166980.982343:0:35247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166980.982347:0:35247:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde200/0x2f180c4effbacaa4 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea827 expref: 24 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.982381:0:35247:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde800/0x2f180c4effbac985 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea7b0 expref: 24 pid: 35248 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166980.982393:0:35247:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde800/0x2f180c4effbac985 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea7b0 expref: 24 pid: 35248 timeout: 700 lvb_type: 1 00000100:00100000:0.0:1762166980.982404:0:35247:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:35247:1847765449783168:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166980.982473:0:35247:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc4eeae40 going to sleep for 11 seconds 00000100:00100000:1.0:1762166980.983161:0:35247:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:35247:1847765449783168:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166980.983188:0:35247:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde200/0x2f180c4effbacaa4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea827 expref: 24 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.983202:0:35247:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bde200, rc 0) 00000100:00100000:1.0:1762166980.983232:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+24:61766:x1847765450692736:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 941us (1015us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166980.983240:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19375 00000100:00100000:3.0:1762166980.983418:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.983465:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450692864 00000100:00100000:0.0:1762166980.983470:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450692864 00010000:00010000:0.0:1762166980.983514:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde800/0x2f180c4effbac985 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea7b0 expref: 24 pid: 35248 timeout: 700 lvb_type: 1 00000100:00100000:0.0:1762166980.983546:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9790 00000100:00100000:0.0:1762166980.983555:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d21880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+24:2418:x1847765450692864:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166980.983566:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166980.983585:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde800/0x2f180c4effbac985 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea7b0 expref: 24 pid: 35248 timeout: 700 lvb_type: 1 00010000:00010000:0.0:1762166980.983597:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde800/0x2f180c4effbac985 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea7b0 expref: 24 pid: 35248 timeout: 700 lvb_type: 1 00010000:00010000:0.0:1762166980.983615:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde800/0x2f180c4effbac985 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea7b0 expref: 24 pid: 35248 timeout: 700 lvb_type: 1 00010000:00010000:0.0:1762166980.983625:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166980.983628:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166980.983634:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde200/0x2f180c4effbacaa4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea827 expref: 23 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.983645:0:7421:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde200/0x2f180c4effbacaa4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea827 expref: 23 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.983668:0:7421:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde200/0x2f180c4effbacaa4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea827 expref: 23 pid: 35247 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166980.983679:0:7421:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7421:1847765449783296:192.168.204.38@tcp:105: 00000100:00100000:0.0:1762166980.983720:0:7421:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc4eeae40 going to sleep for 11 seconds 00000100:00100000:0.0:1762166980.984437:0:7421:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7421:1847765449783296:192.168.204.38@tcp:105: 00010000:00010000:0.0:1762166980.984445:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166980.984467:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d21880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765450692864:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 915us (1107us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166980.984473:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9790 00000100:00100000:3.0:1762166980.984702:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166980.984739:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450692992 00000100:00100000:1.0:1762166980.984742:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450692992 00000100:00100000:1.0:1762166980.984769:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19376 00000100:00100000:1.0:1762166980.984773:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf7838700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+23:61766:x1847765450692992:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:1.0:1762166980.984782:0:35247:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166980.984791:0:35247:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cc355be00/0x2f180c4effbacaab lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea82e expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.984803:0:35247:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945cc355b200/0x2f180c4effbac98c lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea7b7 expref: 24 pid: 9165 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166980.984808:0:35247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166980.984809:0:35247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166980.984822:0:35247:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355be00/0x2f180c4effbacaab lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea82e expref: 24 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.984838:0:35247:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945cc355b200/0x2f180c4effbac98c lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea7b7 expref: 24 pid: 9165 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166980.984845:0:35247:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945cc355b200/0x2f180c4effbac98c lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea7b7 expref: 24 pid: 9165 timeout: 700 lvb_type: 1 00000100:00100000:1.0:1762166980.984852:0:35247:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5bbb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:35247:1847765449783424:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166980.984881:0:35247:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc350f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166980.985511:0:35247:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5bbb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:35247:1847765449783424:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166980.985524:0:35247:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945cc355be00/0x2f180c4effbacaab lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea82e expref: 24 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166980.985532:0:35247:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355be00, rc 0) 00000100:00100000:1.0:1762166980.985555:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf7838700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+24:61766:x1847765450692992:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 782us (855us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166980.985560:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19376 00000100:00100000:3.0:1762166980.985662:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.985701:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450693120 00000100:00100000:0.0:1762166980.985706:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450693120 00010000:00010000:0.0:1762166980.985725:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355b200/0x2f180c4effbac98c lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea7b7 expref: 24 pid: 9165 timeout: 700 lvb_type: 1 00000100:00100000:0.0:1762166980.985754:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9791 00000100:00100000:0.0:1762166980.985763:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+24:2418:x1847765450693120:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166980.985773:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166980.985789:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945cc355b200/0x2f180c4effbac98c lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea7b7 expref: 24 pid: 9165 timeout: 700 lvb_type: 1 00010000:00010000:0.0:1762166980.985806:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945cc355b200/0x2f180c4effbac98c lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea7b7 expref: 24 pid: 9165 timeout: 700 lvb_type: 1 00010000:00010000:0.0:1762166980.985830:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cc355b200/0x2f180c4effbac98c lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea7b7 expref: 24 pid: 9165 timeout: 700 lvb_type: 1 00010000:00010000:0.0:1762166980.985840:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166980.985842:0:7421:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166980.985847:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945cc355be00/0x2f180c4effbacaab lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea82e expref: 23 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.985865:0:7421:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355be00/0x2f180c4effbacaab lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea82e expref: 23 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166980.985890:0:7421:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff945cc355be00/0x2f180c4effbacaab lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea82e expref: 23 pid: 35247 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166980.985907:0:7421:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7421:1847765449783552:192.168.204.38@tcp:105: 00000100:00100000:0.0:1762166980.985945:0:7421:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc4eeae40 going to sleep for 11 seconds 00000100:00100000:0.0:1762166980.986658:0:7421:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7421:1847765449783552:192.168.204.38@tcp:105: 00010000:00010000:0.0:1762166980.986666:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166980.986692:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765450693120:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 930us (1031us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166980.986700:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9791 00000100:00100000:1.0:1762166980.986887:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.986914:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450693248 00000100:00100000:3.0:1762166980.986920:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450693248 00000100:00100000:1.0:1762166980.986925:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00002000:00010000:3.0:1762166980.986949:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (32254->18446744073709551615) 00000100:00100000:1.0:1762166980.986957:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00002000:00100000:3.0:1762166980.986958:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5bbb800 with x1847765450693248 ext(32254->18446744073709551615) 00002000:00010000:3.0:1762166980.986967:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5bbb800. 00000100:00100000:0.0:1762166980.986973:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450693376 00000100:00100000:0.0:1762166980.986979:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450693376 00000100:00100000:3.0:1762166980.986987:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450693504 00000100:00100000:3.0:1762166980.986992:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450693504 00002000:00010000:0.0:1762166980.986997:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:0.0:1762166980.987003:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5bba300 with x1847765450693376 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166980.987006:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:3.0:1762166980.987010:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5bbad80 with x1847765450693504 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166980.987010:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc5bba300. 00000100:00100000:2.0:1762166980.987018:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2686 00002000:00010000:3.0:1762166980.987020:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5bbad80. 00000100:00100000:2.0:1762166980.987035:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765450693248:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:0.0:1762166980.987053:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2687 00000100:00100000:3.0:1762166980.987063:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2688 00000100:00100000:0.0:1762166980.987068:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765450693376:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:3.0:1762166980.987078:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+24:2418:x1847765450693504:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:3.0:1762166980.987195:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166980.987197:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166980.987199:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00010000:0.0:1762166980.987201:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00010000:3.0:1762166980.987204:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166981 -> 1762166981 00002000:00010000:0.0:1762166980.987205:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166981 -> 1762166981 00002000:00010000:0.0:1762166980.987210:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00002000:00010000:3.0:1762166980.987211:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00002000:00010000:0.0:1762166980.987213:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00002000:00010000:3.0:1762166980.987217:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1762166980.987246:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+24:2418:x1847765450693376:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 185us (324us total) trans 21474843444 rc 0/0 00000100:00100000:3.0:1762166980.987252:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+26:2418:x1847765450693504:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 175us (294us total) trans 17179876686 rc 0/0 00000100:00100000:0.0:1762166980.987257:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2687 00002000:00010000:0.0:1762166980.987264:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00000100:00100000:3.0:1762166980.987268:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2688 00002000:00100000:0.0:1762166980.987269:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5bba300 with x1847765450693376 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166980.987274:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00010000:0.0:1762166980.987275:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc5bba300. 00002000:00100000:3.0:1762166980.987280:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5bbad80 with x1847765450693504 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166980.987286:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5bbad80. 00002000:00010000:2.0:1762166980.987366:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 148474 -> 32254 00002000:00010000:2.0:1762166980.987370:0:23943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00010000:2.0:1762166980.987372:0:23943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166981 -> 1762166981 00002000:00010000:2.0:1762166980.987373:0:23943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00002000:00010000:2.0:1762166980.987375:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 288 -> 72 00000100:00100000:2.0:1762166980.987399:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+25:2419:x1847765450693248:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 371us (513us total) trans 17179876687 rc 0/0 00000100:00100000:2.0:1762166980.987404:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2686 00002000:00010000:2.0:1762166980.987407:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (32254->18446744073709551615) 00002000:00100000:2.0:1762166980.987409:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5bbb800 with x1847765450693248 ext(32254->18446744073709551615) 00002000:00010000:2.0:1762166980.987413:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5bbb800. 00000100:00100000:1.0:1762166980.988256:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166980.988294:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450693632 00000100:00100000:3.0:1762166980.988300:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450693632 00000100:00100000:3.0:1762166980.988335:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30820 00000100:00100000:3.0:1762166980.988344:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc3551880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+528:61766:x1847765450693632:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:3.0:1762166980.988357:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166980.988373:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63000/0x2f180c4effbacab2 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea835 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166980.988469:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62600/0x2f180c4effbacab9 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:3.0:1762166980.988506:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62600/0x2f180c4effbacab9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166980.988518:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62600/0x2f180c4effbacab9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000004:00200000:3.0:1762166980.988554:0:30829:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 32254 00000004:00200000:3.0:1762166980.988559:0:30829:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166980.988642:0:30829:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62600/0x2f180c4effbacab9 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166980.988673:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63000/0x2f180c4effbacab2 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea835 expref: 530 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.988689:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62600/0x2f180c4effbacab9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea835 expref: 529 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166980.988697:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166980.988700:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166980.988703:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4b62600, rc 0) 00000100:00100000:2.0:1762166980.988740:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc3551880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+529:61766:x1847765450693632:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 398us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166980.988747:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30820 00000100:00100000:3.0:1762166980.992064:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.992114:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450693760 00000100:00100000:2.0:1762166980.992123:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450693760 00000100:00100000:2.0:1762166980.992193:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2689 00000100:00100000:2.0:1762166980.992204:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+25:2419:x1847765450693760:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:2.0:1762166980.992410:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 32254 -> 32254 00002000:00010000:2.0:1762166980.992413:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00010000:2.0:1762166980.992414:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166981 -> 1762166981 00002000:00010000:2.0:1762166980.992416:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00002000:00010000:2.0:1762166980.992418:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 72 -> 72 00000100:00100000:2.0:1762166980.992460:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765450693760:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 261us (403us total) trans 17179876688 rc 0/0 00000100:00100000:2.0:1762166980.992465:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2689 00000100:00100000:1.0:1762166980.994164:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166980.994203:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450693888 00000100:00100000:2.0:1762166980.994208:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450693888 00002000:00100000:2.0:1762166980.994232:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (0->28671) req@ffff945cc3553480 x1847765450693888/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 504/0 e 0 to 0 dl 1762166991 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166980.994244:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cc3553480 with x1847765450693888 ext(0->28671) 00002000:00010000:2.0:1762166980.994248:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cc3553480 00000100:00100000:2.0:1762166980.994264:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2690 00000100:00100000:2.0:1762166980.994269:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc3553480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+26:2418:x1847765450693888:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:2.0:1762166980.995067:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc3553480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+26:2418:x1847765450693888:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 796us (906us total) trans 0 rc 20480/20480 00000100:00100000:2.0:1762166980.995073:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2690 00002000:00100000:2.0:1762166980.995079:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (0->28671) req@ffff945cc3553480 x1847765450693888/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:11/0 lens 504/440 e 0 to 0 dl 1762166991 ref 1 fl Complete:/600/0 rc 20480/20480 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166980.995085:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cc3553480 with x1847765450693888 ext(0->28671) 00002000:00010000:2.0:1762166980.995089:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cc3553480 00000100:00100000:3.0:1762166980.996715:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166980.996762:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450694144 00000100:00100000:0.0:1762166980.996768:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450694144 00000100:00100000:0.0:1762166980.996800:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11971 00000100:00100000:0.0:1762166980.996806:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+529:61766:x1847765450694144:12345-192.168.204.38@tcp:35:fsx.0 00000100:00100000:0.0:1762166980.997036:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+530:61766:x1847765450694144:12345-192.168.204.38@tcp:35:fsx.0 Request processed in 230us (325us total) trans 4294992472 rc 0/0 00000100:00100000:0.0:1762166980.997041:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11971 00000100:00100000:1.0:1762166981.004594:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.004646:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450694272 00000100:00100000:2.0:1762166981.004657:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450694272 00000100:00080000:1.0:1762166981.004703:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1762166981.004731:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30821 00000100:00100000:2.0:1762166981.004744:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc3553b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+530:61879:x1847765450694272:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166981.004771:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166981.004792:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4ac00/0x2f180c4effbacac0 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea83c expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.004869:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4a000/0x2f180c4effbacac7 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166981.004882:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4a000/0x2f180c4effbacac7 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.004891:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4a000/0x2f180c4effbacac7 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.004901:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4a400/0x2f180c4effbacace lrc: 3/1,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166981.004905:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4a400/0x2f180c4effbacace lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.004909:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4a400/0x2f180c4effbacace lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.004996:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4b200/0x2f180c4effbacad5 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166981.005006:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4b200/0x2f180c4effbacad5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.005012:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4b200/0x2f180c4effbacad5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000004:00200000:2.0:1762166981.005054:0:30829:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 32254 00000004:00200000:2.0:1762166981.005059:0:30829:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166981.005078:0:30829:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4b200/0x2f180c4effbacad5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.005090:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4b200/0x2f180c4effbacad5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.005100:0:30829:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4a000/0x2f180c4effbacac7 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.005107:0:30829:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4a000/0x2f180c4effbacac7 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.005113:0:30829:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4a000/0x2f180c4effbacac7 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.005124:0:30829:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4a000/0x2f180c4effbacac7 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.005130:0:30829:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc3d4a000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166981.005134:0:30829:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4a000/0x2f180c4effbacac7 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.005142:0:30829:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4a000/0x2f180c4effbacac7 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.005155:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0x0 (ffff945bc809b900) 00010000:00010000:2.0:1762166981.005159:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166981.005163:0:30829:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4a000/0x2f180c4effbacac7 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.005169:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4a000/0x2f180c4effbacac7 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.005183:0:30829:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4a400/0x2f180c4effbacace lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.005190:0:30829:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4a400/0x2f180c4effbacace lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.005196:0:30829:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4a400/0x2f180c4effbacace lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.005201:0:30829:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc3d4a400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166981.005203:0:30829:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4a400/0x2f180c4effbacace lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.005209:0:30829:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4a400/0x2f180c4effbacace lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.005221:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0xdd396665 (ffff945bc809ba00) 00010000:00010000:2.0:1762166981.005223:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166981.005226:0:30829:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4a400/0x2f180c4effbacace lrc: 2/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.005231:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4a400/0x2f180c4effbacace lrc: 0/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.005260:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4ac00/0x2f180c4effbacac0 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea83c expref: 532 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.005273:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4b200/0x2f180c4effbacad5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea83c expref: 531 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.005279:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166981.005281:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166981.005284:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc3d4b200, rc 0) 00000100:00100000:2.0:1762166981.005346:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc3553b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+531:61879:x1847765450694272:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 606us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166981.005353:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30821 00000100:00100000:1.0:1762166981.006442:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166981.006518:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450694400 00000100:00100000:0.0:1762166981.006524:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450694400 00000100:00100000:0.0:1762166981.006562:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 899 00000100:00100000:0.0:1762166981.006569:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc3550380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+531:2418:x1847765450694400:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166981.006580:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166981.006591:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4b200/0x2f180c4effbacad5 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea83c expref: 531 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.006601:0:7421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:0.0:1762166981.006604:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166981.006629:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc3550380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+530:2418:x1847765450694400:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 61us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166981.006633:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 899 00000100:00100000:3.0:1762166981.007191:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.007227:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450694656 00000100:00100000:2.0:1762166981.007232:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450694656 00000100:00100000:2.0:1762166981.007268:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30822 00000100:00100000:2.0:1762166981.007277:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+530:61879:x1847765450694656:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166981.007289:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166981.007299:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42ff400/0x2f180c4effbacadc lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea843 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.007374:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc936ac00/0x2f180c4effbacae3 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166981.007382:0:30829:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62600/0x2f180c4effbacab9 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea835 expref: 531 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.007388:0:30829:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc936ac00/0x2f180c4effbacae3 lrc: 4/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.007416:0:30829:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62600/0x2f180c4effbacab9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea835 expref: 531 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.007426:0:30829:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62600/0x2f180c4effbacab9 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea835 expref: 531 pid: 30829 timeout: 700 lvb_type: 0 00000100:00100000:2.0:1762166981.007438:0:30829:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a29500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:30829:1847765449783680:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166981.007531:0:30829:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a1c00 going to sleep for 11 seconds 00000100:00100000:2.0:1762166981.008166:0:30829:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a29500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:30829:1847765449783680:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166981.008187:0:30829:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc936ac00/0x2f180c4effbacae3 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000100:00100000:3.0:1762166981.008469:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166981.008535:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450694784 00000100:00100000:0.0:1762166981.008541:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450694784 00010000:00010000:0.0:1762166981.008559:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62600/0x2f180c4effbacab9 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea835 expref: 532 pid: 30829 timeout: 700 lvb_type: 0 00000100:00100000:0.0:1762166981.008604:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9792 00000100:00100000:0.0:1762166981.008612:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cceb4b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+532:2419:x1847765450694784:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166981.008622:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166981.008628:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62600/0x2f180c4effbacab9 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea835 expref: 532 pid: 30829 timeout: 700 lvb_type: 0 00010000:00010000:0.0:1762166981.008644:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62600/0x2f180c4effbacab9 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea835 expref: 532 pid: 30829 timeout: 700 lvb_type: 0 00010000:00010000:0.0:1762166981.008661:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62600/0x2f180c4effbacab9 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea835 expref: 532 pid: 30829 timeout: 700 lvb_type: 0 00010000:00010000:0.0:1762166981.008673:0:7421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:0.0:1762166981.008678:0:7421:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc936ac00/0x2f180c4effbacae3 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.008686:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc936ac00/0x2f180c4effbacae3 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.008693:0:7421:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc936ac00/0x2f180c4effbacae3 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.008717:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166981.008738:0:30829:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc936ac00/0x2f180c4effbacae3 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.008745:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc936ac00/0x2f180c4effbacae3 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000100:00100000:0.0:1762166981.008754:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cceb4b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+531:2419:x1847765450694784:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 141us (284us total) trans 0 rc 0/0 00000004:00200000:2.0:1762166981.008763:0:30829:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 32254 00000100:00100000:0.0:1762166981.008763:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9792 00010000:00010000:2.0:1762166981.008897:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42ff400/0x2f180c4effbacadc lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea843 expref: 532 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.008912:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc936ac00/0x2f180c4effbacae3 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea843 expref: 531 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.008919:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166981.008921:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1762166981.008923:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc936ac00, rc 0) 00000100:00100000:2.0:1762166981.008951:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+531:61879:x1847765450694656:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1676us (1761us total) trans 4294992473 rc 0/0 00000100:00100000:2.0:1762166981.008958:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30822 00000100:00100000:3.0:1762166981.010048:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.010084:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450694912 00000100:00100000:2.0:1762166981.010091:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450694912 00000100:00100000:2.0:1762166981.010130:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30823 00000100:00100000:2.0:1762166981.010138:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+531:61879:x1847765450694912:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166981.010158:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166981.010170:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc936b200/0x2f180c4effbacaf1 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea84a expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.010241:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc936a800/0x2f180c4effbacaf8 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166981.010253:0:30829:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc936ac00/0x2f180c4effbacae3 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea843 expref: 532 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.010260:0:30829:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc936a800/0x2f180c4effbacaf8 lrc: 4/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.010289:0:30829:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc936ac00/0x2f180c4effbacae3 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea843 expref: 532 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.010301:0:30829:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc936ac00/0x2f180c4effbacae3 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea843 expref: 532 pid: 30829 timeout: 700 lvb_type: 0 00000100:00100000:2.0:1762166981.010314:0:30829:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a29500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:30829:1847765449783808:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166981.010375:0:30829:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a1600 going to sleep for 11 seconds 00000100:00100000:2.0:1762166981.011593:0:30829:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a29500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:30829:1847765449783808:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166981.011616:0:30829:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc936a800/0x2f180c4effbacaf8 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000100:00100000:3.0:1762166981.011854:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166981.011898:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450695040 00000100:00100000:0.0:1762166981.011905:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450695040 00010000:00010000:0.0:1762166981.011930:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc936ac00/0x2f180c4effbacae3 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea843 expref: 533 pid: 30829 timeout: 700 lvb_type: 0 00000100:00100000:0.0:1762166981.011961:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9793 00000100:00100000:0.0:1762166981.011971:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+533:2419:x1847765450695040:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166981.011983:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166981.011989:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc936ac00/0x2f180c4effbacae3 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea843 expref: 533 pid: 30829 timeout: 700 lvb_type: 0 00010000:00010000:0.0:1762166981.012003:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc936ac00/0x2f180c4effbacae3 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea843 expref: 533 pid: 30829 timeout: 700 lvb_type: 0 00010000:00010000:0.0:1762166981.012022:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc936ac00/0x2f180c4effbacae3 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea843 expref: 533 pid: 30829 timeout: 700 lvb_type: 0 00010000:00010000:0.0:1762166981.012037:0:7421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:0.0:1762166981.012041:0:7421:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc936a800/0x2f180c4effbacaf8 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.012050:0:7421:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc936a800/0x2f180c4effbacaf8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.012057:0:7421:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc936a800/0x2f180c4effbacaf8 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.012081:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166981.012099:0:30829:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc936a800/0x2f180c4effbacaf8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.012106:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc936a800/0x2f180c4effbacaf8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000100:00100000:0.0:1762166981.012121:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e1e11365-ba0b-405b-99c9-a704373217f2+532:2419:x1847765450695040:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 151us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166981.012130:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9793 00000004:00200000:2.0:1762166981.012140:0:30829:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 32254 00000004:00200000:2.0:1762166981.012146:0:30829:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166981.012160:0:30829:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc936a800/0x2f180c4effbacaf8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.012182:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc936b200/0x2f180c4effbacaf1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea84a expref: 532 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.012193:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc936a800/0x2f180c4effbacaf8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea84a expref: 531 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.012198:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166981.012201:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166981.012204:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc936a800, rc 0) 00000100:00100000:2.0:1762166981.012241:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+531:61879:x1847765450694912:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2103us (2196us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166981.012249:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30823 00000100:00100000:3.0:1762166981.013711:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.013753:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450695296 00000100:00100000:2.0:1762166981.013760:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450695296 00000100:00100000:2.0:1762166981.013790:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30824 00000100:00100000:2.0:1762166981.013795:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+531:61879:x1847765450695296:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166981.013809:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166981.013839:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4ac00/0x2f180c4effbacaff lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea851 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.013921:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4a400/0x2f180c4effbacb06 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166981.013930:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4a400/0x2f180c4effbacb06 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.013936:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4a400/0x2f180c4effbacb06 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000004:00200000:2.0:1762166981.013950:0:30829:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 32254 00010000:00010000:2.0:1762166981.014053:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4ac00/0x2f180c4effbacaff lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea851 expref: 534 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.014069:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4a400/0x2f180c4effbacb06 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea851 expref: 533 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.014077:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166981.014079:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166981.014082:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc3d4a400, rc 0) 00000100:00100000:2.0:1762166981.014118:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+533:61879:x1847765450695296:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 323us (446us total) trans 4294992474 rc 0/0 00000100:00100000:2.0:1762166981.014123:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30824 00000100:00100000:1.0:1762166981.015288:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166981.015320:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166981.015358:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166981.015363:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450695424 00000100:00100000:0.0:1762166981.015374:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450695424 00000100:00100000:2.0:1762166981.015387:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450695552 00000100:00100000:2.0:1762166981.015394:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450695552 00000100:00100000:3.0:1762166981.015414:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450695680 00000100:00100000:3.0:1762166981.015426:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450695680 00000100:00100000:0.0:1762166981.015432:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19377 00000100:00100000:0.0:1762166981.015445:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc3550380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+27:2418:x1847765450695424:12345-192.168.204.38@tcp:1:lfs.0 00000100:00100000:2.0:1762166981.015452:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19378 00000100:00100000:2.0:1762166981.015467:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765450695552:12345-192.168.204.38@tcp:1:lfs.0 00000100:00100000:1.0:1762166981.015526:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19379 00010000:00010000:0.0:1762166981.015534:0:35247:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde800/0x2f180c4effbacb14 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.015540:0:9168:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945cc3d4a000/0x2f180c4effbacb1b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166981.015550:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+27:2419:x1847765450695680:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:2.0:1762166981.015562:0:9168:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde200/0x2f180c4effbacaa4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea827 expref: 24 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.015563:0:35247:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbaca81 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 180224->196607) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea812 expref: 27 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.015580:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166981.015581:0:35247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166981.015584:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166981.015585:0:35247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166981.015590:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cc3d4a000/0x2f180c4effbacb1b lrc: 4/0,1 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.015591:0:35247:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde800/0x2f180c4effbacb14 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.015607:0:28874:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945cc355a000/0x2f180c4effbacb22 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.015633:0:28874:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945cc355be00/0x2f180c4effbacaab lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea82e expref: 27 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.015641:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166981.015646:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166981.015647:0:9168:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde200/0x2f180c4effbacaa4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea827 expref: 24 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.015647:0:35247:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbaca81 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 180224->196607) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea812 expref: 27 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.015652:0:28874:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355a000/0x2f180c4effbacb22 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.015695:0:35247:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbaca81 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 180224->196607) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea812 expref: 27 pid: 35247 timeout: 700 lvb_type: 0 00010000:00010000:2.0:1762166981.015696:0:9168:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde200/0x2f180c4effbacaa4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea827 expref: 24 pid: 35247 timeout: 700 lvb_type: 0 00000100:00100000:0.0:1762166981.015722:0:35247:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:35247:1847765449784064:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166981.015725:0:9168:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a29500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9168:1847765449783936:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166981.015731:0:28874:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945cc355be00/0x2f180c4effbacaab lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea82e expref: 27 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.015749:0:28874:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945cc355be00/0x2f180c4effbacaab lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea82e expref: 27 pid: 35247 timeout: 700 lvb_type: 0 00000100:00100000:1.0:1762166981.015765:0:28874:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bccb7c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28874:1847765449784192:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166981.015827:0:9168:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc4eeae40 going to sleep for 11 seconds 00000100:00100000:0.0:1762166981.015828:0:35247:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1fe20c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166981.015834:0:28874:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc350f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166981.016809:0:9168:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a29500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9168:1847765449783936:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166981.016809:0:35247:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:35247:1847765449784064:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166981.016848:0:35247:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde800/0x2f180c4effbacb14 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.016854:0:9168:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945cc3d4a000/0x2f180c4effbacb1b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166981.016861:0:28874:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bccb7c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28874:1847765449784192:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166981.016898:0:28874:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945cc355a000/0x2f180c4effbacb22 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166981.017068:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166981.017106:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450695936 00000100:00100000:0.0:1762166981.017113:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450695936 00000100:00100000:1.0:1762166981.017115:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:0.0:1762166981.017144:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355be00/0x2f180c4effbacaab lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea82e expref: 28 pid: 35247 timeout: 700 lvb_type: 0 00000100:00100000:1.0:1762166981.017160:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.017175:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450695808 00000100:00100000:2.0:1762166981.017182:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450695808 00000100:00100000:0.0:1762166981.017198:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450696064 00010000:00010000:2.0:1762166981.017208:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbaca81 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 180224->196607) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea812 expref: 29 pid: 35247 timeout: 700 lvb_type: 0 00000100:00100000:0.0:1762166981.017212:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450696064 00000100:00100000:1.0:1762166981.017223:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9794 00010000:00010000:0.0:1762166981.017236:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde200/0x2f180c4effbacaa4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea827 expref: 25 pid: 35247 timeout: 700 lvb_type: 0 00000100:00100000:1.0:1762166981.017243:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+29:2416:x1847765450695936:12345-192.168.204.38@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1762166981.017255:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9795 00010000:00010000:1.0:1762166981.017270:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1762166981.017285:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+29:2419:x1847765450695808:12345-192.168.204.38@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1762166981.017287:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9796 00010000:00010000:1.0:1762166981.017297:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945cc355be00/0x2f180c4effbacaab lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea82e expref: 29 pid: 35247 timeout: 700 lvb_type: 0 00010000:00010000:3.0:1762166981.017308:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1762166981.017310:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+25:2419:x1847765450696064:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166981.017313:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945cc355be00/0x2f180c4effbacaab lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea82e expref: 29 pid: 35247 timeout: 700 lvb_type: 0 00010000:00010000:3.0:1762166981.017327:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbaca81 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 180224->196607) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea812 expref: 29 pid: 35247 timeout: 700 lvb_type: 0 00010000:00010000:2.0:1762166981.017336:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166981.017345:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbaca81 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 180224->196607) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea812 expref: 29 pid: 35247 timeout: 700 lvb_type: 0 00010000:00010000:1.0:1762166981.017345:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cc355be00/0x2f180c4effbacaab lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea82e expref: 29 pid: 35247 timeout: 700 lvb_type: 0 00010000:00010000:2.0:1762166981.017362:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde200/0x2f180c4effbacaa4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea827 expref: 25 pid: 35247 timeout: 700 lvb_type: 0 00010000:00010000:1.0:1762166981.017374:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166981.017375:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbaca81 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 180224->196607) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea812 expref: 28 pid: 35247 timeout: 700 lvb_type: 0 00010000:00010000:1.0:1762166981.017380:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166981.017387:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde200/0x2f180c4effbacaa4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea827 expref: 25 pid: 35247 timeout: 700 lvb_type: 0 00010000:00010000:1.0:1762166981.017388:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945cc355a000/0x2f180c4effbacb22 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.017435:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166981.017439:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166981.017439:0:9458:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355a000/0x2f180c4effbacb22 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.017446:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde800/0x2f180c4effbacb14 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.017456:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde200/0x2f180c4effbacaa4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea827 expref: 25 pid: 35247 timeout: 700 lvb_type: 0 00010000:00010000:3.0:1762166981.017460:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde800/0x2f180c4effbacb14 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.017464:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166981.017512:0:28874:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945cc355a000/0x2f180c4effbacb22 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.017521:0:28874:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cc355a000/0x2f180c4effbacb22 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.017538:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166981.017542:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166981.017543:0:28874:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945cc355a000/0x2f180c4effbacb22 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.017547:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945cc3d4a000/0x2f180c4effbacb1b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.017550:0:28874:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355a000/0x2f180c4effbacb22 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.017554:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166981.017561:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+27:2416:x1847765450695936:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 317us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166981.017596:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+27:2419:x1847765450695808:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 314us (476us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166981.017598:0:28874:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945cc355a000/0x2f180c4effbacb22 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.017604:0:6479:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cc3d4a000/0x2f180c4effbacb1b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166981.017606:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9794 00000100:00100000:3.0:1762166981.017639:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9795 00010000:00010000:0.0:1762166981.017641:0:28874:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355a000 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166981.017650:0:28874:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc355a000/0x2f180c4effbacb22 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.017658:0:35247:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde800/0x2f180c4effbacb14 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.017662:0:28874:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc355a000/0x2f180c4effbacb22 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.017663:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166981.017666:0:35247:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde800/0x2f180c4effbacb14 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166981.017704:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765450696064:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 395us (545us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166981.017713:0:28874:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945cc355a000/0x2f180c4effbacb22 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.017719:0:35247:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde800/0x2f180c4effbacb14 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166981.017720:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9796 00010000:00010000:0.0:1762166981.017723:0:28874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cc355a000/0x2f180c4effbacb22 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.017758:0:9168:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945cc3d4a000/0x2f180c4effbacb1b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.017768:0:35247:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde800/0x2f180c4effbacb14 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.017778:0:9168:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cc3d4a000/0x2f180c4effbacb1b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.017786:0:35247:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde800/0x2f180c4effbacb14 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.017805:0:35247:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bde800 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166981.017808:0:9168:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945cc3d4a000/0x2f180c4effbacb1b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.017824:0:35247:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde800/0x2f180c4effbacb14 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166981.017835:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+25:2419:x1847765450695680:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 2292us (2472us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166981.017864:0:9168:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945cc3d4a000/0x2f180c4effbacb1b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.017870:0:35247:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde800/0x2f180c4effbacb14 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166981.017870:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19379 00010000:00010000:2.0:1762166981.017889:0:9168:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945cc3d4a000/0x2f180c4effbacb1b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.017898:0:9168:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc3d4a000 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166981.017902:0:35247:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde800/0x2f180c4effbacb14 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.017903:0:9168:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945cc3d4a000/0x2f180c4effbacb1b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.017954:0:9168:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945cc3d4a000/0x2f180c4effbacb1b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.017956:0:35247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde800/0x2f180c4effbacb14 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.018007:0:9168:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945cc3d4a000/0x2f180c4effbacb1b lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.018016:0:9168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cc3d4a000/0x2f180c4effbacb1b lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166981.018057:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc3550380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+24:2418:x1847765450695424:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 2613us (2771us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166981.018064:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19377 00000100:00100000:2.0:1762166981.018078:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765450695552:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 2613us (2753us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166981.018089:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19378 00000100:00100000:3.0:1762166981.018912:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.018963:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450696320 00000100:00100000:2.0:1762166981.018970:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450696320 00000100:00100000:2.0:1762166981.019010:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30825 00000100:00100000:2.0:1762166981.019020:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+533:61879:x1847765450696320:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:2.0:1762166981.019075:0:30829:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1762166981.019094:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4410c00/0x2f180c4effbaca9d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea820 expref: 533 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.019115:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc936a800/0x2f180c4effbacaf8 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea84a expref: 532 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.019127:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166981.019131:0:30829:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166981.019159:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4b200/0x2f180c4effbacb29 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166981.019172:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4b200/0x2f180c4effbacb29 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.019181:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4b200/0x2f180c4effbacb29 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000040:00080000:2.0:1762166981.019450:0:30829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5943, 88 off465640 00000004:00080000:2.0:1762166981.019459:0:30829:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 600167980849ns, next at 600144491692ns, rc = 0 00000040:00080000:2.0:1762166981.019528:0:30829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5942, 88 off465640 00000004:00080000:2.0:1762166981.019533:0:30829:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 600168055536ns, next at 600144525370ns, rc = 0 00000040:00080000:2.0:1762166981.019553:0:30829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5943, 88 off465728 00000004:00080000:2.0:1762166981.019557:0:30829:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 600168078966ns, next at 600144525370ns, rc = 0 00000040:00080000:2.0:1762166981.019571:0:30829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5944, 88 off465728 00000004:00080000:2.0:1762166981.019575:0:30829:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 600168097516ns, next at 600144491692ns, rc = 0 00000040:00080000:2.0:1762166981.019589:0:30829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5945, 88 off465816 00000004:00080000:2.0:1762166981.019592:0:30829:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 600168113951ns, next at 600144491692ns, rc = 0 00000040:00080000:2.0:1762166981.019603:0:30829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5944, 88 off465816 00000004:00080000:2.0:1762166981.019606:0:30829:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 600168128176ns, next at 600144525370ns, rc = 0 00000001:00080000:1.0:1762166981.020495:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294992475 is committed 00000004:00080000:1.0:1762166981.020505:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3305 committed 00000004:00080000:1.0:1762166981.020519:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3302 committed 00000004:00080000:1.0:1762166981.020533:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3301 committed 00010000:00010000:3.0:1762166981.020537:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc7d16400/0x2f180c4effbaca96 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00000004:00080000:1.0:1762166981.020537:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3304 committed 00000004:00080000:1.0:1762166981.020542:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3303 committed 00010000:00010000:3.0:1762166981.020547:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc7d16400/0x2f180c4effbaca96 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00000004:00080000:1.0:1762166981.020549:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3300 committed 00010000:00010000:3.0:1762166981.020556:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc7d16400/0x2f180c4effbaca96 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.020562:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc7d16400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166981.020566:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc7d16400/0x2f180c4effbaca96 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.020585:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc7d16400/0x2f180c4effbaca96 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.020608:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:3.0:1762166981.020613:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166981.020618:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc7d16400/0x2f180c4effbaca96 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.020625:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc7d16400/0x2f180c4effbaca96 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00000100:00100000:2.0:1762166981.020671:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449784576:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1762166981.020676:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449784320:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166981.020677:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449784448:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1762166981.020763:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166981.020774:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449784704:0@lo:2:osp-syn-1-1.0 00000004:00010000:3.0:1762166981.020799:0:30829:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000deb3813b reply state 00000000ab2395b4 transno 4294992475 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4b200/0x2f180c4effbacb29 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.020820:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4b200/0x2f180c4effbacb29 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.020828:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00000100:00100000:1.0:1762166981.020828:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449784576 00010000:00010000:3.0:1762166981.020833:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1762166981.020835:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449784576 00000100:00100000:3.0:1762166981.020836:0:30829:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166981.020843:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166981.020881:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166981.020899:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449784704 00000100:00100000:1.0:1762166981.020904:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449784704 00010000:00080000:3.0:1762166981.020912:0:30829:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1762166981.020918:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449784320 00000100:00100000:0.0:1762166981.020925:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449784320 00000100:00100000:2.0:1762166981.020930:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449784832:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166981.020941:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+526:61879:x1847765450696320:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 1918us (2024us total) trans 4294992475 rc 0/0 00000100:00100000:1.0:1762166981.020941:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19380 00000100:00100000:3.0:1762166981.020952:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30825 00000100:00100000:1.0:1762166981.020959:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5807100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+20:3634:x1847765449784576:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1762166981.020970:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166981.020978:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19381 00010000:00010000:3.0:1762166981.020979:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4b200/0x2f180c4effbacb29 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.020986:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4b200/0x2f180c4effbacb29 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.020991:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4b200/0x2f180c4effbacb29 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00000100:00100000:0.0:1762166981.020996:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+11:3635:x1847765449784704:12345-0@lo:2:osp-syn-1-1.0 00010000:00010000:3.0:1762166981.021000:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc3d4b200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166981.021006:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4b200/0x2f180c4effbacb29 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00000100:00100000:2.0:1762166981.021013:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449784832 00010000:00010000:3.0:1762166981.021014:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4b200/0x2f180c4effbacb29 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30829 initiator: MDT1 00000100:00100000:2.0:1762166981.021019:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449784832 00010000:00010000:3.0:1762166981.021035:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:3.0:1762166981.021039:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166981.021043:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4b200/0x2f180c4effbacb29 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.021049:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4b200/0x2f180c4effbacb29 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00000100:00100000:2.0:1762166981.021070:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19382 00000100:00100000:2.0:1762166981.021087:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5806d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+21:3636:x1847765449784320:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1762166981.021120:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5807100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+21:3634:x1847765449784576:12345-0@lo:2:osp-syn-0-1.0 Request processed in 168us (356us total) trans 21474843445 rc 0/0 00000100:00100000:0.0:1762166981.021127:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+13:3635:x1847765449784704:12345-0@lo:2:osp-syn-1-1.0 Request processed in 138us (286us total) trans 17179876689 rc 0/0 00000100:00100000:1.0:1762166981.021128:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19380 00000100:00100000:0.0:1762166981.021140:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19381 00000100:00100000:1.0:1762166981.021152:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19383 00000100:00100000:1.0:1762166981.021161:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5805f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+12:3636:x1847765449784832:12345-0@lo:2:osp-syn-1-1.0 00000004:00080000:0.0:1762166981.021198:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc4a28380/2, rc 0, transno 17179876689 00000100:00100000:3.0:1762166981.021204:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:2.0:1762166981.021208:0:8382:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:0.0:1762166981.021210:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449784704:0@lo:2:osp-syn-1-1.0 00002000:00010000:2.0:1762166981.021218:0:8382:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb mtime from disk: 1762166966 -> 1762166966 00002000:00010000:2.0:1762166981.021224:0:8382:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1762166981.021227:0:8382:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb ctime from disk: 1762166966 -> 1762166966 00002000:00010000:2.0:1762166981.021231:0:8382:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:1.0:1762166981.021238:0:9168:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb size from disk: 148474 -> 148474 00000100:00100000:0.0:1762166981.021241:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449784448 00002000:00010000:1.0:1762166981.021242:0:9168:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00010000:1.0:1762166981.021247:0:9168:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00000100:00100000:0.0:1762166981.021248:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449784448 00002000:00010000:1.0:1762166981.021249:0:9168:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00002000:00010000:1.0:1762166981.021254:0:9168:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1762166981.021288:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449784960:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1762166981.021292:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19384 00000100:00100000:2.0:1762166981.021306:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5806d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+21:3636:x1847765449784320:12345-0@lo:2:osp-syn-0-1.0 Request processed in 222us (426us total) trans 21474843446 rc 0/0 00000100:00100000:0.0:1762166981.021308:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4012d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+14:3633:x1847765449784448:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1762166981.021314:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5805f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+14:3636:x1847765449784832:12345-0@lo:2:osp-syn-1-1.0 Request processed in 151us (342us total) trans 17179876690 rc 0/0 00000100:00100000:3.0:1762166981.021333:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166981.021342:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19382 00000100:00100000:1.0:1762166981.021352:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19383 00000100:00100000:2.0:1762166981.021376:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449784960 00000100:00100000:2.0:1762166981.021382:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449784960 00000100:00080000:1.0:1762166981.021389:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1762166981.021393:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1762166981.021416:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19385 00000004:00080000:3.0:1762166981.021429:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf783ea00/2, rc 0, transno 21474843445 00000100:00100000:1.0:1762166981.021432:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4012680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+21:3633:x1847765449784960:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166981.021437:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449784576:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1762166981.021439:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4012d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+14:3633:x1847765449784448:12345-0@lo:2:osp-syn-1-1.0 Request processed in 133us (235us total) trans 17179876691 rc 0/0 00000100:00100000:0.0:1762166981.021452:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19384 00000004:00080000:3.0:1762166981.021499:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc4a29500/2, rc 0, transno 17179876691 00000100:00100000:3.0:1762166981.021505:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449784448:0@lo:2:osp-syn-1-1.0 00000004:00080000:2.0:1762166981.021516:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf783d180/2, rc 0, transno 21474843446 00002000:00010000:1.0:1762166981.021517:0:8380:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166981.021527:0:8380:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00010000:1.0:1762166981.021530:0:8380:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00000100:00100000:2.0:1762166981.021533:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449784320:0@lo:2:osp-syn-0-1.0 00002000:00010000:1.0:1762166981.021533:0:8380:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00002000:00010000:1.0:1762166981.021539:0:8380:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb blocks from disk: 0 -> 0 00000004:00080000:2.0:1762166981.021567:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc4a2a680/2, rc 0, transno 17179876690 00000100:00100000:2.0:1762166981.021575:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449784832:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1762166981.021581:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4012680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+22:3633:x1847765449784960:12345-0@lo:2:osp-syn-0-1.0 Request processed in 156us (261us total) trans 21474843447 rc 0/0 00000100:00100000:1.0:1762166981.021589:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19385 00000004:00080000:3.0:1762166981.021608:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf783ce00/2, rc 0, transno 21474843447 00000100:00100000:3.0:1762166981.021615:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449784960:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1762166981.021962:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166981.021998:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450696448 00000100:00100000:3.0:1762166981.022004:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450696448 00000100:00100000:3.0:1762166981.022037:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30826 00000100:00100000:3.0:1762166981.022045:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+525:61879:x1847765450696448:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166981.022056:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166981.022066:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effbacb30 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea858 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.022097:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effbacb30 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea858 expref: 526 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.022104:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effbacb30 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea858 expref: 526 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.022114:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:3.0:1762166981.022115:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166981.022117:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4b63e00, rc 0) 00000100:00100000:3.0:1762166981.022141:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+526:61879:x1847765450696448:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 97us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166981.022145:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30826 00000100:00100000:3.0:1762166981.023158:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.023212:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450696576 00000100:00100000:2.0:1762166981.023219:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450696576 00000100:00100000:2.0:1762166981.023260:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30827 00000100:00100000:2.0:1762166981.023270:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4013b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+526:61879:x1847765450696576:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166981.023284:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166981.023300:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4ac00/0x2f180c4effbacb37 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea85f expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.023381:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42ff400/0x2f180c4effbacb3e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166981.023394:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42ff400/0x2f180c4effbacb3e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.023405:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42ff400/0x2f180c4effbacb3e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000004:00200000:2.0:1762166981.023433:0:30829:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 32254 00000004:00200000:2.0:1762166981.023438:0:30829:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166981.023457:0:30829:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42ff400/0x2f180c4effbacb3e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.023523:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4ac00/0x2f180c4effbacb37 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea85f expref: 528 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.023544:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42ff400/0x2f180c4effbacb3e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea85f expref: 527 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.023553:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166981.023556:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166981.023559:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc42ff400, rc 0) 00000100:00100000:2.0:1762166981.023605:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4013b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+527:61879:x1847765450696576:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 337us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166981.023613:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30827 00000100:00100000:0.0:1762166981.024609:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166981.024667:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450696704 00000100:00100000:1.0:1762166981.024678:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450696704 00000100:00100000:1.0:1762166981.024722:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19386 00000100:00100000:1.0:1762166981.024732:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+24:2416:x1847765450696704:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166981.024745:0:8380:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166981.024760:0:8380:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cc355be00/0x2f180c4effbacb45 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea866 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166981.024773:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00002000:00010000:1.0:1762166981.024780:0:8380:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa77:0x0] initial LVB size: 32254, mtime: 0x690888c5, atime: 0x690888c5, ctime: 0x690888c5, blocks: 0x48 00010000:00010000:1.0:1762166981.024793:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166981.024795:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166981.024803:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355be00/0x2f180c4effbacb45 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea866 expref: 25 pid: 8380 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1762166981.024804:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450696832 00000100:00100000:0.0:1762166981.024820:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450696832 00010000:00010000:1.0:1762166981.024831:0:8380:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945cc355be00/0x2f180c4effbacb45 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea866 expref: 25 pid: 8380 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166981.024840:0:8380:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355be00, rc 0) 00000100:00100000:3.0:1762166981.024844:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166981.024866:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450696960 00000100:00100000:0.0:1762166981.024871:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450696960 00000100:00100000:1.0:1762166981.024874:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+25:2416:x1847765450696704:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 143us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166981.024882:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19386 00000100:00100000:3.0:1762166981.024937:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19387 00000100:00100000:2.0:1762166981.024956:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19388 00000100:00100000:3.0:1762166981.024957:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4012300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+23:2417:x1847765450696832:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166981.024972:0:35247:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1762166981.024981:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4013100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+25:2416:x1847765450696960:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166981.024987:0:35247:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4b63400/0x2f180c4effbacb4c lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea86d expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.024996:0:35472:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:3.0:1762166981.025007:0:35247:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa7a:0x0] initial LVB size: 0, mtime: 0x690888c5, atime: 0x690888c5, ctime: 0x690888c5, blocks: 0x1800 00010000:00010000:2.0:1762166981.025018:0:35472:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc56eb800/0x2f180c4effbacb53 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea874 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.025021:0:35247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166981.025026:0:35247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166981.025038:0:35247:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4b63400/0x2f180c4effbacb4c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea86d expref: 24 pid: 35247 timeout: 0 lvb_type: 1 00002000:00010000:2.0:1762166981.025049:0:35472:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa79:0x0] initial LVB size: 0, mtime: 0x690888c5, atime: 0x690888c5, ctime: 0x690888c5, blocks: 0x0 00010000:00010000:3.0:1762166981.025063:0:35247:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc4b63400/0x2f180c4effbacb4c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea86d expref: 24 pid: 35247 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166981.025067:0:35472:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166981.025073:0:35472:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166981.025078:0:35247:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4b63400, rc 0) 00010000:00010000:2.0:1762166981.025085:0:35472:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc56eb800/0x2f180c4effbacb53 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea874 expref: 26 pid: 35472 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166981.025107:0:35472:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc56eb800/0x2f180c4effbacb53 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea874 expref: 26 pid: 35472 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1762166981.025109:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4012300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+24:2417:x1847765450696832:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 160us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166981.025134:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19387 00010000:00010000:2.0:1762166981.025142:0:35472:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc56eb800, rc 0) 00000100:00100000:2.0:1762166981.025181:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4013100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+26:2416:x1847765450696960:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 209us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166981.025189:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19388 00000100:00100000:0.0:1762166981.048062:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.048132:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450697088 00000100:00100000:2.0:1762166981.048142:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450697088 00000100:00100000:2.0:1762166981.048199:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19389 00000100:00100000:2.0:1762166981.048209:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+26:2417:x1847765450697088:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:2.0:1762166981.048319:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+26:2417:x1847765450697088:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 112us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166981.048327:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19389 00000100:00100000:3.0:1762166981.049464:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166981.049577:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450697216 00000100:00100000:0.0:1762166981.049584:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450697216 00000100:00100000:0.0:1762166981.049619:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19390 00000100:00100000:0.0:1762166981.049628:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+26:2416:x1847765450697216:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:0.0:1762166981.049703:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+26:2416:x1847765450697216:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 76us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166981.049713:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19390 00000100:00100000:1.0:1762166981.051455:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.051537:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450697344 00000100:00100000:2.0:1762166981.051546:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450697344 00000100:00100000:2.0:1762166981.051609:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2691 00000100:00100000:2.0:1762166981.051620:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+26:2418:x1847765450697344:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:2.0:1762166981.051654:0:23940:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc56eb000/0x2f180c4effbacb5a lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.051669:0:23940:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166981.051671:0:23940:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166981.051676:0:23940:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc56eb000/0x2f180c4effbacb5a lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.051695:0:23940:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc56eb000/0x2f180c4effbacb5a lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.051792:0:23940:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc56eb000/0x2f180c4effbacb5a lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.051801:0:23940:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc56eb000/0x2f180c4effbacb5a lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.051809:0:23940:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc56eb000/0x2f180c4effbacb5a lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.051826:0:23940:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc56eb000 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166981.051830:0:23940:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc56eb000/0x2f180c4effbacb5a lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.051839:0:23940:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc56eb000/0x2f180c4effbacb5a lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.051853:0:23940:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc56eb000/0x2f180c4effbacb5a lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.051860:0:23940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc56eb000/0x2f180c4effbacb5a lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166981.051913:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+26:2418:x1847765450697344:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 295us (459us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1762166981.051921:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2691 00000100:00100000:3.0:1762166981.053461:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.053536:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450697472 00000100:00100000:2.0:1762166981.053543:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450697472 00000100:00100000:2.0:1762166981.053583:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2692 00000100:00100000:2.0:1762166981.053593:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+26:2418:x1847765450697472:12345-192.168.204.38@tcp:4:lfs.0 00010000:00010000:2.0:1762166981.053618:0:23940:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc56eaa00/0x2f180c4effbacb61 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.053634:0:23940:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945cc355a600/0x2f180c4effbaca6c lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea804 expref: 26 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166981.053640:0:23940:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166981.053642:0:23940:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166981.053644:0:23940:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc56eaa00/0x2f180c4effbacb61 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.053677:0:23940:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945cc355a600/0x2f180c4effbaca6c lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea804 expref: 26 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166981.053692:0:23940:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945cc355a600/0x2f180c4effbaca6c lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea804 expref: 26 pid: 9168 timeout: 700 lvb_type: 1 00000100:00100000:2.0:1762166981.053714:0:23940:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5805500 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_007:lustre-OST0001_UUID:23940:1847765449785088:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166981.053806:0:23940:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a1c00 going to sleep for 11 seconds 00000100:00100000:2.0:1762166981.054651:0:23940:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5805500 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_007:lustre-OST0001_UUID:23940:1847765449785088:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166981.054673:0:23940:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc56eaa00/0x2f180c4effbacb61 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166981.054882:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.054932:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450697600 00000100:00100000:2.0:1762166981.054937:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450697600 00010000:00010000:2.0:1762166981.054961:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355a600/0x2f180c4effbaca6c lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea804 expref: 27 pid: 9168 timeout: 700 lvb_type: 1 00000100:00100000:2.0:1762166981.054983:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9797 00000100:00100000:2.0:1762166981.054987:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b20000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+27:2418:x1847765450697600:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166981.054995:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166981.055008:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945cc355a600/0x2f180c4effbaca6c lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea804 expref: 27 pid: 9168 timeout: 700 lvb_type: 1 00010000:00010000:2.0:1762166981.055016:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945cc355a600/0x2f180c4effbaca6c lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea804 expref: 27 pid: 9168 timeout: 700 lvb_type: 1 00010000:00010000:2.0:1762166981.055030:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cc355a600/0x2f180c4effbaca6c lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea804 expref: 27 pid: 9168 timeout: 700 lvb_type: 1 00010000:00010000:2.0:1762166981.055038:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166981.055040:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166981.055042:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc56eaa00/0x2f180c4effbacb61 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.055048:0:6479:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc56eaa00/0x2f180c4effbacb61 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.055067:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166981.055086:0:23940:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc56eaa00/0x2f180c4effbacb61 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.055095:0:23940:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc56eaa00/0x2f180c4effbacb61 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166981.055107:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b20000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+26:2418:x1847765450697600:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 117us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166981.055116:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9797 00000001:00080000:2.0:1762166981.056101:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876692 is committed 00000001:00080000:2.0:1762166981.056111:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876691 is committed 00010000:00010000:0.0:1762166981.056216:0:23940:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc56eaa00/0x2f180c4effbacb61 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.056226:0:23940:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc56eaa00/0x2f180c4effbacb61 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.056233:0:23940:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc56eaa00/0x2f180c4effbacb61 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.056238:0:23940:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc56eaa00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166981.056241:0:23940:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc56eaa00/0x2f180c4effbacb61 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.056247:0:23940:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc56eaa00/0x2f180c4effbacb61 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.056259:0:23940:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc56eaa00/0x2f180c4effbacb61 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.056263:0:23940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc56eaa00/0x2f180c4effbacb61 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166981.056328:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+16:2418:x1847765450697472:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 2735us (2868us total) trans 17179876692 rc 0/0 00000100:00100000:0.0:1762166981.056339:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2692 00000100:00100000:3.0:1762166981.057966:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166981.058007:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450697728 00000100:00100000:0.0:1762166981.058017:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450697728 00000100:00100000:0.0:1762166981.058069:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19391 00000100:00100000:0.0:1762166981.058080:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+16:2419:x1847765450697728:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:0.0:1762166981.058187:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+16:2419:x1847765450697728:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 109us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166981.058195:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19391 00000100:00100000:3.0:1762166981.059771:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.059851:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450697984 00000100:00100000:2.0:1762166981.059865:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450697984 00000100:00100000:2.0:1762166981.059932:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30828 00000100:00100000:2.0:1762166981.059940:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+527:61879:x1847765450697984:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:2.0:1762166981.059989:0:30829:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166981.060012:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42ff400/0x2f180c4effbacb3e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea85f expref: 527 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.060030:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166981.060033:0:30829:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166981.060194:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4410c00/0x2f180c4effbacb68 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166981.060211:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4410c00/0x2f180c4effbacb68 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.060220:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4410c00/0x2f180c4effbacb68 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000001:00080000:2.0:1762166981.060252:0:30829:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992476 00000004:00010000:2.0:1762166981.060268:0:30829:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000097915802 reply state 0000000048bb58e0 transno 4294992477 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4410c00/0x2f180c4effbacb68 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.060276:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4410c00/0x2f180c4effbacb68 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.060280:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166981.060282:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166981.060283:0:30829:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166981.060356:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+529:61879:x1847765450697984:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 417us (589us total) trans 4294992477 rc 0/0 00000100:00100000:2.0:1762166981.060363:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30828 00000020:00080000:2.0:1762166981.060369:0:30829:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1762166981.061175:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166981.061222:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450698112 00000100:00100000:0.0:1762166981.061228:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450698112 00000100:00100000:0.0:1762166981.061260:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19392 00000100:00100000:0.0:1762166981.061265:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+16:61879:x1847765450698112:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166981.061277:0:35472:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166981.061296:0:35472:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde000/0x2f180c4effbacb6f lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea87b expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166981.061314:0:35472:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa90:0x0] initial LVB size: 148474, mtime: 0x690888c5, atime: 0x690888c4, ctime: 0x690888c5, blocks: 0x8 00010000:00010000:0.0:1762166981.061333:0:35472:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166981.061336:0:35472:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166981.061344:0:35472:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde000/0x2f180c4effbacb6f lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea87b expref: 17 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.061359:0:35472:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde000/0x2f180c4effbacb6f lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea87b expref: 17 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.061385:0:35472:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bde000, rc 0) 00000100:00100000:0.0:1762166981.061417:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+17:61879:x1847765450698112:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 152us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166981.061422:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19392 00000100:00100000:3.0:1762166981.062223:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166981.062256:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450698368 00000100:00100000:0.0:1762166981.062260:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450698368 00002000:00010000:0.0:1762166981.062279:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2705 (0->18446744073709551615) 00002000:00100000:0.0:1762166981.062283:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc7b20700 with x1847765450698368 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166981.062292:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc7b20700. 00000100:00100000:0.0:1762166981.062308:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2693 00000100:00100000:0.0:1762166981.062314:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765450698368:12345-192.168.204.38@tcp:10:lfs.0 00000100:00100000:1.0:1762166981.062400:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00002000:00010000:0.0:1762166981.062431:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166981.062434:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00010000:0.0:1762166981.062436:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00002000:00010000:0.0:1762166981.062438:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00002000:00010000:0.0:1762166981.062440:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166981.062448:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450698240 00000100:00100000:3.0:1762166981.062452:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450698240 00002000:00010000:3.0:1762166981.062466:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2704 (4096->18446744073709551615) 00002000:00100000:3.0:1762166981.062469:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bccb7f100 with x1847765450698240 ext(4096->18446744073709551615) 00000100:00100000:0.0:1762166981.062471:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+25:2419:x1847765450698368:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 157us (249us total) trans 21474843448 rc 0/0 00000100:00100000:0.0:1762166981.062498:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2693 00002000:00010000:3.0:1762166981.062499:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bccb7f100. 00002000:00010000:0.0:1762166981.062502:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2705 (0->18446744073709551615) 00002000:00100000:0.0:1762166981.062507:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc7b20700 with x1847765450698368 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166981.062512:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc7b20700. 00000100:00100000:3.0:1762166981.062527:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2694 00000100:00100000:3.0:1762166981.062537:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450698240:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:3.0:1762166981.062798:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb size from disk: 148474 -> 4096 00002000:00010000:3.0:1762166981.062801:0:23943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00010000:3.0:1762166981.062802:0:23943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00002000:00010000:3.0:1762166981.062804:0:23943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00002000:00010000:3.0:1762166981.062806:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1762166981.062843:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450698240:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 309us (446us total) trans 17179876693 rc 0/0 00000100:00100000:3.0:1762166981.062848:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2694 00002000:00010000:3.0:1762166981.062851:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2704 (4096->18446744073709551615) 00002000:00100000:3.0:1762166981.062853:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bccb7f100 with x1847765450698240 ext(4096->18446744073709551615) 00002000:00010000:3.0:1762166981.062857:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bccb7f100. 00000100:00100000:1.0:1762166981.063698:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.063750:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450698496 00000100:00100000:2.0:1762166981.063762:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450698496 00000100:00100000:2.0:1762166981.063847:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30829 00000100:00100000:2.0:1762166981.063859:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+529:61879:x1847765450698496:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166981.063882:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166981.063900:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7c0f800/0x2f180c4effbacb76 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea882 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.063983:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7c0ec00/0x2f180c4effbacb7d lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166981.063997:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7c0ec00/0x2f180c4effbacb7d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.064007:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7c0ec00/0x2f180c4effbacb7d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000004:00200000:2.0:1762166981.064030:0:30829:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 4096 00000004:00200000:2.0:1762166981.064034:0:30829:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166981.064050:0:30829:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7c0ec00/0x2f180c4effbacb7d lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.064073:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7c0f800/0x2f180c4effbacb76 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea882 expref: 531 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.064090:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7c0ec00/0x2f180c4effbacb7d lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea882 expref: 530 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.064103:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166981.064107:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166981.064110:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc7c0ec00, rc 0) 00000100:00100000:2.0:1762166981.064171:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+530:61879:x1847765450698496:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 314us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166981.064178:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30829 00000100:00100000:0.0:1762166981.065628:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.065681:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450698752 00000100:00100000:2.0:1762166981.065689:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450698752 00000100:00100000:2.0:1762166981.065737:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30830 00000100:00100000:2.0:1762166981.065748:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+530:61879:x1847765450698752:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:2.0:1762166981.065797:0:30829:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166981.065836:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7c0ec00/0x2f180c4effbacb7d lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea882 expref: 530 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.065853:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166981.065858:0:30829:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166981.066026:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eaa00/0x2f180c4effbacb84 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166981.066039:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eaa00/0x2f180c4effbacb84 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.066049:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eaa00/0x2f180c4effbacb84 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000001:00080000:2.0:1762166981.066093:0:30829:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992478 00000004:00010000:2.0:1762166981.066129:0:30829:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000b41c4ff3 reply state 00000000e5c2b50b transno 4294992479 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eaa00/0x2f180c4effbacb84 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.066143:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eaa00/0x2f180c4effbacb84 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.066149:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166981.066151:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166981.066154:0:30829:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166981.066227:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+532:61879:x1847765450698752:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 482us (604us total) trans 4294992479 rc 0/0 00000100:00100000:2.0:1762166981.066232:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30830 00000020:00080000:2.0:1762166981.066236:0:30829:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1762166981.067546:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166981.067582:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166981.067615:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450698880 00000100:00100000:2.0:1762166981.067626:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450699008 00000100:00100000:3.0:1762166981.067628:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450698880 00000100:00100000:2.0:1762166981.067636:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450699008 00002000:00010000:2.0:1762166981.067671:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2705 (0->18446744073709551615) 00002000:00100000:2.0:1762166981.067676:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc70b1c00 with x1847765450699008 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166981.067677:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2704 (32254->18446744073709551615) 00002000:00100000:3.0:1762166981.067685:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bccb7c000 with x1847765450698880 ext(32254->18446744073709551615) 00002000:00010000:2.0:1762166981.067688:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc70b1c00. 00002000:00010000:3.0:1762166981.067699:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bccb7c000. 00000100:00100000:2.0:1762166981.067721:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2695 00000100:00100000:2.0:1762166981.067733:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc70b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+25:2418:x1847765450699008:12345-192.168.204.38@tcp:10:lfs.0 00000100:00100000:0.0:1762166981.067747:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2696 00000100:00100000:0.0:1762166981.067764:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450698880:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:2.0:1762166981.067870:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166981.067874:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00010000:2.0:1762166981.067877:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00002000:00010000:2.0:1762166981.067879:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00002000:00010000:2.0:1762166981.067881:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1762166981.067927:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc70b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+26:2418:x1847765450699008:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 196us (344us total) trans 21474843449 rc 0/0 00000100:00100000:2.0:1762166981.067936:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2695 00002000:00010000:0.0:1762166981.067940:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb size from disk: 4096 -> 32254 00002000:00010000:2.0:1762166981.067941:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2705 (0->18446744073709551615) 00002000:00010000:0.0:1762166981.067947:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00100000:2.0:1762166981.067949:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc70b1c00 with x1847765450699008 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166981.067951:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00002000:00010000:0.0:1762166981.067956:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00002000:00010000:2.0:1762166981.067958:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc70b1c00. 00002000:00010000:0.0:1762166981.067958:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1762166981.067990:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450698880:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 233us (447us total) trans 17179876694 rc 0/0 00000100:00100000:0.0:1762166981.067998:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2696 00002000:00010000:0.0:1762166981.068002:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2704 (32254->18446744073709551615) 00002000:00100000:0.0:1762166981.068005:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bccb7c000 with x1847765450698880 ext(32254->18446744073709551615) 00002000:00010000:0.0:1762166981.068011:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bccb7c000. 00000100:00100000:1.0:1762166981.075286:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.075335:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450699136 00000100:00100000:2.0:1762166981.075345:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450699136 00000100:00100000:2.0:1762166981.075394:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30831 00000100:00100000:2.0:1762166981.075401:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc70b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+532:61879:x1847765450699136:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166981.075425:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166981.075444:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb000/0x2f180c4effbacb8b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea889 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.075563:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7c0ec00/0x2f180c4effbacb92 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166981.075577:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7c0ec00/0x2f180c4effbacb92 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.075586:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7c0ec00/0x2f180c4effbacb92 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000004:00200000:2.0:1762166981.075610:0:30829:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 32254 00000004:00200000:2.0:1762166981.075614:0:30829:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166981.075628:0:30829:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7c0ec00/0x2f180c4effbacb92 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.075648:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb000/0x2f180c4effbacb8b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea889 expref: 534 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.075661:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7c0ec00/0x2f180c4effbacb92 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea889 expref: 533 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.075667:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166981.075670:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166981.075673:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc7c0ec00, rc 0) 00000100:00100000:2.0:1762166981.075718:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc70b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+533:61879:x1847765450699136:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 318us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166981.075722:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30831 00000100:00100000:3.0:1762166981.077030:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.077082:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450699392 00000100:00100000:2.0:1762166981.077091:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450699392 00000100:00100000:2.0:1762166981.077141:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30832 00000100:00100000:2.0:1762166981.077147:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+533:61879:x1847765450699392:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:2.0:1762166981.077190:0:30829:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166981.077210:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7c0ec00/0x2f180c4effbacb92 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea889 expref: 533 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.077225:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166981.077227:0:30829:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166981.077364:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7c0f800/0x2f180c4effbacb99 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166981.077375:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7c0f800/0x2f180c4effbacb99 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.077381:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7c0f800/0x2f180c4effbacb99 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000001:00080000:2.0:1762166981.077414:0:30829:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992480 00000004:00010000:2.0:1762166981.077429:0:30829:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000000fcfd30e reply state 00000000c5439889 transno 4294992481 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7c0f800/0x2f180c4effbacb99 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.077437:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7c0f800/0x2f180c4effbacb99 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.077444:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166981.077446:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166981.077447:0:30829:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166981.077534:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+535:61879:x1847765450699392:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 387us (513us total) trans 4294992481 rc 0/0 00000100:00100000:2.0:1762166981.077539:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30832 00000020:00080000:2.0:1762166981.077544:0:30829:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1762166981.078702:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166981.078757:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166981.078768:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450699648 00000100:00100000:0.0:1762166981.078779:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450699648 00000100:00100000:2.0:1762166981.078796:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450699520 00000100:00100000:2.0:1762166981.078799:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450699520 00002000:00010000:0.0:1762166981.078804:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2705 (0->18446744073709551615) 00002000:00100000:0.0:1762166981.078809:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc70b2a00 with x1847765450699648 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166981.078820:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2704 (32254->18446744073709551615) 00002000:00100000:2.0:1762166981.078823:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc70b2300 with x1847765450699520 ext(32254->18446744073709551615) 00002000:00010000:0.0:1762166981.078826:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc70b2a00. 00002000:00010000:2.0:1762166981.078828:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc70b2300. 00000100:00100000:2.0:1762166981.078849:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2697 00000100:00100000:0.0:1762166981.078854:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2698 00000100:00100000:2.0:1762166981.078857:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc70b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450699520:12345-192.168.204.38@tcp:10:lfs.0 00000100:00100000:0.0:1762166981.078861:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc70b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765450699648:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:2.0:1762166981.078945:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb size from disk: 32254 -> 32254 00002000:00010000:0.0:1762166981.078945:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166981.078948:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00010000:0.0:1762166981.078948:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00010000:0.0:1762166981.078951:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00002000:00010000:2.0:1762166981.078952:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00002000:00010000:2.0:1762166981.078955:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00002000:00010000:0.0:1762166981.078955:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00002000:00010000:2.0:1762166981.078958:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb blocks from disk: 8 -> 8 00002000:00010000:0.0:1762166981.078958:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1762166981.078990:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc70b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+27:2419:x1847765450699648:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 129us (289us total) trans 21474843450 rc 0/0 00000100:00100000:2.0:1762166981.078991:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc70b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450699520:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 136us (234us total) trans 17179876695 rc 0/0 00000100:00100000:0.0:1762166981.078997:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2698 00000100:00100000:2.0:1762166981.079001:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2697 00002000:00010000:0.0:1762166981.079001:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2705 (0->18446744073709551615) 00002000:00010000:2.0:1762166981.079004:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2704 (32254->18446744073709551615) 00002000:00100000:0.0:1762166981.079004:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc70b2a00 with x1847765450699648 ext(0->18446744073709551615) 00002000:00100000:2.0:1762166981.079007:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc70b2300 with x1847765450699520 ext(32254->18446744073709551615) 00002000:00010000:0.0:1762166981.079009:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc70b2a00. 00002000:00010000:2.0:1762166981.079011:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc70b2300. 00000100:00100000:1.0:1762166981.079947:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.079982:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450699904 00000100:00100000:2.0:1762166981.079987:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450699904 00000100:00100000:2.0:1762166981.080021:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30833 00000100:00100000:2.0:1762166981.080027:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc70b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+535:61879:x1847765450699904:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:2.0:1762166981.080073:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42ff400/0x2f180c4effbacba0 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166981.080081:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42ff400/0x2f180c4effbacba0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.080087:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42ff400/0x2f180c4effbacba0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000004:00010000:2.0:1762166981.080128:0:30829:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000674a7b6e reply state 00000000e41bc45d transno 4294992482 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42ff400/0x2f180c4effbacba0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.080134:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42ff400/0x2f180c4effbacba0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.080138:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166981.080140:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166981.080142:0:30829:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166981.080180:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc70b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+537:61879:x1847765450699904:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 154us (234us total) trans 4294992482 rc 0/0 00000100:00100000:2.0:1762166981.080185:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30833 00000100:00100000:3.0:1762166981.080971:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166981.081004:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166981.081032:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450700160 00000100:00100000:0.0:1762166981.081037:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450700160 00000100:00100000:3.0:1762166981.081043:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166981.081068:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450700032 00000100:00100000:1.0:1762166981.081074:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450700032 00000100:00100000:0.0:1762166981.081086:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450700288 00000100:00100000:0.0:1762166981.081092:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450700288 00000100:00100000:2.0:1762166981.081100:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19393 00000100:00100000:1.0:1762166981.081109:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19394 00000100:00100000:2.0:1762166981.081111:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+27:2419:x1847765450700160:12345-192.168.204.38@tcp:2:lfs.0 00000100:00100000:1.0:1762166981.081116:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450700032:12345-192.168.204.38@tcp:2:lfs.0 00000100:00100000:0.0:1762166981.081134:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19395 00000100:00100000:0.0:1762166981.081145:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450700288:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:2.0:1762166981.081184:0:28434:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166981.081184:0:35247:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 32254 -> 32254 00002000:00010000:2.0:1762166981.081188:0:28434:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00010000:1.0:1762166981.081188:0:35247:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00010000:2.0:1762166981.081192:0:28434:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166981 -> 1762166981 00002000:00010000:1.0:1762166981.081192:0:35247:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166981 -> 1762166981 00002000:00010000:2.0:1762166981.081195:0:28434:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00002000:00010000:1.0:1762166981.081195:0:35247:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00002000:00010000:1.0:1762166981.081198:0:35247:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 72 -> 72 00002000:00010000:2.0:1762166981.081199:0:28434:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00002000:00010000:0.0:1762166981.081223:0:35472:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166981.081228:0:35472:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00010000:0.0:1762166981.081230:0:35472:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166981 -> 1762166981 00002000:00010000:0.0:1762166981.081233:0:35472:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00000100:00100000:2.0:1762166981.081239:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+28:2419:x1847765450700160:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 128us (267us total) trans 21474843451 rc 0/0 00000100:00100000:1.0:1762166981.081239:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765450700032:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 120us (232us total) trans 17179876696 rc 0/0 00002000:00010000:0.0:1762166981.081239:0:35472:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1762166981.081250:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19394 00000100:00100000:2.0:1762166981.081256:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19393 00000100:00100000:0.0:1762166981.081273:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765450700288:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 129us (229us total) trans 17179876697 rc 0/0 00000100:00100000:0.0:1762166981.081279:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19395 00000100:00100000:1.0:1762166981.082242:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166981.082299:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450700544 00000100:00100000:0.0:1762166981.082305:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450700544 00000100:00100000:0.0:1762166981.082340:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11972 00000100:00100000:0.0:1762166981.082349:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc70b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+537:61879:x1847765450700544:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:0.0:1762166981.082392:0:19593:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x240000404:0x5eb:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4a400/0x2f180c4effbacb06 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea851 expref: 537 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.082425:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbacba7 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166981.082434:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effbacb30 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea858 expref: 537 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.082443:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbacba7 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166981.082473:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effbacb30 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea858 expref: 537 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.082511:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effbacb30 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea858 expref: 537 pid: 30829 timeout: 700 lvb_type: 0 00000100:00100000:0.0:1762166981.082526:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7d20e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449785216:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166981.082603:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1fe20c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166981.083332:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7d20e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449785216:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166981.083345:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbacba7 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:1.0:1762166981.083525:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.083572:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450700672 00000100:00100000:2.0:1762166981.083579:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450700672 00010000:00010000:2.0:1762166981.083605:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effbacb30 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea858 expref: 538 pid: 30829 timeout: 700 lvb_type: 0 00000100:00100000:2.0:1762166981.083644:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9798 00000100:00100000:2.0:1762166981.083655:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc70b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+538:2419:x1847765450700672:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166981.083665:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166981.083672:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effbacb30 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea858 expref: 538 pid: 30829 timeout: 700 lvb_type: 0 00010000:00010000:2.0:1762166981.083684:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effbacb30 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea858 expref: 538 pid: 30829 timeout: 700 lvb_type: 0 00010000:00010000:2.0:1762166981.083699:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effbacb30 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea858 expref: 538 pid: 30829 timeout: 700 lvb_type: 0 00010000:00010000:2.0:1762166981.083714:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166981.083718:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbacba7 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166981.083725:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbacba7 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166981.083735:0:6479:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbacba7 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166981.083762:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166981.083792:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbacba7 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166981.083799:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbacba7 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:2.0:1762166981.083823:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc70b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+537:2419:x1847765450700672:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 150us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166981.083834:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9798 00000040:00080000:0.0:1762166981.083982:0:19593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5946, 88 off465904 00000004:00080000:0.0:1762166981.083988:0:19593:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 600232510427ns, next at 600144491692ns, rc = 0 00000040:00080000:0.0:1762166981.084015:0:19593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5945, 88 off465904 00000004:00080000:0.0:1762166981.084020:0:19593:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 600232542351ns, next at 600144525370ns, rc = 0 00000040:00080000:0.0:1762166981.084049:0:19593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5946, 88 off465992 00000004:00080000:0.0:1762166981.084055:0:19593:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 600232575902ns, next at 600144525370ns, rc = 0 00000040:00080000:0.0:1762166981.084070:0:19593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5947, 88 off465992 00000004:00080000:0.0:1762166981.084076:0:19593:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 600232597970ns, next at 600144491692ns, rc = 0 00000040:00080000:0.0:1762166981.084104:0:19593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5948, 88 off466080 00000004:00080000:0.0:1762166981.084109:0:19593:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 600232631516ns, next at 600144491692ns, rc = 0 00000040:00080000:0.0:1762166981.084127:0:19593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5947, 88 off466080 00000004:00080000:0.0:1762166981.084130:0:19593:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 600232652445ns, next at 600144525370ns, rc = 0 00000001:00080000:3.0:1762166981.085139:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294992483 is committed 00000004:00080000:3.0:1762166981.085147:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3308 committed 00000004:00080000:3.0:1762166981.085160:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3305 committed 00000004:00080000:3.0:1762166981.085173:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3304 committed 00010000:00010000:0.0:1762166981.085174:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4410c00/0x2f180c4effbacb68 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00000004:00080000:3.0:1762166981.085177:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3307 committed 00000004:00080000:3.0:1762166981.085181:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3306 committed 00000004:00080000:3.0:1762166981.085187:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3303 committed 00010000:00010000:0.0:1762166981.085198:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4410c00/0x2f180c4effbacb68 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.085206:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4410c00/0x2f180c4effbacb68 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.085213:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4410c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166981.085219:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4410c00/0x2f180c4effbacb68 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.085229:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4410c00/0x2f180c4effbacb68 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.085240:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:0.0:1762166981.085244:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166981.085249:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4410c00/0x2f180c4effbacb68 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.085258:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4410c00/0x2f180c4effbacb68 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00000100:00100000:3.0:1762166981.085267:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc70b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449785344:0@lo:2:osp-syn-0-1.0 00010000:00010000:0.0:1762166981.085277:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eaa00/0x2f180c4effbacb84 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.085286:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eaa00/0x2f180c4effbacb84 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.085294:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eaa00/0x2f180c4effbacb84 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.085300:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc56eaa00 already unused, calling callback (ffffffffc18e2310) 00000100:00100000:1.0:1762166981.085306:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5807480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449785856:0@lo:2:osp-syn-1-1.0 00010000:00010000:0.0:1762166981.085306:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eaa00/0x2f180c4effbacb84 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00000100:00100000:2.0:1762166981.085315:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5807b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449785600:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166981.085327:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1762166981.085346:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eaa00/0x2f180c4effbacb84 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.085362:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:0.0:1762166981.085366:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166981.085370:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eaa00/0x2f180c4effbacb84 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00000100:00100000:1.0:1762166981.085379:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166981.085380:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5805500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449785472:0@lo:2:osp-syn-1-1.0 00010000:00010000:0.0:1762166981.085384:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eaa00/0x2f180c4effbacb84 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00000004:00010000:2.0:1762166981.085397:0:19593:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000031ffb6a2 reply state 000000005b980c21 transno 4294992483 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbacba7 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166981.085409:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7c0f800/0x2f180c4effbacb99 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.085418:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7c0f800/0x2f180c4effbacb99 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00000100:00100000:3.0:1762166981.085426:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166981.085426:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:0.0:1762166981.085437:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7c0f800/0x2f180c4effbacb99 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.085441:0:19593:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbacba7 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00000100:00100000:1.0:1762166981.085441:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc70b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449785984:0@lo:2:osp-syn-0-1.0 00010000:00010000:0.0:1762166981.085455:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc7c0f800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166981.085456:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166981.085463:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:2.0:1762166981.085465:0:19593:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1762166981.085470:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7c0f800/0x2f180c4effbacb99 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.085472:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166981.085499:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166981.085504:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc3d4a400/0x2f180c4effbacb06 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea851 expref: 527 pid: 30829 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166981.085506:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1762166981.085524:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7c0f800/0x2f180c4effbacb99 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.085546:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:0.0:1762166981.085549:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166981.085555:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7c0f800/0x2f180c4effbacb99 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.085561:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7c0f800/0x2f180c4effbacb99 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00000100:00100000:1.0:1762166981.085571:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc70b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449785728:0@lo:2:osp-syn-0-1.0 00010000:00010000:0.0:1762166981.085579:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42ff400/0x2f180c4effbacba0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.085587:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42ff400/0x2f180c4effbacba0 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00000100:00100000:1.0:1762166981.085594:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1762166981.085594:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42ff400/0x2f180c4effbacba0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00080000:2.0:1762166981.085600:0:19593:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00010000:00010000:0.0:1762166981.085608:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc42ff400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166981.085614:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42ff400/0x2f180c4effbacba0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.085621:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42ff400/0x2f180c4effbacba0 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30829 initiator: MDT1 00000100:00100000:2.0:1762166981.085623:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc70b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+526:61879:x1847765450700544:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 3274us (3381us total) trans 4294992483 rc 0/0 00010000:00010000:0.0:1762166981.085636:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00000100:00100000:2.0:1762166981.085637:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11972 00010000:00010000:0.0:1762166981.085642:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166981.085644:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449785344 00010000:00010000:0.0:1762166981.085647:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42ff400/0x2f180c4effbacba0 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00000100:00100000:1.0:1762166981.085650:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449785344 00010000:00010000:0.0:1762166981.085658:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42ff400/0x2f180c4effbacba0 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.085678:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbacba7 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166981.085686:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbacba7 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166981.085693:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbacba7 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00000100:00100000:1.0:1762166981.085696:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449785856 00000100:00100000:1.0:1762166981.085700:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449785856 00010000:00010000:2.0:1762166981.085701:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdec00 already unused, calling callback (ffffffffc18e2310) 00000100:00100000:0.0:1762166981.085706:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449785472 00010000:00010000:2.0:1762166981.085708:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbacba7 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00000100:00100000:3.0:1762166981.085713:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449785984 00000100:00100000:0.0:1762166981.085715:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449785472 00010000:00010000:2.0:1762166981.085717:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbacba7 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT1 00000100:00100000:3.0:1762166981.085721:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449785984 00000100:00100000:1.0:1762166981.085730:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449785728 00010000:00010000:2.0:1762166981.085731:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00000100:00100000:1.0:1762166981.085733:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449785728 00010000:00010000:2.0:1762166981.085734:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166981.085737:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbacba7 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166981.085742:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbacba7 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00000100:00100000:1.0:1762166981.085757:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19396 00000100:00100000:1.0:1762166981.085769:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+24:3634:x1847765449785344:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1762166981.085776:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19397 00000100:00100000:2.0:1762166981.085789:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166981.085792:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+6:3633:x1847765449785856:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166981.085800:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449785600 00000100:00100000:3.0:1762166981.085805:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449785600 00000100:00100000:3.0:1762166981.085845:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19398 00000100:00100000:3.0:1762166981.085863:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+24:3636:x1847765449785728:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1762166981.085863:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19399 00000100:00100000:2.0:1762166981.085886:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+8:3634:x1847765449785472:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:1.0:1762166981.085891:0:8382:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166981.085896:0:8382:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb mtime from disk: 1762166966 -> 1762166966 00002000:00010000:1.0:1762166981.085899:0:8382:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1762166981.085900:0:35472:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb size from disk: 32254 -> 32254 00002000:00010000:1.0:1762166981.085901:0:8382:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb ctime from disk: 1762166966 -> 1762166966 00002000:00010000:1.0:1762166981.085907:0:8382:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:0.0:1762166981.085907:0:35472:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00010000:0.0:1762166981.085914:0:35472:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00002000:00010000:0.0:1762166981.085918:0:35472:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00002000:00010000:0.0:1762166981.085920:0:35472:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1762166981.085951:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+25:3634:x1847765449785344:12345-0@lo:2:osp-syn-0-1.0 Request processed in 186us (633us total) trans 21474843452 rc 0/0 00000100:00100000:1.0:1762166981.085960:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19396 00000100:00100000:0.0:1762166981.085977:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+9:3633:x1847765449785856:12345-0@lo:2:osp-syn-1-1.0 Request processed in 189us (601us total) trans 17179876698 rc 0/0 00002000:00010000:2.0:1762166981.085980:0:28434:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 32254 -> 32254 00002000:00010000:3.0:1762166981.085987:0:8380:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166981.085988:0:28434:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00000100:00100000:1.0:1762166981.085989:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19400 00002000:00010000:2.0:1762166981.085997:0:28434:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166981 -> 1762166981 00002000:00010000:2.0:1762166981.086000:0:28434:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00000100:00100000:0.0:1762166981.086004:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19397 00002000:00010000:2.0:1762166981.086005:0:28434:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 72 -> 72 00000100:00100000:1.0:1762166981.086005:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+25:3633:x1847765449785984:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1762166981.086031:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19401 00000100:00100000:2.0:1762166981.086040:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+8:3634:x1847765449785472:12345-0@lo:2:osp-syn-1-1.0 Request processed in 159us (615us total) trans 17179876699 rc 0/0 00000100:00100000:0.0:1762166981.086043:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3d58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+8:3635:x1847765449785600:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1762166981.086051:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19399 00002000:00010000:3.0:1762166981.086054:0:8380:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00010000:3.0:1762166981.086059:0:8380:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166981 -> 1762166981 00002000:00010000:3.0:1762166981.086061:0:8380:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00002000:00010000:3.0:1762166981.086063:0:8380:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00002000:00010000:1.0:1762166981.086071:0:8382:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166981.086076:0:8382:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00010000:1.0:1762166981.086079:0:8382:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00002000:00010000:1.0:1762166981.086082:0:8382:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00002000:00010000:1.0:1762166981.086086:0:8382:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb blocks from disk: 0 -> 0 00000004:00080000:2.0:1762166981.086119:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc70b0e00/2, rc 0, transno 21474843452 00002000:00010000:0.0:1762166981.086119:0:35472:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:3.0:1762166981.086120:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+26:3636:x1847765449785728:12345-0@lo:2:osp-syn-0-1.0 Request processed in 263us (521us total) trans 21474843453 rc 0/0 00002000:00010000:0.0:1762166981.086131:0:35472:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00000100:00100000:2.0:1762166981.086134:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc70b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449785344:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1762166981.086139:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+26:3633:x1847765449785984:12345-0@lo:2:osp-syn-0-1.0 Request processed in 132us (626us total) trans 21474843454 rc 0/0 00002000:00010000:0.0:1762166981.086146:0:35472:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166981 -> 1762166981 00000100:00100000:3.0:1762166981.086152:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19398 00000100:00100000:2.0:1762166981.086156:0:3634:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 17179876691 gen 2 00002000:00010000:0.0:1762166981.086159:0:35472:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00000100:00100000:1.0:1762166981.086161:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19400 00000004:00080000:2.0:1762166981.086162:0:3634:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc4a2b100, transno 17179876679 00002000:00010000:0.0:1762166981.086169:0:35472:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00000004:00080000:2.0:1762166981.086181:0:3634:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc4a28000, transno 17179876680 00000004:00080000:2.0:1762166981.086190:0:3634:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc4a28700, transno 17179876681 00000004:00080000:2.0:1762166981.086193:0:3634:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc4a2b800, transno 17179876682 00000004:00080000:2.0:1762166981.086197:0:3634:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc4a2aa00, transno 17179876683 00000004:00080000:2.0:1762166981.086201:0:3634:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc4a2a300, transno 17179876684 00000004:00080000:2.0:1762166981.086204:0:3634:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc4a28380, transno 17179876689 00000004:00080000:2.0:1762166981.086206:0:3634:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc4a2a680, transno 17179876690 00000004:00080000:2.0:1762166981.086209:0:3634:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc4a29500, transno 17179876691 00000100:00100000:2.0:1762166981.086218:0:3634:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff945bc5805500 x1847765449785472/t17179876699(17179876699) o2->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 440/432 e 0 to 0 dl 1762166997 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1762166981.086218:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc70b0380/2, rc 0, transno 21474843453 00000100:00100000:1.0:1762166981.086225:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc70b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449785728:0@lo:2:osp-syn-0-1.0 00000004:00080000:2.0:1762166981.086228:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc5805500/2, rc 0, transno 17179876699 00000100:00100000:2.0:1762166981.086234:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5805500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449785472:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1762166981.086236:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3d58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+8:3635:x1847765449785600:12345-0@lo:2:osp-syn-1-1.0 Request processed in 189us (442us total) trans 17179876700 rc 0/0 00000100:00100000:0.0:1762166981.086248:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19401 00000004:00080000:3.0:1762166981.086253:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc5807b80/2, rc 0, transno 17179876700 00000100:00100000:3.0:1762166981.086260:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5807b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449785600:0@lo:2:osp-syn-1-1.0 00000004:00080000:1.0:1762166981.086291:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc70b0700/2, rc 0, transno 21474843454 00000100:00100000:1.0:1762166981.086299:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc70b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449785984:0@lo:2:osp-syn-0-1.0 00000004:00080000:1.0:1762166981.086311:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc5807480/2, rc 0, transno 17179876698 00000100:00100000:1.0:1762166981.086316:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5807480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449785856:0@lo:2:osp-syn-1-1.0 00000004:00080000:2.0:1762166981.086366:0:9994:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0001: 0 changes, 3 in progress, 0 in flight, 9 done 00000100:00100000:1.0:1762166981.086425:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.086458:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450700800 00000100:00100000:2.0:1762166981.086462:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450700800 00000100:00100000:2.0:1762166981.086518:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30834 00000100:00100000:2.0:1762166981.086528:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+524:61879:x1847765450700800:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166981.086540:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166981.086550:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb000/0x2f180c4effbacbae lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea890 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.086580:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb000/0x2f180c4effbacbae lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea890 expref: 525 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.086591:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb000/0x2f180c4effbacbae lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea890 expref: 525 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.086601:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166981.086603:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166981.086605:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc56eb000, rc 0) 00000100:00100000:2.0:1762166981.086630:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+525:61879:x1847765450700800:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 106us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166981.086634:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30834 00000100:00100000:3.0:1762166981.087766:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.087798:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450701056 00000100:00100000:2.0:1762166981.087803:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450701056 00000100:00100000:2.0:1762166981.087846:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11973 00000100:00100000:2.0:1762166981.087854:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+525:61879:x1847765450701056:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:2.0:1762166981.087964:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+526:61879:x1847765450701056:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 110us (200us total) trans 4294992484 rc 0/0 00000100:00100000:2.0:1762166981.087971:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11973 00000100:00100000:3.0:1762166981.096308:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.096377:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450701184 00000100:00100000:2.0:1762166981.096391:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450701184 00000100:00100000:2.0:1762166981.096445:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30835 00000100:00100000:2.0:1762166981.096458:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+526:61880:x1847765450701184:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166981.096497:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166981.096514:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eaa00/0x2f180c4effbacbb5 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea897 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.096564:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7c0f800/0x2f180c4effbacbbc lrc: 3/1,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166981.096581:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7c0f800/0x2f180c4effbacbbc lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.096590:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7c0f800/0x2f180c4effbacbbc lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.096599:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7c0ec00/0x2f180c4effbacbc3 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166981.096603:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7c0ec00/0x2f180c4effbacbc3 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.096607:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7c0ec00/0x2f180c4effbacbc3 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.096662:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5ae4a00/0x2f180c4effbacbca lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166981.096667:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5ae4a00/0x2f180c4effbacbca lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.096671:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5ae4a00/0x2f180c4effbacbca lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000004:00200000:2.0:1762166981.096700:0:30829:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 32254 00000004:00200000:2.0:1762166981.096703:0:30829:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166981.096714:0:30829:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5ae4a00/0x2f180c4effbacbca lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.096722:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5ae4a00/0x2f180c4effbacbca lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.096728:0:30829:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7c0f800/0x2f180c4effbacbbc lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.096735:0:30829:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7c0f800/0x2f180c4effbacbbc lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.096739:0:30829:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7c0f800/0x2f180c4effbacbbc lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.096743:0:30829:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7c0f800/0x2f180c4effbacbbc lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.096746:0:30829:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc7c0f800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166981.096749:0:30829:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7c0f800/0x2f180c4effbacbbc lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.096753:0:30829:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7c0f800/0x2f180c4effbacbbc lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.096760:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0x0 (ffff945bc809b000) 00010000:00010000:2.0:1762166981.096762:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166981.096765:0:30829:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7c0f800/0x2f180c4effbacbbc lrc: 3/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.096769:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7c0f800/0x2f180c4effbacbbc lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.096776:0:30829:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7c0ec00/0x2f180c4effbacbc3 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.096780:0:30829:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7c0ec00/0x2f180c4effbacbc3 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.096784:0:30829:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7c0ec00/0x2f180c4effbacbc3 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.096786:0:30829:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc7c0ec00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166981.096788:0:30829:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7c0ec00/0x2f180c4effbacbc3 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.096791:0:30829:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7c0ec00/0x2f180c4effbacbc3 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.096795:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0xdd396665 (ffff945bc809b200) 00010000:00010000:2.0:1762166981.096796:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166981.096798:0:30829:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7c0ec00/0x2f180c4effbacbc3 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.096801:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7c0ec00/0x2f180c4effbacbc3 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.096833:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eaa00/0x2f180c4effbacbb5 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea897 expref: 528 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.096842:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5ae4a00/0x2f180c4effbacbca lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea897 expref: 527 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.096846:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166981.096848:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166981.096849:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc5ae4a00, rc 0) 00000100:00100000:2.0:1762166981.096901:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+527:61880:x1847765450701184:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 451us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166981.096907:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30835 00000100:00100000:1.0:1762166981.098462:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.098526:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450701440 00000100:00100000:2.0:1762166981.098537:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450701440 00000100:00100000:2.0:1762166981.098574:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30836 00000100:00100000:2.0:1762166981.098583:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+527:61880:x1847765450701440:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166981.098597:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166981.098608:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5ae4800/0x2f180c4effbacbd1 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea89e expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.098670:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42f6200/0x2f180c4effbacbd8 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166981.098681:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42f6200/0x2f180c4effbacbd8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.098689:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42f6200/0x2f180c4effbacbd8 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000004:00200000:2.0:1762166981.098698:0:30829:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 32254 00010000:00010000:2.0:1762166981.098787:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5ae4800/0x2f180c4effbacbd1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea89e expref: 530 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.098801:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42f6200/0x2f180c4effbacbd8 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea89e expref: 529 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.098822:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166981.098825:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1762166981.098828:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc42f6200, rc 0) 00000100:00100000:2.0:1762166981.098868:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+529:61880:x1847765450701440:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 287us (408us total) trans 4294992485 rc 0/0 00000100:00100000:2.0:1762166981.098876:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30836 00000100:00100000:3.0:1762166981.099691:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.099723:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450701696 00000100:00100000:2.0:1762166981.099727:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450701696 00000100:00100000:2.0:1762166981.099753:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30837 00000100:00100000:2.0:1762166981.099758:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+529:61880:x1847765450701696:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166981.099766:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166981.099773:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194e00/0x2f180c4effbacbe6 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea8a5 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.099807:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194200/0x2f180c4effbacbed lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166981.099825:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194200/0x2f180c4effbacbed lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.099830:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194200/0x2f180c4effbacbed lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000004:00200000:2.0:1762166981.099837:0:30829:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 32254 00010000:00010000:2.0:1762166981.099869:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194e00/0x2f180c4effbacbe6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea8a5 expref: 532 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.099879:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194200/0x2f180c4effbacbed lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea8a5 expref: 531 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.099883:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166981.099885:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166981.099887:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc7194200, rc 0) 00000100:00100000:2.0:1762166981.099913:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+531:61880:x1847765450701696:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 155us (225us total) trans 4294992486 rc 0/0 00000100:00100000:2.0:1762166981.099917:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30837 00000100:00100000:3.0:1762166981.134168:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166981.134292:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450701824 00000100:00100000:0.0:1762166981.134305:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450701824 00000100:00100000:2.0:1762166981.134440:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2699 00000100:00100000:2.0:1762166981.134455:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450701824:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:2.0:1762166981.134518:0:23942:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc7194e00/0x2f180c4effbacbfb lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.134532:0:23942:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166981.134534:0:23942:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166981.134539:0:23942:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc7194e00/0x2f180c4effbacbfb lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->32767] (req 0->32767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.134552:0:23942:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc7194e00/0x2f180c4effbacbfb lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->32767] (req 0->32767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.135991:0:23942:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc7194e00/0x2f180c4effbacbfb lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->32767] (req 0->32767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.136003:0:23942:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc7194e00/0x2f180c4effbacbfb lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->32767] (req 0->32767) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.136011:0:23942:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc7194e00/0x2f180c4effbacbfb lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->32767] (req 0->32767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.136018:0:23942:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc7194e00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166981.136023:0:23942:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc7194e00/0x2f180c4effbacbfb lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->32767] (req 0->32767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.136031:0:23942:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc7194e00/0x2f180c4effbacbfb lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->32767] (req 0->32767) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.136045:0:23942:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc7194e00/0x2f180c4effbacbfb lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->32767] (req 0->32767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.136053:0:23942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc7194e00/0x2f180c4effbacbfb lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->32767] (req 0->32767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166981.136118:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450701824:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 1667us (1964us total) trans 0 rc 32254/32254 00000100:00100000:2.0:1762166981.136126:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2699 00000100:00100000:3.0:1762166981.137590:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.137645:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450701952 00000100:00100000:2.0:1762166981.137656:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450701952 00000100:00100000:2.0:1762166981.137729:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2700 00000100:00100000:2.0:1762166981.137740:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765450701952:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:2.0:1762166981.137783:0:23942:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc7194800/0x2f180c4effbacc02 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.137805:0:23942:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde000/0x2f180c4effbacb6f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea87b expref: 22 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.137826:0:23942:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166981.137828:0:23942:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166981.137831:0:23942:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc7194800/0x2f180c4effbacc02 lrc: 4/1,0 mode: --/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->32767] (req 0->32767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.137871:0:23942:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde000/0x2f180c4effbacb6f lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea87b expref: 22 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.137887:0:23942:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde000/0x2f180c4effbacb6f lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea87b expref: 22 pid: 35472 timeout: 700 lvb_type: 0 00000100:00100000:2.0:1762166981.137904:0:23942:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5807100 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_009:lustre-OST0001_UUID:23942:1847765449786112:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166981.138001:0:23942:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc4eeae40 going to sleep for 11 seconds 00000100:00100000:2.0:1762166981.138979:0:23942:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5807100 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_009:lustre-OST0001_UUID:23942:1847765449786112:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166981.139000:0:23942:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc7194800/0x2f180c4effbacc02 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->32767] (req 0->32767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166981.139218:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.139258:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450702080 00000100:00100000:2.0:1762166981.139263:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450702080 00010000:00010000:2.0:1762166981.139282:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde000/0x2f180c4effbacb6f lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea87b expref: 23 pid: 35472 timeout: 700 lvb_type: 0 00000100:00100000:2.0:1762166981.139305:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9799 00000100:00100000:2.0:1762166981.139310:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cceb48050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765450702080:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166981.139319:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166981.139341:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde000/0x2f180c4effbacb6f lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea87b expref: 23 pid: 35472 timeout: 700 lvb_type: 0 00010000:00010000:2.0:1762166981.139354:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde000/0x2f180c4effbacb6f lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea87b expref: 23 pid: 35472 timeout: 700 lvb_type: 0 00010000:00010000:2.0:1762166981.139377:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde000/0x2f180c4effbacb6f lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea87b expref: 23 pid: 35472 timeout: 700 lvb_type: 0 00010000:00010000:2.0:1762166981.139400:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166981.139405:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166981.139409:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc7194800/0x2f180c4effbacc02 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->32767] (req 0->32767) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.139420:0:6479:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc7194800/0x2f180c4effbacc02 lrc: 4/1,0 mode: PR/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->32767] (req 0->32767) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.139451:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166981.139499:0:23942:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc7194800/0x2f180c4effbacc02 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->32767] (req 0->32767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166981.139507:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cceb48050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450702080:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 194us (289us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166981.139510:0:23942:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc7194800/0x2f180c4effbacc02 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->32767] (req 0->32767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166981.139519:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9799 00010000:00010000:2.0:1762166981.140457:0:23942:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc7194800/0x2f180c4effbacc02 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->32767] (req 0->32767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.140469:0:23942:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc7194800/0x2f180c4effbacc02 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->32767] (req 0->32767) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.140508:0:23942:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc7194800/0x2f180c4effbacc02 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->32767] (req 0->32767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.140515:0:23942:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc7194800 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166981.140520:0:23942:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc7194800/0x2f180c4effbacc02 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->32767] (req 0->32767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.140529:0:23942:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc7194800/0x2f180c4effbacc02 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->32767] (req 0->32767) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.140541:0:23942:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc7194800/0x2f180c4effbacc02 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->32767] (req 0->32767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.140547:0:23942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc7194800/0x2f180c4effbacc02 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->32767] (req 0->32767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166981.140603:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450701952:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 2864us (3024us total) trans 0 rc 32254/32254 00000100:00100000:2.0:1762166981.140616:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2700 00000100:00100000:0.0:1762166981.147924:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.147989:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450702208 00000100:00100000:2.0:1762166981.148000:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450702208 00000100:00100000:2.0:1762166981.148074:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 900 00000100:00100000:2.0:1762166981.148088:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d21180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+531:61880:x1847765450702208:12345-192.168.204.38@tcp:103:lfs.0 00010000:00010000:2.0:1762166981.148109:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166981.148138:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194200/0x2f180c4effbacbed lrc: 0/0,0 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea8a5 expref: 531 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.148161:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166981.148167:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166981.148232:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d21180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+530:61880:x1847765450702208:12345-192.168.204.38@tcp:103:lfs.0 Request processed in 149us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166981.148240:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 900 00000100:00100000:1.0:1762166981.149195:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.149246:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450702464 00000100:00100000:2.0:1762166981.149252:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450702464 00000100:00100000:2.0:1762166981.149284:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11974 00000100:00100000:2.0:1762166981.149293:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+530:61880:x1847765450702464:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:2.0:1762166981.149549:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+531:61880:x1847765450702464:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 257us (357us total) trans 4294992487 rc 0/0 00000100:00100000:2.0:1762166981.149557:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11974 00000100:00100000:3.0:1762166981.151528:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.151586:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450702720 00000100:00100000:2.0:1762166981.151600:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450702720 00000100:00100000:2.0:1762166981.151666:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30838 00000100:00100000:2.0:1762166981.151680:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+531:61766:x1847765450702720:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:2.0:1762166981.151715:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166981.151739:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194800/0x2f180c4effbacc09 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea8ac expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.151847:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194e00/0x2f180c4effbacc10 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166981.151866:0:30829:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5ae4a00/0x2f180c4effbacbca lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea897 expref: 532 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.151877:0:30829:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194e00/0x2f180c4effbacc10 lrc: 4/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.151909:0:30829:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5ae4a00/0x2f180c4effbacbca lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea897 expref: 532 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.151920:0:30829:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5ae4a00/0x2f180c4effbacbca lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea897 expref: 532 pid: 30829 timeout: 700 lvb_type: 0 00000100:00100000:2.0:1762166981.151932:0:30829:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5807100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:30829:1847765449786240:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166981.152010:0:30829:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a1600 going to sleep for 11 seconds 00000100:00100000:2.0:1762166981.152959:0:30829:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5807100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:30829:1847765449786240:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166981.152976:0:30829:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194e00/0x2f180c4effbacc10 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000100:00100000:3.0:1762166981.153139:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.153177:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450702848 00000100:00100000:2.0:1762166981.153181:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450702848 00010000:00010000:2.0:1762166981.153196:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5ae4a00/0x2f180c4effbacbca lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea897 expref: 533 pid: 30829 timeout: 700 lvb_type: 0 00000100:00100000:2.0:1762166981.153221:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9800 00000100:00100000:2.0:1762166981.153227:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+533:2419:x1847765450702848:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166981.153234:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166981.153238:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5ae4a00/0x2f180c4effbacbca lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea897 expref: 533 pid: 30829 timeout: 700 lvb_type: 0 00010000:00010000:2.0:1762166981.153247:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5ae4a00/0x2f180c4effbacbca lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea897 expref: 533 pid: 30829 timeout: 700 lvb_type: 0 00010000:00010000:2.0:1762166981.153261:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5ae4a00/0x2f180c4effbacbca lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea897 expref: 533 pid: 30829 timeout: 700 lvb_type: 0 00010000:00010000:2.0:1762166981.153273:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166981.153277:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194e00/0x2f180c4effbacc10 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.153282:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194e00/0x2f180c4effbacc10 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.153286:0:6479:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194e00/0x2f180c4effbacc10 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.153302:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166981.153319:0:30829:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194e00/0x2f180c4effbacc10 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.153330:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194e00/0x2f180c4effbacc10 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000100:00100000:2.0:1762166981.153333:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+532:2419:x1847765450702848:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 101us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166981.153343:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9800 00000004:00200000:3.0:1762166981.153348:0:30829:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 32254 00010000:00010000:3.0:1762166981.153448:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194800/0x2f180c4effbacc09 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea8ac expref: 533 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.153459:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194e00/0x2f180c4effbacc10 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea8ac expref: 532 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.153464:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:3.0:1762166981.153466:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1762166981.153467:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc7194e00, rc 0) 00000100:00100000:3.0:1762166981.153566:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+532:61766:x1847765450702720:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 1889us (2044us total) trans 4294992488 rc 0/0 00000100:00100000:3.0:1762166981.153573:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30838 00000100:00100000:3.0:1762166981.154651:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.154688:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450702976 00000100:00100000:2.0:1762166981.154693:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450702976 00000100:00100000:2.0:1762166981.154718:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30839 00000100:00100000:2.0:1762166981.154722:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+532:61766:x1847765450702976:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:2.0:1762166981.154732:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166981.154740:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194200/0x2f180c4effbacc1e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea8b3 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.154796:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5ae4800/0x2f180c4effbacc25 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166981.154805:0:30829:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194e00/0x2f180c4effbacc10 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea8ac expref: 533 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.154821:0:30829:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5ae4800/0x2f180c4effbacc25 lrc: 4/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.154837:0:30829:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194e00/0x2f180c4effbacc10 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea8ac expref: 533 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.154847:0:30829:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194e00/0x2f180c4effbacc10 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea8ac expref: 533 pid: 30829 timeout: 700 lvb_type: 0 00000100:00100000:2.0:1762166981.154856:0:30829:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5807100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:30829:1847765449786368:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166981.154903:0:30829:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a1c00 going to sleep for 11 seconds 00000100:00100000:2.0:1762166981.155744:0:30829:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5807100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:30829:1847765449786368:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166981.155756:0:30829:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5ae4800/0x2f180c4effbacc25 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000100:00100000:3.0:1762166981.155907:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.155958:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450703104 00000100:00100000:2.0:1762166981.155964:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450703104 00010000:00010000:2.0:1762166981.155982:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194e00/0x2f180c4effbacc10 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea8ac expref: 534 pid: 30829 timeout: 700 lvb_type: 0 00000100:00100000:2.0:1762166981.156012:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9801 00000100:00100000:2.0:1762166981.156023:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+534:2419:x1847765450703104:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166981.156032:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166981.156038:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194e00/0x2f180c4effbacc10 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea8ac expref: 534 pid: 30829 timeout: 700 lvb_type: 0 00010000:00010000:2.0:1762166981.156048:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194e00/0x2f180c4effbacc10 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea8ac expref: 534 pid: 30829 timeout: 700 lvb_type: 0 00010000:00010000:2.0:1762166981.156060:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194e00/0x2f180c4effbacc10 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea8ac expref: 534 pid: 30829 timeout: 700 lvb_type: 0 00010000:00010000:2.0:1762166981.156071:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166981.156075:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5ae4800/0x2f180c4effbacc25 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.156082:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5ae4800/0x2f180c4effbacc25 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.156087:0:6479:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5ae4800/0x2f180c4effbacc25 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.156111:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166981.156153:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+533:2419:x1847765450703104:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 129us (245us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166981.156158:0:30829:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5ae4800/0x2f180c4effbacc25 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000100:00100000:2.0:1762166981.156165:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9801 00010000:00010000:3.0:1762166981.156178:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5ae4800/0x2f180c4effbacc25 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000004:00200000:3.0:1762166981.156227:0:30829:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 32254 00000004:00200000:3.0:1762166981.156231:0:30829:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166981.156247:0:30829:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5ae4800/0x2f180c4effbacc25 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.156309:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7194200/0x2f180c4effbacc1e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea8b3 expref: 533 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.156338:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5ae4800/0x2f180c4effbacc25 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea8b3 expref: 532 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.156347:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:3.0:1762166981.156350:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166981.156354:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc5ae4800, rc 0) 00000100:00100000:3.0:1762166981.156400:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+532:61766:x1847765450702976:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 1677us (1755us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166981.156409:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30839 00000100:00100000:3.0:1762166981.157399:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166981.157448:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450703232 00000100:00100000:0.0:1762166981.157455:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450703232 00000100:00100000:0.0:1762166981.157522:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19402 00000100:00100000:0.0:1762166981.157534:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+21:2416:x1847765450703232:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:0.0:1762166981.157547:0:35472:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166981.157562:0:35472:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbacc2c lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea8ba expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166981.157581:0:35472:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa90:0x0] initial LVB size: 32254, mtime: 0x690888c5, atime: 0x690888c4, ctime: 0x690888c5, blocks: 0x8 00010000:00010000:0.0:1762166981.157599:0:35472:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166981.157602:0:35472:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166981.157611:0:35472:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbacc2c lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea8ba expref: 22 pid: 35472 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166981.157626:0:35472:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbacc2c lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea8ba expref: 22 pid: 35472 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166981.157637:0:35472:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdf000, rc 0) 00000100:00100000:0.0:1762166981.157668:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+22:2416:x1847765450703232:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 140us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166981.157673:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19402 00000100:00100000:0.0:1762166981.158830:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.158887:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450703488 00000100:00100000:2.0:1762166981.158895:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450703488 00000100:00100000:2.0:1762166981.158935:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11975 00000100:00100000:2.0:1762166981.158945:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff2fd050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+532:61766:x1847765450703488:12345-192.168.204.38@tcp:35:fsx.0 00000100:00100000:2.0:1762166981.159104:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff2fd050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+533:61766:x1847765450703488:12345-192.168.204.38@tcp:35:fsx.0 Request processed in 158us (274us total) trans 4294992489 rc 0/0 00000100:00100000:2.0:1762166981.159112:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11975 00000100:00100000:1.0:1762166981.159887:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166981.159928:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450703744 00000100:00100000:3.0:1762166981.159935:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450703744 00000100:00100000:3.0:1762166981.159976:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30840 00000100:00100000:3.0:1762166981.159985:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+533:61766:x1847765450703744:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:3.0:1762166981.159997:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166981.160000:0:30829:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 1 00010000:00010000:3.0:1762166981.160018:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42f6200/0x2f180c4effbacbd8 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea89e expref: 533 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.160034:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eb000/0x2f180c4effbacbae lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea890 expref: 532 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.160047:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5ae4800/0x2f180c4effbacc25 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea8b3 expref: 531 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.160057:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:3.0:1762166981.160060:0:30829:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166981.160070:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62c00/0x2f180c4effbacc33 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea8c1 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.160103:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62000/0x2f180c4effbacc3a lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:3.0:1762166981.160112:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62000/0x2f180c4effbacc3a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.160120:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62000/0x2f180c4effbacc3a lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000040:00080000:3.0:1762166981.160287:0:30829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5949, 88 off466168 00000004:00080000:3.0:1762166981.160295:0:30829:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 600308817145ns, next at 600144491692ns, rc = 0 00000040:00080000:3.0:1762166981.160333:0:30829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5948, 88 off466168 00000004:00080000:3.0:1762166981.160340:0:30829:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 600308861867ns, next at 600144525370ns, rc = 0 00000040:00080000:3.0:1762166981.160367:0:30829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5949, 88 off466256 00000004:00080000:3.0:1762166981.160373:0:30829:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 600308894975ns, next at 600144525370ns, rc = 0 00000040:00080000:3.0:1762166981.160390:0:30829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5950, 88 off466256 00000004:00080000:3.0:1762166981.160394:0:30829:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 600308916518ns, next at 600144491692ns, rc = 0 00000040:00080000:3.0:1762166981.160421:0:30829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5951, 88 off466344 00000004:00080000:3.0:1762166981.160427:0:30829:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 600308948828ns, next at 600144491692ns, rc = 0 00000040:00080000:3.0:1762166981.160452:0:30829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5950, 88 off466344 00000004:00080000:3.0:1762166981.160457:0:30829:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 600308979525ns, next at 600144525370ns, rc = 0 00000001:00080000:0.0:1762166981.162237:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294992490 is committed 00000004:00080000:0.0:1762166981.162247:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3311 committed 00000004:00080000:0.0:1762166981.162261:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3308 committed 00000004:00080000:0.0:1762166981.162276:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3307 committed 00000004:00080000:0.0:1762166981.162280:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3310 committed 00000004:00080000:0.0:1762166981.162284:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3309 committed 00000004:00080000:0.0:1762166981.162289:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3306 committed 00000100:00100000:3.0:1762166981.162364:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449786496:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1762166981.162370:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5807100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449786624:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1762166981.162428:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449786752:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166981.162437:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166981.162469:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5806d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449786880:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1762166981.162536:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166981.162563:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449787008:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1762166981.162585:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166981.162601:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449786496 00010000:00010000:2.0:1762166981.162604:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62000/0x2f180c4effbacc3a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea8c1 expref: 526 pid: 30829 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166981.162607:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449786496 00000100:00100000:3.0:1762166981.162628:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1762166981.162634:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166981.162641:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000100:00100000:1.0:1762166981.162651:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449786752 00000100:00100000:1.0:1762166981.162658:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449786752 00010000:00010000:2.0:1762166981.162662:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62c00/0x2f180c4effbacc33 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea8c1 expref: 526 pid: 30829 timeout: 0 lvb_type: 3 00000100:00100000:0.0:1762166981.162673:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166981.162677:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1762166981.162694:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5805f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449787136:0@lo:2:osp-syn-1-1.0 00010000:00010000:2.0:1762166981.162694:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62000/0x2f180c4effbacc3a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea8c1 expref: 525 pid: 30829 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166981.162696:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449786880 00000100:00100000:1.0:1762166981.162708:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449786880 00000100:00100000:0.0:1762166981.162734:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449787008 00010000:00010000:2.0:1762166981.162740:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00000100:00100000:0.0:1762166981.162743:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449787008 00010000:00010000:2.0:1762166981.162745:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1762166981.162751:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4b62000, rc 0) 00000100:00100000:3.0:1762166981.162752:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166981.162757:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449786624 00000100:00100000:1.0:1762166981.162764:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449786624 00000100:00100000:3.0:1762166981.162829:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449787136 00000100:00100000:3.0:1762166981.162835:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449787136 00000100:00100000:0.0:1762166981.162840:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19403 00000100:00100000:1.0:1762166981.162860:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19404 00000100:00100000:0.0:1762166981.162861:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+27:3635:x1847765449786496:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1762166981.162878:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19405 00000100:00100000:1.0:1762166981.162886:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+27:3633:x1847765449786752:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1762166981.162901:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+10:3634:x1847765449786880:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166981.162909:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19406 00000100:00100000:3.0:1762166981.162923:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+27:3635:x1847765449787008:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:1.0:1762166981.162983:0:9165:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166981.162987:0:9165:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00010000:1.0:1762166981.162989:0:9165:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166981 -> 1762166981 00002000:00010000:1.0:1762166981.162992:0:9165:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00002000:00010000:1.0:1762166981.162993:0:9165:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00002000:00010000:0.0:1762166981.163024:0:35472:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166981.163027:0:28434:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166981.163030:0:35472:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb mtime from disk: 1762166966 -> 1762166966 00002000:00010000:2.0:1762166981.163033:0:28434:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00010000:3.0:1762166981.163035:0:8380:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166981.163036:0:35472:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1762166981.163038:0:28434:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166981 -> 1762166981 00002000:00010000:0.0:1762166981.163041:0:35472:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb ctime from disk: 1762166966 -> 1762166966 00002000:00010000:2.0:1762166981.163043:0:28434:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00002000:00010000:0.0:1762166981.163054:0:35472:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1762166981.163055:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+30:3633:x1847765449786752:12345-0@lo:2:osp-syn-0-1.0 Request processed in 168us (567us total) trans 21474843455 rc 0/0 00002000:00010000:2.0:1762166981.163056:0:28434:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:3.0:1762166981.163057:0:8380:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00010000:3.0:1762166981.163071:0:8380:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00002000:00010000:3.0:1762166981.163077:0:8380:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00000100:00100000:1.0:1762166981.163077:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19404 00002000:00010000:3.0:1762166981.163084:0:8380:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1762166981.163116:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19407 00000100:00100000:1.0:1762166981.163134:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+11:3636:x1847765449786624:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1762166981.163137:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+29:3635:x1847765449786496:12345-0@lo:2:osp-syn-0-1.0 Request processed in 280us (697us total) trans 21474843456 rc 0/0 00000100:00100000:2.0:1762166981.163141:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+11:3634:x1847765449786880:12345-0@lo:2:osp-syn-1-1.0 Request processed in 243us (557us total) trans 17179876701 rc 0/0 00000100:00100000:3.0:1762166981.163157:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+29:3635:x1847765449787008:12345-0@lo:2:osp-syn-0-1.0 Request processed in 229us (538us total) trans 21474843457 rc 0/0 00000100:00100000:0.0:1762166981.163173:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19403 00000100:00100000:2.0:1762166981.163182:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19405 00000100:00100000:3.0:1762166981.163190:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19406 00000100:00100000:0.0:1762166981.163209:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19408 00000100:00100000:0.0:1762166981.163225:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+11:3635:x1847765449787136:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:1.0:1762166981.163227:0:9165:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 32254 -> 32254 00002000:00010000:1.0:1762166981.163235:0:9165:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00010000:1.0:1762166981.163238:0:9165:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166981 -> 1762166981 00002000:00010000:1.0:1762166981.163242:0:9165:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00002000:00010000:1.0:1762166981.163245:0:9165:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 72 -> 72 00000004:00080000:3.0:1762166981.163269:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945ceda2c380/2, rc 0, transno 21474843457 00000004:00080000:2.0:1762166981.163273:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc5806d80/2, rc 0, transno 17179876701 00000100:00100000:3.0:1762166981.163283:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449787008:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1762166981.163285:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5806d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449786880:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1762166981.163303:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+12:3636:x1847765449786624:12345-0@lo:2:osp-syn-1-1.0 Request processed in 170us (628us total) trans 17179876702 rc 0/0 00002000:00010000:0.0:1762166981.163305:0:35472:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb size from disk: 32254 -> 32254 00002000:00010000:0.0:1762166981.163318:0:35472:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00000004:00080000:3.0:1762166981.163319:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945ceda2e680/2, rc 0, transno 21474843456 00000100:00100000:1.0:1762166981.163322:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19407 00002000:00010000:0.0:1762166981.163335:0:35472:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00000100:00100000:3.0:1762166981.163346:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449786496:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1762166981.163346:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+525:61766:x1847765450703744:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 3356us (3455us total) trans 4294992490 rc 0/0 00002000:00010000:0.0:1762166981.163346:0:35472:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00002000:00010000:0.0:1762166981.163359:0:35472:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1762166981.163377:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30840 00000004:00080000:1.0:1762166981.163407:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945ceda2d500/2, rc 0, transno 21474843455 00000100:00100000:1.0:1762166981.163415:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449786752:0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1762166981.163435:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+11:3635:x1847765449787136:12345-0@lo:2:osp-syn-1-1.0 Request processed in 212us (682us total) trans 17179876703 rc 0/0 00000100:00100000:0.0:1762166981.163446:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19408 00000004:00080000:2.0:1762166981.163461:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc5805f80/2, rc 0, transno 17179876703 00000004:00080000:1.0:1762166981.163465:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc5807100/2, rc 0, transno 17179876702 00000100:00100000:2.0:1762166981.163471:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5805f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449787136:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1762166981.163527:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5807100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449786624:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166981.165059:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166981.165117:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450703872 00000100:00100000:0.0:1762166981.165126:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450703872 00000100:00100000:0.0:1762166981.165167:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19409 00000100:00100000:0.0:1762166981.165176:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+22:61766:x1847765450703872:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:0.0:1762166981.165190:0:35472:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166981.165206:0:35472:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbacc41 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea8c8 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.165237:0:35472:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945cc355be00/0x2f180c4effbacb45 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea866 expref: 23 pid: 8380 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166981.165245:0:35472:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166981.165247:0:35472:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166981.165251:0:35472:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbacc41 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [16384->24575] (req 16384->24575) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea8c8 expref: 23 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.165281:0:35472:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945cc355be00/0x2f180c4effbacb45 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea866 expref: 23 pid: 8380 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166981.165296:0:35472:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945cc355be00/0x2f180c4effbacb45 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea866 expref: 23 pid: 8380 timeout: 700 lvb_type: 1 00000100:00100000:0.0:1762166981.165308:0:35472:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7d21880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:35472:1847765449787264:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166981.165375:0:35472:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1fe2600 going to sleep for 11 seconds 00000100:00100000:0.0:1762166981.166212:0:35472:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7d21880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:35472:1847765449787264:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166981.166237:0:35472:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbacc41 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [16384->24575] (req 16384->24575) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea8c8 expref: 23 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.166252:0:35472:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdf600, rc 0) 00000100:00100000:0.0:1762166981.166294:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+23:61766:x1847765450703872:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 1119us (1236us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166981.166305:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19409 00000100:00100000:3.0:1762166981.166457:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.166545:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450704000 00000100:00100000:2.0:1762166981.166551:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450704000 00010000:00010000:2.0:1762166981.166571:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355be00/0x2f180c4effbacb45 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea866 expref: 23 pid: 8380 timeout: 700 lvb_type: 1 00000100:00100000:2.0:1762166981.166599:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9802 00000100:00100000:2.0:1762166981.166608:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765450704000:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166981.166621:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166981.166637:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945cc355be00/0x2f180c4effbacb45 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea866 expref: 23 pid: 8380 timeout: 700 lvb_type: 1 00010000:00010000:2.0:1762166981.166650:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945cc355be00/0x2f180c4effbacb45 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea866 expref: 23 pid: 8380 timeout: 700 lvb_type: 1 00010000:00010000:2.0:1762166981.166669:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cc355be00/0x2f180c4effbacb45 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea866 expref: 23 pid: 8380 timeout: 700 lvb_type: 1 00010000:00010000:2.0:1762166981.166686:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166981.166688:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166981.166695:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbacc41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->24575) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea8c8 expref: 22 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.166703:0:6479:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbacc41 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->24575) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea8c8 expref: 22 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.166726:0:6479:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbacc41 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->24575) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea8c8 expref: 22 pid: 35472 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166981.166735:0:6479:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6479:1847765449787392:192.168.204.38@tcp:105: 00000100:00100000:2.0:1762166981.166773:0:6479:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cff1fa300 going to sleep for 11 seconds 00000100:00100000:2.0:1762166981.167687:0:6479:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6479:1847765449787392:192.168.204.38@tcp:105: 00010000:00010000:2.0:1762166981.167702:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166981.167742:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450704000:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1135us (1285us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166981.167751:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9802 00000100:00100000:3.0:1762166981.167944:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.167992:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450704128 00000100:00100000:2.0:1762166981.167997:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450704128 00000100:00100000:2.0:1762166981.168038:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2701 00000100:00100000:2.0:1762166981.168048:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450704128:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:2.0:1762166981.168214:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 32254 -> 32254 00002000:00010000:2.0:1762166981.168218:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00010000:2.0:1762166981.168221:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166981 -> 1762166981 00002000:00010000:2.0:1762166981.168224:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00002000:00010000:2.0:1762166981.168226:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 72 -> 72 00000100:00100000:2.0:1762166981.168258:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765450704128:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 212us (314us total) trans 17179876704 rc 0/0 00000100:00100000:2.0:1762166981.168266:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2701 00000100:00100000:0.0:1762166981.169095:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.169133:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450704256 00000100:00100000:2.0:1762166981.169137:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450704256 00000100:00100000:2.0:1762166981.169170:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30841 00000100:00100000:2.0:1762166981.169178:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+525:61766:x1847765450704256:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:2.0:1762166981.169196:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166981.169214:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5ae4a00/0x2f180c4effbacc48 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea8cf expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.169304:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eaa00/0x2f180c4effbacc4f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166981.169318:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eaa00/0x2f180c4effbacc4f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.169330:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eaa00/0x2f180c4effbacc4f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000004:00200000:2.0:1762166981.169356:0:30829:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 32254 00000004:00200000:2.0:1762166981.169361:0:30829:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166981.169377:0:30829:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eaa00/0x2f180c4effbacc4f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.169402:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5ae4a00/0x2f180c4effbacc48 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea8cf expref: 527 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.169418:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eaa00/0x2f180c4effbacc4f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea8cf expref: 526 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.169426:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166981.169430:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166981.169432:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc56eaa00, rc 0) 00000100:00100000:2.0:1762166981.169468:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+526:61766:x1847765450704256:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 291us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166981.169475:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30841 00000100:00100000:1.0:1762166981.170991:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166981.171070:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450704512 00000100:00100000:3.0:1762166981.171079:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450704512 00000100:00100000:3.0:1762166981.171122:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30842 00000100:00100000:3.0:1762166981.171131:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+526:61766:x1847765450704512:12345-192.168.204.38@tcp:36:fsx.0 00010000:00010000:3.0:1762166981.171173:0:30829:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1762166981.171193:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62000/0x2f180c4effbacc3a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea8c1 expref: 526 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.171211:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc56eaa00/0x2f180c4effbacc4f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea8cf expref: 525 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.171221:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:3.0:1762166981.171224:0:30829:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166981.171382:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62e00/0x2f180c4effbacc56 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:3.0:1762166981.171393:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62e00/0x2f180c4effbacc56 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.171401:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62e00/0x2f180c4effbacc56 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000001:00080000:3.0:1762166981.171440:0:30829:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992491 00000004:00010000:3.0:1762166981.171468:0:30829:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000f4fdf966 reply state 00000000a62e49b2 transno 4294992492 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62e00/0x2f180c4effbacc56 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.171509:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62e00/0x2f180c4effbacc56 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.171520:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:3.0:1762166981.171522:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1762166981.171525:0:30829:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166981.171594:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+527:61766:x1847765450704512:12345-192.168.204.38@tcp:36:fsx.0 Request processed in 465us (606us total) trans 4294992492 rc 0/0 00000100:00100000:3.0:1762166981.171601:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30842 00000020:00080000:3.0:1762166981.171606:0:30829:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1762166981.172308:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.172349:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450704640 00000100:00100000:2.0:1762166981.172356:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450704640 00000100:00100000:2.0:1762166981.172392:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30843 00000100:00100000:2.0:1762166981.172404:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+527:61766:x1847765450704640:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:2.0:1762166981.172417:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166981.172427:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7c0ec00/0x2f180c4effbacc5d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea8d6 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.172457:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7c0ec00/0x2f180c4effbacc5d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea8d6 expref: 528 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.172469:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7c0ec00/0x2f180c4effbacc5d lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea8d6 expref: 528 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.172506:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166981.172510:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166981.172513:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc7c0ec00, rc 0) 00000100:00100000:2.0:1762166981.172547:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+528:61766:x1847765450704640:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 144us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166981.172554:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30843 00000100:00100000:0.0:1762166981.173644:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.173680:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450704768 00000100:00100000:2.0:1762166981.173685:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450704768 00000100:00100000:2.0:1762166981.173712:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19410 00000100:00100000:2.0:1762166981.173718:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+28:61766:x1847765450704768:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:2.0:1762166981.173727:0:35472:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166981.173738:0:35472:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc7c0f800/0x2f180c4effbacc64 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea8dd expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.173757:0:35472:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4b63400/0x2f180c4effbacb4c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea86d expref: 29 pid: 35247 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166981.173763:0:35472:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166981.173765:0:35472:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166981.173767:0:35472:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc7c0f800/0x2f180c4effbacc64 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea8dd expref: 29 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.173797:0:35472:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc4b63400/0x2f180c4effbacb4c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea86d expref: 29 pid: 35247 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166981.173820:0:35472:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc4b63400/0x2f180c4effbacb4c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea86d expref: 29 pid: 35247 timeout: 700 lvb_type: 1 00000100:00100000:2.0:1762166981.173838:0:35472:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:35472:1847765449787520:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166981.173906:0:35472:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cff1fa300 going to sleep for 11 seconds 00000100:00100000:2.0:1762166981.174899:0:35472:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:35472:1847765449787520:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166981.174922:0:35472:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc7c0f800/0x2f180c4effbacc64 lrc: 3/0,0 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea8dd expref: 29 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.174942:0:35472:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc7c0f800, rc 0) 00000100:00100000:2.0:1762166981.174984:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+29:61766:x1847765450704768:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 1267us (1343us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166981.174993:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19410 00000100:00100000:3.0:1762166981.175080:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.175127:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450704896 00000100:00100000:2.0:1762166981.175134:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450704896 00010000:00010000:2.0:1762166981.175158:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4b63400/0x2f180c4effbacb4c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea86d expref: 29 pid: 35247 timeout: 700 lvb_type: 1 00000100:00100000:2.0:1762166981.175199:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9803 00000100:00100000:2.0:1762166981.175211:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+29:2418:x1847765450704896:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166981.175225:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166981.175246:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc4b63400/0x2f180c4effbacb4c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea86d expref: 29 pid: 35247 timeout: 700 lvb_type: 1 00010000:00010000:2.0:1762166981.175261:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc4b63400/0x2f180c4effbacb4c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea86d expref: 29 pid: 35247 timeout: 700 lvb_type: 1 00010000:00010000:2.0:1762166981.175280:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4b63400/0x2f180c4effbacb4c lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea86d expref: 29 pid: 35247 timeout: 700 lvb_type: 1 00010000:00010000:2.0:1762166981.175293:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166981.175295:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166981.175302:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc7c0f800/0x2f180c4effbacc64 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea8dd expref: 28 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.175317:0:6479:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc7c0f800/0x2f180c4effbacc64 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea8dd expref: 28 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.175341:0:6479:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff945bc7c0f800/0x2f180c4effbacc64 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea8dd expref: 28 pid: 35472 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166981.175352:0:6479:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6479:1847765449787648:192.168.204.38@tcp:105: 00000100:00100000:2.0:1762166981.175404:0:6479:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cff1fa300 going to sleep for 11 seconds 00000100:00100000:2.0:1762166981.176216:0:6479:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6479:1847765449787648:192.168.204.38@tcp:105: 00010000:00010000:2.0:1762166981.176229:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166981.176266:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+28:2418:x1847765450704896:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1060us (1191us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166981.176274:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9803 00000100:00100000:1.0:1762166981.176515:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.176539:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450705024 00000100:00100000:2.0:1762166981.176545:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450705024 00000100:00100000:2.0:1762166981.176587:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19411 00000100:00100000:2.0:1762166981.176596:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+23:61766:x1847765450705024:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:2.0:1762166981.176611:0:35472:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166981.176628:0:35472:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc6eeaa00/0x2f180c4effbacc6b lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea8e4 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.176647:0:35472:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc56eb800/0x2f180c4effbacb53 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea874 expref: 24 pid: 35472 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166981.176656:0:35472:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166981.176657:0:35472:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166981.176659:0:35472:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc6eeaa00/0x2f180c4effbacc6b lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea8e4 expref: 24 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.176677:0:35472:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc56eb800/0x2f180c4effbacb53 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea874 expref: 24 pid: 35472 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166981.176688:0:35472:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc56eb800/0x2f180c4effbacb53 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea874 expref: 24 pid: 35472 timeout: 700 lvb_type: 1 00000100:00100000:2.0:1762166981.176698:0:35472:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:35472:1847765449787776:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166981.176741:0:35472:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cff1fa300 going to sleep for 11 seconds 00000100:00100000:2.0:1762166981.177597:0:35472:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:35472:1847765449787776:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166981.177615:0:35472:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc6eeaa00/0x2f180c4effbacc6b lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea8e4 expref: 24 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.177627:0:35472:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc6eeaa00, rc 0) 00000100:00100000:2.0:1762166981.177662:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+24:61766:x1847765450705024:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 1067us (1146us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166981.177669:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19411 00000100:00100000:3.0:1762166981.177718:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.177749:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450705152 00000100:00100000:2.0:1762166981.177754:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450705152 00010000:00010000:2.0:1762166981.177773:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc56eb800/0x2f180c4effbacb53 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea874 expref: 24 pid: 35472 timeout: 700 lvb_type: 1 00000100:00100000:2.0:1762166981.177824:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9804 00000100:00100000:2.0:1762166981.177832:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+24:2418:x1847765450705152:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166981.177843:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166981.177860:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc56eb800/0x2f180c4effbacb53 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea874 expref: 24 pid: 35472 timeout: 700 lvb_type: 1 00010000:00010000:2.0:1762166981.177871:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc56eb800/0x2f180c4effbacb53 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea874 expref: 24 pid: 35472 timeout: 700 lvb_type: 1 00010000:00010000:2.0:1762166981.177893:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc56eb800/0x2f180c4effbacb53 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea874 expref: 24 pid: 35472 timeout: 700 lvb_type: 1 00010000:00010000:2.0:1762166981.177904:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166981.177906:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166981.177911:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc6eeaa00/0x2f180c4effbacc6b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea8e4 expref: 23 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.177920:0:6479:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc6eeaa00/0x2f180c4effbacc6b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea8e4 expref: 23 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.177942:0:6479:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff945bc6eeaa00/0x2f180c4effbacc6b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea8e4 expref: 23 pid: 35472 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166981.177951:0:6479:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6479:1847765449787904:192.168.204.38@tcp:105: 00000100:00100000:2.0:1762166981.177993:0:6479:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cff1fa300 going to sleep for 11 seconds 00000100:00100000:2.0:1762166981.178890:0:6479:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6479:1847765449787904:192.168.204.38@tcp:105: 00010000:00010000:2.0:1762166981.178920:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166981.178983:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765450705152:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1151us (1265us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166981.179001:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9804 00000100:00100000:3.0:1762166981.179008:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166981.179076:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450705280 00000100:00100000:0.0:1762166981.179084:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450705280 00000100:00100000:3.0:1762166981.179119:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00002000:00010000:0.0:1762166981.179125:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (144456->18446744073709551615) 00002000:00100000:0.0:1762166981.179132:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc55ded80 with x1847765450705280 ext(144456->18446744073709551615) 00002000:00010000:0.0:1762166981.179143:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc55ded80. 00000100:00100000:0.0:1762166981.179170:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450705536 00000100:00100000:0.0:1762166981.179175:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450705536 00000100:00100000:2.0:1762166981.179182:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2702 00002000:00010000:0.0:1762166981.179192:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:0.0:1762166981.179197:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc55dca80 with x1847765450705536 ext(0->18446744073709551615) 00000100:00100000:2.0:1762166981.179199:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765450705280:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:0.0:1762166981.179208:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc55dca80. 00000100:00100000:3.0:1762166981.179224:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166981.179242:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450705408 00000100:00100000:0.0:1762166981.179248:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450705408 00002000:00010000:0.0:1762166981.179267:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00000100:00100000:1.0:1762166981.179269:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2703 00002000:00100000:0.0:1762166981.179272:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc55dc700 with x1847765450705408 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166981.179282:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc55dc700. 00000100:00100000:1.0:1762166981.179288:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765450705536:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:0.0:1762166981.179303:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2704 00000100:00100000:0.0:1762166981.179316:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+28:2418:x1847765450705408:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:1.0:1762166981.179444:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166981.179449:0:23943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00010000:2.0:1762166981.179453:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 32254 -> 144456 00002000:00010000:1.0:1762166981.179454:0:23943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166981 -> 1762166981 00002000:00010000:0.0:1762166981.179455:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166981.179462:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00010000:0.0:1762166981.179462:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00010000:1.0:1762166981.179470:0:23943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00002000:00010000:2.0:1762166981.179473:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166981 -> 1762166981 00002000:00010000:0.0:1762166981.179473:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166981 -> 1762166981 00002000:00010000:2.0:1762166981.179520:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00002000:00010000:2.0:1762166981.179522:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 72 -> 72 00002000:00010000:0.0:1762166981.179528:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00002000:00010000:0.0:1762166981.179531:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00002000:00010000:1.0:1762166981.179534:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1762166981.179567:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765450705280:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 373us (568us total) trans 17179876706 rc 0/0 00000100:00100000:0.0:1762166981.179574:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+29:2418:x1847765450705408:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 257us (347us total) trans 21474843458 rc 0/0 00000100:00100000:2.0:1762166981.179588:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2702 00000100:00100000:1.0:1762166981.179588:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765450705536:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 298us (460us total) trans 17179876705 rc 0/0 00002000:00010000:2.0:1762166981.179596:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (144456->18446744073709551615) 00000100:00100000:0.0:1762166981.179601:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2704 00002000:00100000:2.0:1762166981.179603:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc55ded80 with x1847765450705280 ext(144456->18446744073709551615) 00002000:00010000:0.0:1762166981.179607:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00010000:2.0:1762166981.179612:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc55ded80. 00002000:00100000:0.0:1762166981.179619:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc55dc700 with x1847765450705408 ext(0->18446744073709551615) 00000100:00100000:1.0:1762166981.179620:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2703 00002000:00010000:1.0:1762166981.179634:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00010000:0.0:1762166981.179635:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc55dc700. 00002000:00100000:1.0:1762166981.179643:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc55dca80 with x1847765450705536 ext(0->18446744073709551615) 00002000:00010000:1.0:1762166981.179653:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc55dca80. 00000100:00100000:1.0:1762166981.180729:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.180779:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450705664 00000100:00100000:2.0:1762166981.180788:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450705664 00000100:00100000:2.0:1762166981.180840:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30844 00000100:00100000:2.0:1762166981.180850:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4530380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+528:61766:x1847765450705664:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:2.0:1762166981.180867:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166981.180890:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac200/0x2f180c4effbacc72 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea8eb expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.180988:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cada00/0x2f180c4effbacc79 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166981.181003:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cada00/0x2f180c4effbacc79 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.181015:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cada00/0x2f180c4effbacc79 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000004:00200000:2.0:1762166981.181046:0:30829:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 144456 00000004:00200000:2.0:1762166981.181051:0:30829:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166981.181071:0:30829:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cada00/0x2f180c4effbacc79 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.181101:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac200/0x2f180c4effbacc72 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea8eb expref: 530 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.181118:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cada00/0x2f180c4effbacc79 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea8eb expref: 529 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.181127:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166981.181131:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166981.181134:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cada00, rc 0) 00000100:00100000:2.0:1762166981.181178:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4530380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+529:61766:x1847765450705664:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 330us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166981.181186:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30844 00000100:00100000:3.0:1762166981.182993:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166981.183054:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450705792 00000100:00100000:1.0:1762166981.183061:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450705792 00000100:00100000:1.0:1762166981.183107:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2705 00000100:00100000:1.0:1762166981.183114:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+25:2416:x1847765450705792:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:1.0:1762166981.183295:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 144456 -> 144456 00002000:00010000:1.0:1762166981.183298:0:23943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00010000:1.0:1762166981.183300:0:23943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166981 -> 1762166981 00002000:00010000:1.0:1762166981.183301:0:23943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00002000:00010000:1.0:1762166981.183302:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 72 -> 72 00000100:00100000:1.0:1762166981.183340:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+26:2416:x1847765450705792:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 227us (354us total) trans 17179876707 rc 0/0 00000100:00100000:1.0:1762166981.183347:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2705 00000100:00100000:0.0:1762166981.185670:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166981.185713:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450705920 00000100:00100000:1.0:1762166981.185722:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450705920 00002000:00100000:1.0:1762166981.185762:0:23943:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000400:0xa77:0x0] (28672->53247) req@ffff945bcce77480 x1847765450705920/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:12/0 lens 488/0 e 0 to 0 dl 1762166992 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166981.185774:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bcce77480 with x1847765450705920 ext(28672->53247) 00002000:00010000:1.0:1762166981.185780:0:23943:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bcce77480 00000100:00100000:1.0:1762166981.185816:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2706 00000100:00100000:1.0:1762166981.185835:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765450705920:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:1.0:1762166981.187030:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765450705920:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 1198us (1363us total) trans 0 rc 24576/24576 00000100:00100000:1.0:1762166981.187041:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2706 00002000:00100000:1.0:1762166981.187050:0:23943:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000400:0xa77:0x0] (28672->53247) req@ffff945bcce77480 x1847765450705920/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:12/0 lens 488/440 e 0 to 0 dl 1762166992 ref 1 fl Complete:/600/0 rc 24576/24576 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166981.187060:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bcce77480 with x1847765450705920 ext(28672->53247) 00002000:00010000:1.0:1762166981.187064:0:23943:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bcce77480 00000100:00100000:3.0:1762166981.188823:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.188868:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450706176 00000100:00100000:2.0:1762166981.188877:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450706176 00000100:00100000:2.0:1762166981.188919:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30845 00000100:00100000:2.0:1762166981.188930:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+529:61766:x1847765450706176:12345-192.168.204.38@tcp:36:fsx.0 00010000:00010000:2.0:1762166981.188993:0:30829:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166981.189021:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cada00/0x2f180c4effbacc79 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea8eb expref: 529 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.189036:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166981.189040:0:30829:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166981.189240:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42d1200/0x2f180c4effbacc80 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166981.189256:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42d1200/0x2f180c4effbacc80 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.189267:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42d1200/0x2f180c4effbacc80 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000001:00080000:2.0:1762166981.189315:0:30829:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992493 00000004:00010000:2.0:1762166981.189341:0:30829:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000041e7924f reply state 000000000cf9aff9 transno 4294992494 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42d1200/0x2f180c4effbacc80 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.189354:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42d1200/0x2f180c4effbacc80 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.189360:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166981.189363:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166981.189366:0:30829:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166981.189448:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+531:61766:x1847765450706176:12345-192.168.204.38@tcp:36:fsx.0 Request processed in 520us (646us total) trans 4294992494 rc 0/0 00000100:00100000:2.0:1762166981.189456:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30845 00000020:00080000:2.0:1762166981.189461:0:30829:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1762166981.191089:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166981.191122:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166981.191152:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450706304 00000100:00100000:2.0:1762166981.191160:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450706432 00000100:00100000:1.0:1762166981.191163:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450706304 00000100:00100000:2.0:1762166981.191166:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450706432 00000100:00100000:0.0:1762166981.191204:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00002000:00010000:1.0:1762166981.191208:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (262144->18446744073709551615) 00002000:00010000:2.0:1762166981.191212:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:1.0:1762166981.191215:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bcce74e00 with x1847765450706304 ext(262144->18446744073709551615) 00002000:00100000:2.0:1762166981.191218:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bcce75880 with x1847765450706432 ext(0->18446744073709551615) 00002000:00010000:1.0:1762166981.191229:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bcce74e00. 00002000:00010000:2.0:1762166981.191232:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bcce75880. 00000100:00100000:1.0:1762166981.191257:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450706560 00000100:00100000:1.0:1762166981.191262:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450706560 00000100:00100000:2.0:1762166981.191274:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2707 00002000:00010000:1.0:1762166981.191282:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00000100:00100000:2.0:1762166981.191286:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+27:2418:x1847765450706304:12345-192.168.204.38@tcp:10:fsx.0 00002000:00100000:1.0:1762166981.191292:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf79e8700 with x1847765450706560 ext(0->18446744073709551615) 00000100:00100000:0.0:1762166981.191296:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2708 00002000:00010000:1.0:1762166981.191306:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf79e8700. 00000100:00100000:3.0:1762166981.191325:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2709 00000100:00100000:0.0:1762166981.191337:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+29:2418:x1847765450706432:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:3.0:1762166981.191344:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+27:2419:x1847765450706560:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:2.0:1762166981.191445:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 144456 -> 262144 00002000:00010000:2.0:1762166981.191450:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00010000:2.0:1762166981.191452:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166981 -> 1762166981 00002000:00010000:2.0:1762166981.191453:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00002000:00010000:2.0:1762166981.191455:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 72 -> 72 00002000:00010000:0.0:1762166981.191532:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166981.191536:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00010000:0.0:1762166981.191540:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166981 -> 1762166981 00002000:00010000:0.0:1762166981.191542:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00002000:00010000:0.0:1762166981.191544:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00000100:00100000:2.0:1762166981.191560:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+29:2418:x1847765450706304:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 276us (473us total) trans 17179876708 rc 0/0 00000100:00100000:2.0:1762166981.191566:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2707 00002000:00010000:2.0:1762166981.191571:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (262144->18446744073709551615) 00002000:00100000:2.0:1762166981.191574:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bcce74e00 with x1847765450706304 ext(262144->18446744073709551615) 00002000:00010000:2.0:1762166981.191580:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bcce74e00. 00002000:00010000:3.0:1762166981.191583:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166981.191589:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00010000:3.0:1762166981.191594:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166981 -> 1762166981 00002000:00010000:3.0:1762166981.191597:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00002000:00010000:3.0:1762166981.191602:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1762166981.191602:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+30:2418:x1847765450706432:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 283us (472us total) trans 21474843459 rc 0/0 00000100:00100000:0.0:1762166981.191615:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2708 00002000:00010000:0.0:1762166981.191622:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:0.0:1762166981.191626:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bcce75880 with x1847765450706432 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166981.191634:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bcce75880. 00000100:00100000:3.0:1762166981.191679:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+28:2419:x1847765450706560:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 338us (472us total) trans 17179876709 rc 0/0 00000100:00100000:3.0:1762166981.191687:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2709 00002000:00010000:3.0:1762166981.191692:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:3.0:1762166981.191696:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf79e8700 with x1847765450706560 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166981.191703:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf79e8700. 00000100:00100000:0.0:1762166981.193111:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166981.193152:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450706688 00000100:00100000:3.0:1762166981.193160:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450706688 00002000:00100000:3.0:1762166981.193193:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (196608->200703) req@ffff945cf79e9c00 x1847765450706688/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:12/0 lens 488/0 e 0 to 0 dl 1762166992 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166981.193203:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf79e9c00 with x1847765450706688 ext(196608->200703) 00002000:00010000:3.0:1762166981.193208:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf79e9c00 00000100:00100000:3.0:1762166981.193230:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2710 00000100:00100000:3.0:1762166981.193240:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+28:2416:x1847765450706688:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:3.0:1762166981.193392:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+28:2416:x1847765450706688:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 154us (281us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1762166981.193400:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2710 00002000:00100000:3.0:1762166981.193407:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (196608->200703) req@ffff945cf79e9c00 x1847765450706688/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:12/0 lens 488/4536 e 0 to 0 dl 1762166992 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166981.193416:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf79e9c00 with x1847765450706688 ext(196608->200703) 00002000:00010000:3.0:1762166981.193420:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf79e9c00 00000100:00100000:1.0:1762166981.194693:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166981.194741:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450706816 00000100:00100000:3.0:1762166981.194747:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450706816 00002000:00100000:3.0:1762166981.194777:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (200704->204799) req@ffff945bc4532d80 x1847765450706816/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:12/0 lens 488/0 e 0 to 0 dl 1762166992 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166981.194785:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4532d80 with x1847765450706816 ext(200704->204799) 00002000:00010000:3.0:1762166981.194790:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4532d80 00000100:00100000:3.0:1762166981.194823:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2711 00000100:00100000:3.0:1762166981.194831:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4532d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+28:2419:x1847765450706816:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:3.0:1762166981.194913:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4532d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+28:2419:x1847765450706816:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 84us (227us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1762166981.194918:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2711 00002000:00100000:3.0:1762166981.194922:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (200704->204799) req@ffff945bc4532d80 x1847765450706816/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:12/0 lens 488/4536 e 0 to 0 dl 1762166992 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166981.194928:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4532d80 with x1847765450706816 ext(200704->204799) 00002000:00010000:3.0:1762166981.194930:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4532d80 00000100:00100000:0.0:1762166981.196394:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166981.196439:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450706944 00000100:00100000:3.0:1762166981.196445:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450706944 00002000:00100000:3.0:1762166981.196464:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (176128->241663) req@ffff945cf79eb480 x1847765450706944/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:12/0 lens 504/0 e 0 to 0 dl 1762166992 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166981.196473:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf79eb480 with x1847765450706944 ext(176128->241663) 00002000:00010000:3.0:1762166981.196506:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf79eb480 00000100:00100000:3.0:1762166981.196530:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2712 00000100:00100000:3.0:1762166981.196546:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+28:2419:x1847765450706944:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:3.0:1762166981.197573:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+28:2419:x1847765450706944:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 1030us (1175us total) trans 0 rc 57344/57344 00000100:00100000:3.0:1762166981.197585:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2712 00002000:00100000:3.0:1762166981.197598:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (176128->241663) req@ffff945cf79eb480 x1847765450706944/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:12/0 lens 504/440 e 0 to 0 dl 1762166992 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166981.197607:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf79eb480 with x1847765450706944 ext(176128->241663) 00002000:00010000:3.0:1762166981.197612:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf79eb480 00000100:00100000:1.0:1762166981.200415:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166981.200457:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450707072 00000100:00100000:3.0:1762166981.200465:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450707072 00002000:00100000:3.0:1762166981.200529:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (241664->262143) req@ffff945bc4531180 x1847765450707072/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:12/0 lens 488/0 e 0 to 0 dl 1762166992 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166981.200537:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4531180 with x1847765450707072 ext(241664->262143) 00002000:00010000:3.0:1762166981.200541:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4531180 00000100:00100000:3.0:1762166981.200560:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2713 00000100:00100000:3.0:1762166981.200568:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4531180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+28:2419:x1847765450707072:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:3.0:1762166981.201474:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4531180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+28:2419:x1847765450707072:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 903us (1064us total) trans 0 rc 20480/20480 00000100:00100000:3.0:1762166981.201499:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2713 00002000:00100000:3.0:1762166981.201506:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (241664->262143) req@ffff945bc4531180 x1847765450707072/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:12/0 lens 488/440 e 0 to 0 dl 1762166992 ref 1 fl Complete:/600/0 rc 20480/20480 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166981.201513:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4531180 with x1847765450707072 ext(241664->262143) 00002000:00010000:3.0:1762166981.201516:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4531180 00000100:00100000:0.0:1762166981.203262:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166981.203304:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450707200 00000100:00100000:3.0:1762166981.203321:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450707200 00002000:00100000:3.0:1762166981.203363:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (196608->262143) req@ffff945cf79e8380 x1847765450707200/t0(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:12/0 lens 488/0 e 0 to 0 dl 1762166992 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166981.203371:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf79e8380 with x1847765450707200 ext(196608->262143) 00002000:00010000:3.0:1762166981.203374:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf79e8380 00000100:00100000:3.0:1762166981.203395:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2714 00000100:00100000:3.0:1762166981.203402:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+28:2418:x1847765450707200:12345-192.168.204.38@tcp:4:fsx.0 00000100:00100000:3.0:1762166981.204867:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+30:2418:x1847765450707200:12345-192.168.204.38@tcp:4:fsx.0 Request processed in 1460us (1603us total) trans 17179876710 rc 0/0 00000100:00100000:3.0:1762166981.204880:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2714 00002000:00100000:3.0:1762166981.204889:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (196608->262143) req@ffff945cf79e8380 x1847765450707200/t17179876710(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:12/0 lens 488/448 e 0 to 0 dl 1762166992 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166981.204898:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf79e8380 with x1847765450707200 ext(196608->262143) 00002000:00010000:3.0:1762166981.204901:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf79e8380 00000100:00100000:0.0:1762166981.205734:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.205797:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450707328 00000100:00100000:2.0:1762166981.205804:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450707328 00000100:00100000:2.0:1762166981.205863:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19412 00000100:00100000:2.0:1762166981.205873:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+30:2419:x1847765450707328:12345-192.168.204.38@tcp:16:fsx.0 00000001:00080000:3.0:1762166981.206803:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876710 is committed 00000001:00080000:3.0:1762166981.206841:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876703 is committed 00000100:00100000:2.0:1762166981.206943:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450707328:12345-192.168.204.38@tcp:16:fsx.0 Request processed in 1070us (1211us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166981.206952:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19412 00000100:00100000:0.0:1762166981.208042:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.208096:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450707456 00000100:00100000:2.0:1762166981.208105:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450707456 00000100:00100000:2.0:1762166981.208146:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30846 00000100:00100000:2.0:1762166981.208154:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+531:61766:x1847765450707456:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:2.0:1762166981.208177:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166981.208200:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cada00/0x2f180c4effbacc87 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea8f2 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.208301:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac200/0x2f180c4effbacc8e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166981.208318:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac200/0x2f180c4effbacc8e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.208330:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac200/0x2f180c4effbacc8e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000004:00200000:2.0:1762166981.208358:0:30829:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 262144 00000004:00200000:2.0:1762166981.208362:0:30829:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166981.208379:0:30829:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac200/0x2f180c4effbacc8e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.208407:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cada00/0x2f180c4effbacc87 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea8f2 expref: 533 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.208426:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac200/0x2f180c4effbacc8e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea8f2 expref: 532 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.208435:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166981.208438:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166981.208442:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cac200, rc 0) 00000100:00100000:2.0:1762166981.208536:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+532:61766:x1847765450707456:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 383us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166981.208545:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30846 00000100:00100000:1.0:1762166981.210828:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166981.210864:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450707584 00000100:00100000:3.0:1762166981.210873:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450707584 00002000:00100000:3.0:1762166981.210911:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (135168->176127) req@ffff945bc4530a80 x1847765450707584/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:12/0 lens 488/0 e 0 to 0 dl 1762166992 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166981.210920:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4530a80 with x1847765450707584 ext(135168->176127) 00002000:00010000:3.0:1762166981.210924:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4530a80 00000100:00100000:3.0:1762166981.210943:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2715 00000100:00100000:3.0:1762166981.210949:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4530a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450707584:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:3.0:1762166981.211896:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4530a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450707584:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 945us (1088us total) trans 0 rc 40960/40960 00000100:00100000:3.0:1762166981.211903:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2715 00002000:00100000:3.0:1762166981.211909:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (135168->176127) req@ffff945bc4530a80 x1847765450707584/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:12/0 lens 488/440 e 0 to 0 dl 1762166992 ref 1 fl Complete:/600/0 rc 40960/40960 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166981.211916:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4530a80 with x1847765450707584 ext(135168->176127) 00002000:00010000:3.0:1762166981.211919:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4530a80 00000100:00100000:0.0:1762166981.213925:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.213972:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450707840 00000100:00100000:2.0:1762166981.213980:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450707840 00000100:00100000:2.0:1762166981.214030:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11976 00000100:00100000:2.0:1762166981.214041:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc3550380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+532:61766:x1847765450707840:12345-192.168.204.38@tcp:35:fsx.0 00000100:00100000:2.0:1762166981.214267:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc3550380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+533:61766:x1847765450707840:12345-192.168.204.38@tcp:35:fsx.0 Request processed in 229us (348us total) trans 4294992495 rc 0/0 00000100:00100000:2.0:1762166981.214272:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11976 00000100:00100000:1.0:1762166981.222885:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.222965:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450707968 00000100:00100000:2.0:1762166981.222979:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450707968 00000100:00100000:2.0:1762166981.223045:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30847 00000100:00100000:2.0:1762166981.223057:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4533480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+533:61881:x1847765450707968:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166981.223089:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166981.223114:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cada00/0x2f180c4effbacc95 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea8f9 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.223194:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbacc9c lrc: 3/1,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166981.223211:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbacc9c lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.223222:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbacc9c lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.223233:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbacca3 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166981.223237:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbacca3 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.223242:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbacca3 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.223313:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8200/0x2f180c4effbaccaa lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166981.223319:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8200/0x2f180c4effbaccaa lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.223324:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8200/0x2f180c4effbaccaa lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000004:00200000:2.0:1762166981.223358:0:30829:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 262144 00000004:00200000:2.0:1762166981.223362:0:30829:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166981.223378:0:30829:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8200/0x2f180c4effbaccaa lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.223393:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8200/0x2f180c4effbaccaa lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.223401:0:30829:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbacc9c lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.223405:0:30829:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbacc9c lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.223410:0:30829:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbacc9c lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.223414:0:30829:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbacc9c lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.223417:0:30829:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc5db9c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166981.223420:0:30829:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbacc9c lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.223427:0:30829:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbacc9c lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.223436:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0x0 (ffff945bc809b000) 00010000:00010000:2.0:1762166981.223438:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166981.223441:0:30829:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbacc9c lrc: 3/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.223446:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbacc9c lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.223458:0:30829:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbacca3 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.223462:0:30829:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbacca3 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.223465:0:30829:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbacca3 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.223468:0:30829:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc5db8e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166981.223470:0:30829:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbacca3 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.223472:0:30829:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbacca3 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.223517:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0xdd396665 (ffff945bc809b200) 00010000:00010000:2.0:1762166981.223519:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166981.223521:0:30829:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbacca3 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.223524:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbacca3 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.223558:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cada00/0x2f180c4effbacc95 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea8f9 expref: 535 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.223576:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8200/0x2f180c4effbaccaa lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea8f9 expref: 534 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.223583:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166981.223584:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166981.223586:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc5db8200, rc 0) 00000100:00100000:2.0:1762166981.223652:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4533480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+534:61881:x1847765450707968:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 599us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166981.223658:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30847 00000100:00100000:0.0:1762166981.224955:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.225069:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450708096 00000100:00100000:2.0:1762166981.225080:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450708096 00000100:00100000:2.0:1762166981.225149:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 901 00000100:00100000:2.0:1762166981.225160:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cceb4b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+534:2417:x1847765450708096:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166981.225175:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166981.225197:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8200/0x2f180c4effbaccaa lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea8f9 expref: 534 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.225216:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166981.225221:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166981.225277:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cceb4b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+533:2417:x1847765450708096:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 119us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166981.225285:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 901 00000100:00100000:0.0:1762166981.225614:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.226129:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450708352 00000100:00100000:2.0:1762166981.226136:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450708352 00000100:00100000:2.0:1762166981.226177:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30848 00000100:00100000:2.0:1762166981.226185:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+533:61881:x1847765450708352:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166981.226201:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166981.226216:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9a00/0x2f180c4effbaccb1 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea900 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.226316:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9200/0x2f180c4effbaccb8 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166981.226329:0:30829:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac200/0x2f180c4effbacc8e lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea8f2 expref: 534 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.226337:0:30829:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9200/0x2f180c4effbaccb8 lrc: 4/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.226366:0:30829:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac200/0x2f180c4effbacc8e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea8f2 expref: 534 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.226378:0:30829:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac200/0x2f180c4effbacc8e lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea8f2 expref: 534 pid: 30829 timeout: 700 lvb_type: 0 00000100:00100000:2.0:1762166981.226389:0:30829:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:30829:1847765449788032:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166981.226464:0:30829:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cff1fa300 going to sleep for 11 seconds 00000100:00100000:2.0:1762166981.227374:0:30829:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:30829:1847765449788032:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166981.227392:0:30829:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9200/0x2f180c4effbaccb8 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000100:00100000:0.0:1762166981.227600:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.227661:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450708480 00000100:00100000:2.0:1762166981.227667:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450708480 00010000:00010000:2.0:1762166981.227694:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac200/0x2f180c4effbacc8e lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea8f2 expref: 535 pid: 30829 timeout: 700 lvb_type: 0 00000100:00100000:2.0:1762166981.227722:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9805 00000100:00100000:2.0:1762166981.227730:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+535:2418:x1847765450708480:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166981.227738:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166981.227743:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac200/0x2f180c4effbacc8e lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea8f2 expref: 535 pid: 30829 timeout: 700 lvb_type: 0 00010000:00010000:2.0:1762166981.227755:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac200/0x2f180c4effbacc8e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea8f2 expref: 535 pid: 30829 timeout: 700 lvb_type: 0 00010000:00010000:2.0:1762166981.227768:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac200/0x2f180c4effbacc8e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea8f2 expref: 535 pid: 30829 timeout: 700 lvb_type: 0 00010000:00010000:2.0:1762166981.227777:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166981.227780:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9200/0x2f180c4effbaccb8 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.227785:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9200/0x2f180c4effbaccb8 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.227790:0:6479:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9200/0x2f180c4effbaccb8 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.227821:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166981.227847:0:30829:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9200/0x2f180c4effbaccb8 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.227857:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9200/0x2f180c4effbaccb8 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000100:00100000:2.0:1762166981.227865:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+534:2418:x1847765450708480:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 134us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166981.227874:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9805 00000004:00200000:3.0:1762166981.227878:0:30829:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 262144 00010000:00010000:3.0:1762166981.228037:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9a00/0x2f180c4effbaccb1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea900 expref: 535 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.228053:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9200/0x2f180c4effbaccb8 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea900 expref: 534 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.228059:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:3.0:1762166981.228061:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1762166981.228063:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc5db9200, rc 0) 00000100:00100000:3.0:1762166981.228110:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+534:61881:x1847765450708352:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1927us (2498us total) trans 4294992496 rc 0/0 00000100:00100000:3.0:1762166981.228120:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30848 00000100:00100000:0.0:1762166981.229367:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166981.229404:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450708608 00000100:00100000:3.0:1762166981.229412:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450708608 00000100:00100000:3.0:1762166981.229455:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30849 00000100:00100000:3.0:1762166981.229465:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4012d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+534:61881:x1847765450708608:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166981.229509:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166981.229527:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62800/0x2f180c4effbaccc6 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea907 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.229612:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62000/0x2f180c4effbacccd lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:3.0:1762166981.229626:0:30829:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9200/0x2f180c4effbaccb8 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea900 expref: 535 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.229635:0:30829:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62000/0x2f180c4effbacccd lrc: 4/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.229669:0:30829:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9200/0x2f180c4effbaccb8 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea900 expref: 535 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.229682:0:30829:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9200/0x2f180c4effbaccb8 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea900 expref: 535 pid: 30829 timeout: 700 lvb_type: 0 00000100:00100000:3.0:1762166981.229697:0:30829:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55de680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:30829:1847765449788160:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166981.229765:0:30829:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc56bf840 going to sleep for 11 seconds 00000100:00100000:3.0:1762166981.230539:0:30829:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55de680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:30829:1847765449788160:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166981.230553:0:30829:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62000/0x2f180c4effbacccd lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000100:00100000:0.0:1762166981.230966:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.231022:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450708736 00000100:00100000:2.0:1762166981.231028:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450708736 00010000:00010000:2.0:1762166981.231055:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9200/0x2f180c4effbaccb8 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea900 expref: 536 pid: 30829 timeout: 700 lvb_type: 0 00000100:00100000:2.0:1762166981.231087:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9806 00000100:00100000:2.0:1762166981.231097:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4012680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+536:2418:x1847765450708736:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166981.231109:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166981.231116:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9200/0x2f180c4effbaccb8 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea900 expref: 536 pid: 30829 timeout: 700 lvb_type: 0 00010000:00010000:2.0:1762166981.231133:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9200/0x2f180c4effbaccb8 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea900 expref: 536 pid: 30829 timeout: 700 lvb_type: 0 00010000:00010000:2.0:1762166981.231152:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9200/0x2f180c4effbaccb8 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea900 expref: 536 pid: 30829 timeout: 700 lvb_type: 0 00010000:00010000:2.0:1762166981.231167:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166981.231171:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62000/0x2f180c4effbacccd lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.231179:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62000/0x2f180c4effbacccd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.231186:0:6479:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62000/0x2f180c4effbacccd lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.231209:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166981.231227:0:30829:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62000/0x2f180c4effbacccd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.231234:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62000/0x2f180c4effbacccd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000100:00100000:2.0:1762166981.231240:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4012680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+535:2418:x1847765450708736:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 145us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166981.231249:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9806 00000004:00200000:3.0:1762166981.231263:0:30829:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 262144 00000004:00200000:3.0:1762166981.231268:0:30829:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166981.231282:0:30829:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62000/0x2f180c4effbacccd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.231302:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62800/0x2f180c4effbaccc6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea907 expref: 535 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.231317:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62000/0x2f180c4effbacccd lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea907 expref: 534 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.231322:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:3.0:1762166981.231325:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166981.231327:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4b62000, rc 0) 00000100:00100000:3.0:1762166981.231359:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4012d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+534:61881:x1847765450708608:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1897us (1995us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166981.231365:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30849 00000100:00100000:0.0:1762166981.232781:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166981.232835:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450708992 00000100:00100000:3.0:1762166981.232847:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450708992 00000100:00100000:3.0:1762166981.232901:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30850 00000100:00100000:3.0:1762166981.232911:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4012300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+534:61881:x1847765450708992:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166981.232929:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166981.232947:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63a00/0x2f180c4effbaccd4 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea90e expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.233054:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63400/0x2f180c4effbaccdb lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:3.0:1762166981.233067:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63400/0x2f180c4effbaccdb lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.233076:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63400/0x2f180c4effbaccdb lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000004:00200000:3.0:1762166981.233087:0:30829:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 262144 00010000:00010000:3.0:1762166981.233199:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63a00/0x2f180c4effbaccd4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea90e expref: 537 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.233216:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63400/0x2f180c4effbaccdb lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea90e expref: 536 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.233224:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:3.0:1762166981.233227:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166981.233231:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4b63400, rc 0) 00000100:00100000:3.0:1762166981.233289:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4012300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+536:61881:x1847765450708992:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 379us (512us total) trans 4294992497 rc 0/0 00000100:00100000:3.0:1762166981.233298:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30850 00000100:00100000:1.0:1762166981.234253:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.234301:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450709120 00000100:00100000:2.0:1762166981.234306:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450709120 00000100:00100000:2.0:1762166981.234342:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19413 00000100:00100000:2.0:1762166981.234352:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4533800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450709120:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:2.0:1762166981.234376:0:35472:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc5db8200/0x2f180c4effbacce9 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.234389:0:35472:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbacc41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->24575) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea8c8 expref: 17 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.234397:0:35472:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166981.234400:0:35472:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166981.234405:0:35472:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc5db8200/0x2f180c4effbacce9 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166981.234424:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:2.0:1762166981.234441:0:35472:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbacc41 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->24575) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea8c8 expref: 17 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.234456:0:35472:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbacc41 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->24575) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea8c8 expref: 17 pid: 35472 timeout: 700 lvb_type: 0 00000100:00100000:1.0:1762166981.234467:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450709248 00000100:00100000:1.0:1762166981.234471:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450709248 00000100:00100000:0.0:1762166981.234526:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.234531:0:35472:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:35472:1847765449788288:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166981.234543:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450709376 00000100:00100000:1.0:1762166981.234549:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450709376 00000100:00100000:3.0:1762166981.234572:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19414 00000100:00100000:3.0:1762166981.234590:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4013100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+30:2418:x1847765450709248:12345-192.168.204.38@tcp:1:lfs.0 00000100:00100000:1.0:1762166981.234601:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19415 00000100:00100000:1.0:1762166981.234620:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450709376:12345-192.168.204.38@tcp:1:lfs.0 00000100:00100000:2.0:1762166981.234632:0:35472:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cff1fa300 going to sleep for 11 seconds 00010000:00010000:3.0:1762166981.234634:0:8382:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc4b62c00/0x2f180c4effbaccf0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.234654:0:28874:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945cc355a600/0x2f180c4effbaccf7 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.234660:0:8382:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc7c0f800/0x2f180c4effbacc64 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea8dd expref: 30 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.234684:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166981.234685:0:28874:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc6eeaa00/0x2f180c4effbacc6b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea8e4 expref: 18 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.234693:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166981.234700:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166981.234702:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4b62c00/0x2f180c4effbaccf0 lrc: 4/0,1 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.234703:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166981.234709:0:28874:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355a600/0x2f180c4effbaccf7 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.234729:0:28874:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc6eeaa00/0x2f180c4effbacc6b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea8e4 expref: 18 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.234735:0:28874:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc6eeaa00/0x2f180c4effbacc6b lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea8e4 expref: 18 pid: 35472 timeout: 700 lvb_type: 0 00000100:00100000:1.0:1762166981.234746:0:28874:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4530e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28874:1847765449788416:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166981.234783:0:8382:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc7c0f800/0x2f180c4effbacc64 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea8dd expref: 30 pid: 35472 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166981.234784:0:28874:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc350f6c0 going to sleep for 11 seconds 00010000:00010000:3.0:1762166981.234803:0:8382:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc7c0f800/0x2f180c4effbacc64 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea8dd expref: 30 pid: 35472 timeout: 700 lvb_type: 0 00000100:00100000:3.0:1762166981.234832:0:8382:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55de680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8382:1847765449788544:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166981.234879:0:8382:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7c0fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1762166981.235422:0:35472:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:35472:1847765449788288:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166981.235439:0:35472:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc5db8200/0x2f180c4effbacce9 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166981.235621:0:28874:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4530e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:28874:1847765449788416:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166981.235632:0:28874:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945cc355a600/0x2f180c4effbaccf7 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166981.236057:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166981.236092:0:8382:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55de680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8382:1847765449788544:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166981.236101:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450709504 00000100:00100000:0.0:1762166981.236105:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.236109:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450709504 00010000:00010000:2.0:1762166981.236134:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbacc41 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->24575) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea8c8 expref: 19 pid: 35472 timeout: 700 lvb_type: 0 00010000:00010000:3.0:1762166981.236137:0:8382:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bc4b62c00/0x2f180c4effbaccf0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166981.236153:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166981.236154:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450709632 00000100:00100000:1.0:1762166981.236162:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450709632 00000100:00100000:2.0:1762166981.236184:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450709760 00000100:00100000:2.0:1762166981.236189:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450709760 00010000:00010000:1.0:1762166981.236190:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc6eeaa00/0x2f180c4effbacc6b lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea8e4 expref: 20 pid: 35472 timeout: 700 lvb_type: 0 00000100:00100000:0.0:1762166981.236200:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9807 00010000:00010000:2.0:1762166981.236208:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc7c0f800/0x2f180c4effbacc64 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea8dd expref: 31 pid: 35472 timeout: 700 lvb_type: 0 00000100:00100000:0.0:1762166981.236214:0:6480:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b20e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450709504:12345-192.168.204.38@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1762166981.236231:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9808 00010000:00010000:0.0:1762166981.236232:0:6480:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1762166981.236243:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b23100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450709632:12345-192.168.204.38@tcp:103:ldlm_bl.0 00002000:00010000:0.0:1762166981.236249:0:6480:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 72 -> 200 00010000:00010000:1.0:1762166981.236254:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1762166981.236258:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9809 00010000:00010000:0.0:1762166981.236261:0:6480:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbacc41 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 16384->24575) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea8c8 expref: 20 pid: 35472 timeout: 700 lvb_type: 0 00000100:00100000:2.0:1762166981.236272:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+31:2416:x1847765450709760:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166981.236272:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc6eeaa00/0x2f180c4effbacc6b lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea8e4 expref: 20 pid: 35472 timeout: 700 lvb_type: 0 00010000:00010000:0.0:1762166981.236283:0:6480:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbacc41 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 16384->24575) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea8c8 expref: 20 pid: 35472 timeout: 700 lvb_type: 0 00010000:00010000:2.0:1762166981.236284:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166981.236292:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc6eeaa00/0x2f180c4effbacc6b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea8e4 expref: 20 pid: 35472 timeout: 700 lvb_type: 0 00010000:00010000:2.0:1762166981.236301:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc7c0f800/0x2f180c4effbacc64 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea8dd expref: 31 pid: 35472 timeout: 700 lvb_type: 0 00010000:00010000:0.0:1762166981.236307:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbacc41 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 16384->24575) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea8c8 expref: 20 pid: 35472 timeout: 700 lvb_type: 0 00010000:00010000:1.0:1762166981.236314:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc6eeaa00/0x2f180c4effbacc6b lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea8e4 expref: 20 pid: 35472 timeout: 700 lvb_type: 0 00010000:00010000:2.0:1762166981.236317:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc7c0f800/0x2f180c4effbacc64 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea8dd expref: 31 pid: 35472 timeout: 700 lvb_type: 0 00010000:00010000:0.0:1762166981.236321:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166981.236325:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166981.236329:0:6480:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc5db8200/0x2f180c4effbacce9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.236343:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166981.236346:0:6480:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc5db8200/0x2f180c4effbacce9 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.236347:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166981.236353:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945cc355a600/0x2f180c4effbaccf7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.236360:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc7c0f800/0x2f180c4effbacc64 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea8dd expref: 31 pid: 35472 timeout: 700 lvb_type: 0 00010000:00010000:1.0:1762166981.236363:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355a600/0x2f180c4effbaccf7 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.236373:0:6480:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166981.236378:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166981.236382:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166981.236386:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4b62c00/0x2f180c4effbaccf0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.236400:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166981.236401:0:6479:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4b62c00/0x2f180c4effbaccf0 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.236403:0:35472:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc5db8200/0x2f180c4effbacce9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166981.236414:0:6480:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b20e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450709504:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 201us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166981.236433:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b23100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450709632:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 187us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166981.236451:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9807 00010000:00010000:3.0:1762166981.236452:0:35472:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc5db8200/0x2f180c4effbacce9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166981.236469:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9808 00010000:00010000:2.0:1762166981.236470:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166981.236536:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+30:2416:x1847765450709760:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 265us (388us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166981.236537:0:35472:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc5db8200/0x2f180c4effbacce9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.236550:0:28874:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945cc355a600/0x2f180c4effbaccf7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166981.236564:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9809 00010000:00010000:3.0:1762166981.236567:0:35472:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc5db8200/0x2f180c4effbacce9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.236569:0:28874:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cc355a600/0x2f180c4effbaccf7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.236592:0:8382:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bc4b62c00/0x2f180c4effbaccf0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.236600:0:35472:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc5db8200/0x2f180c4effbacce9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.236610:0:28874:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945cc355a600/0x2f180c4effbaccf7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.236613:0:8382:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4b62c00/0x2f180c4effbaccf0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.236639:0:35472:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc5db8200 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166981.236649:0:28874:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355a600/0x2f180c4effbaccf7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.236659:0:28874:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945cc355a600/0x2f180c4effbaccf7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.236661:0:8382:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc4b62c00/0x2f180c4effbaccf0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.236672:0:28874:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355a600 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166981.236679:0:8382:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4b62c00/0x2f180c4effbaccf0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.236680:0:28874:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc355a600/0x2f180c4effbaccf7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.236699:0:35472:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc5db8200/0x2f180c4effbacce9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.236701:0:8382:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc4b62c00/0x2f180c4effbaccf0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.236703:0:28874:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc355a600/0x2f180c4effbaccf7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.236754:0:28874:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945cc355a600/0x2f180c4effbaccf7 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.236756:0:8382:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4b62c00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166981.236770:0:8382:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4b62c00/0x2f180c4effbaccf0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.236774:0:28874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cc355a600/0x2f180c4effbaccf7 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.236775:0:35472:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc5db8200/0x2f180c4effbacce9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.236828:0:8382:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4b62c00/0x2f180c4effbaccf0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.236847:0:35472:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc5db8200/0x2f180c4effbacce9 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.236850:0:8382:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc4b62c00/0x2f180c4effbaccf0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.236888:0:35472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc5db8200/0x2f180c4effbacce9 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.236888:0:8382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4b62c00/0x2f180c4effbaccf0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166981.236890:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+16:2419:x1847765450709376:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 2278us (2417us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166981.236923:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19415 00000100:00100000:2.0:1762166981.237060:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4013100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+29:2418:x1847765450709248:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 2476us (2638us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166981.237072:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4533800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e1e11365-ba0b-405b-99c9-a704373217f2+15:2419:x1847765450709120:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 2716us (2810us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166981.237083:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19414 00000100:00100000:3.0:1762166981.237094:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19413 00000100:00100000:0.0:1762166981.237917:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166981.237955:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450710016 00000100:00100000:3.0:1762166981.237962:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450710016 00000100:00100000:3.0:1762166981.238003:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30851 00000100:00100000:3.0:1762166981.238011:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+536:61881:x1847765450710016:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:3.0:1762166981.238066:0:30829:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1762166981.238090:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7c0ec00/0x2f180c4effbacc5d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea8d6 expref: 536 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.238111:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62000/0x2f180c4effbacccd lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea907 expref: 535 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.238122:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:3.0:1762166981.238126:0:30829:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166981.238152:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effbaccfe lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:3.0:1762166981.238165:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effbaccfe lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.238174:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effbaccfe lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000040:00080000:3.0:1762166981.238429:0:30829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5952, 88 off466432 00000004:00080000:3.0:1762166981.238436:0:30829:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 600386958320ns, next at 600144491692ns, rc = 0 00000040:00080000:3.0:1762166981.238471:0:30829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5951, 88 off466432 00000004:00080000:3.0:1762166981.238475:0:30829:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 600386997112ns, next at 600144525370ns, rc = 0 00000040:00080000:3.0:1762166981.238517:0:30829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5952, 88 off466520 00000004:00080000:3.0:1762166981.238524:0:30829:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 600387046060ns, next at 600144525370ns, rc = 0 00000040:00080000:3.0:1762166981.238548:0:30829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5953, 88 off466520 00000004:00080000:3.0:1762166981.238554:0:30829:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 600387076239ns, next at 600144491692ns, rc = 0 00000040:00080000:3.0:1762166981.238575:0:30829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5954, 88 off466608 00000004:00080000:3.0:1762166981.238581:0:30829:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 600387102822ns, next at 600144491692ns, rc = 0 00000040:00080000:3.0:1762166981.238597:0:30829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5953, 88 off466608 00000004:00080000:3.0:1762166981.238602:0:30829:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 600387124118ns, next at 600144525370ns, rc = 0 00000001:00080000:0.0:1762166981.239538:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294992498 is committed 00000004:00080000:0.0:1762166981.239546:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3314 committed 00010000:00010000:3.0:1762166981.239555:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62e00/0x2f180c4effbacc56 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00000004:00080000:0.0:1762166981.239558:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3311 committed 00010000:00010000:3.0:1762166981.239567:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62e00/0x2f180c4effbacc56 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00000004:00080000:0.0:1762166981.239569:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3310 committed 00000004:00080000:0.0:1762166981.239574:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3313 committed 00010000:00010000:3.0:1762166981.239579:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62e00/0x2f180c4effbacc56 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00000004:00080000:0.0:1762166981.239585:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3312 committed 00010000:00010000:3.0:1762166981.239588:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4b62e00 already unused, calling callback (ffffffffc18e2310) 00000004:00080000:0.0:1762166981.239591:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3309 committed 00010000:00010000:3.0:1762166981.239595:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62e00/0x2f180c4effbacc56 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.239605:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62e00/0x2f180c4effbacc56 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.239623:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:3.0:1762166981.239627:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166981.239631:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62e00/0x2f180c4effbacc56 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.239638:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62e00/0x2f180c4effbacc56 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.239656:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42d1200/0x2f180c4effbacc80 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.239664:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42d1200/0x2f180c4effbacc80 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.239670:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42d1200/0x2f180c4effbacc80 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.239677:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc42d1200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166981.239682:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42d1200/0x2f180c4effbacc80 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.239688:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42d1200/0x2f180c4effbacc80 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.239698:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00000100:00100000:0.0:1762166981.239700:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4532300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449788928:0@lo:2:osp-syn-0-1.0 00010000:00010000:3.0:1762166981.239702:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166981.239708:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42d1200/0x2f180c4effbacc80 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00000100:00100000:2.0:1762166981.239712:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449788800:0@lo:2:osp-syn-1-1.0 00010000:00010000:3.0:1762166981.239716:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc42d1200/0x2f180c4effbacc80 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00000100:00100000:1.0:1762166981.239743:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4530e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449788672:0@lo:2:osp-syn-0-1.0 00000004:00010000:3.0:1762166981.239762:0:30829:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000064559d32 reply state 000000007917b942 transno 4294992498 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effbaccfe lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000100:00100000:0.0:1762166981.239774:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1762166981.239782:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effbaccfe lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.239791:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:3.0:1762166981.239795:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1762166981.239798:0:30829:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166981.239799:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7d21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449789056:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1762166981.239827:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166981.239865:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449788928 00000100:00100000:2.0:1762166981.239872:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166981.239874:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449788928 00000100:00100000:1.0:1762166981.239876:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc47b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449789184:0@lo:2:osp-syn-1-1.0 00010000:00080000:3.0:1762166981.239890:0:30829:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1762166981.239915:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+526:61881:x1847765450710016:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 1901us (1996us total) trans 4294992498 rc 0/0 00000100:00100000:1.0:1762166981.239927:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166981.239929:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449788672 00000100:00100000:3.0:1762166981.239933:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30851 00000100:00100000:0.0:1762166981.239936:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449788672 00010000:00010000:2.0:1762166981.239964:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effbaccfe lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.239975:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effbaccfe lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00000100:00100000:1.0:1762166981.239976:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1762166981.239979:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449789056 00000100:00100000:0.0:1762166981.239989:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449789056 00010000:00010000:2.0:1762166981.239993:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effbaccfe lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00000100:00100000:1.0:1762166981.239995:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4531880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449789312:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166981.240006:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166981.240013:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449789184 00000100:00100000:0.0:1762166981.240022:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449789184 00010000:00010000:2.0:1762166981.240023:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4b63e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166981.240031:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effbaccfe lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.240047:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effbaccfe lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30829 initiator: MDT1 00000100:00100000:0.0:1762166981.240062:0:35472:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449788800 00000100:00100000:1.0:1762166981.240063:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166981.240070:0:35472:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449788800 00010000:00010000:2.0:1762166981.240071:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166981.240076:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166981.240080:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effbaccfe lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.240090:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effbaccfe lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00000100:00100000:3.0:1762166981.240114:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449789312 00000100:00100000:0.0:1762166981.240123:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19416 00000100:00100000:3.0:1762166981.240132:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449789312 00000100:00100000:0.0:1762166981.240142:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+30:3635:x1847765449788928:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1762166981.240145:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19417 00000100:00100000:1.0:1762166981.240168:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4533100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+30:3633:x1847765449788672:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1762166981.240169:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19418 00000100:00100000:2.0:1762166981.240197:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+7:3636:x1847765449789056:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166981.240199:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19419 00000100:00100000:3.0:1762166981.240212:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4531500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+7:3633:x1847765449789184:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:1.0:1762166981.240303:0:35248:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166981.240306:0:35248:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb mtime from disk: 1762166966 -> 1762166966 00002000:00010000:1.0:1762166981.240308:0:35248:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1762166981.240312:0:35248:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb ctime from disk: 1762166966 -> 1762166966 00002000:00010000:1.0:1762166981.240315:0:35248:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:3.0:1762166981.240334:0:8383:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb size from disk: 32254 -> 32254 00002000:00010000:3.0:1762166981.240341:0:8383:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00010000:3.0:1762166981.240344:0:8383:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00002000:00010000:3.0:1762166981.240347:0:8383:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00002000:00010000:3.0:1762166981.240352:0:8383:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1762166981.240352:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+32:3635:x1847765449788928:12345-0@lo:2:osp-syn-0-1.0 Request processed in 217us (580us total) trans 21474843460 rc 0/0 00000100:00100000:0.0:1762166981.240363:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19416 00000100:00100000:0.0:1762166981.240388:0:35472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19420 00000100:00100000:2.0:1762166981.240399:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+9:3636:x1847765449789056:12345-0@lo:2:osp-syn-1-1.0 Request processed in 203us (525us total) trans 17179876711 rc 0/0 00000100:00100000:1.0:1762166981.240400:0:35248:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4533100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+31:3633:x1847765449788672:12345-0@lo:2:osp-syn-0-1.0 Request processed in 234us (587us total) trans 21474843461 rc 0/0 00000100:00100000:3.0:1762166981.240411:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4531500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+9:3633:x1847765449789184:12345-0@lo:2:osp-syn-1-1.0 Request processed in 198us (483us total) trans 17179876712 rc 0/0 00000100:00100000:0.0:1762166981.240413:0:35472:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+9:3634:x1847765449788800:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1762166981.240435:0:35248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19417 00000100:00100000:3.0:1762166981.240444:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19419 00000100:00100000:2.0:1762166981.240456:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19418 00000100:00100000:1.0:1762166981.240474:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19421 00000100:00100000:1.0:1762166981.240533:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4531c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+30:3633:x1847765449789312:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1762166981.240567:0:3636:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 17179876703 gen 2 00000100:00100000:0.0:1762166981.240567:0:35472:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+8:3634:x1847765449788800:12345-0@lo:2:osp-syn-1-1.0 Request processed in 162us (572us total) trans 17179876713 rc 0/0 00000004:00080000:2.0:1762166981.240577:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc5807480, transno 17179876698 00000100:00100000:0.0:1762166981.240582:0:35472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19420 00000004:00080000:2.0:1762166981.240601:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc5805500, transno 17179876699 00002000:00010000:1.0:1762166981.240603:0:35248:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb size from disk: 0 -> 0 00000004:00080000:2.0:1762166981.240606:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc5807b80, transno 17179876700 00002000:00010000:1.0:1762166981.240607:0:35248:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00010000:1.0:1762166981.240615:0:35248:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00000004:00080000:2.0:1762166981.240616:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc5806d80, transno 17179876701 00002000:00010000:1.0:1762166981.240631:0:35248:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00000004:00080000:2.0:1762166981.240634:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc5807100, transno 17179876702 00002000:00010000:1.0:1762166981.240636:0:35248:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb blocks from disk: 0 -> 0 00000004:00080000:0.0:1762166981.240641:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc4532300/2, rc 0, transno 21474843460 00000004:00080000:2.0:1762166981.240645:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc5805f80, transno 17179876703 00000100:00100000:0.0:1762166981.240656:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4532300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449788928:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1762166981.240660:0:3636:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff945bc7d21180 x1847765449789056/t17179876711(17179876711) o2->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 440/432 e 0 to 0 dl 1762166997 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1762166981.240671:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc7d21180/2, rc 0, transno 17179876711 00000004:00080000:3.0:1762166981.240675:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc2d5dc00/2, rc 0, transno 17179876713 00000100:00100000:2.0:1762166981.240681:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7d21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449789056:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166981.240687:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449788800:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1762166981.240698:0:35248:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4531c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+31:3633:x1847765449789312:12345-0@lo:2:osp-syn-0-1.0 Request processed in 169us (640us total) trans 21474843462 rc 0/0 00000100:00100000:1.0:1762166981.240705:0:35248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19421 00000004:00080000:3.0:1762166981.240770:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc4531880/2, rc 0, transno 21474843462 00000100:00100000:3.0:1762166981.240781:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4531880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449789312:0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1762166981.240796:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc4530e00/2, rc 0, transno 21474843461 00000004:00080000:2.0:1762166981.240841:0:9994:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0001: 0 changes, 3 in progress, 1 in flight, 6 done 00000100:00100000:3.0:1762166981.240857:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4530e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449788672:0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1762166981.240871:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc47b5880/2, rc 0, transno 17179876712 00000100:00100000:3.0:1762166981.240874:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc47b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449789184:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1762166981.241595:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166981.241631:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450710144 00000100:00100000:3.0:1762166981.241636:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450710144 00000100:00100000:3.0:1762166981.241668:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30852 00000100:00100000:3.0:1762166981.241677:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+525:61881:x1847765450710144:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166981.241694:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166981.241707:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63a00/0x2f180c4effbacd05 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea915 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.241746:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63a00/0x2f180c4effbacd05 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea915 expref: 526 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.241758:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63a00/0x2f180c4effbacd05 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea915 expref: 526 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.241777:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:3.0:1762166981.241780:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166981.241782:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4b63a00, rc 0) 00000100:00100000:3.0:1762166981.241825:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+526:61881:x1847765450710144:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 150us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166981.241833:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30852 00000100:00100000:1.0:1762166981.242965:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166981.243000:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450710272 00000100:00100000:3.0:1762166981.243006:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450710272 00000100:00100000:3.0:1762166981.243038:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30853 00000100:00100000:3.0:1762166981.243046:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4533b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+526:61881:x1847765450710272:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166981.243057:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166981.243068:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62000/0x2f180c4effbacd0c lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea91c expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.243144:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62800/0x2f180c4effbacd13 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:3.0:1762166981.243155:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62800/0x2f180c4effbacd13 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.243164:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62800/0x2f180c4effbacd13 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000004:00200000:3.0:1762166981.243188:0:30829:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 262144 00000004:00200000:3.0:1762166981.243193:0:30829:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166981.243213:0:30829:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62800/0x2f180c4effbacd13 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.243238:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62000/0x2f180c4effbacd0c lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea91c expref: 528 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.243253:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62800/0x2f180c4effbacd13 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea91c expref: 527 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.243260:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:3.0:1762166981.243263:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166981.243266:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4b62800, rc 0) 00000100:00100000:3.0:1762166981.243299:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4533b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+527:61881:x1847765450710272:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 254us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166981.243304:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30853 00000100:00100000:0.0:1762166981.244198:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166981.244255:0:35248:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450710400 00000100:00100000:1.0:1762166981.244261:0:35248:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450710400 00000100:00100000:1.0:1762166981.244299:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19422 00000100:00100000:1.0:1762166981.244308:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+15:2416:x1847765450710400:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166981.244319:0:35248:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166981.244334:0:35248:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cc355a600/0x2f180c4effbacd1a lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea923 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762166981.244351:0:35248:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa77:0x0] initial LVB size: 262144, mtime: 0x690888c5, atime: 0x690888c5, ctime: 0x690888c5, blocks: 0xc8 00010000:00010000:1.0:1762166981.244367:0:35248:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166981.244371:0:35248:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166981.244381:0:35248:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355a600/0x2f180c4effbacd1a lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea923 expref: 16 pid: 35248 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1762166981.244393:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:1.0:1762166981.244403:0:35248:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945cc355a600/0x2f180c4effbacd1a lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea923 expref: 16 pid: 35248 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166981.244415:0:35248:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355a600, rc 0) 00000100:00100000:3.0:1762166981.244422:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450710528 00000100:00100000:3.0:1762166981.244426:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450710528 00000100:00100000:1.0:1762166981.244452:0:35248:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+16:2416:x1847765450710400:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 145us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166981.244460:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19423 00000100:00100000:0.0:1762166981.244466:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166981.244473:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+29:2417:x1847765450710528:12345-192.168.204.38@tcp:101:lfs.0 00000100:00100000:1.0:1762166981.244473:0:35248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19422 00000100:00100000:2.0:1762166981.244502:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450710656 00000100:00100000:2.0:1762166981.244508:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450710656 00010000:00010000:3.0:1762166981.244532:0:8382:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166981.244545:0:8382:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4b62600/0x2f180c4effbacd21 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea92a expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166981.244551:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19424 00002000:00010000:3.0:1762166981.244562:0:8382:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa7a:0x0] initial LVB size: 0, mtime: 0x690888c5, atime: 0x690888c5, ctime: 0x690888c5, blocks: 0x1800 00000100:00100000:2.0:1762166981.244567:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf7838700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+16:2416:x1847765450710656:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166981.244574:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166981.244578:0:28874:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166981.244592:0:28874:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc5db9200/0x2f180c4effbacd28 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea931 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166981.244606:0:28874:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa79:0x0] initial LVB size: 0, mtime: 0x690888c5, atime: 0x690888c5, ctime: 0x690888c5, blocks: 0x0 00010000:00010000:3.0:1762166981.244613:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166981.244618:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166981.244619:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4b62600/0x2f180c4effbacd21 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea92a expref: 30 pid: 8382 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166981.244622:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166981.244631:0:28874:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc5db9200/0x2f180c4effbacd28 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea931 expref: 17 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166981.244635:0:8382:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc4b62600/0x2f180c4effbacd21 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea92a expref: 30 pid: 8382 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166981.244654:0:8382:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4b62600, rc 0) 00010000:00010000:2.0:1762166981.244660:0:28874:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc5db9200/0x2f180c4effbacd28 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea931 expref: 17 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166981.244671:0:28874:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc5db9200, rc 0) 00000100:00100000:3.0:1762166981.244681:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+30:2417:x1847765450710528:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 212us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166981.244687:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19423 00000100:00100000:2.0:1762166981.244701:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf7838700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+17:2416:x1847765450710656:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 139us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166981.244709:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19424 00000100:00100000:0.0:1762166981.269913:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.269985:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450710784 00000100:00100000:2.0:1762166981.269997:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450710784 00000100:00100000:2.0:1762166981.270054:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19425 00000100:00100000:2.0:1762166981.270063:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450710784:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:2.0:1762166981.270180:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450710784:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 119us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166981.270189:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19425 00000100:00100000:0.0:1762166981.271303:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.271350:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450710912 00000100:00100000:2.0:1762166981.271357:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450710912 00000100:00100000:2.0:1762166981.271388:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19426 00000100:00100000:2.0:1762166981.271397:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5769880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450710912:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:2.0:1762166981.271518:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5769880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450710912:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 122us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166981.271524:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19426 00000100:00100000:0.0:1762166981.272781:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166981.272833:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450711040 00000100:00100000:3.0:1762166981.272839:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450711040 00000100:00100000:3.0:1762166981.272886:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2716 00000100:00100000:3.0:1762166981.272894:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5768000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450711040:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:3.0:1762166981.272929:0:23940:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62000/0x2f180c4effbacd2f lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.272946:0:23940:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166981.272948:0:23940:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166981.272954:0:23940:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62000/0x2f180c4effbacd2f lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.272968:0:23940:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62000/0x2f180c4effbacd2f lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.273082:0:23940:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62000/0x2f180c4effbacd2f lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.273091:0:23940:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62000/0x2f180c4effbacd2f lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.273100:0:23940:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62000/0x2f180c4effbacd2f lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.273106:0:23940:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4b62000 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166981.273111:0:23940:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62000/0x2f180c4effbacd2f lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.273120:0:23940:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62000/0x2f180c4effbacd2f lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.273137:0:23940:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62000/0x2f180c4effbacd2f lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.273149:0:23940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62000/0x2f180c4effbacd2f lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166981.273197:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5768000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450711040:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 304us (417us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1762166981.273202:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2716 00000100:00100000:0.0:1762166981.274633:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166981.274662:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450711168 00000100:00100000:3.0:1762166981.274670:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450711168 00000100:00100000:3.0:1762166981.274713:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2717 00000100:00100000:3.0:1762166981.274719:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5768380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450711168:12345-192.168.204.38@tcp:4:lfs.0 00010000:00010000:3.0:1762166981.274745:0:23940:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62e00/0x2f180c4effbacd36 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.274762:0:23940:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbacc2c lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea8ba expref: 17 pid: 35472 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166981.274770:0:23940:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166981.274772:0:23940:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166981.274775:0:23940:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62e00/0x2f180c4effbacd36 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.274826:0:23940:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbacc2c lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea8ba expref: 17 pid: 35472 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166981.274838:0:23940:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbacc2c lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea8ba expref: 17 pid: 35472 timeout: 700 lvb_type: 1 00000100:00100000:3.0:1762166981.274856:0:23940:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55dce00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_007:lustre-OST0001_UUID:23940:1847765449789440:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166981.274934:0:23940:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc56bf0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166981.275794:0:23940:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55dce00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_007:lustre-OST0001_UUID:23940:1847765449789440:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166981.275983:0:23940:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62e00/0x2f180c4effbacd36 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166981.276003:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.276056:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450711296 00000100:00100000:2.0:1762166981.276063:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450711296 00010000:00010000:2.0:1762166981.276089:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbacc2c lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea8ba expref: 18 pid: 35472 timeout: 700 lvb_type: 1 00000100:00100000:2.0:1762166981.276123:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9810 00000100:00100000:2.0:1762166981.276130:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5768a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450711296:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166981.276142:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166981.276164:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbacc2c lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea8ba expref: 18 pid: 35472 timeout: 700 lvb_type: 1 00010000:00010000:2.0:1762166981.276175:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbacc2c lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea8ba expref: 18 pid: 35472 timeout: 700 lvb_type: 1 00010000:00010000:2.0:1762166981.276202:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbacc2c lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea8ba expref: 18 pid: 35472 timeout: 700 lvb_type: 1 00010000:00010000:2.0:1762166981.276222:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166981.276224:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166981.276228:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62e00/0x2f180c4effbacd36 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.276237:0:6479:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62e00/0x2f180c4effbacd36 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.276263:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166981.276290:0:23940:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62e00/0x2f180c4effbacd36 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.276302:0:23940:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62e00/0x2f180c4effbacd36 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166981.276304:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5768a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450711296:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 172us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166981.276328:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9810 00000001:00080000:2.0:1762166981.277599:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876714 is committed 00000001:00080000:2.0:1762166981.277610:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876713 is committed 00010000:00010000:3.0:1762166981.277680:0:23940:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62e00/0x2f180c4effbacd36 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.277692:0:23940:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62e00/0x2f180c4effbacd36 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.277702:0:23940:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62e00/0x2f180c4effbacd36 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.277709:0:23940:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4b62e00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166981.277713:0:23940:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62e00/0x2f180c4effbacd36 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.277721:0:23940:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62e00/0x2f180c4effbacd36 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.277738:0:23940:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62e00/0x2f180c4effbacd36 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.277746:0:23940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62e00/0x2f180c4effbacd36 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166981.277832:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5768380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+16:2419:x1847765450711168:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 3110us (3203us total) trans 17179876714 rc 0/0 00000100:00100000:3.0:1762166981.277843:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2717 00000100:00100000:0.0:1762166981.279499:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.279537:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450711424 00000100:00100000:2.0:1762166981.279546:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450711424 00000100:00100000:2.0:1762166981.279603:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19427 00000100:00100000:2.0:1762166981.279615:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc576a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+16:2417:x1847765450711424:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:2.0:1762166981.279710:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc576a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+16:2417:x1847765450711424:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 98us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166981.279718:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19427 00000100:00100000:0.0:1762166981.280715:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.280753:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450711552 00000100:00100000:2.0:1762166981.280758:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450711552 00000100:00100000:2.0:1762166981.280789:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19428 00000100:00100000:2.0:1762166981.280797:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc576aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+16:2416:x1847765450711552:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:2.0:1762166981.280850:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc576aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+16:2416:x1847765450711552:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 55us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166981.280858:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19428 00000100:00100000:0.0:1762166981.282025:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166981.282088:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450711808 00000100:00100000:3.0:1762166981.282098:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450711808 00000100:00100000:3.0:1762166981.282155:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30854 00000100:00100000:3.0:1762166981.282164:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc576b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+527:61881:x1847765450711808:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:3.0:1762166981.282220:0:30829:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166981.282248:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62800/0x2f180c4effbacd13 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea91c expref: 527 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.282266:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:3.0:1762166981.282271:0:30829:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166981.282455:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62000/0x2f180c4effbacd3d lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:3.0:1762166981.282469:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62000/0x2f180c4effbacd3d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.282519:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62000/0x2f180c4effbacd3d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000001:00080000:3.0:1762166981.282573:0:30829:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992499 00000004:00010000:3.0:1762166981.282596:0:30829:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000769d6b6b reply state 00000000401af236 transno 4294992500 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62000/0x2f180c4effbacd3d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.282608:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62000/0x2f180c4effbacd3d lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.282614:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:3.0:1762166981.282617:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1762166981.282620:0:30829:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166981.282706:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc576b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+529:61881:x1847765450711808:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 542us (681us total) trans 4294992500 rc 0/0 00000100:00100000:3.0:1762166981.282714:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30854 00000020:00080000:3.0:1762166981.282719:0:30829:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1762166981.283586:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.283630:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450711936 00000100:00100000:2.0:1762166981.283638:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450711936 00000100:00100000:2.0:1762166981.283677:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19429 00000100:00100000:2.0:1762166981.283687:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5769c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+16:61881:x1847765450711936:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166981.283700:0:28874:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166981.283718:0:28874:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbacd44 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea938 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166981.283735:0:28874:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa90:0x0] initial LVB size: 32254, mtime: 0x690888c5, atime: 0x690888c4, ctime: 0x690888c5, blocks: 0x8 00010000:00010000:2.0:1762166981.283750:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166981.283753:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166981.283759:0:28874:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbacd44 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea938 expref: 17 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.283774:0:28874:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbacd44 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea938 expref: 17 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.283786:0:28874:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc5db8e00, rc 0) 00000100:00100000:2.0:1762166981.283842:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5769c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+17:61881:x1847765450711936:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 157us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166981.283850:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19429 00000100:00100000:0.0:1762166981.284656:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166981.284680:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166981.284703:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450712064 00000100:00100000:3.0:1762166981.284710:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450712064 00000100:00100000:1.0:1762166981.284720:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450712192 00000100:00100000:1.0:1762166981.284725:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450712192 00002000:00010000:3.0:1762166981.284739:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2704 (4096->18446744073709551615) 00002000:00010000:1.0:1762166981.284742:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2705 (0->18446744073709551615) 00002000:00100000:3.0:1762166981.284745:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5768e00 with x1847765450712064 ext(4096->18446744073709551615) 00002000:00100000:1.0:1762166981.284747:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5769180 with x1847765450712192 ext(0->18446744073709551615) 00002000:00010000:1.0:1762166981.284758:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc5769180. 00002000:00010000:3.0:1762166981.284759:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5768e00. 00000100:00100000:1.0:1762166981.284787:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2718 00000100:00100000:1.0:1762166981.284796:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5769180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+30:2418:x1847765450712192:12345-192.168.204.38@tcp:10:lfs.0 00000100:00100000:3.0:1762166981.284819:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2719 00000100:00100000:3.0:1762166981.284832:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5768e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450712064:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:1.0:1762166981.284930:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166981.284932:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00010000:1.0:1762166981.284934:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00002000:00010000:1.0:1762166981.284936:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00002000:00010000:1.0:1762166981.284938:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1762166981.284972:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5769180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+31:2418:x1847765450712192:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 178us (290us total) trans 21474843463 rc 0/0 00000100:00100000:1.0:1762166981.284978:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2718 00002000:00010000:1.0:1762166981.284981:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2705 (0->18446744073709551615) 00002000:00100000:1.0:1762166981.284984:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5769180 with x1847765450712192 ext(0->18446744073709551615) 00002000:00010000:1.0:1762166981.284987:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc5769180. 00002000:00010000:3.0:1762166981.285028:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb size from disk: 32254 -> 4096 00002000:00010000:3.0:1762166981.285032:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00010000:3.0:1762166981.285035:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00002000:00010000:3.0:1762166981.285038:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00002000:00010000:3.0:1762166981.285040:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1762166981.285072:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5768e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450712064:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 242us (415us total) trans 17179876715 rc 0/0 00000100:00100000:3.0:1762166981.285081:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2719 00002000:00010000:3.0:1762166981.285085:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2704 (4096->18446744073709551615) 00002000:00100000:3.0:1762166981.285088:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5768e00 with x1847765450712064 ext(4096->18446744073709551615) 00002000:00010000:3.0:1762166981.285165:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5768e00. 00000100:00100000:0.0:1762166981.286024:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166981.286054:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450712320 00000100:00100000:3.0:1762166981.286059:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450712320 00000100:00100000:3.0:1762166981.286088:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30855 00000100:00100000:3.0:1762166981.286093:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc576b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+529:61881:x1847765450712320:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166981.286109:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166981.286121:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62e00/0x2f180c4effbacd4b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea93f expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.286215:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63000/0x2f180c4effbacd52 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:3.0:1762166981.286227:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63000/0x2f180c4effbacd52 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.286235:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63000/0x2f180c4effbacd52 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000004:00200000:3.0:1762166981.286258:0:30829:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 4096 00000004:00200000:3.0:1762166981.286262:0:30829:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166981.286275:0:30829:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63000/0x2f180c4effbacd52 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.286296:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62e00/0x2f180c4effbacd4b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea93f expref: 531 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.286306:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63000/0x2f180c4effbacd52 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea93f expref: 530 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.286313:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:3.0:1762166981.286315:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166981.286318:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4b63000, rc 0) 00000100:00100000:3.0:1762166981.286351:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc576b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+530:61881:x1847765450712320:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 257us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166981.286357:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30855 00000100:00100000:0.0:1762166981.287722:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166981.287761:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450712448 00000100:00100000:3.0:1762166981.287768:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450712448 00000100:00100000:3.0:1762166981.287835:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2720 00000100:00100000:3.0:1762166981.287846:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6225180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450712448:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:3.0:1762166981.287875:0:23940:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4b63e00/0x2f180c4effbacd59 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.287888:0:23940:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166981.287889:0:23940:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166981.287894:0:23940:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4b63e00/0x2f180c4effbacd59 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [196608->262143] (req 196608->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.287906:0:23940:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4b63e00/0x2f180c4effbacd59 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [196608->262143] (req 196608->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.289046:0:23940:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4b63e00/0x2f180c4effbacd59 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [196608->262143] (req 196608->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.289061:0:23940:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4b63e00/0x2f180c4effbacd59 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [196608->262143] (req 196608->262143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.289076:0:23940:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc4b63e00/0x2f180c4effbacd59 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [196608->262143] (req 196608->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.289084:0:23940:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4b63e00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166981.289088:0:23940:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4b63e00/0x2f180c4effbacd59 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [196608->262143] (req 196608->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.289097:0:23940:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4b63e00/0x2f180c4effbacd59 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [196608->262143] (req 196608->262143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.289115:0:23940:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc4b63e00/0x2f180c4effbacd59 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [196608->262143] (req 196608->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.289124:0:23940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4b63e00/0x2f180c4effbacd59 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [196608->262143] (req 196608->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166981.289194:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6225180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450712448:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 1348us (1475us total) trans 0 rc 65536/65536 00000100:00100000:3.0:1762166981.289203:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2720 00000100:00100000:0.0:1762166981.290723:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166981.290769:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450712576 00000100:00100000:3.0:1762166981.290779:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450712576 00000100:00100000:3.0:1762166981.290843:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2721 00000100:00100000:3.0:1762166981.290851:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6224e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450712576:12345-192.168.204.38@tcp:4:lfs.0 00010000:00010000:3.0:1762166981.290877:0:23940:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62800/0x2f180c4effbacd60 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.290893:0:23940:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbacd44 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea938 expref: 18 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.290898:0:23940:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166981.290900:0:23940:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166981.290902:0:23940:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62800/0x2f180c4effbacd60 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 3 type: EXT [196608->262143] (req 196608->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.290928:0:23940:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbacd44 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea938 expref: 18 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.290937:0:23940:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbacd44 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea938 expref: 18 pid: 28874 timeout: 700 lvb_type: 0 00000100:00100000:3.0:1762166981.290946:0:23940:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55dce00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_007:lustre-OST0001_UUID:23940:1847765449789568:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166981.291018:0:23940:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc56bf0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166981.291790:0:23940:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55dce00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_007:lustre-OST0001_UUID:23940:1847765449789568:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166981.291821:0:23940:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62800/0x2f180c4effbacd60 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 3 type: EXT [196608->262143] (req 196608->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166981.292028:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.292093:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450712704 00000100:00100000:2.0:1762166981.292100:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450712704 00010000:00010000:2.0:1762166981.292136:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbacd44 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea938 expref: 19 pid: 28874 timeout: 700 lvb_type: 0 00000100:00100000:2.0:1762166981.292184:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9811 00000100:00100000:2.0:1762166981.292195:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cceb4a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450712704:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166981.292210:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166981.292230:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbacd44 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea938 expref: 19 pid: 28874 timeout: 700 lvb_type: 0 00010000:00010000:2.0:1762166981.292243:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbacd44 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea938 expref: 19 pid: 28874 timeout: 700 lvb_type: 0 00010000:00010000:2.0:1762166981.292265:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbacd44 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea938 expref: 19 pid: 28874 timeout: 700 lvb_type: 0 00010000:00010000:2.0:1762166981.292276:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166981.292277:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166981.292281:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62800/0x2f180c4effbacd60 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 3 type: EXT [196608->262143] (req 196608->262143) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.292288:0:6479:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62800/0x2f180c4effbacd60 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 3 type: EXT [196608->262143] (req 196608->262143) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.292311:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166981.292336:0:23940:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62800/0x2f180c4effbacd60 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [196608->262143] (req 196608->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.292345:0:23940:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62800/0x2f180c4effbacd60 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [196608->262143] (req 196608->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166981.292361:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cceb4a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450712704:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 162us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166981.292371:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9811 00000001:00080000:2.0:1762166981.294542:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876716 is committed 00002000:00010000:3.0:1762166981.294614:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb size from disk: 4096 -> 262144 00002000:00010000:3.0:1762166981.294620:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb blocks from disk: 8 -> 136 00010000:00010000:3.0:1762166981.294630:0:23940:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62800/0x2f180c4effbacd60 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [196608->262143] (req 196608->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.294640:0:23940:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62800/0x2f180c4effbacd60 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [196608->262143] (req 196608->262143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.294649:0:23940:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62800/0x2f180c4effbacd60 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [196608->262143] (req 196608->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.294655:0:23940:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4b62800 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166981.294659:0:23940:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62800/0x2f180c4effbacd60 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [196608->262143] (req 196608->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.294666:0:23940:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62800/0x2f180c4effbacd60 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [196608->262143] (req 196608->262143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.294677:0:23940:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62800/0x2f180c4effbacd60 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [196608->262143] (req 196608->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.294682:0:23940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62800/0x2f180c4effbacd60 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [196608->262143] (req 196608->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166981.294740:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6224e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+16:2418:x1847765450712576:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 3889us (4019us total) trans 17179876716 rc 0/0 00000100:00100000:3.0:1762166981.294748:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2721 00000100:00100000:0.0:1762166981.302232:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166981.302278:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450712960 00000100:00100000:3.0:1762166981.302288:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450712960 00000100:00100000:3.0:1762166981.302342:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30856 00000100:00100000:3.0:1762166981.302353:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6225880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+530:61881:x1847765450712960:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:3.0:1762166981.302408:0:30829:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166981.302431:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63000/0x2f180c4effbacd52 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea93f expref: 530 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.302451:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:3.0:1762166981.302456:0:30829:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166981.302663:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62800/0x2f180c4effbacd67 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:3.0:1762166981.302677:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62800/0x2f180c4effbacd67 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.302687:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62800/0x2f180c4effbacd67 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000001:00080000:3.0:1762166981.302726:0:30829:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992501 00000004:00010000:3.0:1762166981.302751:0:30829:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000897a2e11 reply state 000000001e81894e transno 4294992502 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62800/0x2f180c4effbacd67 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.302762:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62800/0x2f180c4effbacd67 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.302768:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:3.0:1762166981.302771:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1762166981.302773:0:30829:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166981.302879:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6225880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+532:61881:x1847765450712960:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 528us (652us total) trans 4294992502 rc 0/0 00000100:00100000:3.0:1762166981.302887:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30856 00000020:00080000:3.0:1762166981.302893:0:30829:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1762166981.303713:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.303776:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450713088 00000100:00100000:2.0:1762166981.303791:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450713088 00000100:00100000:2.0:1762166981.303873:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19430 00000100:00100000:2.0:1762166981.303884:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6225c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+16:61881:x1847765450713088:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166981.303903:0:28874:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166981.303934:0:28874:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbacd6e lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea946 expref: -99 pid: 28874 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166981.303963:0:28874:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa90:0x0] initial LVB size: 262144, mtime: 0x690888c5, atime: 0x690888c4, ctime: 0x690888c5, blocks: 0x88 00010000:00010000:2.0:1762166981.303986:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166981.303989:0:28874:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166981.303997:0:28874:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbacd6e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea946 expref: 17 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.304040:0:28874:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbacd6e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea946 expref: 17 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.304055:0:28874:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc5db8e00, rc 0) 00000100:00100000:2.0:1762166981.304120:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6225c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+17:61881:x1847765450713088:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 238us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166981.304128:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19430 00000100:00100000:0.0:1762166981.305117:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166981.305169:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450713216 00000100:00100000:0.0:1762166981.305175:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166981.305178:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450713216 00002000:00010000:3.0:1762166981.305207:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2704 (262144->18446744073709551615) 00000100:00100000:1.0:1762166981.305234:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450713344 00000100:00100000:1.0:1762166981.305239:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450713344 00002000:00100000:3.0:1762166981.305253:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc6226d80 with x1847765450713216 ext(262144->18446744073709551615) 00002000:00010000:1.0:1762166981.305257:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2705 (0->18446744073709551615) 00002000:00010000:3.0:1762166981.305265:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc6226d80. 00002000:00100000:1.0:1762166981.305273:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc6227800 with x1847765450713344 ext(0->18446744073709551615) 00002000:00010000:1.0:1762166981.305281:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc6227800. 00000100:00100000:3.0:1762166981.305294:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2722 00000100:00100000:3.0:1762166981.305307:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6226d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+17:2417:x1847765450713216:12345-192.168.204.38@tcp:10:lfs.0 00000100:00100000:1.0:1762166981.305313:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2723 00000100:00100000:1.0:1762166981.305326:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6227800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+31:2417:x1847765450713344:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:1.0:1762166981.305429:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166981.305430:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:1.0:1762166981.305435:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00010000:3.0:1762166981.305437:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00010000:1.0:1762166981.305442:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00002000:00010000:3.0:1762166981.305443:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00002000:00010000:1.0:1762166981.305448:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00002000:00010000:3.0:1762166981.305449:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00002000:00010000:1.0:1762166981.305453:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:3.0:1762166981.305455:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb blocks from disk: 136 -> 136 00000100:00100000:1.0:1762166981.305521:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6227800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+32:2417:x1847765450713344:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 198us (346us total) trans 21474843464 rc 0/0 00000100:00100000:3.0:1762166981.305526:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6226d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+18:2417:x1847765450713216:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 220us (408us total) trans 17179876717 rc 0/0 00000100:00100000:1.0:1762166981.305535:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2723 00002000:00010000:1.0:1762166981.305540:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2705 (0->18446744073709551615) 00000100:00100000:3.0:1762166981.305545:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2722 00002000:00100000:1.0:1762166981.305547:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc6227800 with x1847765450713344 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166981.305551:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2704 (262144->18446744073709551615) 00002000:00010000:1.0:1762166981.305555:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc6227800. 00002000:00100000:3.0:1762166981.305557:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc6226d80 with x1847765450713216 ext(262144->18446744073709551615) 00002000:00010000:3.0:1762166981.305565:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc6226d80. 00000100:00100000:1.0:1762166981.306655:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166981.306712:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450713600 00000100:00100000:3.0:1762166981.306722:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450713600 00000100:00100000:3.0:1762166981.306781:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30857 00000100:00100000:3.0:1762166981.306792:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+532:61881:x1847765450713600:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:3.0:1762166981.306917:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effbacd75 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:3.0:1762166981.306933:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effbacd75 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.306946:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effbacd75 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000004:00010000:3.0:1762166981.307056:0:30829:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000ab87e694 reply state 000000003451f54e transno 4294992503 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effbacd75 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.307067:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effbacd75 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.307072:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:3.0:1762166981.307074:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1762166981.307077:0:30829:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166981.307141:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+534:61881:x1847765450713600:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 351us (487us total) trans 4294992503 rc 0/0 00000100:00100000:3.0:1762166981.307148:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30857 00000100:00100000:0.0:1762166981.308237:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166981.308270:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.308297:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450713728 00000100:00100000:0.0:1762166981.308303:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.308307:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450713728 00000100:00100000:3.0:1762166981.308362:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450713856 00000100:00100000:2.0:1762166981.308362:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450713984 00000100:00100000:2.0:1762166981.308365:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450713984 00000100:00100000:3.0:1762166981.308366:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450713856 00000100:00100000:0.0:1762166981.308375:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19431 00000100:00100000:0.0:1762166981.308387:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc59d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450713728:12345-192.168.204.38@tcp:2:lfs.0 00000100:00100000:2.0:1762166981.308394:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19432 00000100:00100000:3.0:1762166981.308403:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19433 00000100:00100000:2.0:1762166981.308405:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc59d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450713984:12345-192.168.204.38@tcp:2:lfs.0 00000100:00100000:3.0:1762166981.308409:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc59d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+32:2419:x1847765450713856:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:3.0:1762166981.308526:0:8382:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166981.308526:0:28874:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166981.308530:0:28874:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00010000:3.0:1762166981.308531:0:8382:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00010000:3.0:1762166981.308534:0:8382:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166981 -> 1762166981 00002000:00010000:2.0:1762166981.308534:0:28874:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166981 -> 1762166981 00002000:00010000:3.0:1762166981.308537:0:8382:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00002000:00010000:2.0:1762166981.308537:0:28874:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00002000:00010000:3.0:1762166981.308540:0:8382:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00002000:00010000:2.0:1762166981.308540:0:28874:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166981.308581:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc59d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+33:2419:x1847765450713856:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 169us (309us total) trans 21474843465 rc 0/0 00000100:00100000:2.0:1762166981.308581:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc59d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450713984:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 175us (276us total) trans 17179876718 rc 0/0 00000100:00100000:2.0:1762166981.308589:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19432 00000100:00100000:3.0:1762166981.308593:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19433 00002000:00010000:0.0:1762166981.308599:0:35247:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:0.0:1762166981.308606:0:35247:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00010000:0.0:1762166981.308609:0:35247:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166981 -> 1762166981 00002000:00010000:0.0:1762166981.308612:0:35247:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00002000:00010000:0.0:1762166981.308615:0:35247:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 200 -> 200 00000100:00100000:0.0:1762166981.308658:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc59d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450713728:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 272us (421us total) trans 17179876719 rc 0/0 00000100:00100000:0.0:1762166981.308669:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19431 00000100:00100000:0.0:1762166981.310518:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.310577:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450714240 00000100:00100000:2.0:1762166981.310583:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450714240 00000100:00100000:2.0:1762166981.310623:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11977 00000100:00100000:2.0:1762166981.310631:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc59d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+534:61881:x1847765450714240:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:2.0:1762166981.310682:0:19593:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x240000404:0x5eb:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63400/0x2f180c4effbaccdb lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea90e expref: 534 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.310722:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbacd7c lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:2.0:1762166981.310743:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63a00/0x2f180c4effbacd05 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea915 expref: 534 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.310756:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbacd7c lrc: 4/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166981.310787:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63a00/0x2f180c4effbacd05 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea915 expref: 534 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.310799:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63a00/0x2f180c4effbacd05 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea915 expref: 534 pid: 30829 timeout: 700 lvb_type: 0 00000100:00100000:2.0:1762166981.310830:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449789696:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166981.310905:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cd05170c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166981.311700:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449789696:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166981.311721:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbacd7c lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:0.0:1762166981.311884:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.311938:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450714368 00000100:00100000:2.0:1762166981.311944:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450714368 00010000:00010000:2.0:1762166981.311961:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63a00/0x2f180c4effbacd05 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea915 expref: 535 pid: 30829 timeout: 700 lvb_type: 0 00000100:00100000:2.0:1762166981.311990:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9812 00000100:00100000:2.0:1762166981.311998:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc59d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+535:2418:x1847765450714368:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166981.312009:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166981.312016:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63a00/0x2f180c4effbacd05 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea915 expref: 535 pid: 30829 timeout: 700 lvb_type: 0 00010000:00010000:2.0:1762166981.312030:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63a00/0x2f180c4effbacd05 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea915 expref: 535 pid: 30829 timeout: 700 lvb_type: 0 00010000:00010000:2.0:1762166981.312044:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63a00/0x2f180c4effbacd05 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea915 expref: 535 pid: 30829 timeout: 700 lvb_type: 0 00010000:00010000:2.0:1762166981.312059:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166981.312063:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbacd7c lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166981.312075:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbacd7c lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166981.312082:0:6479:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbacd7c lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166981.312108:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166981.312142:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbacd7c lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:2.0:1762166981.312147:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc59d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+534:2418:x1847765450714368:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 148us (262us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166981.312155:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbacd7c lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:2.0:1762166981.312162:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9812 00000040:00080000:0.0:1762166981.312365:0:19593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5955, 88 off466696 00000004:00080000:0.0:1762166981.312371:0:19593:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 600460893492ns, next at 600144491692ns, rc = 0 00000040:00080000:0.0:1762166981.312400:0:19593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5954, 88 off466696 00000004:00080000:0.0:1762166981.312403:0:19593:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 600460925558ns, next at 600144525370ns, rc = 0 00000040:00080000:0.0:1762166981.312417:0:19593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5955, 88 off466784 00000004:00080000:0.0:1762166981.312420:0:19593:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 600460942053ns, next at 600144525370ns, rc = 0 00000040:00080000:0.0:1762166981.312432:0:19593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5956, 88 off466784 00000004:00080000:0.0:1762166981.312436:0:19593:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 600460958215ns, next at 600144491692ns, rc = 0 00000040:00080000:0.0:1762166981.312460:0:19593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5957, 88 off466872 00000004:00080000:0.0:1762166981.312466:0:19593:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 600460987811ns, next at 600144491692ns, rc = 0 00000040:00080000:0.0:1762166981.312518:0:19593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5956, 88 off466872 00000004:00080000:0.0:1762166981.312524:0:19593:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 600461046286ns, next at 600144525370ns, rc = 0 00000001:00080000:3.0:1762166981.313447:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294992504 is committed 00000004:00080000:3.0:1762166981.313460:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3317 committed 00010000:00010000:2.0:1762166981.313500:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62000/0x2f180c4effbacd3d lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.313513:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62000/0x2f180c4effbacd3d lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00000004:00080000:3.0:1762166981.313518:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3314 committed 00010000:00010000:2.0:1762166981.313522:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62000/0x2f180c4effbacd3d lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.313532:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4b62000 already unused, calling callback (ffffffffc18e2310) 00000004:00080000:3.0:1762166981.313533:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3313 committed 00000004:00080000:3.0:1762166981.313537:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3316 committed 00000004:00080000:3.0:1762166981.313541:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3315 committed 00010000:00010000:2.0:1762166981.313543:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62000/0x2f180c4effbacd3d lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00000004:00080000:3.0:1762166981.313546:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3312 committed 00010000:00010000:2.0:1762166981.313558:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62000/0x2f180c4effbacd3d lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.313576:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166981.313580:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166981.313583:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62000/0x2f180c4effbacd3d lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.313587:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62000/0x2f180c4effbacd3d lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.313601:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62800/0x2f180c4effbacd67 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.313608:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62800/0x2f180c4effbacd67 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.313616:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62800/0x2f180c4effbacd67 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00000100:00100000:3.0:1762166981.313617:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc59d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449789952:0@lo:2:osp-syn-1-1.0 00010000:00010000:2.0:1762166981.313636:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4b62800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166981.313640:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62800/0x2f180c4effbacd67 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.313647:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62800/0x2f180c4effbacd67 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.313659:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166981.313663:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166981.313667:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62800/0x2f180c4effbacd67 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.313676:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62800/0x2f180c4effbacd67 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.313693:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effbacd75 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00000100:00100000:0.0:1762166981.313702:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449790080:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1762166981.313703:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc59d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449790208:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166981.313710:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1762166981.313724:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effbacd75 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.313729:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effbacd75 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.313739:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4b63e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166981.313746:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effbacd75 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.313752:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effbacd75 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.313764:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166981.313769:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166981.313772:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effbacd75 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00000100:00100000:3.0:1762166981.313775:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449790464:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1762166981.313788:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1762166981.313796:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effbacd75 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00000100:00100000:0.0:1762166981.313804:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449789824:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166981.313853:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00010000:2.0:1762166981.313876:0:19593:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000dac15128 reply state 000000003fbc7332 transno 4294992504 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbacd7c lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:1.0:1762166981.313879:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449789952 00000100:00100000:1.0:1762166981.313889:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449789952 00000100:00100000:0.0:1762166981.313895:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1762166981.313905:0:19593:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbacd7c lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166981.313920:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00000100:00100000:3.0:1762166981.313921:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449790208 00010000:00010000:2.0:1762166981.313924:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1762166981.313927:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449790208 00000100:00100000:2.0:1762166981.313930:0:19593:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1762166981.313939:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166981.313942:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00000100:00100000:1.0:1762166981.313945:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449790464 00010000:00010000:2.0:1762166981.313949:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63400/0x2f180c4effbaccdb lrc: 0/0,0 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea90e expref: 525 pid: 30829 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166981.313952:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449790464 00000100:00100000:3.0:1762166981.313961:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449790080 00000100:00100000:3.0:1762166981.313965:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449790080 00000100:00100000:0.0:1762166981.313992:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166981.314015:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449789824 00000100:00100000:1.0:1762166981.314022:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449789824 00000100:00100000:3.0:1762166981.314029:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19434 00000100:00100000:0.0:1762166981.314037:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc59d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449790336:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166981.314046:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3636:x1847765449789952:12345-0@lo:2:osp-syn-1-1.0 00010000:00080000:2.0:1762166981.314064:0:19593:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1762166981.314067:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19435 00000100:00100000:0.0:1762166981.314093:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166981.314094:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:3634:x1847765449790208:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1762166981.314095:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc59d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+525:61881:x1847765450714240:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 3451us (3566us total) trans 4294992504 rc 0/0 00000100:00100000:2.0:1762166981.314118:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11977 00010000:00010000:0.0:1762166981.314135:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbacd7c lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166981.314144:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbacd7c lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166981.314151:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbacd7c lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166981.314165:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc5db9c00 already unused, calling callback (ffffffffc18e2310) 00000100:00100000:2.0:1762166981.314171:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449790336 00010000:00010000:0.0:1762166981.314171:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbacd7c lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00002000:00010000:3.0:1762166981.314178:0:8382:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 262144 -> 262144 00000100:00100000:2.0:1762166981.314179:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449790336 00010000:00010000:0.0:1762166981.314181:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbacd7c lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT1 00002000:00010000:1.0:1762166981.314184:0:9168:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166981.314190:0:8382:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00010000:1.0:1762166981.314195:0:9168:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00010000:3.0:1762166981.314201:0:8382:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166981 -> 1762166981 00002000:00010000:1.0:1762166981.314204:0:9168:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166981 -> 1762166981 00002000:00010000:3.0:1762166981.314215:0:8382:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00002000:00010000:1.0:1762166981.314218:0:9168:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00000100:00100000:2.0:1762166981.314220:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19436 00002000:00010000:3.0:1762166981.314222:0:8382:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 200 -> 200 00010000:00010000:0.0:1762166981.314225:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00002000:00010000:1.0:1762166981.314228:0:9168:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00010000:0.0:1762166981.314240:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:2.0:1762166981.314242:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+33:3636:x1847765449790464:12345-0@lo:2:osp-syn-0-1.0 00010000:00010000:0.0:1762166981.314245:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbacd7c lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166981.314254:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbacd7c lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00000100:00100000:3.0:1762166981.314273:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+9:3636:x1847765449789952:12345-0@lo:2:osp-syn-1-1.0 Request processed in 236us (579us total) trans 17179876720 rc 0/0 00000100:00100000:3.0:1762166981.314281:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19434 00000100:00100000:1.0:1762166981.314297:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+9:3634:x1847765449790208:12345-0@lo:2:osp-syn-1-1.0 Request processed in 215us (512us total) trans 17179876721 rc 0/0 00000100:00100000:0.0:1762166981.314307:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19437 00000100:00100000:3.0:1762166981.314317:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19438 00000100:00100000:1.0:1762166981.314333:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19435 00000100:00100000:3.0:1762166981.314336:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb386300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+34:3635:x1847765449789824:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:0.0:1762166981.314337:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3d59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+34:3633:x1847765449790080:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:2.0:1762166981.314362:0:8380:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:1.0:1762166981.314366:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19439 00002000:00010000:2.0:1762166981.314371:0:8380:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00010000:2.0:1762166981.314377:0:8380:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00002000:00010000:2.0:1762166981.314381:0:8380:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00002000:00010000:2.0:1762166981.314385:0:8380:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1762166981.314391:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb386a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+7:3635:x1847765449790336:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:3.0:1762166981.314405:0:8382:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166981.314409:0:8382:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb mtime from disk: 1762166966 -> 1762166966 00002000:00010000:3.0:1762166981.314412:0:8382:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1762166981.314414:0:8382:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb ctime from disk: 1762166966 -> 1762166966 00002000:00010000:3.0:1762166981.314417:0:8382:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1762166981.314433:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+36:3636:x1847765449790464:12345-0@lo:2:osp-syn-0-1.0 Request processed in 194us (582us total) trans 21474843466 rc 0/0 00002000:00010000:0.0:1762166981.314443:0:35247:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:2.0:1762166981.314445:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19436 00002000:00010000:0.0:1762166981.314449:0:35247:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00010000:0.0:1762166981.314454:0:35247:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166981 -> 1762166981 00002000:00010000:0.0:1762166981.314458:0:35247:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00000100:00100000:3.0:1762166981.314464:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb386300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+35:3635:x1847765449789824:12345-0@lo:2:osp-syn-0-1.0 Request processed in 136us (471us total) trans 21474843467 rc 0/0 00002000:00010000:0.0:1762166981.314466:0:35247:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00000100:00100000:3.0:1762166981.314504:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19438 00002000:00010000:1.0:1762166981.314512:0:9168:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:1.0:1762166981.314517:0:9168:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00010000:1.0:1762166981.314521:0:9168:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00002000:00010000:1.0:1762166981.314523:0:9168:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00002000:00010000:1.0:1762166981.314526:0:9168:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb blocks from disk: 136 -> 136 00000100:00100000:0.0:1762166981.314583:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3d59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+34:3633:x1847765449790080:12345-0@lo:2:osp-syn-0-1.0 Request processed in 258us (688us total) trans 21474843468 rc 0/0 00000004:00080000:2.0:1762166981.314594:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc406e680/2, rc 0, transno 21474843466 00000100:00100000:1.0:1762166981.314605:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb386a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+8:3635:x1847765449790336:12345-0@lo:2:osp-syn-1-1.0 Request processed in 217us (513us total) trans 17179876722 rc 0/0 00000100:00100000:0.0:1762166981.314605:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19437 00000100:00100000:2.0:1762166981.314609:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449790464:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1762166981.314630:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19439 00000100:00100000:2.0:1762166981.314640:0:3636:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 17179876713 gen 2 00000004:00080000:2.0:1762166981.314648:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc7d21180, transno 17179876711 00000004:00080000:2.0:1762166981.314666:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc47b5880, transno 17179876712 00000004:00080000:2.0:1762166981.314675:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc2d5dc00, transno 17179876713 00000100:00100000:2.0:1762166981.314689:0:3636:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff945bc59d6a00 x1847765449789952/t17179876720(17179876720) o2->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 440/432 e 0 to 0 dl 1762166997 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1762166981.314699:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc59d6a00/2, rc 0, transno 17179876720 00000100:00100000:2.0:1762166981.314706:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc59d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449789952:0@lo:2:osp-syn-1-1.0 00000004:00080000:1.0:1762166981.314707:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc59d4a80/2, rc 0, transno 17179876721 00000100:00100000:1.0:1762166981.314720:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc59d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449790208:0@lo:2:osp-syn-1-1.0 00000004:00080000:2.0:1762166981.314787:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc406dc00/2, rc 0, transno 21474843467 00000100:00100000:2.0:1762166981.314798:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449789824:0@lo:2:osp-syn-0-1.0 00000004:00080000:1.0:1762166981.314847:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc406f480/2, rc 0, transno 21474843468 00000004:00080000:2.0:1762166981.314852:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc59d5500/2, rc 0, transno 17179876722 00000100:00100000:1.0:1762166981.314859:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449790080:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1762166981.314865:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc59d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449790336:0@lo:2:osp-syn-1-1.0 00000004:00080000:3.0:1762166981.314932:0:9994:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0001: 0 changes, 3 in progress, 0 in flight, 3 done 00000100:00100000:0.0:1762166981.315597:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166981.315648:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450714496 00000100:00100000:3.0:1762166981.315653:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450714496 00000100:00100000:3.0:1762166981.315686:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30858 00000100:00100000:3.0:1762166981.315692:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb384000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+524:61881:x1847765450714496:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166981.315706:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166981.315720:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63000/0x2f180c4effbacd83 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea94d expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.315760:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63000/0x2f180c4effbacd83 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea94d expref: 525 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.315770:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63000/0x2f180c4effbacd83 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea94d expref: 525 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.315783:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:3.0:1762166981.315785:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166981.315787:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4b63000, rc 0) 00000100:00100000:3.0:1762166981.315836:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb384000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+525:61881:x1847765450714496:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 144us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166981.315846:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30858 00000100:00100000:3.0:1762166981.317165:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.317223:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450714752 00000100:00100000:2.0:1762166981.317230:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450714752 00000100:00100000:2.0:1762166981.317270:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11978 00000100:00100000:2.0:1762166981.317278:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+525:61881:x1847765450714752:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:2.0:1762166981.317522:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+526:61881:x1847765450714752:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 243us (358us total) trans 4294992505 rc 0/0 00000100:00100000:2.0:1762166981.317533:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11978 00000100:00100000:1.0:1762166981.326327:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166981.326398:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450714880 00000100:00100000:3.0:1762166981.326411:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450714880 00000100:00100000:3.0:1762166981.326516:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30859 00000100:00100000:3.0:1762166981.326530:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+526:61882:x1847765450714880:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166981.326562:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166981.326602:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62e00/0x2f180c4effbacd8a lrc: 2/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea954 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.326692:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62c00/0x2f180c4effbacd91 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:3.0:1762166981.326707:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62c00/0x2f180c4effbacd91 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.326719:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62c00/0x2f180c4effbacd91 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.326734:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63400/0x2f180c4effbacd98 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:3.0:1762166981.326740:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63400/0x2f180c4effbacd98 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.326746:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63400/0x2f180c4effbacd98 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.326868:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effbacd9f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:3.0:1762166981.326878:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effbacd9f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.326885:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effbacd9f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000004:00200000:3.0:1762166981.326937:0:30829:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 262144 00000004:00200000:3.0:1762166981.326943:0:30829:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166981.326964:0:30829:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effbacd9f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.326977:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effbacd9f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.326987:0:30829:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62c00/0x2f180c4effbacd91 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.326993:0:30829:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62c00/0x2f180c4effbacd91 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.326999:0:30829:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62c00/0x2f180c4effbacd91 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.327006:0:30829:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62c00/0x2f180c4effbacd91 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.327012:0:30829:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4b62c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166981.327016:0:30829:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62c00/0x2f180c4effbacd91 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.327025:0:30829:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62c00/0x2f180c4effbacd91 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.327038:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0x0 (ffff945cf1ee9d00) 00010000:00010000:3.0:1762166981.327042:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166981.327047:0:30829:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62c00/0x2f180c4effbacd91 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.327053:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62c00/0x2f180c4effbacd91 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.327068:0:30829:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63400/0x2f180c4effbacd98 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.327074:0:30829:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63400/0x2f180c4effbacd98 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.327079:0:30829:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63400/0x2f180c4effbacd98 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.327083:0:30829:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4b63400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166981.327086:0:30829:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63400/0x2f180c4effbacd98 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.327092:0:30829:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63400/0x2f180c4effbacd98 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.327098:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0xdd396665 (ffff945cf1ee9c00) 00010000:00010000:3.0:1762166981.327101:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166981.327104:0:30829:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63400/0x2f180c4effbacd98 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.327109:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63400/0x2f180c4effbacd98 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.327141:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62e00/0x2f180c4effbacd8a lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea954 expref: 528 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.327156:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effbacd9f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea954 expref: 527 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.327163:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:3.0:1762166981.327166:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166981.327168:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4b63e00, rc 0) 00000100:00100000:3.0:1762166981.327248:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+527:61882:x1847765450714880:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 721us (932us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166981.327256:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30859 00000100:00100000:0.0:1762166981.329512:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166981.329712:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450715136 00000100:00100000:3.0:1762166981.329730:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450715136 00000100:00100000:3.0:1762166981.329819:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30860 00000100:00100000:3.0:1762166981.329832:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb386680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+527:61882:x1847765450715136:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166981.329858:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166981.329891:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62800/0x2f180c4effbacda6 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea95b expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.330015:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62000/0x2f180c4effbacdad lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:3.0:1762166981.330030:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62000/0x2f180c4effbacdad lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.330042:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62000/0x2f180c4effbacdad lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000004:00200000:3.0:1762166981.330053:0:30829:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 262144 00010000:00010000:3.0:1762166981.330167:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62800/0x2f180c4effbacda6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea95b expref: 530 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.330186:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62000/0x2f180c4effbacdad lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea95b expref: 529 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.330195:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:3.0:1762166981.330199:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1762166981.330203:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4b62000, rc 0) 00000100:00100000:3.0:1762166981.330280:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb386680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+529:61882:x1847765450715136:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 451us (815us total) trans 4294992506 rc 0/0 00000100:00100000:3.0:1762166981.330293:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30860 00000100:00100000:1.0:1762166981.334648:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166981.334692:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450715392 00000100:00100000:3.0:1762166981.334700:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450715392 00000100:00100000:3.0:1762166981.334756:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30861 00000100:00100000:3.0:1762166981.334766:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+529:61882:x1847765450715392:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166981.334785:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166981.334800:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62e00/0x2f180c4effbacdbb lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea962 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.334913:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63400/0x2f180c4effbacdc2 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:3.0:1762166981.334926:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63400/0x2f180c4effbacdc2 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.334934:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63400/0x2f180c4effbacdc2 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000004:00200000:3.0:1762166981.334942:0:30829:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 262144 00010000:00010000:3.0:1762166981.335023:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62e00/0x2f180c4effbacdbb lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea962 expref: 532 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.335037:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63400/0x2f180c4effbacdc2 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea962 expref: 531 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.335045:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:3.0:1762166981.335049:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166981.335052:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4b63400, rc 0) 00000100:00100000:3.0:1762166981.335109:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+531:61882:x1847765450715392:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 345us (467us total) trans 4294992507 rc 0/0 00000100:00100000:3.0:1762166981.335117:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30861 00000100:00100000:1.0:1762166981.361697:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166981.361749:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450715520 00000100:00100000:3.0:1762166981.361762:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450715520 00000100:00100000:3.0:1762166981.361861:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2724 00000100:00100000:3.0:1762166981.361873:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+20:2417:x1847765450715520:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:3.0:1762166981.361911:0:23940:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62e00/0x2f180c4effbacdd0 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.361927:0:23940:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166981.361929:0:23940:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166981.361935:0:23940:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62e00/0x2f180c4effbacdd0 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.361949:0:23940:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62e00/0x2f180c4effbacdd0 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.364072:0:23940:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62e00/0x2f180c4effbacdd0 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.364097:0:23940:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62e00/0x2f180c4effbacdd0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.364107:0:23940:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62e00/0x2f180c4effbacdd0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.364121:0:23940:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4b62e00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166981.364126:0:23940:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62e00/0x2f180c4effbacdd0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.364136:0:23940:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62e00/0x2f180c4effbacdd0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.364162:0:23940:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62e00/0x2f180c4effbacdd0 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.364170:0:23940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62e00/0x2f180c4effbacdd0 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166981.364266:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+20:2417:x1847765450715520:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 2391us (2575us total) trans 0 rc 262144/262144 00000100:00100000:3.0:1762166981.364277:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2724 00000100:00100000:1.0:1762166981.366725:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.366850:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450715648 00000100:00100000:2.0:1762166981.366859:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450715648 00000100:00100000:2.0:1762166981.366927:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2725 00000100:00100000:2.0:1762166981.366936:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+20:2416:x1847765450715648:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:2.0:1762166981.366966:0:23940:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc5db9800/0x2f180c4effbacdd7 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.366984:0:23940:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbacd6e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea946 expref: 20 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.366992:0:23940:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166981.366994:0:23940:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166981.366998:0:23940:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc5db9800/0x2f180c4effbacdd7 lrc: 4/1,0 mode: --/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.367029:0:23940:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbacd6e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea946 expref: 20 pid: 28874 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.367043:0:23940:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbacd6e lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea946 expref: 20 pid: 28874 timeout: 700 lvb_type: 0 00000100:00100000:2.0:1762166981.367063:0:23940:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783f800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_007:lustre-OST0001_UUID:23940:1847765449790592:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166981.367150:0:23940:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cd05170c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166981.368602:0:23940:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783f800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_007:lustre-OST0001_UUID:23940:1847765449790592:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166981.368621:0:23940:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc5db9800/0x2f180c4effbacdd7 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166981.369029:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.369102:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450715776 00000100:00100000:2.0:1762166981.369108:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450715776 00010000:00010000:2.0:1762166981.369129:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbacd6e lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea946 expref: 21 pid: 28874 timeout: 700 lvb_type: 0 00000100:00100000:2.0:1762166981.369164:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9813 00000100:00100000:2.0:1762166981.369173:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450715776:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166981.369185:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166981.369204:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbacd6e lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea946 expref: 21 pid: 28874 timeout: 700 lvb_type: 0 00010000:00010000:2.0:1762166981.369216:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbacd6e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea946 expref: 21 pid: 28874 timeout: 700 lvb_type: 0 00010000:00010000:2.0:1762166981.369238:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbacd6e lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea946 expref: 21 pid: 28874 timeout: 700 lvb_type: 0 00010000:00010000:2.0:1762166981.369252:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166981.369254:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166981.369258:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc5db9800/0x2f180c4effbacdd7 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.369267:0:6479:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc5db9800/0x2f180c4effbacdd7 lrc: 4/1,0 mode: PR/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.369293:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166981.369319:0:23940:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc5db9800/0x2f180c4effbacdd7 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.369331:0:23940:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc5db9800/0x2f180c4effbacdd7 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166981.369340:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450715776:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 167us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166981.369351:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9813 00010000:00010000:2.0:1762166981.371628:0:23940:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc5db9800/0x2f180c4effbacdd7 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.371642:0:23940:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc5db9800/0x2f180c4effbacdd7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.371651:0:23940:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc5db9800/0x2f180c4effbacdd7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.371659:0:23940:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc5db9800 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166981.371663:0:23940:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc5db9800/0x2f180c4effbacdd7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.371672:0:23940:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc5db9800/0x2f180c4effbacdd7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.371687:0:23940:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc5db9800/0x2f180c4effbacdd7 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.371700:0:23940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc5db9800/0x2f180c4effbacdd7 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23940 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166981.371781:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+19:2416:x1847765450715648:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 4843us (5061us total) trans 0 rc 262144/262144 00000100:00100000:2.0:1762166981.371790:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2725 00000100:00100000:1.0:1762166981.380046:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.380111:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450715904 00000100:00100000:2.0:1762166981.380124:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450715904 00000100:00100000:2.0:1762166981.380201:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 902 00000100:00100000:2.0:1762166981.380213:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+531:61882:x1847765450715904:12345-192.168.204.38@tcp:103:lfs.0 00010000:00010000:2.0:1762166981.380228:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166981.380259:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63400/0x2f180c4effbacdc2 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea962 expref: 531 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.380278:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166981.380284:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166981.380362:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+530:61882:x1847765450715904:12345-192.168.204.38@tcp:103:lfs.0 Request processed in 151us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166981.380373:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 902 00000100:00100000:0.0:1762166981.381545:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.381590:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450716160 00000100:00100000:2.0:1762166981.381596:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450716160 00000100:00100000:2.0:1762166981.381635:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11979 00000100:00100000:2.0:1762166981.381643:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb385880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+530:61882:x1847765450716160:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:2.0:1762166981.381862:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb385880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+531:61882:x1847765450716160:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 220us (319us total) trans 4294992508 rc 0/0 00000100:00100000:2.0:1762166981.381873:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11979 00000100:00100000:1.0:1762166981.384213:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166981.384279:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450716416 00000100:00100000:3.0:1762166981.384290:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450716416 00000100:00100000:3.0:1762166981.384362:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30862 00000100:00100000:3.0:1762166981.384374:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+531:61766:x1847765450716416:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:3.0:1762166981.384401:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166981.384427:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62e00/0x2f180c4effbacdde lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea969 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.384735:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9800/0x2f180c4effbacde5 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166981.384759:0:30829:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effbacd9f lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea954 expref: 532 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.384768:0:30829:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9800/0x2f180c4effbacde5 lrc: 4/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.384852:0:30829:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effbacd9f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea954 expref: 532 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.384869:0:30829:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effbacd9f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea954 expref: 532 pid: 30829 timeout: 700 lvb_type: 0 00000100:00100000:2.0:1762166981.384883:0:30829:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783f800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:30829:1847765449790720:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166981.384994:0:30829:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc56bf0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166981.386624:0:30829:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783f800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:30829:1847765449790720:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166981.386658:0:30829:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9800/0x2f180c4effbacde5 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000100:00100000:1.0:1762166981.386933:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.387050:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450716544 00000100:00100000:2.0:1762166981.387064:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450716544 00010000:00010000:2.0:1762166981.387098:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effbacd9f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea954 expref: 533 pid: 30829 timeout: 700 lvb_type: 0 00000100:00100000:2.0:1762166981.387144:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9814 00000100:00100000:2.0:1762166981.387153:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+533:2419:x1847765450716544:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166981.387168:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166981.387174:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effbacd9f lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea954 expref: 533 pid: 30829 timeout: 700 lvb_type: 0 00010000:00010000:2.0:1762166981.387189:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effbacd9f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea954 expref: 533 pid: 30829 timeout: 700 lvb_type: 0 00010000:00010000:2.0:1762166981.387209:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effbacd9f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea954 expref: 533 pid: 30829 timeout: 700 lvb_type: 0 00010000:00010000:2.0:1762166981.387225:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166981.387230:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9800/0x2f180c4effbacde5 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.387238:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9800/0x2f180c4effbacde5 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.387245:0:6479:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9800/0x2f180c4effbacde5 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.387276:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166981.387321:0:30829:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9800/0x2f180c4effbacde5 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000100:00100000:2.0:1762166981.387336:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+532:2419:x1847765450716544:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 178us (398us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166981.387338:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9800/0x2f180c4effbacde5 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000100:00100000:2.0:1762166981.387364:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9814 00000004:00200000:3.0:1762166981.387382:0:30829:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 262144 00010000:00010000:3.0:1762166981.387652:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62e00/0x2f180c4effbacdde lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea969 expref: 533 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.387674:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9800/0x2f180c4effbacde5 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea969 expref: 532 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.387687:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:3.0:1762166981.387690:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1762166981.387693:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc5db9800, rc 0) 00000100:00100000:2.0:1762166981.387838:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+532:61766:x1847765450716416:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 3465us (3631us total) trans 4294992509 rc 0/0 00000100:00100000:2.0:1762166981.387847:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30862 00000100:00100000:1.0:1762166981.389591:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.389703:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450716672 00000100:00100000:2.0:1762166981.389715:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450716672 00000100:00100000:2.0:1762166981.389772:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30863 00000100:00100000:2.0:1762166981.389781:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+532:61766:x1847765450716672:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:2.0:1762166981.389816:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166981.389835:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbacdf3 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea970 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.389947:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8400/0x2f180c4effbacdfa lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166981.389962:0:30829:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9800/0x2f180c4effbacde5 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea969 expref: 533 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.389971:0:30829:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8400/0x2f180c4effbacdfa lrc: 4/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.390005:0:30829:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9800/0x2f180c4effbacde5 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea969 expref: 533 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.390019:0:30829:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9800/0x2f180c4effbacde5 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea969 expref: 533 pid: 30829 timeout: 700 lvb_type: 0 00000100:00100000:2.0:1762166981.390034:0:30829:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783f800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:30829:1847765449790848:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166981.390123:0:30829:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc56bf0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166981.391305:0:30829:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783f800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:30829:1847765449790848:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166981.391325:0:30829:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8400/0x2f180c4effbacdfa lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000100:00100000:1.0:1762166981.391669:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.391731:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450716800 00000100:00100000:2.0:1762166981.391746:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450716800 00010000:00010000:2.0:1762166981.391786:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9800/0x2f180c4effbacde5 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea969 expref: 534 pid: 30829 timeout: 700 lvb_type: 0 00000100:00100000:2.0:1762166981.391839:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9815 00000100:00100000:2.0:1762166981.391850:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+534:2418:x1847765450716800:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166981.391866:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166981.391874:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9800/0x2f180c4effbacde5 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea969 expref: 534 pid: 30829 timeout: 700 lvb_type: 0 00010000:00010000:2.0:1762166981.391889:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9800/0x2f180c4effbacde5 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea969 expref: 534 pid: 30829 timeout: 700 lvb_type: 0 00010000:00010000:2.0:1762166981.391915:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9800/0x2f180c4effbacde5 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea969 expref: 534 pid: 30829 timeout: 700 lvb_type: 0 00010000:00010000:2.0:1762166981.391936:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166981.391941:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8400/0x2f180c4effbacdfa lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.391952:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8400/0x2f180c4effbacdfa lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.391960:0:6479:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8400/0x2f180c4effbacdfa lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.391998:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166981.392049:0:30829:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8400/0x2f180c4effbacdfa lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000100:00100000:2.0:1762166981.392059:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+533:2418:x1847765450716800:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 208us (393us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166981.392061:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8400/0x2f180c4effbacdfa lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000100:00100000:2.0:1762166981.392074:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9815 00000004:00200000:0.0:1762166981.392124:0:30829:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 262144 00000004:00200000:0.0:1762166981.392131:0:30829:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166981.392156:0:30829:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8400/0x2f180c4effbacdfa lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.392188:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbacdf3 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea970 expref: 533 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.392203:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8400/0x2f180c4effbacdfa lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea970 expref: 532 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.392211:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:0.0:1762166981.392214:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166981.392217:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc5db8400, rc 0) 00000100:00100000:0.0:1762166981.392256:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+532:61766:x1847765450716672:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 2476us (2673us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166981.392263:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30863 00000100:00100000:1.0:1762166981.393891:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166981.393966:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450716928 00000100:00100000:0.0:1762166981.393977:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450716928 00000100:00100000:0.0:1762166981.394038:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19440 00000100:00100000:0.0:1762166981.394052:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450716928:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:0.0:1762166981.394072:0:35247:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166981.394095:0:35247:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbace01 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea977 expref: -99 pid: 35247 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166981.394127:0:35247:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa90:0x0] initial LVB size: 262144, mtime: 0x690888c5, atime: 0x690888c4, ctime: 0x690888c5, blocks: 0x88 00010000:00010000:0.0:1762166981.394147:0:35247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166981.394150:0:35247:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166981.394159:0:35247:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbace01 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea977 expref: 20 pid: 35247 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166981.394176:0:35247:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbace01 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea977 expref: 20 pid: 35247 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166981.394188:0:35247:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdfc00, rc 0) 00000100:00100000:0.0:1762166981.394246:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450716928:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 199us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166981.394253:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19440 00000100:00100000:1.0:1762166981.395788:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166981.395886:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450717184 00000100:00100000:3.0:1762166981.395907:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450717184 00000100:00100000:3.0:1762166981.395970:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11980 00000100:00100000:3.0:1762166981.395981:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff2fc450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+532:61766:x1847765450717184:12345-192.168.204.38@tcp:35:fsx.0 00000100:00100000:3.0:1762166981.396230:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff2fc450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+533:61766:x1847765450717184:12345-192.168.204.38@tcp:35:fsx.0 Request processed in 250us (448us total) trans 4294992510 rc 0/0 00000100:00100000:3.0:1762166981.396239:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11980 00000100:00100000:1.0:1762166981.397399:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166981.397464:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450717440 00000100:00100000:0.0:1762166981.397475:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450717440 00000100:00100000:0.0:1762166981.397550:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30864 00000100:00100000:0.0:1762166981.397558:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+533:61766:x1847765450717440:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:0.0:1762166981.397576:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166981.397579:0:30829:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 1 00010000:00010000:0.0:1762166981.397606:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62000/0x2f180c4effbacdad lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea95b expref: 533 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.397625:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63000/0x2f180c4effbacd83 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea94d expref: 532 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.397638:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8400/0x2f180c4effbacdfa lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea970 expref: 531 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.397650:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:0.0:1762166981.397655:0:30829:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166981.397673:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbace08 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea97e expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.397726:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbace0f lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:0.0:1762166981.397737:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbace0f lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.397745:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbace0f lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000040:00080000:0.0:1762166981.397995:0:30829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5959, 88 off467032 00000004:00080000:0.0:1762166981.398002:0:30829:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 600546523566ns, next at 600144491692ns, rc = 0 00000040:00080000:0.0:1762166981.398040:0:30829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5958, 88 off467032 00000004:00080000:0.0:1762166981.398045:0:30829:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 600546567407ns, next at 600144525370ns, rc = 0 00000040:00080000:0.0:1762166981.398075:0:30829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5959, 88 off467120 00000004:00080000:0.0:1762166981.398081:0:30829:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 600546603356ns, next at 600144525370ns, rc = 0 00000040:00080000:0.0:1762166981.398102:0:30829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5960, 88 off467120 00000004:00080000:0.0:1762166981.398108:0:30829:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 600546629926ns, next at 600144491692ns, rc = 0 00000040:00080000:0.0:1762166981.398135:0:30829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5961, 88 off467208 00000004:00080000:0.0:1762166981.398141:0:30829:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 600546663151ns, next at 600144491692ns, rc = 0 00000040:00080000:0.0:1762166981.398164:0:30829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5960, 88 off467208 00000004:00080000:0.0:1762166981.398169:0:30829:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 600546690887ns, next at 600144525370ns, rc = 0 00000001:00080000:3.0:1762166981.399388:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294992511 is committed 00000004:00080000:3.0:1762166981.399398:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3320 committed 00000004:00080000:3.0:1762166981.399412:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3317 committed 00000004:00080000:3.0:1762166981.399428:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3316 committed 00000004:00080000:3.0:1762166981.399430:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3319 committed 00000004:00080000:3.0:1762166981.399432:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3318 committed 00000004:00080000:3.0:1762166981.399434:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3315 committed 00010000:00010000:2.0:1762166981.399605:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbace0f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea97e expref: 526 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.399624:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166981.399628:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000100:00100000:1.0:1762166981.399632:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4bd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449791104:0@lo:2:osp-syn-0-1.0 00010000:00010000:2.0:1762166981.399655:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbace08 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea97e expref: 526 pid: 30829 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1762166981.399681:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbace0f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea97e expref: 525 pid: 30829 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166981.399709:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1762166981.399711:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166981.399719:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1762166981.399723:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bde800, rc 0) 00000100:00100000:0.0:1762166981.399738:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449791104 00000100:00100000:0.0:1762166981.399745:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449791104 00000100:00100000:1.0:1762166981.399784:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcb385880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449791616:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1762166981.399817:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+525:61766:x1847765450717440:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 2242us (2406us total) trans 4294992511 rc 0/0 00000100:00100000:0.0:1762166981.399818:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19441 00000100:00100000:1.0:1762166981.399837:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166981.399838:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4bd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+34:3634:x1847765449791104:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1762166981.399847:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30864 00000100:00100000:1.0:1762166981.399875:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1762166981.399886:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449790976:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1762166981.399913:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166981.399934:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcb387b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449791360:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1762166981.399946:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcb386d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449791488:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1762166981.399993:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:0.0:1762166981.400005:0:35247:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166981.400011:0:35247:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00010000:0.0:1762166981.400014:0:35247:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166981 -> 1762166981 00002000:00010000:0.0:1762166981.400018:0:35247:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00000100:00100000:2.0:1762166981.400020:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4bd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449791232:0@lo:2:osp-syn-0-1.0 00002000:00010000:0.0:1762166981.400024:0:35247:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00000100:00100000:1.0:1762166981.400053:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449791616 00000100:00100000:1.0:1762166981.400059:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449791616 00000100:00100000:3.0:1762166981.400072:0:35248:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449790976 00000100:00100000:3.0:1762166981.400080:0:35248:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449790976 00000100:00100000:2.0:1762166981.400091:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166981.400104:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4bd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+36:3634:x1847765449791104:12345-0@lo:2:osp-syn-0-1.0 Request processed in 269us (394us total) trans 21474843469 rc 0/0 00000100:00100000:1.0:1762166981.400113:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449791488 00000100:00100000:0.0:1762166981.400118:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19441 00000100:00100000:1.0:1762166981.400121:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449791488 00000100:00100000:3.0:1762166981.400136:0:35248:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449791232 00000100:00100000:3.0:1762166981.400142:0:35248:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449791232 00000100:00100000:0.0:1762166981.400146:0:35247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19442 00000100:00100000:0.0:1762166981.400158:0:35247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4bdaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+9:3634:x1847765449791616:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1762166981.400167:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19443 00000100:00100000:1.0:1762166981.400183:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4bdb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+36:3634:x1847765449790976:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166981.400184:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19444 00000100:00100000:2.0:1762166981.400202:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19445 00000100:00100000:3.0:1762166981.400204:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4bdbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+9:3634:x1847765449791488:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1762166981.400225:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+36:3635:x1847765449791232:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:0.0:1762166981.400241:0:35247:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:0.0:1762166981.400247:0:35247:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00010000:0.0:1762166981.400251:0:35247:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00002000:00010000:0.0:1762166981.400254:0:35247:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00002000:00010000:0.0:1762166981.400258:0:35247:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa90:0x0] updating lvb blocks from disk: 136 -> 136 00002000:00010000:1.0:1762166981.400269:0:28434:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166981.400274:0:28434:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb mtime from disk: 1762166966 -> 1762166966 00002000:00010000:1.0:1762166981.400277:0:28434:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1762166981.400280:0:28434:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb ctime from disk: 1762166966 -> 1762166966 00002000:00010000:1.0:1762166981.400283:0:28434:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:3.0:1762166981.400284:0:35248:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166981.400290:0:35248:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00010000:3.0:1762166981.400292:0:35248:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166981 -> 1762166981 00002000:00010000:3.0:1762166981.400298:0:35248:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00000100:00100000:0.0:1762166981.400299:0:35247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4bdaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+11:3634:x1847765449791616:12345-0@lo:2:osp-syn-1-1.0 Request processed in 142us (466us total) trans 17179876723 rc 0/0 00002000:00010000:3.0:1762166981.400303:0:35248:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1762166981.400312:0:35247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19442 00000100:00100000:1.0:1762166981.400326:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4bdb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+37:3634:x1847765449790976:12345-0@lo:2:osp-syn-0-1.0 Request processed in 148us (411us total) trans 21474843470 rc 0/0 00000100:00100000:1.0:1762166981.400336:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19443 00000100:00100000:3.0:1762166981.400350:0:35248:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4bdbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+10:3634:x1847765449791488:12345-0@lo:2:osp-syn-1-1.0 Request processed in 152us (355us total) trans 17179876724 rc 0/0 00000100:00100000:3.0:1762166981.400360:0:35248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19444 00000100:00100000:0.0:1762166981.400390:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:2.0:1762166981.400392:0:9165:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166981.400398:0:9165:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00010000:2.0:1762166981.400403:0:9165:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb atime from disk: 1762166980 -> 1762166980 00002000:00010000:2.0:1762166981.400406:0:9165:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00002000:00010000:2.0:1762166981.400409:0:9165:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa91:0x0] updating lvb blocks from disk: 0 -> 0 00000004:00080000:1.0:1762166981.400438:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc406ce00/2, rc 0, transno 21474843470 00000100:00100000:3.0:1762166981.400439:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449791360 00000100:00100000:3.0:1762166981.400446:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449791360 00000100:00100000:1.0:1762166981.400450:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449790976:0@lo:2:osp-syn-0-1.0 00000004:00080000:1.0:1762166981.400473:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bcb386d80/2, rc 0, transno 17179876724 00000100:00100000:1.0:1762166981.400511:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcb386d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449791488:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166981.400518:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19446 00000004:00080000:1.0:1762166981.400527:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bcb385880/2, rc 0, transno 17179876723 00000100:00100000:3.0:1762166981.400532:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+10:3636:x1847765449791360:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1762166981.400541:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+37:3635:x1847765449791232:12345-0@lo:2:osp-syn-0-1.0 Request processed in 317us (448us total) trans 21474843471 rc 0/0 00000100:00100000:1.0:1762166981.400541:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcb385880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449791616:0@lo:2:osp-syn-1-1.0 00000004:00080000:1.0:1762166981.400566:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc4bd8380/2, rc 0, transno 21474843469 00000100:00100000:2.0:1762166981.400567:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19445 00000100:00100000:1.0:1762166981.400582:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4bd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449791104:0@lo:2:osp-syn-0-1.0 00002000:00010000:3.0:1762166981.400637:0:8383:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:3.0:1762166981.400643:0:8383:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00010000:3.0:1762166981.400646:0:8383:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166981 -> 1762166981 00002000:00010000:3.0:1762166981.400650:0:8383:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00002000:00010000:3.0:1762166981.400653:0:8383:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 200 -> 200 00000004:00080000:2.0:1762166981.400672:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc4bd8700/2, rc 0, transno 21474843471 00000100:00100000:2.0:1762166981.400680:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4bd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449791232:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166981.400710:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+11:3636:x1847765449791360:12345-0@lo:2:osp-syn-1-1.0 Request processed in 180us (319us total) trans 17179876725 rc 0/0 00000100:00100000:3.0:1762166981.400719:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19446 00000004:00080000:0.0:1762166981.400827:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bcb387b80/2, rc 0, transno 17179876725 00000100:00100000:0.0:1762166981.400834:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcb387b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449791360:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1762166981.402597:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.402666:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450717568 00000100:00100000:2.0:1762166981.402676:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450717568 00000100:00100000:2.0:1762166981.402728:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19447 00000100:00100000:2.0:1762166981.402739:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4bdad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:61766:x1847765450717568:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:2.0:1762166981.402753:0:8383:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166981.402770:0:8383:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc5db9800/0x2f180c4effbace16 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea985 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.402797:0:8383:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945cc355a600/0x2f180c4effbacd1a lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea923 expref: 21 pid: 35248 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166981.402817:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166981.402819:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166981.402824:0:8383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc5db9800/0x2f180c4effbace16 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [241664->262143] (req 241664->262143) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea985 expref: 21 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.402857:0:8383:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945cc355a600/0x2f180c4effbacd1a lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea923 expref: 21 pid: 35248 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166981.402871:0:8383:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945cc355a600/0x2f180c4effbacd1a lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea923 expref: 21 pid: 35248 timeout: 700 lvb_type: 1 00000100:00100000:2.0:1762166981.402884:0:8383:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4013100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8383:1847765449791744:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166981.402975:0:8383:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc56bf0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166981.404435:0:8383:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4013100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8383:1847765449791744:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166981.404458:0:8383:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc5db9800/0x2f180c4effbace16 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [241664->262143] (req 241664->262143) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea985 expref: 21 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.404472:0:8383:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc5db9800, rc 0) 00000100:00100000:2.0:1762166981.404549:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4bdad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:61766:x1847765450717568:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 1811us (1958us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166981.404557:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19447 00000100:00100000:3.0:1762166981.404682:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.404734:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450717696 00000100:00100000:2.0:1762166981.404741:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450717696 00010000:00010000:2.0:1762166981.404768:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355a600/0x2f180c4effbacd1a lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea923 expref: 21 pid: 35248 timeout: 700 lvb_type: 1 00000100:00100000:2.0:1762166981.404798:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9816 00000100:00100000:2.0:1762166981.404819:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450717696:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166981.404831:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166981.404847:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945cc355a600/0x2f180c4effbacd1a lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea923 expref: 21 pid: 35248 timeout: 700 lvb_type: 1 00010000:00010000:2.0:1762166981.404859:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945cc355a600/0x2f180c4effbacd1a lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea923 expref: 21 pid: 35248 timeout: 700 lvb_type: 1 00010000:00010000:2.0:1762166981.404877:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cc355a600/0x2f180c4effbacd1a lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea923 expref: 21 pid: 35248 timeout: 700 lvb_type: 1 00010000:00010000:2.0:1762166981.404893:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166981.404895:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166981.404901:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc5db9800/0x2f180c4effbace16 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 241664->262143) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea985 expref: 20 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.404910:0:6479:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc5db9800/0x2f180c4effbace16 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 241664->262143) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea985 expref: 20 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.404932:0:6479:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff945bc5db9800/0x2f180c4effbace16 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 241664->262143) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea985 expref: 20 pid: 8383 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166981.404944:0:6479:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4013100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6479:1847765449791872:192.168.204.38@tcp:105: 00000100:00100000:2.0:1762166981.404988:0:6479:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc56bf0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166981.406076:0:6479:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4013100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6479:1847765449791872:192.168.204.38@tcp:105: 00010000:00010000:2.0:1762166981.406098:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166981.406150:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450717696:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1344us (1478us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166981.406160:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9816 00000100:00100000:3.0:1762166981.406193:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.406251:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450717824 00000100:00100000:2.0:1762166981.406257:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450717824 00000100:00100000:2.0:1762166981.406310:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2726 00000100:00100000:2.0:1762166981.406319:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450717824:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:2.0:1762166981.406727:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:2.0:1762166981.406732:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00010000:2.0:1762166981.406735:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166981 -> 1762166981 00002000:00010000:2.0:1762166981.406738:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00002000:00010000:2.0:1762166981.406741:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 200 -> 200 00000100:00100000:2.0:1762166981.406778:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450717824:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 460us (587us total) trans 17179876726 rc 0/0 00000100:00100000:2.0:1762166981.406786:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2726 00000100:00100000:0.0:1762166981.407848:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.407894:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450717952 00000100:00100000:2.0:1762166981.407901:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450717952 00000100:00100000:2.0:1762166981.407940:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30865 00000100:00100000:2.0:1762166981.407945:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+525:61766:x1847765450717952:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:2.0:1762166981.407966:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166981.407982:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbace1d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea98c expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.408066:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbace24 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166981.408078:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbace24 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.408087:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbace24 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000004:00200000:2.0:1762166981.408110:0:30829:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 262144 00000004:00200000:2.0:1762166981.408114:0:30829:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166981.408129:0:30829:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbace24 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.408150:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbace1d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea98c expref: 527 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.408162:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbace24 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea98c expref: 526 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.408169:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166981.408172:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166981.408174:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc5db9c00, rc 0) 00000100:00100000:2.0:1762166981.408209:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+526:61766:x1847765450717952:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 262us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166981.408213:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30865 00000100:00100000:1.0:1762166981.410359:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.410422:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450718080 00000100:00100000:2.0:1762166981.410431:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450718080 00002000:00100000:2.0:1762166981.410516:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (16384->73727) req@ffff945bc4bdb100 x1847765450718080/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:12/0 lens 488/0 e 0 to 0 dl 1762166992 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166981.410530:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4bdb100 with x1847765450718080 ext(16384->73727) 00002000:00010000:2.0:1762166981.410536:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4bdb100 00000100:00100000:2.0:1762166981.410566:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2727 00000100:00100000:2.0:1762166981.410587:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4bdb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450718080:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:2.0:1762166981.411879:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4bdb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450718080:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 1302us (1525us total) trans 0 rc 57344/57344 00000100:00100000:2.0:1762166981.411886:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2727 00002000:00100000:2.0:1762166981.411893:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (16384->73727) req@ffff945bc4bdb100 x1847765450718080/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:12/0 lens 488/440 e 0 to 0 dl 1762166992 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166981.411900:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4bdb100 with x1847765450718080 ext(16384->73727) 00002000:00010000:2.0:1762166981.411904:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4bdb100 00000100:00100000:0.0:1762166981.414189:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.414238:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450718208 00000100:00100000:2.0:1762166981.414248:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450718208 00002000:00100000:2.0:1762166981.414303:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (139264->143359) req@ffff945bc7d20e00 x1847765450718208/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:12/0 lens 488/0 e 0 to 0 dl 1762166992 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166981.414315:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc7d20e00 with x1847765450718208 ext(139264->143359) 00002000:00010000:2.0:1762166981.414322:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc7d20e00 00000100:00100000:2.0:1762166981.414349:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2728 00000100:00100000:2.0:1762166981.414358:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450718208:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:2.0:1762166981.414559:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450718208:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 203us (380us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1762166981.414566:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2728 00002000:00100000:2.0:1762166981.414572:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (139264->143359) req@ffff945bc7d20e00 x1847765450718208/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:12/0 lens 488/4536 e 0 to 0 dl 1762166992 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166981.414578:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc7d20e00 with x1847765450718208 ext(139264->143359) 00002000:00010000:2.0:1762166981.414580:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc7d20e00 00000100:00100000:1.0:1762166981.416106:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.416167:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450718336 00000100:00100000:2.0:1762166981.416174:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450718336 00002000:00100000:2.0:1762166981.416205:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (143360->147455) req@ffff945bc4bd8a80 x1847765450718336/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:12/0 lens 488/0 e 0 to 0 dl 1762166992 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166981.416216:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4bd8a80 with x1847765450718336 ext(143360->147455) 00002000:00010000:2.0:1762166981.416221:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4bd8a80 00000100:00100000:2.0:1762166981.416248:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2729 00000100:00100000:2.0:1762166981.416256:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4bd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450718336:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:2.0:1762166981.416385:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4bd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450718336:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 128us (283us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1762166981.416393:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2729 00002000:00100000:2.0:1762166981.416401:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (143360->147455) req@ffff945bc4bd8a80 x1847765450718336/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:12/0 lens 488/4536 e 0 to 0 dl 1762166992 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166981.416410:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4bd8a80 with x1847765450718336 ext(143360->147455) 00002000:00010000:2.0:1762166981.416413:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4bd8a80 00000100:00100000:3.0:1762166981.417884:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.417988:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450718464 00000100:00100000:2.0:1762166981.418017:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450718464 00002000:00100000:2.0:1762166981.418083:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (118784->184319) req@ffff945bc55ddc00 x1847765450718464/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:12/0 lens 504/0 e 0 to 0 dl 1762166992 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166981.418095:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc55ddc00 with x1847765450718464 ext(118784->184319) 00002000:00010000:2.0:1762166981.418101:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc55ddc00 00000100:00100000:2.0:1762166981.418147:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2730 00000100:00100000:2.0:1762166981.418158:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450718464:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:2.0:1762166981.419292:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450718464:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 1131us (1411us total) trans 0 rc 57344/57344 00000100:00100000:2.0:1762166981.419304:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2730 00002000:00100000:2.0:1762166981.419313:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (118784->184319) req@ffff945bc55ddc00 x1847765450718464/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:12/0 lens 504/440 e 0 to 0 dl 1762166992 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166981.419320:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc55ddc00 with x1847765450718464 ext(118784->184319) 00002000:00010000:2.0:1762166981.419325:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc55ddc00 00000100:00100000:3.0:1762166981.421647:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.421708:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450718592 00000100:00100000:2.0:1762166981.421716:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450718592 00002000:00100000:2.0:1762166981.421771:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (139264->176127) req@ffff945bc55dfb80 x1847765450718592/t0(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:12/0 lens 488/0 e 0 to 0 dl 1762166992 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166981.421779:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc55dfb80 with x1847765450718592 ext(139264->176127) 00002000:00010000:2.0:1762166981.421783:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc55dfb80 00000100:00100000:2.0:1762166981.421825:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2731 00000100:00100000:2.0:1762166981.421837:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450718592:12345-192.168.204.38@tcp:4:fsx.0 00000100:00100000:2.0:1762166981.423443:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765450718592:12345-192.168.204.38@tcp:4:fsx.0 Request processed in 1601us (1798us total) trans 17179876727 rc 0/0 00000100:00100000:2.0:1762166981.423455:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2731 00002000:00100000:2.0:1762166981.423464:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (139264->176127) req@ffff945bc55dfb80 x1847765450718592/t17179876727(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:12/0 lens 488/448 e 0 to 0 dl 1762166992 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166981.423474:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc55dfb80 with x1847765450718592 ext(139264->176127) 00002000:00010000:2.0:1762166981.423518:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc55dfb80 00000100:00100000:0.0:1762166981.424688:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.424745:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450718720 00000100:00100000:2.0:1762166981.424754:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450718720 00000100:00100000:2.0:1762166981.424815:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19448 00000100:00100000:2.0:1762166981.424825:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765450718720:12345-192.168.204.38@tcp:16:fsx.0 00000001:00080000:3.0:1762166981.426109:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876727 is committed 00000001:00080000:3.0:1762166981.426126:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876725 is committed 00000100:00100000:2.0:1762166981.426274:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450718720:12345-192.168.204.38@tcp:16:fsx.0 Request processed in 1447us (1587us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166981.426284:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19448 00000100:00100000:3.0:1762166981.429090:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.429143:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450718848 00000100:00100000:2.0:1762166981.429153:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450718848 00002000:00100000:2.0:1762166981.429201:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (131072->139263) req@ffff945bc55df480 x1847765450718848/t0(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:12/0 lens 8680/0 e 0 to 0 dl 1762166992 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166981.429211:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc55df480 with x1847765450718848 ext(131072->139263) 00002000:00010000:2.0:1762166981.429218:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc55df480 00000100:00100000:2.0:1762166981.429253:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2732 00000100:00100000:2.0:1762166981.429265:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450718848:12345-192.168.204.38@tcp:4:fsx.0 00000100:00100000:2.0:1762166981.429964:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450718848:12345-192.168.204.38@tcp:4:fsx.0 Request processed in 699us (882us total) trans 17179876728 rc 0/0 00000100:00100000:2.0:1762166981.429973:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2732 00002000:00100000:2.0:1762166981.429982:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (131072->139263) req@ffff945bc55df480 x1847765450718848/t17179876728(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:12/0 lens 8680/448 e 0 to 0 dl 1762166992 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166981.429992:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc55df480 with x1847765450718848 ext(131072->139263) 00002000:00010000:2.0:1762166981.429996:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc55df480 00000100:00100000:3.0:1762166981.430859:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.430901:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450718976 00000100:00100000:2.0:1762166981.430906:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450718976 00000100:00100000:2.0:1762166981.430945:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19449 00000100:00100000:2.0:1762166981.430954:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450718976:12345-192.168.204.38@tcp:16:fsx.0 00000001:00080000:3.0:1762166981.431693:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876728 is committed 00000100:00100000:2.0:1762166981.431767:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450718976:12345-192.168.204.38@tcp:16:fsx.0 Request processed in 813us (909us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166981.431773:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19449 00000100:00100000:0.0:1762166981.433417:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.433467:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450719104 00000100:00100000:2.0:1762166981.433474:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450719104 00000100:00100000:2.0:1762166981.433589:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2733 00000100:00100000:2.0:1762166981.433600:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450719104:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:2.0:1762166981.433922:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:2.0:1762166981.433926:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00010000:2.0:1762166981.433929:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166981 -> 1762166981 00002000:00010000:2.0:1762166981.433931:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00002000:00010000:2.0:1762166981.433934:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 200 -> 280 00000100:00100000:2.0:1762166981.433982:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450719104:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 384us (570us total) trans 17179876729 rc 0/0 00000100:00100000:2.0:1762166981.433994:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2733 00000100:00100000:2.0:1762166981.435729:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166981.435800:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450719360 00000100:00100000:0.0:1762166981.435819:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450719360 00000100:00100000:0.0:1762166981.435878:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30866 00000100:00100000:0.0:1762166981.435889:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4013100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+526:61766:x1847765450719360:12345-192.168.204.38@tcp:36:fsx.0 00010000:00010000:0.0:1762166981.435971:0:30829:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1762166981.436002:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbace0f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea97e expref: 526 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.436018:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbace24 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea98c expref: 525 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.436028:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:0.0:1762166981.436031:0:30829:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166981.436210:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbace2b lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:0.0:1762166981.436224:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbace2b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.436235:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbace2b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000001:00080000:0.0:1762166981.436286:0:30829:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992512 00000004:00010000:0.0:1762166981.436306:0:30829:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000098833d4c reply state 00000000c3a514dd transno 4294992513 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbace2b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.436316:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbace2b lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.436320:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:0.0:1762166981.436323:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762166981.436325:0:30829:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166981.436397:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4013100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+527:61766:x1847765450719360:12345-192.168.204.38@tcp:36:fsx.0 Request processed in 511us (675us total) trans 4294992513 rc 0/0 00000100:00100000:0.0:1762166981.436402:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30866 00000020:00080000:0.0:1762166981.436406:0:30829:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1762166981.437303:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166981.437359:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450719488 00000100:00100000:0.0:1762166981.437367:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450719488 00000100:00100000:0.0:1762166981.437410:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30867 00000100:00100000:0.0:1762166981.437419:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+527:61766:x1847765450719488:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:0.0:1762166981.437437:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166981.437449:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbace32 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea993 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.437510:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbace32 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea993 expref: 528 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.437523:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbace32 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea993 expref: 528 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.437540:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:0.0:1762166981.437543:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166981.437546:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bde200, rc 0) 00000100:00100000:0.0:1762166981.437595:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+528:61766:x1847765450719488:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 174us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166981.437603:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30867 00000100:00100000:1.0:1762166981.438531:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.438560:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450719616 00000100:00100000:2.0:1762166981.438566:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450719616 00000100:00100000:2.0:1762166981.438617:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19450 00000100:00100000:2.0:1762166981.438626:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4bd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+33:61766:x1847765450719616:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:2.0:1762166981.438639:0:8383:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166981.438653:0:8383:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc5db8200/0x2f180c4effbace39 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea99a expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.438677:0:8383:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4b62600/0x2f180c4effbacd21 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea92a expref: 34 pid: 8382 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166981.438686:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166981.438689:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166981.438693:0:8383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc5db8200/0x2f180c4effbace39 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea99a expref: 34 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.438725:0:8383:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc4b62600/0x2f180c4effbacd21 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea92a expref: 34 pid: 8382 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166981.438736:0:8383:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc4b62600/0x2f180c4effbacd21 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea92a expref: 34 pid: 8382 timeout: 700 lvb_type: 1 00000100:00100000:2.0:1762166981.438748:0:8383:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4012680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8383:1847765449792000:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166981.438840:0:8383:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc56bf840 going to sleep for 11 seconds 00000100:00100000:3.0:1762166981.439681:0:8383:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4012680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8383:1847765449792000:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166981.439708:0:8383:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc5db8200/0x2f180c4effbace39 lrc: 3/0,0 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea99a expref: 34 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.439814:0:8383:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc5db8200, rc 0) 00000100:00100000:3.0:1762166981.439892:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4bd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+34:61766:x1847765450719616:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 1229us (1324us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166981.439905:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166981.439910:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19450 00000100:00100000:2.0:1762166981.439958:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450719744 00000100:00100000:2.0:1762166981.439964:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450719744 00010000:00010000:2.0:1762166981.440003:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4b62600/0x2f180c4effbacd21 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea92a expref: 34 pid: 8382 timeout: 700 lvb_type: 1 00000100:00100000:2.0:1762166981.440039:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9817 00000100:00100000:2.0:1762166981.440048:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cceb49850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+34:2418:x1847765450719744:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166981.440059:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166981.440080:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc4b62600/0x2f180c4effbacd21 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea92a expref: 34 pid: 8382 timeout: 700 lvb_type: 1 00010000:00010000:2.0:1762166981.440091:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc4b62600/0x2f180c4effbacd21 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea92a expref: 34 pid: 8382 timeout: 700 lvb_type: 1 00010000:00010000:2.0:1762166981.440115:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4b62600/0x2f180c4effbacd21 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea92a expref: 34 pid: 8382 timeout: 700 lvb_type: 1 00010000:00010000:2.0:1762166981.440128:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166981.440131:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166981.440138:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc5db8200/0x2f180c4effbace39 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea99a expref: 33 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.440149:0:6479:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc5db8200/0x2f180c4effbace39 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea99a expref: 33 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.440182:0:6479:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff945bc5db8200/0x2f180c4effbace39 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea99a expref: 33 pid: 8383 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166981.440198:0:6479:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4012680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6479:1847765449792128:192.168.204.38@tcp:105: 00000100:00100000:2.0:1762166981.440246:0:6479:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc56bf0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166981.441117:0:6479:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4012680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6479:1847765449792128:192.168.204.38@tcp:105: 00010000:00010000:2.0:1762166981.441130:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166981.441167:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cceb49850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+33:2418:x1847765450719744:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1120us (1275us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166981.441177:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9817 00000100:00100000:1.0:1762166981.441297:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166981.441378:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450719872 00000100:00100000:3.0:1762166981.441383:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450719872 00000100:00100000:3.0:1762166981.441417:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19451 00000100:00100000:3.0:1762166981.441427:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4bda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+18:61766:x1847765450719872:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:3.0:1762166981.441441:0:8383:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166981.441452:0:8383:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62e00/0x2f180c4effbace40 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea9a1 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.441508:0:8383:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc5db9200/0x2f180c4effbacd28 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea931 expref: 19 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166981.441518:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166981.441520:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166981.441524:0:8383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62e00/0x2f180c4effbace40 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea9a1 expref: 19 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.441544:0:8383:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc5db9200/0x2f180c4effbacd28 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea931 expref: 19 pid: 28874 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166981.441553:0:8383:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc5db9200/0x2f180c4effbacd28 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea931 expref: 19 pid: 28874 timeout: 700 lvb_type: 1 00000100:00100000:3.0:1762166981.441560:0:8383:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55dce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8383:1847765449792256:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166981.441598:0:8383:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d0116ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1762166981.442309:0:8383:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55dce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8383:1847765449792256:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166981.442324:0:8383:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62e00/0x2f180c4effbace40 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea9a1 expref: 19 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.442337:0:8383:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4b62e00, rc 0) 00000100:00100000:3.0:1762166981.442367:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4bda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:61766:x1847765450719872:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 943us (1071us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166981.442372:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19451 00000100:00100000:1.0:1762166981.442497:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.442528:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450720000 00000100:00100000:2.0:1762166981.442533:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450720000 00010000:00010000:2.0:1762166981.442551:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc5db9200/0x2f180c4effbacd28 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea931 expref: 19 pid: 28874 timeout: 700 lvb_type: 1 00000100:00100000:2.0:1762166981.442577:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9818 00000100:00100000:2.0:1762166981.442585:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4bdb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450720000:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166981.442593:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166981.442609:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc5db9200/0x2f180c4effbacd28 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea931 expref: 19 pid: 28874 timeout: 700 lvb_type: 1 00010000:00010000:2.0:1762166981.442617:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc5db9200/0x2f180c4effbacd28 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea931 expref: 19 pid: 28874 timeout: 700 lvb_type: 1 00010000:00010000:2.0:1762166981.442632:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc5db9200/0x2f180c4effbacd28 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea931 expref: 19 pid: 28874 timeout: 700 lvb_type: 1 00010000:00010000:2.0:1762166981.442645:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166981.442647:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166981.442650:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62e00/0x2f180c4effbace40 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea9a1 expref: 18 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.442656:0:6479:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62e00/0x2f180c4effbace40 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea9a1 expref: 18 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.442672:0:6479:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62e00/0x2f180c4effbace40 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea9a1 expref: 18 pid: 8383 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166981.442678:0:6479:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4012680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6479:1847765449792384:192.168.204.38@tcp:105: 00000100:00100000:2.0:1762166981.442710:0:6479:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc56bf840 going to sleep for 11 seconds 00000100:00100000:2.0:1762166981.443611:0:6479:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4012680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6479:1847765449792384:192.168.204.38@tcp:105: 00010000:00010000:2.0:1762166981.443638:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166981.443703:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4bdb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450720000:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1117us (1226us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166981.443713:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9818 00000100:00100000:1.0:1762166981.443867:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166981.443901:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166981.443931:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.443948:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450720128 00000100:00100000:2.0:1762166981.443954:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450720128 00000100:00100000:3.0:1762166981.443977:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450720256 00002000:00010000:2.0:1762166981.443983:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (123442->18446744073709551615) 00000100:00100000:3.0:1762166981.443984:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450720256 00000100:00100000:0.0:1762166981.443988:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450720384 00002000:00100000:2.0:1762166981.443990:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4bd9500 with x1847765450720128 ext(123442->18446744073709551615) 00000100:00100000:0.0:1762166981.443993:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450720384 00002000:00010000:2.0:1762166981.444002:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4bd9500. 00002000:00010000:3.0:1762166981.444004:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:3.0:1762166981.444009:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4bd9880 with x1847765450720256 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166981.444011:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00010000:3.0:1762166981.444014:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc4bd9880. 00002000:00100000:0.0:1762166981.444016:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4a2ad80 with x1847765450720384 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166981.444023:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4a2ad80. 00000100:00100000:2.0:1762166981.444032:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2734 00000100:00100000:3.0:1762166981.444043:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2735 00000100:00100000:2.0:1762166981.444045:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4bd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450720128:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:0.0:1762166981.444059:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2736 00000100:00100000:3.0:1762166981.444060:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4bd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+33:2419:x1847765450720256:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:0.0:1762166981.444070:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450720384:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:0.0:1762166981.444210:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166981.444212:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166981.444216:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00010000:3.0:1762166981.444218:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00010000:0.0:1762166981.444221:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166981 -> 1762166981 00002000:00010000:3.0:1762166981.444223:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166981 -> 1762166981 00002000:00010000:0.0:1762166981.444225:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00002000:00010000:3.0:1762166981.444228:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00002000:00010000:0.0:1762166981.444231:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:3.0:1762166981.444233:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00000100:00100000:3.0:1762166981.444281:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4bd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+34:2419:x1847765450720256:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 227us (375us total) trans 21474843472 rc 0/0 00000100:00100000:0.0:1762166981.444287:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450720384:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 212us (344us total) trans 17179876730 rc 0/0 00000100:00100000:3.0:1762166981.444292:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2735 00002000:00010000:3.0:1762166981.444298:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:3.0:1762166981.444302:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4bd9880 with x1847765450720256 ext(0->18446744073709551615) 00000100:00100000:0.0:1762166981.444306:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2736 00002000:00010000:3.0:1762166981.444309:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc4bd9880. 00002000:00010000:0.0:1762166981.444311:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:0.0:1762166981.444317:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4a2ad80 with x1847765450720384 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166981.444323:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4a2ad80. 00002000:00010000:2.0:1762166981.444399:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 262144 -> 123442 00002000:00010000:2.0:1762166981.444402:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00010000:2.0:1762166981.444405:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166981 -> 1762166981 00002000:00010000:2.0:1762166981.444407:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00002000:00010000:2.0:1762166981.444410:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 280 -> 64 00000100:00100000:2.0:1762166981.444442:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4bd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450720128:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 402us (578us total) trans 17179876731 rc 0/0 00000100:00100000:2.0:1762166981.444450:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2734 00002000:00010000:2.0:1762166981.444454:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (123442->18446744073709551615) 00002000:00100000:2.0:1762166981.444457:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4bd9500 with x1847765450720128 ext(123442->18446744073709551615) 00002000:00010000:2.0:1762166981.444462:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4bd9500. 00000100:00100000:1.0:1762166981.445617:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166981.445660:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450720512 00000100:00100000:0.0:1762166981.445664:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450720512 00000100:00100000:0.0:1762166981.445701:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30868 00000100:00100000:0.0:1762166981.445710:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+528:61766:x1847765450720512:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:0.0:1762166981.445726:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166981.445744:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbace47 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea9a8 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.445857:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbace4e lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:0.0:1762166981.445872:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbace4e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.445885:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbace4e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000004:00200000:0.0:1762166981.445910:0:30829:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 123442 00000004:00200000:0.0:1762166981.445913:0:30829:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166981.445929:0:30829:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbace4e lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.445950:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbace47 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea9a8 expref: 530 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.445964:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbace4e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea9a8 expref: 529 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.445973:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:0.0:1762166981.445976:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166981.445980:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdfe00, rc 0) 00000100:00100000:0.0:1762166981.446021:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+529:61766:x1847765450720512:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 311us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166981.446027:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30868 00000100:00100000:0.0:1762166981.448510:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.448571:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450720640 00000100:00100000:2.0:1762166981.448584:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450720640 00002000:00100000:2.0:1762166981.448647:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (0->118783) req@ffff945ceda2e300 x1847765450720640/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:12/0 lens 504/0 e 0 to 0 dl 1762166992 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166981.448659:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945ceda2e300 with x1847765450720640 ext(0->118783) 00002000:00010000:2.0:1762166981.448665:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945ceda2e300 00000100:00100000:2.0:1762166981.448698:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2737 00000100:00100000:2.0:1762166981.448709:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450720640:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:2.0:1762166981.450278:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450720640:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 1565us (1803us total) trans 0 rc 110592/110592 00000100:00100000:2.0:1762166981.450291:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2737 00002000:00100000:2.0:1762166981.450304:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (0->118783) req@ffff945ceda2e300 x1847765450720640/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:12/0 lens 504/440 e 0 to 0 dl 1762166992 ref 1 fl Complete:/600/0 rc 110592/110592 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166981.450322:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945ceda2e300 with x1847765450720640 ext(0->118783) 00002000:00010000:2.0:1762166981.450327:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945ceda2e300 00000100:00100000:1.0:1762166981.452449:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.452550:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450720768 00000100:00100000:2.0:1762166981.452562:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450720768 00000100:00100000:2.0:1762166981.452627:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2738 00000100:00100000:2.0:1762166981.452639:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450720768:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:2.0:1762166981.452882:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 123442 -> 123442 00002000:00010000:2.0:1762166981.452886:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00010000:2.0:1762166981.452889:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166981 -> 1762166981 00002000:00010000:2.0:1762166981.452892:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00002000:00010000:2.0:1762166981.452894:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 64 -> 120 00000100:00100000:2.0:1762166981.452954:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450720768:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 318us (506us total) trans 17179876732 rc 0/0 00000100:00100000:2.0:1762166981.452962:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2738 00010000:00010000:0.0:1762166981.458627:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166981.459195:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166981.459285:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450721024 00000100:00100000:3.0:1762166981.459297:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450721024 00000100:00100000:3.0:1762166981.459353:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11981 00000100:00100000:3.0:1762166981.459364:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+529:61766:x1847765450721024:12345-192.168.204.38@tcp:35:fsx.0 00000100:00100000:3.0:1762166981.459670:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+530:61766:x1847765450721024:12345-192.168.204.38@tcp:35:fsx.0 Request processed in 307us (480us total) trans 4294992514 rc 0/0 00000100:00100000:3.0:1762166981.459678:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11981 00000100:00100000:1.0:1762166981.469534:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166981.469603:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450721280 00000100:00100000:0.0:1762166981.469613:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450721280 00000100:00100000:0.0:1762166981.469678:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30869 00000100:00100000:0.0:1762166981.469688:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+530:61883:x1847765450721280:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166981.469712:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166981.469736:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbace55 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea9af expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.469825:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbace5c lrc: 3/1,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:0.0:1762166981.469839:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbace5c lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.469850:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbace5c lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.469863:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbace63 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:0.0:1762166981.469869:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbace63 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.469875:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbace63 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.469983:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbace6a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:0.0:1762166981.469992:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbace6a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.470000:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbace6a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000004:00200000:0.0:1762166981.470010:0:30829:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 241040 00010000:00010000:0.0:1762166981.470095:0:30829:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbace5c lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.470101:0:30829:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbace5c lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.470105:0:30829:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbace5c lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.470109:0:30829:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbace5c lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.470113:0:30829:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bde800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166981.470115:0:30829:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbace5c lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.470120:0:30829:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbace5c lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.470128:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:0.0:1762166981.470130:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166981.470132:0:30829:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbace5c lrc: 3/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.470136:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbace5c lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.470145:0:30829:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbace63 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.470149:0:30829:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbace63 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.470152:0:30829:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbace63 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.470155:0:30829:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bde600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166981.470156:0:30829:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbace63 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.470162:0:30829:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbace63 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.470166:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0xdd396665 (ffff945bc4afe300) 00010000:00010000:0.0:1762166981.470167:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166981.470168:0:30829:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbace63 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.470171:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde600/0x2f180c4effbace63 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.470207:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbace55 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea9af expref: 533 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.470222:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbace6a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea9af expref: 532 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.470228:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:0.0:1762166981.470230:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166981.470233:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdf800, rc 0) 00000100:00100000:0.0:1762166981.470295:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+532:61883:x1847765450721280:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 607us (772us total) trans 4294992515 rc 0/0 00000100:00100000:0.0:1762166981.470302:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30869 00000100:00100000:1.0:1762166981.471688:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.471748:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450721408 00000100:00100000:2.0:1762166981.471756:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450721408 00000100:00100000:2.0:1762166981.471817:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 903 00000100:00100000:2.0:1762166981.471830:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+532:2419:x1847765450721408:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166981.471844:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166981.471860:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbace6a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea9af expref: 532 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.471874:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166981.471878:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166981.471925:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+531:2419:x1847765450721408:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 100us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166981.471933:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 903 00000100:00100000:3.0:1762166981.472212:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166981.472323:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450721664 00000100:00100000:1.0:1762166981.472332:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450721664 00000100:00100000:1.0:1762166981.472389:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11982 00000100:00100000:1.0:1762166981.472399:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+531:61883:x1847765450721664:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:1.0:1762166981.472659:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+532:61883:x1847765450721664:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 257us (445us total) trans 4294992516 rc 0/0 00000100:00100000:1.0:1762166981.472668:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11982 00000100:00100000:0.0:1762166981.474098:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.474179:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450721920 00000100:00100000:2.0:1762166981.474186:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450721920 00000100:00100000:2.0:1762166981.474233:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30870 00000100:00100000:2.0:1762166981.474243:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+532:61883:x1847765450721920:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166981.474264:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166981.474285:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9200/0x2f180c4effbace78 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea9b6 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.474386:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9a00/0x2f180c4effbace7f lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166981.474407:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9a00/0x2f180c4effbace7f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.474419:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9a00/0x2f180c4effbace7f lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000004:00200000:2.0:1762166981.474431:0:30829:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 241040 00010000:00010000:2.0:1762166981.474548:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9200/0x2f180c4effbace78 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea9b6 expref: 535 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.474567:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9a00/0x2f180c4effbace7f lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea9b6 expref: 534 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.474576:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166981.474580:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1762166981.474583:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc5db9a00, rc 0) 00000100:00100000:2.0:1762166981.474637:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+534:61883:x1847765450721920:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 396us (542us total) trans 4294992517 rc 0/0 00000100:00100000:2.0:1762166981.474644:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30870 00000100:00100000:3.0:1762166981.476524:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.476567:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450722176 00000100:00100000:2.0:1762166981.476576:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450722176 00000100:00100000:2.0:1762166981.476625:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30871 00000100:00100000:2.0:1762166981.476634:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+534:61883:x1847765450722176:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166981.476656:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166981.476674:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbace8d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea9bd expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.476776:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbace94 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166981.476790:0:30829:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbace4e lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea9a8 expref: 535 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.476799:0:30829:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbace94 lrc: 4/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.476845:0:30829:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbace4e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea9a8 expref: 535 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.476857:0:30829:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbace4e lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea9a8 expref: 535 pid: 30829 timeout: 700 lvb_type: 0 00000100:00100000:2.0:1762166981.476870:0:30829:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4012680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:30829:1847765449792512:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166981.476961:0:30829:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cee17e6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166981.477991:0:30829:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4012680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:30829:1847765449792512:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166981.478013:0:30829:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbace94 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000100:00100000:3.0:1762166981.478095:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166981.478187:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450722304 00000100:00100000:1.0:1762166981.478198:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450722304 00010000:00010000:1.0:1762166981.478238:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbace4e lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea9a8 expref: 536 pid: 30829 timeout: 700 lvb_type: 0 00000100:00100000:1.0:1762166981.478281:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9819 00000100:00100000:1.0:1762166981.478293:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc3550380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+536:2418:x1847765450722304:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166981.478309:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166981.478316:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbace4e lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea9a8 expref: 536 pid: 30829 timeout: 700 lvb_type: 0 00010000:00010000:1.0:1762166981.478339:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbace4e lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea9a8 expref: 536 pid: 30829 timeout: 700 lvb_type: 0 00010000:00010000:1.0:1762166981.478371:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbace4e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea9a8 expref: 536 pid: 30829 timeout: 700 lvb_type: 0 00010000:00010000:1.0:1762166981.478394:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:1.0:1762166981.478400:0:9458:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbace94 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166981.478410:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbace94 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166981.478417:0:9458:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbace94 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166981.478454:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166981.478518:0:30829:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbace94 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.478529:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbace94 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000100:00100000:1.0:1762166981.478546:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc3550380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+535:2418:x1847765450722304:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 254us (450us total) trans 0 rc 0/0 00000004:00200000:2.0:1762166981.478553:0:30829:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 241040 00000100:00100000:1.0:1762166981.478558:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9819 00010000:00010000:2.0:1762166981.478688:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbace8d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea9bd expref: 536 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.478704:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbace94 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea9bd expref: 535 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.478712:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166981.478715:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1762166981.478717:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc5db8e00, rc 0) 00000100:00100000:2.0:1762166981.478751:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+535:61883:x1847765450722176:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2118us (2235us total) trans 4294992518 rc 0/0 00000100:00100000:2.0:1762166981.478758:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30871 00000100:00100000:3.0:1762166981.480094:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.480160:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450722432 00000100:00100000:2.0:1762166981.480167:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450722432 00000100:00100000:2.0:1762166981.480204:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11983 00000100:00100000:2.0:1762166981.480214:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+535:61883:x1847765450722432:12345-192.168.204.38@tcp:33:lfs.0 00000100:00100000:2.0:1762166981.480351:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+535:61883:x1847765450722432:12345-192.168.204.38@tcp:33:lfs.0 Request processed in 139us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166981.480359:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11983 00000100:00100000:3.0:1762166981.481300:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.481586:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450722688 00000100:00100000:2.0:1762166981.481593:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450722688 00000100:00100000:2.0:1762166981.481636:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11984 00000100:00100000:2.0:1762166981.481645:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+535:61883:x1847765450722688:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:2.0:1762166981.481862:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+536:61883:x1847765450722688:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 218us (564us total) trans 4294992519 rc 0/0 00000100:00100000:2.0:1762166981.481869:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11984 00000100:00100000:0.0:1762166981.483320:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.483398:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450722944 00000100:00100000:2.0:1762166981.483406:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450722944 00000100:00100000:2.0:1762166981.483469:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30872 00000100:00100000:2.0:1762166981.483518:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf79e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+536:61883:x1847765450722944:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166981.483543:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166981.483546:0:30829:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:2.0:1762166981.483571:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbace94 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea9bd expref: 536 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.483593:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9a00/0x2f180c4effbace7f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea9b6 expref: 535 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.483605:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166981.483610:0:30829:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166981.483623:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8400/0x2f180c4effbacea2 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea9c4 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.483724:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7c0ec00/0x2f180c4effbacea9 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166981.483737:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7c0ec00/0x2f180c4effbacea9 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.483747:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7c0ec00/0x2f180c4effbacea9 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000004:00200000:2.0:1762166981.483758:0:30829:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 241040 00010000:00010000:2.0:1762166981.483875:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8400/0x2f180c4effbacea2 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea9c4 expref: 537 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.483888:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7c0ec00/0x2f180c4effbacea9 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea9c4 expref: 536 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.483896:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166981.483899:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166981.483901:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc7c0ec00, rc 0) 00000100:00100000:2.0:1762166981.483947:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf79e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+536:61883:x1847765450722944:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 469us (635us total) trans 4294992520 rc 0/0 00000100:00100000:2.0:1762166981.483955:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30872 00000100:00100000:3.0:1762166981.485613:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166981.485669:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450723200 00000100:00100000:1.0:1762166981.485676:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450723200 00000100:00100000:1.0:1762166981.485719:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11985 00000100:00100000:1.0:1762166981.485729:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff2fdc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+536:61883:x1847765450723200:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:1.0:1762166981.485771:0:6497:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x240000404:0x5eb:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7c0ec00/0x2f180c4effbacea9 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea9c4 expref: 536 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.485800:0:6497:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbaceb7 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 00010000:00010000:1.0:1762166981.485823:0:6497:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbac8b3 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea755 expref: 536 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.485836:0:6497:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbace32 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea993 expref: 536 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.485843:0:6497:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbaceb7 lrc: 5/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166981.485872:0:6497:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbace32 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea993 expref: 536 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.485884:0:6497:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbace32 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea993 expref: 536 pid: 30829 timeout: 700 lvb_type: 0 00000100:00100000:1.0:1762166981.485897:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a28000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6497:1847765449792640:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166981.485968:0:6497:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbac8b3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea755 expref: 536 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.485977:0:6497:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbac8b3 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea755 expref: 536 pid: 6494 timeout: 700 lvb_type: 0 00000100:00100000:1.0:1762166981.485986:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a28700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6497:1847765449792768:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166981.486008:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc350f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166981.487308:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a28000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6497:1847765449792640:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166981.487324:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a28700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6497:1847765449792768:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166981.487350:0:6497:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbaceb7 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00000100:00100000:3.0:1762166981.487588:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166981.487626:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.487668:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450723328 00000100:00100000:2.0:1762166981.487675:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450723328 00000100:00100000:1.0:1762166981.487695:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450723456 00000100:00100000:1.0:1762166981.487702:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450723456 00010000:00010000:2.0:1762166981.487704:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbace32 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea993 expref: 537 pid: 30829 timeout: 700 lvb_type: 0 00010000:00010000:1.0:1762166981.487724:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbac8b3 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea755 expref: 538 pid: 6494 timeout: 700 lvb_type: 0 00000100:00100000:2.0:1762166981.487748:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9820 00000100:00100000:2.0:1762166981.487759:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+538:2419:x1847765450723328:12345-192.168.204.38@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1762166981.487765:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9821 00010000:00010000:2.0:1762166981.487772:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166981.487782:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbace32 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea993 expref: 538 pid: 30829 timeout: 700 lvb_type: 0 00000100:00100000:1.0:1762166981.487783:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1dded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+538:2418:x1847765450723456:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166981.487798:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166981.487815:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbac8b3 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea755 expref: 538 pid: 6494 timeout: 700 lvb_type: 0 00010000:00010000:2.0:1762166981.487820:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbace32 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea993 expref: 538 pid: 30829 timeout: 700 lvb_type: 0 00010000:00010000:1.0:1762166981.487836:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbac8b3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea755 expref: 538 pid: 6494 timeout: 700 lvb_type: 0 00010000:00010000:2.0:1762166981.487852:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbace32 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea993 expref: 538 pid: 30829 timeout: 700 lvb_type: 0 00010000:00010000:1.0:1762166981.487857:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbac8b3 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea755 expref: 538 pid: 6494 timeout: 700 lvb_type: 0 00010000:00010000:2.0:1762166981.487871:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166981.487878:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbaceb7 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166981.487886:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbaceb7 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166981.487893:0:6479:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbaceb7 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166981.487902:0:9458:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:1.0:1762166981.487908:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166981.487923:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166981.487955:0:6497:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbaceb7 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00000100:00100000:2.0:1762166981.487967:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+536:2419:x1847765450723328:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 200us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166981.487968:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1dded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+536:2418:x1847765450723456:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 182us (328us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166981.487970:0:6497:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbaceb7 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00000100:00100000:1.0:1762166981.487997:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9821 00000100:00100000:2.0:1762166981.488006:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9820 00010000:00010000:2.0:1762166981.488229:0:6497:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbaceb7 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166981.488244:0:6497:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbaceb7 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166981.488251:0:6497:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbaceb7 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166981.488256:0:6497:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355a800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166981.488260:0:6497:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbaceb7 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166981.488268:0:6497:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbaceb7 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166981.488277:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166981.488281:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1762166981.488285:0:6497:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbaceb7 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166981.488290:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbaceb7 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166981.488300:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166981.488302:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166981.488306:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7c0ec00/0x2f180c4effbacea9 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea9c4 expref: 534 pid: 30829 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166981.488402:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff2fdc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+534:61883:x1847765450723200:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 2674us (2791us total) trans 4294992521 rc -22/-22 00000100:00100000:2.0:1762166981.488410:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11985 00000100:00100000:3.0:1762166981.489468:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.489550:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450723584 00000100:00100000:2.0:1762166981.489558:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450723584 00000100:00100000:2.0:1762166981.489591:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30873 00000100:00100000:2.0:1762166981.489599:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1dddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+534:61883:x1847765450723584:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166981.489615:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166981.489630:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7c0f800/0x2f180c4effbacebe lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea9cb expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.489670:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7c0f800/0x2f180c4effbacebe lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea9cb expref: 535 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.489686:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7c0f800/0x2f180c4effbacebe lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea9cb expref: 535 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.489702:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166981.489705:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166981.489707:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc7c0f800, rc 0) 00000100:00100000:2.0:1762166981.489742:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1dddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+535:61883:x1847765450723584:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 144us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166981.489749:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30873 00000100:00100000:2.0:1762166981.491215:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166981.491270:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450723840 00000100:00100000:0.0:1762166981.491279:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450723840 00000100:00100000:0.0:1762166981.491349:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30874 00000100:00100000:0.0:1762166981.491360:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4012680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+535:61883:x1847765450723840:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166981.491381:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166981.491403:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbacec5 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea9d2 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.492019:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbacecc lrc: 3/1,0 mode: --/PR res: [0x240000404:0x61c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:0.0:1762166981.492033:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbacecc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x61c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.492045:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbacecc lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x61c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000004:00200000:0.0:1762166981.492058:0:30829:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x61c:0x0]: returning size 0 00010000:00010000:0.0:1762166981.492112:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdea00/0x2f180c4effbacec5 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea9d2 expref: 538 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.492138:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbacecc lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x61c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea9d2 expref: 537 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.492147:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x61c:0x0].0x0 (ffff945bc4afe300) 00010000:00010000:0.0:1762166981.492151:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166981.492154:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdfa00, rc 0) 00000100:00100000:0.0:1762166981.492217:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4012680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+537:61883:x1847765450723840:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 859us (1010us total) trans 4294992522 rc 0/0 00000100:00100000:0.0:1762166981.492225:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30874 00000100:00100000:1.0:1762166981.493687:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166981.493745:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450724096 00000100:00100000:0.0:1762166981.493755:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450724096 00000100:00100000:0.0:1762166981.493822:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30875 00000100:00100000:0.0:1762166981.493833:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+537:61883:x1847765450724096:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166981.493860:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166981.493878:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbaceda lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea9d9 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.493972:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbacee1 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:0.0:1762166981.493985:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbacee1 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.493995:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbacee1 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000004:00200000:0.0:1762166981.494006:0:30829:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 241040 00010000:00010000:0.0:1762166981.494094:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbaceda lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea9d9 expref: 540 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.494111:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbacee1 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea9d9 expref: 539 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.494119:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:0.0:1762166981.494122:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166981.494126:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdf400, rc 0) 00000100:00100000:0.0:1762166981.494178:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+539:61883:x1847765450724096:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 347us (498us total) trans 4294992523 rc 0/0 00000100:00100000:0.0:1762166981.494185:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30875 00000100:00100000:3.0:1762166981.495272:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.495326:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450724352 00000100:00100000:2.0:1762166981.495333:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450724352 00000100:00100000:2.0:1762166981.495383:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11986 00000100:00100000:2.0:1762166981.495392:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+539:61883:x1847765450724352:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:2.0:1762166981.495453:0:6497:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x240000404:0x5eb:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbacee1 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea9d9 expref: 539 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.495525:0:6497:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8400/0x2f180c4effbaceef lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 00010000:00010000:2.0:1762166981.495548:0:6497:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7c0f800/0x2f180c4effbacebe lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea9cb expref: 539 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.495557:0:6497:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8400/0x2f180c4effbaceef lrc: 4/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166981.495605:0:6497:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7c0f800/0x2f180c4effbacebe lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea9cb expref: 539 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.495618:0:6497:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7c0f800/0x2f180c4effbacebe lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea9cb expref: 539 pid: 30829 timeout: 700 lvb_type: 0 00000100:00100000:2.0:1762166981.495633:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945ceda2f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6497:1847765449792896:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166981.495710:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cee17e6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166981.496790:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945ceda2f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6497:1847765449792896:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166981.496828:0:6497:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8400/0x2f180c4effbaceef lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00000100:00100000:3.0:1762166981.497028:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.497080:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450724480 00000100:00100000:2.0:1762166981.497086:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450724480 00010000:00010000:2.0:1762166981.497114:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7c0f800/0x2f180c4effbacebe lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea9cb expref: 540 pid: 30829 timeout: 700 lvb_type: 0 00000100:00100000:2.0:1762166981.497151:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9822 00000100:00100000:2.0:1762166981.497160:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1dde680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+540:2418:x1847765450724480:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166981.497173:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166981.497180:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7c0f800/0x2f180c4effbacebe lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea9cb expref: 540 pid: 30829 timeout: 700 lvb_type: 0 00010000:00010000:2.0:1762166981.497191:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7c0f800/0x2f180c4effbacebe lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea9cb expref: 540 pid: 30829 timeout: 700 lvb_type: 0 00010000:00010000:2.0:1762166981.497207:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7c0f800/0x2f180c4effbacebe lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea9cb expref: 540 pid: 30829 timeout: 700 lvb_type: 0 00010000:00010000:2.0:1762166981.497221:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166981.497226:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8400/0x2f180c4effbaceef lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166981.497234:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8400/0x2f180c4effbaceef lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166981.497242:0:6479:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8400/0x2f180c4effbaceef lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166981.497269:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166981.497288:0:6497:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8400/0x2f180c4effbaceef lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166981.497295:0:6497:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8400/0x2f180c4effbaceef lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166981.497310:0:6497:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbacef6 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x61c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 00000100:00100000:2.0:1762166981.497316:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1dde680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+539:2418:x1847765450724480:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 154us (286us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166981.497323:0:6497:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbacecc lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x61c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea9d2 expref: 539 pid: 30829 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166981.497330:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9822 00010000:00010000:1.0:1762166981.497338:0:6497:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbacef6 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x61c:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166981.497369:0:6497:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbacecc lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x61c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea9d2 expref: 538 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.497381:0:6497:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbacecc lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x61c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea9d2 expref: 538 pid: 30829 timeout: 700 lvb_type: 0 00000100:00100000:1.0:1762166981.497394:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a28000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6497:1847765449793024:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166981.497453:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc350f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166981.498612:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a28000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001_UUID:6497:1847765449793024:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166981.498633:0:6497:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbacef6 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x61c:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00000100:00100000:0.0:1762166981.498823:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.498878:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450724608 00000100:00100000:2.0:1762166981.498883:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450724608 00010000:00010000:2.0:1762166981.498904:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbacecc lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x61c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea9d2 expref: 539 pid: 30829 timeout: 700 lvb_type: 0 00000100:00100000:2.0:1762166981.498936:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9823 00000100:00100000:2.0:1762166981.498946:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cceb4a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+539:2419:x1847765450724608:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166981.498958:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166981.498964:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbacecc lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x61c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea9d2 expref: 539 pid: 30829 timeout: 700 lvb_type: 0 00010000:00010000:2.0:1762166981.498975:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbacecc lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x61c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea9d2 expref: 539 pid: 30829 timeout: 700 lvb_type: 0 00010000:00010000:2.0:1762166981.498989:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbacecc lrc: 0/0,0 mode: --/PR res: [0x240000404:0x61c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea9d2 expref: 539 pid: 30829 timeout: 700 lvb_type: 0 00010000:00010000:2.0:1762166981.499000:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x61c:0x0].0x0 (ffff945bc4afe300) 00010000:00010000:2.0:1762166981.499003:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbacef6 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x61c:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166981.499011:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbacef6 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x61c:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166981.499015:0:6479:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbacef6 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x61c:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT1 00010000:00010000:2.0:1762166981.499033:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166981.499054:0:6497:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbacef6 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x61c:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166981.499064:0:6497:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbacef6 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x61c:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT1 00000100:00100000:2.0:1762166981.499066:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cceb4a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+538:2419:x1847765450724608:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 122us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166981.499076:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9823 00000100:00100000:1.0:1762166981.499470:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a28000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449793152:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762166981.499536:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166981.499566:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc350f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166981.499577:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449793152 00000100:00100000:2.0:1762166981.499583:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449793152 00000100:00100000:2.0:1762166981.499625:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1468 00000100:00100000:2.0:1762166981.499632:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:6497:x1847765449793152:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762166981.499720:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:6497:x1847765449793152:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 88us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166981.499728:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1468 00000100:00100000:1.0:1762166981.499749:0:6497:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 17179876725 gen 2 00000004:00080000:1.0:1762166981.499756:0:6497:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc59d6a00, transno 17179876720 00000004:00080000:1.0:1762166981.499769:0:6497:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc59d4a80, transno 17179876721 00000004:00080000:1.0:1762166981.499772:0:6497:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc59d5500, transno 17179876722 00000004:00080000:1.0:1762166981.499775:0:6497:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bcb385880, transno 17179876723 00000004:00080000:1.0:1762166981.499778:0:6497:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bcb386d80, transno 17179876724 00000004:00080000:1.0:1762166981.499781:0:6497:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bcb387b80, transno 17179876725 00000100:00100000:1.0:1762166981.499787:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a28000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449793152:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762166981.499867:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a28000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449793280:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762166981.499895:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166981.499918:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc350f9c0 going to sleep for 11 seconds 00000004:00080000:0.0:1762166981.499941:0:9994:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0001: 0 changes, 0 in progress, 0 in flight, 6 done 00000100:00100000:2.0:1762166981.499944:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449793280 00000100:00100000:2.0:1762166981.499951:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449793280 00000100:00100000:2.0:1762166981.499983:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1469 00000100:00100000:2.0:1762166981.499993:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+37:6497:x1847765449793280:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762166981.500069:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+37:6497:x1847765449793280:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 78us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166981.500077:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1469 00000100:00100000:1.0:1762166981.500096:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a28000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449793280:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762166981.500144:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a28000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449793408:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762166981.500165:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166981.500184:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf3a33f00 going to sleep for 11 seconds 00000100:00100000:2.0:1762166981.500218:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449793408 00000100:00100000:2.0:1762166981.500223:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449793408 00000100:00100000:2.0:1762166981.500250:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1470 00000100:00100000:2.0:1762166981.500257:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc6359c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+37:6497:x1847765449793408:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762166981.500315:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc6359c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+37:6497:x1847765449793408:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 59us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166981.500323:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1470 00000100:00100000:1.0:1762166981.500347:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a28000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449793408:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762166981.500405:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a28000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449793536:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762166981.500439:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166981.500470:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc56bf840 going to sleep for 11 seconds 00000100:00100000:0.0:1762166981.500619:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449793536 00000100:00100000:0.0:1762166981.500625:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449793536 00000100:00100000:2.0:1762166981.500659:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1471 00000100:00100000:2.0:1762166981.500668:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:6497:x1847765449793536:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762166981.500729:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:6497:x1847765449793536:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 58us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166981.500738:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1471 00000100:00100000:1.0:1762166981.500745:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a28000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449793536:0@lo:1000:mdt_rdpg00_000.0 00000040:00080000:1.0:1762166981.500922:0:6497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x2:0x0].63, 280 off71888 00000001:00080000:1.0:1762166981.500951:0:6497:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992524 00000100:00100000:1.0:1762166981.501000:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a28000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449793664:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762166981.501024:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166981.501051:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc350fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1762166981.501139:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449793664 00000100:00100000:2.0:1762166981.501144:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449793664 00000100:00100000:2.0:1762166981.501176:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1472 00000100:00100000:2.0:1762166981.501183:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:6497:x1847765449793664:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762166981.501355:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:6497:x1847765449793664:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 172us (329us total) trans 17179876733 rc 0/0 00000100:00100000:2.0:1762166981.501363:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1472 00000100:00100000:1.0:1762166981.501434:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a28000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449793664:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762166981.501458:0:6497:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a2a680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449793792:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1762166981.501519:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166981.501539:0:6497:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc9a5e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166981.501567:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449793792 00000100:00100000:2.0:1762166981.501571:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449793792 00000100:00100000:2.0:1762166981.501596:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1473 00000100:00100000:2.0:1762166981.501602:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+37:6497:x1847765449793792:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1762166981.501682:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+38:6497:x1847765449793792:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 80us (163us total) trans 21474843473 rc 0/0 00000100:00100000:2.0:1762166981.501689:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1473 00000100:00100000:1.0:1762166981.501695:0:6497:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a2a680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0001-mdtlov_UUID:6497:1847765449793792:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1762166981.501746:0:6497:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992525 00010000:00010000:1.0:1762166981.501765:0:6497:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbacef6 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x61c:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166981.501773:0:6497:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbacef6 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x61c:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166981.501778:0:6497:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbacef6 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x61c:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166981.501782:0:6497:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355b600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166981.501786:0:6497:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbacef6 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x61c:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166981.501792:0:6497:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbacef6 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x61c:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166981.501818:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x61c:0x0].0x0 (ffff945bc4afe300) 00010000:00010000:1.0:1762166981.501821:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1762166981.501827:0:6497:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbacef6 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x61c:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166981.501833:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbacef6 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x61c:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166981.501857:0:6497:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8400/0x2f180c4effbaceef lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166981.501863:0:6497:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8400/0x2f180c4effbaceef lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166981.501868:0:6497:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8400/0x2f180c4effbaceef lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166981.501874:0:6497:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc5db8400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166981.501877:0:6497:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8400/0x2f180c4effbaceef lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166981.501882:0:6497:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8400/0x2f180c4effbaceef lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166981.501890:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:1.0:1762166981.501893:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1762166981.501895:0:6497:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8400/0x2f180c4effbaceef lrc: 2/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166981.501901:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8400/0x2f180c4effbaceef lrc: 0/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166981.501914:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:1.0:1762166981.501916:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762166981.501931:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf400/0x2f180c4effbacee1 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea9d9 expref: 540 pid: 30829 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166981.502029:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+539:61883:x1847765450724352:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 6639us (6760us total) trans 4294992526 rc 0/0 00000100:00100000:1.0:1762166981.502035:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11986 00000020:00080000:1.0:1762166981.502038:0:6497:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1762166981.503146:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.503187:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450724736 00000100:00100000:2.0:1762166981.503192:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450724736 00000100:00100000:2.0:1762166981.503224:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30876 00000100:00100000:2.0:1762166981.503230:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb385f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+539:61883:x1847765450724736:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166981.503248:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166981.503267:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbacefd lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea9e0 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.503322:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbacefd lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea9e0 expref: 540 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.503339:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbacefd lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea9e0 expref: 540 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.503356:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166981.503357:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166981.503360:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc5db8e00, rc 0) 00000100:00100000:2.0:1762166981.503391:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb385f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+540:61883:x1847765450724736:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 161us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166981.503395:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30876 00000100:00100000:3.0:1762166981.504643:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.504709:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450724864 00000100:00100000:2.0:1762166981.504716:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450724864 00002000:00100000:2.0:1762166981.504757:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (122880->241039) req@ffff945cf1ddd500 x1847765450724864/t0(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:12/0 lens 488/0 e 0 to 0 dl 1762166992 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166981.504769:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1ddd500 with x1847765450724864 ext(122880->241039) 00002000:00010000:2.0:1762166981.504775:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1ddd500 00000100:00100000:2.0:1762166981.504800:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2739 00000100:00100000:2.0:1762166981.504820:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+21:2417:x1847765450724864:12345-192.168.204.38@tcp:4:fsx.0 00000100:00100000:2.0:1762166981.507018:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+23:2417:x1847765450724864:12345-192.168.204.38@tcp:4:fsx.0 Request processed in 2189us (2370us total) trans 17179876734 rc 0/0 00000100:00100000:2.0:1762166981.507035:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2739 00002000:00100000:2.0:1762166981.507047:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (122880->241039) req@ffff945cf1ddd500 x1847765450724864/t17179876734(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:12/0 lens 488/448 e 0 to 0 dl 1762166992 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166981.507056:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1ddd500 with x1847765450724864 ext(122880->241039) 00002000:00010000:2.0:1762166981.507061:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1ddd500 00000100:00100000:0.0:1762166981.508986:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166981.509058:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450725120 00000100:00100000:1.0:1762166981.509074:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450725120 00000100:00100000:1.0:1762166981.509151:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11987 00000100:00100000:1.0:1762166981.509169:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb387480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+540:61883:x1847765450725120:12345-192.168.204.38@tcp:35:lfs.0 00000004:00080000:1.0:1762166981.509508:0:6497:0:(mdd_object.c:3965:mdd_close()) Object [0x240000404:0x61c:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1762166981.509594:0:6497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5962, 64 off467272 00000004:00080000:1.0:1762166981.509608:0:6497:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 600658128150ns, next at 601658123630ns, rc = 0 00000040:00080000:1.0:1762166981.509637:0:6497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5961, 64 off467272 00000004:00080000:1.0:1762166981.509643:0:6497:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 600658165485ns, next at 601658163748ns, rc = 0 00000001:00080000:1.0:1762166981.509650:0:6497:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992527 00010000:00010000:1.0:1762166981.509693:0:6497:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbacf04 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x61c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 00010000:00010000:1.0:1762166981.509710:0:6497:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbacf04 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x61c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166981.509722:0:6497:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbacf04 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x61c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166981.509731:0:6497:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbacf04 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x61c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166981.509737:0:6497:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbacf04 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x61c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166981.509747:0:6497:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbacf04 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x61c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6497 initiator: MDT1 00010000:00010000:1.0:1762166981.509776:0:6497:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1762166981.510003:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb387480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+542:61883:x1847765450725120:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 841us (1026us total) trans 4294992528 rc 0/0 00000100:00100000:1.0:1762166981.510011:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11987 00000020:00080000:1.0:1762166981.510018:0:6497:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1762166981.510035:0:10256:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1762166981.510043:0:10256:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbacf04 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x61c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166981.510050:0:10256:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355b600 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166981.510054:0:10256:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbacf04 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x61c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166981.510063:0:10256:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbacf04 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x61c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166981.510077:0:10256:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x61c:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:0.0:1762166981.510080:0:10256:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1762166981.510085:0:10256:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbacf04 lrc: 1/0,0 mode: --/PW res: [0x240000404:0x61c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166981.510090:0:10256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b600/0x2f180c4effbacf04 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x61c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6497 initiator: MDT1 00010000:00010000:0.0:1762166981.510103:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166981.510105:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166981.510106:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166981.511353:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166981.511436:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450725376 00000100:00100000:1.0:1762166981.511442:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450725376 00000100:00100000:1.0:1762166981.511504:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11988 00000100:00100000:1.0:1762166981.511513:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+542:61883:x1847765450725376:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:1.0:1762166981.511655:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+543:61883:x1847765450725376:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 142us (301us total) trans 4294992529 rc 0/0 00000100:00100000:1.0:1762166981.511664:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11988 00000100:00100000:2.0:1762166981.514025:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166981.514141:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450725632 00000100:00100000:0.0:1762166981.514156:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450725632 00000100:00100000:0.0:1762166981.514244:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30877 00000100:00100000:0.0:1762166981.514256:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+543:61766:x1847765450725632:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:0.0:1762166981.514295:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166981.514322:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbacf0b lrc: 2/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea9e7 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.514433:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbacf12 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:0.0:1762166981.514448:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbacf12 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.514461:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbacf12 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.514516:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbacf19 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:0.0:1762166981.514525:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbacf19 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.514534:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbacf19 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.514657:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbacf20 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:0.0:1762166981.514668:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbacf20 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.514676:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbacf20 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000004:00200000:0.0:1762166981.514688:0:30829:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 241040 00010000:00010000:0.0:1762166981.514794:0:30829:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbacf12 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.514813:0:30829:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbacf12 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.514824:0:30829:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbacf12 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.514831:0:30829:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbacf12 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.514837:0:30829:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdfe00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166981.514841:0:30829:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbacf12 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.514848:0:30829:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbacf12 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.514860:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:0.0:1762166981.514862:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166981.514867:0:30829:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbacf12 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.514873:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbacf12 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.514887:0:30829:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbacf19 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.514894:0:30829:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbacf19 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.514900:0:30829:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbacf19 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.514905:0:30829:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bde800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166981.514907:0:30829:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbacf19 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.514916:0:30829:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbacf19 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.514923:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0xdd396665 (ffff945bc4afe900) 00010000:00010000:0.0:1762166981.514926:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166981.514929:0:30829:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbacf19 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.514934:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbacf19 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.514979:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbacf0b lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea9e7 expref: 546 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.514993:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbacf20 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea9e7 expref: 545 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.515001:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:0.0:1762166981.515004:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166981.515007:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdf800, rc 0) 00000100:00100000:0.0:1762166981.515075:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+545:61766:x1847765450725632:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 821us (1052us total) trans 4294992530 rc 0/0 00000100:00100000:0.0:1762166981.515084:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30877 00000100:00100000:2.0:1762166981.519631:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166981.519735:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450725760 00000100:00100000:0.0:1762166981.519748:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450725760 00002000:00100000:0.0:1762166981.519824:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (102400->106495) req@ffff945bcce75500 x1847765450725760/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:12/0 lens 488/0 e 0 to 0 dl 1762166992 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166981.519838:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bcce75500 with x1847765450725760 ext(102400->106495) 00002000:00010000:0.0:1762166981.519847:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bcce75500 00000100:00100000:0.0:1762166981.519897:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2740 00000100:00100000:0.0:1762166981.519910:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765450725760:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:0.0:1762166981.520201:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765450725760:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 293us (583us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1762166981.520211:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2740 00002000:00100000:0.0:1762166981.520219:0:23940:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000400:0xa77:0x0] (102400->106495) req@ffff945bcce75500 x1847765450725760/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:12/0 lens 488/4536 e 0 to 0 dl 1762166992 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166981.520228:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bcce75500 with x1847765450725760 ext(102400->106495) 00002000:00010000:0.0:1762166981.520232:0:23940:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bcce75500 00000100:00100000:3.0:1762166981.523221:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166981.523293:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450725888 00000100:00100000:1.0:1762166981.523309:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450725888 00002000:00100000:1.0:1762166981.523366:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (106496->110591) req@ffff945cf1ddfb80 x1847765450725888/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:12/0 lens 488/0 e 0 to 0 dl 1762166992 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166981.523377:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1ddfb80 with x1847765450725888 ext(106496->110591) 00002000:00010000:1.0:1762166981.523395:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1ddfb80 00000100:00100000:1.0:1762166981.523431:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2741 00000100:00100000:1.0:1762166981.523440:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+23:2416:x1847765450725888:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:1.0:1762166981.523659:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+23:2416:x1847765450725888:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 219us (452us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1762166981.523671:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2741 00002000:00100000:1.0:1762166981.523679:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (106496->110591) req@ffff945cf1ddfb80 x1847765450725888/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:12/0 lens 488/4536 e 0 to 0 dl 1762166992 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166981.523686:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1ddfb80 with x1847765450725888 ext(106496->110591) 00002000:00010000:1.0:1762166981.523689:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1ddfb80 00000100:00100000:3.0:1762166981.525450:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166981.525575:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450726016 00000100:00100000:1.0:1762166981.525580:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450726016 00002000:00100000:1.0:1762166981.525600:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (81920->147455) req@ffff945cf1dddf80 x1847765450726016/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:12/0 lens 504/0 e 0 to 0 dl 1762166992 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166981.525609:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1dddf80 with x1847765450726016 ext(81920->147455) 00002000:00010000:1.0:1762166981.525613:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1dddf80 00000100:00100000:1.0:1762166981.525643:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2742 00000100:00100000:1.0:1762166981.525652:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1dddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+23:2417:x1847765450726016:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:1.0:1762166981.527110:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1dddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+23:2417:x1847765450726016:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 1458us (1661us total) trans 0 rc 57344/57344 00000100:00100000:1.0:1762166981.527120:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2742 00002000:00100000:1.0:1762166981.527135:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (81920->147455) req@ffff945cf1dddf80 x1847765450726016/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:12/0 lens 504/440 e 0 to 0 dl 1762166992 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166981.527145:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1dddf80 with x1847765450726016 ext(81920->147455) 00002000:00010000:1.0:1762166981.527150:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1dddf80 00000100:00100000:3.0:1762166981.529343:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166981.529459:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450726144 00000100:00100000:1.0:1762166981.529470:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450726144 00002000:00100000:1.0:1762166981.529546:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (147456->184319) req@ffff945cf1ddd880 x1847765450726144/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:12/0 lens 488/0 e 0 to 0 dl 1762166992 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166981.529565:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1ddd880 with x1847765450726144 ext(147456->184319) 00002000:00010000:1.0:1762166981.529571:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1ddd880 00000100:00100000:1.0:1762166981.529609:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2743 00000100:00100000:1.0:1762166981.529620:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+23:2417:x1847765450726144:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:1.0:1762166981.531185:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+23:2417:x1847765450726144:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 1559us (1849us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1762166981.531198:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2743 00002000:00100000:1.0:1762166981.531208:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (147456->184319) req@ffff945cf1ddd880 x1847765450726144/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:12/0 lens 488/440 e 0 to 0 dl 1762166992 ref 1 fl Complete:/600/0 rc 36864/36864 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166981.531219:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1ddd880 with x1847765450726144 ext(147456->184319) 00002000:00010000:1.0:1762166981.531225:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1ddd880 00000100:00100000:2.0:1762166981.534633:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166981.534740:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450726272 00000100:00100000:1.0:1762166981.534752:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450726272 00000100:00100000:1.0:1762166981.534863:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2744 00000100:00100000:1.0:1762166981.534876:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+23:2417:x1847765450726272:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:1.0:1762166981.535198:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 123442 -> 241040 00002000:00010000:1.0:1762166981.535203:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00010000:1.0:1762166981.535206:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166981 -> 1762166981 00002000:00010000:1.0:1762166981.535208:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00002000:00010000:1.0:1762166981.535211:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 120 -> 296 00000100:00100000:1.0:1762166981.535291:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+24:2417:x1847765450726272:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 417us (671us total) trans 17179876735 rc 0/0 00000100:00100000:1.0:1762166981.535300:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2744 00000100:00100000:3.0:1762166981.538065:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166981.538133:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450726400 00000100:00100000:0.0:1762166981.538143:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450726400 00000100:00100000:0.0:1762166981.538205:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30878 00000100:00100000:0.0:1762166981.538217:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+545:61766:x1847765450726400:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:0.0:1762166981.538251:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166981.538276:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbacf2e lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea9ee expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.538319:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbacf35 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:0.0:1762166981.538336:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbacf35 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.538350:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbacf35 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.538522:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbacf2e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea9ee expref: 547 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.538548:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbacf35 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea9ee expref: 546 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.538559:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:0.0:1762166981.538562:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1762166981.538566:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bde800, rc 0) 00000100:00100000:0.0:1762166981.538703:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+546:61766:x1847765450726400:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 488us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166981.538711:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30878 00000100:00100000:3.0:1762166981.540010:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166981.540060:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450726656 00000100:00100000:0.0:1762166981.540067:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450726656 00000100:00100000:0.0:1762166981.540112:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30879 00000100:00100000:0.0:1762166981.540120:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1dde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+546:61766:x1847765450726656:12345-192.168.204.38@tcp:36:fsx.0 00010000:00010000:0.0:1762166981.540163:0:30829:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166981.540192:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf800/0x2f180c4effbacf20 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea9e7 expref: 546 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.540208:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:0.0:1762166981.540212:0:30829:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166981.540405:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbacf3c lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:0.0:1762166981.540418:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbacf3c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.540426:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbacf3c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000001:00080000:0.0:1762166981.540501:0:30829:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992531 00000004:00010000:0.0:1762166981.540529:0:30829:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000a08a45b0 reply state 00000000e4fd4a30 transno 4294992532 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbacf3c lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.540541:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbacf3c lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.540548:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:0.0:1762166981.540551:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762166981.540554:0:30829:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166981.540651:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1dde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+548:61766:x1847765450726656:12345-192.168.204.38@tcp:36:fsx.0 Request processed in 530us (644us total) trans 4294992532 rc 0/0 00000100:00100000:0.0:1762166981.540658:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30879 00000020:00080000:0.0:1762166981.540664:0:30829:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1762166981.542000:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.542035:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166981.542100:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450726784 00000100:00100000:1.0:1762166981.542108:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450726784 00000100:00100000:2.0:1762166981.542116:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00002000:00010000:1.0:1762166981.542148:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (262144->18446744073709551615) 00002000:00100000:1.0:1762166981.542155:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1cd1c00 with x1847765450726784 ext(262144->18446744073709551615) 00002000:00010000:1.0:1762166981.542166:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1cd1c00. 00000100:00100000:1.0:1762166981.542195:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450726912 00000100:00100000:1.0:1762166981.542200:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450726912 00000100:00100000:0.0:1762166981.542204:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450727040 00000100:00100000:0.0:1762166981.542209:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450727040 00002000:00010000:1.0:1762166981.542216:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00000100:00100000:3.0:1762166981.542220:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2745 00002000:00100000:1.0:1762166981.542222:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1cd1880 with x1847765450726912 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166981.542226:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:0.0:1762166981.542230:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1cd0a80 with x1847765450727040 ext(0->18446744073709551615) 00002000:00010000:1.0:1762166981.542232:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945cf1cd1880. 00002000:00010000:0.0:1762166981.542237:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1cd0a80. 00000100:00100000:3.0:1762166981.542239:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+25:2419:x1847765450726784:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:1.0:1762166981.542256:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2746 00000100:00100000:0.0:1762166981.542264:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2747 00000100:00100000:1.0:1762166981.542270:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+34:2419:x1847765450726912:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:0.0:1762166981.542277:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+25:2418:x1847765450727040:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:1.0:1762166981.542411:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166981.542411:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166981.542420:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00010000:0.0:1762166981.542420:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00010000:1.0:1762166981.542428:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166981 -> 1762166981 00002000:00010000:0.0:1762166981.542428:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166981 -> 1762166981 00002000:00010000:1.0:1762166981.542435:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00002000:00010000:0.0:1762166981.542435:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00002000:00010000:1.0:1762166981.542442:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00002000:00010000:0.0:1762166981.542443:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1762166981.542515:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+35:2419:x1847765450726912:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 250us (479us total) trans 21474843474 rc 0/0 00000100:00100000:0.0:1762166981.542521:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+27:2418:x1847765450727040:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 245us (404us total) trans 17179876736 rc 0/0 00002000:00010000:2.0:1762166981.542538:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 241040 -> 262144 00000100:00100000:1.0:1762166981.542540:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2746 00002000:00010000:2.0:1762166981.542544:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00010000:1.0:1762166981.542547:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00010000:2.0:1762166981.542549:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166981 -> 1762166981 00000100:00100000:0.0:1762166981.542550:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2747 00002000:00100000:1.0:1762166981.542554:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1cd1880 with x1847765450726912 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166981.542557:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00002000:00010000:0.0:1762166981.542558:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00010000:2.0:1762166981.542562:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 296 -> 296 00002000:00010000:1.0:1762166981.542562:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945cf1cd1880. 00002000:00100000:0.0:1762166981.542563:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1cd0a80 with x1847765450727040 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166981.542574:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1cd0a80. 00000100:00100000:2.0:1762166981.542601:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765450726784:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 363us (601us total) trans 17179876737 rc 0/0 00000100:00100000:2.0:1762166981.542612:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2745 00002000:00010000:2.0:1762166981.542616:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (262144->18446744073709551615) 00002000:00100000:2.0:1762166981.542619:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1cd1c00 with x1847765450726784 ext(262144->18446744073709551615) 00002000:00010000:2.0:1762166981.542625:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1cd1c00. 00000100:00100000:3.0:1762166981.544911:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.545000:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450727168 00000100:00100000:2.0:1762166981.545009:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450727168 00002000:00100000:2.0:1762166981.545067:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (192512->258047) req@ffff945cf1dded80 x1847765450727168/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:12/0 lens 488/0 e 0 to 0 dl 1762166992 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166981.545079:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1dded80 with x1847765450727168 ext(192512->258047) 00002000:00010000:2.0:1762166981.545085:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1dded80 00000100:00100000:2.0:1762166981.545116:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2748 00000100:00100000:2.0:1762166981.545127:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1dded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+26:2416:x1847765450727168:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:2.0:1762166981.546744:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1dded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+26:2416:x1847765450727168:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 1608us (1834us total) trans 0 rc 65536/65536 00000100:00100000:2.0:1762166981.546758:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2748 00002000:00100000:2.0:1762166981.546771:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (192512->258047) req@ffff945cf1dded80 x1847765450727168/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:12/0 lens 488/440 e 0 to 0 dl 1762166992 ref 1 fl Complete:/600/0 rc 65536/65536 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166981.546781:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1dded80 with x1847765450727168 ext(192512->258047) 00002000:00010000:2.0:1762166981.546787:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1dded80 00000100:00100000:0.0:1762166981.550730:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.550821:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450727296 00000100:00100000:2.0:1762166981.550833:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450727296 00002000:00100000:2.0:1762166981.550899:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (258048->262143) req@ffff945bcb387800 x1847765450727296/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:12/0 lens 488/0 e 0 to 0 dl 1762166992 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166981.550911:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bcb387800 with x1847765450727296 ext(258048->262143) 00002000:00010000:2.0:1762166981.550918:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bcb387800 00000100:00100000:2.0:1762166981.550958:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2749 00000100:00100000:2.0:1762166981.550969:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb387800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+26:2417:x1847765450727296:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:2.0:1762166981.551247:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb387800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+26:2417:x1847765450727296:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 280us (528us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1762166981.551255:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2749 00002000:00100000:2.0:1762166981.551263:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (258048->262143) req@ffff945bcb387800 x1847765450727296/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:12/0 lens 488/4536 e 0 to 0 dl 1762166992 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166981.551271:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bcb387800 with x1847765450727296 ext(258048->262143) 00002000:00010000:2.0:1762166981.551274:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bcb387800 00000100:00100000:3.0:1762166981.552929:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.552992:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450727424 00000100:00100000:2.0:1762166981.553001:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450727424 00002000:00100000:2.0:1762166981.553046:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (221184->262143) req@ffff945cf1ddca80 x1847765450727424/t0(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:12/0 lens 488/0 e 0 to 0 dl 1762166992 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166981.553065:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1ddca80 with x1847765450727424 ext(221184->262143) 00002000:00010000:2.0:1762166981.553074:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1ddca80 00000100:00100000:2.0:1762166981.553108:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2750 00000100:00100000:2.0:1762166981.553118:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+26:2416:x1847765450727424:12345-192.168.204.38@tcp:4:fsx.0 00000100:00100000:2.0:1762166981.554908:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+28:2416:x1847765450727424:12345-192.168.204.38@tcp:4:fsx.0 Request processed in 1782us (1978us total) trans 17179876738 rc 0/0 00000100:00100000:2.0:1762166981.554918:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2750 00002000:00100000:2.0:1762166981.554930:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (221184->262143) req@ffff945cf1ddca80 x1847765450727424/t17179876738(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:12/0 lens 488/448 e 0 to 0 dl 1762166992 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166981.554940:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1ddca80 with x1847765450727424 ext(221184->262143) 00002000:00010000:2.0:1762166981.554946:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1ddca80 00000100:00100000:0.0:1762166981.556023:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166981.556087:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450727552 00000100:00100000:3.0:1762166981.556098:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450727552 00000100:00100000:3.0:1762166981.556152:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19452 00000100:00100000:3.0:1762166981.556163:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb384e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+28:2419:x1847765450727552:12345-192.168.204.38@tcp:16:fsx.0 00000001:00080000:2.0:1762166981.557523:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876738 is committed 00000001:00080000:2.0:1762166981.557553:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876733 is committed 00000100:00100000:3.0:1762166981.557825:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb384e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450727552:12345-192.168.204.38@tcp:16:fsx.0 Request processed in 1660us (1802us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166981.557836:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19452 00000100:00100000:3.0:1762166981.559332:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166981.559409:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450727680 00000100:00100000:0.0:1762166981.559418:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450727680 00000100:00100000:0.0:1762166981.559502:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30880 00000100:00100000:0.0:1762166981.559514:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1dde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+548:61766:x1847765450727680:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:0.0:1762166981.559543:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166981.559569:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbacf43 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea9f5 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.559691:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbacf4a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:0.0:1762166981.559705:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbacf4a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.559714:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbacf4a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000004:00200000:0.0:1762166981.559739:0:30829:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 262144 00000004:00200000:0.0:1762166981.559743:0:30829:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166981.559759:0:30829:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbacf4a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.559784:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbacf43 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea9f5 expref: 550 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.559812:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbacf4a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea9f5 expref: 549 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.559822:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:0.0:1762166981.559826:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166981.559829:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bde000, rc 0) 00000100:00100000:0.0:1762166981.559886:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1dde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+549:61766:x1847765450727680:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 374us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166981.559893:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30880 00000100:00100000:2.0:1762166981.562111:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166981.562165:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450727808 00000100:00100000:0.0:1762166981.562175:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450727808 00000100:00100000:0.0:1762166981.562240:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2751 00000100:00100000:0.0:1762166981.562251:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450727808:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:0.0:1762166981.562766:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:0.0:1762166981.562772:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00010000:0.0:1762166981.562774:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166981 -> 1762166981 00002000:00010000:0.0:1762166981.562777:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00002000:00010000:0.0:1762166981.562779:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 296 -> 296 00000100:00100000:0.0:1762166981.562851:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450727808:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 601us (748us total) trans 17179876739 rc 0/0 00000100:00100000:0.0:1762166981.562859:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2751 00000100:00100000:2.0:1762166981.565225:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166981.565272:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450727936 00000100:00100000:0.0:1762166981.565283:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450727936 00002000:00100000:0.0:1762166981.565352:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (155648->192511) req@ffff945cf1cd0000 x1847765450727936/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:12/0 lens 504/0 e 0 to 0 dl 1762166992 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166981.565371:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1cd0000 with x1847765450727936 ext(155648->192511) 00002000:00010000:0.0:1762166981.565378:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1cd0000 00000100:00100000:0.0:1762166981.565414:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2752 00000100:00100000:0.0:1762166981.565424:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450727936:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:0.0:1762166981.567724:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450727936:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 2291us (2497us total) trans 0 rc 12288/12288 00000100:00100000:0.0:1762166981.567738:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2752 00002000:00100000:0.0:1762166981.567750:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (155648->192511) req@ffff945cf1cd0000 x1847765450727936/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:12/0 lens 504/440 e 0 to 0 dl 1762166992 ref 1 fl Complete:/600/0 rc 12288/12288 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166981.567760:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1cd0000 with x1847765450727936 ext(155648->192511) 00002000:00010000:0.0:1762166981.567766:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1cd0000 00000100:00100000:2.0:1762166981.570610:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166981.570909:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450728064 00000100:00100000:0.0:1762166981.570921:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450728064 00002000:00100000:0.0:1762166981.570981:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (0->155647) req@ffff945cf1cd1180 x1847765450728064/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:12/0 lens 504/0 e 0 to 0 dl 1762166992 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166981.570993:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1cd1180 with x1847765450728064 ext(0->155647) 00002000:00010000:0.0:1762166981.570999:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1cd1180 00000100:00100000:0.0:1762166981.571039:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2753 00000100:00100000:0.0:1762166981.571049:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450728064:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:0.0:1762166981.573033:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450728064:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 1976us (2425us total) trans 0 rc 106496/106496 00000100:00100000:0.0:1762166981.573047:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2753 00002000:00100000:0.0:1762166981.573062:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (0->155647) req@ffff945cf1cd1180 x1847765450728064/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:12/0 lens 504/440 e 0 to 0 dl 1762166992 ref 1 fl Complete:/600/0 rc 106496/106496 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166981.573073:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1cd1180 with x1847765450728064 ext(0->155647) 00002000:00010000:0.0:1762166981.573078:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1cd1180 00000100:00100000:3.0:1762166981.575961:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166981.576053:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450728192 00000100:00100000:0.0:1762166981.576068:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450728192 00000100:00100000:0.0:1762166981.576158:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2754 00000100:00100000:0.0:1762166981.576170:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450728192:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:0.0:1762166981.576688:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:0.0:1762166981.576693:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00010000:0.0:1762166981.576696:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166981 -> 1762166981 00002000:00010000:0.0:1762166981.576699:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00002000:00010000:0.0:1762166981.576702:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 296 -> 320 00000100:00100000:0.0:1762166981.576784:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450728192:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 615us (834us total) trans 17179876740 rc 0/0 00000100:00100000:0.0:1762166981.576854:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2754 00000100:00100000:2.0:1762166981.580518:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166981.580604:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450728320 00000100:00100000:0.0:1762166981.580618:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450728320 00002000:00100000:0.0:1762166981.580684:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (217088->237567) req@ffff945bc5767100 x1847765450728320/t0(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:12/0 lens 488/0 e 0 to 0 dl 1762166992 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166981.580696:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5767100 with x1847765450728320 ext(217088->237567) 00002000:00010000:0.0:1762166981.580704:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5767100 00000100:00100000:0.0:1762166981.580746:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2755 00000100:00100000:0.0:1762166981.580758:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5767100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450728320:12345-192.168.204.38@tcp:4:fsx.0 00000100:00100000:0.0:1762166981.582640:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5767100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450728320:12345-192.168.204.38@tcp:4:fsx.0 Request processed in 1878us (2122us total) trans 17179876741 rc 0/0 00000100:00100000:0.0:1762166981.582654:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2755 00002000:00100000:0.0:1762166981.582667:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (217088->237567) req@ffff945bc5767100 x1847765450728320/t17179876741(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:12/0 lens 488/448 e 0 to 0 dl 1762166992 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166981.582677:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5767100 with x1847765450728320 ext(217088->237567) 00002000:00010000:0.0:1762166981.582682:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5767100 00000100:00100000:3.0:1762166981.583947:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.584014:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450728448 00000100:00100000:2.0:1762166981.584025:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450728448 00000100:00100000:2.0:1762166981.584094:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19453 00000100:00100000:2.0:1762166981.584104:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450728448:12345-192.168.204.38@tcp:16:fsx.0 00000001:00080000:3.0:1762166981.585257:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876741 is committed 00000100:00100000:2.0:1762166981.585423:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450728448:12345-192.168.204.38@tcp:16:fsx.0 Request processed in 1316us (1476us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166981.585435:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19453 00000100:00100000:2.0:1762166981.588528:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166981.588597:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450728704 00000100:00100000:1.0:1762166981.588609:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450728704 00000100:00100000:1.0:1762166981.588677:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11989 00000100:00100000:1.0:1762166981.588688:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5767b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+549:61766:x1847765450728704:12345-192.168.204.38@tcp:35:fsx.0 00000100:00100000:1.0:1762166981.589053:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5767b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+550:61766:x1847765450728704:12345-192.168.204.38@tcp:35:fsx.0 Request processed in 366us (534us total) trans 4294992533 rc 0/0 00000100:00100000:1.0:1762166981.589062:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11989 00000100:00100000:0.0:1762166981.598896:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.599284:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450728960 00000100:00100000:2.0:1762166981.599298:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450728960 00000100:00100000:2.0:1762166981.599377:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30881 00000100:00100000:2.0:1762166981.599389:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb385c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+550:61884:x1847765450728960:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166981.599430:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166981.599469:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbacf51 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ea9fc expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.600354:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9a00/0x2f180c4effbacf58 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166981.600379:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9a00/0x2f180c4effbacf58 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.600391:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9a00/0x2f180c4effbacf58 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.600408:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8400/0x2f180c4effbacf5f lrc: 3/1,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166981.600415:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8400/0x2f180c4effbacf5f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.600426:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8400/0x2f180c4effbacf5f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.600589:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9200/0x2f180c4effbacf66 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166981.600599:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9200/0x2f180c4effbacf66 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.600607:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9200/0x2f180c4effbacf66 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000004:00200000:2.0:1762166981.600616:0:30829:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 262144 00010000:00010000:2.0:1762166981.600701:0:30829:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9a00/0x2f180c4effbacf58 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.600708:0:30829:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9a00/0x2f180c4effbacf58 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.600714:0:30829:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9a00/0x2f180c4effbacf58 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.600720:0:30829:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9a00/0x2f180c4effbacf58 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.600726:0:30829:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc5db9a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166981.600730:0:30829:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9a00/0x2f180c4effbacf58 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.600737:0:30829:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9a00/0x2f180c4effbacf58 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.600748:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0x0 (ffff945bc809bc00) 00010000:00010000:2.0:1762166981.600751:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166981.600756:0:30829:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9a00/0x2f180c4effbacf58 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.600761:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9a00/0x2f180c4effbacf58 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.600775:0:30829:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8400/0x2f180c4effbacf5f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.600781:0:30829:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8400/0x2f180c4effbacf5f lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.600786:0:30829:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8400/0x2f180c4effbacf5f lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.600791:0:30829:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc5db8400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166981.600793:0:30829:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8400/0x2f180c4effbacf5f lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.600811:0:30829:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8400/0x2f180c4effbacf5f lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.600819:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0xdd396665 (ffff945bc809b500) 00010000:00010000:2.0:1762166981.600822:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166981.600824:0:30829:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8400/0x2f180c4effbacf5f lrc: 2/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.600829:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8400/0x2f180c4effbacf5f lrc: 0/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.600878:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9c00/0x2f180c4effbacf51 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea9fc expref: 553 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.600899:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9200/0x2f180c4effbacf66 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea9fc expref: 552 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.600906:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166981.600908:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166981.600911:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc5db9200, rc 0) 00000100:00100000:2.0:1762166981.600998:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb385c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+552:61884:x1847765450728960:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1610us (2117us total) trans 4294992534 rc 0/0 00000100:00100000:2.0:1762166981.601008:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30881 00000100:00100000:3.0:1762166981.603242:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.603286:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450729088 00000100:00100000:2.0:1762166981.603296:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450729088 00000100:00100000:2.0:1762166981.603347:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 904 00000100:00100000:2.0:1762166981.603356:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc3552d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+552:2418:x1847765450729088:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166981.603368:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166981.603383:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db9200/0x2f180c4effbacf66 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea9fc expref: 552 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.603396:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166981.603400:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166981.603443:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc3552d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+551:2418:x1847765450729088:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 88us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166981.603453:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 904 00000100:00100000:3.0:1762166981.604008:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.604047:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450729344 00000100:00100000:2.0:1762166981.604051:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450729344 00000100:00100000:2.0:1762166981.604085:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30882 00000100:00100000:2.0:1762166981.604091:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc3553800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+551:61884:x1847765450729344:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166981.604109:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166981.604123:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7c0f800/0x2f180c4effbacf74 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eaa03 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.604498:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7c0ec00/0x2f180c4effbacf7b lrc: 3/1,0 mode: --/PR res: [0x240000404:0x61d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166981.604509:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7c0ec00/0x2f180c4effbacf7b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x61d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.604517:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7c0ec00/0x2f180c4effbacf7b lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x61d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000004:00200000:2.0:1762166981.604526:0:30829:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x61d:0x0]: returning size 0 00010000:00010000:2.0:1762166981.604559:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7c0f800/0x2f180c4effbacf74 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa03 expref: 554 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.604575:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7c0ec00/0x2f180c4effbacf7b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x61d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa03 expref: 553 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.604594:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x61d:0x0].0x0 (ffff945bc809b600) 00010000:00010000:2.0:1762166981.604597:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166981.604599:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc7c0ec00, rc 0) 00000100:00100000:2.0:1762166981.604637:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc3553800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+553:61884:x1847765450729344:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 545us (629us total) trans 4294992535 rc 0/0 00000100:00100000:2.0:1762166981.604644:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30882 00000100:00100000:0.0:1762166981.606537:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166981.606838:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450729600 00000100:00100000:1.0:1762166981.606846:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450729600 00000100:00100000:1.0:1762166981.606893:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30883 00000100:00100000:1.0:1762166981.606902:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb387100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+553:61884:x1847765450729600:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166981.606918:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166981.606931:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbacf89 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x61d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eaa0a expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.607013:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbacf90 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x61d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:1.0:1762166981.607027:0:30829:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7c0ec00/0x2f180c4effbacf7b lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x61d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa03 expref: 554 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.607124:0:30829:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbacf90 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x61d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166981.607160:0:30829:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7c0ec00/0x2f180c4effbacf7b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x61d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa03 expref: 554 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.607173:0:30829:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7c0ec00/0x2f180c4effbacf7b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x61d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa03 expref: 554 pid: 30829 timeout: 700 lvb_type: 0 00000100:00100000:1.0:1762166981.607187:0:30829:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a2b800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:30829:1847765449793920:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166981.607277:0:30829:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc350fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1762166981.609774:0:30829:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a2b800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:30829:1847765449793920:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166981.609812:0:30829:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbacf90 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x61d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000100:00100000:0.0:1762166981.611852:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.611967:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450729728 00000100:00100000:2.0:1762166981.611979:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450729728 00010000:00010000:2.0:1762166981.612037:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7c0ec00/0x2f180c4effbacf7b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x61d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa03 expref: 555 pid: 30829 timeout: 700 lvb_type: 0 00000100:00100000:2.0:1762166981.612112:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9824 00000100:00100000:2.0:1762166981.612126:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb384700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+555:2419:x1847765450729728:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166981.612147:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166981.612156:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7c0ec00/0x2f180c4effbacf7b lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x61d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa03 expref: 555 pid: 30829 timeout: 700 lvb_type: 0 00010000:00010000:2.0:1762166981.612172:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7c0ec00/0x2f180c4effbacf7b lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x61d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa03 expref: 555 pid: 30829 timeout: 700 lvb_type: 0 00010000:00010000:2.0:1762166981.612208:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc7c0ec00/0x2f180c4effbacf7b lrc: 0/0,0 mode: --/PR res: [0x240000404:0x61d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa03 expref: 555 pid: 30829 timeout: 700 lvb_type: 0 00010000:00010000:2.0:1762166981.612231:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x61d:0x0].0x0 (ffff945bc809b600) 00010000:00010000:2.0:1762166981.612237:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbacf90 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x61d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.612248:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbacf90 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x61d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.612255:0:6479:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbacf90 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x61d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.612294:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166981.612342:0:30829:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbacf90 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x61d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166981.612353:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbacf90 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x61d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000100:00100000:2.0:1762166981.612376:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb384700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+554:2419:x1847765450729728:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 254us (534us total) trans 0 rc 0/0 00000004:00200000:1.0:1762166981.612376:0:30829:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x61d:0x0]: returning size 0 00000100:00100000:2.0:1762166981.612389:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9824 00000004:00080000:1.0:1762166981.612664:0:30829:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xa92:0x0], index 0: 0 00000004:00080000:1.0:1762166981.612674:0:30829:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xa91:0x0], index 1: 0 00000100:00100000:2.0:1762166981.612713:0:9159:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5764e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:9159:1847765449794048:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1762166981.612771:0:9159:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166981.612824:0:9159:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cee171300 going to sleep for 11 seconds 00010000:00010000:1.0:1762166981.612828:0:30829:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbacf90 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x61d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166981.612839:0:30829:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbacf90 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x61d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166981.612847:0:30829:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbacf90 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x61d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166981.612854:0:30829:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355b400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166981.612859:0:30829:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbacf90 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x61d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166981.612868:0:30829:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbacf90 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x61d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166981.612878:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x61d:0x0].0x0 (ffff945bc809b600) 00010000:00010000:1.0:1762166981.612881:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166981.612885:0:30829:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbacf90 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x61d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166981.612896:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b400/0x2f180c4effbacf90 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x61d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00000100:00100000:3.0:1762166981.612932:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449794048 00000100:00100000:3.0:1762166981.612945:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449794048 00010000:00010000:1.0:1762166981.612966:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbacf89 lrc: 1/0,0 mode: --/CR res: [0x240000404:0x61d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa0a expref: 554 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.612979:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x61d:0x0].0x0 (ffff945bc809b600) 00010000:00010000:1.0:1762166981.612982:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1762166981.612985:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355bc00/0x2f180c4effbacf89 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x61d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa0a expref: 554 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.613004:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355bc00, rc 0) 00000100:00100000:3.0:1762166981.613019:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19454 00000100:00100000:3.0:1762166981.613037:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5765c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+38:9159:x1847765449794048:12345-0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1762166981.613062:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb387100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+553:61884:x1847765450729600:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 6157us (6525us total) trans 4294992536 rc 301/301 00000100:00100000:1.0:1762166981.613073:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30883 00002000:00080000:3.0:1762166981.613100:0:8383:0:(ofd_dev.c:1745:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2722 00000100:00100000:3.0:1762166981.614993:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5765c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+39:9159:x1847765449794048:12345-0@lo:5:osp-pre-0-1.0 Request processed in 1960us (2219us total) trans 21474843475 rc 0/0 00000100:00100000:3.0:1762166981.615004:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19454 00000100:00100000:2.0:1762166981.615143:0:9159:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5764e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:9159:1847765449794048:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1762166981.615158:0:9159:0:(osp_precreate.c:701:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0xa92:0x0]-[0x280000400:0xac1:0x0] 00000100:00100000:0.0:1762166981.615391:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166981.615830:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450729984 00000100:00100000:1.0:1762166981.615841:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450729984 00000100:00100000:1.0:1762166981.615907:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11990 00000100:00100000:1.0:1762166981.615919:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff2fd450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+553:61884:x1847765450729984:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:1.0:1762166981.616233:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff2fd450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e1e11365-ba0b-405b-99c9-a704373217f2+554:61884:x1847765450729984:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 316us (849us total) trans 4294992537 rc 0/0 00000100:00100000:1.0:1762166981.616241:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11990 00000100:00100000:2.0:1762166981.617935:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166981.618111:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450730112 00000100:00100000:0.0:1762166981.618118:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450730112 00000100:00100000:0.0:1762166981.618169:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30884 00000100:00100000:0.0:1762166981.618180:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5767800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+554:61884:x1847765450730112:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166981.618203:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166981.618230:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbacf9e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x61d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eaa11 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.618304:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbacfa5 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x61d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:0.0:1762166981.618318:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbacfa5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x61d:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.618329:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbacfa5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x61d:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000004:00200000:0.0:1762166981.618375:0:30829:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x61d:0x0]: returning size 0 00000004:00200000:0.0:1762166981.618380:0:30829:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166981.618400:0:30829:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbacfa5 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x61d:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.618424:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbacf9e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x61d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa11 expref: 556 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.618440:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbacfa5 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x61d:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa11 expref: 555 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.618446:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x61d:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:0.0:1762166981.618449:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1762166981.618452:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdee00, rc 0) 00000100:00100000:0.0:1762166981.618552:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5767800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+555:61884:x1847765450730112:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 373us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166981.618559:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30884 00000100:00100000:3.0:1762166981.620072:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.620158:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450730240 00000100:00100000:2.0:1762166981.620167:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450730240 00000100:00100000:2.0:1762166981.620215:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19455 00000100:00100000:2.0:1762166981.620225:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc3550e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+35:2417:x1847765450730240:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166981.620241:0:8383:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166981.620262:0:8383:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc5db8400/0x2f180c4effbacfac lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa92:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eaa18 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166981.620290:0:8383:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa92:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1762166981.620310:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166981.620313:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166981.620322:0:8383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc5db8400/0x2f180c4effbacfac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa18 expref: 36 pid: 8383 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166981.620340:0:8383:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc5db8400/0x2f180c4effbacfac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa18 expref: 36 pid: 8383 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166981.620353:0:8383:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc5db8400, rc 0) 00000100:00100000:2.0:1762166981.620414:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc3550e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+36:2417:x1847765450730240:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 191us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166981.620421:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19455 00000100:00100000:0.0:1762166981.620620:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166981.620701:0:35248:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450730368 00000100:00100000:3.0:1762166981.620706:0:35248:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450730368 00000100:00100000:3.0:1762166981.620743:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19456 00000100:00100000:3.0:1762166981.620752:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb385180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+17:2416:x1847765450730368:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166981.620762:0:35248:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166981.620776:0:35248:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62800/0x2f180c4effbacfb3 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa91:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eaa1f expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166981.620795:0:35248:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa91:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1762166981.620816:0:35248:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166981.620819:0:35248:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166981.620824:0:35248:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62800/0x2f180c4effbacfb3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa1f expref: 18 pid: 35248 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166981.620835:0:35248:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62800/0x2f180c4effbacfb3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa1f expref: 18 pid: 35248 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166981.620843:0:35248:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4b62800, rc 0) 00000100:00100000:3.0:1762166981.620883:0:35248:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb385180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+18:2416:x1847765450730368:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 133us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166981.620890:0:35248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19456 00000100:00100000:2.0:1762166981.622193:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166981.625929:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450730624 00000100:00100000:0.0:1762166981.625946:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450730624 00000100:00100000:0.0:1762166981.626033:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30885 00000100:00100000:0.0:1762166981.626047:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5766d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+555:61884:x1847765450730624:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166981.626074:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166981.626100:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbacfba lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eaa26 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.626237:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbacfc1 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:0.0:1762166981.626255:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbacfc1 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.626272:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbacfc1 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000004:00200000:0.0:1762166981.626286:0:30829:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 262144 00010000:00010000:0.0:1762166981.626432:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf200/0x2f180c4effbacfba lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa26 expref: 558 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.626452:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbacfc1 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa26 expref: 557 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.626462:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:0.0:1762166981.626465:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166981.626468:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdf600, rc 0) 00000100:00100000:0.0:1762166981.626598:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5766d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+557:61884:x1847765450730624:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 553us (4410us total) trans 4294992538 rc 0/0 00000100:00100000:0.0:1762166981.626608:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30885 00000100:00100000:2.0:1762166981.629406:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.629444:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.629523:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166981.629654:0:35248:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450730752 00000100:00100000:3.0:1762166981.629665:0:35248:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450730752 00000100:00100000:3.0:1762166981.629718:0:35248:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450730880 00000100:00100000:3.0:1762166981.629721:0:35248:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450730880 00000100:00100000:3.0:1762166981.629743:0:35248:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450731008 00000100:00100000:3.0:1762166981.629746:0:35248:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450731008 00000100:00100000:2.0:1762166981.629760:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19457 00000100:00100000:2.0:1762166981.629777:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5765f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450730752:12345-192.168.204.38@tcp:1:lfs.0 00000100:00100000:3.0:1762166981.629790:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19458 00000100:00100000:3.0:1762166981.629811:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5767480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+36:2419:x1847765450730880:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:3.0:1762166981.629844:0:35248:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc4b62c00/0x2f180c4effbacfd6 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.629844:0:9165:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc5db9200/0x2f180c4effbacfcf lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.629873:0:9165:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc5db9800/0x2f180c4effbace16 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 241664->262143) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea985 expref: 19 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.629877:0:35248:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc5db8200/0x2f180c4effbace39 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea99a expref: 36 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.629887:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166981.629892:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166981.629898:0:9165:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc5db9200/0x2f180c4effbacfcf lrc: 4/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.629901:0:35248:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166981.629905:0:35248:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166981.629910:0:35248:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4b62c00/0x2f180c4effbacfd6 lrc: 4/1,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.629953:0:9165:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc5db9800/0x2f180c4effbace16 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 241664->262143) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea985 expref: 19 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.629955:0:35248:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc5db8200/0x2f180c4effbace39 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea99a expref: 36 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.629980:0:9165:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc5db9800/0x2f180c4effbace16 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 241664->262143) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea985 expref: 19 pid: 8383 timeout: 700 lvb_type: 0 00010000:00010000:3.0:1762166981.629981:0:35248:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc5db8200/0x2f180c4effbace39 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea99a expref: 36 pid: 8383 timeout: 700 lvb_type: 0 00000100:00100000:0.0:1762166981.629983:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19459 00000100:00100000:0.0:1762166981.630001:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5767b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450731008:12345-192.168.204.38@tcp:1:lfs.0 00000100:00100000:3.0:1762166981.630021:0:35248:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cc3552a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:35248:1847765449794304:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166981.630021:0:9165:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc55dce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9165:1847765449794176:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166981.630030:0:8383:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde600/0x2f180c4effbacfdd lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.630047:0:8383:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62e00/0x2f180c4effbace40 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea9a1 expref: 19 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.630055:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166981.630057:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166981.630059:0:8383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde600/0x2f180c4effbacfdd lrc: 4/1,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.630083:0:8383:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62e00/0x2f180c4effbace40 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea9a1 expref: 19 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.630093:0:8383:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62e00/0x2f180c4effbace40 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea9a1 expref: 19 pid: 8383 timeout: 700 lvb_type: 0 00000100:00100000:0.0:1762166981.630105:0:8383:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcb384a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8383:1847765449794432:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166981.630137:0:35248:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d0116c540 going to sleep for 11 seconds 00000100:00100000:2.0:1762166981.630138:0:9165:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cee171300 going to sleep for 11 seconds 00000100:00100000:0.0:1762166981.630143:0:8383:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1fe20c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166981.631595:0:35248:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cc3552a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:35248:1847765449794304:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166981.631629:0:35248:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bc4b62c00/0x2f180c4effbacfd6 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166981.631659:0:9165:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc55dce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9165:1847765449794176:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166981.631665:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166981.631669:0:8383:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcb384a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8383:1847765449794432:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166981.631685:0:9165:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc5db9200/0x2f180c4effbacfcf lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166981.631716:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450731136 00010000:00010000:1.0:1762166981.631716:0:8383:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde600/0x2f180c4effbacfdd lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166981.631725:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166981.631728:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450731136 00010000:00010000:3.0:1762166981.631768:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc5db8200/0x2f180c4effbace39 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea99a expref: 37 pid: 8383 timeout: 700 lvb_type: 0 00000100:00100000:0.0:1762166981.631778:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450731264 00000100:00100000:0.0:1762166981.631785:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450731264 00010000:00010000:0.0:1762166981.631819:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62e00/0x2f180c4effbace40 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea9a1 expref: 20 pid: 8383 timeout: 700 lvb_type: 0 00000100:00100000:3.0:1762166981.631838:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9825 00000100:00100000:3.0:1762166981.631853:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+37:2419:x1847765450731136:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166981.631872:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1762166981.631873:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9826 00000100:00100000:0.0:1762166981.631884:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+20:2417:x1847765450731264:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166981.631895:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166981.631921:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62e00/0x2f180c4effbace40 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea9a1 expref: 20 pid: 8383 timeout: 700 lvb_type: 0 00010000:00010000:3.0:1762166981.631930:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc5db8200/0x2f180c4effbace39 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea99a expref: 37 pid: 8383 timeout: 700 lvb_type: 0 00010000:00010000:0.0:1762166981.631933:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62e00/0x2f180c4effbace40 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea9a1 expref: 20 pid: 8383 timeout: 700 lvb_type: 0 00010000:00010000:3.0:1762166981.631958:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc5db8200/0x2f180c4effbace39 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea99a expref: 37 pid: 8383 timeout: 700 lvb_type: 0 00010000:00010000:0.0:1762166981.631967:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62e00/0x2f180c4effbace40 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea9a1 expref: 20 pid: 8383 timeout: 700 lvb_type: 0 00010000:00010000:3.0:1762166981.631978:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc5db8200/0x2f180c4effbace39 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea99a expref: 37 pid: 8383 timeout: 700 lvb_type: 0 00010000:00010000:0.0:1762166981.631982:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166981.631985:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166981.631990:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde600/0x2f180c4effbacfdd lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.631996:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166981.631999:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166981.632003:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4b62c00/0x2f180c4effbacfd6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.632006:0:9458:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde600/0x2f180c4effbacfdd lrc: 4/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.632018:0:6479:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4b62c00/0x2f180c4effbacfd6 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.632036:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166981.632097:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+19:2417:x1847765450731264:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 213us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166981.632106:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9826 00010000:00010000:3.0:1762166981.632112:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1762166981.632138:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+36:2419:x1847765450731136:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 291us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166981.632146:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9825 00010000:00010000:3.0:1762166981.632173:0:35248:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bc4b62c00/0x2f180c4effbacfd6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.632182:0:35248:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4b62c00/0x2f180c4effbacfd6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.632208:0:35248:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc4b62c00/0x2f180c4effbacfd6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.632217:0:35248:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4b62c00/0x2f180c4effbacfd6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.632226:0:35248:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc4b62c00/0x2f180c4effbacfd6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.632234:0:35248:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4b62c00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166981.632239:0:35248:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4b62c00/0x2f180c4effbacfd6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.632249:0:35248:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4b62c00/0x2f180c4effbacfd6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.632266:0:35248:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc4b62c00/0x2f180c4effbacfd6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.632276:0:35248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4b62c00/0x2f180c4effbacfd6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.632288:0:8383:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde600/0x2f180c4effbacfdd lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.632303:0:8383:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde600/0x2f180c4effbacfdd lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166981.632314:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:1.0:1762166981.632338:0:8383:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde600/0x2f180c4effbacfdd lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.632350:0:8383:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde600/0x2f180c4effbacfdd lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.632360:0:8383:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde600/0x2f180c4effbacfdd lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166981.632360:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450731392 00000100:00100000:0.0:1762166981.632371:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450731392 00010000:00010000:1.0:1762166981.632380:0:8383:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bde600 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166981.632385:0:8383:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde600/0x2f180c4effbacfdd lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.632396:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc5db9800/0x2f180c4effbace16 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 241664->262143) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea985 expref: 19 pid: 8383 timeout: 700 lvb_type: 0 00000100:00100000:3.0:1762166981.632398:0:35248:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5767480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+35:2419:x1847765450730880:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 2593us (2946us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166981.632399:0:8383:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde600/0x2f180c4effbacfdd lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166981.632433:0:35248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19458 00000100:00100000:0.0:1762166981.632464:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9827 00010000:00010000:1.0:1762166981.632471:0:8383:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde600/0x2f180c4effbacfdd lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166981.632512:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450731392:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166981.632535:0:8383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bde600/0x2f180c4effbacfdd lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.632540:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166981.632563:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc5db9800/0x2f180c4effbace16 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 241664->262143) gid 0 flags: 0x60000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea985 expref: 19 pid: 8383 timeout: 700 lvb_type: 0 00010000:00010000:0.0:1762166981.632588:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc5db9800/0x2f180c4effbace16 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 241664->262143) gid 0 flags: 0x50000400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea985 expref: 19 pid: 8383 timeout: 700 lvb_type: 0 00010000:00010000:0.0:1762166981.632617:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc5db9800/0x2f180c4effbace16 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 241664->262143) gid 0 flags: 0x44801400020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea985 expref: 19 pid: 8383 timeout: 700 lvb_type: 0 00010000:00010000:0.0:1762166981.632629:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166981.632631:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166981.632634:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc5db9200/0x2f180c4effbacfcf lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.632643:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc5db9200/0x2f180c4effbacfcf lrc: 4/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166981.632648:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5767b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450731008:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 2649us (3120us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166981.632670:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19459 00010000:00010000:0.0:1762166981.632692:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166981.632723:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450731392:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 249us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166981.632732:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9827 00010000:00010000:3.0:1762166981.632836:0:9165:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc5db9200/0x2f180c4effbacfcf lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.632849:0:9165:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc5db9200/0x2f180c4effbacfcf lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.632866:0:9165:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc5db9200/0x2f180c4effbacfcf lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.632873:0:9165:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc5db9200/0x2f180c4effbacfcf lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.632880:0:9165:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc5db9200/0x2f180c4effbacfcf lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.632886:0:9165:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc5db9200 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166981.632890:0:9165:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc5db9200/0x2f180c4effbacfcf lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.632897:0:9165:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc5db9200/0x2f180c4effbacfcf lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.632908:0:9165:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc5db9200/0x2f180c4effbacfcf lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.632914:0:9165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc5db9200/0x2f180c4effbacfcf lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166981.633019:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5765f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+16:2419:x1847765450730752:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 3247us (3623us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166981.633029:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19457 00000100:00100000:2.0:1762166981.634661:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.634693:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.634727:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166981.634753:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450731520 00000100:00100000:3.0:1762166981.634762:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450731520 00000100:00100000:3.0:1762166981.634816:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450731648 00000100:00100000:3.0:1762166981.634821:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450731648 00000100:00100000:0.0:1762166981.634837:0:35248:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450731776 00000100:00100000:0.0:1762166981.634849:0:35248:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450731776 00000100:00100000:3.0:1762166981.634866:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19460 00000100:00100000:3.0:1762166981.634880:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+17:2417:x1847765450731520:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166981.634910:0:9165:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1762166981.634911:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19461 00000100:00100000:0.0:1762166981.634929:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+35:2416:x1847765450731648:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166981.634935:0:9165:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4b63a00/0x2f180c4effbacfe4 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eaa2d expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.634947:0:35248:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1762166981.634949:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19462 00002000:00010000:3.0:1762166981.634958:0:9165:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa77:0x0] initial LVB size: 262144, mtime: 0x690888c5, atime: 0x690888c5, ctime: 0x690888c5, blocks: 0x140 00000100:00100000:2.0:1762166981.634968:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+18:2417:x1847765450731776:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166981.634972:0:35248:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf200/0x2f180c4effbacfeb lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eaa34 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.634986:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166981.634991:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166981.634995:0:8382:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166981.635008:0:9165:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4b63a00/0x2f180c4effbacfe4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa2d expref: 18 pid: 9165 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166981.635015:0:8382:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc7c0f800/0x2f180c4effbacff2 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eaa3b expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1762166981.635017:0:35248:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa7a:0x0] initial LVB size: 0, mtime: 0x690888c5, atime: 0x690888c5, ctime: 0x690888c5, blocks: 0x1800 00010000:00010000:3.0:1762166981.635030:0:9165:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4b63a00/0x2f180c4effbacfe4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa2d expref: 18 pid: 9165 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166981.635046:0:35248:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00002000:00010000:2.0:1762166981.635047:0:8382:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa79:0x0] initial LVB size: 0, mtime: 0x690888c5, atime: 0x690888c5, ctime: 0x690888c5, blocks: 0x0 00010000:00010000:0.0:1762166981.635052:0:35248:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166981.635065:0:35248:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf200/0x2f180c4effbacfeb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa34 expref: 36 pid: 35248 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166981.635068:0:9165:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4b63a00, rc 0) 00010000:00010000:2.0:1762166981.635069:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166981.635076:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166981.635088:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc7c0f800/0x2f180c4effbacff2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa3b expref: 19 pid: 8382 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166981.635096:0:35248:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf200/0x2f180c4effbacfeb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa34 expref: 36 pid: 35248 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1762166981.635113:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+19:2417:x1847765450731520:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 235us (452us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166981.635114:0:35248:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdf200, rc 0) 00010000:00010000:2.0:1762166981.635128:0:8382:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc7c0f800/0x2f180c4effbacff2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa3b expref: 19 pid: 8382 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1762166981.635129:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19460 00010000:00010000:2.0:1762166981.635145:0:8382:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc7c0f800, rc 0) 00000100:00100000:0.0:1762166981.635161:0:35248:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+36:2416:x1847765450731648:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 236us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166981.635168:0:35248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19461 00000100:00100000:2.0:1762166981.635188:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+18:2417:x1847765450731776:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 223us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166981.635198:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19462 00000100:00100000:2.0:1762166981.660934:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166981.661113:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450731904 00000100:00100000:1.0:1762166981.661130:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450731904 00000100:00100000:1.0:1762166981.661207:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19463 00000100:00100000:1.0:1762166981.661218:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450731904:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:1.0:1762166981.661354:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450731904:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 138us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166981.661362:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19463 00000100:00100000:3.0:1762166981.663193:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166981.663298:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450732032 00000100:00100000:0.0:1762166981.663308:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450732032 00000100:00100000:0.0:1762166981.663358:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30886 00000100:00100000:0.0:1762166981.663365:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc3552a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+557:61884:x1847765450732032:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166981.663397:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166981.663424:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbacff9 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x61d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eaa42 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.663466:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbad000 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x61d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:0.0:1762166981.663514:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbad000 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x61d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.663533:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbad000 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x61d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.663666:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbacff9 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x61d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa42 expref: 559 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.663679:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbad000 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x61d:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa42 expref: 558 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.663687:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x61d:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:0.0:1762166981.663689:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1762166981.663692:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdf000, rc 0) 00000100:00100000:0.0:1762166981.663750:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc3552a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+558:61884:x1847765450732032:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 384us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166981.663757:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30886 00000100:00100000:2.0:1762166981.665738:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166981.665792:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450732288 00000100:00100000:0.0:1762166981.665833:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450732288 00000100:00100000:0.0:1762166981.665905:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30887 00000100:00100000:0.0:1762166981.665915:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+558:61884:x1847765450732288:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:0.0:1762166981.665982:0:30829:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166981.666013:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbacfa5 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x61d:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa11 expref: 558 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.666032:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x61d:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:0.0:1762166981.666036:0:30829:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166981.666252:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbad007 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x61d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:0.0:1762166981.666271:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbad007 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x61d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.666280:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbad007 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x61d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000001:00080000:0.0:1762166981.666354:0:30829:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992539 00000004:00010000:0.0:1762166981.666380:0:30829:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000007691756c reply state 00000000f72a74c2 transno 4294992540 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbad007 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x61d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.666394:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbad007 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x61d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.666400:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x61d:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:0.0:1762166981.666404:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762166981.666407:0:30829:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166981.666535:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+560:61884:x1847765450732288:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 620us (805us total) trans 4294992540 rc 0/0 00000100:00100000:0.0:1762166981.666544:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30887 00000020:00080000:0.0:1762166981.666551:0:30829:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1762166981.667858:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166981.667962:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450732416 00000100:00100000:0.0:1762166981.667971:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450732416 00000100:00100000:0.0:1762166981.668029:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30888 00000100:00100000:0.0:1762166981.668041:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc3551180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+560:61884:x1847765450732416:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166981.668067:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166981.668091:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbad00e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x61d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eaa49 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.668155:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbad00e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x61d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa49 expref: 561 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.668175:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbad00e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x61d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa49 expref: 561 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.668195:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x61d:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:0.0:1762166981.668198:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166981.668201:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bde200, rc 0) 00000100:00100000:0.0:1762166981.668263:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc3551180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+561:61884:x1847765450732416:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 225us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166981.668270:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30888 00000100:00100000:3.0:1762166981.669566:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166981.669630:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450732544 00000100:00100000:1.0:1762166981.669638:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450732544 00000100:00100000:1.0:1762166981.669696:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19464 00000100:00100000:1.0:1762166981.669711:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc3551c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+36:61884:x1847765450732544:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166981.669726:0:8383:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166981.669743:0:8383:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cc355bc00/0x2f180c4effbad015 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa92:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eaa50 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.669773:0:8383:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc5db8400/0x2f180c4effbacfac lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa92:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa18 expref: 37 pid: 8383 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166981.669781:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166981.669783:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166981.669787:0:8383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cc355bc00/0x2f180c4effbad015 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xa92:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa50 expref: 37 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.669842:0:8383:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc5db8400/0x2f180c4effbacfac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa92:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa18 expref: 37 pid: 8383 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166981.669858:0:8383:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc5db8400/0x2f180c4effbacfac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa92:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa18 expref: 37 pid: 8383 timeout: 700 lvb_type: 1 00000100:00100000:1.0:1762166981.669875:0:8383:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a2b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8383:1847765449794560:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166981.669985:0:8383:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7a77300 going to sleep for 11 seconds 00000100:00100000:1.0:1762166981.672355:0:8383:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a2b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8383:1847765449794560:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166981.672400:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:1.0:1762166981.672401:0:8383:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945cc355bc00/0x2f180c4effbad015 lrc: 3/0,0 mode: --/PW res: [0x280000400:0xa92:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa50 expref: 37 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.672425:0:8383:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355bc00, rc 0) 00000100:00100000:0.0:1762166981.672471:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450732672 00000100:00100000:0.0:1762166981.672515:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450732672 00000100:00100000:1.0:1762166981.672523:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc3551c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+38:61884:x1847765450732544:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2814us (2962us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166981.672538:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19464 00010000:00010000:0.0:1762166981.672570:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc5db8400/0x2f180c4effbacfac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa92:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa18 expref: 37 pid: 8383 timeout: 700 lvb_type: 1 00000100:00100000:0.0:1762166981.672617:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9828 00000100:00100000:0.0:1762166981.672628:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc3550380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+37:2419:x1847765450732672:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166981.672649:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166981.672655:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc5db8400/0x2f180c4effbacfac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa92:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa18 expref: 37 pid: 8383 timeout: 700 lvb_type: 1 00010000:00010000:0.0:1762166981.672670:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc5db8400/0x2f180c4effbacfac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa92:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa18 expref: 37 pid: 8383 timeout: 700 lvb_type: 1 00010000:00010000:0.0:1762166981.672698:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc5db8400/0x2f180c4effbacfac lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa92:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa18 expref: 37 pid: 8383 timeout: 700 lvb_type: 1 00010000:00010000:0.0:1762166981.672720:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166981.672722:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166981.672729:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945cc355bc00/0x2f180c4effbad015 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa92:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa50 expref: 36 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.672752:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cc355bc00/0x2f180c4effbad015 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa92:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa50 expref: 36 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.672795:0:6481:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff945cc355bc00/0x2f180c4effbad015 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa92:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa50 expref: 36 pid: 8383 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166981.672846:0:6481:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcb385500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6481:1847765449794688:192.168.204.38@tcp:105: 00000100:00100000:0.0:1762166981.672918:0:6481:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1fe2600 going to sleep for 11 seconds 00000100:00100000:0.0:1762166981.673921:0:6481:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcb385500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6481:1847765449794688:192.168.204.38@tcp:105: 00010000:00010000:0.0:1762166981.673939:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166981.673982:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc3550380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+36:2419:x1847765450732672:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1355us (1586us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166981.673992:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9828 00000100:00100000:3.0:1762166981.674120:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166981.674184:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450732800 00000100:00100000:1.0:1762166981.674192:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450732800 00000100:00100000:1.0:1762166981.674245:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19465 00000100:00100000:1.0:1762166981.674256:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4bdb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+18:61884:x1847765450732800:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166981.674274:0:8383:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166981.674293:0:8383:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cc355b400/0x2f180c4effbad01c lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa91:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eaa57 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.674433:0:8383:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62800/0x2f180c4effbacfb3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa91:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa1f expref: 19 pid: 35248 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166981.674442:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166981.674444:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166981.674448:0:8383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355b400/0x2f180c4effbad01c lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xa91:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa57 expref: 19 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.674516:0:8383:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62800/0x2f180c4effbacfb3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa91:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa1f expref: 19 pid: 35248 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1762166981.674533:0:8383:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62800/0x2f180c4effbacfb3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa91:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa1f expref: 19 pid: 35248 timeout: 700 lvb_type: 1 00000100:00100000:1.0:1762166981.674545:0:8383:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a2b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8383:1847765449794816:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166981.674615:0:8383:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7a77300 going to sleep for 11 seconds 00000100:00100000:2.0:1762166981.676018:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166981.676027:0:8383:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a2b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8383:1847765449794816:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166981.676059:0:8383:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945cc355b400/0x2f180c4effbad01c lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xa91:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa57 expref: 19 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.676079:0:8383:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355b400, rc 0) 00000100:00100000:0.0:1762166981.676080:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450732928 00000100:00100000:0.0:1762166981.676088:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450732928 00010000:00010000:0.0:1762166981.676118:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62800/0x2f180c4effbacfb3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa91:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa1f expref: 20 pid: 35248 timeout: 700 lvb_type: 1 00000100:00100000:1.0:1762166981.676130:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4bdb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:61884:x1847765450732800:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1874us (2008us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166981.676139:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19465 00000100:00100000:0.0:1762166981.676168:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9829 00000100:00100000:0.0:1762166981.676178:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ccec70c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450732928:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166981.676196:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166981.676203:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62800/0x2f180c4effbacfb3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa91:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa1f expref: 19 pid: 35248 timeout: 700 lvb_type: 1 00010000:00010000:0.0:1762166981.676215:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62800/0x2f180c4effbacfb3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa91:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa1f expref: 19 pid: 35248 timeout: 700 lvb_type: 1 00010000:00010000:0.0:1762166981.676238:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62800/0x2f180c4effbacfb3 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa91:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa1f expref: 19 pid: 35248 timeout: 700 lvb_type: 1 00010000:00010000:0.0:1762166981.676252:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166981.676254:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166981.676260:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945cc355b400/0x2f180c4effbad01c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa91:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa57 expref: 18 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.676271:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355b400/0x2f180c4effbad01c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa91:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa57 expref: 18 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.676304:0:6481:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff945cc355b400/0x2f180c4effbad01c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa91:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa57 expref: 18 pid: 8383 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166981.676318:0:6481:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcb385500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6481:1847765449794944:192.168.204.38@tcp:105: 00000100:00100000:0.0:1762166981.676364:0:6481:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf1fe2600 going to sleep for 11 seconds 00000100:00100000:0.0:1762166981.677997:0:6481:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcb385500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6481:1847765449794944:192.168.204.38@tcp:105: 00010000:00010000:0.0:1762166981.678019:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166981.678084:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ccec70c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450732928:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1907us (2074us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166981.678098:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9829 00000100:00100000:3.0:1762166981.678222:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166981.678262:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450733056 00000100:00100000:0.0:1762166981.678268:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450733056 00002000:00010000:0.0:1762166981.678306:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2706 (0->18446744073709551615) 00002000:00100000:0.0:1762166981.678311:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc7d22d80 with x1847765450733056 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166981.678322:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc7d22d80. 00000100:00100000:0.0:1762166981.678356:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2756 00000100:00100000:0.0:1762166981.678365:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+36:2418:x1847765450733056:12345-192.168.204.38@tcp:10:lfs.0 00000100:00100000:3.0:1762166981.678581:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166981.678614:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450733184 00000100:00100000:1.0:1762166981.678621:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450733184 00002000:00010000:0.0:1762166981.678632:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa92:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166981.678636:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa92:0x0] updating lvb mtime from disk: 0 -> 1762166981 00002000:00010000:0.0:1762166981.678639:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa92:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1762166981.678642:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2705 (0->18446744073709551615) 00002000:00010000:0.0:1762166981.678642:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa92:0x0] updating lvb ctime from disk: 0 -> 1762166981 00002000:00010000:0.0:1762166981.678645:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa92:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00100000:1.0:1762166981.678646:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc7d23b80 with x1847765450733184 ext(0->18446744073709551615) 00002000:00010000:1.0:1762166981.678652:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc7d23b80. 00000100:00100000:1.0:1762166981.678680:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2757 00000100:00100000:1.0:1762166981.678688:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7d23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450733184:12345-192.168.204.38@tcp:10:lfs.0 00000100:00100000:0.0:1762166981.678689:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+37:2418:x1847765450733056:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 326us (468us total) trans 21474843476 rc 0/0 00000100:00100000:0.0:1762166981.678697:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2756 00002000:00010000:0.0:1762166981.678701:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2706 (0->18446744073709551615) 00002000:00100000:0.0:1762166981.678703:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc7d22d80 with x1847765450733056 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166981.678708:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc7d22d80. 00002000:00010000:1.0:1762166981.678811:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa91:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166981.678815:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa91:0x0] updating lvb mtime from disk: 0 -> 1762166981 00002000:00010000:1.0:1762166981.678817:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa91:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1762166981.678819:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa91:0x0] updating lvb ctime from disk: 0 -> 1762166981 00002000:00010000:1.0:1762166981.678820:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa91:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1762166981.678849:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7d23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450733184:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 163us (282us total) trans 17179876742 rc 0/0 00000100:00100000:1.0:1762166981.678854:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2757 00002000:00010000:1.0:1762166981.678856:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2705 (0->18446744073709551615) 00002000:00100000:1.0:1762166981.678858:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc7d23b80 with x1847765450733184 ext(0->18446744073709551615) 00002000:00010000:1.0:1762166981.678862:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc7d23b80. 00000100:00100000:3.0:1762166981.681033:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166981.681114:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450733312 00000100:00100000:1.0:1762166981.681124:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450733312 00000100:00100000:1.0:1762166981.681182:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19466 00000100:00100000:1.0:1762166981.681192:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450733312:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:1.0:1762166981.681313:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450733312:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 122us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166981.681321:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19466 00000100:00100000:2.0:1762166981.682976:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166981.683094:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450733440 00000100:00100000:1.0:1762166981.683111:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450733440 00000100:00100000:1.0:1762166981.683186:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19467 00000100:00100000:1.0:1762166981.683197:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450733440:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:1.0:1762166981.683337:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450733440:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 142us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166981.683346:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19467 00000100:00100000:3.0:1762166981.685255:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166981.685344:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450733568 00000100:00100000:1.0:1762166981.685350:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450733568 00000100:00100000:1.0:1762166981.685402:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2758 00000100:00100000:1.0:1762166981.685411:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450733568:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:1.0:1762166981.685440:0:8388:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945cc355a400/0x2f180c4effbad023 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.685454:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166981.685456:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166981.685462:0:8388:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355a400/0x2f180c4effbad023 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.685474:0:8388:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cc355a400/0x2f180c4effbad023 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.685589:0:8388:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945cc355a400/0x2f180c4effbad023 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.685598:0:8388:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355a400/0x2f180c4effbad023 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.685606:0:8388:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945cc355a400/0x2f180c4effbad023 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.685618:0:8388:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355a400 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166981.685622:0:8388:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc355a400/0x2f180c4effbad023 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.685630:0:8388:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc355a400/0x2f180c4effbad023 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.685645:0:8388:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945cc355a400/0x2f180c4effbad023 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.685652:0:8388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cc355a400/0x2f180c4effbad023 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166981.685692:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450733568:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 282us (440us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1762166981.685699:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2758 00000100:00100000:3.0:1762166981.687413:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166981.687547:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450733696 00000100:00100000:1.0:1762166981.687557:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450733696 00000100:00100000:1.0:1762166981.687633:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2759 00000100:00100000:1.0:1762166981.687645:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+37:2418:x1847765450733696:12345-192.168.204.38@tcp:4:lfs.0 00010000:00010000:1.0:1762166981.687683:0:8388:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945cc355a600/0x2f180c4effbad02a lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa92:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.687706:0:8388:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945cc355bc00/0x2f180c4effbad015 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa92:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa50 expref: 37 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.687714:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166981.687716:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166981.687719:0:8388:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cc355a600/0x2f180c4effbad02a lrc: 4/0,1 mode: --/PW res: [0x280000400:0xa92:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.687758:0:8388:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945cc355bc00/0x2f180c4effbad015 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa92:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa50 expref: 37 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.687773:0:8388:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945cc355bc00/0x2f180c4effbad015 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa92:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa50 expref: 37 pid: 8383 timeout: 700 lvb_type: 0 00000100:00100000:1.0:1762166981.687790:0:8388:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a2b800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0000_UUID:8388:1847765449795072:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166981.687889:0:8388:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7a77300 going to sleep for 11 seconds 00000100:00100000:1.0:1762166981.689567:0:8388:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a2b800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0000_UUID:8388:1847765449795072:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166981.689606:0:8388:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945cc355a600/0x2f180c4effbad02a lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa92:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166981.689760:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166981.689886:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450733824 00000100:00100000:0.0:1762166981.689894:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450733824 00010000:00010000:0.0:1762166981.689927:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945cc355bc00/0x2f180c4effbad015 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa92:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa50 expref: 38 pid: 8383 timeout: 700 lvb_type: 0 00000100:00100000:0.0:1762166981.690008:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9830 00000100:00100000:0.0:1762166981.690022:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+38:2419:x1847765450733824:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166981.690039:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166981.690074:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945cc355bc00/0x2f180c4effbad015 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa92:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa50 expref: 38 pid: 8383 timeout: 700 lvb_type: 0 00010000:00010000:0.0:1762166981.690088:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945cc355bc00/0x2f180c4effbad015 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa92:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa50 expref: 38 pid: 8383 timeout: 700 lvb_type: 0 00010000:00010000:0.0:1762166981.690114:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cc355bc00/0x2f180c4effbad015 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa92:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480020020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa50 expref: 38 pid: 8383 timeout: 700 lvb_type: 0 00010000:00010000:0.0:1762166981.690130:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166981.690132:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166981.690137:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945cc355a600/0x2f180c4effbad02a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa92:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.690147:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cc355a600/0x2f180c4effbad02a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa92:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.690177:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166981.690237:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+37:2419:x1847765450733824:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 220us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166981.690247:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9830 00010000:00010000:1.0:1762166981.690291:0:8388:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945cc355a600/0x2f180c4effbad02a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa92:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.690308:0:8388:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cc355a600/0x2f180c4effbad02a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa92:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000001:00080000:3.0:1762166981.694170:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843477 is committed 00000001:00080000:3.0:1762166981.694190:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843475 is committed 00002000:00010000:1.0:1762166981.694413:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa92:0x0] updating lvb size from disk: 0 -> 4096 00002000:00010000:1.0:1762166981.694418:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa92:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1762166981.694428:0:8388:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945cc355a600/0x2f180c4effbad02a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa92:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.694439:0:8388:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945cc355a600/0x2f180c4effbad02a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa92:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.694448:0:8388:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945cc355a600/0x2f180c4effbad02a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa92:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.694455:0:8388:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355a600 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166981.694459:0:8388:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945cc355a600/0x2f180c4effbad02a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa92:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.694467:0:8388:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945cc355a600/0x2f180c4effbad02a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa92:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.694507:0:8388:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945cc355a600/0x2f180c4effbad02a lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa92:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.694515:0:8388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cc355a600/0x2f180c4effbad02a lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa92:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166981.694674:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+15:2418:x1847765450733696:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 7027us (7264us total) trans 21474843477 rc 0/0 00000100:00100000:1.0:1762166981.694685:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2759 00000100:00100000:3.0:1762166981.697357:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166981.697402:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450733952 00000100:00100000:1.0:1762166981.697410:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450733952 00000100:00100000:1.0:1762166981.697452:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19468 00000100:00100000:1.0:1762166981.697459:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:2417:x1847765450733952:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:1.0:1762166981.697570:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:2417:x1847765450733952:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 112us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166981.697574:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19468 00000100:00100000:2.0:1762166981.700811:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166981.700876:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450734080 00000100:00100000:1.0:1762166981.700884:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450734080 00000100:00100000:1.0:1762166981.700937:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19469 00000100:00100000:1.0:1762166981.700947:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+19:2417:x1847765450734080:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:1.0:1762166981.701062:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+19:2417:x1847765450734080:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 117us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166981.701070:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19469 00000100:00100000:3.0:1762166981.703022:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166981.703095:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450734208 00000100:00100000:1.0:1762166981.703100:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450734208 00000100:00100000:1.0:1762166981.703145:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2760 00000100:00100000:1.0:1762166981.703154:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:2416:x1847765450734208:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:1.0:1762166981.703203:0:8388:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945cc355a600/0x2f180c4effbad031 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.703218:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166981.703220:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166981.703225:0:8388:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355a600/0x2f180c4effbad031 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [122880->135167] (req 122880->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.703238:0:8388:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cc355a600/0x2f180c4effbad031 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [122880->135167] (req 122880->135167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.703329:0:8388:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945cc355a600/0x2f180c4effbad031 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [122880->135167] (req 122880->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.703338:0:8388:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355a600/0x2f180c4effbad031 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [122880->135167] (req 122880->135167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.703346:0:8388:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945cc355a600/0x2f180c4effbad031 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [122880->135167] (req 122880->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.703353:0:8388:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355a600 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166981.703357:0:8388:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc355a600/0x2f180c4effbad031 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [122880->135167] (req 122880->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.703366:0:8388:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc355a600/0x2f180c4effbad031 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [122880->135167] (req 122880->135167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.703380:0:8388:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945cc355a600/0x2f180c4effbad031 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [122880->135167] (req 122880->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.703387:0:8388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cc355a600/0x2f180c4effbad031 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [122880->135167] (req 122880->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166981.703442:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:2416:x1847765450734208:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 288us (422us total) trans 0 rc 12288/12288 00000100:00100000:1.0:1762166981.703449:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2760 00000100:00100000:3.0:1762166981.705450:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166981.705585:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450734336 00000100:00100000:1.0:1762166981.705596:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450734336 00000100:00100000:1.0:1762166981.705663:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2761 00000100:00100000:1.0:1762166981.705674:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+15:2416:x1847765450734336:12345-192.168.204.38@tcp:4:lfs.0 00002000:00010000:1.0:1762166981.705729:0:8388:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa92:0x0] initial LVB size: 4096, mtime: 0x690888c5, atime: 0x0, ctime: 0x690888c5, blocks: 0x8 00010000:00010000:1.0:1762166981.705740:0:8388:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945cc355a400/0x2f180c4effbad038 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa92:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.705755:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166981.705758:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166981.705765:0:8388:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cc355a400/0x2f180c4effbad038 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa92:0x0].0x0 rrc: 2 type: EXT [122880->135167] (req 122880->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.705780:0:8388:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cc355a400/0x2f180c4effbad038 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa92:0x0].0x0 rrc: 2 type: EXT [122880->135167] (req 122880->135167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000001:00080000:3.0:1762166981.708388:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843478 is committed 00002000:00010000:1.0:1762166981.708536:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa92:0x0] updating lvb size from disk: 4096 -> 135168 00002000:00010000:1.0:1762166981.708541:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa92:0x0] updating lvb blocks from disk: 8 -> 32 00010000:00010000:1.0:1762166981.708554:0:8388:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945cc355a400/0x2f180c4effbad038 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa92:0x0].0x0 rrc: 2 type: EXT [122880->135167] (req 122880->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.708567:0:8388:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945cc355a400/0x2f180c4effbad038 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa92:0x0].0x0 rrc: 2 type: EXT [122880->135167] (req 122880->135167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.708576:0:8388:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945cc355a400/0x2f180c4effbad038 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa92:0x0].0x0 rrc: 2 type: EXT [122880->135167] (req 122880->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.708584:0:8388:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355a400 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166981.708589:0:8388:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945cc355a400/0x2f180c4effbad038 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa92:0x0].0x0 rrc: 2 type: EXT [122880->135167] (req 122880->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.708598:0:8388:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945cc355a400/0x2f180c4effbad038 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa92:0x0].0x0 rrc: 2 type: EXT [122880->135167] (req 122880->135167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.708618:0:8388:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945cc355a400/0x2f180c4effbad038 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa92:0x0].0x0 rrc: 2 type: EXT [122880->135167] (req 122880->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.708626:0:8388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cc355a400/0x2f180c4effbad038 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa92:0x0].0x0 rrc: 2 type: EXT [122880->135167] (req 122880->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166981.708738:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+15:2416:x1847765450734336:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 3061us (3292us total) trans 21474843478 rc 0/0 00000100:00100000:1.0:1762166981.708749:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2761 00000100:00100000:2.0:1762166981.710434:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166981.710668:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450734464 00000100:00100000:1.0:1762166981.710683:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450734464 00000100:00100000:1.0:1762166981.710990:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19470 00000100:00100000:1.0:1762166981.711003:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+19:2417:x1847765450734464:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:1.0:1762166981.711160:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+19:2417:x1847765450734464:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 160us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166981.711169:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19470 00000100:00100000:3.0:1762166981.713138:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166981.713193:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450734592 00000100:00100000:1.0:1762166981.713202:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450734592 00000100:00100000:1.0:1762166981.713244:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19471 00000100:00100000:1.0:1762166981.713252:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450734592:12345-192.168.204.38@tcp:23:lfs.0 00000100:00100000:1.0:1762166981.713331:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450734592:12345-192.168.204.38@tcp:23:lfs.0 Request processed in 80us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166981.713338:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19471 00000100:00100000:3.0:1762166981.715101:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166981.715224:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450734720 00000100:00100000:1.0:1762166981.715235:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450734720 00000100:00100000:1.0:1762166981.715314:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2762 00000100:00100000:1.0:1762166981.715325:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:2416:x1847765450734720:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:1.0:1762166981.715367:0:8388:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945cc355a600/0x2f180c4effbad03f lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.715391:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166981.715394:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166981.715400:0:8388:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355a600/0x2f180c4effbad03f lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [155648->262143] (req 155648->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.715418:0:8388:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cc355a600/0x2f180c4effbad03f lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [155648->262143] (req 155648->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.718245:0:8388:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945cc355a600/0x2f180c4effbad03f lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [155648->262143] (req 155648->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.718259:0:8388:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355a600/0x2f180c4effbad03f lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [155648->262143] (req 155648->262143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.718265:0:8388:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945cc355a600/0x2f180c4effbad03f lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [155648->262143] (req 155648->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.718269:0:8388:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355a600 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166981.718272:0:8388:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc355a600/0x2f180c4effbad03f lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [155648->262143] (req 155648->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.718278:0:8388:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc355a600/0x2f180c4effbad03f lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [155648->262143] (req 155648->262143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.718291:0:8388:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945cc355a600/0x2f180c4effbad03f lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [155648->262143] (req 155648->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.718318:0:8388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cc355a600/0x2f180c4effbad03f lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [155648->262143] (req 155648->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166981.718397:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:2416:x1847765450734720:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 3071us (3300us total) trans 0 rc 106496/106496 00000100:00100000:1.0:1762166981.718408:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2762 00000100:00100000:3.0:1762166981.720725:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166981.720778:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450734848 00000100:00100000:1.0:1762166981.720790:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450734848 00000100:00100000:1.0:1762166981.720939:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2763 00000100:00100000:1.0:1762166981.720951:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+15:2417:x1847765450734848:12345-192.168.204.38@tcp:4:lfs.0 00002000:00010000:1.0:1762166981.721005:0:8388:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa92:0x0] initial LVB size: 135168, mtime: 0x690888c5, atime: 0x0, ctime: 0x690888c5, blocks: 0x20 00010000:00010000:1.0:1762166981.721014:0:8388:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945cc355a400/0x2f180c4effbad046 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa92:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.721026:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166981.721028:0:8388:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166981.721034:0:8388:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cc355a400/0x2f180c4effbad046 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa92:0x0].0x0 rrc: 2 type: EXT [155648->262143] (req 155648->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.721048:0:8388:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cc355a400/0x2f180c4effbad046 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa92:0x0].0x0 rrc: 2 type: EXT [155648->262143] (req 155648->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000001:00080000:3.0:1762166981.726268:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843479 is committed 00002000:00010000:1.0:1762166981.726360:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa92:0x0] updating lvb size from disk: 135168 -> 262144 00002000:00010000:1.0:1762166981.726365:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa92:0x0] updating lvb blocks from disk: 32 -> 240 00010000:00010000:1.0:1762166981.726375:0:8388:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945cc355a400/0x2f180c4effbad046 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa92:0x0].0x0 rrc: 2 type: EXT [155648->262143] (req 155648->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.726386:0:8388:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945cc355a400/0x2f180c4effbad046 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa92:0x0].0x0 rrc: 2 type: EXT [155648->262143] (req 155648->262143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.726401:0:8388:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945cc355a400/0x2f180c4effbad046 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa92:0x0].0x0 rrc: 2 type: EXT [155648->262143] (req 155648->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.726408:0:8388:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355a400 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166981.726413:0:8388:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945cc355a400/0x2f180c4effbad046 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa92:0x0].0x0 rrc: 2 type: EXT [155648->262143] (req 155648->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.726421:0:8388:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945cc355a400/0x2f180c4effbad046 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa92:0x0].0x0 rrc: 2 type: EXT [155648->262143] (req 155648->262143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.726438:0:8388:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945cc355a400/0x2f180c4effbad046 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa92:0x0].0x0 rrc: 2 type: EXT [155648->262143] (req 155648->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.726446:0:8388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cc355a400/0x2f180c4effbad046 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa92:0x0].0x0 rrc: 2 type: EXT [155648->262143] (req 155648->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8388 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166981.726566:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+15:2417:x1847765450734848:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 5613us (5847us total) trans 21474843479 rc 0/0 00000100:00100000:1.0:1762166981.726575:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2763 00000100:00100000:2.0:1762166981.729630:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166981.729693:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450735104 00000100:00100000:0.0:1762166981.729706:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450735104 00000100:00100000:0.0:1762166981.729773:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30889 00000100:00100000:0.0:1762166981.729783:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+561:61884:x1847765450735104:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:0.0:1762166981.730080:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbad04d lrc: 3/0,1 mode: --/PW res: [0x240000404:0x61d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:0.0:1762166981.730101:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbad04d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x61d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.730114:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbad04d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x61d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000001:00080000:0.0:1762166981.730165:0:30829:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992541 00000004:00010000:0.0:1762166981.730191:0:30829:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000473b9317 reply state 00000000d926370c transno 4294992542 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbad04d lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x61d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.730205:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbad04d lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x61d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.730213:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x61d:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:0.0:1762166981.730217:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762166981.730221:0:30829:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166981.730316:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+564:61884:x1847765450735104:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 535us (699us total) trans 4294992542 rc 0/0 00000100:00100000:0.0:1762166981.730322:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30889 00000020:00080000:0.0:1762166981.730327:0:30829:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1762166981.731246:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166981.731306:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450735232 00000100:00100000:1.0:1762166981.731321:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450735232 00000100:00100000:1.0:1762166981.731387:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19472 00000100:00100000:1.0:1762166981.731399:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+15:61884:x1847765450735232:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166981.731418:0:8382:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166981.731436:0:8382:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cc355a600/0x2f180c4effbad054 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa92:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eaa5e expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1762166981.731464:0:8382:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa92:0x0] initial LVB size: 262144, mtime: 0x690888c5, atime: 0x0, ctime: 0x690888c5, blocks: 0xf0 00010000:00010000:1.0:1762166981.731523:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166981.731526:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166981.731534:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cc355a600/0x2f180c4effbad054 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa5e expref: 16 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.731553:0:8382:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945cc355a600/0x2f180c4effbad054 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa5e expref: 16 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.731567:0:8382:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355a600, rc 0) 00000100:00100000:1.0:1762166981.731631:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1e11365-ba0b-405b-99c9-a704373217f2+16:61884:x1847765450735232:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 234us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166981.731647:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19472 00000100:00100000:3.0:1762166981.732847:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166981.732928:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166981.733067:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450735360 00000100:00100000:0.0:1762166981.733079:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450735360 00000100:00100000:1.0:1762166981.733114:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450735488 00002000:00010000:0.0:1762166981.733119:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2706 (262144->18446744073709551615) 00000100:00100000:1.0:1762166981.733124:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450735488 00002000:00100000:0.0:1762166981.733126:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc7b23100 with x1847765450735360 ext(262144->18446744073709551615) 00002000:00010000:0.0:1762166981.733140:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc7b23100. 00002000:00010000:1.0:1762166981.733155:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2705 (0->18446744073709551615) 00002000:00100000:1.0:1762166981.733161:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bccb7ea00 with x1847765450735488 ext(0->18446744073709551615) 00002000:00010000:1.0:1762166981.733176:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bccb7ea00. 00000100:00100000:0.0:1762166981.733192:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2764 00000100:00100000:0.0:1762166981.733205:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+16:2419:x1847765450735360:12345-192.168.204.38@tcp:10:lfs.0 00000100:00100000:1.0:1762166981.733216:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2765 00000100:00100000:1.0:1762166981.733230:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450735488:12345-192.168.204.38@tcp:10:lfs.0 00002000:00010000:0.0:1762166981.733415:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa92:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:0.0:1762166981.733418:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa92:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00010000:0.0:1762166981.733421:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa92:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1762166981.733424:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa92:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00002000:00010000:0.0:1762166981.733426:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa92:0x0] updating lvb blocks from disk: 240 -> 240 00002000:00010000:1.0:1762166981.733430:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa91:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166981.733435:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa91:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00010000:1.0:1762166981.733438:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa91:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1762166981.733440:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa91:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00002000:00010000:1.0:1762166981.733443:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa91:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1762166981.733515:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450735488:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 287us (584us total) trans 17179876743 rc 0/0 00000100:00100000:0.0:1762166981.733524:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450735360:12345-192.168.204.38@tcp:10:lfs.0 Request processed in 278us (637us total) trans 21474843480 rc 0/0 00000100:00100000:1.0:1762166981.733530:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2765 00002000:00010000:1.0:1762166981.733541:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2705 (0->18446744073709551615) 00000100:00100000:0.0:1762166981.733549:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2764 00002000:00100000:1.0:1762166981.733550:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bccb7ea00 with x1847765450735488 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166981.733556:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2706 (262144->18446744073709551615) 00002000:00010000:1.0:1762166981.733558:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bccb7ea00. 00002000:00100000:0.0:1762166981.733562:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc7b23100 with x1847765450735360 ext(262144->18446744073709551615) 00002000:00010000:0.0:1762166981.733572:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc7b23100. 00000100:00100000:2.0:1762166981.734844:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166981.734914:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450735616 00000100:00100000:0.0:1762166981.734922:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450735616 00000100:00100000:0.0:1762166981.734967:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30890 00000100:00100000:0.0:1762166981.734978:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5807480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+564:61884:x1847765450735616:12345-192.168.204.38@tcp:44:lfs.0 00000001:00080000:2.0:1762166981.736673:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294992542 is committed 00000004:00080000:2.0:1762166981.736718:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3321 committed 00010000:00010000:0.0:1762166981.736722:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbace2b lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00000004:00080000:2.0:1762166981.736732:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3318 committed 00010000:00010000:0.0:1762166981.736740:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbace2b lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.736759:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbace2b lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00000020:00080000:2.0:1762166981.736760:0:7412:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff945bc350f6c0 refcount 2 committed 0 result 0 batchid 64 00000020:00080000:2.0:1762166981.736769:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cf1d0e000 obd lustre-OST0001-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff945cf3a33f00 00000020:00080000:2.0:1762166981.736780:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cf1d0e900 obd lustre-OST0000-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff945bc350f9c0 00010000:00010000:0.0:1762166981.736782:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdec00 already unused, calling callback (ffffffffc18e2310) 00000020:00080000:2.0:1762166981.736784:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cf1d0ea00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff945cff20e800 00000020:00080000:2.0:1762166981.736789:0:7412:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000400:0x2:0x0].63 00010000:00010000:0.0:1762166981.736792:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbace2b lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.736813:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbace2b lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.736837:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:0.0:1762166981.736842:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166981.736848:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbace2b lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.736855:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdec00/0x2f180c4effbace2b lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.736876:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbacf3c lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00000100:00100000:1.0:1762166981.736881:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:0.0:1762166981.736882:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbacf3c lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00000020:00080000:2.0:1762166981.736887:0:7435:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 64 committed batchid 63 00010000:00010000:0.0:1762166981.736894:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbacf3c lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00000100:00100000:1.0:1762166981.736903:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449795200:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1762166981.736904:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdfe00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166981.736910:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbacf3c lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.736918:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbacf3c lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.736930:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:0.0:1762166981.736933:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166981.736936:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbacf3c lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.736941:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbacf3c lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.736954:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbad007 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x61d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.736961:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbad007 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x61d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00000020:00080000:2.0:1762166981.736970:0:7435:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 63 00000100:00100000:1.0:1762166981.736970:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1762166981.736972:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbad007 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x61d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.736987:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bde400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166981.736991:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbad007 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x61d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.736997:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbad007 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x61d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.737007:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x61d:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:0.0:1762166981.737010:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166981.737014:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbad007 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x61d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.737020:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde400/0x2f180c4effbad007 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x61d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.737033:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbad04d lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x61d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00000100:00100000:1.0:1762166981.737064:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449795200 00000100:00100000:1.0:1762166981.737072:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449795200 00010000:00010000:0.0:1762166981.737095:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbad04d lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x61d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.737106:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbad04d lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x61d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.737112:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdee00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166981.737118:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbad04d lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x61d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.737126:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbad04d lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x61d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30829 initiator: MDT1 00000100:00100000:1.0:1762166981.737129:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19473 00000100:00100000:1.0:1762166981.737148:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1847765449795200:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1762166981.737154:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x61d:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:0.0:1762166981.737161:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166981.737162:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5807480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+530:61884:x1847765450735616:12345-192.168.204.38@tcp:44:lfs.0 Request processed in 2180us (2319us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166981.737166:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbad04d lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x61d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00002000:00080000:1.0:1762166981.737174:0:8382:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:2705 count 1 00010000:00010000:0.0:1762166981.737177:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbad04d lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x61d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00000100:00100000:2.0:1762166981.737183:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30890 00010000:00010000:1.0:1762166981.737208:0:8382:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945cc355ac00/0x2f180c4effbad05b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa91:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.737228:0:8382:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc56eae00/0x2f180c4effbac9af lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa91:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea7c5 expref: 16 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.737236:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166981.737239:0:8382:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166981.737243:0:8382:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cc355ac00/0x2f180c4effbad05b lrc: 4/0,1 mode: --/PW res: [0x280000400:0xa91:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.737272:0:8382:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc56eae00/0x2f180c4effbac9af lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa91:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea7c5 expref: 16 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.737293:0:8382:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc56eae00/0x2f180c4effbac9af lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa91:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea7c5 expref: 16 pid: 9165 timeout: 700 lvb_type: 0 00000100:00100000:1.0:1762166981.737306:0:8382:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a2b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8382:1847765449795328:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166981.737337:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bccb7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449795456:0@lo:6:osp-syn-1-1.0 00000100:00100000:1.0:1762166981.737388:0:8382:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7a77300 going to sleep for 11 seconds 00000100:00100000:0.0:1762166981.737415:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166981.737615:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449795456 00000100:00100000:3.0:1762166981.737622:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449795456 00000100:00100000:3.0:1762166981.737662:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19474 00000100:00100000:3.0:1762166981.737670:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3d59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1847765449795456:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1762166981.737683:0:8383:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:2704 count 1 00010000:00010000:3.0:1762166981.737736:0:8383:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62c00/0x2f180c4effbad062 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.737755:0:8383:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbace01 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea977 expref: 19 pid: 35247 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166981.737762:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166981.737764:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166981.737767:0:8383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62c00/0x2f180c4effbad062 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.737790:0:8383:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbace01 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea977 expref: 19 pid: 35247 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166981.737813:0:8383:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbace01 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea977 expref: 19 pid: 35247 timeout: 700 lvb_type: 1 00000100:00100000:3.0:1762166981.737825:0:8383:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bccb7dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8383:1847765449795584:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166981.737883:0:8383:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d0116c540 going to sleep for 11 seconds 00000100:00100000:2.0:1762166981.738853:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166981.738895:0:8382:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a2b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8382:1847765449795328:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166981.738897:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:1.0:1762166981.738930:0:8382:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945cc355ac00/0x2f180c4effbad05b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa91:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166981.738941:0:35248:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450735744 00000100:00100000:3.0:1762166981.738951:0:35248:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450735744 00000100:00100000:0.0:1762166981.738957:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450735872 00000100:00100000:0.0:1762166981.738965:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450735872 00000100:00100000:2.0:1762166981.738998:0:8383:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bccb7dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8383:1847765449795584:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166981.739016:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19475 00000100:00100000:0.0:1762166981.739027:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19476 00010000:00010000:2.0:1762166981.739028:0:8383:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62c00/0x2f180c4effbad062 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166981.739033:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5805500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+17:2417:x1847765450735744:12345-192.168.204.38@tcp:16:lfs.0 00000100:00100000:0.0:1762166981.739045:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5807b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+20:2417:x1847765450735872:12345-192.168.204.38@tcp:16:lfs.0 00000100:00100000:2.0:1762166981.739095:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.739159:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166981.739162:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450736128 00000100:00100000:1.0:1762166981.739170:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450736128 00000100:00100000:2.0:1762166981.739199:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450736000 00010000:00010000:1.0:1762166981.739200:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbace01 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea977 expref: 21 pid: 35247 timeout: 700 lvb_type: 1 00000100:00100000:2.0:1762166981.739212:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450736000 00010000:00010000:2.0:1762166981.739245:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc56eae00/0x2f180c4effbac9af lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa91:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea7c5 expref: 18 pid: 9165 timeout: 700 lvb_type: 0 00000100:00100000:1.0:1762166981.739245:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9831 00000100:00100000:1.0:1762166981.739265:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5806d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450736128:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166981.739280:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166981.739288:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbace01 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea977 expref: 21 pid: 35247 timeout: 700 lvb_type: 1 00000100:00100000:2.0:1762166981.739295:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9832 00000100:00100000:2.0:1762166981.739315:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5807100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450736000:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166981.739320:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbace01 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea977 expref: 21 pid: 35247 timeout: 700 lvb_type: 1 00010000:00010000:2.0:1762166981.739332:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166981.739342:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc56eae00/0x2f180c4effbac9af lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa91:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea7c5 expref: 18 pid: 9165 timeout: 700 lvb_type: 0 00010000:00010000:1.0:1762166981.739350:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdfc00/0x2f180c4effbace01 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa90:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea977 expref: 21 pid: 35247 timeout: 700 lvb_type: 1 00010000:00010000:2.0:1762166981.739363:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc56eae00/0x2f180c4effbac9af lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa91:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea7c5 expref: 18 pid: 9165 timeout: 700 lvb_type: 0 00010000:00010000:1.0:1762166981.739369:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166981.739374:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166981.739379:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62c00/0x2f180c4effbad062 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.739389:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62c00/0x2f180c4effbad062 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.739392:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc56eae00/0x2f180c4effbac9af lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa91:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea7c5 expref: 18 pid: 9165 timeout: 700 lvb_type: 0 00010000:00010000:2.0:1762166981.739430:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166981.739433:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166981.739437:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945cc355ac00/0x2f180c4effbad05b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa91:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.739444:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166981.739447:0:6479:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cc355ac00/0x2f180c4effbad05b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa91:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.739506:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166981.739537:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5806d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450736128:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 272us (438us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166981.739542:0:8383:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62c00/0x2f180c4effbad062 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.739553:0:8383:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62c00/0x2f180c4effbad062 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166981.739557:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9831 00000100:00100000:2.0:1762166981.739559:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5807100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450736000:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 238us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166981.739584:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9832 00010000:00010000:3.0:1762166981.739586:0:8383:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62c00/0x2f180c4effbad062 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.739593:0:8383:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62c00/0x2f180c4effbad062 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.739631:0:8382:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945cc355ac00/0x2f180c4effbad05b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.739643:0:8382:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cc355ac00/0x2f180c4effbad05b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.739652:0:8382:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945cc355ac00/0x2f180c4effbad05b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.739660:0:8382:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945cc355ac00/0x2f180c4effbad05b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.739686:0:8382:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166981.739700:0:8383:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1762166981.739710:0:10257:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1762166981.739720:0:6482:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1762166981.739722:0:10257:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945cc355ac00/0x2f180c4effbad05b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.739727:0:6482:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62c00/0x2f180c4effbad062 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.739742:0:10257:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355ac00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166981.739744:0:6482:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4b62c00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166981.739750:0:10257:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945cc355ac00/0x2f180c4effbad05b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.739751:0:6482:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62c00/0x2f180c4effbad062 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.739776:0:10257:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945cc355ac00/0x2f180c4effbad05b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.739795:0:10257:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945cc355ac00/0x2f180c4effbad05b lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.739822:0:10257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cc355ac00/0x2f180c4effbad05b lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.739836:0:6482:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62c00/0x2f180c4effbad062 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.739854:0:6482:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62c00/0x2f180c4effbad062 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.739863:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62c00/0x2f180c4effbad062 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.739881:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166981.739885:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166981.739889:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166981.739908:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166981.739912:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166981.739915:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166981.740011:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3636:x1847765449795200:12345-0@lo:6:osp-syn-0-1.0 Request processed in 2864us (3040us total) trans 21474843481 rc 0/0 00000100:00100000:1.0:1762166981.740030:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19473 00000100:00100000:1.0:1762166981.740120:0:3636:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 21474843475 gen 2 00000004:00080000:1.0:1762166981.740126:0:3636:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 21474843424 committed transno 21474843475 00000004:00080000:1.0:1762166981.740143:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf1cd3480, transno 21474843425 00000004:00080000:1.0:1762166981.740159:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf1cd0380, transno 21474843426 00000004:00080000:1.0:1762166981.740163:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf1cd3800, transno 21474843427 00000004:00080000:1.0:1762166981.740169:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc2d5ea00, transno 21474843428 00000004:00080000:1.0:1762166981.740172:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc5765500, transno 21474843431 00000004:00080000:1.0:1762166981.740175:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc5764a80, transno 21474843432 00000004:00080000:1.0:1762166981.740178:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc4011180, transno 21474843433 00000004:00080000:1.0:1762166981.740181:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf3db7800, transno 21474843438 00000004:00080000:1.0:1762166981.740185:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bcce74a80, transno 21474843439 00000004:00080000:1.0:1762166981.740189:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf3db5500, transno 21474843440 00000004:00080000:1.0:1762166981.740192:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf783fb80, transno 21474843441 00000004:00080000:1.0:1762166981.740197:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf783f100, transno 21474843442 00000004:00080000:1.0:1762166981.740204:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bcce75c00, transno 21474843443 00000004:00080000:1.0:1762166981.740214:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf783ea00, transno 21474843445 00000004:00080000:1.0:1762166981.740225:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf783d180, transno 21474843446 00000004:00080000:1.0:1762166981.740238:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf783ce00, transno 21474843447 00000004:00080000:1.0:1762166981.740248:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc70b0e00, transno 21474843452 00000004:00080000:1.0:1762166981.740254:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc70b0380, transno 21474843453 00000004:00080000:1.0:1762166981.740264:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc70b0700, transno 21474843454 00000004:00080000:1.0:1762166981.740270:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945ceda2d500, transno 21474843455 00000004:00080000:1.0:1762166981.740274:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945ceda2e680, transno 21474843456 00000004:00080000:1.0:1762166981.740279:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945ceda2c380, transno 21474843457 00000004:00080000:1.0:1762166981.740285:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc4532300, transno 21474843460 00000004:00080000:1.0:1762166981.740289:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc4530e00, transno 21474843461 00000004:00080000:1.0:1762166981.740293:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc4531880, transno 21474843462 00000004:00080000:1.0:1762166981.740300:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc406e680, transno 21474843466 00000004:00080000:1.0:1762166981.740303:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc406dc00, transno 21474843467 00000004:00080000:1.0:1762166981.740309:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc406f480, transno 21474843468 00000004:00080000:1.0:1762166981.740315:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc4bd8380, transno 21474843469 00000004:00080000:1.0:1762166981.740320:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc406ce00, transno 21474843470 00000004:00080000:1.0:1762166981.740326:0:3636:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc4bd8700, transno 21474843471 00000004:00080000:1.0:1762166981.740335:0:3636:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 21474843473 committed transno 21474843475 00000001:00080000:3.0:1762166981.740377:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876743 is committed 00000100:00100000:1.0:1762166981.740377:0:3636:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff945bc4a2b800 x1847765449795200/t21474843481(21474843481) o6->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 544/432 e 0 to 0 dl 1762166997 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1762166981.740392:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc4a2b800/2, rc 0, transno 21474843481 00000100:00100000:1.0:1762166981.740404:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449795200:0@lo:6:osp-syn-0-1.0 00000100:00100000:2.0:1762166981.740417:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3d59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3636:x1847765449795456:12345-0@lo:6:osp-syn-1-1.0 Request processed in 2743us (2999us total) trans 17179876744 rc 0/0 00000001:00080000:3.0:1762166981.740423:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843480 is committed 00000100:00100000:2.0:1762166981.740431:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19474 00000100:00100000:1.0:1762166981.740453:0:3636:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 17179876733 gen 2 00000004:00080000:1.0:1762166981.740460:0:3636:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 17179876733 committed transno 17179876733 00000100:00100000:3.0:1762166981.740563:0:35248:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5805500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+15:2417:x1847765450735744:12345-192.168.204.38@tcp:16:lfs.0 Request processed in 1531us (1710us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166981.740573:0:3636:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff945bccb7f800 x1847765449795456/t17179876744(17179876744) o6->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 544/432 e 0 to 0 dl 1762166997 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1762166981.740577:0:35248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19475 00000004:00080000:1.0:1762166981.740594:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bccb7f800/2, rc 0, transno 17179876744 00000100:00100000:1.0:1762166981.740604:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bccb7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449795456:0@lo:6:osp-syn-1-1.0 00000004:00080000:0.0:1762166981.740688:0:9158:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0001: 0 changes, 14 in progress, 0 in flight, 18 done 00000100:00100000:1.0:1762166981.740743:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5807b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+17:2417:x1847765450735872:12345-192.168.204.38@tcp:16:lfs.0 Request processed in 1700us (1845us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166981.740754:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19476 00000004:00080000:0.0:1762166981.740830:0:9158:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0001: 0 changes, 1 in progress, 0 in flight, 13 done 00000100:00100000:3.0:1762166981.747768:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166981.747825:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166981.747868:0:8380:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450736256 00000100:00100000:2.0:1762166981.747876:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450736384 00000100:00100000:1.0:1762166981.747878:0:8380:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450736256 00000100:00100000:2.0:1762166981.747882:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450736384 00000100:00100000:3.0:1762166981.747918:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.747947:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450736512 00000100:00100000:2.0:1762166981.747952:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450736512 00000100:00100000:1.0:1762166981.747956:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19477 00000100:00100000:1.0:1762166981.747968:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+15:2418:x1847765450736384:12345-192.168.204.38@tcp:1:lfs.0 00000100:00100000:2.0:1762166981.747988:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19478 00000100:00100000:2.0:1762166981.747998:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450736256:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:1.0:1762166981.748014:0:8380:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945cc355a400/0x2f180c4effbad069 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.748025:0:8383:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac200/0x2f180c4effbad070 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.748041:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1762166981.748041:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19479 00010000:00010000:1.0:1762166981.748050:0:8380:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166981.748057:0:8380:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cc355a400/0x2f180c4effbad069 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.748060:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166981.748064:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166981.748070:0:8383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac200/0x2f180c4effbad070 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166981.748074:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc576b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450736512:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:1.0:1762166981.748077:0:8380:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cc355a400/0x2f180c4effbad069 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.748105:0:8383:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac200/0x2f180c4effbad070 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.748126:0:8383:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac200/0x2f180c4effbad070 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.748129:0:8380:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945cc355a400/0x2f180c4effbad069 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.748140:0:8383:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac200/0x2f180c4effbad070 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.748142:0:35248:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbad077 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.748145:0:8380:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945cc355a400/0x2f180c4effbad069 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.748179:0:8383:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac200/0x2f180c4effbad070 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.748200:0:35248:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166981.748201:0:8380:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945cc355a400/0x2f180c4effbad069 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.748210:0:35248:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166981.748221:0:35248:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbad077 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.748231:0:8383:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cac200 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166981.748231:0:8380:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355a400 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166981.748241:0:8380:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945cc355a400/0x2f180c4effbad069 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.748242:0:8383:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac200/0x2f180c4effbad070 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.748255:0:35248:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbad077 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.748278:0:8380:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945cc355a400/0x2f180c4effbad069 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.748279:0:8383:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac200/0x2f180c4effbad070 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.748303:0:35248:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbad077 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.748313:0:8383:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac200/0x2f180c4effbad070 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.748313:0:8380:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945cc355a400/0x2f180c4effbad069 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.748315:0:35248:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbad077 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.748365:0:8383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cf3cac200/0x2f180c4effbad070 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.748403:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cc355a400/0x2f180c4effbad069 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8380 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.748406:0:35248:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbad077 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.748442:0:35248:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdee00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166981.748449:0:35248:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbad077 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.748459:0:35248:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbad077 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.748510:0:35248:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbad077 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.748520:0:35248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbad077 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166981.748523:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1e11365-ba0b-405b-99c9-a704373217f2+15:2418:x1847765450736384:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 514us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166981.748534:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450736256:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 481us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166981.748564:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19477 00000100:00100000:2.0:1762166981.748575:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19478 00000100:00100000:0.0:1762166981.748671:0:35248:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc576b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450736512:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 609us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166981.748680:0:35248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19479 00000100:00100000:3.0:1762166981.750733:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.750823:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450736768 00000100:00100000:2.0:1762166981.750829:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450736768 00000100:00100000:2.0:1762166981.750901:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30891 00000100:00100000:2.0:1762166981.750914:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5769500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+529:61884:x1847765450736768:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:2.0:1762166981.750996:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cada00/0x2f180c4effbad07e lrc: 3/0,1 mode: --/PW res: [0x240000404:0x61d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166981.751012:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cada00/0x2f180c4effbad07e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x61d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.751022:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cada00/0x2f180c4effbad07e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x61d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000004:00010000:2.0:1762166981.751142:0:30829:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000014696a58 reply state 0000000014104b5a transno 4294992543 ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cada00/0x2f180c4effbad07e lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x61d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.751151:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cada00/0x2f180c4effbad07e lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x61d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.751156:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x61d:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166981.751158:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166981.751160:0:30829:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166981.751233:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5769500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+531:61884:x1847765450736768:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 323us (504us total) trans 4294992543 rc 0/0 00000100:00100000:2.0:1762166981.751240:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30891 00000100:00100000:1.0:1762166981.752923:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166981.752957:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166981.752990:0:35248:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450736896 00000100:00100000:0.0:1762166981.753001:0:35248:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450736896 00000100:00100000:2.0:1762166981.753007:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450737024 00000100:00100000:2.0:1762166981.753012:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450737024 00000100:00100000:2.0:1762166981.753051:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19480 00000100:00100000:2.0:1762166981.753058:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450737024:12345-192.168.204.38@tcp:2:lfs.0 00000100:00100000:0.0:1762166981.753073:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19481 00000100:00100000:0.0:1762166981.753087:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+15:2418:x1847765450736896:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:2.0:1762166981.753223:0:8383:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa91:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166981.753223:0:35248:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa92:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:2.0:1762166981.753231:0:8383:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa91:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00010000:0.0:1762166981.753231:0:35248:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa92:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00010000:2.0:1762166981.753238:0:8383:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa91:0x0] updating lvb atime from disk: 0 -> 1762166981 00002000:00010000:0.0:1762166981.753239:0:35248:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa92:0x0] updating lvb atime from disk: 0 -> 1762166981 00002000:00010000:0.0:1762166981.753245:0:35248:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa92:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00002000:00010000:2.0:1762166981.753246:0:8383:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa91:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00002000:00010000:0.0:1762166981.753250:0:35248:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa92:0x0] updating lvb blocks from disk: 240 -> 240 00002000:00010000:2.0:1762166981.753252:0:8383:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa91:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1762166981.753312:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450737024:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 253us (353us total) trans 17179876745 rc 0/0 00000100:00100000:0.0:1762166981.753321:0:35248:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+16:2418:x1847765450736896:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 237us (402us total) trans 21474843482 rc 0/0 00000100:00100000:2.0:1762166981.753324:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19480 00000100:00100000:0.0:1762166981.753349:0:35248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19481 00000100:00100000:0.0:1762166981.754396:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.754472:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450737280 00000100:00100000:2.0:1762166981.754509:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450737280 00000100:00100000:2.0:1762166981.754542:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30892 00000100:00100000:2.0:1762166981.754549:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb384700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+531:61884:x1847765450737280:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:2.0:1762166981.754607:0:30829:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166981.754634:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbacf4a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea9f5 expref: 531 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.754652:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166981.754657:0:30829:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166981.754703:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac200/0x2f180c4effbad085 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166981.754716:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac200/0x2f180c4effbad085 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.754725:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac200/0x2f180c4effbad085 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000004:00010000:2.0:1762166981.754835:0:30829:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000a7198c17 reply state 00000000499f272c transno 4294992544 ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac200/0x2f180c4effbad085 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.754849:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac200/0x2f180c4effbad085 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.754856:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166981.754859:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166981.754861:0:30829:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166981.754939:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb384700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+532:61884:x1847765450737280:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 389us (546us total) trans 4294992544 rc 0/0 00000100:00100000:2.0:1762166981.754946:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30892 00000100:00100000:3.0:1762166981.755916:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166981.755949:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166981.755975:0:35248:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450737536 00000100:00100000:3.0:1762166981.755981:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166981.755984:0:35248:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450737536 00000100:00100000:2.0:1762166981.756006:0:8383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450737408 00000100:00100000:2.0:1762166981.756012:0:8383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450737408 00000100:00100000:0.0:1762166981.756018:0:35248:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450737664 00000100:00100000:0.0:1762166981.756024:0:35248:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450737664 00000100:00100000:1.0:1762166981.756074:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19482 00000100:00100000:2.0:1762166981.756085:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19483 00000100:00100000:1.0:1762166981.756092:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5768700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+16:2418:x1847765450737536:12345-192.168.204.38@tcp:2:lfs.0 00000100:00100000:0.0:1762166981.756099:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19484 00000100:00100000:2.0:1762166981.756103:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5769f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450737408:12345-192.168.204.38@tcp:2:lfs.0 00000100:00100000:0.0:1762166981.756130:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc576bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450737664:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:2.0:1762166981.756231:0:9165:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:1.0:1762166981.756233:0:9168:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166981.756233:0:35248:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166981.756237:0:9165:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00010000:1.0:1762166981.756241:0:9168:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00010000:0.0:1762166981.756242:0:35248:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00010000:2.0:1762166981.756243:0:9165:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166981 -> 1762166981 00002000:00010000:1.0:1762166981.756249:0:9168:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166981 -> 1762166981 00002000:00010000:0.0:1762166981.756251:0:35248:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166981 -> 1762166981 00002000:00010000:2.0:1762166981.756252:0:9165:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00002000:00010000:1.0:1762166981.756255:0:9168:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00002000:00010000:2.0:1762166981.756259:0:9165:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 320 -> 320 00002000:00010000:0.0:1762166981.756260:0:35248:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00002000:00010000:1.0:1762166981.756261:0:9168:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00002000:00010000:0.0:1762166981.756269:0:35248:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1762166981.756312:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5769f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450737408:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 213us (360us total) trans 17179876746 rc 0/0 00000100:00100000:1.0:1762166981.756314:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5768700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450737536:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 226us (398us total) trans 21474843483 rc 0/0 00000100:00100000:0.0:1762166981.756314:0:35248:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc576bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450737664:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 202us (332us total) trans 17179876747 rc 0/0 00000100:00100000:2.0:1762166981.756333:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19483 00000100:00100000:1.0:1762166981.756349:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19482 00000100:00100000:0.0:1762166981.756359:0:35248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19484 00000100:00100000:1.0:1762166981.757617:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166981.757687:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450737920 00000100:00100000:0.0:1762166981.757694:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450737920 00000100:00100000:0.0:1762166981.757739:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11991 00000100:00100000:0.0:1762166981.757750:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+532:61884:x1847765450737920:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:0.0:1762166981.757844:0:19593:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x240000404:0x5eb:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbacfc1 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa26 expref: 532 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.757887:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad08c lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166981.757902:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbacefd lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea9e0 expref: 532 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.757911:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbacf35 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea9ee expref: 532 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.757920:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad08c lrc: 5/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166981.757963:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbacf35 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea9ee expref: 532 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.757978:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbacf35 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea9ee expref: 532 pid: 30829 timeout: 700 lvb_type: 0 00000100:00100000:0.0:1762166981.757995:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcb385500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449795712:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166981.758106:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbacefd lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea9e0 expref: 532 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.758126:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbacefd lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea9e0 expref: 532 pid: 30829 timeout: 700 lvb_type: 0 00000100:00100000:0.0:1762166981.758138:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcb385880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449795840:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166981.758165:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc350f000 going to sleep for 11 seconds 00000100:00100000:0.0:1762166981.759153:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcb385500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449795712:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166981.759167:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcb385880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449795840:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166981.759189:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad08c lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:1.0:1762166981.759510:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.759540:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450738048 00000100:00100000:2.0:1762166981.759548:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450738048 00010000:00010000:2.0:1762166981.759582:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbacf35 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea9ee expref: 533 pid: 30829 timeout: 700 lvb_type: 0 00000100:00100000:1.0:1762166981.759609:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.759660:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450738176 00000100:00100000:0.0:1762166981.759667:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9833 00000100:00100000:2.0:1762166981.759675:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450738176 00000100:00100000:0.0:1762166981.759684:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+533:2419:x1847765450738048:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166981.759700:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166981.759709:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbacf35 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea9ee expref: 534 pid: 30829 timeout: 700 lvb_type: 0 00010000:00010000:0.0:1762166981.759729:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbacf35 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea9ee expref: 534 pid: 30829 timeout: 700 lvb_type: 0 00010000:00010000:2.0:1762166981.759731:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbacefd lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea9e0 expref: 534 pid: 30829 timeout: 700 lvb_type: 0 00010000:00010000:0.0:1762166981.759759:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbacf35 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea9ee expref: 534 pid: 30829 timeout: 700 lvb_type: 0 00010000:00010000:0.0:1762166981.759779:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:0.0:1762166981.759785:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad08c lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166981.759793:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad08c lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166981.759816:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166981.759820:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9834 00000100:00100000:2.0:1762166981.759838:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5765c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+533:2418:x1847765450738176:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166981.759854:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166981.759867:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbacefd lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea9e0 expref: 533 pid: 30829 timeout: 700 lvb_type: 0 00000100:00100000:0.0:1762166981.759869:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+533:2419:x1847765450738048:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 186us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166981.759901:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9833 00010000:00010000:2.0:1762166981.759909:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbacefd lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea9e0 expref: 533 pid: 30829 timeout: 700 lvb_type: 0 00010000:00010000:2.0:1762166981.759941:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc5db8e00/0x2f180c4effbacefd lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ea9e0 expref: 532 pid: 30829 timeout: 700 lvb_type: 0 00010000:00010000:2.0:1762166981.759959:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166981.759964:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad08c lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166981.759974:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad08c lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166981.759983:0:6479:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad08c lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166981.760026:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166981.760081:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5765c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+531:2418:x1847765450738176:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 250us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166981.760091:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9834 00010000:00010000:0.0:1762166981.760111:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad08c lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166981.760121:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad08c lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166981.760143:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbad093 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x61d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166981.760156:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbad000 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x61d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa42 expref: 530 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.760165:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbad00e lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x61d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa49 expref: 530 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.760172:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbad093 lrc: 5/0,1 mode: --/EX res: [0x240000404:0x61d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166981.760201:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbad00e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x61d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa49 expref: 530 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.760216:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbad00e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x61d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa49 expref: 530 pid: 30829 timeout: 700 lvb_type: 0 00000100:00100000:0.0:1762166981.760240:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcb385880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449795968:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166981.760326:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbad000 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x61d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa42 expref: 530 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.760385:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbad000 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x61d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa42 expref: 530 pid: 30829 timeout: 700 lvb_type: 0 00000100:00100000:0.0:1762166981.760406:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcb385500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449796096:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166981.760451:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc350f000 going to sleep for 11 seconds 00000100:00100000:0.0:1762166981.761585:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcb385500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449796096:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166981.761651:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcb385880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449795968:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166981.761674:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbad093 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x61d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:3.0:1762166981.761708:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.761822:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450738304 00000100:00100000:2.0:1762166981.761830:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450738304 00010000:00010000:2.0:1762166981.761858:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbad000 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x61d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa42 expref: 531 pid: 30829 timeout: 700 lvb_type: 0 00000100:00100000:2.0:1762166981.761893:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9835 00000100:00100000:2.0:1762166981.761902:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5769880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+531:2419:x1847765450738304:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166981.761915:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166981.761921:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbad000 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x61d:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa42 expref: 531 pid: 30829 timeout: 700 lvb_type: 0 00010000:00010000:2.0:1762166981.761947:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbad000 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x61d:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa42 expref: 531 pid: 30829 timeout: 700 lvb_type: 0 00010000:00010000:2.0:1762166981.761970:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbad000 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x61d:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa42 expref: 531 pid: 30829 timeout: 700 lvb_type: 0 00010000:00010000:2.0:1762166981.761983:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x61d:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:2.0:1762166981.761988:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbad093 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x61d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166981.761995:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbad093 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x61d:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166981.761999:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166981.762041:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5769880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+530:2419:x1847765450738304:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 140us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166981.762049:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9835 00000100:00100000:3.0:1762166981.762077:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.762105:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450738432 00000100:00100000:2.0:1762166981.762111:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450738432 00010000:00010000:2.0:1762166981.762129:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbad00e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x61d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa49 expref: 530 pid: 30829 timeout: 700 lvb_type: 0 00000100:00100000:0.0:1762166981.762189:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9836 00000100:00100000:0.0:1762166981.762202:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ccec70050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+530:2419:x1847765450738432:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166981.762211:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166981.762216:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbad00e lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x61d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa49 expref: 530 pid: 30829 timeout: 700 lvb_type: 0 00010000:00010000:0.0:1762166981.762223:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbad00e lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x61d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa49 expref: 530 pid: 30829 timeout: 700 lvb_type: 0 00010000:00010000:0.0:1762166981.762233:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde200/0x2f180c4effbad00e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x61d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa49 expref: 530 pid: 30829 timeout: 700 lvb_type: 0 00010000:00010000:0.0:1762166981.762241:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x61d:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:0.0:1762166981.762244:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbad093 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x61d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166981.762251:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbad093 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x61d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166981.762262:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbad093 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x61d:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166981.762288:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166981.762305:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbad093 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x61d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166981.762311:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbad093 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x61d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:0.0:1762166981.762323:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ccec70050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+529:2419:x1847765450738432:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 124us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166981.762333:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9836 00000100:00100000:2.0:1762166981.762690:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5805f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449796224:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762166981.762741:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166981.762773:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cee171300 going to sleep for 11 seconds 00000100:00100000:1.0:1762166981.762904:0:7427:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449796224 00000100:00100000:1.0:1762166981.762909:0:7427:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449796224 00000100:00100000:1.0:1762166981.762945:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1474 00000100:00100000:1.0:1762166981.762951:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5806d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:19593:x1847765449796224:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166981.763027:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5806d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:19593:x1847765449796224:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 77us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166981.763031:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1474 00000100:00100000:0.0:1762166981.763080:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5805f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449796224:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166981.763129:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcb385880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449796352:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166981.763151:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166981.763171:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc350fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1762166981.763231:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449796352 00000100:00100000:2.0:1762166981.763239:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449796352 00000100:00100000:2.0:1762166981.763284:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1475 00000100:00100000:2.0:1762166981.763294:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb385500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:19593:x1847765449796352:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762166981.763398:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb385500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:19593:x1847765449796352:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 106us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166981.763406:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1475 00000100:00100000:0.0:1762166981.763449:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcb385880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449796352:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166981.763551:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcb385880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449796480:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166981.763581:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166981.763610:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011c7300 going to sleep for 11 seconds 00000100:00100000:2.0:1762166981.763661:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449796480 00000100:00100000:2.0:1762166981.763666:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449796480 00000100:00100000:2.0:1762166981.763693:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1476 00000100:00100000:2.0:1762166981.763700:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb386d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:19593:x1847765449796480:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762166981.763766:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb386d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:19593:x1847765449796480:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 66us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166981.763773:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1476 00000100:00100000:0.0:1762166981.763794:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcb385880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449796480:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166981.763830:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcb385880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449796608:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166981.763853:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166981.763871:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc350fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1762166981.763887:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449796608 00000100:00100000:2.0:1762166981.763891:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449796608 00000100:00100000:2.0:1762166981.763918:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1477 00000100:00100000:2.0:1762166981.763923:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb387b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:19593:x1847765449796608:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762166981.763984:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb387b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:19593:x1847765449796608:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 60us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166981.763990:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1477 00000100:00100000:0.0:1762166981.764022:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcb385880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449796608:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166981.764055:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcb385880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449796736:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166981.764085:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166981.764105:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc9a5e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166981.764106:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449796736 00000100:00100000:2.0:1762166981.764112:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449796736 00000100:00100000:2.0:1762166981.764150:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1478 00000100:00100000:2.0:1762166981.764160:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb386300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:19593:x1847765449796736:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762166981.764230:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb386300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:19593:x1847765449796736:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 71us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166981.764237:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1478 00000100:00100000:0.0:1762166981.764290:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcb385880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449796736:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166981.764346:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcb385880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449796864:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166981.764380:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166981.764404:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc9a5e6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166981.764424:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449796864 00000100:00100000:2.0:1762166981.764429:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449796864 00000100:00100000:2.0:1762166981.764462:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1479 00000100:00100000:2.0:1762166981.764468:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb386a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:19593:x1847765449796864:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762166981.764560:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb386a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:19593:x1847765449796864:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 91us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166981.764567:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1479 00000100:00100000:0.0:1762166981.764584:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcb385880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449796864:0@lo:1000:mdt_rdpg00_003.0 00000040:00080000:0.0:1762166981.764767:0:19593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x2:0x0].64, 456 off72344 00000001:00080000:0.0:1762166981.764775:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992545 00000100:00100000:0.0:1762166981.764845:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcb385880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449796992:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166981.764873:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166981.764896:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc9a5e6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166981.764996:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449796992 00000100:00100000:2.0:1762166981.765001:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449796992 00000100:00100000:2.0:1762166981.765036:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1480 00000100:00100000:2.0:1762166981.765042:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb384e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:19593:x1847765449796992:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762166981.765181:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb384e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:19593:x1847765449796992:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 138us (306us total) trans 17179876748 rc 0/0 00000100:00100000:2.0:1762166981.765188:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1480 00000100:00100000:0.0:1762166981.765239:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcb385880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449796992:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166981.765265:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcb385180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449797120:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166981.765294:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166981.765319:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc9a5e6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166981.765432:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449797120 00000100:00100000:2.0:1762166981.765437:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449797120 00000100:00100000:2.0:1762166981.765473:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1481 00000100:00100000:2.0:1762166981.765502:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb384a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:19593:x1847765449797120:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762166981.765600:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb384a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:19593:x1847765449797120:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 99us (303us total) trans 21474843484 rc 0/0 00000100:00100000:2.0:1762166981.765608:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1481 00000100:00100000:0.0:1762166981.765643:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcb385180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449797120:0@lo:1000:mdt_rdpg00_003.0 00000001:00080000:0.0:1762166981.765704:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992546 00010000:00010000:0.0:1762166981.765730:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbad093 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x61d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166981.765740:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbad093 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x61d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166981.765748:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbad093 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x61d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166981.765754:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdee00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166981.765760:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbad093 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x61d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166981.765769:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbad093 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x61d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166981.765786:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x61d:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:0.0:1762166981.765789:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166981.765794:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbad093 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x61d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166981.765812:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbad093 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x61d:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166981.765827:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad08c lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166981.765833:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad08c lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166981.765839:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad08c lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166981.765843:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdfe00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166981.765846:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad08c lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166981.765852:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad08c lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166981.765860:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:0.0:1762166981.765862:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166981.765865:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad08c lrc: 2/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166981.765869:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad08c lrc: 0/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166981.765880:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:0.0:1762166981.765881:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166981.765886:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbacfc1 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa26 expref: 531 pid: 30829 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166981.765984:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+530:61884:x1847765450737920:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 8236us (8376us total) trans 4294992547 rc 0/0 00000100:00100000:0.0:1762166981.765993:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11991 00000020:00080000:0.0:1762166981.765997:0:19593:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1762166981.767308:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.767364:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450738560 00000100:00100000:2.0:1762166981.767371:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450738560 00000100:00100000:2.0:1762166981.767419:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30893 00000100:00100000:2.0:1762166981.767428:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5767480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+530:61884:x1847765450738560:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166981.767449:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166981.767470:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba000/0x2f180c4effbad09a lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eaa65 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.767560:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba000/0x2f180c4effbad09a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa65 expref: 531 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.767574:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba000/0x2f180c4effbad09a lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa65 expref: 531 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.767590:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166981.767593:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166981.767596:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc93ba000, rc 0) 00000100:00100000:2.0:1762166981.767646:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5767480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+531:61884:x1847765450738560:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 216us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166981.767652:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30893 00000100:00100000:3.0:1762166981.769331:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166981.769387:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450738816 00000100:00100000:0.0:1762166981.769395:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450738816 00000100:00100000:0.0:1762166981.769443:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11992 00000100:00100000:0.0:1762166981.769451:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc576a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+531:61884:x1847765450738816:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166981.769715:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc576a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+532:61884:x1847765450738816:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 263us (388us total) trans 4294992548 rc 0/0 00000100:00100000:0.0:1762166981.769723:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11992 00000100:00100000:3.0:1762166981.770729:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166981.770788:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450739072 00000100:00100000:0.0:1762166981.770813:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450739072 00000100:00100000:0.0:1762166981.770856:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11993 00000100:00100000:0.0:1762166981.770865:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc576aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+532:61884:x1847765450739072:12345-192.168.204.38@tcp:35:lfs.0 00000004:00080000:0.0:1762166981.771027:0:19593:0:(mdd_object.c:3965:mdd_close()) Object [0x240000404:0x61d:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:0.0:1762166981.771096:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbad0a1 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x61d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166981.771111:0:19593:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbad0a1 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x61d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166981.771128:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbad0a1 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x61d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166981.771137:0:19593:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbad0a1 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x61d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166981.771143:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbad0a1 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x61d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166981.771150:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbad0a1 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x61d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166981.771173:0:19593:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762166981.771211:0:7420:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166981.771221:0:7420:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbad0a1 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x61d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166981.771234:0:7420:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bde800 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166981.771239:0:7420:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbad0a1 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x61d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166981.771247:0:7420:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbad0a1 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x61d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166981.771263:0:7420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x61d:0x0].0x0 (ffff945bc4afe500) 00010000:00010000:1.0:1762166981.771266:0:7420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1762166981.771271:0:7420:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbad0a1 lrc: 1/0,0 mode: --/PW res: [0x240000404:0x61d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166981.771277:0:7420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde800/0x2f180c4effbad0a1 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x61d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166981.771292:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166981.771295:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166981.771296:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166981.771345:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc576aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+533:61884:x1847765450739072:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 481us (620us total) trans 4294992549 rc 0/0 00000100:00100000:0.0:1762166981.771354:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11993 00000100:00100000:1.0:1762166981.780914:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.781032:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450739200 00000100:00100000:2.0:1762166981.781046:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450739200 00000100:00100000:2.0:1762166981.781133:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30894 00000100:00100000:2.0:1762166981.781145:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5767b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+533:61885:x1847765450739200:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166981.781175:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166981.781200:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb600/0x2f180c4effbad0a8 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eaa6c expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.781288:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4a14000/0x2f180c4effbad0af lrc: 3/1,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166981.781307:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4a14000/0x2f180c4effbad0af lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.781328:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4a14000/0x2f180c4effbad0af lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.781346:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effbad0b6 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166981.781354:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effbad0b6 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.781360:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effbad0b6 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.781454:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4e00/0x2f180c4effbad0bd lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166981.781460:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4e00/0x2f180c4effbad0bd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.781464:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4e00/0x2f180c4effbad0bd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000004:00200000:2.0:1762166981.781530:0:30829:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 262144 00000004:00200000:2.0:1762166981.781534:0:30829:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166981.781554:0:30829:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4e00/0x2f180c4effbad0bd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.781564:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4e00/0x2f180c4effbad0bd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.781571:0:30829:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4a14000/0x2f180c4effbad0af lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.781586:0:30829:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4a14000/0x2f180c4effbad0af lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.781592:0:30829:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4a14000/0x2f180c4effbad0af lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.781599:0:30829:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4a14000/0x2f180c4effbad0af lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.781605:0:30829:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4a14000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166981.781610:0:30829:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4a14000/0x2f180c4effbad0af lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.781618:0:30829:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4a14000/0x2f180c4effbad0af lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.781631:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0x0 (ffff945bc809bd00) 00010000:00010000:2.0:1762166981.781634:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166981.781639:0:30829:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4a14000/0x2f180c4effbad0af lrc: 3/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.781646:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4a14000/0x2f180c4effbad0af lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.781660:0:30829:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effbad0b6 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.781666:0:30829:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effbad0b6 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.781672:0:30829:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effbad0b6 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.781677:0:30829:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cb4200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166981.781680:0:30829:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effbad0b6 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.781686:0:30829:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effbad0b6 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.781693:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0xdd396665 (ffff945bc809b100) 00010000:00010000:2.0:1762166981.781695:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166981.781698:0:30829:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effbad0b6 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.781702:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4200/0x2f180c4effbad0b6 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.781729:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb600/0x2f180c4effbad0a8 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa6c expref: 535 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.781739:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4e00/0x2f180c4effbad0bd lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa6c expref: 534 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.781743:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166981.781745:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166981.781747:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cb4e00, rc 0) 00000100:00100000:2.0:1762166981.781835:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5767b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+534:61885:x1847765450739200:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 692us (935us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166981.781843:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30894 00000100:00100000:3.0:1762166981.783583:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.783660:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450739456 00000100:00100000:2.0:1762166981.783668:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450739456 00000100:00100000:2.0:1762166981.783715:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30895 00000100:00100000:2.0:1762166981.783724:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5769c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+534:61885:x1847765450739456:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166981.783748:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166981.783778:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99c00/0x2f180c4effbad0c4 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eaa73 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.783886:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b98400/0x2f180c4effbad0cb lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166981.783900:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b98400/0x2f180c4effbad0cb lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.783908:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b98400/0x2f180c4effbad0cb lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000004:00200000:2.0:1762166981.783915:0:30829:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 262144 00010000:00010000:2.0:1762166981.784028:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99c00/0x2f180c4effbad0c4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa73 expref: 537 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.784041:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b98400/0x2f180c4effbad0cb lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa73 expref: 536 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.784047:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166981.784049:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1762166981.784051:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4b98400, rc 0) 00000100:00100000:2.0:1762166981.784093:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5769c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+536:61885:x1847765450739456:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 372us (520us total) trans 4294992550 rc 0/0 00000100:00100000:2.0:1762166981.784098:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30895 00000100:00100000:3.0:1762166981.785105:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.785142:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450739712 00000100:00100000:2.0:1762166981.785147:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450739712 00000100:00100000:2.0:1762166981.785176:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30896 00000100:00100000:2.0:1762166981.785182:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+536:61885:x1847765450739712:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166981.785197:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166981.785208:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99a00/0x2f180c4effbad0d9 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eaa7a expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.785268:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99800/0x2f180c4effbad0e0 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166981.785275:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99800/0x2f180c4effbad0e0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.785281:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99800/0x2f180c4effbad0e0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000004:00200000:2.0:1762166981.785287:0:30829:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 262144 00010000:00010000:2.0:1762166981.785337:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99a00/0x2f180c4effbad0d9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa7a expref: 539 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.785353:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99800/0x2f180c4effbad0e0 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa7a expref: 538 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.785360:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166981.785363:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166981.785365:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4b99800, rc 0) 00000100:00100000:2.0:1762166981.785399:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+538:61885:x1847765450739712:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 216us (296us total) trans 4294992551 rc 0/0 00000100:00100000:2.0:1762166981.785407:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30896 00000100:00100000:1.0:1762166981.809998:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166981.810093:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450739840 00000100:00100000:0.0:1762166981.810107:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450739840 00000100:00100000:0.0:1762166981.810195:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2766 00000100:00100000:0.0:1762166981.810208:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5765f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+20:2416:x1847765450739840:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:0.0:1762166981.810249:0:23942:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbad0ee lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.810267:0:23942:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166981.810269:0:23942:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166981.810276:0:23942:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbad0ee lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.810292:0:23942:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbad0ee lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.812067:0:23942:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbad0ee lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.812083:0:23942:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbad0ee lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.812092:0:23942:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbad0ee lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.812099:0:23942:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdf600 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166981.812104:0:23942:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbad0ee lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.812113:0:23942:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbad0ee lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.812133:0:23942:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbad0ee lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.812140:0:23942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbad0ee lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166981.812218:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5765f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+20:2416:x1847765450739840:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 2009us (2231us total) trans 0 rc 262144/262144 00000100:00100000:0.0:1762166981.812228:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2766 00000100:00100000:3.0:1762166981.814188:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166981.814249:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450739968 00000100:00100000:0.0:1762166981.814260:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450739968 00000100:00100000:0.0:1762166981.814330:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2767 00000100:00100000:0.0:1762166981.814337:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5769880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+17:2417:x1847765450739968:12345-192.168.204.38@tcp:3:lfs.0 00010000:00010000:0.0:1762166981.814367:0:23942:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad0f5 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa92:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.814383:0:23942:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945cc355a600/0x2f180c4effbad054 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa92:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa5e expref: 17 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.814396:0:23942:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166981.814398:0:23942:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166981.814402:0:23942:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad0f5 lrc: 4/1,0 mode: --/PR res: [0x280000400:0xa92:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.814442:0:23942:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945cc355a600/0x2f180c4effbad054 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa92:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa5e expref: 17 pid: 8382 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.814458:0:23942:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945cc355a600/0x2f180c4effbad054 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa92:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa5e expref: 17 pid: 8382 timeout: 700 lvb_type: 0 00000100:00100000:0.0:1762166981.814503:0:23942:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcb387480 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_009:lustre-OST0000_UUID:23942:1847765449797248:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166981.814619:0:23942:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc9a5e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166981.815624:0:23942:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcb387480 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_009:lustre-OST0000_UUID:23942:1847765449797248:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166981.815647:0:23942:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad0f5 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xa92:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166981.816046:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166981.816126:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450740096 00000100:00100000:0.0:1762166981.816136:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450740096 00010000:00010000:0.0:1762166981.816176:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945cc355a600/0x2f180c4effbad054 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa92:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa5e expref: 18 pid: 8382 timeout: 700 lvb_type: 0 00000100:00100000:0.0:1762166981.816221:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9837 00000100:00100000:0.0:1762166981.816232:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc70b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450740096:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166981.816249:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166981.816270:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945cc355a600/0x2f180c4effbad054 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa92:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa5e expref: 18 pid: 8382 timeout: 700 lvb_type: 0 00010000:00010000:0.0:1762166981.816284:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945cc355a600/0x2f180c4effbad054 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa92:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa5e expref: 18 pid: 8382 timeout: 700 lvb_type: 0 00010000:00010000:0.0:1762166981.816307:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cc355a600/0x2f180c4effbad054 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa92:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa5e expref: 18 pid: 8382 timeout: 700 lvb_type: 0 00010000:00010000:0.0:1762166981.816323:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166981.816325:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166981.816330:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad0f5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa92:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.816340:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad0f5 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0xa92:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.816373:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166981.816415:0:23942:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad0f5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa92:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166981.816424:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc70b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450740096:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 190us (383us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166981.816440:0:23942:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad0f5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa92:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166981.816449:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9837 00010000:00010000:2.0:1762166981.818550:0:23942:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad0f5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xa92:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.818566:0:23942:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad0f5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa92:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.818574:0:23942:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad0f5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa92:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.818582:0:23942:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdfe00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166981.818586:0:23942:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad0f5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa92:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.818595:0:23942:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad0f5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa92:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.818614:0:23942:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad0f5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa92:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.818622:0:23942:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad0f5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa92:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23942 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166981.818706:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5769880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+16:2417:x1847765450739968:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 4365us (4522us total) trans 0 rc 262144/262144 00000100:00100000:2.0:1762166981.818715:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2767 00000100:00100000:1.0:1762166981.824883:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166981.824975:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450740224 00000100:00100000:0.0:1762166981.824988:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450740224 00000100:00100000:0.0:1762166981.825066:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 905 00000100:00100000:0.0:1762166981.825077:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5765500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+538:61885:x1847765450740224:12345-192.168.204.38@tcp:103:lfs.0 00010000:00010000:0.0:1762166981.825098:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166981.825139:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99800/0x2f180c4effbad0e0 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa7a expref: 538 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.825163:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:0.0:1762166981.825169:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166981.825232:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5765500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+537:61885:x1847765450740224:12345-192.168.204.38@tcp:103:lfs.0 Request processed in 157us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166981.825239:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 905 00000100:00100000:3.0:1762166981.826183:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166981.826228:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450740480 00000100:00100000:0.0:1762166981.826233:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450740480 00000100:00100000:0.0:1762166981.826263:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11994 00000100:00100000:0.0:1762166981.826268:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc70b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+537:61885:x1847765450740480:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166981.826504:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc70b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+538:61885:x1847765450740480:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 233us (322us total) trans 4294992552 rc 0/0 00000100:00100000:0.0:1762166981.826513:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11994 00000100:00100000:3.0:1762166981.828473:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.828604:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450740736 00000100:00100000:2.0:1762166981.828619:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450740736 00000100:00100000:2.0:1762166981.828687:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30897 00000100:00100000:2.0:1762166981.828702:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc70b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+538:61766:x1847765450740736:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:2.0:1762166981.828727:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166981.828746:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99a00/0x2f180c4effbad0fc lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eaa81 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.828855:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99c00/0x2f180c4effbad103 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166981.828871:0:30829:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4e00/0x2f180c4effbad0bd lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa6c expref: 539 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.828879:0:30829:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99c00/0x2f180c4effbad103 lrc: 4/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.828912:0:30829:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4e00/0x2f180c4effbad0bd lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa6c expref: 539 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.828925:0:30829:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4e00/0x2f180c4effbad0bd lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa6c expref: 539 pid: 30829 timeout: 700 lvb_type: 0 00000100:00100000:2.0:1762166981.828940:0:30829:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5807100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:30829:1847765449797376:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166981.829040:0:30829:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc4446600 going to sleep for 11 seconds 00000100:00100000:1.0:1762166981.830195:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.830299:0:30829:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5807100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:30829:1847765449797376:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166981.830320:0:30829:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99c00/0x2f180c4effbad103 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000100:00100000:0.0:1762166981.830342:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450740864 00000100:00100000:0.0:1762166981.830352:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450740864 00010000:00010000:0.0:1762166981.830400:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4e00/0x2f180c4effbad0bd lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa6c expref: 540 pid: 30829 timeout: 700 lvb_type: 0 00000100:00100000:0.0:1762166981.830438:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9838 00000100:00100000:0.0:1762166981.830447:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5764a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+540:2418:x1847765450740864:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166981.830462:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166981.830470:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4e00/0x2f180c4effbad0bd lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa6c expref: 540 pid: 30829 timeout: 700 lvb_type: 0 00010000:00010000:0.0:1762166981.830505:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4e00/0x2f180c4effbad0bd lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa6c expref: 540 pid: 30829 timeout: 700 lvb_type: 0 00010000:00010000:0.0:1762166981.830528:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4e00/0x2f180c4effbad0bd lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa6c expref: 540 pid: 30829 timeout: 700 lvb_type: 0 00010000:00010000:0.0:1762166981.830545:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:0.0:1762166981.830550:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99c00/0x2f180c4effbad103 lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.830559:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99c00/0x2f180c4effbad103 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.830567:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99c00/0x2f180c4effbad103 lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.830595:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166981.830625:0:30829:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99c00/0x2f180c4effbad103 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.830640:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99c00/0x2f180c4effbad103 lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000100:00100000:0.0:1762166981.830658:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5764a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+539:2418:x1847765450740864:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 208us (460us total) trans 0 rc 0/0 00000004:00200000:2.0:1762166981.830659:0:30829:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 262144 00000100:00100000:0.0:1762166981.830679:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9838 00010000:00010000:2.0:1762166981.830793:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99a00/0x2f180c4effbad0fc lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa81 expref: 540 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.830824:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99c00/0x2f180c4effbad103 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa81 expref: 539 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.830833:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166981.830837:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1762166981.830839:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4b99c00, rc 0) 00000100:00100000:2.0:1762166981.830878:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc70b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+539:61766:x1847765450740736:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 2182us (2413us total) trans 4294992553 rc 0/0 00000100:00100000:2.0:1762166981.830887:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30897 00000100:00100000:1.0:1762166981.832066:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.832120:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450740992 00000100:00100000:2.0:1762166981.832127:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450740992 00000100:00100000:2.0:1762166981.832168:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30898 00000100:00100000:2.0:1762166981.832177:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5764e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+539:61766:x1847765450740992:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:2.0:1762166981.832197:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166981.832212:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b98a00/0x2f180c4effbad111 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eaa88 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.832299:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99600/0x2f180c4effbad118 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166981.832312:0:30829:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99c00/0x2f180c4effbad103 lrc: 2/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa81 expref: 540 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.832322:0:30829:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99600/0x2f180c4effbad118 lrc: 4/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.832357:0:30829:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99c00/0x2f180c4effbad103 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa81 expref: 540 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.832370:0:30829:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99c00/0x2f180c4effbad103 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa81 expref: 540 pid: 30829 timeout: 700 lvb_type: 0 00000100:00100000:2.0:1762166981.832383:0:30829:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5807100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:30829:1847765449797504:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166981.832450:0:30829:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc2d6af00 going to sleep for 11 seconds 00000100:00100000:2.0:1762166981.833319:0:30829:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5807100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:30829:1847765449797504:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166981.833336:0:30829:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99600/0x2f180c4effbad118 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000100:00100000:1.0:1762166981.833926:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166981.833969:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450741120 00000100:00100000:0.0:1762166981.833975:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450741120 00010000:00010000:0.0:1762166981.834003:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99c00/0x2f180c4effbad103 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa81 expref: 541 pid: 30829 timeout: 700 lvb_type: 0 00000100:00100000:0.0:1762166981.834044:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9839 00000100:00100000:0.0:1762166981.834057:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5764380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+541:2418:x1847765450741120:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166981.834073:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166981.834079:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99c00/0x2f180c4effbad103 lrc: 4/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa81 expref: 541 pid: 30829 timeout: 700 lvb_type: 0 00010000:00010000:0.0:1762166981.834091:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99c00/0x2f180c4effbad103 lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa81 expref: 541 pid: 30829 timeout: 700 lvb_type: 0 00010000:00010000:0.0:1762166981.834111:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99c00/0x2f180c4effbad103 lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa81 expref: 541 pid: 30829 timeout: 700 lvb_type: 0 00010000:00010000:0.0:1762166981.834127:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:0.0:1762166981.834131:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99600/0x2f180c4effbad118 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.834138:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99600/0x2f180c4effbad118 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.834144:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99600/0x2f180c4effbad118 lrc: 4/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.834172:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166981.834198:0:30829:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99600/0x2f180c4effbad118 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.834207:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99600/0x2f180c4effbad118 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000100:00100000:0.0:1762166981.834220:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5764380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+540:2418:x1847765450741120:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 162us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166981.834231:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9839 00000004:00200000:2.0:1762166981.834237:0:30829:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 262144 00000004:00200000:2.0:1762166981.834241:0:30829:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166981.834254:0:30829:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99600/0x2f180c4effbad118 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.834277:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b98a00/0x2f180c4effbad111 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa88 expref: 540 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.834296:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99600/0x2f180c4effbad118 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa88 expref: 539 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.834302:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166981.834304:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166981.834306:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4b99600, rc 0) 00000100:00100000:2.0:1762166981.834352:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5764e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+539:61766:x1847765450740992:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 2176us (2288us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166981.834359:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30898 00000100:00100000:1.0:1762166981.835881:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166981.835929:0:35248:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450741248 00000100:00100000:0.0:1762166981.835938:0:35248:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450741248 00000100:00100000:1.0:1762166981.835950:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166981.835984:0:35248:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450741376 00000100:00100000:0.0:1762166981.835989:0:35248:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450741376 00000100:00100000:2.0:1762166981.836014:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19485 00000100:00100000:2.0:1762166981.836031:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5765c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+16:2417:x1847765450741248:12345-192.168.204.38@tcp:101:fsx.0 00000100:00100000:0.0:1762166981.836036:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19486 00000100:00100000:0.0:1762166981.836048:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+20:2417:x1847765450741376:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:2.0:1762166981.836055:0:9165:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166981.836062:0:35248:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166981.836071:0:9165:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4b99e00/0x2f180c4effbad11f lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa92:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eaa8f expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.836080:0:35248:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbad126 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa91:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eaa96 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166981.836089:0:9165:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa92:0x0] initial LVB size: 262144, mtime: 0x690888c5, atime: 0x690888c5, ctime: 0x690888c5, blocks: 0xf0 00010000:00010000:2.0:1762166981.836108:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166981.836109:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166981.836115:0:9165:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4b99e00/0x2f180c4effbad11f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa8f expref: 17 pid: 9165 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166981.836125:0:9165:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc4b99e00/0x2f180c4effbad11f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa8f expref: 17 pid: 9165 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166981.836133:0:9165:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4b99e00, rc 0) 00000100:00100000:0.0:1762166981.836148:0:35248:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcb387480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:35248:1847765449797632:192.168.204.38@tcp:106: 00000100:00100000:2.0:1762166981.836167:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5765c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+17:2417:x1847765450741248:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 145us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166981.836173:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19485 00000100:00100000:0.0:1762166981.836225:0:35248:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc9a5e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166981.837064:0:35248:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcb387480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:35248:1847765449797632:192.168.204.38@tcp:106: 00010000:00010000:0.0:1762166981.837097:0:35248:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbad126 lrc: 1/0,0 mode: --/PR res: [0x2c0000400:0xa91:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa96 expref: 21 pid: 35248 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166981.837117:0:35248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbad126 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa91:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa96 expref: 21 pid: 35248 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166981.837128:0:35248:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdf600, rc 0) 00000100:00100000:0.0:1762166981.837167:0:35248:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+20:2417:x1847765450741376:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 1121us (1217us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166981.837175:0:35248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19486 00000100:00100000:3.0:1762166981.838438:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166981.838500:0:35248:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450741504 00000100:00100000:0.0:1762166981.838507:0:35248:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450741504 00000100:00100000:0.0:1762166981.838536:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19487 00000100:00100000:0.0:1762166981.838541:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc70b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450741504:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:0.0:1762166981.838551:0:35248:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166981.838560:0:35248:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbad12d lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa91:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eaa9d expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166981.838616:0:35248:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcb387480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:35248:1847765449797760:192.168.204.38@tcp:106: 00000100:00100000:0.0:1762166981.838683:0:35248:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc9a5e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166981.839420:0:35248:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcb387480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:35248:1847765449797760:192.168.204.38@tcp:106: 00010000:00010000:0.0:1762166981.839436:0:35248:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbad12d lrc: 1/0,0 mode: --/PR res: [0x2c0000400:0xa91:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa9d expref: 21 pid: 35248 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166981.839448:0:35248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4bdee00/0x2f180c4effbad12d lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa91:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa9d expref: 21 pid: 35248 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166981.839457:0:35248:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdee00, rc 0) 00000100:00100000:0.0:1762166981.839514:0:35248:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc70b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450741504:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 969us (1075us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166981.839519:0:35248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19487 00000100:00100000:3.0:1762166981.840437:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166981.840470:0:35248:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450741632 00000100:00100000:0.0:1762166981.840499:0:35248:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450741632 00000100:00100000:0.0:1762166981.840533:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19488 00000100:00100000:0.0:1762166981.840540:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc70b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+17:61766:x1847765450741632:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:0.0:1762166981.840551:0:35248:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166981.840562:0:35248:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde200/0x2f180c4effbad134 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa92:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eaaa4 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.840594:0:35248:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4b99e00/0x2f180c4effbad11f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa92:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa8f expref: 18 pid: 9165 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166981.840603:0:35248:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166981.840605:0:35248:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166981.840609:0:35248:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde200/0x2f180c4effbad134 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xa92:0x0].0x0 rrc: 3 type: EXT [28672->32767] (req 28672->32767) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaaa4 expref: 18 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.840636:0:35248:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc4b99e00/0x2f180c4effbad11f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa92:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa8f expref: 18 pid: 9165 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1762166981.840651:0:35248:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc4b99e00/0x2f180c4effbad11f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa92:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa8f expref: 18 pid: 9165 timeout: 700 lvb_type: 1 00000100:00100000:0.0:1762166981.840665:0:35248:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcb387480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:35248:1847765449797888:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166981.840714:0:35248:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc9a5e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166981.841615:0:35248:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcb387480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:35248:1847765449797888:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166981.841635:0:35248:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde200/0x2f180c4effbad134 lrc: 3/0,0 mode: --/PW res: [0x280000400:0xa92:0x0].0x0 rrc: 3 type: EXT [28672->32767] (req 28672->32767) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaaa4 expref: 18 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.841648:0:35248:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bde200, rc 0) 00000100:00100000:0.0:1762166981.841692:0:35248:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc70b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e1e11365-ba0b-405b-99c9-a704373217f2+18:61766:x1847765450741632:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 1153us (1257us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166981.841701:0:35248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19488 00000100:00100000:1.0:1762166981.842015:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166981.842073:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450741760 00000100:00100000:0.0:1762166981.842079:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450741760 00010000:00010000:0.0:1762166981.842104:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4b99e00/0x2f180c4effbad11f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa92:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa8f expref: 18 pid: 9165 timeout: 700 lvb_type: 1 00000100:00100000:0.0:1762166981.842136:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9840 00000100:00100000:0.0:1762166981.842146:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450741760:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166981.842161:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166981.842181:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc4b99e00/0x2f180c4effbad11f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa92:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa8f expref: 18 pid: 9165 timeout: 700 lvb_type: 1 00010000:00010000:0.0:1762166981.842194:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc4b99e00/0x2f180c4effbad11f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa92:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa8f expref: 18 pid: 9165 timeout: 700 lvb_type: 1 00010000:00010000:0.0:1762166981.842214:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4b99e00/0x2f180c4effbad11f lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa92:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa8f expref: 18 pid: 9165 timeout: 700 lvb_type: 1 00010000:00010000:0.0:1762166981.842229:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166981.842231:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166981.842238:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde200/0x2f180c4effbad134 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa92:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 28672->32767) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaaa4 expref: 17 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.842254:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde200/0x2f180c4effbad134 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa92:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 28672->32767) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaaa4 expref: 17 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.842283:0:6481:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde200/0x2f180c4effbad134 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa92:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 28672->32767) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaaa4 expref: 17 pid: 35248 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166981.842295:0:6481:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bcb387480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6481:1847765449798016:192.168.204.38@tcp:105: 00000100:00100000:0.0:1762166981.842349:0:6481:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc9a5e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166981.843516:0:6481:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bcb387480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6481:1847765449798016:192.168.204.38@tcp:105: 00010000:00010000:0.0:1762166981.843537:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166981.843593:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450741760:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1448us (1584us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166981.843608:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9840 00000100:00100000:3.0:1762166981.843903:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.843969:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450741888 00000100:00100000:2.0:1762166981.843977:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450741888 00002000:00100000:2.0:1762166981.844023:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000400:0xa92:0x0] (28672->32767) req@ffff945bc8120700 x1847765450741888/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:12/0 lens 488/0 e 0 to 0 dl 1762166992 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166981.844033:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc8120700 with x1847765450741888 ext(28672->32767) 00002000:00010000:2.0:1762166981.844038:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc8120700 00000100:00100000:2.0:1762166981.844069:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2768 00000100:00100000:2.0:1762166981.844079:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc8120700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450741888:12345-192.168.204.38@tcp:3:lfs.0 00000100:00100000:2.0:1762166981.844251:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc8120700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450741888:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 175us (357us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1762166981.844256:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2768 00002000:00100000:2.0:1762166981.844261:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000400:0xa92:0x0] (28672->32767) req@ffff945bc8120700 x1847765450741888/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:12/0 lens 488/4536 e 0 to 0 dl 1762166992 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166981.844267:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc8120700 with x1847765450741888 ext(28672->32767) 00002000:00010000:2.0:1762166981.844270:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc8120700 00000100:00100000:1.0:1762166981.845300:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166981.845347:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450742144 00000100:00100000:0.0:1762166981.845353:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450742144 00000100:00100000:0.0:1762166981.845396:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11995 00000100:00100000:0.0:1762166981.845405:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff2fc850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+539:61766:x1847765450742144:12345-192.168.204.38@tcp:35:fsx.0 00000100:00100000:0.0:1762166981.845710:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff2fc850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+540:61766:x1847765450742144:12345-192.168.204.38@tcp:35:fsx.0 Request processed in 306us (412us total) trans 4294992554 rc 0/0 00000100:00100000:0.0:1762166981.845718:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11995 00000100:00100000:3.0:1762166981.847199:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.847302:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450742400 00000100:00100000:2.0:1762166981.847315:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450742400 00000100:00100000:2.0:1762166981.847385:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30899 00000100:00100000:2.0:1762166981.847396:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc8122300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+540:61766:x1847765450742400:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:2.0:1762166981.847420:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166981.847423:0:30829:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 1 00010000:00010000:2.0:1762166981.847448:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99600/0x2f180c4effbad118 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa88 expref: 540 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.847472:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b98400/0x2f180c4effbad0cb lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa73 expref: 539 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.847521:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba000/0x2f180c4effbad09a lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa65 expref: 538 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.847532:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166981.847537:0:30829:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166981.847551:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b98a00/0x2f180c4effbad13b lrc: 2/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eaaab expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.847595:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99a00/0x2f180c4effbad142 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166981.847606:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99a00/0x2f180c4effbad142 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.847615:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99a00/0x2f180c4effbad142 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000040:00080000:2.0:1762166981.847865:0:30829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5963, 88 off467360 00000004:00080000:2.0:1762166981.847872:0:30829:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 600996394168ns, next at 601658123630ns, rc = 0 00000040:00080000:2.0:1762166981.847909:0:30829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5962, 88 off467360 00000004:00080000:2.0:1762166981.847915:0:30829:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 600996436848ns, next at 601658163748ns, rc = 0 00000040:00080000:2.0:1762166981.847951:0:30829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5963, 88 off467448 00000004:00080000:2.0:1762166981.847957:0:30829:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 600996478541ns, next at 601658163748ns, rc = 0 00000040:00080000:2.0:1762166981.847970:0:30829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5964, 88 off467448 00000004:00080000:2.0:1762166981.847973:0:30829:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 600996495881ns, next at 601658123630ns, rc = 0 00000040:00080000:2.0:1762166981.848008:0:30829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5964, 88 off467536 00000004:00080000:2.0:1762166981.848016:0:30829:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 600996537798ns, next at 601658163748ns, rc = 0 00000040:00080000:2.0:1762166981.848031:0:30829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5965, 88 off467536 00000004:00080000:2.0:1762166981.848035:0:30829:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 600996557918ns, next at 601658123630ns, rc = 0 00000001:00080000:0.0:1762166981.849555:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294992555 is committed 00000004:00080000:0.0:1762166981.849565:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3321 committed 00000004:00080000:0.0:1762166981.849588:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3324 committed 00000004:00080000:0.0:1762166981.849603:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3320 committed 00010000:00010000:3.0:1762166981.849605:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cada00/0x2f180c4effbad07e lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x61d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00000004:00080000:0.0:1762166981.849606:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3323 committed 00000004:00080000:0.0:1762166981.849612:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3322 committed 00000004:00080000:0.0:1762166981.849619:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3319 committed 00010000:00010000:3.0:1762166981.849628:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cada00/0x2f180c4effbad07e lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x61d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.849637:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cada00/0x2f180c4effbad07e lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x61d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.849644:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cada00 already unused, calling callback (ffffffffc18e2310) 00000020:00080000:0.0:1762166981.849646:0:7412:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff945cee171300 refcount 2 committed 0 result 0 batchid 65 00010000:00010000:3.0:1762166981.849650:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cada00/0x2f180c4effbad07e lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x61d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00000020:00080000:0.0:1762166981.849652:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945bc49ab400 obd lustre-OST0001-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff945d011c7300 00000020:00080000:0.0:1762166981.849661:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945bc49ab200 obd lustre-OST0000-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff945cee171000 00000020:00080000:0.0:1762166981.849665:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945bc49ab800 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff945cd44d8e00 00010000:00010000:3.0:1762166981.849668:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cada00/0x2f180c4effbad07e lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x61d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30829 initiator: MDT1 00000020:00080000:0.0:1762166981.849669:0:7412:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000400:0x2:0x0].64 00010000:00010000:3.0:1762166981.849691:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x61d:0x0].0x0 (ffff945bc4afe500) 00000020:00080000:0.0:1762166981.849695:0:7412:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0001: 64 batchid updated 00010000:00010000:3.0:1762166981.849696:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166981.849704:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cada00/0x2f180c4effbad07e lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x61d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.849712:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cada00/0x2f180c4effbad07e lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x61d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.849751:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac200/0x2f180c4effbad085 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.849760:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac200/0x2f180c4effbad085 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.849766:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac200/0x2f180c4effbad085 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.849772:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cac200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166981.849776:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac200/0x2f180c4effbad085 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00000100:00100000:0.0:1762166981.849783:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449798528:0@lo:2:osp-syn-1-1.0 00010000:00010000:3.0:1762166981.849806:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac200/0x2f180c4effbad085 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30829 initiator: MDT1 00000020:00080000:2.0:1762166981.849810:0:7435:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 65 committed batchid 64 00000100:00100000:1.0:1762166981.849812:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4a2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449798144:0@lo:2:osp-syn-1-1.0 00010000:00010000:3.0:1762166981.849830:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:3.0:1762166981.849834:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166981.849838:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac200/0x2f180c4effbad085 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.849845:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cac200/0x2f180c4effbad085 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00000100:00100000:0.0:1762166981.849876:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166981.849881:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5807100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449798272:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1762166981.849927:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1762166981.849929:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99a00/0x2f180c4effbad142 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaaab expref: 525 pid: 30829 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166981.849932:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000020:00080000:2.0:1762166981.849939:0:7435:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 64 cancel update log [0x240000400:0x2:0x0].63: rc = 0 00010000:00010000:3.0:1762166981.849944:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00000100:00100000:0.0:1762166981.849946:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5805f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449798400:0@lo:2:osp-syn-0-1.0 00010000:00010000:3.0:1762166981.849956:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000100:00100000:1.0:1762166981.849962:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7d21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449798784:0@lo:2:osp-syn-0-1.0 00000020:00080000:2.0:1762166981.849969:0:7435:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 64 00010000:00010000:3.0:1762166981.849975:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b98a00/0x2f180c4effbad13b lrc: 0/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaaab expref: 525 pid: 30829 timeout: 0 lvb_type: 3 00000100:00100000:0.0:1762166981.849992:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1762166981.850003:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99a00/0x2f180c4effbad142 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaaab expref: 524 pid: 30829 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166981.850007:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449798528 00000100:00100000:2.0:1762166981.850019:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449798528 00000100:00100000:1.0:1762166981.850028:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1762166981.850036:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:3.0:1762166981.850041:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1762166981.850045:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4b99a00, rc 0) 00000100:00100000:1.0:1762166981.850062:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1cd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449798656:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1762166981.850075:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449798272 00000100:00100000:2.0:1762166981.850080:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449798400 00000100:00100000:0.0:1762166981.850084:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449798272 00000100:00100000:2.0:1762166981.850088:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449798400 00000100:00100000:1.0:1762166981.850101:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166981.850108:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc8122300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+524:61766:x1847765450742400:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 2713us (2911us total) trans 4294992555 rc 0/0 00000100:00100000:3.0:1762166981.850119:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30899 00000100:00100000:0.0:1762166981.850138:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449798144 00000100:00100000:0.0:1762166981.850144:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449798144 00000100:00100000:2.0:1762166981.850161:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449798656 00000100:00100000:2.0:1762166981.850167:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449798656 00000100:00100000:1.0:1762166981.850169:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19489 00000100:00100000:0.0:1762166981.850185:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19490 00000100:00100000:1.0:1762166981.850187:0:8380:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb387480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+9:3636:x1847765449798528:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166981.850197:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19491 00000100:00100000:0.0:1762166981.850199:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+8:3634:x1847765449798272:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166981.850211:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc576a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+8:3636:x1847765449798400:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1762166981.850227:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19492 00000100:00100000:2.0:1762166981.850239:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+9:3633:x1847765449798144:12345-0@lo:2:osp-syn-1-1.0 00002000:00010000:1.0:1762166981.850320:0:8380:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166981.850322:0:9168:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166981.850325:0:8380:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00010000:0.0:1762166981.850327:0:9168:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb mtime from disk: 1762166966 -> 1762166966 00002000:00010000:1.0:1762166981.850329:0:8380:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166981 -> 1762166981 00002000:00010000:3.0:1762166981.850330:0:8382:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166981.850334:0:9168:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1762166981.850336:0:8380:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00002000:00010000:3.0:1762166981.850337:0:8382:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00010000:0.0:1762166981.850340:0:9168:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb ctime from disk: 1762166966 -> 1762166966 00002000:00010000:1.0:1762166981.850344:0:8380:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:3.0:1762166981.850345:0:8382:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166981 -> 1762166981 00002000:00010000:0.0:1762166981.850346:0:9168:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa78:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:3.0:1762166981.850353:0:8382:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00002000:00010000:3.0:1762166981.850359:0:8382:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00002000:00010000:2.0:1762166981.850370:0:9165:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:2.0:1762166981.850376:0:9165:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00010000:2.0:1762166981.850380:0:9165:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166981 -> 1762166981 00002000:00010000:2.0:1762166981.850384:0:9165:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00002000:00010000:2.0:1762166981.850388:0:9165:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 320 -> 320 00000100:00100000:0.0:1762166981.850404:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+10:3634:x1847765449798272:12345-0@lo:2:osp-syn-0-1.0 Request processed in 207us (477us total) trans 21474843485 rc 0/0 00000100:00100000:1.0:1762166981.850407:0:8380:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb387480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+11:3636:x1847765449798528:12345-0@lo:2:osp-syn-1-1.0 Request processed in 224us (530us total) trans 17179876749 rc 0/0 00000100:00100000:3.0:1762166981.850415:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc576a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+10:3636:x1847765449798400:12345-0@lo:2:osp-syn-0-1.0 Request processed in 207us (425us total) trans 21474843486 rc 0/0 00000100:00100000:0.0:1762166981.850422:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19490 00000100:00100000:1.0:1762166981.850431:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19489 00000100:00100000:3.0:1762166981.850438:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19491 00000100:00100000:0.0:1762166981.850450:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19493 00000100:00100000:0.0:1762166981.850463:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+10:3633:x1847765449798656:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1762166981.850508:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166981.850522:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+10:3633:x1847765449798144:12345-0@lo:2:osp-syn-1-1.0 Request processed in 242us (451us total) trans 17179876750 rc 0/0 00000100:00100000:3.0:1762166981.850527:0:35247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449798784 00000100:00100000:3.0:1762166981.850534:0:35247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449798784 00000100:00100000:2.0:1762166981.850536:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19492 00000004:00080000:1.0:1762166981.850560:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc5807100/2, rc 0, transno 21474843485 00000100:00100000:1.0:1762166981.850573:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5807100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449798272:0@lo:2:osp-syn-0-1.0 00000100:00100000:2.0:1762166981.850579:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19494 00002000:00010000:0.0:1762166981.850586:0:9168:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa91:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166981.850593:0:9168:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa91:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00010000:0.0:1762166981.850597:0:9168:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa91:0x0] updating lvb atime from disk: 1762166981 -> 1762166981 00002000:00010000:0.0:1762166981.850601:0:9168:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa91:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00000100:00100000:2.0:1762166981.850606:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+9:3634:x1847765449798784:12345-0@lo:2:osp-syn-0-1.0 00002000:00010000:0.0:1762166981.850608:0:9168:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa91:0x0] updating lvb blocks from disk: 0 -> 0 00000004:00080000:1.0:1762166981.850625:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc5805f80/2, rc 0, transno 21474843486 00000100:00100000:1.0:1762166981.850631:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5805f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449798400:0@lo:2:osp-syn-0-1.0 00000004:00080000:3.0:1762166981.850644:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc4a2b100/2, rc 0, transno 17179876750 00000004:00080000:1.0:1762166981.850646:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc4a2aa00/2, rc 0, transno 17179876749 00000100:00100000:1.0:1762166981.850654:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449798528:0@lo:2:osp-syn-1-1.0 00000100:00100000:3.0:1762166981.850655:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4a2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449798144:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1762166981.850660:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+10:3633:x1847765449798656:12345-0@lo:2:osp-syn-1-1.0 Request processed in 199us (559us total) trans 17179876751 rc 0/0 00000100:00100000:0.0:1762166981.850670:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19493 00000004:00080000:3.0:1762166981.850680:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945cf1cd3480/2, rc 0, transno 17179876751 00000100:00100000:3.0:1762166981.850687:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1cd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449798656:0@lo:2:osp-syn-1-1.0 00002000:00010000:2.0:1762166981.850711:0:9165:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa92:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:2.0:1762166981.850717:0:9165:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa92:0x0] updating lvb mtime from disk: 1762166981 -> 1762166981 00002000:00010000:2.0:1762166981.850719:0:9165:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa92:0x0] updating lvb atime from disk: 1762166981 -> 1762166981 00002000:00010000:2.0:1762166981.850723:0:9165:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa92:0x0] updating lvb ctime from disk: 1762166981 -> 1762166981 00002000:00010000:2.0:1762166981.850725:0:9165:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa92:0x0] updating lvb blocks from disk: 240 -> 240 00000100:00100000:2.0:1762166981.850784:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+10:3634:x1847765449798784:12345-0@lo:2:osp-syn-0-1.0 Request processed in 191us (275us total) trans 21474843487 rc 0/0 00000100:00100000:2.0:1762166981.850791:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19494 00000004:00080000:0.0:1762166981.850868:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc7d21180/2, rc 0, transno 21474843487 00000100:00100000:0.0:1762166981.850874:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7d21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449798784:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1762166981.852243:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.852288:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450742528 00000100:00100000:2.0:1762166981.852294:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450742528 00000100:00100000:2.0:1762166981.852327:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19495 00000100:00100000:2.0:1762166981.852332:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc8121c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+20:61766:x1847765450742528:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:2.0:1762166981.852341:0:9165:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166981.852353:0:9165:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4b98e00/0x2f180c4effbad149 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eaab2 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.852370:0:9165:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4b63a00/0x2f180c4effbacfe4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa2d expref: 21 pid: 9165 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166981.852376:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166981.852377:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166981.852387:0:9165:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4b98e00/0x2f180c4effbad149 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [28672->32767] (req 28672->32767) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaab2 expref: 21 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.852418:0:9165:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4b63a00/0x2f180c4effbacfe4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa2d expref: 21 pid: 9165 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166981.852430:0:9165:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc4b63a00/0x2f180c4effbacfe4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa2d expref: 21 pid: 9165 timeout: 700 lvb_type: 1 00000100:00100000:2.0:1762166981.852442:0:9165:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1e6d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9165:1847765449798912:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166981.852546:0:9165:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc4446600 going to sleep for 11 seconds 00000100:00100000:2.0:1762166981.853616:0:9165:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1e6d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9165:1847765449798912:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166981.853632:0:9165:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4b98e00/0x2f180c4effbad149 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [28672->32767] (req 28672->32767) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaab2 expref: 21 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.853642:0:9165:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4b98e00, rc 0) 00000100:00100000:2.0:1762166981.853673:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc8121c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+21:61766:x1847765450742528:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 1340us (1434us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166981.853680:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19495 00000100:00100000:3.0:1762166981.854047:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166981.854100:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450742656 00000100:00100000:0.0:1762166981.854105:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450742656 00010000:00010000:0.0:1762166981.854124:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4b63a00/0x2f180c4effbacfe4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa2d expref: 21 pid: 9165 timeout: 700 lvb_type: 1 00000100:00100000:0.0:1762166981.854154:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9841 00000100:00100000:0.0:1762166981.854164:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc8120000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450742656:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166981.854175:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166981.854189:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff945bc4b63a00/0x2f180c4effbacfe4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa2d expref: 21 pid: 9165 timeout: 700 lvb_type: 1 00010000:00010000:0.0:1762166981.854200:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc4b63a00/0x2f180c4effbacfe4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa2d expref: 21 pid: 9165 timeout: 700 lvb_type: 1 00010000:00010000:0.0:1762166981.854220:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4b63a00/0x2f180c4effbacfe4 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa2d expref: 21 pid: 9165 timeout: 700 lvb_type: 1 00010000:00010000:0.0:1762166981.854231:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166981.854233:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166981.854239:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4b98e00/0x2f180c4effbad149 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 28672->32767) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaab2 expref: 20 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.854248:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4b98e00/0x2f180c4effbad149 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 28672->32767) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaab2 expref: 20 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.854273:0:6481:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4b98e00/0x2f180c4effbad149 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 28672->32767) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaab2 expref: 20 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166981.854284:0:6481:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc576aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6481:1847765449799040:192.168.204.38@tcp:105: 00000100:00100000:0.0:1762166981.854332:0:6481:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc9a5e000 going to sleep for 11 seconds 00000100:00100000:0.0:1762166981.855268:0:6481:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc576aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6481:1847765449799040:192.168.204.38@tcp:105: 00010000:00010000:0.0:1762166981.855296:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166981.855353:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc8120000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450742656:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1191us (1306us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166981.855364:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9841 00000100:00100000:1.0:1762166981.867354:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.867424:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450742784 00000100:00100000:2.0:1762166981.867438:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450742784 00002000:00100000:2.0:1762166981.867510:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (28672->32767) req@ffff945ceda2c380 x1847765450742784/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:12/0 lens 488/0 e 0 to 0 dl 1762166992 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166981.867522:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945ceda2c380 with x1847765450742784 ext(28672->32767) 00002000:00010000:2.0:1762166981.867528:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945ceda2c380 00000100:00100000:2.0:1762166981.867564:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2769 00000100:00100000:2.0:1762166981.867579:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945ceda2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450742784:12345-192.168.204.38@tcp:3:lfs.0 00000100:00100000:2.0:1762166981.867750:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945ceda2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450742784:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 176us (411us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1762166981.867759:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2769 00002000:00100000:2.0:1762166981.867767:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (28672->32767) req@ffff945ceda2c380 x1847765450742784/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:12/0 lens 488/4536 e 0 to 0 dl 1762166992 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166981.867774:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945ceda2c380 with x1847765450742784 ext(28672->32767) 00002000:00010000:2.0:1762166981.867777:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945ceda2c380 00000100:00100000:3.0:1762166981.869617:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.869673:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450742912 00000100:00100000:2.0:1762166981.869679:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450742912 00002000:00100000:2.0:1762166981.869703:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (4096->69631) req@ffff945bc8123b80 x1847765450742912/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:12/0 lens 504/0 e 0 to 0 dl 1762166992 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166981.869726:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc8123b80 with x1847765450742912 ext(4096->69631) 00002000:00010000:2.0:1762166981.869730:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc8123b80 00000100:00100000:2.0:1762166981.869753:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2770 00000100:00100000:2.0:1762166981.869760:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc8123b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450742912:12345-192.168.204.38@tcp:3:lfs.0 00000100:00100000:2.0:1762166981.870815:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc8123b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450742912:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 1054us (1198us total) trans 0 rc 61440/61440 00000100:00100000:2.0:1762166981.870824:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2770 00002000:00100000:2.0:1762166981.870833:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (4096->69631) req@ffff945bc8123b80 x1847765450742912/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:12/0 lens 504/440 e 0 to 0 dl 1762166992 ref 1 fl Complete:/600/0 rc 61440/61440 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166981.870841:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc8123b80 with x1847765450742912 ext(4096->69631) 00002000:00010000:2.0:1762166981.870845:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc8123b80 00000100:00100000:1.0:1762166981.874326:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.874379:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450743040 00000100:00100000:2.0:1762166981.874386:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450743040 00002000:00100000:2.0:1762166981.874419:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (69632->106495) req@ffff945bc4011180 x1847765450743040/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:12/0 lens 488/0 e 0 to 0 dl 1762166992 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166981.874430:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4011180 with x1847765450743040 ext(69632->106495) 00002000:00010000:2.0:1762166981.874434:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4011180 00000100:00100000:2.0:1762166981.874456:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2771 00000100:00100000:2.0:1762166981.874466:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4011180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450743040:12345-192.168.204.38@tcp:3:lfs.0 00000100:00100000:2.0:1762166981.875717:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4011180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450743040:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 1245us (1387us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1762166981.875732:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2771 00002000:00100000:2.0:1762166981.875744:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (69632->106495) req@ffff945bc4011180 x1847765450743040/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:12/0 lens 488/440 e 0 to 0 dl 1762166992 ref 1 fl Complete:/600/0 rc 36864/36864 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166981.875755:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4011180 with x1847765450743040 ext(69632->106495) 00002000:00010000:2.0:1762166981.875760:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4011180 00000100:00100000:3.0:1762166981.877841:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.877904:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450743168 00000100:00100000:2.0:1762166981.877914:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450743168 00002000:00100000:2.0:1762166981.877956:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (28672->90111) req@ffff945bc8122a00 x1847765450743168/t0(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:12/0 lens 488/0 e 0 to 0 dl 1762166992 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166981.877964:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc8122a00 with x1847765450743168 ext(28672->90111) 00002000:00010000:2.0:1762166981.877967:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc8122a00 00000100:00100000:2.0:1762166981.877990:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2772 00000100:00100000:2.0:1762166981.877996:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc8122a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450743168:12345-192.168.204.38@tcp:4:lfs.0 00000100:00100000:2.0:1762166981.879651:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc8122a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450743168:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 1649us (1811us total) trans 17179876752 rc 0/0 00000100:00100000:2.0:1762166981.879662:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2772 00002000:00100000:2.0:1762166981.879672:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (28672->90111) req@ffff945bc8122a00 x1847765450743168/t17179876752(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:12/0 lens 488/448 e 0 to 0 dl 1762166992 ref 1 fl Complete:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166981.879682:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc8122a00 with x1847765450743168 ext(28672->90111) 00002000:00010000:2.0:1762166981.879687:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc8122a00 00000100:00100000:1.0:1762166981.880690:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.880741:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450743296 00000100:00100000:2.0:1762166981.880748:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450743296 00000100:00100000:2.0:1762166981.880785:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19496 00000100:00100000:2.0:1762166981.880792:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765450743296:12345-192.168.204.38@tcp:16:fsx.0 00000001:00080000:3.0:1762166981.882040:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876752 is committed 00000001:00080000:3.0:1762166981.882051:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876751 is committed 00000100:00100000:2.0:1762166981.882161:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450743296:12345-192.168.204.38@tcp:16:fsx.0 Request processed in 1367us (1472us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166981.882168:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19496 00000100:00100000:3.0:1762166981.883442:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.883550:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450743424 00000100:00100000:2.0:1762166981.883558:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450743424 00000100:00100000:2.0:1762166981.883609:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30900 00000100:00100000:2.0:1762166981.883618:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc8123100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+524:61766:x1847765450743424:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:2.0:1762166981.883645:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166981.883669:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b98400/0x2f180c4effbad150 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eaab9 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.883776:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99600/0x2f180c4effbad157 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166981.883790:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99600/0x2f180c4effbad157 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.883816:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99600/0x2f180c4effbad157 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000004:00200000:2.0:1762166981.883849:0:30829:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 262144 00000004:00200000:2.0:1762166981.883854:0:30829:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166981.883873:0:30829:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99600/0x2f180c4effbad157 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166981.883903:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b98400/0x2f180c4effbad150 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaab9 expref: 526 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.883920:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99600/0x2f180c4effbad157 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaab9 expref: 525 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.883934:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166981.883938:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166981.883942:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4b99600, rc 0) 00000100:00100000:2.0:1762166981.883989:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc8123100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+525:61766:x1847765450743424:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 372us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166981.883997:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30900 00000100:00100000:3.0:1762166981.886219:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.886263:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450743552 00000100:00100000:2.0:1762166981.886270:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450743552 00002000:00100000:2.0:1762166981.886312:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (106496->159743) req@ffff945bc8121f80 x1847765450743552/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:12/0 lens 488/0 e 0 to 0 dl 1762166992 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166981.886324:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc8121f80 with x1847765450743552 ext(106496->159743) 00002000:00010000:2.0:1762166981.886330:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc8121f80 00000100:00100000:2.0:1762166981.886357:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2773 00000100:00100000:2.0:1762166981.886366:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc8121f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450743552:12345-192.168.204.38@tcp:3:lfs.0 00000100:00100000:2.0:1762166981.887351:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc8121f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450743552:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 981us (1135us total) trans 0 rc 53248/53248 00000100:00100000:2.0:1762166981.887363:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2773 00002000:00100000:2.0:1762166981.887372:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (106496->159743) req@ffff945bc8121f80 x1847765450743552/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:12/0 lens 488/440 e 0 to 0 dl 1762166992 ref 1 fl Complete:/600/0 rc 53248/53248 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166981.887382:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc8121f80 with x1847765450743552 ext(106496->159743) 00002000:00010000:2.0:1762166981.887386:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc8121f80 00000100:00100000:3.0:1762166981.889618:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.889692:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450743680 00000100:00100000:2.0:1762166981.889699:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450743680 00002000:00100000:2.0:1762166981.889734:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (167936->233471) req@ffff945bc8121180 x1847765450743680/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:12/0 lens 488/0 e 0 to 0 dl 1762166992 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166981.889742:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc8121180 with x1847765450743680 ext(167936->233471) 00002000:00010000:2.0:1762166981.889745:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc8121180 00000100:00100000:2.0:1762166981.889770:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2774 00000100:00100000:2.0:1762166981.889779:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc8121180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450743680:12345-192.168.204.38@tcp:3:lfs.0 00000100:00100000:2.0:1762166981.890782:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc8121180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450743680:12345-192.168.204.38@tcp:3:lfs.0 Request processed in 995us (1163us total) trans 0 rc 65536/65536 00000100:00100000:2.0:1762166981.890793:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2774 00002000:00100000:2.0:1762166981.890811:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (167936->233471) req@ffff945bc8121180 x1847765450743680/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:12/0 lens 488/440 e 0 to 0 dl 1762166992 ref 1 fl Complete:/600/0 rc 65536/65536 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166981.890818:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc8121180 with x1847765450743680 ext(167936->233471) 00002000:00010000:2.0:1762166981.890821:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc8121180 00000100:00100000:1.0:1762166981.894375:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.894451:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450743808 00000100:00100000:2.0:1762166981.894463:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450743808 00002000:00100000:2.0:1762166981.894548:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (204800->212991) req@ffff945cf783fb80 x1847765450743808/t0(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:12/0 lens 8680/0 e 0 to 0 dl 1762166992 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166981.894561:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf783fb80 with x1847765450743808 ext(204800->212991) 00002000:00010000:2.0:1762166981.894567:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf783fb80 00000100:00100000:2.0:1762166981.894610:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2775 00000100:00100000:2.0:1762166981.894621:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450743808:12345-192.168.204.38@tcp:4:lfs.0 00000100:00100000:2.0:1762166981.895158:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450743808:12345-192.168.204.38@tcp:4:lfs.0 Request processed in 539us (795us total) trans 17179876753 rc 0/0 00000100:00100000:2.0:1762166981.895167:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2775 00002000:00100000:2.0:1762166981.895176:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (204800->212991) req@ffff945cf783fb80 x1847765450743808/t17179876753(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:12/0 lens 8680/448 e 0 to 0 dl 1762166992 ref 1 fl Complete:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166981.895184:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf783fb80 with x1847765450743808 ext(204800->212991) 00002000:00010000:2.0:1762166981.895188:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf783fb80 00000100:00100000:3.0:1762166981.896012:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.896053:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450743936 00000100:00100000:2.0:1762166981.896058:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450743936 00000100:00100000:2.0:1762166981.896086:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19497 00000100:00100000:2.0:1762166981.896091:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc8122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450743936:12345-192.168.204.38@tcp:16:fsx.0 00000001:00080000:3.0:1762166981.896780:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876753 is committed 00000100:00100000:2.0:1762166981.896879:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc8122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450743936:12345-192.168.204.38@tcp:16:fsx.0 Request processed in 787us (871us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166981.896884:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19497 00000100:00100000:3.0:1762166981.898225:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.898276:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450744064 00000100:00100000:2.0:1762166981.898283:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450744064 00000100:00100000:2.0:1762166981.898337:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2776 00000100:00100000:2.0:1762166981.898347:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc8122680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450744064:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:2.0:1762166981.898709:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:2.0:1762166981.898713:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166981 -> 1762166982 00002000:00010000:2.0:1762166981.898715:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166981 -> 1762166981 00002000:00010000:2.0:1762166981.898718:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166981 -> 1762166982 00002000:00010000:2.0:1762166981.898720:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 320 -> 440 00000100:00100000:2.0:1762166981.898779:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc8122680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450744064:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 433us (555us total) trans 17179876754 rc 0/0 00000100:00100000:2.0:1762166981.898888:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2776 00000100:00100000:1.0:1762166981.900464:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166981.900586:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450744192 00000100:00100000:3.0:1762166981.900595:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450744192 00000100:00100000:3.0:1762166981.900650:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30901 00000100:00100000:3.0:1762166981.900661:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+525:61766:x1847765450744192:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:3.0:1762166981.900681:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166981.900700:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effbad15e lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eaac0 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.900732:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63400/0x2f180c4effbad165 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:3.0:1762166981.900744:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63400/0x2f180c4effbad165 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.900755:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63400/0x2f180c4effbad165 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.900880:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effbad15e lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaac0 expref: 527 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.900895:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63400/0x2f180c4effbad165 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaac0 expref: 526 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.900904:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:3.0:1762166981.900907:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1762166981.900910:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4b63400, rc 0) 00000100:00100000:3.0:1762166981.900967:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+526:61766:x1847765450744192:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 307us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166981.900974:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30901 00000100:00100000:3.0:1762166981.902092:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.902126:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450744320 00000100:00100000:2.0:1762166981.902132:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450744320 00002000:00100000:2.0:1762166981.902163:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (40960->65535) req@ffff945bc8123800 x1847765450744320/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:12/0 lens 488/0 e 0 to 0 dl 1762166992 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166981.902173:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc8123800 with x1847765450744320 ext(40960->65535) 00002000:00010000:2.0:1762166981.902178:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc8123800 00000100:00100000:2.0:1762166981.902203:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2777 00000100:00100000:2.0:1762166981.902209:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc8123800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450744320:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:2.0:1762166981.903045:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc8123800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450744320:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 835us (952us total) trans 0 rc 24576/24576 00000100:00100000:2.0:1762166981.903058:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2777 00002000:00100000:2.0:1762166981.903066:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (40960->65535) req@ffff945bc8123800 x1847765450744320/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:12/0 lens 488/440 e 0 to 0 dl 1762166992 ref 1 fl Complete:/600/0 rc 24576/24576 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166981.903075:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc8123800 with x1847765450744320 ext(40960->65535) 00002000:00010000:2.0:1762166981.903079:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc8123800 00000100:00100000:1.0:1762166981.905428:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.905464:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450744448 00000100:00100000:2.0:1762166981.905471:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450744448 00000100:00100000:2.0:1762166981.905529:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2778 00000100:00100000:2.0:1762166981.905538:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450744448:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:2.0:1762166981.905675:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:2.0:1762166981.905678:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166982 -> 1762166982 00002000:00010000:2.0:1762166981.905681:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166981 -> 1762166981 00002000:00010000:2.0:1762166981.905683:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166982 -> 1762166982 00002000:00010000:2.0:1762166981.905685:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 440 -> 440 00000100:00100000:2.0:1762166981.905721:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450744448:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 185us (294us total) trans 17179876755 rc 0/0 00000100:00100000:2.0:1762166981.905731:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2778 00000100:00100000:3.0:1762166981.907225:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.907260:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450744576 00000100:00100000:2.0:1762166981.907265:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450744576 00000100:00100000:2.0:1762166981.907297:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2779 00000100:00100000:2.0:1762166981.907303:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc8120380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450744576:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:2.0:1762166981.907345:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:2.0:1762166981.907348:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166982 -> 1762166982 00002000:00010000:2.0:1762166981.907349:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166981 -> 1762166981 00002000:00010000:2.0:1762166981.907350:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166982 -> 1762166982 00002000:00010000:2.0:1762166981.907352:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 440 -> 440 00000100:00100000:2.0:1762166981.907376:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc8120380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450744576:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 74us (153us total) trans 17179876756 rc 0/0 00000100:00100000:2.0:1762166981.907380:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2779 00000100:00100000:0.0:1762166981.908745:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.908817:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450744832 00000100:00100000:2.0:1762166981.908822:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450744832 00000100:00100000:2.0:1762166981.908855:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11996 00000100:00100000:2.0:1762166981.908863:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc576aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+526:61766:x1847765450744832:12345-192.168.204.38@tcp:35:fsx.0 00000100:00100000:2.0:1762166981.909028:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc576aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+527:61766:x1847765450744832:12345-192.168.204.38@tcp:35:fsx.0 Request processed in 165us (283us total) trans 4294992556 rc 0/0 00000100:00100000:2.0:1762166981.909035:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11996 00000100:00100000:1.0:1762166981.917176:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166981.917267:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450745088 00000100:00100000:3.0:1762166981.917274:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450745088 00000100:00100000:3.0:1762166981.917317:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30902 00000100:00100000:3.0:1762166981.917326:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+527:61886:x1847765450745088:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166981.917351:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166981.917374:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effbad16c lrc: 2/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eaac7 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.917438:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63000/0x2f180c4effbad173 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:3.0:1762166981.917448:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63000/0x2f180c4effbad173 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.917456:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63000/0x2f180c4effbad173 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.917464:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62c00/0x2f180c4effbad17a lrc: 3/1,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:3.0:1762166981.917468:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62c00/0x2f180c4effbad17a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.917472:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62c00/0x2f180c4effbad17a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.917587:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62600/0x2f180c4effbad181 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:3.0:1762166981.917595:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62600/0x2f180c4effbad181 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.917605:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62600/0x2f180c4effbad181 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000004:00200000:3.0:1762166981.917615:0:30829:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 262144 00010000:00010000:3.0:1762166981.917684:0:30829:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63000/0x2f180c4effbad173 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.917689:0:30829:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63000/0x2f180c4effbad173 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.917692:0:30829:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63000/0x2f180c4effbad173 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.917696:0:30829:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63000/0x2f180c4effbad173 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.917700:0:30829:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4b63000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166981.917702:0:30829:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63000/0x2f180c4effbad173 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.917707:0:30829:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63000/0x2f180c4effbad173 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.917714:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0x0 (ffff945cc3449d00) 00010000:00010000:3.0:1762166981.917716:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166981.917719:0:30829:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63000/0x2f180c4effbad173 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.917723:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63000/0x2f180c4effbad173 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.917731:0:30829:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62c00/0x2f180c4effbad17a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.917737:0:30829:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62c00/0x2f180c4effbad17a lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.917741:0:30829:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62c00/0x2f180c4effbad17a lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.917743:0:30829:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4b62c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166981.917745:0:30829:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62c00/0x2f180c4effbad17a lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.917748:0:30829:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62c00/0x2f180c4effbad17a lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.917751:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0xdd396665 (ffff945cc3449e00) 00010000:00010000:3.0:1762166981.917752:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166981.917754:0:30829:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62c00/0x2f180c4effbad17a lrc: 2/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.917757:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62c00/0x2f180c4effbad17a lrc: 0/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.917791:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effbad16c lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaac7 expref: 530 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.917818:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62600/0x2f180c4effbad181 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaac7 expref: 529 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.917825:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:3.0:1762166981.917828:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166981.917830:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4b62600, rc 0) 00000100:00100000:3.0:1762166981.917884:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+529:61886:x1847765450745088:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 558us (715us total) trans 4294992557 rc 0/0 00000100:00100000:3.0:1762166981.917891:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30902 00000100:00100000:3.0:1762166981.919036:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166981.919080:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450745216 00000100:00100000:0.0:1762166981.919086:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450745216 00000100:00100000:0.0:1762166981.919129:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 906 00000100:00100000:0.0:1762166981.919137:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cd425a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+529:2418:x1847765450745216:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166981.919149:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166981.919159:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62600/0x2f180c4effbad181 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaac7 expref: 529 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.919168:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:0.0:1762166981.919170:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166981.919195:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cd425a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+528:2418:x1847765450745216:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 60us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166981.919199:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 906 00000100:00100000:0.0:1762166981.919627:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.919711:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450745472 00000100:00100000:2.0:1762166981.919727:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450745472 00000100:00100000:2.0:1762166981.919813:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11997 00000100:00100000:2.0:1762166981.919825:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5765500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+528:61886:x1847765450745472:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:2.0:1762166981.920067:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5765500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+529:61886:x1847765450745472:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 244us (440us total) trans 4294992558 rc 0/0 00000100:00100000:2.0:1762166981.920077:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11997 00000100:00100000:1.0:1762166981.921066:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166981.921142:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450745728 00000100:00100000:3.0:1762166981.921149:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450745728 00000100:00100000:3.0:1762166981.921193:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30903 00000100:00100000:3.0:1762166981.921202:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+529:61886:x1847765450745728:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166981.921218:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166981.921229:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62000/0x2f180c4effbad18f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eaace expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.921296:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63a00/0x2f180c4effbad196 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:3.0:1762166981.921306:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63a00/0x2f180c4effbad196 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.921313:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63a00/0x2f180c4effbad196 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000004:00200000:3.0:1762166981.921319:0:30829:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 262144 00010000:00010000:3.0:1762166981.921389:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62000/0x2f180c4effbad18f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaace expref: 532 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.921404:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63a00/0x2f180c4effbad196 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaace expref: 531 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.921411:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:3.0:1762166981.921414:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1762166981.921416:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4b63a00, rc 0) 00000100:00100000:3.0:1762166981.921466:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+531:61886:x1847765450745728:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 263us (400us total) trans 4294992559 rc 0/0 00000100:00100000:3.0:1762166981.921474:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30903 00000100:00100000:3.0:1762166981.923080:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166981.923135:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450745984 00000100:00100000:0.0:1762166981.923143:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450745984 00000100:00100000:0.0:1762166981.923183:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30904 00000100:00100000:0.0:1762166981.923192:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc8123480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+531:61886:x1847765450745984:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166981.923205:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166981.923217:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbad1a4 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eaad5 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.923282:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbad1ab lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:0.0:1762166981.923295:0:30829:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99600/0x2f180c4effbad157 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaab9 expref: 532 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.923303:0:30829:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbad1ab lrc: 4/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166981.923332:0:30829:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99600/0x2f180c4effbad157 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaab9 expref: 532 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166981.923351:0:30829:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99600/0x2f180c4effbad157 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaab9 expref: 532 pid: 30829 timeout: 701 lvb_type: 0 00000100:00100000:0.0:1762166981.923365:0:30829:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5764a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:30829:1847765449799168:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166981.923438:0:30829:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc9a5e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166981.924197:0:30829:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5764a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:30829:1847765449799168:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166981.924280:0:30829:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbad1ab lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000100:00100000:0.0:1762166981.924349:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166981.924405:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450746112 00000100:00100000:1.0:1762166981.924410:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450746112 00010000:00010000:1.0:1762166981.924431:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99600/0x2f180c4effbad157 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaab9 expref: 533 pid: 30829 timeout: 701 lvb_type: 0 00000100:00100000:1.0:1762166981.924468:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9842 00000100:00100000:1.0:1762166981.924503:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5764380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+533:2419:x1847765450746112:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166981.924513:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166981.924520:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99600/0x2f180c4effbad157 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaab9 expref: 533 pid: 30829 timeout: 701 lvb_type: 0 00010000:00010000:1.0:1762166981.924532:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99600/0x2f180c4effbad157 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaab9 expref: 533 pid: 30829 timeout: 701 lvb_type: 0 00010000:00010000:1.0:1762166981.924548:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99600/0x2f180c4effbad157 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaab9 expref: 533 pid: 30829 timeout: 701 lvb_type: 0 00010000:00010000:1.0:1762166981.924562:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:1.0:1762166981.924566:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbad1ab lrc: 3/0,1 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166981.924574:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbad1ab lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166981.924580:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbad1ab lrc: 4/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 30829 initiator: MDT1 00010000:00010000:1.0:1762166981.924602:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166981.924619:0:30829:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbad1ab lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.924627:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbad1ab lrc: 3/0,1 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000100:00100000:1.0:1762166981.924641:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5764380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+532:2419:x1847765450746112:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 164us (292us total) trans 0 rc 0/0 00000004:00200000:3.0:1762166981.924646:0:30829:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 262144 00000100:00100000:1.0:1762166981.924655:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9842 00010000:00010000:3.0:1762166981.924755:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbad1a4 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaad5 expref: 533 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.924777:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbad1ab lrc: 3/0,0 mode: CW/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaad5 expref: 532 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.924786:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:3.0:1762166981.924788:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1762166981.924791:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdf600, rc 0) 00000100:00100000:3.0:1762166981.924877:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc8123480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+532:61886:x1847765450745984:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1686us (1803us total) trans 4294992560 rc 0/0 00000100:00100000:3.0:1762166981.924885:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30904 00000100:00100000:0.0:1762166981.925861:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.925938:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450746240 00000100:00100000:2.0:1762166981.925944:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450746240 00000100:00100000:2.0:1762166981.925989:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11998 00000100:00100000:2.0:1762166981.925999:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5764a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+532:61886:x1847765450746240:12345-192.168.204.38@tcp:33:lfs.0 00000100:00100000:2.0:1762166981.926102:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5764a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+532:61886:x1847765450746240:12345-192.168.204.38@tcp:33:lfs.0 Request processed in 105us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166981.926111:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11998 00000100:00100000:0.0:1762166981.926816:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.926862:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450746496 00000100:00100000:2.0:1762166981.926866:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450746496 00000100:00100000:2.0:1762166981.926890:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 11999 00000100:00100000:2.0:1762166981.926895:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+532:61886:x1847765450746496:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:2.0:1762166981.927033:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+533:61886:x1847765450746496:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 136us (216us total) trans 4294992561 rc 0/0 00000100:00100000:2.0:1762166981.927040:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 11999 00000100:00100000:1.0:1762166981.927826:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166981.927858:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450746752 00000100:00100000:3.0:1762166981.927902:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450746752 00000100:00100000:3.0:1762166981.927940:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30905 00000100:00100000:3.0:1762166981.927946:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+533:61886:x1847765450746752:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166981.927959:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166981.927963:0:30829:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:3.0:1762166981.927986:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbad1ab lrc: 0/0,0 mode: --/CW res: [0x240000404:0x5eb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaad5 expref: 533 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.928006:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63a00/0x2f180c4effbad196 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaace expref: 532 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.928016:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:3.0:1762166981.928021:0:30829:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166981.928033:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effbad1b9 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eaadc expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.928101:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62c00/0x2f180c4effbad1c0 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:3.0:1762166981.928114:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62c00/0x2f180c4effbad1c0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.928122:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62c00/0x2f180c4effbad1c0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000004:00200000:3.0:1762166981.928131:0:30829:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 262144 00010000:00010000:3.0:1762166981.928193:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effbad1b9 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaadc expref: 534 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.928206:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62c00/0x2f180c4effbad1c0 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaadc expref: 533 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.928218:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:3.0:1762166981.928221:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166981.928223:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4b62c00, rc 0) 00000100:00100000:3.0:1762166981.928260:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+533:61886:x1847765450746752:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 314us (435us total) trans 4294992562 rc 0/0 00000100:00100000:3.0:1762166981.928268:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30905 00000100:00100000:0.0:1762166981.929570:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.929692:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450747008 00000100:00100000:2.0:1762166981.929702:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450747008 00000100:00100000:2.0:1762166981.929762:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 12000 00000100:00100000:2.0:1762166981.929775:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff2fe450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+533:61886:x1847765450747008:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:2.0:1762166981.929853:0:19593:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x240000404:0x5eb:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62c00/0x2f180c4effbad1c0 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaadc expref: 533 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.929888:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99400/0x2f180c4effbad1ce lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:2.0:1762166981.929902:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99a00/0x2f180c4effbad142 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaaab expref: 533 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.929909:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63400/0x2f180c4effbad165 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaac0 expref: 533 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.929915:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99400/0x2f180c4effbad1ce lrc: 5/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166981.929946:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63400/0x2f180c4effbad165 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaac0 expref: 533 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.929959:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63400/0x2f180c4effbad165 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaac0 expref: 533 pid: 30829 timeout: 701 lvb_type: 0 00000100:00100000:2.0:1762166981.929972:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf1e6d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449799296:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166981.930057:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99a00/0x2f180c4effbad142 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaaab expref: 533 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.930067:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99a00/0x2f180c4effbad142 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaaab expref: 533 pid: 30829 timeout: 701 lvb_type: 0 00000100:00100000:2.0:1762166981.930076:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4bd8380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449799424:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166981.930099:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cee014e40 going to sleep for 11 seconds 00000100:00100000:0.0:1762166981.931868:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.931887:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf1e6d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449799296:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166981.931912:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.931923:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4bd8380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449799424:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166981.931956:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450747136 00000100:00100000:1.0:1762166981.931966:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450747136 00000100:00100000:3.0:1762166981.931968:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450747264 00010000:00010000:2.0:1762166981.931969:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99400/0x2f180c4effbad1ce lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:3.0:1762166981.931977:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450747264 00010000:00010000:1.0:1762166981.932007:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63400/0x2f180c4effbad165 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaac0 expref: 535 pid: 30829 timeout: 701 lvb_type: 0 00010000:00010000:3.0:1762166981.932009:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99a00/0x2f180c4effbad142 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaaab expref: 535 pid: 30829 timeout: 701 lvb_type: 0 00000100:00100000:1.0:1762166981.932083:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9843 00000100:00100000:1.0:1762166981.932099:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc70b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+535:2418:x1847765450747136:12345-192.168.204.38@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1762166981.932109:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9844 00010000:00010000:1.0:1762166981.932117:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1762166981.932124:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc70b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+535:2419:x1847765450747264:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166981.932131:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63400/0x2f180c4effbad165 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaac0 expref: 535 pid: 30829 timeout: 701 lvb_type: 0 00010000:00010000:3.0:1762166981.932144:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166981.932152:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63400/0x2f180c4effbad165 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaac0 expref: 535 pid: 30829 timeout: 701 lvb_type: 0 00010000:00010000:3.0:1762166981.932159:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99a00/0x2f180c4effbad142 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaaab expref: 535 pid: 30829 timeout: 701 lvb_type: 0 00010000:00010000:3.0:1762166981.932201:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99a00/0x2f180c4effbad142 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaaab expref: 535 pid: 30829 timeout: 701 lvb_type: 0 00010000:00010000:1.0:1762166981.932228:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63400/0x2f180c4effbad165 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaac0 expref: 535 pid: 30829 timeout: 701 lvb_type: 0 00010000:00010000:3.0:1762166981.932244:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99a00/0x2f180c4effbad142 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaaab expref: 534 pid: 30829 timeout: 701 lvb_type: 0 00010000:00010000:1.0:1762166981.932250:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:1.0:1762166981.932258:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99400/0x2f180c4effbad1ce lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166981.932268:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99400/0x2f180c4effbad1ce lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166981.932276:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99400/0x2f180c4effbad1ce lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00010000:00010000:3.0:1762166981.932286:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:3.0:1762166981.932293:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166981.932308:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166981.932334:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99400/0x2f180c4effbad1ce lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:3.0:1762166981.932345:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc70b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+533:2419:x1847765450747264:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 222us (433us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166981.932350:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99400/0x2f180c4effbad1ce lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:1.0:1762166981.932357:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc70b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+533:2418:x1847765450747136:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 257us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166981.932383:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9844 00000100:00100000:1.0:1762166981.932394:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9843 00010000:00010000:2.0:1762166981.932640:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99400/0x2f180c4effbad1ce lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166981.932650:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99400/0x2f180c4effbad1ce lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166981.932656:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99400/0x2f180c4effbad1ce lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166981.932662:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4b99400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166981.932667:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99400/0x2f180c4effbad1ce lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166981.932674:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99400/0x2f180c4effbad1ce lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166981.932684:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166981.932687:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1762166981.932691:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99400/0x2f180c4effbad1ce lrc: 2/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166981.932696:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99400/0x2f180c4effbad1ce lrc: 0/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166981.932708:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945bc809b800) 00010000:00010000:2.0:1762166981.932711:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166981.932716:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62c00/0x2f180c4effbad1c0 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaadc expref: 531 pid: 30829 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166981.932870:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff2fe450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+531:61886:x1847765450747008:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 3099us (3303us total) trans 4294992563 rc -22/-22 00000100:00100000:2.0:1762166981.932879:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 12000 00000100:00100000:0.0:1762166981.933946:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166981.934025:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450747392 00000100:00100000:3.0:1762166981.934031:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450747392 00000100:00100000:3.0:1762166981.934068:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30906 00000100:00100000:3.0:1762166981.934079:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc3550e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+531:61886:x1847765450747392:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166981.934096:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166981.934112:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62000/0x2f180c4effbad1d5 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eaae3 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.934157:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62000/0x2f180c4effbad1d5 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaae3 expref: 532 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.934169:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62000/0x2f180c4effbad1d5 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaae3 expref: 532 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.934184:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945cc3449d00) 00010000:00010000:3.0:1762166981.934187:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166981.934189:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4b62000, rc 0) 00000100:00100000:3.0:1762166981.934233:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc3550e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+532:61886:x1847765450747392:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 157us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166981.934239:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30906 00000100:00100000:1.0:1762166981.935899:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166981.935932:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450747648 00000100:00100000:3.0:1762166981.935937:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450747648 00000100:00100000:3.0:1762166981.935972:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30907 00000100:00100000:3.0:1762166981.935978:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+532:61886:x1847765450747648:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166981.935986:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166981.935996:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effbad1dc lrc: 2/0,0 mode: --/CW res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eaaea expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.936385:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63a00/0x2f180c4effbad1e3 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x61e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:3.0:1762166981.936395:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63a00/0x2f180c4effbad1e3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x61e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.936403:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63a00/0x2f180c4effbad1e3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x61e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000004:00200000:3.0:1762166981.936418:0:30829:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x61e:0x0]: returning size 0 00010000:00010000:3.0:1762166981.936460:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effbad1dc lrc: 0/0,0 mode: --/CW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaaea expref: 535 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.936512:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63a00/0x2f180c4effbad1e3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x61e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaaea expref: 534 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.936521:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x61e:0x0].0x0 (ffff945cc3449100) 00010000:00010000:3.0:1762166981.936525:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166981.936527:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4b63a00, rc 0) 00000100:00100000:3.0:1762166981.936565:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+534:61886:x1847765450747648:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 585us (668us total) trans 4294992564 rc 0/0 00000100:00100000:3.0:1762166981.936571:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30907 00000100:00100000:0.0:1762166981.938069:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166981.938155:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450747904 00000100:00100000:3.0:1762166981.938162:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450747904 00000100:00100000:3.0:1762166981.938204:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30908 00000100:00100000:3.0:1762166981.938213:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc3551c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+534:61886:x1847765450747904:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166981.938228:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166981.938240:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63000/0x2f180c4effbad1f1 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eaaf1 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.938300:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62800/0x2f180c4effbad1f8 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:3.0:1762166981.938309:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62800/0x2f180c4effbad1f8 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.938317:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62800/0x2f180c4effbad1f8 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000004:00200000:3.0:1762166981.938327:0:30829:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 262144 00010000:00010000:3.0:1762166981.938403:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63000/0x2f180c4effbad1f1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaaf1 expref: 537 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.938416:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62800/0x2f180c4effbad1f8 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaaf1 expref: 536 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.938424:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945cc3449d00) 00010000:00010000:3.0:1762166981.938426:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1762166981.938429:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4b62800, rc 0) 00000100:00100000:3.0:1762166981.938467:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc3551c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+536:61886:x1847765450747904:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 256us (401us total) trans 4294992565 rc 0/0 00000100:00100000:3.0:1762166981.938474:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30908 00000100:00100000:0.0:1762166981.939703:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.939748:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450748160 00000100:00100000:2.0:1762166981.939754:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450748160 00000100:00100000:2.0:1762166981.939803:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 12001 00000100:00100000:2.0:1762166981.939813:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc3552d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+536:61886:x1847765450748160:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:2.0:1762166981.939857:0:19593:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x240000404:0x5eb:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62800/0x2f180c4effbad1f8 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaaf1 expref: 536 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.939881:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b98600/0x2f180c4effbad206 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:2.0:1762166981.939891:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62000/0x2f180c4effbad1d5 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaae3 expref: 536 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.939899:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b98600/0x2f180c4effbad206 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166981.939928:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62000/0x2f180c4effbad1d5 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaae3 expref: 536 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.939941:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62000/0x2f180c4effbad1d5 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaae3 expref: 536 pid: 30829 timeout: 701 lvb_type: 0 00000100:00100000:2.0:1762166981.939954:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4bd8380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449799552:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166981.940011:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1762166981.940958:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4bd8380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449799552:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166981.940973:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b98600/0x2f180c4effbad206 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:0.0:1762166981.941184:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166981.941242:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450748288 00000100:00100000:1.0:1762166981.941254:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450748288 00010000:00010000:1.0:1762166981.941292:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62000/0x2f180c4effbad1d5 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaae3 expref: 537 pid: 30829 timeout: 701 lvb_type: 0 00000100:00100000:1.0:1762166981.941333:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9845 00000100:00100000:1.0:1762166981.941347:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc3550380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+537:2418:x1847765450748288:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166981.941361:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166981.941368:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62000/0x2f180c4effbad1d5 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaae3 expref: 537 pid: 30829 timeout: 701 lvb_type: 0 00010000:00010000:1.0:1762166981.941381:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62000/0x2f180c4effbad1d5 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaae3 expref: 537 pid: 30829 timeout: 701 lvb_type: 0 00010000:00010000:1.0:1762166981.941396:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62000/0x2f180c4effbad1d5 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaae3 expref: 537 pid: 30829 timeout: 701 lvb_type: 0 00010000:00010000:1.0:1762166981.941412:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945cc3449d00) 00010000:00010000:1.0:1762166981.941417:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b98600/0x2f180c4effbad206 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166981.941426:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b98600/0x2f180c4effbad206 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166981.941433:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b98600/0x2f180c4effbad206 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166981.941459:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166981.941509:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b98600/0x2f180c4effbad206 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166981.941519:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b98600/0x2f180c4effbad206 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:1.0:1762166981.941527:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc3550380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+536:2418:x1847765450748288:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 182us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166981.941536:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9845 00010000:00010000:2.0:1762166981.941537:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99200/0x2f180c4effbad20d lrc: 3/0,1 mode: --/EX res: [0x240000404:0x61e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:2.0:1762166981.941554:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63a00/0x2f180c4effbad1e3 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x61e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaaea expref: 535 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.941562:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99200/0x2f180c4effbad20d lrc: 4/0,1 mode: --/EX res: [0x240000404:0x61e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166981.941585:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63a00/0x2f180c4effbad1e3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x61e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaaea expref: 535 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.941599:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63a00/0x2f180c4effbad1e3 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x61e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaaea expref: 535 pid: 30829 timeout: 701 lvb_type: 0 00000100:00100000:2.0:1762166981.941609:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4bd8380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449799680:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166981.941674:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1762166981.942692:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4bd8380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449799680:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166981.942706:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99200/0x2f180c4effbad20d lrc: 3/0,1 mode: --/EX res: [0x240000404:0x61e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:0.0:1762166981.943002:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166981.943063:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450748416 00000100:00100000:1.0:1762166981.943069:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450748416 00010000:00010000:1.0:1762166981.943088:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63a00/0x2f180c4effbad1e3 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x61e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaaea expref: 536 pid: 30829 timeout: 701 lvb_type: 0 00000100:00100000:1.0:1762166981.943110:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9846 00000100:00100000:1.0:1762166981.943116:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+536:2418:x1847765450748416:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166981.943125:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166981.943131:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63a00/0x2f180c4effbad1e3 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x61e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaaea expref: 536 pid: 30829 timeout: 701 lvb_type: 0 00010000:00010000:1.0:1762166981.943139:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63a00/0x2f180c4effbad1e3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x61e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaaea expref: 536 pid: 30829 timeout: 701 lvb_type: 0 00010000:00010000:1.0:1762166981.943149:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63a00/0x2f180c4effbad1e3 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x61e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaaea expref: 536 pid: 30829 timeout: 701 lvb_type: 0 00010000:00010000:1.0:1762166981.943159:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x61e:0x0].0x0 (ffff945cc3449100) 00010000:00010000:1.0:1762166981.943164:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99200/0x2f180c4effbad20d lrc: 3/0,1 mode: --/EX res: [0x240000404:0x61e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166981.943171:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99200/0x2f180c4effbad20d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x61e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166981.943178:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99200/0x2f180c4effbad20d lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x61e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166981.943204:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166981.943238:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99200/0x2f180c4effbad20d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x61e:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166981.943245:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99200/0x2f180c4effbad20d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x61e:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:1.0:1762166981.943254:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+535:2418:x1847765450748416:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 136us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166981.943261:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9846 00000100:00100000:2.0:1762166981.943709:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4bd8380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449799808:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762166981.943758:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166981.943792:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166981.943829:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449799808 00000100:00100000:1.0:1762166981.943838:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449799808 00000100:00100000:1.0:1762166981.943886:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1482 00000100:00100000:1.0:1762166981.943896:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4bd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449799808:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166981.944001:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4bd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449799808:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 107us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166981.944012:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1482 00000100:00100000:2.0:1762166981.944029:0:19593:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 17179876751 gen 2 00000004:00080000:2.0:1762166981.944037:0:19593:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bccb7f800, transno 17179876744 00000004:00080000:2.0:1762166981.944053:0:19593:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 17179876748 committed transno 17179876751 00000004:00080000:2.0:1762166981.944077:0:19593:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc4a2aa00, transno 17179876749 00000004:00080000:2.0:1762166981.944081:0:19593:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc4a2b100, transno 17179876750 00000004:00080000:2.0:1762166981.944084:0:19593:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945cf1cd3480, transno 17179876751 00000100:00100000:2.0:1762166981.944092:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4bd8380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449799808:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762166981.944139:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4bd8380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449799936:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762166981.944177:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1762166981.944208:0:9994:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0001: 0 changes, 0 in progress, 0 in flight, 3 done 00000100:00100000:2.0:1762166981.944209:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166981.944220:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449799936 00000100:00100000:3.0:1762166981.944226:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449799936 00000100:00100000:3.0:1762166981.944259:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1483 00000100:00100000:3.0:1762166981.944268:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4bd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:19593:x1847765449799936:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166981.944351:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4bd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:19593:x1847765449799936:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 85us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166981.944359:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1483 00000100:00100000:2.0:1762166981.944423:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4bd8380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449799936:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762166981.944468:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4bd8380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449800064:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762166981.944524:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166981.944535:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402f300 going to sleep for 11 seconds 00000100:00100000:3.0:1762166981.944538:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449800064 00000100:00100000:3.0:1762166981.944543:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449800064 00000100:00100000:3.0:1762166981.944566:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1484 00000100:00100000:3.0:1762166981.944571:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4bdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:19593:x1847765449800064:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166981.944626:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4bdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:19593:x1847765449800064:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 53us (102us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166981.944633:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1484 00000100:00100000:2.0:1762166981.944640:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4bd8380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449800064:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762166981.944680:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4bd8380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449800192:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762166981.944703:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166981.944722:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402f300 going to sleep for 11 seconds 00000100:00100000:3.0:1762166981.944731:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449800192 00000100:00100000:3.0:1762166981.944735:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449800192 00000100:00100000:3.0:1762166981.944755:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1485 00000100:00100000:3.0:1762166981.944761:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4bdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449800192:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166981.944822:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4bdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449800192:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 62us (118us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166981.944829:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1485 00000100:00100000:2.0:1762166981.944846:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4bd8380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449800192:0@lo:1000:mdt_rdpg00_003.0 00000040:00080000:2.0:1762166981.944955:0:19593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x2:0x0].65, 280 off72624 00000001:00080000:2.0:1762166981.944961:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992566 00000100:00100000:2.0:1762166981.944991:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4bd8380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449800320:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762166981.945007:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166981.945022:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166981.945042:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449800320 00000100:00100000:3.0:1762166981.945047:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449800320 00000100:00100000:3.0:1762166981.945070:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1486 00000100:00100000:3.0:1762166981.945074:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4bdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:19593:x1847765449800320:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166981.945173:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4bdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:19593:x1847765449800320:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 98us (164us total) trans 17179876757 rc 0/0 00000100:00100000:3.0:1762166981.945181:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1486 00000100:00100000:2.0:1762166981.945205:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4bd8380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449800320:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762166981.945229:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4bdad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449800448:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762166981.945254:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166981.945272:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166981.945287:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449800448 00000100:00100000:3.0:1762166981.945292:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449800448 00000100:00100000:3.0:1762166981.945317:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1487 00000100:00100000:3.0:1762166981.945325:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4bd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:19593:x1847765449800448:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166981.945406:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4bd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:19593:x1847765449800448:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 82us (150us total) trans 21474843488 rc 0/0 00000100:00100000:3.0:1762166981.945414:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1487 00000100:00100000:2.0:1762166981.945418:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4bdad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449800448:0@lo:1000:mdt_rdpg00_003.0 00000001:00080000:2.0:1762166981.945456:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992567 00010000:00010000:2.0:1762166981.945473:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99200/0x2f180c4effbad20d lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x61e:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166981.945500:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99200/0x2f180c4effbad20d lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x61e:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166981.945506:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99200/0x2f180c4effbad20d lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x61e:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166981.945513:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4b99200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166981.945519:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99200/0x2f180c4effbad20d lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x61e:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166981.945526:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99200/0x2f180c4effbad20d lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x61e:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166981.945540:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x61e:0x0].0x0 (ffff945cc3449100) 00010000:00010000:2.0:1762166981.945542:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1762166981.945546:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99200/0x2f180c4effbad20d lrc: 2/0,0 mode: --/EX res: [0x240000404:0x61e:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166981.945551:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99200/0x2f180c4effbad20d lrc: 0/0,0 mode: --/EX res: [0x240000404:0x61e:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166981.945571:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b98600/0x2f180c4effbad206 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166981.945577:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b98600/0x2f180c4effbad206 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166981.945582:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b98600/0x2f180c4effbad206 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166981.945586:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4b98600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166981.945589:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b98600/0x2f180c4effbad206 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166981.945595:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b98600/0x2f180c4effbad206 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166981.945602:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945cc3449d00) 00010000:00010000:2.0:1762166981.945604:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1762166981.945607:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b98600/0x2f180c4effbad206 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166981.945612:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b98600/0x2f180c4effbad206 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166981.945623:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945cc3449d00) 00010000:00010000:2.0:1762166981.945626:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1762166981.945632:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62800/0x2f180c4effbad1f8 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaaf1 expref: 537 pid: 30829 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166981.945713:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc3552d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+536:61886:x1847765450748160:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 5902us (6012us total) trans 4294992568 rc 0/0 00000100:00100000:2.0:1762166981.945719:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 12001 00000020:00080000:2.0:1762166981.945723:0:19593:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1762166981.946918:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166981.946965:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450748544 00000100:00100000:3.0:1762166981.946972:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450748544 00000100:00100000:3.0:1762166981.947013:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30909 00000100:00100000:3.0:1762166981.947021:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+536:61886:x1847765450748544:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166981.947037:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166981.947053:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62e00/0x2f180c4effbad214 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eaaf8 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.947093:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62e00/0x2f180c4effbad214 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaaf8 expref: 537 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.947102:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62e00/0x2f180c4effbad214 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaaf8 expref: 537 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.947115:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945cc3449e00) 00010000:00010000:3.0:1762166981.947117:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1762166981.947119:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4b62e00, rc 0) 00000100:00100000:3.0:1762166981.947151:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+537:61886:x1847765450748544:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 132us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166981.947155:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30909 00000100:00100000:0.0:1762166981.948329:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.948378:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450748672 00000100:00100000:2.0:1762166981.948384:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450748672 00002000:00100000:2.0:1762166981.948425:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (57344->65535) req@ffff945bc55dce00 x1847765450748672/t0(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:12/0 lens 8680/0 e 0 to 0 dl 1762166992 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166981.948437:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc55dce00 with x1847765450748672 ext(57344->65535) 00002000:00010000:2.0:1762166981.948443:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc55dce00 00000100:00100000:2.0:1762166981.948504:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2780 00000100:00100000:2.0:1762166981.948515:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450748672:12345-192.168.204.38@tcp:4:fsx.0 00000100:00100000:2.0:1762166981.949268:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765450748672:12345-192.168.204.38@tcp:4:fsx.0 Request processed in 754us (941us total) trans 17179876759 rc 0/0 00000100:00100000:2.0:1762166981.949278:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2780 00002000:00100000:2.0:1762166981.949286:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (57344->65535) req@ffff945bc55dce00 x1847765450748672/t17179876759(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:12/0 lens 8680/448 e 0 to 0 dl 1762166992 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166981.949295:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc55dce00 with x1847765450748672 ext(57344->65535) 00002000:00010000:2.0:1762166981.949299:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc55dce00 00000100:00100000:1.0:1762166981.950820:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.950870:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450748928 00000100:00100000:2.0:1762166981.950882:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450748928 00000100:00100000:2.0:1762166981.950939:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 12002 00000100:00100000:2.0:1762166981.950947:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+537:61886:x1847765450748928:12345-192.168.204.38@tcp:35:lfs.0 00000004:00080000:2.0:1762166981.951168:0:19593:0:(mdd_object.c:3965:mdd_close()) Object [0x240000404:0x61e:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1762166981.951213:0:19593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5965, 64 off467600 00000040:00080000:2.0:1762166981.951227:0:19593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5966, 64 off467600 00000001:00080000:2.0:1762166981.951231:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992569 00010000:00010000:2.0:1762166981.951258:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99400/0x2f180c4effbad21b lrc: 3/0,1 mode: --/PW res: [0x240000404:0x61e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:2.0:1762166981.951269:0:19593:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99400/0x2f180c4effbad21b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x61e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166981.951277:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99400/0x2f180c4effbad21b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x61e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166981.951283:0:19593:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99400/0x2f180c4effbad21b lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x61e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166981.951287:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99400/0x2f180c4effbad21b lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x61e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166981.951290:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99400/0x2f180c4effbad21b lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x61e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166981.951307:0:19593:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1762166981.951376:0:6483:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1762166981.951386:0:6483:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99400/0x2f180c4effbad21b lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x61e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166981.951396:0:6483:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4b99400 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166981.951401:0:6483:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99400/0x2f180c4effbad21b lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x61e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166981.951410:0:6483:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99400/0x2f180c4effbad21b lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x61e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166981.951427:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x61e:0x0].0x0 (ffff945bc809b800) 00010000:00010000:0.0:1762166981.951430:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1762166981.951435:0:6483:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99400/0x2f180c4effbad21b lrc: 1/0,0 mode: --/PW res: [0x240000404:0x61e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166981.951441:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99400/0x2f180c4effbad21b lrc: 0/0,0 mode: --/PW res: [0x240000404:0x61e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 19593 initiator: MDT1 00000100:00100000:2.0:1762166981.951450:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+539:61886:x1847765450748928:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 502us (633us total) trans 4294992570 rc 0/0 00000100:00100000:2.0:1762166981.951458:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 12002 00000020:00080000:2.0:1762166981.951463:0:19593:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1762166981.951468:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166981.951474:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166981.951528:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166981.952446:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.952512:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450749184 00000100:00100000:2.0:1762166981.952517:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450749184 00000100:00100000:2.0:1762166981.952536:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 12003 00000100:00100000:2.0:1762166981.952541:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+539:61886:x1847765450749184:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:2.0:1762166981.952644:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+540:61886:x1847765450749184:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 96us (195us total) trans 4294992571 rc 0/0 00000100:00100000:2.0:1762166981.952655:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 12003 00000100:00100000:0.0:1762166981.954790:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166981.954907:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450749440 00000100:00100000:3.0:1762166981.954916:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450749440 00000100:00100000:3.0:1762166981.954970:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30910 00000100:00100000:3.0:1762166981.954981:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+540:61766:x1847765450749440:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:3.0:1762166981.955004:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166981.955027:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63000/0x2f180c4effbad222 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eaaff expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.955105:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effbad229 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:3.0:1762166981.955120:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effbad229 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.955131:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effbad229 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.955145:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62800/0x2f180c4effbad230 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:3.0:1762166981.955152:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62800/0x2f180c4effbad230 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.955159:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62800/0x2f180c4effbad230 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.955264:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63a00/0x2f180c4effbad237 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:3.0:1762166981.955272:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63a00/0x2f180c4effbad237 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.955279:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63a00/0x2f180c4effbad237 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000004:00200000:3.0:1762166981.955289:0:30829:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 262144 00010000:00010000:3.0:1762166981.955369:0:30829:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effbad229 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.955381:0:30829:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effbad229 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.955387:0:30829:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effbad229 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.955394:0:30829:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effbad229 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.955399:0:30829:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4b63e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166981.955404:0:30829:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effbad229 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.955411:0:30829:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effbad229 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.955424:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0x0 (ffff945cc3449600) 00010000:00010000:3.0:1762166981.955427:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166981.955431:0:30829:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effbad229 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.955437:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63e00/0x2f180c4effbad229 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.955449:0:30829:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62800/0x2f180c4effbad230 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.955454:0:30829:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62800/0x2f180c4effbad230 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.955459:0:30829:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62800/0x2f180c4effbad230 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.955464:0:30829:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4b62800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166981.955466:0:30829:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62800/0x2f180c4effbad230 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.955471:0:30829:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62800/0x2f180c4effbad230 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.955518:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0xdd396665 (ffff945cc3449c00) 00010000:00010000:3.0:1762166981.955522:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166981.955525:0:30829:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62800/0x2f180c4effbad230 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.955532:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62800/0x2f180c4effbad230 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.955591:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63000/0x2f180c4effbad222 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaaff expref: 543 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.955608:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63a00/0x2f180c4effbad237 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaaff expref: 542 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.955616:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945cc3449e00) 00010000:00010000:3.0:1762166981.955619:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166981.955622:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4b63a00, rc 0) 00000100:00100000:3.0:1762166981.955686:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+542:61766:x1847765450749440:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 707us (901us total) trans 4294992572 rc 0/0 00000100:00100000:3.0:1762166981.955695:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30910 00000100:00100000:1.0:1762166981.957885:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166981.957933:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450749568 00000100:00100000:3.0:1762166981.957943:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450749568 00000100:00100000:3.0:1762166981.957993:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30911 00000100:00100000:3.0:1762166981.958003:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+542:61766:x1847765450749568:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:3.0:1762166981.958027:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166981.958044:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62000/0x2f180c4effbad245 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eab06 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.958074:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62c00/0x2f180c4effbad24c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:3.0:1762166981.958086:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62c00/0x2f180c4effbad24c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.958095:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62c00/0x2f180c4effbad24c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.958195:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62000/0x2f180c4effbad245 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eab06 expref: 544 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.958217:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62c00/0x2f180c4effbad24c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eab06 expref: 543 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.958225:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945cc3449e00) 00010000:00010000:3.0:1762166981.958228:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1762166981.958231:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4b62c00, rc 0) 00000100:00100000:3.0:1762166981.958284:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+543:61766:x1847765450749568:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 282us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166981.958291:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30911 00000100:00100000:0.0:1762166981.959355:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.959410:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450749696 00000100:00100000:2.0:1762166981.959416:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450749696 00002000:00100000:2.0:1762166981.959442:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (57344->61439) req@ffff945bc47b5c00 x1847765450749696/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:12/0 lens 488/0 e 0 to 0 dl 1762166992 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166981.959450:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc47b5c00 with x1847765450749696 ext(57344->61439) 00002000:00010000:2.0:1762166981.959453:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc47b5c00 00000100:00100000:2.0:1762166981.959471:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2781 00000100:00100000:2.0:1762166981.959495:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+23:2417:x1847765450749696:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:2.0:1762166981.959621:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+23:2417:x1847765450749696:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 143us (265us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1762166981.959628:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2781 00002000:00100000:2.0:1762166981.959635:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (57344->61439) req@ffff945bc47b5c00 x1847765450749696/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:12/0 lens 488/4536 e 0 to 0 dl 1762166992 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166981.959646:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc47b5c00 with x1847765450749696 ext(57344->61439) 00002000:00010000:2.0:1762166981.959649:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc47b5c00 00000100:00100000:0.0:1762166981.960909:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.960980:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450749824 00000100:00100000:2.0:1762166981.960987:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450749824 00002000:00100000:2.0:1762166981.961014:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (114688->118783) req@ffff945bc4532300 x1847765450749824/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:12/0 lens 488/0 e 0 to 0 dl 1762166992 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166981.961023:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4532300 with x1847765450749824 ext(114688->118783) 00002000:00010000:2.0:1762166981.961027:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4532300 00000100:00100000:2.0:1762166981.961051:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2782 00000100:00100000:2.0:1762166981.961060:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4532300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765450749824:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:2.0:1762166981.961162:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4532300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765450749824:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 103us (255us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1762166981.961170:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2782 00002000:00100000:2.0:1762166981.961177:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (114688->118783) req@ffff945bc4532300 x1847765450749824/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:12/0 lens 488/4536 e 0 to 0 dl 1762166992 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166981.961185:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4532300 with x1847765450749824 ext(114688->118783) 00002000:00010000:2.0:1762166981.961189:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4532300 00000100:00100000:1.0:1762166981.963090:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.963142:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450749952 00000100:00100000:2.0:1762166981.963156:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450749952 00000100:00100000:2.0:1762166981.963228:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2783 00000100:00100000:2.0:1762166981.963240:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765450749952:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:2.0:1762166981.963763:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:2.0:1762166981.963768:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166982 -> 1762166982 00002000:00010000:2.0:1762166981.963771:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166981 -> 1762166981 00002000:00010000:2.0:1762166981.963774:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166982 -> 1762166982 00002000:00010000:2.0:1762166981.963776:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 440 -> 392 00000100:00100000:2.0:1762166981.963862:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765450749952:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 624us (773us total) trans 17179876760 rc 0/0 00000100:00100000:2.0:1762166981.963871:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2783 00000100:00100000:0.0:1762166981.967259:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.967305:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450750080 00000100:00100000:2.0:1762166981.967315:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450750080 00002000:00100000:2.0:1762166981.967369:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (57344->118783) req@ffff945bc4530e00 x1847765450750080/t0(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:12/0 lens 488/0 e 0 to 0 dl 1762166992 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166981.967400:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4530e00 with x1847765450750080 ext(57344->118783) 00002000:00010000:2.0:1762166981.967407:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4530e00 00000100:00100000:2.0:1762166981.967434:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2784 00000100:00100000:2.0:1762166981.967444:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4530e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765450750080:12345-192.168.204.38@tcp:4:fsx.0 00000100:00100000:3.0:1762166981.969107:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4530e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765450750080:12345-192.168.204.38@tcp:4:fsx.0 Request processed in 1659us (1847us total) trans 17179876761 rc 0/0 00000100:00100000:3.0:1762166981.969119:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2784 00002000:00100000:3.0:1762166981.969129:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (57344->118783) req@ffff945bc4530e00 x1847765450750080/t17179876761(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:12/0 lens 488/448 e 0 to 0 dl 1762166992 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166981.969139:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4530e00 with x1847765450750080 ext(57344->118783) 00002000:00010000:3.0:1762166981.969144:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4530e00 00000100:00100000:1.0:1762166981.970039:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.970092:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450750208 00000100:00100000:2.0:1762166981.970100:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450750208 00000100:00100000:2.0:1762166981.970147:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19498 00000100:00100000:2.0:1762166981.970156:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+26:2418:x1847765450750208:12345-192.168.204.38@tcp:16:fsx.0 00000001:00080000:3.0:1762166981.971087:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876761 is committed 00000001:00080000:3.0:1762166981.971106:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876757 is committed 00000100:00100000:2.0:1762166981.971218:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450750208:12345-192.168.204.38@tcp:16:fsx.0 Request processed in 1062us (1181us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166981.971226:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19498 00000100:00100000:0.0:1762166981.973409:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166981.973462:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450750336 00000100:00100000:3.0:1762166981.973470:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450750336 00002000:00100000:3.0:1762166981.973543:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (167936->176127) req@ffff945bc4531880 x1847765450750336/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:12/0 lens 488/0 e 0 to 0 dl 1762166992 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166981.973554:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4531880 with x1847765450750336 ext(167936->176127) 00002000:00010000:3.0:1762166981.973561:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4531880 00000100:00100000:3.0:1762166981.973593:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2785 00000100:00100000:3.0:1762166981.973604:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4531880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450750336:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:3.0:1762166981.973833:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4531880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450750336:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 231us (431us total) trans 0 rc 8192/8192 00000100:00100000:3.0:1762166981.973839:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2785 00002000:00100000:3.0:1762166981.973845:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (167936->176127) req@ffff945bc4531880 x1847765450750336/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:12/0 lens 488/8632 e 0 to 0 dl 1762166992 ref 1 fl Complete:/600/0 rc 8192/8192 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166981.973850:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4531880 with x1847765450750336 ext(167936->176127) 00002000:00010000:3.0:1762166981.973853:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4531880 00000100:00100000:0.0:1762166981.976034:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166981.976103:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450750464 00000100:00100000:3.0:1762166981.976113:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450750464 00000100:00100000:3.0:1762166981.976226:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2786 00000100:00100000:3.0:1762166981.976236:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4532a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+17:2417:x1847765450750464:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:3.0:1762166981.976738:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:3.0:1762166981.976742:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166982 -> 1762166982 00002000:00010000:3.0:1762166981.976745:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166981 -> 1762166981 00002000:00010000:3.0:1762166981.976747:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166982 -> 1762166982 00002000:00010000:3.0:1762166981.976750:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 392 -> 456 00000100:00100000:3.0:1762166981.976819:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4532a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+18:2417:x1847765450750464:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 584us (795us total) trans 17179876762 rc 0/0 00000100:00100000:3.0:1762166981.976828:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2786 00000100:00100000:1.0:1762166981.978688:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166981.978740:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450750592 00000100:00100000:3.0:1762166981.978750:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450750592 00000100:00100000:3.0:1762166981.978828:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2787 00000100:00100000:3.0:1762166981.978839:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450750592:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:3.0:1762166981.979116:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:3.0:1762166981.979121:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166982 -> 1762166982 00002000:00010000:3.0:1762166981.979123:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166981 -> 1762166981 00002000:00010000:3.0:1762166981.979126:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166982 -> 1762166982 00002000:00010000:3.0:1762166981.979128:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 456 -> 456 00000100:00100000:3.0:1762166981.979224:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450750592:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 356us (513us total) trans 17179876763 rc 0/0 00000100:00100000:3.0:1762166981.979234:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2787 00000100:00100000:0.0:1762166981.981443:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166981.981590:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450750848 00000100:00100000:3.0:1762166981.981607:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450750848 00000100:00100000:3.0:1762166981.981676:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30912 00000100:00100000:3.0:1762166981.981687:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4530700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+543:61766:x1847765450750848:12345-192.168.204.38@tcp:36:fsx.0 00010000:00010000:3.0:1762166981.981742:0:30829:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166981.981768:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63a00/0x2f180c4effbad237 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaaff expref: 543 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.981787:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945cc3449e00) 00010000:00010000:3.0:1762166981.981816:0:30829:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166981.981982:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62000/0x2f180c4effbad253 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:3.0:1762166981.981995:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62000/0x2f180c4effbad253 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.982005:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62000/0x2f180c4effbad253 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000001:00080000:3.0:1762166981.982045:0:30829:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992573 00000004:00010000:3.0:1762166981.982066:0:30829:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000001c9f84da reply state 0000000013b9015a transno 4294992574 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62000/0x2f180c4effbad253 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.982077:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62000/0x2f180c4effbad253 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.982083:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945cc3449e00) 00010000:00010000:3.0:1762166981.982086:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1762166981.982089:0:30829:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166981.982179:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4530700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+545:61766:x1847765450750848:12345-192.168.204.38@tcp:36:fsx.0 Request processed in 494us (744us total) trans 4294992574 rc 0/0 00000100:00100000:3.0:1762166981.982187:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30912 00000020:00080000:3.0:1762166981.982192:0:30829:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1762166981.983323:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.983394:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450750976 00000100:00100000:2.0:1762166981.983402:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450750976 00000100:00100000:2.0:1762166981.983460:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19499 00000100:00100000:2.0:1762166981.983471:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4531f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+17:61766:x1847765450750976:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:2.0:1762166981.983513:0:9165:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166981.983531:0:9165:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4b98600/0x2f180c4effbad25a lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eab0d expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.983563:0:9165:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf200/0x2f180c4effbacfeb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa34 expref: 18 pid: 35248 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166981.983572:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166981.983574:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166981.983580:0:9165:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4b98600/0x2f180c4effbad25a lrc: 4/0,0 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eab0d expref: 18 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.983616:0:9165:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf200/0x2f180c4effbacfeb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa34 expref: 18 pid: 35248 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166981.983631:0:9165:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf200/0x2f180c4effbacfeb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa34 expref: 18 pid: 35248 timeout: 701 lvb_type: 1 00000100:00100000:2.0:1762166981.983647:0:9165:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4bda300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9165:1847765449800576:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166981.983737:0:9165:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166981.984969:0:9165:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4bda300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9165:1847765449800576:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166981.984999:0:9165:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc4b98600/0x2f180c4effbad25a lrc: 3/0,0 mode: --/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eab0d expref: 18 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.985015:0:9165:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4b98600, rc 0) 00000100:00100000:2.0:1762166981.985066:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4531f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+18:61766:x1847765450750976:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 1597us (1747us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166981.985074:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19499 00000100:00100000:3.0:1762166981.985266:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166981.985325:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450751104 00000100:00100000:1.0:1762166981.985332:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450751104 00010000:00010000:1.0:1762166981.985358:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf200/0x2f180c4effbacfeb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa34 expref: 18 pid: 35248 timeout: 701 lvb_type: 1 00000100:00100000:1.0:1762166981.985388:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9847 00000100:00100000:1.0:1762166981.985397:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc8121500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450751104:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166981.985411:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166981.985429:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf200/0x2f180c4effbacfeb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa34 expref: 18 pid: 35248 timeout: 701 lvb_type: 1 00010000:00010000:1.0:1762166981.985443:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf200/0x2f180c4effbacfeb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa34 expref: 18 pid: 35248 timeout: 701 lvb_type: 1 00010000:00010000:1.0:1762166981.985464:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdf200/0x2f180c4effbacfeb lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa7a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa34 expref: 18 pid: 35248 timeout: 701 lvb_type: 1 00010000:00010000:1.0:1762166981.985501:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166981.985503:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166981.985508:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4b98600/0x2f180c4effbad25a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eab0d expref: 17 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.985519:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4b98600/0x2f180c4effbad25a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eab0d expref: 17 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166981.985544:0:6481:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff945bc4b98600/0x2f180c4effbad25a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eab0d expref: 17 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166981.985553:0:6481:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf3db7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6481:1847765449800704:192.168.204.38@tcp:105: 00000100:00100000:1.0:1762166981.985608:0:6481:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7a77300 going to sleep for 11 seconds 00000100:00100000:1.0:1762166981.986738:0:6481:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf3db7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6481:1847765449800704:192.168.204.38@tcp:105: 00010000:00010000:1.0:1762166981.986751:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166981.986783:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc8121500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450751104:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1388us (1518us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166981.986791:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9847 00000100:00100000:1.0:1762166981.986999:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.987073:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450751232 00000100:00100000:2.0:1762166981.987077:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450751232 00000100:00100000:2.0:1762166981.987108:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19500 00000100:00100000:2.0:1762166981.987117:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+19:61766:x1847765450751232:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:2.0:1762166981.987130:0:9165:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166981.987144:0:9165:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4b99200/0x2f180c4effbad261 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eab14 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.987168:0:9165:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc7c0f800/0x2f180c4effbacff2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa3b expref: 20 pid: 8382 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166981.987175:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166981.987176:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166981.987179:0:9165:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4b99200/0x2f180c4effbad261 lrc: 4/0,0 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eab14 expref: 20 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.987199:0:9165:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc7c0f800/0x2f180c4effbacff2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa3b expref: 20 pid: 8382 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166981.987211:0:9165:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc7c0f800/0x2f180c4effbacff2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa3b expref: 20 pid: 8382 timeout: 701 lvb_type: 1 00000100:00100000:2.0:1762166981.987221:0:9165:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4bda300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9165:1847765449800832:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166981.987260:0:9165:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166981.988698:0:9165:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4bda300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9165:1847765449800832:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166981.988713:0:9165:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4b99200/0x2f180c4effbad261 lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eab14 expref: 20 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.988728:0:9165:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4b99200, rc 0) 00000100:00100000:2.0:1762166981.988767:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+20:61766:x1847765450751232:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 1651us (1768us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166981.988774:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19500 00000100:00100000:1.0:1762166981.988834:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.988876:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450751360 00000100:00100000:2.0:1762166981.988881:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450751360 00010000:00010000:2.0:1762166981.988896:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc7c0f800/0x2f180c4effbacff2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa3b expref: 20 pid: 8382 timeout: 701 lvb_type: 1 00000100:00100000:2.0:1762166981.988918:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9848 00000100:00100000:2.0:1762166981.988924:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf9d1e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450751360:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166981.988931:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166981.988942:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc7c0f800/0x2f180c4effbacff2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa3b expref: 20 pid: 8382 timeout: 701 lvb_type: 1 00010000:00010000:2.0:1762166981.988952:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc7c0f800/0x2f180c4effbacff2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa3b expref: 20 pid: 8382 timeout: 701 lvb_type: 1 00010000:00010000:2.0:1762166981.988968:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc7c0f800/0x2f180c4effbacff2 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa3b expref: 20 pid: 8382 timeout: 701 lvb_type: 1 00010000:00010000:2.0:1762166981.988978:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166981.988980:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166981.988984:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4b99200/0x2f180c4effbad261 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eab14 expref: 19 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.988993:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4b99200/0x2f180c4effbad261 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eab14 expref: 19 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166981.989012:0:6481:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4b99200/0x2f180c4effbad261 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eab14 expref: 19 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166981.989025:0:6481:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4bda300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6481:1847765449800960:192.168.204.38@tcp:105: 00000100:00100000:2.0:1762166981.989071:0:6481:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166981.990096:0:6481:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4bda300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6481:1847765449800960:192.168.204.38@tcp:105: 00010000:00010000:2.0:1762166981.990109:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166981.990155:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf9d1e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450751360:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 1224us (1316us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166981.990161:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166981.990169:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9848 00000100:00100000:0.0:1762166981.990233:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450751488 00000100:00100000:0.0:1762166981.990244:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450751488 00002000:00010000:0.0:1762166981.990284:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (23269->18446744073709551615) 00002000:00100000:0.0:1762166981.990290:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf3db5500 with x1847765450751488 ext(23269->18446744073709551615) 00002000:00010000:0.0:1762166981.990302:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf3db5500. 00000100:00100000:1.0:1762166981.990317:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166981.990344:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450751616 00000100:00100000:0.0:1762166981.990349:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450751616 00000100:00100000:1.0:1762166981.990365:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00002000:00010000:0.0:1762166981.990367:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:0.0:1762166981.990371:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf7838700 with x1847765450751616 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166981.990377:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945cf7838700. 00000100:00100000:2.0:1762166981.990379:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450751744 00000100:00100000:2.0:1762166981.990386:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450751744 00002000:00010000:2.0:1762166981.990406:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00000100:00100000:0.0:1762166981.990407:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2788 00002000:00100000:2.0:1762166981.990413:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf783b800 with x1847765450751744 ext(0->18446744073709551615) 00000100:00100000:1.0:1762166981.990419:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2789 00000100:00100000:0.0:1762166981.990421:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450751488:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:2.0:1762166981.990423:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf783b800. 00000100:00100000:1.0:1762166981.990436:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf7838700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450751616:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:3.0:1762166981.990442:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2790 00000100:00100000:3.0:1762166981.990456:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450751744:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:3.0:1762166981.990635:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166981.990635:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166981.990643:0:23939:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166981 -> 1762166982 00002000:00010000:1.0:1762166981.990643:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166981 -> 1762166982 00002000:00010000:3.0:1762166981.990651:0:23939:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166981 -> 1762166981 00002000:00010000:1.0:1762166981.990651:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166981 -> 1762166981 00002000:00010000:1.0:1762166981.990659:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166981 -> 1762166982 00002000:00010000:3.0:1762166981.990660:0:23939:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166981 -> 1762166982 00002000:00010000:1.0:1762166981.990666:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00002000:00010000:3.0:1762166981.990667:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1762166981.990729:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf7838700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450751616:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 298us (412us total) trans 21474843489 rc 0/0 00000100:00100000:3.0:1762166981.990730:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450751744:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 276us (364us total) trans 17179876764 rc 0/0 00000100:00100000:1.0:1762166981.990745:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2789 00002000:00010000:1.0:1762166981.990751:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00000100:00100000:3.0:1762166981.990754:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2790 00002000:00100000:1.0:1762166981.990757:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf7838700 with x1847765450751616 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166981.990760:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00010000:1.0:1762166981.990765:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945cf7838700. 00002000:00100000:3.0:1762166981.990766:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf783b800 with x1847765450751744 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166981.990775:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf783b800. 00002000:00010000:0.0:1762166981.990953:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 262144 -> 23269 00002000:00010000:0.0:1762166981.990956:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166982 -> 1762166982 00002000:00010000:0.0:1762166981.990958:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166981 -> 1762166981 00002000:00010000:0.0:1762166981.990959:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166982 -> 1762166982 00002000:00010000:0.0:1762166981.990960:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 456 -> 56 00000100:00100000:0.0:1762166981.990985:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450751488:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 569us (842us total) trans 17179876765 rc 0/0 00000100:00100000:0.0:1762166981.990991:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2788 00002000:00010000:0.0:1762166981.990993:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (23269->18446744073709551615) 00002000:00100000:0.0:1762166981.990995:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf3db5500 with x1847765450751488 ext(23269->18446744073709551615) 00002000:00010000:0.0:1762166981.990998:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf3db5500. 00000100:00100000:2.0:1762166981.992074:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166981.992116:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450751872 00000100:00100000:3.0:1762166981.992123:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450751872 00000100:00100000:3.0:1762166981.992166:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30913 00000100:00100000:3.0:1762166981.992175:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4bda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+545:61766:x1847765450751872:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:3.0:1762166981.992196:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166981.992216:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62800/0x2f180c4effbad268 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eab1b expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.992312:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63000/0x2f180c4effbad26f lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:3.0:1762166981.992328:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63000/0x2f180c4effbad26f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.992341:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63000/0x2f180c4effbad26f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000004:00200000:3.0:1762166981.992377:0:30829:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 23269 00000004:00200000:3.0:1762166981.992382:0:30829:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166981.992402:0:30829:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63000/0x2f180c4effbad26f lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.992428:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62800/0x2f180c4effbad268 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eab1b expref: 547 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.992445:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63000/0x2f180c4effbad26f lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eab1b expref: 546 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.992453:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945cc3449e00) 00010000:00010000:3.0:1762166981.992457:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166981.992460:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4b63000, rc 0) 00000100:00100000:3.0:1762166981.992529:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4bda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+546:61766:x1847765450751872:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 355us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166981.992538:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30913 00000100:00100000:3.0:1762166981.995065:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166981.995155:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450752000 00000100:00100000:0.0:1762166981.995168:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450752000 00002000:00100000:0.0:1762166981.995221:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (4096->24575) req@ffff945bc8120a80 x1847765450752000/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:12/0 lens 488/0 e 0 to 0 dl 1762166992 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166981.995233:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc8120a80 with x1847765450752000 ext(4096->24575) 00002000:00010000:0.0:1762166981.995239:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc8120a80 00000100:00100000:0.0:1762166981.995271:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2791 00000100:00100000:0.0:1762166981.995280:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc8120a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+21:2416:x1847765450752000:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:0.0:1762166981.996439:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc8120a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+21:2416:x1847765450752000:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 1156us (1378us total) trans 0 rc 20480/20480 00000100:00100000:0.0:1762166981.996452:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2791 00002000:00100000:0.0:1762166981.996462:0:23942:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000400:0xa77:0x0] (4096->24575) req@ffff945bc8120a80 x1847765450752000/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:12/0 lens 488/440 e 0 to 0 dl 1762166992 ref 1 fl Complete:/600/0 rc 20480/20480 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166981.996471:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc8120a80 with x1847765450752000 ext(4096->24575) 00002000:00010000:0.0:1762166981.996519:0:23942:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc8120a80 00000100:00100000:2.0:1762166981.998769:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166981.998825:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450752256 00000100:00100000:3.0:1762166981.998836:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450752256 00000100:00100000:3.0:1762166981.998892:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30914 00000100:00100000:3.0:1762166981.998902:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4bdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+546:61766:x1847765450752256:12345-192.168.204.38@tcp:36:fsx.0 00010000:00010000:3.0:1762166981.998962:0:30829:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166981.998994:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63000/0x2f180c4effbad26f lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eab1b expref: 546 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166981.999014:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945cc3449e00) 00010000:00010000:3.0:1762166981.999020:0:30829:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166981.999223:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63a00/0x2f180c4effbad276 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:3.0:1762166981.999238:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63a00/0x2f180c4effbad276 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.999249:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63a00/0x2f180c4effbad276 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000001:00080000:3.0:1762166981.999298:0:30829:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992575 00000004:00010000:3.0:1762166981.999318:0:30829:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000091c960bf reply state 000000004271709b transno 4294992576 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63a00/0x2f180c4effbad276 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.999329:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63a00/0x2f180c4effbad276 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166981.999335:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945cc3449e00) 00010000:00010000:3.0:1762166981.999338:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1762166981.999340:0:30829:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1762166981.999442:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4bdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+548:61766:x1847765450752256:12345-192.168.204.38@tcp:36:fsx.0 Request processed in 541us (683us total) trans 4294992576 rc 0/0 00000100:00100000:3.0:1762166981.999448:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30914 00000020:00080000:3.0:1762166981.999452:0:30829:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1762166982.000916:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166982.000968:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166982.001004:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166982.001035:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450752384 00000100:00100000:1.0:1762166982.001043:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450752384 00000100:00100000:2.0:1762166982.001056:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450752512 00000100:00100000:2.0:1762166982.001068:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450752512 00000100:00100000:3.0:1762166982.001101:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450752640 00002000:00010000:1.0:1762166982.001105:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (207798->18446744073709551615) 00000100:00100000:3.0:1762166982.001109:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450752640 00002000:00010000:2.0:1762166982.001116:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:1.0:1762166982.001117:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4533800 with x1847765450752384 ext(207798->18446744073709551615) 00002000:00100000:2.0:1762166982.001124:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4533100 with x1847765450752512 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166982.001134:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:3.0:1762166982.001141:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4531500 with x1847765450752640 ext(0->18446744073709551615) 00002000:00010000:1.0:1762166982.001144:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4533800. 00002000:00010000:2.0:1762166982.001145:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc4533100. 00002000:00010000:3.0:1762166982.001149:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4531500. 00000100:00080000:0.0:1762166982.001189:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1762166982.001194:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2792 00000100:00080000:0.0:1762166982.001198:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1762166982.001205:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2793 00000100:00100000:1.0:1762166982.001215:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4533800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765450752384:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:3.0:1762166982.001228:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2794 00000100:00100000:2.0:1762166982.001228:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4533100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450752512:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:3.0:1762166982.001250:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4531500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765450752640:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:3.0:1762166982.001369:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166982.001373:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166982 -> 1762166982 00002000:00010000:3.0:1762166982.001375:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166981 -> 1762166981 00002000:00010000:3.0:1762166982.001377:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166982 -> 1762166982 00002000:00010000:3.0:1762166982.001378:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:2.0:1762166982.001380:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1762166982.001386:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166982 -> 1762166982 00002000:00010000:2.0:1762166982.001389:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166981 -> 1762166981 00002000:00010000:2.0:1762166982.001393:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166982 -> 1762166982 00002000:00010000:2.0:1762166982.001396:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00000100:00100000:3.0:1762166982.001432:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4531500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765450752640:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 188us (426us total) trans 17179876766 rc 0/0 00000100:00100000:2.0:1762166982.001434:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4533100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450752512:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 217us (465us total) trans 21474843490 rc 0/0 00000100:00100000:3.0:1762166982.001449:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2794 00002000:00010000:3.0:1762166982.001454:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:3.0:1762166982.001458:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4531500 with x1847765450752640 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166982.001464:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4531500. 00000100:00100000:2.0:1762166982.001472:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2793 00002000:00010000:2.0:1762166982.001505:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:2.0:1762166982.001509:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4533100 with x1847765450752512 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166982.001515:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc4533100. 00002000:00010000:1.0:1762166982.001546:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 23269 -> 207798 00002000:00010000:1.0:1762166982.001552:0:23939:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166982 -> 1762166982 00002000:00010000:1.0:1762166982.001555:0:23939:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166981 -> 1762166981 00002000:00010000:1.0:1762166982.001558:0:23939:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166982 -> 1762166982 00002000:00010000:1.0:1762166982.001562:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 56 -> 56 00000100:00100000:1.0:1762166982.001608:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4533800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765450752384:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 401us (698us total) trans 17179876767 rc 0/0 00000100:00100000:1.0:1762166982.001617:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2792 00002000:00010000:1.0:1762166982.001621:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (207798->18446744073709551615) 00002000:00100000:1.0:1762166982.001624:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4533800 with x1847765450752384 ext(207798->18446744073709551615) 00002000:00010000:1.0:1762166982.001631:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4533800. 00000100:00100000:1.0:1762166982.003709:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166982.003756:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450752768 00000100:00100000:3.0:1762166982.003766:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450752768 00002000:00100000:3.0:1762166982.003826:0:23939:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xa77:0x0] (143360->208895) req@ffff945bc6227100 x1847765450752768/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:13/0 lens 488/0 e 0 to 0 dl 1762166993 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166982.003838:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc6227100 with x1847765450752768 ext(143360->208895) 00002000:00010000:3.0:1762166982.003845:0:23939:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc6227100 00000100:00100000:3.0:1762166982.003886:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2795 00000100:00100000:3.0:1762166982.003897:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6227100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765450752768:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:3.0:1762166982.005184:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6227100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765450752768:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 1285us (1476us total) trans 0 rc 65536/65536 00000100:00100000:3.0:1762166982.005206:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2795 00002000:00100000:3.0:1762166982.005216:0:23939:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xa77:0x0] (143360->208895) req@ffff945bc6227100 x1847765450752768/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:13/0 lens 488/440 e 0 to 0 dl 1762166993 ref 1 fl Complete:/600/0 rc 65536/65536 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166982.005232:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc6227100 with x1847765450752768 ext(143360->208895) 00002000:00010000:3.0:1762166982.005238:0:23939:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc6227100 00000100:00100000:0.0:1762166982.008295:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166982.008352:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450752896 00000100:00100000:3.0:1762166982.008362:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450752896 00002000:00100000:3.0:1762166982.008415:0:23939:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xa77:0x0] (172032->207797) req@ffff945bc4531c00 x1847765450752896/t0(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:13/0 lens 488/0 e 0 to 0 dl 1762166993 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1762166982.008424:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4531c00 with x1847765450752896 ext(172032->207797) 00002000:00010000:3.0:1762166982.008429:0:23939:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4531c00 00000100:00100000:3.0:1762166982.008453:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2796 00000100:00100000:3.0:1762166982.008461:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4531c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765450752896:12345-192.168.204.38@tcp:4:fsx.0 00000100:00100000:2.0:1762166982.010176:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4531c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+25:2418:x1847765450752896:12345-192.168.204.38@tcp:4:fsx.0 Request processed in 1706us (1884us total) trans 17179876768 rc 0/0 00000100:00100000:2.0:1762166982.010192:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2796 00002000:00100000:2.0:1762166982.010205:0:23939:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xa77:0x0] (172032->207797) req@ffff945bc4531c00 x1847765450752896/t17179876768(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:13/0 lens 488/448 e 0 to 0 dl 1762166993 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166982.010217:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc4531c00 with x1847765450752896 ext(172032->207797) 00002000:00010000:2.0:1762166982.010223:0:23939:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc4531c00 00000100:00100000:0.0:1762166982.011425:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166982.011499:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450753024 00000100:00100000:2.0:1762166982.011508:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450753024 00000100:00100000:2.0:1762166982.011553:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19501 00000100:00100000:2.0:1762166982.011562:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc59d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+25:2419:x1847765450753024:12345-192.168.204.38@tcp:16:fsx.0 00000001:00080000:3.0:1762166982.012681:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876768 is committed 00000100:00100000:2.0:1762166982.012805:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc59d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450753024:12345-192.168.204.38@tcp:16:fsx.0 Request processed in 1232us (1371us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166982.012814:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19501 00000100:00100000:0.0:1762166982.014680:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166982.014732:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450753152 00000100:00100000:3.0:1762166982.014744:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450753152 00000100:00100000:3.0:1762166982.014817:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30915 00000100:00100000:3.0:1762166982.014828:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc59d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+548:61766:x1847765450753152:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:3.0:1762166982.014855:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166982.014880:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63000/0x2f180c4effbad27d lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eab22 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166982.014995:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62800/0x2f180c4effbad284 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:3.0:1762166982.015011:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62800/0x2f180c4effbad284 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166982.015024:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62800/0x2f180c4effbad284 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000004:00200000:3.0:1762166982.015054:0:30829:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 207798 00000004:00200000:3.0:1762166982.015069:0:30829:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166982.015094:0:30829:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62800/0x2f180c4effbad284 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166982.015122:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63000/0x2f180c4effbad27d lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eab22 expref: 550 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166982.015140:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62800/0x2f180c4effbad284 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eab22 expref: 549 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166982.015151:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945cc3449e00) 00010000:00010000:3.0:1762166982.015155:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166982.015158:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4b62800, rc 0) 00000100:00100000:3.0:1762166982.015226:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc59d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+549:61766:x1847765450753152:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 399us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166982.015234:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30915 00000100:00100000:1.0:1762166982.017991:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166982.018068:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450753280 00000100:00100000:2.0:1762166982.018078:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450753280 00000100:00100000:2.0:1762166982.018143:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2797 00000100:00100000:2.0:1762166982.018154:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6225f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450753280:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:2.0:1762166982.018360:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 207798 -> 207798 00002000:00010000:2.0:1762166982.018365:0:23939:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166982 -> 1762166982 00002000:00010000:2.0:1762166982.018367:0:23939:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166981 -> 1762166982 00002000:00010000:2.0:1762166982.018370:0:23939:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166982 -> 1762166982 00002000:00010000:2.0:1762166982.018372:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 56 -> 144 00000100:00100000:2.0:1762166982.018432:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6225f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450753280:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 279us (449us total) trans 17179876769 rc 0/0 00000100:00100000:2.0:1762166982.018440:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2797 00000100:00100000:0.0:1762166982.022217:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166982.022291:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450753536 00000100:00100000:3.0:1762166982.022306:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450753536 00000100:00100000:3.0:1762166982.022377:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30916 00000100:00100000:3.0:1762166982.022390:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc59d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+549:61766:x1847765450753536:12345-192.168.204.38@tcp:36:fsx.0 00010000:00010000:3.0:1762166982.022458:0:30829:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166982.022536:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62800/0x2f180c4effbad284 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eab22 expref: 549 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166982.022565:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945cc3449e00) 00010000:00010000:3.0:1762166982.022571:0:30829:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166982.023054:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99400/0x2f180c4effbad28b lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166982.023073:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99400/0x2f180c4effbad28b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166982.023091:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99400/0x2f180c4effbad28b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000001:00080000:2.0:1762166982.023156:0:30829:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992577 00000004:00010000:2.0:1762166982.023189:0:30829:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000001e7c9a79 reply state 0000000053f40154 transno 4294992578 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99400/0x2f180c4effbad28b lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166982.023201:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99400/0x2f180c4effbad28b lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166982.023208:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945cc3449e00) 00010000:00010000:2.0:1762166982.023211:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166982.023214:0:30829:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166982.023303:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc59d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+551:61766:x1847765450753536:12345-192.168.204.38@tcp:36:fsx.0 Request processed in 915us (1087us total) trans 4294992578 rc 0/0 00000100:00100000:2.0:1762166982.023312:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30916 00000020:00080000:2.0:1762166982.023317:0:30829:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1762166982.024955:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166982.024998:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166982.025031:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450753664 00000100:00100000:0.0:1762166982.025035:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166982.025047:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450753664 00000100:00100000:3.0:1762166982.025071:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450753792 00000100:00100000:3.0:1762166982.025079:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450753792 00002000:00010000:2.0:1762166982.025094:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (43812->18446744073709551615) 00000100:00100000:1.0:1762166982.025098:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450753920 00002000:00100000:2.0:1762166982.025102:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc59d7800 with x1847765450753664 ext(43812->18446744073709551615) 00002000:00010000:3.0:1762166982.025105:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:3.0:1762166982.025111:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc59d5180 with x1847765450753792 ext(0->18446744073709551615) 00000100:00100000:1.0:1762166982.025111:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450753920 00002000:00010000:2.0:1762166982.025117:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc59d7800. 00002000:00010000:3.0:1762166982.025124:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc59d5180. 00002000:00010000:1.0:1762166982.025152:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00000100:00100000:2.0:1762166982.025154:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2798 00002000:00100000:1.0:1762166982.025162:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc59d4700 with x1847765450753920 ext(0->18446744073709551615) 00000100:00100000:3.0:1762166982.025170:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2799 00000100:00100000:2.0:1762166982.025174:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc59d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450753664:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:1.0:1762166982.025174:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc59d4700. 00000100:00100000:3.0:1762166982.025186:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc59d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+19:2418:x1847765450753792:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:1.0:1762166982.025217:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2800 00000100:00100000:1.0:1762166982.025226:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc59d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450753920:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:1.0:1762166982.025338:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166982.025341:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166982 -> 1762166982 00002000:00010000:1.0:1762166982.025343:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166981 -> 1762166981 00002000:00010000:1.0:1762166982.025346:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166982 -> 1762166982 00002000:00010000:1.0:1762166982.025348:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:3.0:1762166982.025374:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166982.025380:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166982 -> 1762166982 00002000:00010000:3.0:1762166982.025383:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166981 -> 1762166981 00002000:00010000:3.0:1762166982.025386:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166982 -> 1762166982 00002000:00010000:3.0:1762166982.025388:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00000100:00100000:1.0:1762166982.025400:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc59d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450753920:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 172us (361us total) trans 17179876770 rc 0/0 00000100:00100000:1.0:1762166982.025408:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2800 00002000:00010000:1.0:1762166982.025413:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:1.0:1762166982.025416:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc59d4700 with x1847765450753920 ext(0->18446744073709551615) 00002000:00010000:1.0:1762166982.025421:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc59d4700. 00000100:00100000:3.0:1762166982.025442:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc59d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+20:2418:x1847765450753792:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 257us (438us total) trans 21474843491 rc 0/0 00000100:00100000:3.0:1762166982.025450:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2799 00002000:00010000:3.0:1762166982.025454:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:3.0:1762166982.025457:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc59d5180 with x1847765450753792 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166982.025462:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc59d5180. 00002000:00010000:2.0:1762166982.025573:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 207798 -> 43812 00002000:00010000:2.0:1762166982.025577:0:23939:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166982 -> 1762166982 00002000:00010000:2.0:1762166982.025579:0:23939:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166982 -> 1762166982 00002000:00010000:2.0:1762166982.025580:0:23939:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166982 -> 1762166982 00002000:00010000:2.0:1762166982.025582:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 144 -> 56 00000100:00100000:2.0:1762166982.025605:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc59d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450753664:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 436us (657us total) trans 17179876771 rc 0/0 00000100:00100000:2.0:1762166982.025612:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2798 00002000:00010000:2.0:1762166982.025616:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (43812->18446744073709551615) 00002000:00100000:2.0:1762166982.025619:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc59d7800 with x1847765450753664 ext(43812->18446744073709551615) 00002000:00010000:2.0:1762166982.025624:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc59d7800. 00000100:00100000:1.0:1762166982.027198:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166982.027306:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450754048 00000100:00100000:2.0:1762166982.027312:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450754048 00000100:00100000:2.0:1762166982.027358:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30917 00000100:00100000:2.0:1762166982.027368:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6224700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+551:61766:x1847765450754048:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:2.0:1762166982.027393:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166982.027409:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99a00/0x2f180c4effbad292 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eab29 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166982.027536:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99600/0x2f180c4effbad299 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166982.027546:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99600/0x2f180c4effbad299 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166982.027556:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99600/0x2f180c4effbad299 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000004:00200000:2.0:1762166982.027580:0:30829:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 43812 00000004:00200000:2.0:1762166982.027587:0:30829:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166982.027603:0:30829:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99600/0x2f180c4effbad299 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166982.027624:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99a00/0x2f180c4effbad292 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eab29 expref: 553 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166982.027636:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99600/0x2f180c4effbad299 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eab29 expref: 552 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166982.027642:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945cc3449e00) 00010000:00010000:2.0:1762166982.027645:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166982.027647:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4b99600, rc 0) 00000100:00100000:2.0:1762166982.027698:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6224700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+552:61766:x1847765450754048:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 332us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166982.027705:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30917 00000100:00100000:0.0:1762166982.031364:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166982.031424:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450754176 00000100:00100000:2.0:1762166982.031440:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450754176 00000100:00100000:2.0:1762166982.031532:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2801 00000100:00100000:2.0:1762166982.031543:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc59d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450754176:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:2.0:1762166982.031950:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 43812 -> 43812 00002000:00010000:2.0:1762166982.031955:0:23939:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166982 -> 1762166982 00002000:00010000:2.0:1762166982.031957:0:23939:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166982 -> 1762166982 00002000:00010000:2.0:1762166982.031960:0:23939:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166982 -> 1762166982 00002000:00010000:2.0:1762166982.031962:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 56 -> 16 00000100:00100000:2.0:1762166982.032028:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc59d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450754176:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 487us (675us total) trans 17179876772 rc 0/0 00000100:00100000:2.0:1762166982.032037:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2801 00000100:00100000:0.0:1762166982.034597:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166982.034639:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450754304 00000100:00100000:2.0:1762166982.034652:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450754304 00002000:00100000:2.0:1762166982.034693:0:23939:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xa77:0x0] (0->45055) req@ffff945bc59d7b80 x1847765450754304/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:13/0 lens 488/0 e 0 to 0 dl 1762166993 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166982.034705:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc59d7b80 with x1847765450754304 ext(0->45055) 00002000:00010000:2.0:1762166982.034711:0:23939:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc59d7b80 00000100:00100000:2.0:1762166982.034741:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2802 00000100:00100000:2.0:1762166982.034751:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc59d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+21:2416:x1847765450754304:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:2.0:1762166982.036122:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc59d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+21:2416:x1847765450754304:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 1370us (1530us total) trans 0 rc 45056/45056 00000100:00100000:2.0:1762166982.036132:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2802 00002000:00100000:2.0:1762166982.036140:0:23939:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xa77:0x0] (0->45055) req@ffff945bc59d7b80 x1847765450754304/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:13/0 lens 488/440 e 0 to 0 dl 1762166993 ref 1 fl Complete:/600/0 rc 45056/45056 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166982.036149:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc59d7b80 with x1847765450754304 ext(0->45055) 00002000:00010000:2.0:1762166982.036153:0:23939:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc59d7b80 00000100:00100000:0.0:1762166982.041084:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166982.041174:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450754432 00000100:00100000:2.0:1762166982.041188:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450754432 00000100:00100000:2.0:1762166982.041272:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2803 00000100:00100000:2.0:1762166982.041287:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6a95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+21:2417:x1847765450754432:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:2.0:1762166982.041590:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 43812 -> 262144 00002000:00010000:2.0:1762166982.041608:0:23939:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166982 -> 1762166982 00002000:00010000:2.0:1762166982.041611:0:23939:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166982 -> 1762166982 00002000:00010000:2.0:1762166982.041613:0:23939:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166982 -> 1762166982 00002000:00010000:2.0:1762166982.041616:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 16 -> 24 00000100:00100000:2.0:1762166982.041697:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6a95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+23:2417:x1847765450754432:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 415us (626us total) trans 17179876773 rc 0/0 00000100:00100000:2.0:1762166982.041715:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2803 00000100:00100000:0.0:1762166982.045065:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166982.045141:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450754560 00000100:00100000:2.0:1762166982.045159:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450754560 00002000:00100000:2.0:1762166982.045219:0:23939:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xa77:0x0] (45056->262143) req@ffff945bc6a94000 x1847765450754560/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:13/0 lens 504/0 e 0 to 0 dl 1762166993 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166982.045232:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc6a94000 with x1847765450754560 ext(45056->262143) 00002000:00010000:2.0:1762166982.045239:0:23939:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc6a94000 00000100:00100000:2.0:1762166982.045270:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2804 00000100:00100000:2.0:1762166982.045279:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6a94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+23:2417:x1847765450754560:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:2.0:1762166982.046926:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6a94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+23:2417:x1847765450754560:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 1642us (1865us total) trans 0 rc 159744/159744 00000100:00100000:2.0:1762166982.046939:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2804 00002000:00100000:2.0:1762166982.046950:0:23939:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xa77:0x0] (45056->262143) req@ffff945bc6a94000 x1847765450754560/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:13/0 lens 504/440 e 0 to 0 dl 1762166993 ref 1 fl Complete:/600/0 rc 159744/159744 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166982.046960:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc6a94000 with x1847765450754560 ext(45056->262143) 00002000:00010000:2.0:1762166982.046967:0:23939:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc6a94000 00000100:00100000:0.0:1762166982.048936:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166982.048995:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450754688 00000100:00100000:2.0:1762166982.049004:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450754688 00000100:00100000:2.0:1762166982.049063:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2805 00000100:00100000:2.0:1762166982.049074:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6a97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765450754688:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:2.0:1762166982.049300:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:2.0:1762166982.049304:0:23939:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166982 -> 1762166982 00002000:00010000:2.0:1762166982.049307:0:23939:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166982 -> 1762166982 00002000:00010000:2.0:1762166982.049309:0:23939:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166982 -> 1762166982 00002000:00010000:2.0:1762166982.049312:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 24 -> 72 00000100:00100000:2.0:1762166982.049364:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6a97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765450754688:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 291us (435us total) trans 17179876774 rc 0/0 00000100:00100000:2.0:1762166982.049371:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2805 00000100:00100000:0.0:1762166982.052577:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166982.052647:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450754816 00000100:00100000:2.0:1762166982.052656:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450754816 00002000:00100000:2.0:1762166982.052702:0:23939:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xa77:0x0] (61440->159743) req@ffff945bc6a96a00 x1847765450754816/t0(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:13/0 lens 488/0 e 0 to 0 dl 1762166993 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166982.052712:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc6a96a00 with x1847765450754816 ext(61440->159743) 00002000:00010000:2.0:1762166982.052718:0:23939:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc6a96a00 00000100:00100000:2.0:1762166982.052742:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2806 00000100:00100000:2.0:1762166982.052749:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6a96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765450754816:12345-192.168.204.38@tcp:4:fsx.0 00000100:00100000:2.0:1762166982.054705:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6a96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+26:2419:x1847765450754816:12345-192.168.204.38@tcp:4:fsx.0 Request processed in 1946us (2128us total) trans 17179876775 rc 0/0 00000100:00100000:2.0:1762166982.054716:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2806 00002000:00100000:2.0:1762166982.054726:0:23939:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xa77:0x0] (61440->159743) req@ffff945bc6a96a00 x1847765450754816/t17179876775(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:13/0 lens 488/448 e 0 to 0 dl 1762166993 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166982.054737:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc6a96a00 with x1847765450754816 ext(61440->159743) 00002000:00010000:2.0:1762166982.054741:0:23939:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc6a96a00 00000100:00100000:0.0:1762166982.055839:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166982.055888:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450754944 00000100:00100000:2.0:1762166982.055895:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450754944 00000100:00100000:2.0:1762166982.055944:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2807 00000100:00100000:2.0:1762166982.055954:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6a97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+26:2418:x1847765450754944:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:2.0:1762166982.056299:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:2.0:1762166982.056304:0:23939:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166982 -> 1762166982 00002000:00010000:2.0:1762166982.056306:0:23939:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166982 -> 1762166982 00002000:00010000:2.0:1762166982.056309:0:23939:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166982 -> 1762166982 00002000:00010000:2.0:1762166982.056311:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 72 -> 272 00000100:00100000:2.0:1762166982.056366:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6a97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+27:2418:x1847765450754944:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 413us (530us total) trans 17179876776 rc 0/0 00000100:00100000:2.0:1762166982.056374:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2807 00000100:00100000:0.0:1762166982.058803:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166982.058838:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450755072 00000100:00100000:2.0:1762166982.058845:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450755072 00000100:00100000:2.0:1762166982.058891:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2808 00000100:00100000:2.0:1762166982.058898:0:23939:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6a95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+27:2419:x1847765450755072:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:2.0:1762166982.059031:0:23939:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:2.0:1762166982.059034:0:23939:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166982 -> 1762166982 00002000:00010000:2.0:1762166982.059036:0:23939:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166982 -> 1762166982 00002000:00010000:2.0:1762166982.059038:0:23939:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166982 -> 1762166982 00002000:00010000:2.0:1762166982.059039:0:23939:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 272 -> 392 00000100:00100000:2.0:1762166982.059075:0:23939:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6a95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e1e11365-ba0b-405b-99c9-a704373217f2+28:2419:x1847765450755072:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 178us (289us total) trans 17179876777 rc 0/0 00000100:00100000:2.0:1762166982.059082:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2808 00000100:00100000:1.0:1762166982.061456:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166982.061512:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450755328 00000100:00100000:2.0:1762166982.061520:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450755328 00000100:00100000:2.0:1762166982.061571:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30918 00000100:00100000:2.0:1762166982.061581:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6224000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+552:61766:x1847765450755328:12345-192.168.204.38@tcp:36:fsx.0 00010000:00010000:2.0:1762166982.061642:0:30829:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166982.061675:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99600/0x2f180c4effbad299 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eab29 expref: 552 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166982.061693:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945cc3449e00) 00010000:00010000:2.0:1762166982.061697:0:30829:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166982.061886:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99a00/0x2f180c4effbad2a0 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166982.061902:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99a00/0x2f180c4effbad2a0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166982.061914:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99a00/0x2f180c4effbad2a0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000001:00080000:2.0:1762166982.061957:0:30829:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992579 00000004:00010000:2.0:1762166982.061975:0:30829:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000977d83ae reply state 00000000d6003659 transno 4294992580 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99a00/0x2f180c4effbad2a0 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166982.061983:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99a00/0x2f180c4effbad2a0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166982.061987:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945cc3449e00) 00010000:00010000:2.0:1762166982.061989:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166982.061991:0:30829:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166982.062072:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6224000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+554:61766:x1847765450755328:12345-192.168.204.38@tcp:36:fsx.0 Request processed in 492us (621us total) trans 4294992580 rc 0/0 00000100:00100000:2.0:1762166982.062079:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30918 00000020:00080000:2.0:1762166982.062084:0:30829:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1762166982.063402:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166982.063440:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166982.063463:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450755456 00000100:00100000:2.0:1762166982.063469:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450755456 00002000:00010000:2.0:1762166982.063514:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (236624->18446744073709551615) 00000100:00100000:0.0:1762166982.063518:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00002000:00100000:2.0:1762166982.063520:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc6a95180 with x1847765450755456 ext(236624->18446744073709551615) 00002000:00010000:2.0:1762166982.063530:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc6a95180. 00000100:00100000:2.0:1762166982.063548:0:23939:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450755584 00000100:00100000:2.0:1762166982.063551:0:23939:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450755584 00000100:00100000:0.0:1762166982.063552:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450755712 00000100:00100000:0.0:1762166982.063555:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450755712 00002000:00010000:2.0:1762166982.063568:0:23939:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00010000:0.0:1762166982.063568:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:2.0:1762166982.063571:0:23939:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc6a96d80 with x1847765450755584 ext(0->18446744073709551615) 00002000:00100000:0.0:1762166982.063572:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc6a96680 with x1847765450755712 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166982.063579:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc6a96680. 00002000:00010000:2.0:1762166982.063590:0:23939:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc6a96d80. 00000100:00100000:1.0:1762166982.063595:0:23940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2809 00000100:00100000:0.0:1762166982.063607:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2810 00000100:00100000:1.0:1762166982.063614:0:23940:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6a95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+29:2418:x1847765450755456:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:0.0:1762166982.063622:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6a96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+29:2418:x1847765450755712:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:3.0:1762166982.063637:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2811 00000100:00100000:3.0:1762166982.063678:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6a96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+20:2419:x1847765450755584:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:0.0:1762166982.063758:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166982.063762:0:23943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166982 -> 1762166982 00002000:00010000:0.0:1762166982.063764:0:23943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166981 -> 1762166981 00002000:00010000:0.0:1762166982.063767:0:23943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166982 -> 1762166982 00002000:00010000:0.0:1762166982.063769:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1762166982.063843:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6a96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+31:2418:x1847765450755712:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 224us (320us total) trans 17179876778 rc 0/0 00000100:00100000:0.0:1762166982.063858:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2810 00002000:00010000:0.0:1762166982.063864:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:0.0:1762166982.063868:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc6a96680 with x1847765450755712 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166982.063869:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166982.063874:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc6a96680. 00002000:00010000:3.0:1762166982.063876:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166982 -> 1762166982 00002000:00010000:3.0:1762166982.063883:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166981 -> 1762166981 00002000:00010000:3.0:1762166982.063886:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166982 -> 1762166982 00002000:00010000:3.0:1762166982.063889:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00002000:00010000:1.0:1762166982.063941:0:23940:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 262144 -> 236624 00002000:00010000:1.0:1762166982.063948:0:23940:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166982 -> 1762166982 00002000:00010000:1.0:1762166982.063951:0:23940:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166982 -> 1762166982 00002000:00010000:1.0:1762166982.063954:0:23940:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166982 -> 1762166982 00002000:00010000:1.0:1762166982.063957:0:23940:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 392 -> 360 00000100:00100000:3.0:1762166982.063966:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6a96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+21:2419:x1847765450755584:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 297us (519us total) trans 21474843492 rc 0/0 00000100:00100000:3.0:1762166982.063979:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2811 00002000:00010000:3.0:1762166982.063985:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:3.0:1762166982.063989:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc6a96d80 with x1847765450755584 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166982.063999:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc6a96d80. 00000100:00100000:1.0:1762166982.064003:0:23940:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6a95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e1e11365-ba0b-405b-99c9-a704373217f2+30:2418:x1847765450755456:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 393us (599us total) trans 17179876779 rc 0/0 00000100:00100000:1.0:1762166982.064018:0:23940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2809 00002000:00010000:1.0:1762166982.064023:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (236624->18446744073709551615) 00002000:00100000:1.0:1762166982.064027:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc6a95180 with x1847765450755456 ext(236624->18446744073709551615) 00002000:00010000:1.0:1762166982.064034:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc6a95180. 00000100:00100000:0.0:1762166982.065146:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166982.065199:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450755840 00000100:00100000:2.0:1762166982.065206:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450755840 00000100:00100000:2.0:1762166982.065250:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30919 00000100:00100000:2.0:1762166982.065258:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6a97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+554:61766:x1847765450755840:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:2.0:1762166982.065278:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166982.065296:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99e00/0x2f180c4effbad2a7 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eab30 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166982.065382:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99c00/0x2f180c4effbad2ae lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166982.065395:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99c00/0x2f180c4effbad2ae lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166982.065406:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99c00/0x2f180c4effbad2ae lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000004:00200000:2.0:1762166982.065433:0:30829:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 236624 00000004:00200000:2.0:1762166982.065438:0:30829:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166982.065454:0:30829:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99c00/0x2f180c4effbad2ae lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166982.065504:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99e00/0x2f180c4effbad2a7 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eab30 expref: 556 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166982.065525:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99c00/0x2f180c4effbad2ae lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eab30 expref: 555 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166982.065535:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945cc3449e00) 00010000:00010000:2.0:1762166982.065538:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166982.065542:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4b99c00, rc 0) 00000100:00100000:2.0:1762166982.065590:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6a97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+555:61766:x1847765450755840:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 332us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166982.065596:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30919 00000100:00100000:2.0:1762166982.070881:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166982.070965:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450756096 00000100:00100000:0.0:1762166982.070978:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450756096 00000100:00100000:0.0:1762166982.071044:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30920 00000100:00100000:0.0:1762166982.071057:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc70b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+555:61766:x1847765450756096:12345-192.168.204.38@tcp:36:fsx.0 00010000:00010000:0.0:1762166982.071129:0:30829:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166982.071160:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99c00/0x2f180c4effbad2ae lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eab30 expref: 555 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166982.071185:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945cc3449e00) 00010000:00010000:0.0:1762166982.071191:0:30829:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166982.071411:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbad2b5 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:0.0:1762166982.071428:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbad2b5 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166982.071440:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbad2b5 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000001:00080000:0.0:1762166982.071530:0:30829:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992581 00000004:00010000:0.0:1762166982.071556:0:30829:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000a4eda12e reply state 00000000f4a8eeca transno 4294992582 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbad2b5 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166982.071571:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbad2b5 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:0.0:1762166982.071578:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945cc3449e00) 00010000:00010000:0.0:1762166982.071581:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762166982.071585:0:30829:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166982.071695:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc70b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+557:61766:x1847765450756096:12345-192.168.204.38@tcp:36:fsx.0 Request processed in 642us (829us total) trans 4294992582 rc 0/0 00000100:00100000:0.0:1762166982.071701:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30920 00000020:00080000:0.0:1762166982.071706:0:30829:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1762166982.073265:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166982.073299:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166982.073361:0:23942:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450756224 00000100:00100000:1.0:1762166982.073368:0:23940:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450756352 00000100:00100000:3.0:1762166982.073369:0:23942:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450756224 00000100:00100000:0.0:1762166982.073379:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166982.073387:0:23940:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450756352 00002000:00010000:3.0:1762166982.073423:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (8872->18446744073709551615) 00002000:00100000:3.0:1762166982.073429:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc6a94380 with x1847765450756224 ext(8872->18446744073709551615) 00002000:00010000:1.0:1762166982.073439:0:23940:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00010000:3.0:1762166982.073441:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc6a94380. 00000100:00100000:2.0:1762166982.073451:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450756480 00002000:00100000:1.0:1762166982.073451:0:23940:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc6a97480 with x1847765450756352 ext(0->18446744073709551615) 00000100:00100000:2.0:1762166982.073460:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450756480 00002000:00010000:1.0:1762166982.073468:0:23940:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc6a97480. 00000100:00100000:0.0:1762166982.073529:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2812 00000100:00100000:0.0:1762166982.073543:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6a94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+31:2419:x1847765450756224:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:2.0:1762166982.073548:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00000100:00100000:3.0:1762166982.073549:0:23942:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2813 00002000:00100000:2.0:1762166982.073556:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc6a95500 with x1847765450756480 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166982.073566:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc6a95500. 00000100:00100000:3.0:1762166982.073567:0:23942:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6a97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+21:2418:x1847765450756352:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:2.0:1762166982.073602:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2814 00000100:00100000:2.0:1762166982.073616:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6a95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+31:2419:x1847765450756480:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:3.0:1762166982.073719:0:23942:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166982.073723:0:23942:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166982 -> 1762166982 00002000:00010000:2.0:1762166982.073726:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166982.073727:0:23942:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166981 -> 1762166981 00002000:00010000:3.0:1762166982.073733:0:23942:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166982 -> 1762166982 00002000:00010000:2.0:1762166982.073733:0:23943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166982 -> 1762166982 00002000:00010000:3.0:1762166982.073738:0:23942:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00002000:00010000:2.0:1762166982.073741:0:23943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166981 -> 1762166981 00002000:00010000:2.0:1762166982.073745:0:23943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166982 -> 1762166982 00002000:00010000:2.0:1762166982.073748:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1762166982.073803:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6a95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+32:2419:x1847765450756480:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 181us (419us total) trans 17179876780 rc 0/0 00000100:00100000:3.0:1762166982.073804:0:23942:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6a97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765450756352:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 231us (491us total) trans 21474843493 rc 0/0 00000100:00100000:2.0:1762166982.073818:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2814 00002000:00010000:2.0:1762166982.073822:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:2.0:1762166982.073825:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc6a95500 with x1847765450756480 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166982.073830:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc6a95500. 00000100:00100000:3.0:1762166982.073899:0:23942:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2813 00002000:00010000:3.0:1762166982.073904:0:23942:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:3.0:1762166982.073908:0:23942:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc6a97480 with x1847765450756352 ext(0->18446744073709551615) 00002000:00010000:3.0:1762166982.073915:0:23942:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc6a97480. 00002000:00010000:0.0:1762166982.074016:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 236624 -> 8872 00002000:00010000:0.0:1762166982.074021:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166982 -> 1762166982 00002000:00010000:0.0:1762166982.074024:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166982 -> 1762166982 00002000:00010000:0.0:1762166982.074026:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166982 -> 1762166982 00002000:00010000:0.0:1762166982.074028:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 360 -> 16 00000100:00100000:0.0:1762166982.074069:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6a94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+32:2419:x1847765450756224:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 530us (810us total) trans 17179876781 rc 0/0 00000100:00100000:0.0:1762166982.074077:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2812 00002000:00010000:0.0:1762166982.074080:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (8872->18446744073709551615) 00002000:00100000:0.0:1762166982.074083:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc6a94380 with x1847765450756224 ext(8872->18446744073709551615) 00002000:00010000:0.0:1762166982.074087:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc6a94380. 00000100:00100000:0.0:1762166982.075262:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166982.075309:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450756608 00000100:00100000:2.0:1762166982.075314:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450756608 00000100:00100000:2.0:1762166982.075350:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30921 00000100:00100000:2.0:1762166982.075359:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6a94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+557:61766:x1847765450756608:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:2.0:1762166982.075378:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166982.075404:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99600/0x2f180c4effbad2bc lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eab37 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166982.075499:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99e00/0x2f180c4effbad2c3 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166982.075514:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99e00/0x2f180c4effbad2c3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166982.075525:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99e00/0x2f180c4effbad2c3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000004:00200000:2.0:1762166982.075555:0:30829:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 8872 00000004:00200000:2.0:1762166982.075560:0:30829:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166982.075578:0:30829:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99e00/0x2f180c4effbad2c3 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166982.075605:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99600/0x2f180c4effbad2bc lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eab37 expref: 559 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166982.075623:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99e00/0x2f180c4effbad2c3 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eab37 expref: 558 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166982.075632:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945cc3449e00) 00010000:00010000:2.0:1762166982.075635:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166982.075638:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4b99e00, rc 0) 00000100:00100000:2.0:1762166982.075677:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6a94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+558:61766:x1847765450756608:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 319us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166982.075684:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30921 00000100:00100000:2.0:1762166982.078240:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166982.078322:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450756736 00000100:00100000:0.0:1762166982.078330:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450756736 00000100:00100000:0.0:1762166982.078387:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2815 00000100:00100000:0.0:1762166982.078397:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc70b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+32:2418:x1847765450756736:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:0.0:1762166982.078582:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 8872 -> 8872 00002000:00010000:0.0:1762166982.078586:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166982 -> 1762166982 00002000:00010000:0.0:1762166982.078588:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166982 -> 1762166982 00002000:00010000:0.0:1762166982.078590:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166982 -> 1762166982 00002000:00010000:0.0:1762166982.078600:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 16 -> 16 00000100:00100000:0.0:1762166982.078653:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc70b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+33:2418:x1847765450756736:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 258us (419us total) trans 17179876782 rc 0/0 00000100:00100000:0.0:1762166982.078660:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2815 00000100:00100000:1.0:1762166982.080596:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166982.080650:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450756864 00000100:00100000:0.0:1762166982.080658:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450756864 00002000:00100000:0.0:1762166982.080697:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (12288->81919) req@ffff945bc6227b80 x1847765450756864/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:13/0 lens 488/0 e 0 to 0 dl 1762166993 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166982.080708:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc6227b80 with x1847765450756864 ext(12288->81919) 00002000:00010000:0.0:1762166982.080715:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc6227b80 00000100:00100000:0.0:1762166982.080748:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2816 00000100:00100000:0.0:1762166982.080757:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6227b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+33:2417:x1847765450756864:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:0.0:1762166982.081630:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6227b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+33:2417:x1847765450756864:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 872us (1043us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166982.081638:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2816 00002000:00100000:0.0:1762166982.081647:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (12288->81919) req@ffff945bc6227b80 x1847765450756864/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:13/0 lens 488/440 e 0 to 0 dl 1762166993 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166982.081657:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc6227b80 with x1847765450756864 ext(12288->81919) 00002000:00010000:0.0:1762166982.081661:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc6227b80 00000100:00100000:2.0:1762166982.083962:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166982.084028:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450756992 00000100:00100000:0.0:1762166982.084035:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450756992 00000100:00100000:0.0:1762166982.084085:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2817 00000100:00100000:0.0:1762166982.084095:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc3550380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+33:2419:x1847765450756992:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:0.0:1762166982.084582:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 8872 -> 24257 00002000:00010000:0.0:1762166982.084586:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166982 -> 1762166982 00002000:00010000:0.0:1762166982.084589:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166982 -> 1762166982 00002000:00010000:0.0:1762166982.084591:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166982 -> 1762166982 00002000:00010000:0.0:1762166982.084594:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 16 -> 48 00000100:00100000:0.0:1762166982.084637:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc3550380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+34:2419:x1847765450756992:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 544us (678us total) trans 17179876783 rc 0/0 00000100:00100000:0.0:1762166982.084646:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2817 00000100:00100000:1.0:1762166982.086809:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166982.086851:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450757120 00000100:00100000:0.0:1762166982.086859:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450757120 00000100:00100000:0.0:1762166982.086910:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2818 00000100:00100000:0.0:1762166982.086918:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6225500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+34:2418:x1847765450757120:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:0.0:1762166982.087046:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 24257 -> 24257 00002000:00010000:0.0:1762166982.087049:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166982 -> 1762166982 00002000:00010000:0.0:1762166982.087052:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166982 -> 1762166982 00002000:00010000:0.0:1762166982.087054:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166982 -> 1762166982 00002000:00010000:0.0:1762166982.087056:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 48 -> 168 00000100:00100000:0.0:1762166982.087096:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6225500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+35:2418:x1847765450757120:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 179us (304us total) trans 17179876784 rc 0/0 00000100:00100000:0.0:1762166982.087104:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2818 00000100:00100000:2.0:1762166982.088788:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166982.088851:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450757248 00000100:00100000:0.0:1762166982.088856:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450757248 00000100:00100000:0.0:1762166982.088890:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2819 00000100:00100000:0.0:1762166982.088898:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc55dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+35:2419:x1847765450757248:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:0.0:1762166982.089005:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 24257 -> 24257 00002000:00010000:0.0:1762166982.089009:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166982 -> 1762166982 00002000:00010000:0.0:1762166982.089011:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166982 -> 1762166982 00002000:00010000:0.0:1762166982.089013:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166982 -> 1762166982 00002000:00010000:0.0:1762166982.089015:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 168 -> 168 00000100:00100000:0.0:1762166982.089064:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc55dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+36:2419:x1847765450757248:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 166us (282us total) trans 17179876785 rc 0/0 00000100:00100000:0.0:1762166982.089072:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2819 00000100:00100000:2.0:1762166982.091027:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166982.091085:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450757376 00000100:00100000:0.0:1762166982.091096:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450757376 00002000:00100000:0.0:1762166982.091134:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (0->4095) req@ffff945bcb385880 x1847765450757376/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:13/0 lens 488/0 e 0 to 0 dl 1762166993 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166982.091143:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bcb385880 with x1847765450757376 ext(0->4095) 00002000:00010000:0.0:1762166982.091147:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bcb385880 00000100:00100000:0.0:1762166982.091172:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2820 00000100:00100000:0.0:1762166982.091178:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb385880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+36:2418:x1847765450757376:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:0.0:1762166982.091308:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb385880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+36:2418:x1847765450757376:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 130us (298us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1762166982.091314:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2820 00002000:00100000:0.0:1762166982.091318:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (0->4095) req@ffff945bcb385880 x1847765450757376/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:13/0 lens 488/4536 e 0 to 0 dl 1762166993 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166982.091324:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bcb385880 with x1847765450757376 ext(0->4095) 00002000:00010000:0.0:1762166982.091327:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bcb385880 00000100:00100000:1.0:1762166982.092598:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166982.092658:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450757504 00000100:00100000:0.0:1762166982.092667:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450757504 00002000:00100000:0.0:1762166982.092697:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (4096->8191) req@ffff945bc6225c00 x1847765450757504/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:13/0 lens 488/0 e 0 to 0 dl 1762166993 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166982.092708:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc6225c00 with x1847765450757504 ext(4096->8191) 00002000:00010000:0.0:1762166982.092713:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc6225c00 00000100:00100000:0.0:1762166982.092754:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2821 00000100:00100000:0.0:1762166982.092765:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6225c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+36:2419:x1847765450757504:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:0.0:1762166982.092934:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6225c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+36:2419:x1847765450757504:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 171us (343us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1762166982.092943:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2821 00002000:00100000:0.0:1762166982.092949:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (4096->8191) req@ffff945bc6225c00 x1847765450757504/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:13/0 lens 488/4536 e 0 to 0 dl 1762166993 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166982.092958:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc6225c00 with x1847765450757504 ext(4096->8191) 00002000:00010000:0.0:1762166982.092962:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc6225c00 00000100:00100000:2.0:1762166982.094130:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166982.094178:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450757632 00000100:00100000:0.0:1762166982.094184:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450757632 00002000:00100000:0.0:1762166982.094211:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (8192->12287) req@ffff945bc576aa00 x1847765450757632/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:13/0 lens 488/0 e 0 to 0 dl 1762166993 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166982.094221:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc576aa00 with x1847765450757632 ext(8192->12287) 00002000:00010000:0.0:1762166982.094225:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc576aa00 00000100:00100000:0.0:1762166982.094250:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2822 00000100:00100000:0.0:1762166982.094260:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc576aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+36:2418:x1847765450757632:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:0.0:1762166982.094372:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc576aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+36:2418:x1847765450757632:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 113us (242us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1762166982.094380:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2822 00002000:00100000:0.0:1762166982.094386:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (8192->12287) req@ffff945bc576aa00 x1847765450757632/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:13/0 lens 488/4536 e 0 to 0 dl 1762166993 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166982.094394:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc576aa00 with x1847765450757632 ext(8192->12287) 00002000:00010000:0.0:1762166982.094398:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc576aa00 00000100:00100000:2.0:1762166982.095657:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166982.095706:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450757760 00000100:00100000:0.0:1762166982.095713:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450757760 00002000:00100000:0.0:1762166982.095739:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (12288->16383) req@ffff945bc5764380 x1847765450757760/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:13/0 lens 488/0 e 0 to 0 dl 1762166993 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166982.095749:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5764380 with x1847765450757760 ext(12288->16383) 00002000:00010000:0.0:1762166982.095753:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5764380 00000100:00100000:0.0:1762166982.095780:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2823 00000100:00100000:0.0:1762166982.095806:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5764380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+36:2419:x1847765450757760:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:0.0:1762166982.095941:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5764380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+36:2419:x1847765450757760:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 152us (287us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1762166982.095949:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2823 00002000:00100000:0.0:1762166982.095956:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (12288->16383) req@ffff945bc5764380 x1847765450757760/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:13/0 lens 488/4536 e 0 to 0 dl 1762166993 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166982.095965:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5764380 with x1847765450757760 ext(12288->16383) 00002000:00010000:0.0:1762166982.095968:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5764380 00000100:00100000:1.0:1762166982.097021:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166982.097071:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450757888 00000100:00100000:0.0:1762166982.097077:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450757888 00002000:00100000:0.0:1762166982.097103:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (16384->20479) req@ffff945bc6cd1f80 x1847765450757888/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:13/0 lens 488/0 e 0 to 0 dl 1762166993 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166982.097118:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc6cd1f80 with x1847765450757888 ext(16384->20479) 00002000:00010000:0.0:1762166982.097122:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc6cd1f80 00000100:00100000:0.0:1762166982.097155:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2824 00000100:00100000:0.0:1762166982.097169:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+36:2418:x1847765450757888:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:0.0:1762166982.097271:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+36:2418:x1847765450757888:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 104us (252us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1762166982.097279:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2824 00002000:00100000:0.0:1762166982.097287:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (16384->20479) req@ffff945bc6cd1f80 x1847765450757888/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:13/0 lens 488/4536 e 0 to 0 dl 1762166993 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166982.097295:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc6cd1f80 with x1847765450757888 ext(16384->20479) 00002000:00010000:0.0:1762166982.097299:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc6cd1f80 00000100:00100000:2.0:1762166982.098469:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166982.098529:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450758016 00000100:00100000:0.0:1762166982.098535:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450758016 00002000:00100000:0.0:1762166982.098558:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (20480->24575) req@ffff945bc5765500 x1847765450758016/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:13/0 lens 488/0 e 0 to 0 dl 1762166993 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166982.098565:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5765500 with x1847765450758016 ext(20480->24575) 00002000:00010000:0.0:1762166982.098567:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5765500 00000100:00100000:0.0:1762166982.098583:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2825 00000100:00100000:0.0:1762166982.098588:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5765500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+36:2419:x1847765450758016:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:0.0:1762166982.098678:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5765500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+36:2419:x1847765450758016:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 89us (218us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1762166982.098684:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2825 00002000:00100000:0.0:1762166982.098689:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (20480->24575) req@ffff945bc5765500 x1847765450758016/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:13/0 lens 488/4536 e 0 to 0 dl 1762166993 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166982.098695:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5765500 with x1847765450758016 ext(20480->24575) 00002000:00010000:0.0:1762166982.098697:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5765500 00000100:00100000:2.0:1762166982.099724:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166982.099767:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450758144 00000100:00100000:0.0:1762166982.099774:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450758144 00002000:00100000:0.0:1762166982.099809:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (24576->28671) req@ffff945bc5764a80 x1847765450758144/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:13/0 lens 488/0 e 0 to 0 dl 1762166993 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166982.099818:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5764a80 with x1847765450758144 ext(24576->28671) 00002000:00010000:0.0:1762166982.099822:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5764a80 00000100:00100000:0.0:1762166982.099848:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2826 00000100:00100000:0.0:1762166982.099857:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5764a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+36:2418:x1847765450758144:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:0.0:1762166982.099952:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5764a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+36:2418:x1847765450758144:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 95us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166982.099959:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2826 00002000:00100000:0.0:1762166982.099967:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (24576->28671) req@ffff945bc5764a80 x1847765450758144/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:13/0 lens 488/440 e 0 to 0 dl 1762166993 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166982.099976:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc5764a80 with x1847765450758144 ext(24576->28671) 00002000:00010000:0.0:1762166982.099980:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc5764a80 00000100:00100000:1.0:1762166982.101144:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166982.101204:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450758272 00000100:00100000:0.0:1762166982.101209:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450758272 00002000:00100000:0.0:1762166982.101230:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (28672->32767) req@ffff945bc6cd1180 x1847765450758272/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:13/0 lens 488/0 e 0 to 0 dl 1762166993 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166982.101240:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc6cd1180 with x1847765450758272 ext(28672->32767) 00002000:00010000:0.0:1762166982.101244:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc6cd1180 00000100:00100000:0.0:1762166982.101267:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2827 00000100:00100000:0.0:1762166982.101276:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6cd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+36:2419:x1847765450758272:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:0.0:1762166982.101366:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6cd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+36:2419:x1847765450758272:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 91us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166982.101374:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2827 00002000:00100000:0.0:1762166982.101382:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (28672->32767) req@ffff945bc6cd1180 x1847765450758272/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:13/0 lens 488/440 e 0 to 0 dl 1762166993 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166982.101391:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc6cd1180 with x1847765450758272 ext(28672->32767) 00002000:00010000:0.0:1762166982.101395:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc6cd1180 00000100:00100000:2.0:1762166982.102537:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166982.102585:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450758400 00000100:00100000:0.0:1762166982.102591:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450758400 00002000:00100000:0.0:1762166982.102612:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (32768->36863) req@ffff945cf1ddc700 x1847765450758400/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:13/0 lens 488/0 e 0 to 0 dl 1762166993 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166982.102622:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1ddc700 with x1847765450758400 ext(32768->36863) 00002000:00010000:0.0:1762166982.102626:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1ddc700 00000100:00100000:0.0:1762166982.102651:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2828 00000100:00100000:0.0:1762166982.102658:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+36:2418:x1847765450758400:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:0.0:1762166982.102738:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+36:2418:x1847765450758400:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 80us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166982.102745:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2828 00002000:00100000:0.0:1762166982.102751:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (32768->36863) req@ffff945cf1ddc700 x1847765450758400/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:13/0 lens 488/440 e 0 to 0 dl 1762166993 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166982.102759:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1ddc700 with x1847765450758400 ext(32768->36863) 00002000:00010000:0.0:1762166982.102763:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1ddc700 00000100:00100000:2.0:1762166982.103961:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166982.104020:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450758528 00000100:00100000:0.0:1762166982.104026:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450758528 00002000:00100000:0.0:1762166982.104047:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (36864->40959) req@ffff945cf1e6d500 x1847765450758528/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:13/0 lens 488/0 e 0 to 0 dl 1762166993 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166982.104057:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1e6d500 with x1847765450758528 ext(36864->40959) 00002000:00010000:0.0:1762166982.104060:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1e6d500 00000100:00100000:0.0:1762166982.104081:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2829 00000100:00100000:0.0:1762166982.104088:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1e6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+36:2419:x1847765450758528:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:0.0:1762166982.104165:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1e6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+36:2419:x1847765450758528:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 77us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166982.104171:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2829 00002000:00100000:0.0:1762166982.104178:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (36864->40959) req@ffff945cf1e6d500 x1847765450758528/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:13/0 lens 488/440 e 0 to 0 dl 1762166993 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166982.104187:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945cf1e6d500 with x1847765450758528 ext(36864->40959) 00002000:00010000:0.0:1762166982.104190:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945cf1e6d500 00000100:00100000:1.0:1762166982.105215:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166982.105320:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450758656 00000100:00100000:0.0:1762166982.105331:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450758656 00002000:00100000:0.0:1762166982.105380:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (40960->45055) req@ffff945bc6cd2d80 x1847765450758656/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:13/0 lens 488/0 e 0 to 0 dl 1762166993 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166982.105392:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc6cd2d80 with x1847765450758656 ext(40960->45055) 00002000:00010000:0.0:1762166982.105408:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc6cd2d80 00000100:00100000:0.0:1762166982.105439:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2830 00000100:00100000:0.0:1762166982.105449:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6cd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+36:2418:x1847765450758656:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:0.0:1762166982.105657:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6cd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+36:2418:x1847765450758656:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 208us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166982.105665:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2830 00002000:00100000:0.0:1762166982.105673:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (40960->45055) req@ffff945bc6cd2d80 x1847765450758656/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:13/0 lens 488/440 e 0 to 0 dl 1762166993 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166982.105682:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc6cd2d80 with x1847765450758656 ext(40960->45055) 00002000:00010000:0.0:1762166982.105685:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc6cd2d80 00000100:00100000:2.0:1762166982.106755:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166982.106813:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450758784 00000100:00100000:0.0:1762166982.106818:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450758784 00002000:00100000:0.0:1762166982.106841:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (45056->49151) req@ffff945bc406d880 x1847765450758784/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:13/0 lens 488/0 e 0 to 0 dl 1762166993 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166982.106852:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc406d880 with x1847765450758784 ext(45056->49151) 00002000:00010000:0.0:1762166982.106856:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc406d880 00000100:00100000:0.0:1762166982.106879:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2831 00000100:00100000:0.0:1762166982.106887:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+36:2419:x1847765450758784:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:0.0:1762166982.106983:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+36:2419:x1847765450758784:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 97us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166982.106991:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2831 00002000:00100000:0.0:1762166982.106998:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (45056->49151) req@ffff945bc406d880 x1847765450758784/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:13/0 lens 488/440 e 0 to 0 dl 1762166993 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166982.107006:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc406d880 with x1847765450758784 ext(45056->49151) 00002000:00010000:0.0:1762166982.107009:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc406d880 00000100:00100000:2.0:1762166982.108149:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166982.108203:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450758912 00000100:00100000:0.0:1762166982.108208:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450758912 00002000:00100000:0.0:1762166982.108229:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (49152->53247) req@ffff945bc406e680 x1847765450758912/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:13/0 lens 488/0 e 0 to 0 dl 1762166993 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166982.108244:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc406e680 with x1847765450758912 ext(49152->53247) 00002000:00010000:0.0:1762166982.108248:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc406e680 00000100:00100000:0.0:1762166982.108273:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2832 00000100:00100000:0.0:1762166982.108281:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+36:2418:x1847765450758912:12345-192.168.204.38@tcp:3:fsx.0 00000100:00100000:0.0:1762166982.108369:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+36:2418:x1847765450758912:12345-192.168.204.38@tcp:3:fsx.0 Request processed in 88us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166982.108378:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2832 00002000:00100000:0.0:1762166982.108396:0:8388:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xa77:0x0] (49152->53247) req@ffff945bc406e680 x1847765450758912/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:13/0 lens 488/440 e 0 to 0 dl 1762166993 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166982.108405:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc406e680 with x1847765450758912 ext(49152->53247) 00002000:00010000:0.0:1762166982.108409:0:8388:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc406e680 00000100:00100000:1.0:1762166982.111377:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166982.111434:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450759168 00000100:00100000:2.0:1762166982.111443:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450759168 00000100:00100000:2.0:1762166982.111532:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30922 00000100:00100000:2.0:1762166982.111541:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6cd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+558:61766:x1847765450759168:12345-192.168.204.38@tcp:36:fsx.0 00010000:00010000:2.0:1762166982.111613:0:30829:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166982.111646:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99e00/0x2f180c4effbad2c3 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eab37 expref: 558 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166982.111664:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945cc3449e00) 00010000:00010000:2.0:1762166982.111668:0:30829:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166982.111884:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b98a00/0x2f180c4effbad2ca lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166982.111898:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b98a00/0x2f180c4effbad2ca lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166982.111905:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b98a00/0x2f180c4effbad2ca lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000001:00080000:2.0:1762166982.111946:0:30829:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992583 00000004:00010000:2.0:1762166982.111962:0:30829:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000013023a3b reply state 000000002910931c transno 4294992584 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b98a00/0x2f180c4effbad2ca lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166982.111971:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b98a00/0x2f180c4effbad2ca lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166982.111975:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945cc3449e00) 00010000:00010000:2.0:1762166982.111977:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166982.111979:0:30829:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166982.112055:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6cd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+560:61766:x1847765450759168:12345-192.168.204.38@tcp:36:fsx.0 Request processed in 516us (690us total) trans 4294992584 rc 0/0 00000100:00100000:2.0:1762166982.112060:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30922 00000020:00080000:2.0:1762166982.112065:0:30829:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1762166982.113587:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166982.113621:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166982.113646:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450759296 00000100:00100000:2.0:1762166982.113653:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166982.113655:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450759296 00002000:00010000:0.0:1762166982.113691:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (83183->18446744073709551615) 00002000:00100000:0.0:1762166982.113697:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc406dc00 with x1847765450759296 ext(83183->18446744073709551615) 00002000:00010000:0.0:1762166982.113709:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc406dc00. 00000100:00100000:0.0:1762166982.113736:0:8388:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450759424 00000100:00100000:1.0:1762166982.113739:0:23943:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450759552 00000100:00100000:0.0:1762166982.113741:0:8388:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450759424 00000100:00100000:1.0:1762166982.113748:0:23943:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450759552 00000100:00100000:2.0:1762166982.113758:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2833 00002000:00010000:0.0:1762166982.113758:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00002000:00100000:0.0:1762166982.113764:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc406f480 with x1847765450759424 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166982.113771:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc406f480. 00000100:00100000:2.0:1762166982.113775:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+37:2419:x1847765450759296:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:1.0:1762166982.113778:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00002000:00100000:1.0:1762166982.113785:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc406ce00 with x1847765450759552 ext(0->18446744073709551615) 00000100:00100000:0.0:1762166982.113804:0:8388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2834 00002000:00010000:1.0:1762166982.113806:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc406ce00. 00000100:00100000:0.0:1762166982.113814:0:8388:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+22:2419:x1847765450759424:12345-192.168.204.38@tcp:10:fsx.0 00000100:00100000:1.0:1762166982.113837:0:23943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2835 00000100:00100000:1.0:1762166982.113847:0:23943:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+37:2419:x1847765450759552:12345-192.168.204.38@tcp:10:fsx.0 00002000:00010000:1.0:1762166982.113951:0:23943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166982.113951:0:8388:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1762166982.113960:0:8388:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb mtime from disk: 1762166982 -> 1762166982 00002000:00010000:1.0:1762166982.113961:0:23943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb mtime from disk: 1762166982 -> 1762166982 00002000:00010000:0.0:1762166982.113965:0:8388:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb atime from disk: 1762166981 -> 1762166981 00002000:00010000:1.0:1762166982.113967:0:23943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb atime from disk: 1762166981 -> 1762166981 00002000:00010000:0.0:1762166982.113970:0:8388:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb ctime from disk: 1762166982 -> 1762166982 00002000:00010000:1.0:1762166982.113972:0:23943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb ctime from disk: 1762166982 -> 1762166982 00002000:00010000:0.0:1762166982.113976:0:8388:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa7a:0x0] updating lvb blocks from disk: 6144 -> 6144 00002000:00010000:1.0:1762166982.113977:0:23943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa79:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:2.0:1762166982.114021:0:14623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 24257 -> 83183 00002000:00010000:2.0:1762166982.114025:0:14623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166982 -> 1762166982 00002000:00010000:2.0:1762166982.114026:0:14623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166982 -> 1762166982 00002000:00010000:2.0:1762166982.114028:0:14623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166982 -> 1762166982 00002000:00010000:2.0:1762166982.114029:0:14623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 168 -> 48 00000100:00100000:1.0:1762166982.114041:0:23943:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e1e11365-ba0b-405b-99c9-a704373217f2+39:2419:x1847765450759552:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 193us (386us total) trans 17179876786 rc 0/0 00000100:00100000:0.0:1762166982.114042:0:8388:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765450759424:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 227us (417us total) trans 21474843494 rc 0/0 00000100:00100000:2.0:1762166982.114053:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+39:2419:x1847765450759296:12345-192.168.204.38@tcp:10:fsx.0 Request processed in 282us (476us total) trans 17179876787 rc 0/0 00000100:00100000:1.0:1762166982.114060:0:23943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2835 00002000:00010000:1.0:1762166982.114066:0:23943:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2681 (0->18446744073709551615) 00000100:00100000:0.0:1762166982.114068:0:8388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2834 00002000:00100000:1.0:1762166982.114072:0:23943:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc406ce00 with x1847765450759552 ext(0->18446744073709551615) 00002000:00010000:0.0:1762166982.114075:0:8388:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/2682 (0->18446744073709551615) 00000100:00100000:2.0:1762166982.114078:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2833 00002000:00100000:0.0:1762166982.114082:0:8388:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc406f480 with x1847765450759424 ext(0->18446744073709551615) 00002000:00010000:2.0:1762166982.114085:0:14623:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2679 (83183->18446744073709551615) 00002000:00010000:1.0:1762166982.114085:0:23943:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc406ce00. 00002000:00010000:0.0:1762166982.114090:0:8388:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff945bc406f480. 00002000:00100000:2.0:1762166982.114093:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc406dc00 with x1847765450759296 ext(83183->18446744073709551615) 00002000:00010000:2.0:1762166982.114101:0:14623:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc406dc00. 00000100:00100000:0.0:1762166982.115132:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166982.115178:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450759680 00000100:00100000:2.0:1762166982.115183:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450759680 00000100:00100000:2.0:1762166982.115219:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30923 00000100:00100000:2.0:1762166982.115228:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6a95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+560:61766:x1847765450759680:12345-192.168.204.38@tcp:101:fsx.0 00010000:00010000:2.0:1762166982.115243:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166982.115260:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b98400/0x2f180c4effbad2d1 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eab3e expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166982.115340:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99600/0x2f180c4effbad2d8 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166982.115352:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99600/0x2f180c4effbad2d8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166982.115362:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99600/0x2f180c4effbad2d8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000004:00200000:2.0:1762166982.115387:0:30829:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 83183 00000004:00200000:2.0:1762166982.115392:0:30829:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166982.115408:0:30829:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99600/0x2f180c4effbad2d8 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166982.115429:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b98400/0x2f180c4effbad2d1 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eab3e expref: 562 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166982.115441:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99600/0x2f180c4effbad2d8 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eab3e expref: 561 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166982.115447:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945cc3449e00) 00010000:00010000:2.0:1762166982.115449:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166982.115452:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4b99600, rc 0) 00000100:00100000:2.0:1762166982.115493:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6a95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+561:61766:x1847765450759680:12345-192.168.204.38@tcp:101:fsx.0 Request processed in 268us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166982.115498:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30923 00000100:00100000:3.0:1762166982.119679:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166982.119729:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450759808 00000100:00100000:2.0:1762166982.119738:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450759808 00002000:00100000:2.0:1762166982.119785:0:14623:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xa77:0x0] (16384->258110) req@ffff945bc8121880 x1847765450759808/t0(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:13/0 lens 520/0 e 0 to 0 dl 1762166993 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166982.119806:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc8121880 with x1847765450759808 ext(16384->258110) 00002000:00010000:2.0:1762166982.119812:0:14623:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc8121880 00000100:00100000:2.0:1762166982.119839:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2836 00000100:00100000:2.0:1762166982.119847:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc8121880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+38:2417:x1847765450759808:12345-192.168.204.38@tcp:4:fsx.0 00000100:00100000:2.0:1762166982.122069:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc8121880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+40:2417:x1847765450759808:12345-192.168.204.38@tcp:4:fsx.0 Request processed in 2216us (2394us total) trans 17179876788 rc 0/0 00000100:00100000:2.0:1762166982.122080:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2836 00002000:00100000:2.0:1762166982.122089:0:14623:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xa77:0x0] (16384->258110) req@ffff945bc8121880 x1847765450759808/t17179876788(0) o4->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:13/0 lens 520/456 e 0 to 0 dl 1762166993 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1762166982.122096:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc8121880 with x1847765450759808 ext(16384->258110) 00002000:00010000:2.0:1762166982.122099:0:14623:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc8121880 00000100:00100000:0.0:1762166982.123087:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166982.123143:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450759936 00000100:00100000:2.0:1762166982.123150:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450759936 00000100:00100000:2.0:1762166982.123207:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2837 00000100:00100000:2.0:1762166982.123218:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6a94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+40:2418:x1847765450759936:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:2.0:1762166982.123550:0:14623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 83183 -> 258111 00002000:00010000:2.0:1762166982.123555:0:14623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166982 -> 1762166982 00002000:00010000:2.0:1762166982.123557:0:14623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166982 -> 1762166982 00002000:00010000:2.0:1762166982.123559:0:14623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166982 -> 1762166982 00002000:00010000:2.0:1762166982.123562:0:14623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 48 -> 176 00000100:00100000:2.0:1762166982.123606:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6a94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+41:2418:x1847765450759936:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 391us (524us total) trans 17179876789 rc 0/0 00000100:00100000:2.0:1762166982.123615:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2837 00000100:00100000:0.0:1762166982.125226:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166982.125275:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450760064 00000100:00100000:2.0:1762166982.125284:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450760064 00000100:00100000:2.0:1762166982.125349:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2838 00000100:00100000:2.0:1762166982.125361:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6a94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+41:2419:x1847765450760064:12345-192.168.204.38@tcp:22:fsx.0 00002000:00010000:2.0:1762166982.125713:0:14623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb size from disk: 258111 -> 258111 00002000:00010000:2.0:1762166982.125718:0:14623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb mtime from disk: 1762166982 -> 1762166982 00002000:00010000:2.0:1762166982.125720:0:14623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb atime from disk: 1762166982 -> 1762166982 00002000:00010000:2.0:1762166982.125721:0:14623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb ctime from disk: 1762166982 -> 1762166982 00002000:00010000:2.0:1762166982.125723:0:14623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa77:0x0] updating lvb blocks from disk: 176 -> 200 00000100:00100000:2.0:1762166982.125773:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6a94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+42:2419:x1847765450760064:12345-192.168.204.38@tcp:22:fsx.0 Request processed in 416us (555us total) trans 17179876790 rc 0/0 00000100:00100000:2.0:1762166982.125778:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2838 00000100:00100000:3.0:1762166982.128033:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166982.128164:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450760320 00000100:00100000:2.0:1762166982.128172:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450760320 00000100:00100000:2.0:1762166982.128229:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 12004 00000100:00100000:2.0:1762166982.128238:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc8120e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+561:61766:x1847765450760320:12345-192.168.204.38@tcp:35:fsx.0 00000100:00100000:2.0:1762166982.128568:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc8120e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+562:61766:x1847765450760320:12345-192.168.204.38@tcp:35:fsx.0 Request processed in 330us (543us total) trans 4294992585 rc 0/0 00000100:00100000:2.0:1762166982.128575:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 12004 00000100:00100000:0.0:1762166982.131171:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166982.131297:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450760576 00000100:00100000:2.0:1762166982.131311:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450760576 00000100:00100000:2.0:1762166982.131393:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 12005 00000100:00100000:2.0:1762166982.131406:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff2fcc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+562:61766:x1847765450760576:12345-192.168.204.38@tcp:35:fsx.0 00000001:00080000:2.0:1762166982.131661:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992586 00000100:00100000:2.0:1762166982.131776:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff2fcc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+564:61766:x1847765450760576:12345-192.168.204.38@tcp:35:fsx.0 Request processed in 372us (614us total) trans 4294992587 rc 0/0 00000100:00100000:2.0:1762166982.131785:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 12005 00000020:00080000:2.0:1762166982.131804:0:19593:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1762166982.132733:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166982.132777:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450760832 00000100:00100000:2.0:1762166982.132783:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450760832 00000100:00100000:2.0:1762166982.132832:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 12006 00000100:00100000:2.0:1762166982.132838:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6a96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+564:61766:x1847765450760832:12345-192.168.204.38@tcp:35:fsx.0 00000100:00100000:2.0:1762166982.132962:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6a96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+565:61766:x1847765450760832:12345-192.168.204.38@tcp:35:fsx.0 Request processed in 123us (232us total) trans 4294992588 rc 0/0 00000100:00100000:2.0:1762166982.132969:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 12006 00000100:00100000:0.0:1762166982.418793:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449801088:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1762166982.418930:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166982.418992:0:12247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449801088 00000100:00100000:1.0:1762166982.419004:0:12247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449801088 00000100:00100000:1.0:1762166982.419077:0:12247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1762166982.419088:0:12247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc442e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+11:3635:x1847765449801088:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1762166982.419118:0:12247:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 81920 granted 484921792 pending 0 free 3918143488 avail 3686424576 00000100:00100000:1.0:1762166982.419193:0:12247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc442e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+11:3635:x1847765449801088:12345-0@lo:13:osp-pre-0-1.0 Request processed in 107us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166982.419201:0:12247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:0.0:1762166982.419254:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449801088:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1762166982.482595:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166983.506630:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166983.870345:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166983.870456:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450760960 00000100:00100000:2.0:1762166983.870468:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450760960 00000100:00080000:0.0:1762166983.870563:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1762166983.870581:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30924 00000100:00100000:2.0:1762166983.870598:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6cd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+565:62309:x1847765450760960:12345-192.168.204.38@tcp:101:rm.0 00010000:00010000:2.0:1762166983.870621:0:30829:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166983.870644:0:30829:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b98400/0x2f180c4effbad2df lrc: 2/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eab45 expref: -99 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166983.870704:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99e00/0x2f180c4effbad2e6 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166983.870714:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99e00/0x2f180c4effbad2e6 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166983.870723:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99e00/0x2f180c4effbad2e6 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166983.870732:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99000/0x2f180c4effbad2ed lrc: 3/1,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166983.870737:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99000/0x2f180c4effbad2ed lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166983.870742:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99000/0x2f180c4effbad2ed lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166983.870823:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99800/0x2f180c4effbad2f4 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166983.870833:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99800/0x2f180c4effbad2f4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166983.870838:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99800/0x2f180c4effbad2f4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000004:00200000:2.0:1762166983.870872:0:30829:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x5eb:0x0]: returning size 258111 00000004:00200000:2.0:1762166983.870875:0:30829:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166983.870888:0:30829:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99800/0x2f180c4effbad2f4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166983.870898:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99800/0x2f180c4effbad2f4 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166983.870907:0:30829:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99e00/0x2f180c4effbad2e6 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166983.870914:0:30829:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99e00/0x2f180c4effbad2e6 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166983.870920:0:30829:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99e00/0x2f180c4effbad2e6 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166983.870927:0:30829:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99e00/0x2f180c4effbad2e6 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166983.870933:0:30829:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4b99e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166983.870937:0:30829:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99e00/0x2f180c4effbad2e6 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166983.870945:0:30829:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99e00/0x2f180c4effbad2e6 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166983.870956:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0x0 (ffff945bc809bf00) 00010000:00010000:2.0:1762166983.870960:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166983.870964:0:30829:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99e00/0x2f180c4effbad2e6 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166983.870970:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99e00/0x2f180c4effbad2e6 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166983.870982:0:30829:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99000/0x2f180c4effbad2ed lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166983.870989:0:30829:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99000/0x2f180c4effbad2ed lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166983.870994:0:30829:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99000/0x2f180c4effbad2ed lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166983.870999:0:30829:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4b99000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166983.871002:0:30829:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99000/0x2f180c4effbad2ed lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166983.871008:0:30829:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99000/0x2f180c4effbad2ed lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166983.871015:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0xdd396665 (ffff945bc809bb00) 00010000:00010000:2.0:1762166983.871018:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166983.871021:0:30829:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99000/0x2f180c4effbad2ed lrc: 2/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166983.871026:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99000/0x2f180c4effbad2ed lrc: 0/0,0 mode: --/PR res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166983.871055:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b98400/0x2f180c4effbad2df lrc: 0/0,0 mode: --/CR res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eab45 expref: 567 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166983.871073:0:30829:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99800/0x2f180c4effbad2f4 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eab45 expref: 566 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166983.871079:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945cc3449e00) 00010000:00010000:2.0:1762166983.871081:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166983.871083:0:30829:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4b99800, rc 0) 00000100:00100000:2.0:1762166983.871144:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6cd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+566:62309:x1847765450760960:12345-192.168.204.38@tcp:101:rm.0 Request processed in 551us (806us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166983.871152:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30924 00000100:00100000:0.0:1762166983.872850:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166983.872893:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450761088 00000100:00100000:2.0:1762166983.872898:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450761088 00000100:00100000:2.0:1762166983.872950:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 907 00000100:00100000:2.0:1762166983.872963:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc442f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+566:2417:x1847765450761088:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166983.872976:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166983.872995:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99800/0x2f180c4effbad2f4 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eab45 expref: 566 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166983.873012:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945cc3449e00) 00010000:00010000:2.0:1762166983.873016:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166983.873057:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc442f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+565:2417:x1847765450761088:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 98us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166983.873065:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 907 00000100:00100000:3.0:1762166983.873675:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166983.873714:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450761344 00000100:00100000:2.0:1762166983.873720:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450761344 00000100:00100000:2.0:1762166983.873754:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30925 00000100:00100000:2.0:1762166983.873772:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc8120e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+565:62309:x1847765450761344:12345-192.168.204.38@tcp:36:rm.0 00010000:00010000:2.0:1762166983.873814:0:30829:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1762166983.873828:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99600/0x2f180c4effbad2d8 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eab3e expref: 565 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166983.873847:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62c00/0x2f180c4effbad24c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x5eb:0x0].0x0 bits 0x20/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eab06 expref: 564 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166983.873860:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62e00/0x2f180c4effbad214 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x5eb:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaaf8 expref: 563 pid: 30829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166983.873869:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945cc3449e00) 00010000:00010000:2.0:1762166983.873872:0:30829:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166983.873892:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99c00/0x2f180c4effbad2fb lrc: 3/0,1 mode: --/CW res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166983.873900:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99c00/0x2f180c4effbad2fb lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166983.873909:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99c00/0x2f180c4effbad2fb lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166983.873932:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba000/0x2f180c4effbad302 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x6:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166983.873939:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba000/0x2f180c4effbad302 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166983.873946:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba000/0x2f180c4effbad302 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166983.874010:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb600/0x2f180c4effbad309 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166983.874023:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb600/0x2f180c4effbad309 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166983.874030:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb600/0x2f180c4effbad309 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00000040:00080000:2.0:1762166983.874270:0:30829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5967, 64 off467664 00000004:00080000:2.0:1762166983.874282:0:30829:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 603022802972ns, next at 604022800204ns, rc = 0 00000040:00080000:2.0:1762166983.874304:0:30829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5966, 64 off467664 00000004:00080000:2.0:1762166983.874310:0:30829:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 603022831963ns, next at 604022830628ns, rc = 0 00000040:00080000:2.0:1762166983.874321:0:30829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5967, 64 off467728 00000040:00080000:2.0:1762166983.874331:0:30829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5968, 64 off467728 00010000:00010000:2.0:1762166983.874391:0:30829:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4e00/0x2f180c4effbad310 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 30829 initiator: MDT0 00010000:00010000:2.0:1762166983.874401:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4e00/0x2f180c4effbad310 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x40/0x0 rrc: 9 type: IBT flags: 0x50010080000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166983.874409:0:30829:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4e00/0x2f180c4effbad310 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x40/0x0 rrc: 9 type: IBT flags: 0x40010080000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166983.874416:0:30829:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4e00/0x2f180c4effbad310 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x40/0x0 rrc: 9 type: IBT flags: 0x40010080000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166983.874422:0:30829:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4e00/0x2f180c4effbad310 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x40/0x0 rrc: 9 type: IBT flags: 0x50010480000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166983.874428:0:30829:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4e00/0x2f180c4effbad310 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x40/0x0 rrc: 9 type: IBT flags: 0x50010480000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166983.874453:0:30829:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166983.874470:0:30829:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb600/0x2f180c4effbad309 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x3/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166983.874494:0:30829:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb600/0x2f180c4effbad309 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x3/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166983.874501:0:30829:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb600/0x2f180c4effbad309 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x3/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166983.874507:0:30829:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93bb600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166983.874511:0:30829:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb600/0x2f180c4effbad309 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x3/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166983.874516:0:6482:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166983.874519:0:30829:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb600/0x2f180c4effbad309 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x3/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166983.874524:0:6482:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4e00/0x2f180c4effbad310 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x40/0x0 rrc: 10 type: IBT flags: 0x40010480000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166983.874529:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945cc3449e00) 00010000:00010000:2.0:1762166983.874535:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1762166983.874539:0:30829:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb600/0x2f180c4effbad309 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x3/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166983.874542:0:6482:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cb4e00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166983.874545:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93bb600/0x2f180c4effbad309 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x5eb:0x0].0x0 bits 0x3/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166983.874550:0:6482:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4e00/0x2f180c4effbad310 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x40/0x0 rrc: 10 type: IBT flags: 0x40010480000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166983.874559:0:6482:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4e00/0x2f180c4effbad310 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x40/0x0 rrc: 8 type: IBT flags: 0x40018480000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166983.874570:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945cc3449e00) 00010000:00010000:3.0:1762166983.874572:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1762166983.874575:0:6482:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4e00/0x2f180c4effbad310 lrc: 1/0,0 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x40/0x0 rrc: 8 type: IBT flags: 0x44819480000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166983.874581:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cf3cb4e00/0x2f180c4effbad310 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x5eb:0x0].0x0 bits 0x40/0x0 rrc: 8 type: IBT flags: 0x44819480000000 pid: 30829 initiator: MDT1 00010000:00010000:3.0:1762166983.874592:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166983.874594:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166983.874596:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166983.874690:0:30829:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99c00/0x2f180c4effbad2fb lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166983.874697:0:30829:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99c00/0x2f180c4effbad2fb lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166983.874703:0:30829:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99c00/0x2f180c4effbad2fb lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166983.874709:0:30829:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99c00/0x2f180c4effbad2fb lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166983.874715:0:30829:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4b99c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166983.874720:0:30829:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99c00/0x2f180c4effbad2fb lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166983.874726:0:30829:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99c00/0x2f180c4effbad2fb lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166983.874735:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0x0 (ffff945bc809b900) 00010000:00010000:2.0:1762166983.874738:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166983.874741:0:30829:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99c00/0x2f180c4effbad2fb lrc: 3/0,0 mode: --/CW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166983.874747:0:30829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99c00/0x2f180c4effbad2fb lrc: 0/0,0 mode: --/CW res: [0x240000405:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00000004:00010000:2.0:1762166983.874774:0:30829:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000ae9e540f reply state 00000000ff3bdd62 transno 4294992589 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba000/0x2f180c4effbad302 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166983.874787:0:30829:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba000/0x2f180c4effbad302 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166983.874795:0:30829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0xdd396665 (ffff945bc809ba00) 00010000:00010000:2.0:1762166983.874797:0:30829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1762166983.874800:0:30829:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1762166983.874854:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc8120e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+564:62309:x1847765450761344:12345-192.168.204.38@tcp:36:rm.0 Request processed in 1092us (1178us total) trans 4294992589 rc 0/0 00000100:00100000:2.0:1762166983.874861:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30925 00000100:00100000:3.0:1762166983.949988:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166983.950037:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166983.950069:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450761600 00000100:00100000:2.0:1762166983.950079:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450761600 00000100:00100000:3.0:1762166983.950085:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166983.950111:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450761856 00000100:00100000:0.0:1762166983.950120:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450761856 00000100:00100000:2.0:1762166983.950148:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 669 00000100:00100000:3.0:1762166983.950157:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166983.950162:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc8121500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+24:2417:x1847765450761600:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1762166983.950171:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450761728 00000100:00100000:0.0:1762166983.950176:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450761728 00000100:00100000:3.0:1762166983.950197:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 382 00000100:00100000:1.0:1762166983.950203:0:32221:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450761472 00000100:00100000:1.0:1762166983.950210:0:32221:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450761472 00000100:00100000:0.0:1762166983.950211:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 383 00000100:00100000:3.0:1762166983.950213:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc8120000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+42:2417:x1847765450761856:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:0.0:1762166983.950225:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4959180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+23:2417:x1847765450761728:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:2.0:1762166983.950239:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc8121500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+24:2417:x1847765450761600:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 81us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166983.950253:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 669 00000100:00100000:1.0:1762166983.950260:0:32221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 132 00000100:00100000:3.0:1762166983.950261:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc8120000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e1e11365-ba0b-405b-99c9-a704373217f2+42:2417:x1847765450761856:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 51us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166983.950275:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4959180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1e11365-ba0b-405b-99c9-a704373217f2+23:2417:x1847765450761728:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 50us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166983.950276:0:32221:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc34ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc359222-7391-43f5-989b-bf5867ae8fd6+9:2417:x1847765450761472:12345-192.168.204.38@tcp:400:kworker.0 00000100:00100000:3.0:1762166983.950282:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 382 00000100:00080000:2.0:1762166983.950283:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1762166983.950294:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 383 00000100:00100000:1.0:1762166983.950322:0:32221:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc34ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc359222-7391-43f5-989b-bf5867ae8fd6+9:2417:x1847765450761472:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 51us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166983.950330:0:32221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 132 00000001:02000400:0.0:1762166984.411544:0:35676:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-flr test 71: check mirror extend parent fid ==== 05:49:44 (1762166984) 00000100:00100000:0.0:1762166984.514596:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166984.514657:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450761984 00000100:00100000:2.0:1762166984.514667:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450761984 00000100:00100000:2.0:1762166984.514732:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30926 00000100:00100000:2.0:1762166984.514743:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc442c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+24:62497:x1847765450761984:12345-192.168.204.38@tcp:41:stat.0 00000004:00000024:2.0:1762166984.514800:0:12357:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 7839268864 avail 7376121856 00000100:00100000:2.0:1762166984.514857:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc442c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+24:62497:x1847765450761984:12345-192.168.204.38@tcp:41:stat.0 Request processed in 118us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166984.514862:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30926 00000100:00100000:2.0:1762166984.527426:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166984.527512:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450762112 00000100:00100000:1.0:1762166984.527521:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450762112 00000100:00100000:1.0:1762166984.527569:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30927 00000100:00100000:1.0:1762166984.527576:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+24:62501:x1847765450762112:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166984.527593:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166984.527608:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355b800/0x2f180c4effbad317 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eab4c expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.527656:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355ae00/0x2f180c4effbad31e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166984.527665:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355ae00/0x2f180c4effbad31e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166984.527674:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355ae00/0x2f180c4effbad31e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166984.527683:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355ba00/0x2f180c4effbad325 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4138fd7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166984.527688:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355ba00/0x2f180c4effbad325 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4138fd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166984.527691:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355ba00/0x2f180c4effbad325 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4138fd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166984.527732:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355ae00/0x2f180c4effbad31e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166984.527736:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355ae00/0x2f180c4effbad31e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166984.527740:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355ae00/0x2f180c4effbad31e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166984.527743:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355ae00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166984.527759:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355ae00/0x2f180c4effbad31e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166984.527765:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355ae00/0x2f180c4effbad31e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166984.527772:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945cd0738700) 00010000:00010000:1.0:1762166984.527775:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166984.527777:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355ae00/0x2f180c4effbad31e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166984.527782:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355ae00/0x2f180c4effbad31e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166984.527790:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355ba00/0x2f180c4effbad325 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4138fd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166984.527793:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355ba00/0x2f180c4effbad325 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4138fd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166984.527796:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355ba00/0x2f180c4effbad325 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4138fd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166984.527799:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355ba00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166984.527801:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355ba00/0x2f180c4effbad325 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4138fd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166984.527804:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355ba00/0x2f180c4effbad325 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4138fd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166984.527808:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4138fd7 (ffff945bc812e600) 00010000:00010000:1.0:1762166984.527809:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166984.527811:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355ba00/0x2f180c4effbad325 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4138fd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166984.527813:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355ba00/0x2f180c4effbad325 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4138fd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166984.527835:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355b800/0x2f180c4effbad317 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eab4c expref: 25 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.527841:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945cd0738700) 00010000:00010000:1.0:1762166984.527842:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166984.527844:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355b800/0x2f180c4effbad317 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eab4c expref: 25 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.527849:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355b800, rc 0) 00000100:00100000:1.0:1762166984.527893:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+24:62501:x1847765450762112:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 317us (478us total) trans 0 rc 301/301 00000100:00100000:1.0:1762166984.527898:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30927 00000100:00100000:3.0:1762166984.529348:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166984.529388:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450762368 00000100:00100000:1.0:1762166984.529393:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450762368 00000100:00100000:1.0:1762166984.529429:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30928 00000100:00100000:1.0:1762166984.529437:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc495ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+564:62501:x1847765450762368:12345-192.168.204.38@tcp:36:lfs.0 00000100:00100000:1.0:1762166984.529547:0:12357:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc6cd0380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:12357:1847765449801216:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1762166984.529592:0:12357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166984.529652:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449801216 00000100:00100000:1.0:1762166984.529655:0:12357:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc9a5e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166984.529662:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449801216 00000100:00100000:3.0:1762166984.529717:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1488 00000100:00100000:3.0:1762166984.529729:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6cd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:12357:x1847765449801216:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1762166984.529835:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6cd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:12357:x1847765449801216:12345-0@lo:1000:mdt00_004.0 Request processed in 109us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166984.529841:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1488 00000100:00100000:1.0:1762166984.529885:0:12357:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc6cd0380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:12357:1847765449801216:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1762166984.529919:0:12357:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc6cd0380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:12357:1847765449801344:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1762166984.529939:0:12357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166984.529956:0:12357:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc9a5e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166984.529973:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449801344 00000100:00100000:3.0:1762166984.529977:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449801344 00000100:00100000:3.0:1762166984.529996:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1489 00000100:00100000:3.0:1762166984.530000:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6cd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:12357:x1847765449801344:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1762166984.530083:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6cd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:12357:x1847765449801344:12345-0@lo:1000:mdt00_004.0 Request processed in 83us (142us total) trans 0 rc -2/-2 00000100:00100000:3.0:1762166984.530089:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1489 00000100:00100000:1.0:1762166984.530118:0:12357:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc6cd0380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:12357:1847765449801344:0@lo:1000:mdt00_004.0 00010000:00010000:1.0:1762166984.530150:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff945cc355be00/0x2f180c4effbad32c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166984.530158:0:12357:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff945cc355be00/0x2f180c4effbad32c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.530167:0:12357:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff945cc355be00/0x2f180c4effbad32c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 12357 initiator: MDT1 00000100:00100000:1.0:1762166984.530178:0:12357:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc6cd0380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:12357:1847765449801472:0@lo:101:mdt00_004.0 00000100:00100000:1.0:1762166984.530203:0:12357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166984.530224:0:12357:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7c77cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166984.530247:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449801472 00000100:00100000:3.0:1762166984.530252:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449801472 00000100:00100000:3.0:1762166984.530274:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1490 00000100:00100000:3.0:1762166984.530278:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6cd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:12357:x1847765449801472:12345-0@lo:101:mdt00_004.0 00010000:00010000:3.0:1762166984.530285:0:6500:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166984.530300:0:6500:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b62800/0x2f180c4effbad333 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f180c4effbad32c expref: -99 pid: 6500 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166984.530319:0:6500:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc6eee200/0x2f180c4effba4e17 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e7a53 expref: 23 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166984.530329:0:6500:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b62800/0x2f180c4effbad333 lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x2f180c4effbad32c expref: 8 pid: 6500 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166984.530351:0:6500:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc6eee200/0x2f180c4effba4e17 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e7a53 expref: 23 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166984.530360:0:6500:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc6eee200/0x2f180c4effba4e17 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e7a53 expref: 23 pid: 6495 timeout: 703 lvb_type: 0 00000100:00100000:3.0:1762166984.530369:0:6500:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc495a680 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:6500:1847765449801600:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166984.530427:0:6500:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a1b40 going to sleep for 11 seconds 00010000:00010000:1.0:1762166984.530573:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166984.531239:0:6500:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc495a680 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:6500:1847765449801600:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166984.531259:0:6500:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b62800/0x2f180c4effbad333 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x2f180c4effbad32c expref: 8 pid: 6500 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166984.531269:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945cd0738700) 00010000:00010000:3.0:1762166984.531271:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166984.531275:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b62800/0x2f180c4effbad333 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x2f180c4effbad32c expref: 8 pid: 6500 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166984.531283:0:6500:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4b62800, rc 0) 00000100:00100000:3.0:1762166984.531319:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6cd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:12357:x1847765449801472:12345-0@lo:101:mdt00_004.0 Request processed in 1040us (1116us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166984.531325:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1490 00000100:00100000:1.0:1762166984.531363:0:12357:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc6cd0380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:12357:1847765449801472:0@lo:101:mdt00_004.0 00010000:00010000:1.0:1762166984.531375:0:12357:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff945cc355be00/0x2f180c4effbad32c lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x2f180c4effbad333 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.531382:0:12357:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff945cc355be00/0x2f180c4effbad32c lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x2f180c4effbad333 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166984.531557:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166984.531614:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450762496 00000100:00100000:2.0:1762166984.531620:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450762496 00010000:00010000:2.0:1762166984.531649:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc6eee200/0x2f180c4effba4e17 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e7a53 expref: 24 pid: 6495 timeout: 703 lvb_type: 0 00000100:00100000:2.0:1762166984.531686:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9849 00000100:00100000:2.0:1762166984.531694:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc495a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765450762496:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166984.531704:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166984.531709:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc6eee200/0x2f180c4effba4e17 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e7a53 expref: 24 pid: 6495 timeout: 703 lvb_type: 0 00010000:00010000:2.0:1762166984.531719:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc6eee200/0x2f180c4effba4e17 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e7a53 expref: 24 pid: 6495 timeout: 703 lvb_type: 0 00010000:00010000:2.0:1762166984.531735:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc6eee200/0x2f180c4effba4e17 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e7a53 expref: 24 pid: 6495 timeout: 703 lvb_type: 0 00010000:00010000:2.0:1762166984.531761:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945cd0738700) 00010000:00010000:2.0:1762166984.531766:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b62800/0x2f180c4effbad333 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x2f180c4effbad32c expref: 7 pid: 6500 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166984.531772:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b62800/0x2f180c4effbad333 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x2f180c4effbad32c expref: 7 pid: 6500 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166984.531778:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b62800/0x2f180c4effbad333 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x2f180c4effbad32c expref: 7 pid: 6500 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166984.531798:0:6481:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b62800/0x2f180c4effbad333 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x2f180c4effbad32c expref: 7 pid: 6500 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166984.531806:0:6481:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000_UUID:6481:1847765449801728:0@lo:105: 00000100:00100000:2.0:1762166984.531833:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166984.531867:0:6481:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc4033300 going to sleep for 11 seconds 00000100:00100000:0.0:1762166984.531900:0:6478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449801728 00000100:00100000:0.0:1762166984.531907:0:6478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449801728 00000100:00100000:0.0:1762166984.531938:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1762166984.531944:0:6478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc3552d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:6481:x1847765449801728:12345-0@lo:105: 00010000:00010000:0.0:1762166984.531954:0:6478:0:(ldlm_lockd.c:2517:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff945cc355be00/0x2f180c4effbad32c lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x2f180c4effbad333 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166984.531961:0:6478:0:(ldlm_lockd.c:1967:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff945cc355be00/0x2f180c4effbad32c lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x2f180c4effbad333 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166984.531968:0:6478:0:(ldlm_lockd.c:2044:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff945cc355be00/0x2f180c4effbad32c lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x2f180c4effbad333 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166984.531973:0:6478:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff945cc355be00/0x2f180c4effbad32c lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x2f180c4effbad333 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166984.531977:0:6478:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff945cc355be00/0x2f180c4effbad32c lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x2f180c4effbad333 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166984.531982:0:6478:0:(ldlm_lockd.c:2072:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff945cc355be00/0x2f180c4effbad32c lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x2f180c4effbad333 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166984.532004:0:6478:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff945cc355be00) 00010000:00010000:1.0:1762166984.532022:0:12357:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff945cc355be00/0x2f180c4effbad32c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x2f180c4effbad333 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.532030:0:12357:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff945cc355be00/0x2f180c4effbad32c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x2f180c4effbad333 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1762166984.532047:0:12357:0:(osp_object.c:1389:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:0.0:1762166984.532053:0:6478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc3552d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:6481:x1847765449801728:12345-0@lo:105: Request processed in 105us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166984.532064:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00010000:1.0:1762166984.532079:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff945cc355a000/0x2f180c4effbad33a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x4138fd7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 12357 initiator: MDT0 00000100:00100000:2.0:1762166984.532087:0:6481:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000_UUID:6481:1847765449801728:0@lo:105: 00010000:00010000:1.0:1762166984.532088:0:12357:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff945cc355a000/0x2f180c4effbad33a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x4138fd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.532107:0:12357:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff945cc355a000/0x2f180c4effbad33a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x4138fd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 12357 initiator: MDT1 00000100:00100000:1.0:1762166984.532117:0:12357:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc6cd0380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:12357:1847765449801856:0@lo:101:mdt00_004.0 00010000:00010000:2.0:1762166984.532118:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166984.532159:0:12357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166984.532170:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc495a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765450762496:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 474us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166984.532179:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9849 00000100:00100000:1.0:1762166984.532199:0:12357:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7c77cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166984.532218:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449801856 00000100:00100000:0.0:1762166984.532224:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449801856 00000100:00100000:0.0:1762166984.532252:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1491 00000100:00100000:0.0:1762166984.532261:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6cd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:12357:x1847765449801856:12345-0@lo:101:mdt00_004.0 00010000:00010000:0.0:1762166984.532273:0:6500:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166984.532288:0:6500:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde800/0x2f180c4effbad341 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x4138fd7 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f180c4effbad33a expref: -99 pid: 6500 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166984.532305:0:6500:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde800/0x2f180c4effbad341 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4138fd7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x2f180c4effbad33a expref: 9 pid: 6500 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166984.532316:0:6500:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde800/0x2f180c4effbad341 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4138fd7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x2f180c4effbad33a expref: 9 pid: 6500 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166984.532323:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4138fd7 (ffff945bc2e87700) 00010000:00010000:0.0:1762166984.532325:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166984.532328:0:6500:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bde800, rc 0) 00000100:00100000:0.0:1762166984.532370:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6cd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:12357:x1847765449801856:12345-0@lo:101:mdt00_004.0 Request processed in 111us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166984.532380:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1491 00000100:00100000:1.0:1762166984.532395:0:12357:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc6cd0380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:12357:1847765449801856:0@lo:101:mdt00_004.0 00010000:00010000:1.0:1762166984.532409:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff945cc355a000/0x2f180c4effbad33a lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4138fd7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x2f180c4effbad341 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.532416:0:12357:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff945cc355a000/0x2f180c4effbad33a lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4138fd7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x2f180c4effbad341 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1762166984.532422:0:12357:0:(osp_object.c:1389:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:1.0:1762166984.532442:0:12357:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc6cd0380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:12357:1847765449801984:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1762166984.532463:0:12357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166984.532522:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449801984 00000100:00100000:0.0:1762166984.532526:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449801984 00000100:00100000:1.0:1762166984.532536:0:12357:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc9a5e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166984.532561:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1492 00000100:00100000:0.0:1762166984.532568:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6cd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:12357:x1847765449801984:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1762166984.532621:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6cd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:12357:x1847765449801984:12345-0@lo:1000:mdt00_004.0 Request processed in 54us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166984.532629:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1492 00000100:00100000:1.0:1762166984.532650:0:12357:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc6cd0380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:12357:1847765449801984:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1762166984.532679:0:12357:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc6cd0380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:12357:1847765449802112:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1762166984.532697:0:12357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166984.532712:0:12357:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc9a5e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166984.532727:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449802112 00000100:00100000:0.0:1762166984.532731:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449802112 00000100:00100000:0.0:1762166984.532761:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1493 00000100:00100000:0.0:1762166984.532766:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6cd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:12357:x1847765449802112:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1762166984.532836:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6cd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:12357:x1847765449802112:12345-0@lo:1000:mdt00_004.0 Request processed in 70us (137us total) trans 0 rc -2/-2 00000100:00100000:0.0:1762166984.532841:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1493 00000100:00100000:1.0:1762166984.532870:0:12357:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc6cd0380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:12357:1847765449802112:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1762166984.532927:0:12357:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc6cd0380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:12357:1847765449802240:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1762166984.532946:0:12357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166984.532960:0:12357:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc9a5e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166984.532988:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449802240 00000100:00100000:0.0:1762166984.532994:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449802240 00000100:00100000:0.0:1762166984.533020:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1494 00000100:00100000:0.0:1762166984.533027:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6cd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:12357:x1847765449802240:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1762166984.533080:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6cd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:12357:x1847765449802240:12345-0@lo:1000:mdt00_004.0 Request processed in 55us (133us total) trans 0 rc -2/-2 00000100:00100000:0.0:1762166984.533085:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1494 00000100:00100000:1.0:1762166984.533115:0:12357:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc6cd0380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:12357:1847765449802240:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1762166984.533155:0:12357:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc6cd0380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:12357:1847765449802368:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1762166984.533178:0:12357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166984.533199:0:12357:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc9a5e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166984.533216:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449802368 00000100:00100000:0.0:1762166984.533222:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449802368 00000100:00100000:0.0:1762166984.533249:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1495 00000100:00100000:0.0:1762166984.533257:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:12357:x1847765449802368:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1762166984.533317:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:12357:x1847765449802368:12345-0@lo:1000:mdt00_004.0 Request processed in 62us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166984.533327:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1495 00000100:00100000:1.0:1762166984.533341:0:12357:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc6cd0380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:12357:1847765449802368:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1762166984.533383:0:12357:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc6cd0380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:12357:1847765449802496:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1762166984.533409:0:12357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166984.533432:0:12357:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc9a5e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166984.533439:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449802496 00000100:00100000:0.0:1762166984.533444:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449802496 00000100:00100000:0.0:1762166984.533466:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1496 00000100:00100000:0.0:1762166984.533471:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6cd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:12357:x1847765449802496:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1762166984.533535:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6cd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:12357:x1847765449802496:12345-0@lo:1000:mdt00_004.0 Request processed in 64us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166984.533539:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1496 00000100:00100000:1.0:1762166984.533568:0:12357:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc6cd0380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:12357:1847765449802496:0@lo:1000:mdt00_004.0 00000040:00080000:1.0:1762166984.534232:0:12357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x2:0x0].66, 2152 off74776 00000040:00080000:1.0:1762166984.534298:0:12357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x2:0x0].13, 2352 off50120 00000004:00080000:1.0:1762166984.534305:0:12357:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff945cc9a5e0c0 with version 28 00000004:00080000:2.0:1762166984.534351:0:7425:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff945cc6268300 version 28 rpc_version 28 00000020:00100000:2.0:1762166984.534388:0:7425:0:(genops.c:2438:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1762166984.534398:0:7425:0:(client.c:796:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff945bc406c000 x1847765449802752/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1762166984.534414:0:7425:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406c000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7425:1847765449802752:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1762166984.534456:0:7425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166984.534513:0:7425:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc4033300 going to sleep for 11 seconds 00000100:00100000:0.0:1762166984.534516:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449802752 00000100:00100000:0.0:1762166984.534522:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449802752 00000100:00100000:0.0:1762166984.534552:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1497 00000100:00100000:0.0:1762166984.534560:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcce75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:7425:x1847765449802752:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1762166984.535639:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcce75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:7425:x1847765449802752:12345-0@lo:1000:osp_up0-1.0 Request processed in 1079us (1182us total) trans 8589935335 rc 0/0 00000100:00100000:0.0:1762166984.535645:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1497 00000100:00100000:2.0:1762166984.535721:0:7425:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406c000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7425:1847765449802752:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1762166984.535842:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbad348 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x61f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166984.535853:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbad348 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x61f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.535861:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbad348 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x61f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.535871:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a400/0x2f180c4effbad34f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166984.535875:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a400/0x2f180c4effbad34f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.535879:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a400/0x2f180c4effbad34f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.535901:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff945cc355ac00/0x2f180c4effbad356 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166984.535907:0:12357:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff945cc355ac00/0x2f180c4effbad356 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.535915:0:12357:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff945cc355ac00/0x2f180c4effbad356 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 12357 initiator: MDT1 00000100:00100000:1.0:1762166984.535934:0:12357:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc6cd0380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:12357:1847765449802880:0@lo:101:mdt00_004.0 00000100:00100000:1.0:1762166984.535972:0:12357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166984.536002:0:12357:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cce5219c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166984.536031:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449802880 00000100:00100000:0.0:1762166984.536037:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449802880 00000100:00100000:0.0:1762166984.536066:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1498 00000100:00100000:0.0:1762166984.536070:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6cd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:12357:x1847765449802880:12345-0@lo:101:mdt00_004.0 00010000:00010000:0.0:1762166984.536082:0:6500:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166984.536096:0:6500:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf200/0x2f180c4effbad35d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f180c4effbad356 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166984.536111:0:6500:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf200/0x2f180c4effbad35d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x2f180c4effbad356 expref: 11 pid: 6500 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166984.536118:0:6500:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf200/0x2f180c4effbad35d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x2f180c4effbad356 expref: 11 pid: 6500 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166984.536126:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff945bc2e87000) 00010000:00010000:0.0:1762166984.536129:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166984.536132:0:6500:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdf200, rc 0) 00000100:00100000:0.0:1762166984.536173:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6cd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:12357:x1847765449802880:12345-0@lo:101:mdt00_004.0 Request processed in 101us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166984.536179:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1498 00000100:00100000:1.0:1762166984.536222:0:12357:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc6cd0380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:12357:1847765449802880:0@lo:101:mdt00_004.0 00010000:00010000:1.0:1762166984.536236:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff945cc355ac00/0x2f180c4effbad356 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x2f180c4effbad35d expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.536247:0:12357:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff945cc355ac00/0x2f180c4effbad356 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x2f180c4effbad35d expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1762166984.536264:0:12357:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000045ea7898 reply state 00000000832c08a2 transno 4294992590 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a400/0x2f180c4effbad34f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.536275:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a400/0x2f180c4effbad34f lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.536281:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x6:0x0].0x0 (ffff945bc812e000) 00010000:00010000:1.0:1762166984.536283:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166984.536287:0:12357:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1762166984.536292:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff945cc355ac00/0x2f180c4effbad356 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x2f180c4effbad35d expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.536299:0:12357:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff945cc355ac00/0x2f180c4effbad356 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x2f180c4effbad35d expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1762166984.536307:0:12357:0:(osp_object.c:1389:osp_invalidate()) Invalidate osp_object [0x200000401:0x6:0x0] 00000004:00010000:1.0:1762166984.536312:0:12357:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000045ea7898 reply state 00000000832c08a2 transno 4294992590 ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbad348 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x61f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.536319:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbad348 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x61f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.536325:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x61f:0x0].0x0 (ffff945bc812e700) 00010000:00010000:1.0:1762166984.536327:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166984.536329:0:12357:0:(service.c:177:ptlrpc_save_lock()) nlocks 1 00000004:00200000:1.0:1762166984.536333:0:12357:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x61f:0x0]: returning size 4096 00000004:00080000:1.0:1762166984.536337:0:12357:0:(osp_object.c:1389:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1762166984.536343:0:12357:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff945cc355be00/0x2f180c4effbad32c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x2f180c4effbad333 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.536351:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff945cc355be00/0x2f180c4effbad32c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x2f180c4effbad333 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.536357:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff945cc355be00/0x2f180c4effbad32c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x2f180c4effbad333 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.536380:0:12357:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1762166984.536384:0:12357:0:(osp_object.c:1389:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1762166984.536389:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff945cc355a000/0x2f180c4effbad33a lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4138fd7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x2f180c4effbad341 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.536397:0:12357:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff945cc355a000/0x2f180c4effbad33a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4138fd7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x2f180c4effbad341 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166984.536416:0:6483:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1762166984.536427:0:6483:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff945cc355be00/0x2f180c4effbad32c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x2f180c4effbad333 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166984.536436:0:6483:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355be00 already unused, calling callback (ffffffffc18ef820) 00010000:00010000:0.0:1762166984.536441:0:6483:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff945cc355be00/0x2f180c4effbad32c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x2f180c4effbad333 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1762166984.536449:0:6483:0:(mdt_handler.c:3944:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff945cc355be00/0x2f180c4effbad32c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x2f180c4effbad333 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166984.536524:0:6483:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff945cc355be00/0x2f180c4effbad32c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x2f180c4effbad333 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166984.536532:0:6483:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1762166984.536542:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc495ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+566:62501:x1847765450762368:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 7101us (7195us total) trans 4294992590 rc 0/0 00000100:00100000:1.0:1762166984.536553:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30928 00010000:00010000:0.0:1762166984.536566:0:6483:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff945cc355be00/0x2f180c4effbad32c lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x2f180c4effbad333 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166984.536574:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff945cc355be00/0x2f180c4effbad32c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x2f180c4effbad333 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166984.536586:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166984.536589:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166984.536591:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166984.536601:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1762166984.536617:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc442f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449803008:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1762166984.536652:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166984.536687:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449803008 00000100:00100000:2.0:1762166984.536693:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449803008 00000100:00100000:2.0:1762166984.536741:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 908 00000100:00100000:2.0:1762166984.536761:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc442d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+11:3635:x1847765449803008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1762166984.536772:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166984.536788:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b62800/0x2f180c4effbad333 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x2f180c4effbad32c expref: 11 pid: 6500 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166984.536801:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945cd0738700) 00010000:00010000:2.0:1762166984.536804:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166984.536839:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc442d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+10:3635:x1847765449803008:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166984.536848:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 908 00000100:00100000:0.0:1762166984.536860:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc442f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449803008:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1762166984.543009:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166984.543105:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450762624 00000100:00100000:1.0:1762166984.543117:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450762624 00000100:00100000:1.0:1762166984.543185:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30929 00000100:00100000:1.0:1762166984.543193:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc495b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+23:62502:x1847765450762624:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166984.543210:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166984.543226:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355b800/0x2f180c4effbad364 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eab53 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.543272:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355ba00/0x2f180c4effbad36b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166984.543281:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355ba00/0x2f180c4effbad36b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166984.543288:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355ba00/0x2f180c4effbad36b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00000004:00200000:1.0:1762166984.543324:0:12357:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1762166984.543328:0:12357:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166984.543345:0:12357:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355ba00/0x2f180c4effbad36b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166984.543365:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355b800/0x2f180c4effbad364 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eab53 expref: 25 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.543381:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355ba00/0x2f180c4effbad36b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eab53 expref: 24 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.543388:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945cd0738700) 00010000:00010000:1.0:1762166984.543391:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1762166984.543396:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355ba00, rc 0) 00000100:00100000:1.0:1762166984.543462:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc495b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+24:62502:x1847765450762624:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 269us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166984.543469:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30929 00000100:00100000:2.0:1762166984.544813:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166984.544863:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450762752 00000100:00100000:1.0:1762166984.544871:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450762752 00000100:00100000:1.0:1762166984.544912:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30930 00000100:00100000:1.0:1762166984.544918:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc47b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+24:62502:x1847765450762752:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166984.544933:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166984.544947:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355ae00/0x2f180c4effbad372 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eab5a expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.544992:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355bc00/0x2f180c4effbad379 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166984.545001:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355bc00/0x2f180c4effbad379 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166984.545008:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355bc00/0x2f180c4effbad379 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166984.545016:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355b600/0x2f180c4effbad380 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4138fd7 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166984.545023:0:12357:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde800/0x2f180c4effbad341 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4138fd7 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x2f180c4effbad33a expref: 9 pid: 6500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.545029:0:12357:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355b600/0x2f180c4effbad380 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4138fd7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166984.545057:0:12357:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde800/0x2f180c4effbad341 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4138fd7 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x2f180c4effbad33a expref: 9 pid: 6500 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166984.545070:0:12357:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc6cd0380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12357:1847765449803136:0@lo:104: 00000100:00100000:1.0:1762166984.545112:0:12357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166984.545149:0:6478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449803136 00000100:00100000:0.0:1762166984.545155:0:6478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449803136 00000100:00100000:1.0:1762166984.545157:0:12357:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cce5219c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166984.545210:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1762166984.545221:0:6478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:12357:x1847765449803136:12345-0@lo:104: 00010000:00010000:0.0:1762166984.545233:0:6478:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff945cc355a000/0x2f180c4effbad33a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4138fd7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x2f180c4effbad341 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166984.545296:0:6478:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1762166984.545304:0:12357:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc6cd0380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12357:1847765449803136:0@lo:104: 00000100:00100000:0.0:1762166984.545305:0:6478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:12357:x1847765449803136:12345-0@lo:104: Request processed in 86us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166984.545316:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00010000:00010000:2.0:1762166984.545321:0:10256:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166984.545323:0:12357:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355b600/0x2f180c4effbad380 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4138fd7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166984.545331:0:10256:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff945cc355a000/0x2f180c4effbad33a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4138fd7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x2f180c4effbad341 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166984.545343:0:10256:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355a000 already unused, calling callback (ffffffffc18ef820) 00010000:00010000:2.0:1762166984.545348:0:10256:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff945cc355a000/0x2f180c4effbad33a lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4138fd7 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x2f180c4effbad341 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1762166984.545358:0:10256:0:(mdt_handler.c:3944:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff945cc355a000/0x2f180c4effbad33a lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4138fd7 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x2f180c4effbad341 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166984.545396:0:10256:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff945cc355a000/0x2f180c4effbad33a lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x4138fd7 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x2f180c4effbad341 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166984.545403:0:10256:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1762166984.545430:0:10256:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff945cc355a000/0x2f180c4effbad33a lrc: 1/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x4138fd7 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x2f180c4effbad341 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166984.545438:0:10256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff945cc355a000/0x2f180c4effbad33a lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x4138fd7 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x2f180c4effbad341 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166984.545453:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449803264:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1762166984.545458:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166984.545462:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166984.545463:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1762166984.545520:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166984.545556:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449803264 00000100:00100000:2.0:1762166984.545561:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449803264 00010000:00010000:2.0:1762166984.545583:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde800/0x2f180c4effbad341 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4138fd7 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x2f180c4effbad33a expref: 10 pid: 6500 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166984.545615:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9850 00000100:00100000:2.0:1762166984.545623:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4958380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+10:3633:x1847765449803264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1762166984.545634:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:3.0:1762166984.546848:0:32215:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935335 is committed 00010000:00010000:2.0:1762166984.546921:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde800/0x2f180c4effbad341 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x4138fd7 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x2f180c4effbad33a expref: 9 pid: 6500 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166984.546933:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4138fd7 (ffff945bc2e87700) 00010000:00010000:2.0:1762166984.546936:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355b600/0x2f180c4effbad380 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4138fd7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166984.546942:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355b600/0x2f180c4effbad380 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4138fd7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166984.546946:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355b600/0x2f180c4effbad380 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4138fd7 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166984.546965:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166984.546990:0:12357:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355b600/0x2f180c4effbad380 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4138fd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00000100:00100000:2.0:1762166984.546997:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4958380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+8:3633:x1847765449803264:12345-0@lo:103:ldlm_bl.0 Request processed in 1375us (1478us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166984.547005:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355b600/0x2f180c4effbad380 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4138fd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00000100:00100000:2.0:1762166984.547009:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9850 00000100:00100000:3.0:1762166984.547035:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449803264:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1762166984.547126:0:12357:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc6cd0380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12357:1847765449803392:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1762166984.547158:0:12357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166984.547183:0:12357:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011c73c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166984.547231:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449803392 00000100:00100000:0.0:1762166984.547237:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449803392 00000100:00100000:0.0:1762166984.547271:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1499 00000100:00100000:0.0:1762166984.547279:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6cd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:12357:x1847765449803392:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1762166984.547352:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6cd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:12357:x1847765449803392:12345-0@lo:1000:mdt00_004.0 Request processed in 74us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166984.547360:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1499 00000100:00100000:1.0:1762166984.547428:0:12357:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc6cd0380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12357:1847765449803392:0@lo:1000:mdt00_004.0 00010000:00010000:1.0:1762166984.547498:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355b000/0x2f180c4effbad387 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x61f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166984.547507:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355b000/0x2f180c4effbad387 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x61f:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166984.547514:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355b000/0x2f180c4effbad387 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x61f:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00000004:00010000:1.0:1762166984.547531:0:12357:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355b000/0x2f180c4effbad387 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x61f:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166984.547543:0:12357:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355bc00/0x2f180c4effbad379 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166984.547548:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355bc00/0x2f180c4effbad379 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166984.547553:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355bc00/0x2f180c4effbad379 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166984.547556:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355bc00/0x2f180c4effbad379 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166984.547559:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355bc00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166984.547562:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355bc00/0x2f180c4effbad379 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166984.547567:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355bc00/0x2f180c4effbad379 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166984.547571:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945cd0738700) 00010000:00010000:1.0:1762166984.547573:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166984.547576:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355bc00/0x2f180c4effbad379 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166984.547582:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355bc00/0x2f180c4effbad379 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166984.547589:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355b600/0x2f180c4effbad380 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4138fd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166984.547593:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355b600/0x2f180c4effbad380 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4138fd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166984.547596:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355b600/0x2f180c4effbad380 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4138fd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166984.547599:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355b600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166984.547601:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355b600/0x2f180c4effbad380 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4138fd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166984.547604:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355b600/0x2f180c4effbad380 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4138fd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166984.547607:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4138fd7 (ffff945bc2e87700) 00010000:00010000:1.0:1762166984.547608:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166984.547610:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355b600/0x2f180c4effbad380 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4138fd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166984.547613:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355b600/0x2f180c4effbad380 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4138fd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166984.547635:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355ae00/0x2f180c4effbad372 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eab5a expref: 26 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.547643:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355b000/0x2f180c4effbad387 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x61f:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eab5a expref: 25 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.547651:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x61f:0x0].0x0 (ffff945bc812e600) 00010000:00010000:1.0:1762166984.547653:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1762166984.547655:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355b000, rc 0) 00000100:00100000:1.0:1762166984.547695:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc47b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+25:62502:x1847765450762752:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2777us (2887us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166984.547701:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30930 00000100:00100000:3.0:1762166984.548861:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166984.548894:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450762880 00000100:00100000:1.0:1762166984.548899:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450762880 00000100:00100000:1.0:1762166984.548926:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30931 00000100:00100000:1.0:1762166984.548931:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc495b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+566:62502:x1847765450762880:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166984.548944:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166984.548956:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbad38e lrc: 2/0,0 mode: --/CR res: [0x240000404:0x61f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eab61 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.548987:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbad395 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x61f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166984.548994:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbad395 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x61f:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.548999:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbad395 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x61f:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00000004:00200000:1.0:1762166984.549081:0:12357:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x61f:0x0]: returning size 4096 00000004:00200000:1.0:1762166984.549086:0:12357:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1762166984.549112:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a800/0x2f180c4effbad38e lrc: 0/0,0 mode: --/CR res: [0x240000404:0x61f:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eab61 expref: 568 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.549131:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b200/0x2f180c4effbad395 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x61f:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eab61 expref: 567 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.549138:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x61f:0x0].0x0 (ffff945bc812e700) 00010000:00010000:1.0:1762166984.549141:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:1.0:1762166984.549144:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355b200, rc 0) 00000100:00100000:1.0:1762166984.549178:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc495b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+567:62502:x1847765450762880:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 246us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166984.549185:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30931 00000100:00100000:3.0:1762166984.549902:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166984.549937:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450763008 00000100:00100000:1.0:1762166984.549941:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450763008 00000100:00100000:1.0:1762166984.549965:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30932 00000100:00100000:1.0:1762166984.549970:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4959500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+567:62502:x1847765450763008:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166984.549977:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166984.549984:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbad39c lrc: 2/0,0 mode: --/CR res: [0x240000400:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eab68 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.550007:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbad3a3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166984.550013:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbad3a3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.550019:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbad3a3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00000004:00200000:1.0:1762166984.550036:0:12357:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000400:0x6:0x0]: returning size 4096 00000004:00200000:1.0:1762166984.550039:0:12357:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1762166984.550051:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355b800/0x2f180c4effbad39c lrc: 0/0,0 mode: --/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eab68 expref: 569 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.550060:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbad3a3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eab68 expref: 568 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.550064:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x6:0x0].0x0 (ffff945bc812e000) 00010000:00010000:1.0:1762166984.550067:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1762166984.550068:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355aa00, rc 0) 00000100:00100000:1.0:1762166984.550093:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4959500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+568:62502:x1847765450763008:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 122us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166984.550099:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30932 00000100:00100000:2.0:1762166984.550769:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166984.550803:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450763136 00000100:00100000:1.0:1762166984.550808:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450763136 00000100:00100000:1.0:1762166984.550838:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30933 00000100:00100000:1.0:1762166984.550845:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+25:62502:x1847765450763136:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166984.550855:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166984.550866:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355a200/0x2f180c4effbad3aa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eab6f expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.550896:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355be00/0x2f180c4effbad3b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166984.550908:0:12357:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf200/0x2f180c4effbad35d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x2f180c4effbad356 expref: 7 pid: 6500 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.550915:0:12357:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355be00/0x2f180c4effbad3b1 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166984.550944:0:12357:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf200/0x2f180c4effbad35d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x2f180c4effbad356 expref: 7 pid: 6500 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166984.550961:0:12357:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc6cd0380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12357:1847765449803520:0@lo:104: 00000100:00100000:1.0:1762166984.550999:0:12357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166984.551037:0:12357:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011c73c0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166984.551051:0:6478:0:(service.c:153:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1762166984.551063:0:6478:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449803520 00000100:00100000:0.0:1762166984.551067:0:6478:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449803520 00000100:00100000:0.0:1762166984.551096:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1762166984.551104:0:6478:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cd1af7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:12357:x1847765449803520:12345-0@lo:104: 00010000:00010000:0.0:1762166984.551116:0:6478:0:(ldlm_lockd.c:2505:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff945cc355ac00/0x2f180c4effbad356 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x2f180c4effbad35d expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166984.551180:0:6478:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1762166984.551188:0:6478:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cd1af7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:12357:x1847765449803520:12345-0@lo:104: Request processed in 84us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166984.551195:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00010000:00010000:2.0:1762166984.551204:0:10257:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1762166984.551204:0:12357:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc6cd0380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12357:1847765449803520:0@lo:104: 00010000:00010000:2.0:1762166984.551215:0:10257:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff945cc355ac00/0x2f180c4effbad356 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x2f180c4effbad35d expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166984.551225:0:10257:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355ac00 already unused, calling callback (ffffffffc18ef820) 00010000:00010000:1.0:1762166984.551228:0:12357:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355be00/0x2f180c4effbad3b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166984.551231:0:10257:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff945cc355ac00/0x2f180c4effbad356 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x2f180c4effbad35d expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1762166984.551246:0:10257:0:(mdt_handler.c:3944:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff945cc355ac00/0x2f180c4effbad356 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x2f180c4effbad35d expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166984.551272:0:10257:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff945cc355ac00/0x2f180c4effbad356 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x2f180c4effbad35d expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166984.551279:0:10257:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1762166984.551306:0:10257:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff945cc355ac00/0x2f180c4effbad356 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x2f180c4effbad35d expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166984.551313:0:10257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff945cc355ac00/0x2f180c4effbad356 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x2f180c4effbad35d expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166984.551323:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449803648:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1762166984.551331:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166984.551335:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166984.551338:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166984.551367:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166984.551411:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449803648 00000100:00100000:2.0:1762166984.551416:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449803648 00010000:00010000:2.0:1762166984.551442:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf200/0x2f180c4effbad35d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x2f180c4effbad356 expref: 8 pid: 6500 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166984.551467:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9851 00000100:00100000:2.0:1762166984.551474:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc442f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+8:3634:x1847765449803648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1762166984.551502:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166984.551764:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf200/0x2f180c4effbad35d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x2f180c4effbad356 expref: 8 pid: 6500 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166984.551776:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff945bc2e87000) 00010000:00010000:2.0:1762166984.551779:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355be00/0x2f180c4effbad3b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166984.551786:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355be00/0x2f180c4effbad3b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166984.551791:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355be00/0x2f180c4effbad3b1 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166984.551813:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166984.551834:0:12357:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355be00/0x2f180c4effbad3b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166984.551840:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355be00/0x2f180c4effbad3b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00000100:00100000:2.0:1762166984.551847:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc442f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+7:3634:x1847765449803648:12345-0@lo:103:ldlm_bl.0 Request processed in 374us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166984.551855:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9851 00000004:00200000:1.0:1762166984.551869:0:12357:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x6:0x0]: returning size 4096 00000004:00200000:1.0:1762166984.551873:0:12357:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000100:00100000:0.0:1762166984.551881:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449803648:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1762166984.551895:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355a200/0x2f180c4effbad3aa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eab6f expref: 27 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.551906:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355be00/0x2f180c4effbad3b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eab6f expref: 26 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.551911:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff945bc2e87000) 00010000:00010000:1.0:1762166984.551913:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1762166984.551914:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355be00, rc 0) 00000100:00100000:1.0:1762166984.551942:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+26:62502:x1847765450763136:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1098us (1175us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166984.551946:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30933 00000100:00100000:3.0:1762166984.552907:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166984.552941:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450763392 00000100:00100000:1.0:1762166984.552946:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450763392 00000100:00100000:1.0:1762166984.552971:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30934 00000100:00100000:1.0:1762166984.552976:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4958a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+568:62502:x1847765450763392:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166984.552986:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166984.552987:0:12357:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1762166984.552998:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355aa00/0x2f180c4effbad3a3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eab68 expref: 568 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.553009:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x6:0x0].0x0 (ffff945bc812e000) 00010000:00010000:1.0:1762166984.553012:0:12357:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166984.553021:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eeaa00/0x2f180c4effbad3b8 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eab76 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.553111:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847f600/0x2f180c4effbad3bf lrc: 3/0,1 mode: --/CW res: [0x240000400:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166984.553118:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847f600/0x2f180c4effbad3bf lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.553124:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847f600/0x2f180c4effbad3bf lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.553255:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847e000/0x2f180c4effbad3c6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166984.553273:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847e000/0x2f180c4effbad3c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.553282:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847e000/0x2f180c4effbad3c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00000100:00100000:1.0:1762166984.553413:0:12357:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc6cd0380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:12357:1847765449803776:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1762166984.553525:0:12357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166984.553555:0:12357:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011c7a80 going to sleep for 11 seconds 00000100:00100000:0.0:1762166984.553574:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449803776 00000100:00100000:0.0:1762166984.553580:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449803776 00000100:00100000:0.0:1762166984.553612:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1500 00000100:00100000:0.0:1762166984.553621:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:12357:x1847765449803776:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1762166984.553692:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:12357:x1847765449803776:12345-0@lo:1000:mdt00_004.0 Request processed in 73us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166984.553700:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1500 00000100:00100000:1.0:1762166984.553724:0:12357:0:(client.c:3071:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 8589935335 gen 2 00000004:00080000:1.0:1762166984.553729:0:12357:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 8589935335 committed transno 8589935335 00000100:00100000:1.0:1762166984.553765:0:12357:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc6cd0380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:12357:1847765449803776:0@lo:1000:mdt00_004.0 00010000:00010000:1.0:1762166984.554030:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945d02174400/0x2f180c4effbad3cd lrc: 3/1,0 mode: --/PR res: [0x240000404:0x620:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166984.554037:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945d02174400/0x2f180c4effbad3cd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x620:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.554042:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945d02174400/0x2f180c4effbad3cd lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x620:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00000004:00200000:1.0:1762166984.554050:0:12357:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x620:0x0]: returning size 0 00010000:00010000:1.0:1762166984.554067:0:12357:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847f600/0x2f180c4effbad3bf lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.554072:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847f600/0x2f180c4effbad3bf lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.554075:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847f600/0x2f180c4effbad3bf lrc: 3/0,0 mode: CW/CW res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.554079:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847f600/0x2f180c4effbad3bf lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.554082:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc847f600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166984.554085:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847f600/0x2f180c4effbad3bf lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.554089:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847f600/0x2f180c4effbad3bf lrc: 5/0,0 mode: CW/CW res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.554099:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x6:0x0].0x0 (ffff945bc812e000) 00010000:00010000:1.0:1762166984.554101:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166984.554104:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847f600/0x2f180c4effbad3bf lrc: 3/0,0 mode: --/CW res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.554108:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847f600/0x2f180c4effbad3bf lrc: 0/0,0 mode: --/CW res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00000004:00010000:1.0:1762166984.554116:0:12357:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000011473184 reply state 0000000016560ca1 transno 4294992591 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847e000/0x2f180c4effbad3c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.554122:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847e000/0x2f180c4effbad3c6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.554126:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x6:0x0].0x10cd7725 (ffff945bc812e100) 00010000:00010000:1.0:1762166984.554127:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166984.554129:0:12357:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1762166984.554151:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eeaa00/0x2f180c4effbad3b8 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eab76 expref: 570 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.554160:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945d02174400/0x2f180c4effbad3cd lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x620:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eab76 expref: 569 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.554165:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x620:0x0].0x0 (ffff945bc812e900) 00010000:00010000:1.0:1762166984.554166:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166984.554168:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945d02174400, rc 0) 00000100:00100000:1.0:1762166984.554216:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4958a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+570:62502:x1847765450763392:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1238us (1309us total) trans 4294992591 rc 0/0 00000100:00100000:1.0:1762166984.554224:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30934 00000100:00100000:3.0:1762166984.555507:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166984.555563:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450763648 00000100:00100000:1.0:1762166984.555572:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450763648 00000100:00100000:1.0:1762166984.555617:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30935 00000100:00100000:1.0:1762166984.555625:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4959880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+570:62502:x1847765450763648:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166984.555645:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166984.555658:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945d02174e00/0x2f180c4effbad3db lrc: 2/0,0 mode: --/CR res: [0x240000404:0x620:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eab7d expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.555726:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fac00/0x2f180c4effbad3e2 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x620:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166984.555737:0:12357:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945d02174400/0x2f180c4effbad3cd lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x620:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eab76 expref: 571 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.555759:0:12357:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fac00/0x2f180c4effbad3e2 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x620:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.555782:0:12357:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945d02174400/0x2f180c4effbad3cd lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x620:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eab76 expref: 571 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.555795:0:12357:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945d02174400/0x2f180c4effbad3cd lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x620:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eab76 expref: 571 pid: 12357 timeout: 703 lvb_type: 0 00000100:00100000:1.0:1762166984.555806:0:12357:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc6cd0380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12357:1847765449803904:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166984.555872:0:12357:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011c76c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166984.556665:0:12357:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc6cd0380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12357:1847765449803904:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166984.556675:0:12357:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fac00/0x2f180c4effbad3e2 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x620:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00000100:00100000:3.0:1762166984.556778:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166984.556834:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450763776 00000100:00100000:2.0:1762166984.556840:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450763776 00010000:00010000:2.0:1762166984.556863:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945d02174400/0x2f180c4effbad3cd lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x620:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eab76 expref: 572 pid: 12357 timeout: 703 lvb_type: 0 00000100:00100000:2.0:1762166984.556891:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9852 00000100:00100000:2.0:1762166984.556896:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4958e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+572:2418:x1847765450763776:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166984.556904:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166984.556908:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945d02174400/0x2f180c4effbad3cd lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x620:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eab76 expref: 572 pid: 12357 timeout: 703 lvb_type: 0 00010000:00010000:2.0:1762166984.556918:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945d02174400/0x2f180c4effbad3cd lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x620:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eab76 expref: 572 pid: 12357 timeout: 703 lvb_type: 0 00010000:00010000:2.0:1762166984.556931:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945d02174400/0x2f180c4effbad3cd lrc: 0/0,0 mode: --/PR res: [0x240000404:0x620:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eab76 expref: 572 pid: 12357 timeout: 703 lvb_type: 0 00010000:00010000:2.0:1762166984.556941:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x620:0x0].0x0 (ffff945bc812e900) 00010000:00010000:2.0:1762166984.556943:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fac00/0x2f180c4effbad3e2 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x620:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00010000:00010000:2.0:1762166984.556948:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fac00/0x2f180c4effbad3e2 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x620:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12357 initiator: MDT1 00010000:00010000:2.0:1762166984.556952:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fac00/0x2f180c4effbad3e2 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x620:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12357 initiator: MDT1 00010000:00010000:2.0:1762166984.556966:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166984.556984:0:12357:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fac00/0x2f180c4effbad3e2 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x620:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00000100:00100000:2.0:1762166984.556993:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4958e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+571:2418:x1847765450763776:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 95us (216us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166984.556995:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fac00/0x2f180c4effbad3e2 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x620:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00000100:00100000:2.0:1762166984.557001:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9852 00000004:00200000:1.0:1762166984.557014:0:12357:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x620:0x0]: returning size 0 00000004:00080000:1.0:1762166984.557143:0:12357:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0xa92:0x0], index 1: 0 00000100:00100000:0.0:1762166984.557159:0:9996:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc442ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9996:1847765449804032:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1762166984.557209:0:9996:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1762166984.557224:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fac00/0x2f180c4effbad3e2 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x620:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.557236:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fac00/0x2f180c4effbad3e2 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x620:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.557243:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fac00/0x2f180c4effbad3e2 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x620:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00000100:00100000:0.0:1762166984.557246:0:9996:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7cb40c0 going to sleep for 11 seconds 00010000:00010000:1.0:1762166984.557253:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcc8fac00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166984.557260:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fac00/0x2f180c4effbad3e2 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x620:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.557267:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fac00/0x2f180c4effbad3e2 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x620:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT1 00000100:00100000:2.0:1762166984.557274:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449804032 00010000:00010000:1.0:1762166984.557278:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x620:0x0].0x0 (ffff945bc812e900) 00000100:00100000:2.0:1762166984.557281:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449804032 00010000:00010000:1.0:1762166984.557283:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166984.557288:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fac00/0x2f180c4effbad3e2 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x620:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.557294:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fac00/0x2f180c4effbad3e2 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x620:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.557328:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945d02174e00/0x2f180c4effbad3db lrc: 1/0,0 mode: --/CR res: [0x240000404:0x620:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eab7d expref: 571 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.557344:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x620:0x0].0x0 (ffff945bc812e900) 00010000:00010000:1.0:1762166984.557350:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00000100:00080000:0.0:1762166984.557351:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1762166984.557361:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19502 00010000:00010000:1.0:1762166984.557361:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945d02174e00/0x2f180c4effbad3db lrc: 0/0,0 mode: --/CR res: [0x240000404:0x620:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eab7d expref: 571 pid: 12357 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166984.557389:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc442d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:9996:x1847765449804032:12345-0@lo:5:osp-pre-1-1.0 00010000:00010000:1.0:1762166984.557392:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945d02174e00, rc 0) 00002000:00080000:2.0:1762166984.557428:0:9168:0:(ofd_dev.c:1745:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2722 00000100:00100000:1.0:1762166984.557434:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4959880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+570:62502:x1847765450763648:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1808us (1933us total) trans 4294992592 rc 301/301 00000100:00100000:1.0:1762166984.557439:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30935 00000100:00100000:3.0:1762166984.558345:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166984.558410:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450764032 00000100:00100000:0.0:1762166984.558418:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450764032 00000100:00100000:0.0:1762166984.558475:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 12007 00000100:00100000:0.0:1762166984.558502:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4958700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+570:62502:x1847765450764032:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166984.558773:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4958700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+571:62502:x1847765450764032:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 271us (429us total) trans 4294992593 rc 0/0 00000100:00100000:0.0:1762166984.558782:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 12007 00000100:00100000:2.0:1762166984.559229:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc442d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:9996:x1847765449804032:12345-0@lo:5:osp-pre-1-1.0 Request processed in 1854us (2016us total) trans 17179876791 rc 0/0 00000100:00100000:2.0:1762166984.559238:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19502 00000100:00100000:0.0:1762166984.559280:0:9996:0:(client.c:3071:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 17179876757 gen 2 00000004:00080000:0.0:1762166984.559286:0:9996:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 17179876757 committed transno 17179876757 00000100:00100000:0.0:1762166984.559306:0:9996:0:(client.c:3115:ptlrpc_free_committed()) @@@ stopping search req@ffff945bc442ca80 x1847765449804032/t17179876791(17179876791) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1762167000 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1762166984.559316:0:9996:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc442ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9996:1847765449804032:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1762166984.559326:0:9996:0:(osp_precreate.c:701:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0xa92:0x0]-[0x2c0000400:0xac1:0x0] 00000100:00100000:0.0:1762166984.559522:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166984.559557:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450764160 00000100:00100000:1.0:1762166984.559563:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450764160 00000100:00100000:1.0:1762166984.559608:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30936 00000100:00100000:1.0:1762166984.559618:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc442ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+571:62502:x1847765450764160:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166984.559634:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166984.559650:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fba00/0x2f180c4effbad3f0 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x620:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eab84 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.559685:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fba00/0x2f180c4effbad3f0 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x620:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eab84 expref: 572 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.559697:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fba00/0x2f180c4effbad3f0 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x620:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eab84 expref: 572 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.559713:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x620:0x0].0x0 (ffff945bc812e300) 00010000:00010000:1.0:1762166984.559716:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166984.559718:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcc8fba00, rc 0) 00000100:00100000:1.0:1762166984.559765:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc442ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+572:62502:x1847765450764160:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 149us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166984.559773:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30936 00000100:00100000:3.0:1762166984.560560:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166984.560616:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450764416 00000100:00100000:0.0:1762166984.560622:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450764416 00000100:00100000:0.0:1762166984.560653:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 12008 00000100:00100000:0.0:1762166984.560659:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc495a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+572:62502:x1847765450764416:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166984.560809:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc495a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+573:62502:x1847765450764416:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 148us (251us total) trans 4294992594 rc 0/0 00000100:00100000:0.0:1762166984.560816:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 12008 00000100:00100000:3.0:1762166984.566270:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166984.566331:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450764672 00000100:00100000:1.0:1762166984.566343:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450764672 00000100:00100000:1.0:1762166984.566398:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30937 00000100:00100000:1.0:1762166984.566407:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4959c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+573:62503:x1847765450764672:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166984.566430:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166984.566447:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fac00/0x2f180c4effbad3f7 lrc: 2/0,0 mode: --/CR res: [0x240000400:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eab8b expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.566529:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa400/0x2f180c4effbad3fe lrc: 3/1,0 mode: --/CR res: [0x240000400:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166984.566541:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa400/0x2f180c4effbad3fe lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.566551:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa400/0x2f180c4effbad3fe lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.566561:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fb600/0x2f180c4effbad405 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166984.566567:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fb600/0x2f180c4effbad405 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.566573:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fb600/0x2f180c4effbad405 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.566661:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa200/0x2f180c4effbad40c lrc: 3/1,0 mode: --/PR res: [0x240000404:0x620:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166984.566669:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa200/0x2f180c4effbad40c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x620:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.566676:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa200/0x2f180c4effbad40c lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x620:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00000004:00200000:1.0:1762166984.566685:0:12357:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x620:0x0]: returning size 0 00010000:00010000:1.0:1762166984.566744:0:12357:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa400/0x2f180c4effbad3fe lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.566776:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa400/0x2f180c4effbad3fe lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.566782:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa400/0x2f180c4effbad3fe lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.566792:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa400/0x2f180c4effbad3fe lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.566798:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcc8fa400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166984.566802:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa400/0x2f180c4effbad3fe lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.566809:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa400/0x2f180c4effbad3fe lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.566827:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x6:0x0].0x0 (ffff945bc812e000) 00010000:00010000:1.0:1762166984.566830:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166984.566834:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa400/0x2f180c4effbad3fe lrc: 3/0,0 mode: --/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.566840:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa400/0x2f180c4effbad3fe lrc: 0/0,0 mode: --/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.566850:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fb600/0x2f180c4effbad405 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.566860:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fb600/0x2f180c4effbad405 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.566866:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fb600/0x2f180c4effbad405 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.566871:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bcc8fb600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166984.566874:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fb600/0x2f180c4effbad405 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.566879:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fb600/0x2f180c4effbad405 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.566885:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x6:0x0].0x10cd7725 (ffff945bc812e100) 00010000:00010000:1.0:1762166984.566887:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166984.566890:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fb600/0x2f180c4effbad405 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.566895:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fb600/0x2f180c4effbad405 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.566922:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fac00/0x2f180c4effbad3f7 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eab8b expref: 576 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.566933:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa200/0x2f180c4effbad40c lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x620:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eab8b expref: 575 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.566940:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x620:0x0].0x0 (ffff945bc812e300) 00010000:00010000:1.0:1762166984.566942:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166984.566944:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcc8fa200, rc 0) 00000100:00100000:1.0:1762166984.566996:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4959c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+575:62503:x1847765450764672:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 590us (736us total) trans 4294992595 rc 0/0 00000100:00100000:1.0:1762166984.567005:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30937 00000100:00100000:2.0:1762166984.568201:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166984.568248:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450764928 00000100:00100000:1.0:1762166984.568255:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450764928 00000100:00100000:1.0:1762166984.568290:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30938 00000100:00100000:1.0:1762166984.568299:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+575:62503:x1847765450764928:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166984.568310:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166984.568321:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fb800/0x2f180c4effbad41a lrc: 2/0,0 mode: --/CW res: [0x240000400:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eab92 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.568701:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa000/0x2f180c4effbad421 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x621:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166984.568712:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa000/0x2f180c4effbad421 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x621:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.568721:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa000/0x2f180c4effbad421 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x621:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00000004:00200000:1.0:1762166984.568728:0:12357:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x621:0x0]: returning size 0 00010000:00010000:1.0:1762166984.568777:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fb800/0x2f180c4effbad41a lrc: 0/0,0 mode: --/CW res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eab92 expref: 578 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.568791:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa000/0x2f180c4effbad421 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x621:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eab92 expref: 577 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.568799:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x621:0x0].0x0 (ffff945bc812e900) 00010000:00010000:1.0:1762166984.568802:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166984.568804:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bcc8fa000, rc 0) 00000100:00100000:1.0:1762166984.568848:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+577:62503:x1847765450764928:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 550us (649us total) trans 4294992596 rc 0/0 00000100:00100000:1.0:1762166984.568856:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30938 00000100:00100000:3.0:1762166984.569823:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166984.569883:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450765184 00000100:00100000:1.0:1762166984.569893:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450765184 00000100:00100000:1.0:1762166984.569947:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30939 00000100:00100000:1.0:1762166984.569959:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4958000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+577:62503:x1847765450765184:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166984.569978:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166984.569992:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945d02174400/0x2f180c4effbad42f lrc: 2/0,0 mode: --/CR res: [0x240000404:0x621:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eab99 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.570068:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945d02174e00/0x2f180c4effbad436 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x621:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166984.570078:0:12357:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa000/0x2f180c4effbad421 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x621:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eab92 expref: 578 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.570084:0:12357:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945d02174e00/0x2f180c4effbad436 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x621:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.570115:0:12357:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa000/0x2f180c4effbad421 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x621:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eab92 expref: 578 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.570126:0:12357:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa000/0x2f180c4effbad421 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x621:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eab92 expref: 578 pid: 12357 timeout: 703 lvb_type: 0 00000100:00100000:1.0:1762166984.570138:0:12357:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc6cd0380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12357:1847765449804160:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166984.570221:0:12357:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011c76c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166984.570818:0:12357:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc6cd0380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12357:1847765449804160:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166984.570834:0:12357:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945d02174e00/0x2f180c4effbad436 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x621:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00000100:00100000:3.0:1762166984.571093:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166984.571146:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450765312 00000100:00100000:2.0:1762166984.571152:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450765312 00010000:00010000:2.0:1762166984.571176:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa000/0x2f180c4effbad421 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x621:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eab92 expref: 579 pid: 12357 timeout: 703 lvb_type: 0 00000100:00100000:2.0:1762166984.571201:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9853 00000100:00100000:2.0:1762166984.571207:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf9d1f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+579:2418:x1847765450765312:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166984.571215:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166984.571219:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa000/0x2f180c4effbad421 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x621:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eab92 expref: 579 pid: 12357 timeout: 703 lvb_type: 0 00010000:00010000:2.0:1762166984.571229:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa000/0x2f180c4effbad421 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x621:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eab92 expref: 579 pid: 12357 timeout: 703 lvb_type: 0 00010000:00010000:2.0:1762166984.571245:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa000/0x2f180c4effbad421 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x621:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eab92 expref: 579 pid: 12357 timeout: 703 lvb_type: 0 00010000:00010000:2.0:1762166984.571256:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x621:0x0].0x0 (ffff945bc812e900) 00010000:00010000:2.0:1762166984.571259:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945d02174e00/0x2f180c4effbad436 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x621:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00010000:00010000:2.0:1762166984.571267:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945d02174e00/0x2f180c4effbad436 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x621:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12357 initiator: MDT1 00010000:00010000:2.0:1762166984.571271:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945d02174e00/0x2f180c4effbad436 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x621:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12357 initiator: MDT1 00010000:00010000:2.0:1762166984.571287:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166984.571308:0:12357:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945d02174e00/0x2f180c4effbad436 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x621:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00000100:00100000:2.0:1762166984.571317:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf9d1f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+578:2418:x1847765450765312:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 107us (223us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166984.571321:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945d02174e00/0x2f180c4effbad436 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x621:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00000100:00100000:2.0:1762166984.571330:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9853 00000004:00200000:1.0:1762166984.571347:0:12357:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x621:0x0]: returning size 0 00000004:00080000:1.0:1762166984.571520:0:12357:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0xa93:0x0], index 0: 0 00010000:00010000:1.0:1762166984.571596:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945d02174e00/0x2f180c4effbad436 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x621:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.571601:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945d02174e00/0x2f180c4effbad436 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x621:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.571606:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945d02174e00/0x2f180c4effbad436 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x621:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.571609:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945d02174e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166984.571613:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945d02174e00/0x2f180c4effbad436 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x621:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.571618:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945d02174e00/0x2f180c4effbad436 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x621:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.571624:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x621:0x0].0x0 (ffff945bc812e900) 00010000:00010000:1.0:1762166984.571626:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166984.571628:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945d02174e00/0x2f180c4effbad436 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x621:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.571632:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945d02174e00/0x2f180c4effbad436 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x621:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.571658:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945d02174400/0x2f180c4effbad42f lrc: 1/0,0 mode: --/CR res: [0x240000404:0x621:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eab99 expref: 578 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.571664:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x621:0x0].0x0 (ffff945bc812e900) 00010000:00010000:1.0:1762166984.571666:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1762166984.571669:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945d02174400/0x2f180c4effbad42f lrc: 0/0,0 mode: --/CR res: [0x240000404:0x621:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eab99 expref: 578 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.571679:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945d02174400, rc 0) 00000100:00100000:1.0:1762166984.571706:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4958000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+577:62503:x1847765450765184:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 1751us (1887us total) trans 4294992597 rc 301/301 00000100:00100000:1.0:1762166984.571711:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30939 00000100:00100000:3.0:1762166984.572392:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166984.572445:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450765568 00000100:00100000:0.0:1762166984.572456:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450765568 00000100:00100000:0.0:1762166984.572535:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 12009 00000100:00100000:0.0:1762166984.572552:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc495bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+577:62503:x1847765450765568:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166984.572732:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc495bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+578:62503:x1847765450765568:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 189us (342us total) trans 4294992598 rc 0/0 00000100:00100000:0.0:1762166984.572738:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 12009 00000100:00100000:3.0:1762166984.573540:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166984.573573:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450765696 00000100:00100000:2.0:1762166984.573579:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450765696 00000100:00100000:2.0:1762166984.573626:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19503 00000100:00100000:2.0:1762166984.573636:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc495aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+42:2418:x1847765450765696:12345-192.168.204.38@tcp:101:lfs.0 00000100:00080000:0.0:1762166984.573638:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1762166984.573653:0:9168:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166984.573673:0:9168:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cf3cb4200/0x2f180c4effbad444 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa92:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eaba0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166984.573696:0:9168:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0xa92:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1762166984.573710:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166984.573712:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166984.573718:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cf3cb4200/0x2f180c4effbad444 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaba0 expref: 43 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166984.573729:0:9168:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945cf3cb4200/0x2f180c4effbad444 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaba0 expref: 43 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166984.573736:0:9168:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cb4200, rc 0) 00000100:00100000:2.0:1762166984.573777:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc495aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+43:2418:x1847765450765696:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 143us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166984.573783:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19503 00000100:00100000:2.0:1762166984.574722:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166984.574765:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450765824 00000100:00100000:1.0:1762166984.574770:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450765824 00000100:00100000:1.0:1762166984.574797:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30940 00000100:00100000:1.0:1762166984.574802:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+578:62503:x1847765450765824:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166984.574814:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166984.574828:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eeaa00/0x2f180c4effbad44b lrc: 2/0,0 mode: --/CR res: [0x240000404:0x621:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eaba7 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.574885:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847f600/0x2f180c4effbad452 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x621:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166984.574894:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847f600/0x2f180c4effbad452 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x621:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.574900:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847f600/0x2f180c4effbad452 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x621:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00000004:00200000:1.0:1762166984.574923:0:12357:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x621:0x0]: returning size 0 00000004:00200000:1.0:1762166984.574927:0:12357:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166984.574938:0:12357:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847f600/0x2f180c4effbad452 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x621:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.574953:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc6eeaa00/0x2f180c4effbad44b lrc: 0/0,0 mode: --/CR res: [0x240000404:0x621:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaba7 expref: 580 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.574963:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847f600/0x2f180c4effbad452 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x621:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaba7 expref: 579 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.574968:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x621:0x0].0x0 (ffff945bc812ea00) 00010000:00010000:1.0:1762166984.574970:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1762166984.574972:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc847f600, rc 0) 00000100:00100000:1.0:1762166984.574999:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+579:62503:x1847765450765824:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 197us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166984.575004:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30940 00000100:00100000:3.0:1762166984.575817:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166984.575860:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450765952 00000100:00100000:2.0:1762166984.575865:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450765952 00000100:00100000:2.0:1762166984.575919:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19504 00000100:00100000:2.0:1762166984.575929:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc495b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765450765952:12345-192.168.204.38@tcp:101:lfs.0 00000100:00080000:0.0:1762166984.575938:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1762166984.575941:0:9168:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166984.575959:0:9168:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945cf3cb4e00/0x2f180c4effbad459 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa93:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eabae expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1762166984.575977:0:9168:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0xa93:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1762166984.575988:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166984.575990:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166984.575995:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945cf3cb4e00/0x2f180c4effbad459 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eabae expref: 24 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166984.576007:0:9168:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945cf3cb4e00/0x2f180c4effbad459 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eabae expref: 24 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1762166984.576016:0:9168:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cb4e00, rc 0) 00000100:00100000:2.0:1762166984.576051:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc495b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+24:2418:x1847765450765952:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 126us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166984.576058:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19504 00000100:00100000:3.0:1762166984.576958:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166984.576997:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450766208 00000100:00100000:1.0:1762166984.577003:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450766208 00000100:00100000:1.0:1762166984.577040:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30941 00000100:00100000:1.0:1762166984.577050:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4959f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+579:62503:x1847765450766208:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166984.577064:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166984.577079:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbad460 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x620:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eabb5 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.577177:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbad467 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x620:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166984.577190:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbad467 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x620:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.577199:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbad467 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x620:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00000004:00200000:1.0:1762166984.577209:0:12357:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x620:0x0]: returning size 0 00010000:00010000:1.0:1762166984.577298:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbad460 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x620:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eabb5 expref: 582 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.577315:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbad467 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x620:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eabb5 expref: 581 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.577322:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x620:0x0].0x0 (ffff945bc812e300) 00010000:00010000:1.0:1762166984.577325:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762166984.577327:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa8200, rc 0) 00000100:00100000:1.0:1762166984.577367:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4959f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+581:62503:x1847765450766208:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 320us (410us total) trans 4294992599 rc 0/0 00000100:00100000:1.0:1762166984.577375:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30941 00000100:00100000:0.0:1762166984.578847:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166984.578901:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450766336 00000100:00100000:2.0:1762166984.578909:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450766336 00000100:00100000:2.0:1762166984.578958:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19505 00000100:00100000:2.0:1762166984.578965:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc442c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+43:2419:x1847765450766336:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:2.0:1762166984.579001:0:9168:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945cc355ac00/0x2f180c4effbad475 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa92:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166984.579013:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166984.579014:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1762166984.579018:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355ac00/0x2f180c4effbad475 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa92:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166984.579028:0:9168:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cc355ac00/0x2f180c4effbad475 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa92:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166984.579047:0:9168:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945cc355ac00/0x2f180c4effbad475 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa92:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166984.579052:0:9168:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355ac00/0x2f180c4effbad475 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa92:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166984.579057:0:9168:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945cc355ac00/0x2f180c4effbad475 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa92:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166984.579061:0:9168:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355ac00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166984.579064:0:9168:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc355ac00/0x2f180c4effbad475 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa92:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166984.579070:0:9168:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc355ac00/0x2f180c4effbad475 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa92:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166984.579083:0:9168:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945cc355ac00/0x2f180c4effbad475 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa92:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166984.579088:0:9168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cc355ac00/0x2f180c4effbad475 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa92:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166984.579140:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc442c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+43:2419:x1847765450766336:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 176us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166984.579145:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19505 00000100:00100000:3.0:1762166984.600891:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166984.600963:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450766464 00000100:00100000:1.0:1762166984.600976:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450766464 00000100:00100000:1.0:1762166984.601034:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30942 00000100:00100000:1.0:1762166984.601042:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc495a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+581:62503:x1847765450766464:12345-192.168.204.38@tcp:44:lfs.0 00000001:00080000:0.0:1762166984.602458:0:7412:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 4294992599 is committed 00010000:00010000:2.0:1762166984.602496:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62000/0x2f180c4effbad253 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166984.602506:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62000/0x2f180c4effbad253 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166984.602512:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62000/0x2f180c4effbad253 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00000020:00080000:0.0:1762166984.602517:0:7412:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff945cc9a5e6c0 refcount 2 committed 0 result 0 batchid 67 00010000:00010000:2.0:1762166984.602518:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4b62000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166984.602523:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62000/0x2f180c4effbad253 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00000020:00080000:0.0:1762166984.602525:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cf3bd2400 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff945cc9a5e0c0 00010000:00010000:2.0:1762166984.602533:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62000/0x2f180c4effbad253 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 30829 initiator: MDT1 00000020:00080000:0.0:1762166984.602534:0:7412:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000401:0x2:0x0].13 00000020:00080000:0.0:1762166984.602541:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cf3bd2c00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff945bc4428000 00000020:00080000:0.0:1762166984.602546:0:7412:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000400:0x2:0x0].66 00010000:00010000:2.0:1762166984.602551:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945cc3449e00) 00010000:00010000:2.0:1762166984.602555:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166984.602558:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62000/0x2f180c4effbad253 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166984.602567:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b62000/0x2f180c4effbad253 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00000004:00080000:0.0:1762166984.602571:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3325 committed 00010000:00010000:2.0:1762166984.602588:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63a00/0x2f180c4effbad276 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00000004:00080000:0.0:1762166984.602588:0:7412:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 3322 committed 00010000:00010000:2.0:1762166984.602598:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63a00/0x2f180c4effbad276 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166984.602605:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63a00/0x2f180c4effbad276 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166984.602612:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4b63a00 already unused, calling callback (ffffffffc18e2310) 00000020:00080000:3.0:1762166984.602616:0:7435:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 64 00010000:00010000:2.0:1762166984.602616:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63a00/0x2f180c4effbad276 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166984.602622:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63a00/0x2f180c4effbad276 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166984.602632:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945cc3449e00) 00010000:00010000:2.0:1762166984.602634:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166984.602637:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63a00/0x2f180c4effbad276 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166984.602643:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b63a00/0x2f180c4effbad276 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166984.602655:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99400/0x2f180c4effbad28b lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166984.602660:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99400/0x2f180c4effbad28b lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166984.602666:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99400/0x2f180c4effbad28b lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166984.602671:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4b99400 already unused, calling callback (ffffffffc18e2310) 00000020:00080000:0.0:1762166984.602673:0:7412:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff945bc402f3c0 refcount 2 committed 0 result 0 batchid 66 00010000:00010000:2.0:1762166984.602675:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99400/0x2f180c4effbad28b lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00000020:00080000:0.0:1762166984.602681:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cf3bd1f00 obd lustre-OST0001-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff945bc402f240 00010000:00010000:2.0:1762166984.602685:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99400/0x2f180c4effbad28b lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30829 initiator: MDT1 00000020:00080000:0.0:1762166984.602687:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cf3bd1a00 obd lustre-OST0000-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff945bc402fd80 00000020:00080000:0.0:1762166984.602698:0:7412:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945cf3bd1e00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff945cf9d0bc00 00000020:00080000:0.0:1762166984.602703:0:7412:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000400:0x2:0x0].65 00010000:00010000:2.0:1762166984.602705:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945cc3449e00) 00010000:00010000:2.0:1762166984.602710:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166984.602713:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99400/0x2f180c4effbad28b lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166984.602718:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99400/0x2f180c4effbad28b lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166984.602732:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99a00/0x2f180c4effbad2a0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166984.602738:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99a00/0x2f180c4effbad2a0 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166984.602761:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99a00/0x2f180c4effbad2a0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166984.602767:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4b99a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166984.602772:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99a00/0x2f180c4effbad2a0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166984.602779:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99a00/0x2f180c4effbad2a0 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30829 initiator: MDT1 00000020:00080000:0.0:1762166984.602782:0:7412:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0001: 65 batchid updated 00010000:00010000:2.0:1762166984.602789:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945cc3449e00) 00010000:00010000:2.0:1762166984.602793:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166984.602796:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99a00/0x2f180c4effbad2a0 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166984.602802:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b99a00/0x2f180c4effbad2a0 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00000100:00100000:1.0:1762166984.602804:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc6cd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449804288:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1762166984.602806:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4958380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449804416:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1762166984.602819:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbad2b5 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166984.602826:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbad2b5 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166984.602832:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbad2b5 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166984.602836:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bde000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166984.602839:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbad2b5 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166984.602844:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbad2b5 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166984.602853:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945cc3449e00) 00010000:00010000:2.0:1762166984.602855:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166984.602858:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbad2b5 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166984.602863:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bde000/0x2f180c4effbad2b5 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166984.602873:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b98a00/0x2f180c4effbad2ca lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166984.602879:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b98a00/0x2f180c4effbad2ca lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166984.602885:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b98a00/0x2f180c4effbad2ca lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166984.602889:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4b98a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166984.602892:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b98a00/0x2f180c4effbad2ca lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00000020:00080000:3.0:1762166984.602898:0:7435:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 67 committed batchid 65 00010000:00010000:2.0:1762166984.602898:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b98a00/0x2f180c4effbad2ca lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166984.602905:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x5eb:0x0].0x0 (ffff945cc3449e00) 00010000:00010000:2.0:1762166984.602908:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762166984.602910:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449804672:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1762166984.602913:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b98a00/0x2f180c4effbad2ca lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00000100:00100000:1.0:1762166984.602925:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1762166984.602931:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4b98a00/0x2f180c4effbad2ca lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x5eb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166984.602954:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba000/0x2f180c4effbad302 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166984.602961:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba000/0x2f180c4effbad302 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166984.602969:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba000/0x2f180c4effbad302 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00000100:00100000:0.0:1762166984.602976:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1762166984.602979:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc93ba000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166984.602984:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba000/0x2f180c4effbad302 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166984.602989:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba000/0x2f180c4effbad302 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166984.603005:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x6:0x0].0xdd396665 (ffff945bc809ba00) 00010000:00010000:2.0:1762166984.603009:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166984.603013:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba000/0x2f180c4effbad302 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00010000:00010000:2.0:1762166984.603019:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc93ba000/0x2f180c4effbad302 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x6:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30829 initiator: MDT1 00000020:00080000:3.0:1762166984.603032:0:7435:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 65 cancel update log [0x240000400:0x2:0x0].64: rc = 0 00000100:00100000:0.0:1762166984.603039:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1762166984.603044:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1762166984.603045:0:7435:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 65 00010000:00010000:2.0:1762166984.603045:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbad348 lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x61f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00000100:00100000:0.0:1762166984.603056:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc4958e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449804544:0@lo:6:osp-syn-1-1.0 00010000:00010000:2.0:1762166984.603065:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbad348 lrc: 2/0,0 mode: TXN/TXN res: [0x240000404:0x61f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT1 00010000:00010000:2.0:1762166984.603074:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbad348 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x61f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00000100:00100000:3.0:1762166984.603082:0:35248:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449804288 00010000:00010000:2.0:1762166984.603082:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355a600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166984.603087:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbad348 lrc: 3/0,0 mode: TXN/TXN res: [0x240000404:0x61f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00000100:00100000:3.0:1762166984.603091:0:35248:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449804288 00010000:00010000:2.0:1762166984.603095:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbad348 lrc: 4/0,0 mode: TXN/TXN res: [0x240000404:0x61f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT1 00000100:00100000:1.0:1762166984.603107:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449804672 00010000:00010000:2.0:1762166984.603111:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x61f:0x0].0x0 (ffff945bc812e700) 00000100:00100000:1.0:1762166984.603113:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449804672 00000100:00100000:0.0:1762166984.603115:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1762166984.603121:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166984.603124:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbad348 lrc: 2/0,0 mode: --/TXN res: [0x240000404:0x61f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:2.0:1762166984.603131:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a600/0x2f180c4effbad348 lrc: 0/0,0 mode: --/TXN res: [0x240000404:0x61f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:2.0:1762166984.603146:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a400/0x2f180c4effbad34f lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:2.0:1762166984.603152:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a400/0x2f180c4effbad34f lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT1 00000100:00100000:1.0:1762166984.603158:0:9165:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449804416 00010000:00010000:2.0:1762166984.603159:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a400/0x2f180c4effbad34f lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00000100:00100000:1.0:1762166984.603165:0:9165:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449804416 00000100:00100000:3.0:1762166984.603167:0:35248:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449804544 00010000:00010000:2.0:1762166984.603168:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355a400 already unused, calling callback (ffffffffc18e2310) 00000100:00100000:3.0:1762166984.603173:0:35248:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449804544 00010000:00010000:2.0:1762166984.603173:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a400/0x2f180c4effbad34f lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:2.0:1762166984.603179:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a400/0x2f180c4effbad34f lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT1 00010000:00010000:2.0:1762166984.603191:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x6:0x0].0x0 (ffff945bc812e000) 00000100:00100000:0.0:1762166984.603194:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19506 00010000:00010000:2.0:1762166984.603195:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166984.603201:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a400/0x2f180c4effbad34f lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:2.0:1762166984.603207:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945cc355a400/0x2f180c4effbad34f lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00000100:00100000:0.0:1762166984.603211:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc442e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+12:3634:x1847765449804672:12345-0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1762166984.603233:0:9165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19507 00010000:00010000:2.0:1762166984.603236:0:3620:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847e000/0x2f180c4effbad3c6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00000100:00100000:3.0:1762166984.603242:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19508 00002000:00080000:0.0:1762166984.603246:0:8383:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:2680 count 1 00000100:00100000:1.0:1762166984.603248:0:9165:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7def100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+12:3635:x1847765449804288:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1762166984.603260:0:3620:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847e000/0x2f180c4effbad3c6 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT1 00000100:00100000:3.0:1762166984.603266:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7dedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+7:3636:x1847765449804416:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:0.0:1762166984.603279:0:8383:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdea00/0x2f180c4effbad47c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166984.603285:0:3620:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847e000/0x2f180c4effbad3c6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00002000:00080000:1.0:1762166984.603297:0:9165:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:2706 count 1 00002000:00080000:3.0:1762166984.603298:0:35248:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:2705 count 1 00010000:00010000:2.0:1762166984.603298:0:3620:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc847e000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166984.603306:0:3620:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847e000/0x2f180c4effbad3c6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:0.0:1762166984.603308:0:8383:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945cc0030800/0x2f180c4effba4f05 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e7aa7 expref: 23 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.603319:0:9165:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9800/0x2f180c4effbad483 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa92:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166984.603320:0:35248:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc4b63000/0x2f180c4effbad48a lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa91:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166984.603343:0:3620:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847e000/0x2f180c4effbad3c6 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.603366:0:9165:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde200/0x2f180c4effbad134 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa92:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 28672->32767) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaaa4 expref: 23 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166984.603374:0:35248:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945cc355b400/0x2f180c4effbad01c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa91:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa57 expref: 42 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166984.603375:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x6:0x0].0x10cd7725 (ffff945bc812e100) 00010000:00010000:0.0:1762166984.603376:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1762166984.603384:0:8383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166984.603392:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166984.603394:0:8383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdea00/0x2f180c4effbad47c lrc: 4/0,1 mode: --/PW res: [0x280000400:0xa78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.603395:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166984.603398:0:3620:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847e000/0x2f180c4effbad3c6 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.603402:0:9165:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1762166984.603408:0:9165:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9800/0x2f180c4effbad483 lrc: 4/0,1 mode: --/PW res: [0x280000400:0xa92:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166984.603411:0:35248:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166984.603418:0:35248:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166984.603427:0:35248:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4b63000/0x2f180c4effbad48a lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0xa91:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166984.603427:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847e000/0x2f180c4effbad3c6 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:0.0:1762166984.603511:0:8383:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945cc0030800/0x2f180c4effba4f05 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e7aa7 expref: 23 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.603518:0:9165:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde200/0x2f180c4effbad134 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa92:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 28672->32767) gid 0 flags: 0x50000000030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaaa4 expref: 23 pid: 35248 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166984.603528:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19509 00010000:00010000:0.0:1762166984.603530:0:8383:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945cc0030800/0x2f180c4effba4f05 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e7aa7 expref: 23 pid: 8383 timeout: 703 lvb_type: 0 00010000:00010000:3.0:1762166984.603535:0:35248:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945cc355b400/0x2f180c4effbad01c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa91:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa57 expref: 42 pid: 8383 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166984.603550:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc442dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+7:3634:x1847765449804544:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1762166984.603558:0:9165:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde200/0x2f180c4effbad134 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa92:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 28672->32767) gid 0 flags: 0x70000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaaa4 expref: 23 pid: 35248 timeout: 703 lvb_type: 0 00002000:00080000:2.0:1762166984.603570:0:9168:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:2679 count 1 00000100:00100000:0.0:1762166984.603572:0:8383:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc442c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8383:1847765449804928:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166984.603574:0:35248:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945cc355b400/0x2f180c4effbad01c lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa91:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa57 expref: 42 pid: 8383 timeout: 703 lvb_type: 0 00010000:00010000:2.0:1762166984.603589:0:9168:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945cc355ac00/0x2f180c4effbad491 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166984.603605:0:9165:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7ded180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9165:1847765449804800:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166984.603606:0:35248:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc76aca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:35248:1847765449805056:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166984.603606:0:9168:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4b98e00/0x2f180c4effbad149 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 28672->32767) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaab2 expref: 42 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166984.603622:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166984.603624:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1762166984.603627:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355ac00/0x2f180c4effbad491 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166984.603641:0:8383:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7cb4480 going to sleep for 11 seconds 00010000:00010000:2.0:1762166984.603647:0:9168:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4b98e00/0x2f180c4effbad149 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 28672->32767) gid 0 flags: 0x50000000030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaab2 expref: 42 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166984.603658:0:9168:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc4b98e00/0x2f180c4effbad149 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 28672->32767) gid 0 flags: 0x70000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaab2 expref: 42 pid: 9165 timeout: 703 lvb_type: 0 00000100:00100000:2.0:1762166984.603670:0:9168:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc2d5dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9168:1847765449805184:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166984.603675:0:9165:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc9a5e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166984.603679:0:35248:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011a1b40 going to sleep for 11 seconds 00000100:00100000:2.0:1762166984.603701:0:9168:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cf3dc4600 going to sleep for 11 seconds 00000100:00080000:3.0:1762166984.603738:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1762166984.603849:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc495a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+528:62503:x1847765450766464:12345-192.168.204.38@tcp:44:lfs.0 Request processed in 2805us (2970us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166984.603856:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30942 00000100:00100000:0.0:1762166984.605146:0:8383:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc442c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8383:1847765449804928:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166984.605153:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:0.0:1762166984.605174:0:8383:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdea00/0x2f180c4effbad47c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166984.605199:0:9165:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7ded180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9165:1847765449804800:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166984.605212:0:35248:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc76aca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:35248:1847765449805056:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166984.605213:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166984.605215:0:9168:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc2d5dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9168:1847765449805184:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166984.605231:0:9165:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9800/0x2f180c4effbad483 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa92:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166984.605242:0:9168:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945cc355ac00/0x2f180c4effbad491 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166984.605245:0:35248:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc4b63000/0x2f180c4effbad48a lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa91:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166984.605261:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166984.605287:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166984.605299:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450766720 00000100:00100000:2.0:1762166984.605305:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450766720 00000100:00100000:1.0:1762166984.605310:0:28434:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450767104 00000100:00100000:1.0:1762166984.605317:0:28434:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450767104 00000100:00100000:0.0:1762166984.605330:0:9458:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450766592 00000100:00100000:3.0:1762166984.605334:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:2.0:1762166984.605335:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde200/0x2f180c4effbad134 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa92:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 28672->32767) gid 0 flags: 0x60000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaaa4 expref: 25 pid: 35248 timeout: 703 lvb_type: 0 00000100:00100000:0.0:1762166984.605337:0:9458:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450766592 00010000:00010000:0.0:1762166984.605357:0:9458:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945cc0030800/0x2f180c4effba4f05 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e7aa7 expref: 26 pid: 8383 timeout: 703 lvb_type: 0 00000100:00100000:1.0:1762166984.605366:0:28434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19510 00000100:00100000:3.0:1762166984.605385:0:6480:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450766976 00000100:00100000:2.0:1762166984.605387:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450766848 00000100:00100000:1.0:1762166984.605388:0:28434:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3d58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+26:2418:x1847765450767104:12345-192.168.204.38@tcp:16:lfs.0 00000100:00100000:3.0:1762166984.605391:0:6480:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450766976 00000100:00100000:2.0:1762166984.605394:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450766848 00000100:00100000:0.0:1762166984.605405:0:9458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9854 00010000:00010000:3.0:1762166984.605415:0:6480:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355b400/0x2f180c4effbad01c lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa91:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa57 expref: 44 pid: 8383 timeout: 703 lvb_type: 0 00000100:00100000:0.0:1762166984.605415:0:9458:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc76ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+26:2418:x1847765450766720:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166984.605421:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4b98e00/0x2f180c4effbad149 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 28672->32767) gid 0 flags: 0x60000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaab2 expref: 44 pid: 9165 timeout: 703 lvb_type: 0 00010000:00010000:0.0:1762166984.605428:0:9458:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1762166984.605434:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9855 00010000:00010000:0.0:1762166984.605436:0:9458:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde200/0x2f180c4effbad134 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa92:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 28672->32767) gid 0 flags: 0x60000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaaa4 expref: 26 pid: 35248 timeout: 703 lvb_type: 0 00000100:00100000:3.0:1762166984.605444:0:6480:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc76ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+26:2418:x1847765450766592:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166984.605448:0:9458:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde200/0x2f180c4effbad134 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa92:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 28672->32767) gid 0 flags: 0x50000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaaa4 expref: 26 pid: 35248 timeout: 703 lvb_type: 0 00010000:00010000:3.0:1762166984.605453:0:6480:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1762166984.605455:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9856 00010000:00010000:3.0:1762166984.605459:0:6480:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945cc0030800/0x2f180c4effba4f05 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e7aa7 expref: 26 pid: 8383 timeout: 703 lvb_type: 0 00000100:00100000:2.0:1762166984.605470:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc76ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+44:2417:x1847765450766976:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166984.605472:0:6480:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945cc0030800/0x2f180c4effba4f05 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e7aa7 expref: 26 pid: 8383 timeout: 703 lvb_type: 0 00010000:00010000:0.0:1762166984.605472:0:9458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bde200/0x2f180c4effbad134 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa92:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 28672->32767) gid 0 flags: 0x44801400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaaa4 expref: 26 pid: 35248 timeout: 703 lvb_type: 0 00010000:00010000:2.0:1762166984.605517:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1762166984.605523:0:28434:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3d58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e1e11365-ba0b-405b-99c9-a704373217f2+26:2418:x1847765450767104:12345-192.168.204.38@tcp:16:lfs.0 Request processed in 97us (222us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166984.605532:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945cc355b400/0x2f180c4effbad01c lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa91:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa57 expref: 44 pid: 8383 timeout: 703 lvb_type: 0 00010000:00010000:0.0:1762166984.605549:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166984.605551:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945cc0030800/0x2f180c4effba4f05 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028e7aa7 expref: 25 pid: 8383 timeout: 703 lvb_type: 0 00010000:00010000:0.0:1762166984.605554:0:9458:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1762166984.605557:0:28434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19510 00010000:00010000:0.0:1762166984.605561:0:9458:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9800/0x2f180c4effbad483 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa92:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166984.605578:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945cc355b400/0x2f180c4effbad01c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa91:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa57 expref: 44 pid: 8383 timeout: 703 lvb_type: 0 00010000:00010000:0.0:1762166984.605578:0:9458:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9800/0x2f180c4effbad483 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa92:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166984.605581:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166984.605584:0:6480:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166984.605588:0:6480:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdea00/0x2f180c4effbad47c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166984.605610:0:9458:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166984.605611:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9857 00010000:00010000:3.0:1762166984.605612:0:6480:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdea00/0x2f180c4effbad47c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166984.605635:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc76ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+44:2417:x1847765450766848:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166984.605640:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cc355b400/0x2f180c4effbad01c lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa91:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaa57 expref: 44 pid: 8383 timeout: 703 lvb_type: 0 00010000:00010000:3.0:1762166984.605641:0:6480:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166984.605651:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1762166984.605652:0:9458:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc76ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765450766720:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 236us (495us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166984.605658:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1762166984.605665:0:6480:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc76ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765450766592:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 218us (459us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166984.605665:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166984.605667:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc4b98e00/0x2f180c4effbad149 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 28672->32767) gid 0 flags: 0x60000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaab2 expref: 43 pid: 9165 timeout: 703 lvb_type: 0 00010000:00010000:2.0:1762166984.605672:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4b63000/0x2f180c4effbad48a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa91:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166984.605678:0:9458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9854 00000100:00100000:3.0:1762166984.605695:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9855 00010000:00010000:2.0:1762166984.605713:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4b63000/0x2f180c4effbad48a lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xa91:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.605720:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc4b98e00/0x2f180c4effbad149 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 28672->32767) gid 0 flags: 0x50000400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaab2 expref: 43 pid: 9165 timeout: 703 lvb_type: 0 00010000:00010000:3.0:1762166984.605732:0:8383:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdea00/0x2f180c4effbad47c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166984.605760:0:8383:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdea00/0x2f180c4effbad47c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166984.605763:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166984.605772:0:8383:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdea00/0x2f180c4effbad47c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.605773:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4b98e00/0x2f180c4effbad149 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 28672->32767) gid 0 flags: 0x44801400030020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaab2 expref: 43 pid: 9165 timeout: 703 lvb_type: 0 00000100:00100000:2.0:1762166984.605797:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc76ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+43:2417:x1847765450766976:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 325us (503us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166984.605814:0:8383:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdea00/0x2f180c4effbad47c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.605815:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1762166984.605820:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9856 00010000:00010000:1.0:1762166984.605821:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166984.605831:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945cc355ac00/0x2f180c4effbad491 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166984.605838:0:9165:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9800/0x2f180c4effbad483 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166984.605842:0:8383:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1762166984.605843:0:6479:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355ac00/0x2f180c4effbad491 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166984.605858:0:35248:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc4b63000/0x2f180c4effbad48a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166984.605887:0:9165:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9800/0x2f180c4effbad483 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166984.605889:0:35248:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4b63000/0x2f180c4effbad48a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.605897:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166984.605908:0:9165:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9800/0x2f180c4effbad483 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166984.605912:0:35248:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc4b63000/0x2f180c4effbad48a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166984.605922:0:9165:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9800/0x2f180c4effbad483 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166984.605926:0:35248:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4b63000/0x2f180c4effbad48a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166984.605943:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc76ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+41:2417:x1847765450766848:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 308us (605us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166984.605946:0:9165:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1762166984.605973:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9857 00010000:00010000:2.0:1762166984.605991:0:35248:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1762166984.606012:0:7420:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1762166984.606021:0:7420:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdea00/0x2f180c4effbad47c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.606032:0:7420:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdea00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166984.606037:0:7420:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdea00/0x2f180c4effbad47c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.606047:0:7420:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdea00/0x2f180c4effbad47c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.606064:0:7420:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdea00/0x2f180c4effbad47c lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.606072:0:7420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4bdea00/0x2f180c4effbad47c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.606104:0:7420:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1762166984.606108:0:7420:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9800/0x2f180c4effbad483 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.606116:0:7420:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa9800 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166984.606121:0:7420:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9800/0x2f180c4effbad483 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.606129:0:7420:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9800/0x2f180c4effbad483 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.606141:0:7420:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9800/0x2f180c4effbad483 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.606149:0:7420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4aa9800/0x2f180c4effbad483 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9165 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166984.606164:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc442e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+14:3634:x1847765449804672:12345-0@lo:6:osp-syn-0-1.0 Request processed in 2955us (3191us total) trans 21474843495 rc 0/0 00000100:00100000:3.0:1762166984.606177:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19506 00010000:00010000:1.0:1762166984.606181:0:7420:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1762166984.606187:0:7420:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc4b63000/0x2f180c4effbad48a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166984.606196:0:35248:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7dedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+8:3636:x1847765449804416:12345-0@lo:6:osp-syn-1-1.0 Request processed in 2934us (3153us total) trans 17179876792 rc 0/0 00010000:00010000:3.0:1762166984.606203:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166984.606207:0:7420:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4b63000 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166984.606214:0:7420:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4b63000/0x2f180c4effbad48a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166984.606215:0:35248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19508 00010000:00010000:1.0:1762166984.606231:0:7420:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4b63000/0x2f180c4effbad48a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.606245:0:7420:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc4b63000/0x2f180c4effbad48a lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xa91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.606253:0:7420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4b63000/0x2f180c4effbad48a lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35248 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1762166984.606269:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc4958380/2, rc 0, transno 17179876792 00010000:00010000:1.0:1762166984.606286:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1762166984.606291:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4958380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449804416:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1762166984.606291:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166984.606297:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1762166984.606300:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc406c000/2, rc 0, transno 21474843495 00010000:00010000:1.0:1762166984.606323:0:9168:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945cc355ac00/0x2f180c4effbad491 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166984.606324:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449804672:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1762166984.606327:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1762166984.606344:0:9168:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945cc355ac00/0x2f180c4effbad491 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.606354:0:9168:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945cc355ac00/0x2f180c4effbad491 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.606363:0:9168:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945cc355ac00/0x2f180c4effbad491 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.606392:0:9168:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1762166984.606412:0:10256:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1762166984.606420:0:10256:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945cc355ac00/0x2f180c4effbad491 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166984.606427:0:10256:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355ac00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166984.606432:0:10256:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc355ac00/0x2f180c4effbad491 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166984.606440:0:10256:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945cc355ac00/0x2f180c4effbad491 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166984.606447:0:9165:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7def100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+13:3635:x1847765449804288:12345-0@lo:6:osp-syn-0-1.0 Request processed in 3205us (3532us total) trans 21474843496 rc 0/0 00010000:00010000:3.0:1762166984.606454:0:10256:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945cc355ac00/0x2f180c4effbad491 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166984.606455:0:9165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19507 00010000:00010000:3.0:1762166984.606462:0:10256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945cc355ac00/0x2f180c4effbad491 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1762166984.606518:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc6cd0380/2, rc 0, transno 21474843496 00000100:00100000:2.0:1762166984.606538:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc6cd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449804288:0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1762166984.606560:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166984.606565:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166984.606568:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166984.606945:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc442dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+8:3634:x1847765449804544:12345-0@lo:6:osp-syn-1-1.0 Request processed in 3399us (3832us total) trans 17179876793 rc 0/0 00000100:00100000:1.0:1762166984.606954:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19509 00000004:00080000:3.0:1762166984.606963:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc4958e00/2, rc 0, transno 17179876793 00000100:00100000:3.0:1762166984.606977:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc4958e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449804544:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1762166984.611459:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166984.611539:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450767232 00000100:00100000:1.0:1762166984.611550:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450767232 00000100:00100000:1.0:1762166984.611612:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19511 00000100:00100000:1.0:1762166984.611621:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc76adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+41:2419:x1847765450767232:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:1.0:1762166984.611661:0:9168:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbad498 lrc: 3/1,0 mode: --/PR res: [0x2c0000400:0xa92:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.611673:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166984.611675:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166984.611679:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbad498 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa92:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.611689:0:9168:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbad498 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa92:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.611712:0:9168:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbad498 lrc: 3/1,0 mode: PR/PR res: [0x2c0000400:0xa92:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.611721:0:9168:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbad498 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xa92:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.611728:0:9168:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbad498 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa92:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.611735:0:9168:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa9800 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:1.0:1762166984.611740:0:9168:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbad498 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xa92:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.611761:0:9168:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbad498 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xa92:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.611780:0:9168:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbad498 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xa92:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.611785:0:9168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbad498 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xa92:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166984.611853:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc76adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+41:2419:x1847765450767232:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 234us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166984.611859:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19511 00000100:00100000:2.0:1762166984.612764:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166984.612804:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450767488 00000100:00100000:1.0:1762166984.612810:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450767488 00000100:00100000:1.0:1762166984.612848:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30943 00000100:00100000:1.0:1762166984.612854:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+528:62503:x1847765450767488:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:1.0:1762166984.612897:0:12357:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166984.612914:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc847f600/0x2f180c4effbad452 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x621:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaba7 expref: 528 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.612928:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x621:0x0].0x0 (ffff945bc812ea00) 00010000:00010000:1.0:1762166984.612934:0:12357:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166984.612972:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbad49f lrc: 3/0,1 mode: --/PW res: [0x240000404:0x621:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166984.612980:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbad49f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x621:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.612986:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbad49f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x621:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00000004:00010000:1.0:1762166984.613097:0:12357:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000045a47cf8 reply state 0000000017f4f322 transno 4294992600 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbad49f lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x621:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.613105:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8600/0x2f180c4effbad49f lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x621:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.613109:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x621:0x0].0x0 (ffff945bc812e900) 00010000:00010000:1.0:1762166984.613112:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166984.613114:0:12357:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166984.613201:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+529:62503:x1847765450767488:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 347us (438us total) trans 4294992600 rc 0/0 00000100:00100000:1.0:1762166984.613206:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30943 00000100:00100000:0.0:1762166984.613915:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166984.613953:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450767616 00000100:00100000:1.0:1762166984.613960:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450767616 00000100:00100000:1.0:1762166984.613991:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30944 00000100:00100000:1.0:1762166984.614000:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc442c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+529:62503:x1847765450767616:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166984.614016:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166984.614028:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbad4a6 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x621:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eabbc expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.614063:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbad4a6 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x621:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eabbc expref: 530 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.614075:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbad4a6 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x621:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eabbc expref: 530 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.614090:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x621:0x0].0x0 (ffff945bc812e900) 00010000:00010000:1.0:1762166984.614093:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166984.614096:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa9c00, rc 0) 00000100:00100000:1.0:1762166984.614132:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc442c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+530:62503:x1847765450767616:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 134us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166984.614139:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30944 00000100:00100000:3.0:1762166984.614991:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166984.615036:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450767744 00000100:00100000:1.0:1762166984.615043:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450767744 00000100:00100000:1.0:1762166984.615081:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19512 00000100:00100000:1.0:1762166984.615088:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc76ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+22:2418:x1847765450767744:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:1.0:1762166984.615231:0:9168:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0xa93:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166984.615236:0:9168:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0xa93:0x0] updating lvb mtime from disk: 0 -> 1762166984 00002000:00010000:1.0:1762166984.615238:0:9168:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0xa93:0x0] updating lvb atime from disk: 0 -> 1762166984 00002000:00010000:1.0:1762166984.615241:0:9168:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0xa93:0x0] updating lvb ctime from disk: 0 -> 1762166984 00002000:00010000:1.0:1762166984.615244:0:9168:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0xa93:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1762166984.615280:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc76ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+23:2418:x1847765450767744:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 192us (290us total) trans 21474843497 rc 0/0 00000100:00100000:1.0:1762166984.615289:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19512 00000100:00100000:2.0:1762166984.616287:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166984.616329:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450768000 00000100:00100000:1.0:1762166984.616334:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450768000 00000100:00100000:1.0:1762166984.616361:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30945 00000100:00100000:1.0:1762166984.616365:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+530:62503:x1847765450768000:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:1.0:1762166984.616396:0:12357:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166984.616412:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fa200/0x2f180c4effbad40c lrc: 0/0,0 mode: --/PR res: [0x240000404:0x620:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eab8b expref: 530 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.616422:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x620:0x0].0x0 (ffff945bc812e300) 00010000:00010000:1.0:1762166984.616425:0:12357:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166984.616464:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbad4ad lrc: 3/0,1 mode: --/PW res: [0x240000404:0x620:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166984.616474:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbad4ad lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x620:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.616520:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbad4ad lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x620:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00000004:00010000:1.0:1762166984.616627:0:12357:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000020aaba71 reply state 00000000b2202857 transno 4294992601 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbad4ad lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x620:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.616640:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8c00/0x2f180c4effbad4ad lrc: 3/0,1 mode: TXN/TXN res: [0x240000404:0x620:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.616644:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x620:0x0].0x0 (ffff945bc812e300) 00010000:00010000:1.0:1762166984.616646:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166984.616647:0:12357:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1762166984.616695:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+531:62503:x1847765450768000:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 329us (411us total) trans 4294992601 rc 0/0 00000100:00100000:1.0:1762166984.616700:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30945 00000100:00100000:0.0:1762166984.617540:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166984.617582:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450768128 00000100:00100000:1.0:1762166984.617589:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450768128 00000100:00100000:1.0:1762166984.617623:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19513 00000100:00100000:1.0:1762166984.617632:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc442fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+41:2419:x1847765450768128:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:1.0:1762166984.617730:0:9168:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000400:0xa92:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1762166984.617734:0:9168:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000400:0xa92:0x0] updating lvb mtime from disk: 0 -> 1762166984 00002000:00010000:1.0:1762166984.617736:0:9168:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000400:0xa92:0x0] updating lvb atime from disk: 0 -> 1762166984 00002000:00010000:1.0:1762166984.617739:0:9168:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000400:0xa92:0x0] updating lvb ctime from disk: 0 -> 1762166984 00002000:00010000:1.0:1762166984.617741:0:9168:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000400:0xa92:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1762166984.617788:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc442fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+42:2419:x1847765450768128:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 157us (252us total) trans 17179876794 rc 0/0 00000100:00100000:1.0:1762166984.617796:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19513 00000100:00100000:3.0:1762166984.618685:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166984.618763:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450768384 00000100:00100000:0.0:1762166984.618769:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450768384 00000100:00100000:0.0:1762166984.618810:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 12010 00000100:00100000:0.0:1762166984.618820:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff2fc050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+531:62503:x1847765450768384:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:0.0:1762166984.618884:0:19593:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x240000404:0x620:0x0] lease broken? 0 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbad467 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x620:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eabb5 expref: 531 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166984.618917:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbad4b4 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x620:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166984.618929:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fba00/0x2f180c4effbad3f0 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x620:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eab84 expref: 531 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166984.618939:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbad4b4 lrc: 4/0,1 mode: --/EX res: [0x240000404:0x620:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166984.618975:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fba00/0x2f180c4effbad3f0 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x620:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eab84 expref: 531 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166984.618986:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fba00/0x2f180c4effbad3f0 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x620:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eab84 expref: 531 pid: 12357 timeout: 703 lvb_type: 0 00000100:00100000:0.0:1762166984.618999:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc442ea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449805312:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166984.619071:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7cb4480 going to sleep for 11 seconds 00000100:00100000:0.0:1762166984.619893:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc442ea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449805312:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166984.619912:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbad4b4 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x620:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:3.0:1762166984.620038:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166984.620075:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450768512 00000100:00100000:1.0:1762166984.620079:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450768512 00010000:00010000:1.0:1762166984.620097:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fba00/0x2f180c4effbad3f0 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x620:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eab84 expref: 532 pid: 12357 timeout: 703 lvb_type: 0 00000100:00100000:1.0:1762166984.620124:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9858 00000100:00100000:1.0:1762166984.620131:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc76afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+532:2419:x1847765450768512:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166984.620139:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166984.620143:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fba00/0x2f180c4effbad3f0 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x620:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eab84 expref: 532 pid: 12357 timeout: 703 lvb_type: 0 00010000:00010000:1.0:1762166984.620151:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fba00/0x2f180c4effbad3f0 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x620:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eab84 expref: 532 pid: 12357 timeout: 703 lvb_type: 0 00010000:00010000:1.0:1762166984.620161:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bcc8fba00/0x2f180c4effbad3f0 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x620:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eab84 expref: 532 pid: 12357 timeout: 703 lvb_type: 0 00010000:00010000:1.0:1762166984.620170:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x620:0x0].0x0 (ffff945bc812e300) 00010000:00010000:1.0:1762166984.620173:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbad4b4 lrc: 3/0,1 mode: --/EX res: [0x240000404:0x620:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166984.620178:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbad4b4 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x620:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166984.620182:0:6479:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbad4b4 lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x620:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166984.620197:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166984.620221:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc76afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+531:2419:x1847765450768512:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 91us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166984.620227:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9858 00010000:00010000:0.0:1762166984.620227:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbad4b4 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x620:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166984.620237:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbad4b4 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x620:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166984.620253:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbad4bb lrc: 3/0,1 mode: --/EX res: [0x240000404:0x621:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166984.620263:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbad4a6 lrc: 2/0,0 mode: CR/CR res: [0x240000404:0x621:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eabbc expref: 530 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166984.620270:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbad4bb lrc: 4/0,1 mode: --/EX res: [0x240000404:0x621:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166984.620294:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbad4a6 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x621:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eabbc expref: 530 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166984.620304:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbad4a6 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x621:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eabbc expref: 530 pid: 12357 timeout: 703 lvb_type: 0 00000100:00100000:0.0:1762166984.620314:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc442ea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449805440:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166984.620365:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7cb4480 going to sleep for 11 seconds 00000100:00100000:0.0:1762166984.621046:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc442ea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001_UUID:19593:1847765449805440:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166984.621058:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbad4bb lrc: 3/0,1 mode: --/EX res: [0x240000404:0x621:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:2.0:1762166984.621229:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166984.621275:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450768640 00000100:00100000:1.0:1762166984.621279:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450768640 00010000:00010000:1.0:1762166984.621296:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbad4a6 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x621:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eabbc expref: 531 pid: 12357 timeout: 703 lvb_type: 0 00000100:00100000:1.0:1762166984.621334:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9859 00000100:00100000:1.0:1762166984.621342:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+531:2418:x1847765450768640:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166984.621351:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166984.621356:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbad4a6 lrc: 4/0,0 mode: CR/CR res: [0x240000404:0x621:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eabbc expref: 531 pid: 12357 timeout: 703 lvb_type: 0 00010000:00010000:1.0:1762166984.621366:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbad4a6 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x621:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eabbc expref: 531 pid: 12357 timeout: 703 lvb_type: 0 00010000:00010000:1.0:1762166984.621379:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbad4a6 lrc: 0/0,0 mode: --/CR res: [0x240000404:0x621:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eabbc expref: 531 pid: 12357 timeout: 703 lvb_type: 0 00010000:00010000:1.0:1762166984.621391:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x621:0x0].0x0 (ffff945bc812e900) 00010000:00010000:1.0:1762166984.621396:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbad4bb lrc: 3/0,1 mode: --/EX res: [0x240000404:0x621:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166984.621404:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbad4bb lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x621:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166984.621410:0:6479:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbad4bb lrc: 4/0,1 mode: EX/EX res: [0x240000404:0x621:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT1 00010000:00010000:1.0:1762166984.621433:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166984.621462:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+530:2418:x1847765450768640:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 121us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166984.621473:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9859 00010000:00010000:0.0:1762166984.621521:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbad4bb lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x621:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166984.621531:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbad4bb lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x621:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT1 00000100:00100000:0.0:1762166984.621813:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc442ea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449805568:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166984.621852:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166984.621881:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945d011c7a80 going to sleep for 11 seconds 00000100:00100000:3.0:1762166984.621896:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449805568 00000100:00100000:3.0:1762166984.621901:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449805568 00000100:00100000:3.0:1762166984.621942:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1501 00000100:00100000:3.0:1762166984.621949:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc442f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:19593:x1847765449805568:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166984.622032:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc442f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:19593:x1847765449805568:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 83us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166984.622041:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1501 00000100:00100000:0.0:1762166984.622056:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc442ea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449805568:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166984.622101:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc442ea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449805696:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166984.622129:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166984.622148:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccb38c540 going to sleep for 11 seconds 00000100:00100000:3.0:1762166984.622154:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449805696 00000100:00100000:3.0:1762166984.622160:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449805696 00000100:00100000:3.0:1762166984.622186:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1502 00000100:00100000:3.0:1762166984.622192:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc442df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+13:19593:x1847765449805696:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166984.622255:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc442df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+13:19593:x1847765449805696:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 62us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166984.622261:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1502 00000100:00100000:0.0:1762166984.622287:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc442ea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449805696:0@lo:1000:mdt_rdpg00_003.0 00000040:00080000:0.0:1762166984.622430:0:19593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x2:0x0].67, 280 off75056 00000001:00080000:0.0:1762166984.622438:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992602 00000100:00100000:0.0:1762166984.622497:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc442ea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449805824:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166984.622523:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166984.622541:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc7cb40c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166984.622564:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449805824 00000100:00100000:3.0:1762166984.622569:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449805824 00000100:00100000:3.0:1762166984.622593:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1503 00000100:00100000:3.0:1762166984.622600:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc442d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+13:19593:x1847765449805824:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166984.622692:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc442d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+14:19593:x1847765449805824:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 92us (167us total) trans 21474843498 rc 0/0 00000100:00100000:3.0:1762166984.622699:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1503 00000100:00100000:0.0:1762166984.622726:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc442ea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449805824:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166984.622762:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc442ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449805952:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166984.622789:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166984.622808:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc9a5e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1762166984.622828:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449805952 00000100:00100000:3.0:1762166984.622833:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449805952 00000100:00100000:3.0:1762166984.622857:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1504 00000100:00100000:3.0:1762166984.622863:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc442d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:19593:x1847765449805952:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:3.0:1762166984.622966:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc442d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:19593:x1847765449805952:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 103us (176us total) trans 17179876795 rc 0/0 00000100:00100000:3.0:1762166984.622974:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1504 00000100:00100000:0.0:1762166984.622992:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc442ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0001-mdtlov_UUID:19593:1847765449805952:0@lo:1000:mdt_rdpg00_003.0 00000001:00080000:0.0:1762166984.623028:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294992603 00010000:00010000:0.0:1762166984.623044:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbad4bb lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x621:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166984.623049:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbad4bb lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x621:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166984.623054:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbad4bb lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x621:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166984.623058:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdf600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166984.623061:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbad4bb lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x621:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166984.623066:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbad4bb lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x621:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166984.623075:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x621:0x0].0x0 (ffff945bc812e900) 00010000:00010000:0.0:1762166984.623077:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166984.623080:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbad4bb lrc: 2/0,0 mode: --/EX res: [0x240000404:0x621:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166984.623084:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf600/0x2f180c4effbad4bb lrc: 0/0,0 mode: --/EX res: [0x240000404:0x621:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166984.623092:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbad4b4 lrc: 3/0,1 mode: EX/EX res: [0x240000404:0x620:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166984.623095:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbad4b4 lrc: 2/0,0 mode: EX/EX res: [0x240000404:0x620:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166984.623099:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbad4b4 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x620:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166984.623102:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdfa00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166984.623103:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbad4b4 lrc: 3/0,0 mode: EX/EX res: [0x240000404:0x620:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166984.623106:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbad4b4 lrc: 4/0,0 mode: EX/EX res: [0x240000404:0x620:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166984.623110:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x620:0x0].0x0 (ffff945bc812e300) 00010000:00010000:0.0:1762166984.623111:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166984.623113:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbad4b4 lrc: 2/0,0 mode: --/EX res: [0x240000404:0x620:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166984.623117:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdfa00/0x2f180c4effbad4b4 lrc: 0/0,0 mode: --/EX res: [0x240000404:0x620:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166984.623126:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x620:0x0].0x0 (ffff945bc812e300) 00010000:00010000:0.0:1762166984.623129:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166984.623134:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8200/0x2f180c4effbad467 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x620:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eabb5 expref: 532 pid: 12357 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166984.623210:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff2fc050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+531:62503:x1847765450768384:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 4393us (4529us total) trans 4294992604 rc 0/0 00000100:00100000:0.0:1762166984.623216:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 12010 00000020:00080000:0.0:1762166984.623220:0:19593:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1762166984.624348:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166984.624388:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450768768 00000100:00100000:1.0:1762166984.624392:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450768768 00000100:00100000:1.0:1762166984.624422:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30946 00000100:00100000:1.0:1762166984.624428:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+531:62503:x1847765450768768:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166984.624445:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166984.624460:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbad4c2 lrc: 2/0,0 mode: --/CR res: [0x240000404:0x620:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eabc3 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.624526:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbad4c2 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x620:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eabc3 expref: 532 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.624537:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9800/0x2f180c4effbad4c2 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x620:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eabc3 expref: 532 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.624550:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x620:0x0].0x0 (ffff945bc812e300) 00010000:00010000:1.0:1762166984.624553:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166984.624555:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa9800, rc 0) 00000100:00100000:1.0:1762166984.624590:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+532:62503:x1847765450768768:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 163us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166984.624597:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30946 00000100:00100000:3.0:1762166984.625731:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166984.625851:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450769024 00000100:00100000:0.0:1762166984.625863:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450769024 00000100:00100000:0.0:1762166984.625916:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 12011 00000100:00100000:0.0:1762166984.625928:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc76aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+532:62503:x1847765450769024:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166984.626139:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc76aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+533:62503:x1847765450769024:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 213us (416us total) trans 4294992605 rc 0/0 00000100:00100000:0.0:1762166984.626148:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 12011 00000100:00100000:2.0:1762166984.626833:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166984.626870:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450769280 00000100:00100000:0.0:1762166984.626875:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450769280 00000100:00100000:0.0:1762166984.626903:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 12012 00000100:00100000:0.0:1762166984.626911:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+533:62503:x1847765450769280:12345-192.168.204.38@tcp:35:lfs.0 00000004:00080000:0.0:1762166984.627018:0:19593:0:(mdd_object.c:3965:mdd_close()) Object [0x240000404:0x621:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:0.0:1762166984.627084:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbad4c9 lrc: 3/0,1 mode: --/PW res: [0x240000404:0x621:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166984.627101:0:19593:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbad4c9 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x621:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166984.627112:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbad4c9 lrc: 3/0,1 mode: PW/PW res: [0x240000404:0x621:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166984.627120:0:19593:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbad4c9 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x621:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166984.627131:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbad4c9 lrc: 4/0,1 mode: PW/PW res: [0x240000404:0x621:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166984.627138:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbad4c9 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x621:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 19593 initiator: MDT1 00010000:00010000:0.0:1762166984.627164:0:19593:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1762166984.627181:0:10257:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1762166984.627187:0:10257:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbad4c9 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x621:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166984.627193:0:10257:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdf000 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:2.0:1762166984.627197:0:10257:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbad4c9 lrc: 2/0,0 mode: PW/PW res: [0x240000404:0x621:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166984.627203:0:10257:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbad4c9 lrc: 3/0,0 mode: PW/PW res: [0x240000404:0x621:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166984.627212:0:10257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x621:0x0].0x0 (ffff945bc812e900) 00010000:00010000:2.0:1762166984.627215:0:10257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1762166984.627218:0:10257:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbad4c9 lrc: 1/0,0 mode: --/PW res: [0x240000404:0x621:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166984.627222:0:10257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4bdf000/0x2f180c4effbad4c9 lrc: 0/0,0 mode: --/PW res: [0x240000404:0x621:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 19593 initiator: MDT1 00010000:00010000:2.0:1762166984.627232:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166984.627234:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166984.627235:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166984.627301:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+534:62503:x1847765450769280:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 390us (467us total) trans 4294992606 rc 0/0 00000100:00100000:0.0:1762166984.627310:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 12012 00000100:00100000:2.0:1762166984.633996:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166984.634057:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450769536 00000100:00100000:1.0:1762166984.634069:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450769536 00000100:00100000:1.0:1762166984.634143:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30947 00000100:00100000:1.0:1762166984.634157:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+534:62504:x1847765450769536:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166984.634188:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166984.634220:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbad4d0 lrc: 2/0,0 mode: --/CR res: [0x240000400:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eabca expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.634308:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbad4d7 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166984.634323:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbad4d7 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.634332:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbad4d7 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.634344:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbad4de lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166984.634351:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbad4de lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.634357:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbad4de lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.634442:0:12357:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbad4d7 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.634448:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbad4d7 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.634453:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbad4d7 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.634456:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbad4d7 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.634460:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa9a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166984.634463:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbad4d7 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.634468:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbad4d7 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.634508:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x6:0x0].0x0 (ffff945bc812ea00) 00010000:00010000:1.0:1762166984.634512:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166984.634516:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbad4d7 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.634521:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbad4d7 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.634533:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbad4de lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.634537:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbad4de lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.634541:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbad4de lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.634544:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa8e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166984.634545:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbad4de lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.634548:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbad4de lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.634552:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x6:0x0].0x10cd7725 (ffff945bc812ef00) 00010000:00010000:1.0:1762166984.634553:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166984.634555:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbad4de lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.634558:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbad4de lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.634588:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbad4d0 lrc: 1/0,0 mode: --/CR res: [0x240000400:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eabca expref: 535 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.634599:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x6:0x0].0x0 (ffff945bc812ea00) 00010000:00010000:1.0:1762166984.634601:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1762166984.634605:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbad4d0 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eabca expref: 535 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.634622:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa9c00, rc 0) 00000100:00100000:1.0:1762166984.634689:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+534:62504:x1847765450769536:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 536us (706us total) trans 0 rc 301/301 00000100:00100000:1.0:1762166984.634697:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30947 00000100:00100000:3.0:1762166984.636321:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166984.636386:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450769792 00000100:00100000:1.0:1762166984.636397:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450769792 00000100:00100000:1.0:1762166984.636447:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30948 00000100:00100000:1.0:1762166984.636468:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc76af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+534:62504:x1847765450769792:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166984.636514:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166984.636536:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbad4e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eabd1 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1762166984.636692:0:12357:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x61f:0x0]: returning size 4096 00010000:00010000:1.0:1762166984.636816:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbad4e5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eabd1 expref: 536 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.636829:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945bc812e800) 00010000:00010000:1.0:1762166984.636832:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1762166984.636836:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbad4e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eabd1 expref: 536 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.636853:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa9000, rc 0) 00000100:00100000:1.0:1762166984.636906:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc76af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+535:62504:x1847765450769792:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 443us (595us total) trans 4294992607 rc 301/301 00000100:00100000:1.0:1762166984.636913:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30948 00000100:00100000:2.0:1762166984.638318:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166984.638356:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450769920 00000100:00100000:1.0:1762166984.638367:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450769920 00000100:00100000:1.0:1762166984.638408:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30949 00000100:00100000:1.0:1762166984.638416:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+535:62504:x1847765450769920:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:1.0:1762166984.638474:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbad4f3 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166984.638520:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbad4f3 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.638532:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbad4f3 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.638544:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9400/0x2f180c4effbad4fa lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166984.638550:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9400/0x2f180c4effbad4fa lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.638556:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9400/0x2f180c4effbad4fa lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.638622:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbad501 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x620:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166984.638631:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbad501 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x620:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.638638:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbad501 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x620:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00000004:00200000:1.0:1762166984.638675:0:12357:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x620:0x0]: returning size 0 00000004:00200000:1.0:1762166984.638680:0:12357:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166984.638691:0:12357:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbad501 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x620:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.638704:0:12357:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbad4f3 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.638711:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbad4f3 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.638717:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbad4f3 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.638723:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbad4f3 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.638729:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa8800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166984.638733:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbad4f3 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.638741:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbad4f3 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.638762:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x6:0x0].0x0 (ffff945bc812ed00) 00010000:00010000:1.0:1762166984.638765:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166984.638768:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbad4f3 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.638774:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbad4f3 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.638789:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9400/0x2f180c4effbad4fa lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.638795:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9400/0x2f180c4effbad4fa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.638801:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9400/0x2f180c4effbad4fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.638806:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa9400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166984.638809:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9400/0x2f180c4effbad4fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.638814:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9400/0x2f180c4effbad4fa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.638820:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x6:0x0].0x10cd7725 (ffff945bc812eb00) 00010000:00010000:1.0:1762166984.638822:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166984.638825:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9400/0x2f180c4effbad4fa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.638831:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9400/0x2f180c4effbad4fa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.638842:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbad501 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x620:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.638846:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbad501 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x620:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.638851:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbad501 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x620:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.638856:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa9e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166984.638859:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbad501 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x620:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.638865:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbad501 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x620:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.638871:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x620:0x0].0x0 (ffff945bc812e300) 00010000:00010000:1.0:1762166984.638873:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166984.638876:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbad501 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x620:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.638881:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbad501 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x620:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00000100:00100000:1.0:1762166984.638938:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+535:62504:x1847765450769920:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 519us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166984.638946:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30949 00000100:00100000:2.0:1762166984.639793:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166984.639853:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450770176 00000100:00100000:0.0:1762166984.639864:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450770176 00000100:00100000:0.0:1762166984.639914:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 12013 00000100:00100000:0.0:1762166984.639923:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+535:62504:x1847765450770176:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166984.640113:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+536:62504:x1847765450770176:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 191us (322us total) trans 4294992608 rc 0/0 00000100:00100000:0.0:1762166984.640119:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 12013 00000100:00100000:3.0:1762166984.649176:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166984.649282:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450770432 00000100:00100000:1.0:1762166984.649295:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450770432 00000100:00100000:1.0:1762166984.649365:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30950 00000100:00100000:1.0:1762166984.649375:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc76adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+536:62506:x1847765450770432:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166984.649398:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166984.649419:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbad508 lrc: 2/0,0 mode: --/CR res: [0x240000400:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eabd8 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.649515:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9400/0x2f180c4effbad50f lrc: 3/1,0 mode: --/CR res: [0x240000400:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166984.649529:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9400/0x2f180c4effbad50f lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.649540:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9400/0x2f180c4effbad50f lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.649556:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbad516 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166984.649563:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbad516 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.649569:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbad516 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.649633:0:12357:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9400/0x2f180c4effbad50f lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.649640:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9400/0x2f180c4effbad50f lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.649645:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9400/0x2f180c4effbad50f lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.649651:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9400/0x2f180c4effbad50f lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.649657:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa9400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166984.649661:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9400/0x2f180c4effbad50f lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.649668:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9400/0x2f180c4effbad50f lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.649679:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x6:0x0].0x0 (ffff945bc812eb00) 00010000:00010000:1.0:1762166984.649682:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166984.649685:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9400/0x2f180c4effbad50f lrc: 3/0,0 mode: --/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.649692:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9400/0x2f180c4effbad50f lrc: 0/0,0 mode: --/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.649705:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbad516 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.649711:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbad516 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.649717:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbad516 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.649722:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa8800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166984.649724:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbad516 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.649730:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbad516 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.649735:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x6:0x0].0x10cd7725 (ffff945bc812ed00) 00010000:00010000:1.0:1762166984.649738:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166984.649740:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbad516 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.649759:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbad516 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.649787:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbad508 lrc: 1/0,0 mode: --/CR res: [0x240000400:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eabd8 expref: 537 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.649797:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x6:0x0].0x0 (ffff945bc812eb00) 00010000:00010000:1.0:1762166984.649799:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1762166984.649802:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbad508 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eabd8 expref: 537 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.649817:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa9e00, rc 0) 00000100:00100000:1.0:1762166984.649874:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc76adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+536:62506:x1847765450770432:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 501us (711us total) trans 0 rc 301/301 00000100:00100000:1.0:1762166984.649881:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30950 00000100:00100000:2.0:1762166984.651057:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166984.651100:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450770688 00000100:00100000:1.0:1762166984.651106:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450770688 00000100:00100000:1.0:1762166984.651141:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30951 00000100:00100000:1.0:1762166984.651149:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7b20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+536:62506:x1847765450770688:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166984.651159:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166984.651170:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbad51d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eabdf expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.651296:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbad524 lrc: 3/1,0 mode: --/CR res: [0x240000404:0x61f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166984.651307:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbad524 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x61f:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.651314:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbad524 lrc: 3/1,0 mode: CR/CR res: [0x240000404:0x61f:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00000004:00200000:1.0:1762166984.651323:0:12357:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x61f:0x0]: returning size 4096 00010000:00010000:1.0:1762166984.651412:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbad51d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eabdf expref: 539 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.651429:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9c00/0x2f180c4effbad524 lrc: 3/0,0 mode: CR/CR res: [0x240000404:0x61f:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eabdf expref: 538 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.651441:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x61f:0x0].0x0 (ffff945bc812e700) 00010000:00010000:1.0:1762166984.651443:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1762166984.651445:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa9c00, rc 0) 00000100:00100000:1.0:1762166984.651504:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7b20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+538:62506:x1847765450770688:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 330us (422us total) trans 4294992609 rc 0/0 00000100:00100000:1.0:1762166984.651513:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30951 00000100:00100000:2.0:1762166984.652281:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166984.652327:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450770816 00000100:00100000:1.0:1762166984.652332:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450770816 00000100:00100000:1.0:1762166984.652364:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30952 00000100:00100000:1.0:1762166984.652373:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5bc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+538:62506:x1847765450770816:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:1.0:1762166984.652412:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbad532 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166984.652421:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbad532 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.652429:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbad532 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.652439:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbad539 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166984.652445:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbad539 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.652451:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbad539 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.652517:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbad540 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x620:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166984.652526:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbad540 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x620:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.652533:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbad540 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x620:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00000004:00200000:1.0:1762166984.652558:0:12357:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x620:0x0]: returning size 0 00000004:00200000:1.0:1762166984.652563:0:12357:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166984.652571:0:12357:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbad540 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x620:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.652582:0:12357:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbad532 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.652588:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbad532 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.652594:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbad532 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.652600:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbad532 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.652606:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa8e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166984.652609:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbad532 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.652615:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbad532 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.652624:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x6:0x0].0x0 (ffff945bc812ea00) 00010000:00010000:1.0:1762166984.652627:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166984.652630:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbad532 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.652636:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbad532 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.652648:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbad539 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.652654:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbad539 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.652659:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbad539 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.652664:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa9a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166984.652666:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbad539 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.652671:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbad539 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.652678:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x6:0x0].0x10cd7725 (ffff945bc812ef00) 00010000:00010000:1.0:1762166984.652681:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166984.652684:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbad539 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.652689:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbad539 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.652699:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbad540 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x620:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.652706:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbad540 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x620:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.652714:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbad540 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x620:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.652719:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa8000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166984.652722:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbad540 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x620:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.652728:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbad540 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x620:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.652734:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x620:0x0].0x0 (ffff945bc812e300) 00010000:00010000:1.0:1762166984.652736:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166984.652739:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbad540 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x620:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.652760:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbad540 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x620:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00000100:00100000:1.0:1762166984.652802:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5bc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+538:62506:x1847765450770816:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 431us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166984.652810:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30952 00000100:00100000:3.0:1762166984.663463:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166984.663522:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450771072 00000100:00100000:1.0:1762166984.663532:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450771072 00000100:00100000:1.0:1762166984.663592:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30953 00000100:00100000:1.0:1762166984.663604:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc76ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+538:62509:x1847765450771072:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166984.663623:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166984.663643:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbad547 lrc: 2/0,0 mode: --/CR res: [0x240000400:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eabe6 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.663712:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbad54e lrc: 3/1,0 mode: --/CR res: [0x240000400:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166984.663726:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbad54e lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.663735:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbad54e lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.663759:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbad555 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166984.663766:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbad555 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.663772:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbad555 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.663838:0:12357:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbad54e lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.663845:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbad54e lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.663851:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbad54e lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.663857:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbad54e lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.663862:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa9a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166984.663865:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbad54e lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.663871:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbad54e lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.663885:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x6:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:1.0:1762166984.663888:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166984.663892:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbad54e lrc: 3/0,0 mode: --/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.663898:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbad54e lrc: 0/0,0 mode: --/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.663909:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbad555 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.663915:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbad555 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.663920:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbad555 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.663934:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa8e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166984.663939:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbad555 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.663945:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbad555 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.663952:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x6:0x0].0x10cd7725 (ffff945bc812ea00) 00010000:00010000:1.0:1762166984.663955:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166984.663958:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbad555 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.663963:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbad555 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.663991:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbad547 lrc: 1/0,0 mode: --/CR res: [0x240000400:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eabe6 expref: 539 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.664002:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x6:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:1.0:1762166984.664004:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1762166984.664008:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbad547 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eabe6 expref: 539 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.664019:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa8000, rc 0) 00000100:00100000:1.0:1762166984.664074:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc76ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+538:62509:x1847765450771072:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 473us (616us total) trans 0 rc 301/301 00000100:00100000:1.0:1762166984.664079:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30953 00000100:00100000:2.0:1762166984.665228:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166984.665267:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450771200 00000100:00100000:1.0:1762166984.665273:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450771200 00000100:00100000:1.0:1762166984.665303:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30954 00000100:00100000:1.0:1762166984.665313:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7cadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+538:62509:x1847765450771200:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:1.0:1762166984.665346:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbad55c lrc: 3/1,0 mode: --/CR res: [0x240000400:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166984.665355:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbad55c lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.665362:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbad55c lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.665371:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbad563 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166984.665376:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbad563 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.665382:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbad563 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.665431:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbad56a lrc: 3/1,0 mode: --/PR res: [0x240000404:0x620:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166984.665439:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbad56a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x620:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.665445:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbad56a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x620:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00000004:00200000:1.0:1762166984.665499:0:12357:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x620:0x0]: returning size 0 00000004:00200000:1.0:1762166984.665503:0:12357:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166984.665515:0:12357:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbad56a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x620:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.665525:0:12357:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbad55c lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.665531:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbad55c lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.665536:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbad55c lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.665542:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbad55c lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.665546:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa9000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166984.665550:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbad55c lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.665555:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbad55c lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.665563:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x6:0x0].0x0 (ffff945bc812e800) 00010000:00010000:1.0:1762166984.665567:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166984.665570:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbad55c lrc: 3/0,0 mode: --/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.665575:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbad55c lrc: 0/0,0 mode: --/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.665586:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbad563 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.665592:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbad563 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.665597:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbad563 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.665602:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa9e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166984.665604:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbad563 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.665610:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbad563 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.665615:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x6:0x0].0x10cd7725 (ffff945bc812eb00) 00010000:00010000:1.0:1762166984.665618:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166984.665620:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbad563 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.665626:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbad563 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.665634:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbad56a lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x620:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.665639:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbad56a lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x620:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.665645:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbad56a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x620:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.665650:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa8800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166984.665652:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbad56a lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x620:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.665657:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbad56a lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x620:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.665663:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x620:0x0].0x0 (ffff945bc812e300) 00010000:00010000:1.0:1762166984.665665:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166984.665667:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbad56a lrc: 2/0,0 mode: --/PR res: [0x240000404:0x620:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.665672:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbad56a lrc: 0/0,0 mode: --/PR res: [0x240000404:0x620:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00000100:00100000:1.0:1762166984.665712:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7cadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+538:62509:x1847765450771200:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 402us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166984.665720:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30954 00000100:00100000:2.0:1762166984.676331:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166984.676398:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450771456 00000100:00100000:1.0:1762166984.676407:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450771456 00000100:00100000:1.0:1762166984.676453:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30955 00000100:00100000:1.0:1762166984.676460:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7cac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+538:62512:x1847765450771456:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166984.676507:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166984.676529:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbad571 lrc: 2/0,0 mode: --/CR res: [0x240000400:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eabed expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.676604:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbad578 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166984.676629:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbad578 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.676642:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbad578 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.676652:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbad57f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166984.676656:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbad57f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.676660:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbad57f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.676718:0:12357:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbad578 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.676722:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbad578 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.676725:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbad578 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.676729:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbad578 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.676733:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa9e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166984.676735:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbad578 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.676739:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbad578 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.676769:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x6:0x0].0x0 (ffff945bc812eb00) 00010000:00010000:1.0:1762166984.676771:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166984.676774:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbad578 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.676779:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9e00/0x2f180c4effbad578 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.676790:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbad57f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.676794:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbad57f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.676797:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbad57f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.676800:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa9000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166984.676801:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbad57f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.676804:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbad57f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.676808:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x6:0x0].0x10cd7725 (ffff945bc812e800) 00010000:00010000:1.0:1762166984.676809:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166984.676810:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbad57f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.676813:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9000/0x2f180c4effbad57f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.676835:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbad571 lrc: 1/0,0 mode: --/CR res: [0x240000400:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eabed expref: 539 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.676842:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x6:0x0].0x0 (ffff945bc812eb00) 00010000:00010000:1.0:1762166984.676844:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1762166984.676846:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8800/0x2f180c4effbad571 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eabed expref: 539 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166984.676853:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa8800, rc 0) 00000100:00100000:1.0:1762166984.676898:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7cac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+538:62512:x1847765450771456:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 439us (577us total) trans 0 rc 301/301 00000100:00100000:1.0:1762166984.676903:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30955 00000100:00100000:3.0:1762166984.677941:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166984.677983:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450771584 00000100:00100000:1.0:1762166984.677987:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450771584 00000100:00100000:1.0:1762166984.678012:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30956 00000100:00100000:1.0:1762166984.678017:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc76aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+538:62512:x1847765450771584:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:1.0:1762166984.678043:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbad586 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166984.678050:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbad586 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.678055:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbad586 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.678064:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbad58d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166984.678071:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbad58d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.678077:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbad58d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.678112:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbad594 lrc: 3/1,0 mode: --/PR res: [0x240000404:0x620:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166984.678118:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbad594 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x620:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.678122:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbad594 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x620:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00000004:00200000:1.0:1762166984.678153:0:12357:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000404:0x620:0x0]: returning size 0 00000004:00200000:1.0:1762166984.678156:0:12357:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166984.678165:0:12357:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbad594 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x620:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.678172:0:12357:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbad586 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.678176:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbad586 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.678179:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbad586 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.678183:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbad586 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.678185:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa8000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166984.678187:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbad586 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.678190:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbad586 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.678195:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x6:0x0].0x0 (ffff945bc812ef00) 00010000:00010000:1.0:1762166984.678197:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166984.678199:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbad586 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.678202:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8000/0x2f180c4effbad586 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.678210:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbad58d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.678213:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbad58d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.678217:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbad58d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.678222:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa8e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166984.678225:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbad58d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.678230:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbad58d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.678237:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x6:0x0].0x10cd7725 (ffff945bc812ea00) 00010000:00010000:1.0:1762166984.678240:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166984.678242:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbad58d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.678247:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa8e00/0x2f180c4effbad58d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x10cd7725 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.678257:0:12357:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbad594 lrc: 3/1,0 mode: PR/PR res: [0x240000404:0x620:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.678263:0:12357:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbad594 lrc: 2/0,0 mode: PR/PR res: [0x240000404:0x620:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.678269:0:12357:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbad594 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x620:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.678272:0:12357:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa9a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166984.678274:0:12357:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbad594 lrc: 3/0,0 mode: PR/PR res: [0x240000404:0x620:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.678277:0:12357:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbad594 lrc: 4/0,0 mode: PR/PR res: [0x240000404:0x620:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.678281:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000404:0x620:0x0].0x0 (ffff945bc812e300) 00010000:00010000:1.0:1762166984.678282:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166984.678284:0:12357:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbad594 lrc: 2/0,0 mode: --/PR res: [0x240000404:0x620:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00010000:00010000:1.0:1762166984.678287:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff945bc4aa9a00/0x2f180c4effbad594 lrc: 0/0,0 mode: --/PR res: [0x240000404:0x620:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12357 initiator: MDT1 00000100:00100000:1.0:1762166984.678322:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc76aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+538:62512:x1847765450771584:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 305us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166984.678327:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30956 00000100:00100000:1.0:1762166984.978651:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc442c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449806080:0@lo:13:osp-pre-1-1.0 00000004:00080000:0.0:1762166984.978651:0:9996:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 604127170667ns, next at 605127166852ns, rc = 0 00000100:00100000:1.0:1762166984.978759:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166984.978799:0:12247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449806080 00000100:00100000:0.0:1762166984.978807:0:12247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449806080 00000100:00100000:0.0:1762166984.978866:0:12247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1762166984.978876:0:12247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7dedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+9:3635:x1847765449806080:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1762166984.978902:0:12247:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 485126592 pending 286720 free 3921199104 avail 3689676800 00000100:00100000:0.0:1762166984.978969:0:12247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7dedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+9:3635:x1847765449806080:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166984.978977:0:12247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1762166984.979013:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc442c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449806080:0@lo:13:osp-pre-1-1.0 00000001:02000400:3.0:1762166985.542195:0:35773:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: ** lfs fid2path /mnt/lustre [0x240000404:0x620:0x0] 00010000:00010000:0.0:1762166985.554601:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1762166985.561572:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166985.561635:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450771712 00000100:00100000:1.0:1762166985.561648:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450771712 00000100:00080000:3.0:1762166985.561725:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1762166985.561761:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30957 00000100:00100000:1.0:1762166985.561777:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7cafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+538:62682:x1847765450771712:12345-192.168.204.38@tcp:53:lfs.0 00000004:00000080:1.0:1762166985.561820:0:12357:0:(mdt_handler.c:7894:mdt_fid2path()) path get [0x240000404:0x620:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1762166985.562040:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7cafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1e11365-ba0b-405b-99c9-a704373217f2+538:62682:x1847765450771712:12345-192.168.204.38@tcp:53:lfs.0 Request processed in 267us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166985.562049:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30957 00000100:00100000:0.0:1762166986.002748:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc442e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765449806336:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1762166986.002814:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc76ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5309af7-bf8a-40d1-8f22-842c4953c1ea:3633:1847765449806464:0@lo:400:kworker.0 00000100:00100000:0.0:1762166986.002845:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166986.002883:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166986.002884:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc76af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449806592:0@lo:400:kworker.0 00000100:00100000:3.0:1762166986.002926:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166986.002930:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7caea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765449806208:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1762166986.002934:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc76af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449806976:0@lo:400:kworker.0 00000100:00100000:3.0:1762166986.002961:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc76ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449807104:0@lo:400:kworker.0 00000100:00100000:0.0:1762166986.002978:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166986.002983:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166986.003008:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449806336 00000100:00100000:3.0:1762166986.003018:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449806336 00000100:00100000:0.0:1762166986.003022:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7caf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765449806848:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1762166986.003038:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7bb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1847765449807488:0@lo:400:kworker.0 00000100:00100000:0.0:1762166986.003055:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166986.003076:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449806592 00000100:00100000:2.0:1762166986.003077:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166986.003082:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449806592 00000100:00100000:0.0:1762166986.003084:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7cadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449807360:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1762166986.003112:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1505 00000100:00100000:2.0:1762166986.003119:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7bb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765449808000:0@lo:400:kworker.0 00000100:00100000:1.0:1762166986.003121:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449807488 00000100:00100000:3.0:1762166986.003126:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc442dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1847765449806336:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1762166986.003129:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449807488 00000100:00100000:0.0:1762166986.003130:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166986.003151:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7bb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765449807872:0@lo:400:kworker.0 00000100:00100000:2.0:1762166986.003153:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:3.0:1762166986.003180:0:6500:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445212160 avail 1298972672 00000100:00100000:0.0:1762166986.003188:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166986.003193:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 670 00000100:00100000:2.0:1762166986.003200:0:32221:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449806464 00000100:00100000:2.0:1762166986.003205:0:32221:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449806464 00000100:00100000:1.0:1762166986.003207:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7caed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1847765449807488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1762166986.003210:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:0.0:1762166986.003219:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc76ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3636:1847765449806720:0@lo:400:kworker.0 00000100:00100000:3.0:1762166986.003240:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc442dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1847765449806336:12345-0@lo:41:osp-pre-1-0.0 Request processed in 116us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166986.003247:0:32221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1762166986.003256:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1505 00000100:00100000:0.0:1762166986.003261:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166986.003263:0:32221:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc34e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5309af7-bf8a-40d1-8f22-842c4953c1ea+23:3633:x1847765449806464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1762166986.003271:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7caed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1847765449807488:12345-0@lo:400:kworker.0 Request processed in 67us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166986.003281:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 670 00000100:00100000:0.0:1762166986.003288:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc76aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3636:1847765449807232:0@lo:400:kworker.0 00000100:00100000:3.0:1762166986.003289:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449807360 00000100:00100000:3.0:1762166986.003298:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449807360 00000100:00100000:1.0:1762166986.003304:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449806720 00000100:00100000:1.0:1762166986.003309:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449806720 00000100:00100000:2.0:1762166986.003310:0:32221:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc34e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5309af7-bf8a-40d1-8f22-842c4953c1ea+23:3633:x1847765449806464:12345-0@lo:400:kworker.0 Request processed in 53us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166986.003321:0:32221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1762166986.003327:0:6500:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449807872 00000100:00100000:0.0:1762166986.003329:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166986.003333:0:6500:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449807872 00000100:00100000:1.0:1762166986.003344:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449807232 00000100:00100000:1.0:1762166986.003349:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449807232 00000100:00100000:0.0:1762166986.003358:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7bb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1847765449807744:0@lo:400:kworker.0 00000100:00100000:3.0:1762166986.003361:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1506 00000100:00100000:2.0:1762166986.003373:0:7427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1507 00000100:00100000:3.0:1762166986.003375:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7bb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:3634:x1847765449806592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1762166986.003383:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 671 00000100:00100000:2.0:1762166986.003387:0:7427:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc442f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:3636:x1847765449807360:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1762166986.003394:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166986.003397:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc6a96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1847765449806720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1762166986.003417:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7bb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3636:1847765449808256:0@lo:400:kworker.0 00000004:00000024:2.0:1762166986.003418:0:7427:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445842944 avail 1299603456 00000100:00100000:3.0:1762166986.003421:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7bb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:3634:x1847765449806592:12345-0@lo:400:kworker.0 Request processed in 48us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166986.003433:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1506 00000100:00100000:1.0:1762166986.003445:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc6a96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1847765449806720:12345-0@lo:400:kworker.0 Request processed in 50us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166986.003454:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1508 00000100:00100000:1.0:1762166986.003455:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 671 00000100:00100000:0.0:1762166986.003461:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166986.003470:0:6500:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc442c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1847765449807872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1762166986.003504:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449807744 00000100:00100000:1.0:1762166986.003508:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449807744 00000100:00100000:2.0:1762166986.003520:0:7427:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc442f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3636:x1847765449807360:12345-0@lo:41:osp-pre-0-1.0 Request processed in 138us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166986.003530:0:7427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1507 00000100:00100000:1.0:1762166986.003533:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449808256 00000100:00100000:1.0:1762166986.003537:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449808256 00000100:00100000:3.0:1762166986.003542:0:6500:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc442c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1847765449807872:12345-0@lo:400:kworker.0 Request processed in 76us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166986.003548:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7cadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3636:1847765449807360:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1762166986.003555:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1508 00000100:00100000:1.0:1762166986.003562:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 672 00000100:00100000:2.0:1762166986.003566:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449806976 00000100:00100000:2.0:1762166986.003573:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449806976 00000100:00100000:0.0:1762166986.003573:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7bb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765449807872:0@lo:400:kworker.0 00000100:00100000:1.0:1762166986.003574:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4bd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1847765449807232:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1762166986.003581:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1762166986.003588:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1762166986.003590:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1762166986.003598:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc442e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765449806336:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1762166986.003609:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 673 00000100:00100000:2.0:1762166986.003617:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449808000 00000100:00100000:3.0:1762166986.003622:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1847765449807744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1762166986.003623:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449808000 00000100:00100000:1.0:1762166986.003623:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4bd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1847765449807232:12345-0@lo:400:kworker.0 Request processed in 50us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166986.003634:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 672 00000100:00100000:0.0:1762166986.003645:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc76ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3636:1847765449806720:0@lo:400:kworker.0 00000100:00100000:1.0:1762166986.003660:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 674 00000100:00100000:3.0:1762166986.003661:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1847765449807744:12345-0@lo:400:kworker.0 Request processed in 44us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166986.003668:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc76aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3636:1847765449807232:0@lo:400:kworker.0 00000100:00100000:2.0:1762166986.003673:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:3.0:1762166986.003674:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 673 00000100:00100000:1.0:1762166986.003676:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1847765449808256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1762166986.003690:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7cad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+14:3633:x1847765449806976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1762166986.003693:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7bb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3636:1847765449807744:0@lo:400:kworker.0 00000100:00100000:3.0:1762166986.003711:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:3.0:1762166986.003733:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7cae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1847765449808000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1762166986.003735:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1847765449808256:12345-0@lo:400:kworker.0 Request processed in 62us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166986.003746:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7bb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3636:1847765449808256:0@lo:400:kworker.0 00000100:00100000:1.0:1762166986.003747:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 674 00000100:00100000:2.0:1762166986.003756:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7cad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+14:3633:x1847765449806976:12345-0@lo:400:kworker.0 Request processed in 69us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166986.003765:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:3.0:1762166986.003781:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7cae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1847765449808000:12345-0@lo:400:kworker.0 Request processed in 61us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166986.003789:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:0.0:1762166986.003795:0:12247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449806208 00000100:00100000:0.0:1762166986.003800:0:12247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449806208 00000100:00080000:3.0:1762166986.003816:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1762166986.003823:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7bb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3633:1847765449807488:0@lo:400:kworker.0 00000100:00100000:3.0:1762166986.003831:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166986.003841:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7bb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765449808000:0@lo:400:kworker.0 00000100:00100000:0.0:1762166986.003841:0:12247:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449806848 00000100:00100000:0.0:1762166986.003847:0:12247:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449806848 00000100:00100000:3.0:1762166986.003861:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7bb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3634:1847765449807616:0@lo:400:kworker.0 00000100:00100000:2.0:1762166986.003862:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc76ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5309af7-bf8a-40d1-8f22-842c4953c1ea:3633:1847765449806464:0@lo:400:kworker.0 00000100:00100000:2.0:1762166986.003884:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc76af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3633:1847765449806976:0@lo:400:kworker.0 00000100:00100000:0.0:1762166986.003885:0:12247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1762166986.003895:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166986.003900:0:12247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc442f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1847765449806208:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1762166986.003923:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7bba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765449808128:0@lo:400:kworker.0 00002000:00000024:0.0:1762166986.003926:0:12247:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 81920 granted 484921792 pending 0 free 3918143488 avail 3686621184 00000100:00100000:2.0:1762166986.003927:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449807616 00000100:00100000:2.0:1762166986.003933:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449807616 00000100:00100000:3.0:1762166986.003948:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166986.003973:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 675 00000100:00100000:2.0:1762166986.003984:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7bbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1847765449807616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1762166986.003990:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc76af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449806592:0@lo:400:kworker.0 00000100:00100000:0.0:1762166986.003990:0:12247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc442f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1847765449806208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (1012us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166986.004004:0:12247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:0.0:1762166986.004022:0:12247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1762166986.004030:0:35248:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449807104 00000100:00100000:0.0:1762166986.004032:0:12247:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc442d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1847765449806848:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1762166986.004035:0:35248:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449807104 00000100:00100000:2.0:1762166986.004039:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7bbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1847765449807616:12345-0@lo:400:kworker.0 Request processed in 55us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166986.004048:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 675 00002000:00000024:0.0:1762166986.004057:0:12247:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 485126592 pending 286720 free 3921301504 avail 3689779200 00000100:00100000:3.0:1762166986.004073:0:35248:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449808128 00000100:00100000:3.0:1762166986.004078:0:35248:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449808128 00000100:00100000:0.0:1762166986.004094:0:12247:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc442d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3636:x1847765449806848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (1038us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166986.004099:0:8383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:0.0:1762166986.004109:0:12247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1762166986.004115:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:2.0:1762166986.004116:0:8383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+9:3634:x1847765449807104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1762166986.004129:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7bbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3634:x1847765449808128:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1762166986.004157:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1762166986.004162:0:8383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+9:3634:x1847765449807104:12345-0@lo:400:kworker.0 Request processed in 50us (329us total) trans 0 rc 0/0 00000100:00080000:0.0:1762166986.004163:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1762166986.004173:0:8383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:3.0:1762166986.004181:0:35248:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7bbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3634:x1847765449808128:12345-0@lo:400:kworker.0 Request processed in 55us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166986.004191:0:35248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:0.0:1762166986.004203:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7caf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765449806848:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1762166986.004214:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc76ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3634:1847765449807104:0@lo:400:kworker.0 00000100:00100000:0.0:1762166986.004220:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7caea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765449806208:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1762166986.004235:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7bb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3634:1847765449807616:0@lo:400:kworker.0 00000100:00100000:2.0:1762166986.004251:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7bba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765449808128:0@lo:400:kworker.0 00010000:00010000:2.0:1762166986.578593:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1762166987.538654:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000004:00080000:2.0:1762166987.538664:0:9159:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 606687184233ns, next at 607687179591ns, rc = 0 00000100:00100000:0.0:1762166987.538682:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7caf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449808384:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1762166987.538778:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1762166987.538833:0:9167:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449808384 00000100:00100000:2.0:1762166987.538843:0:9167:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449808384 00000100:00100000:2.0:1762166987.538905:0:9167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:2.0:1762166987.538919:0:9167:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4a2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+14:3635:x1847765449808384:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1762166987.538950:0:9167:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 81920 granted 484921792 pending 0 free 3918143488 avail 3686621184 00000100:00100000:2.0:1762166987.539005:0:9167:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4a2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+14:3635:x1847765449808384:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166987.539015:0:9167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1762166987.539054:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7caf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3635:1847765449808384:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1762166987.602679:0:6483:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1762166987.688708:0:35967:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-flr test 200a: stress test ===================== 05:49:47 (1762166987) 00000100:00100000:2.0:1762166987.724090:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166987.724141:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450771840 00000100:00100000:1.0:1762166987.724154:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450771840 00000100:00080000:0.0:1762166987.724212:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1762166987.724230:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30958 00000100:00100000:1.0:1762166987.724246:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7cac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+26:63267:x1847765450771840:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166987.724266:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166987.724286:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa8000/0x2f180c4effbad59b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eabf4 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166987.724350:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa8800/0x2f180c4effbad5a2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166987.724364:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa8800/0x2f180c4effbad5a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166987.724374:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa8800/0x2f180c4effbad5a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166987.724390:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa9000/0x2f180c4effbad5a9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166987.724397:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa9000/0x2f180c4effbad5a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166987.724404:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa9000/0x2f180c4effbad5a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166987.724445:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa8800/0x2f180c4effbad5a2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166987.724453:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa8800/0x2f180c4effbad5a2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166987.724459:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa8800/0x2f180c4effbad5a2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166987.724465:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa8800/0x2f180c4effbad5a2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166987.724471:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa8800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166987.724501:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa8800/0x2f180c4effbad5a2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166987.724509:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa8800/0x2f180c4effbad5a2 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166987.724522:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945cd0738700) 00010000:00010000:1.0:1762166987.724526:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166987.724531:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa8800/0x2f180c4effbad5a2 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166987.724537:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa8800/0x2f180c4effbad5a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166987.724548:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa9000/0x2f180c4effbad5a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166987.724554:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa9000/0x2f180c4effbad5a9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166987.724560:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa9000/0x2f180c4effbad5a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166987.724566:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa9000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166987.724570:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa9000/0x2f180c4effbad5a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166987.724577:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa9000/0x2f180c4effbad5a9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166987.724586:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x64c18fe5 (ffff945bc812eb00) 00010000:00010000:1.0:1762166987.724589:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166987.724592:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa9000/0x2f180c4effbad5a9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166987.724597:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa9000/0x2f180c4effbad5a9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166987.724626:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa8000/0x2f180c4effbad59b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eabf4 expref: 27 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166987.724636:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945cd0738700) 00010000:00010000:1.0:1762166987.724644:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166987.724648:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa8000/0x2f180c4effbad59b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eabf4 expref: 27 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166987.724657:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa8000, rc 0) 00000100:00100000:1.0:1762166987.724731:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7cac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+26:63267:x1847765450771840:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 491us (648us total) trans 0 rc 301/301 00000100:00100000:1.0:1762166987.724739:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30958 00000100:00100000:3.0:1762166987.726066:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166987.726104:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450772096 00000100:00100000:1.0:1762166987.726111:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450772096 00000100:00100000:1.0:1762166987.726146:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30959 00000100:00100000:1.0:1762166987.726157:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+26:63267:x1847765450772096:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166987.726172:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166987.726175:0:6496:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1762166987.726191:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355ba00/0x2f180c4effbad36b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eab53 expref: 26 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166987.726202:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945cd0738700) 00010000:00010000:1.0:1762166987.726205:0:6496:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166987.726212:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa9e00/0x2f180c4effbad5b0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eabfb expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166987.726273:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa9400/0x2f180c4effbad5b7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166987.726281:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa9400/0x2f180c4effbad5b7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166987.726287:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa9400/0x2f180c4effbad5b7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166987.726296:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa8e00/0x2f180c4effbad5be lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166987.726305:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa8e00/0x2f180c4effbad5be lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166987.726309:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa8e00/0x2f180c4effbad5be lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166987.726655:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa9a00/0x2f180c4effbad5c5 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x54:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166987.726661:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa9a00/0x2f180c4effbad5c5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166987.726669:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa9a00/0x2f180c4effbad5c5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:1.0:1762166987.726675:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x54:0x0]: returning size 0 00010000:00010000:1.0:1762166987.726702:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa9400/0x2f180c4effbad5b7 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166987.726706:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa9400/0x2f180c4effbad5b7 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166987.726711:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa9400/0x2f180c4effbad5b7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166987.726725:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa9400/0x2f180c4effbad5b7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166987.726734:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa9400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166987.726737:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa9400/0x2f180c4effbad5b7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166987.726743:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa9400/0x2f180c4effbad5b7 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166987.726752:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945cd0738700) 00010000:00010000:1.0:1762166987.726755:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166987.726758:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa9400/0x2f180c4effbad5b7 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166987.726764:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa9400/0x2f180c4effbad5b7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00000004:00010000:1.0:1762166987.726775:0:6496:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000006a98eb02 reply state 000000009e57b633 transno 8589935336 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa8e00/0x2f180c4effbad5be lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166987.726790:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa8e00/0x2f180c4effbad5be lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166987.726797:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x64c18fe5 (ffff945bc812e800) 00010000:00010000:1.0:1762166987.726800:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166987.726803:0:6496:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1762166987.726825:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa9e00/0x2f180c4effbad5b0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eabfb expref: 28 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166987.726839:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa9a00/0x2f180c4effbad5c5 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eabfb expref: 27 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166987.726844:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x54:0x0].0x0 (ffff945bc812ed00) 00010000:00010000:1.0:1762166987.726846:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166987.726847:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa9a00, rc 0) 00000100:00100000:1.0:1762166987.726888:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+28:63267:x1847765450772096:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 734us (825us total) trans 8589935336 rc 0/0 00000100:00100000:1.0:1762166987.726895:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30959 00000100:00100000:3.0:1762166987.728212:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166987.728288:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450772352 00000100:00100000:2.0:1762166987.728295:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450772352 00000100:00100000:2.0:1762166987.728335:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30960 00000100:00100000:2.0:1762166987.728346:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7bb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+28:63267:x1847765450772352:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166987.728360:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166987.728372:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355b800/0x2f180c4effbad5d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eac02 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166987.728439:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355a800/0x2f180c4effbad5da lrc: 3/0,1 mode: --/EX res: [0x200000405:0x54:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166987.728451:0:6496:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa9a00/0x2f180c4effbad5c5 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eabfb expref: 29 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166987.728459:0:6496:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355a800/0x2f180c4effbad5da lrc: 4/0,1 mode: --/EX res: [0x200000405:0x54:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166987.728513:0:6496:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa9a00/0x2f180c4effbad5c5 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eabfb expref: 29 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166987.728526:0:6496:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa9a00/0x2f180c4effbad5c5 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eabfb expref: 29 pid: 6496 timeout: 706 lvb_type: 0 00000100:00100000:2.0:1762166987.728540:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7caf480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1847765449808512:192.168.204.38@tcp:104: 00000100:00100000:2.0:1762166987.728607:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cd123b480 going to sleep for 11 seconds 00000100:00100000:2.0:1762166987.730461:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7caf480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1847765449808512:192.168.204.38@tcp:104: 00010000:00010000:2.0:1762166987.730495:0:6496:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355a800/0x2f180c4effbad5da lrc: 3/0,1 mode: --/EX res: [0x200000405:0x54:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000100:00100000:3.0:1762166987.730855:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166987.730920:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450772480 00000100:00100000:1.0:1762166987.730927:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450772480 00010000:00010000:1.0:1762166987.730955:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa9a00/0x2f180c4effbad5c5 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eabfb expref: 30 pid: 6496 timeout: 706 lvb_type: 0 00000100:00100000:1.0:1762166987.730998:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9860 00000100:00100000:1.0:1762166987.731009:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf9d1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+30:2418:x1847765450772480:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166987.731022:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166987.731028:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa9a00/0x2f180c4effbad5c5 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eabfb expref: 30 pid: 6496 timeout: 706 lvb_type: 0 00010000:00010000:1.0:1762166987.731048:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa9a00/0x2f180c4effbad5c5 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eabfb expref: 30 pid: 6496 timeout: 706 lvb_type: 0 00010000:00010000:1.0:1762166987.731069:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa9a00/0x2f180c4effbad5c5 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eabfb expref: 30 pid: 6496 timeout: 706 lvb_type: 0 00010000:00010000:1.0:1762166987.731084:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x54:0x0].0x0 (ffff945bc812ed00) 00010000:00010000:1.0:1762166987.731089:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355a800/0x2f180c4effbad5da lrc: 3/0,1 mode: --/EX res: [0x200000405:0x54:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166987.731097:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355a800/0x2f180c4effbad5da lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x54:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166987.731104:0:6479:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355a800/0x2f180c4effbad5da lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x54:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166987.731129:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1762166987.731152:0:6496:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355a800/0x2f180c4effbad5da lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x54:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166987.731162:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355a800/0x2f180c4effbad5da lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x54:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:2.0:1762166987.731179:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x54:0x0]: returning size 0 00000100:00100000:1.0:1762166987.731182:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf9d1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+29:2418:x1847765450772480:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 176us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166987.731193:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9860 00000004:00080000:2.0:1762166987.731445:0:6496:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x75:0x0], index 1: 0 00010000:00010000:2.0:1762166987.731639:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355a800/0x2f180c4effbad5da lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x54:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166987.731650:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355a800/0x2f180c4effbad5da lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x54:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166987.731658:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355a800/0x2f180c4effbad5da lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x54:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166987.731664:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc355a800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166987.731669:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355a800/0x2f180c4effbad5da lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x54:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166987.731678:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355a800/0x2f180c4effbad5da lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x54:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166987.731713:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x54:0x0].0x0 (ffff945bc812ed00) 00010000:00010000:2.0:1762166987.731717:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1762166987.731722:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355a800/0x2f180c4effbad5da lrc: 2/0,0 mode: --/EX res: [0x200000405:0x54:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166987.731729:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355a800/0x2f180c4effbad5da lrc: 0/0,0 mode: --/EX res: [0x200000405:0x54:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166987.731812:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355b800/0x2f180c4effbad5d3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac02 expref: 29 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166987.731826:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945cd0738700) 00010000:00010000:2.0:1762166987.731829:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1762166987.731834:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355b800/0x2f180c4effbad5d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac02 expref: 29 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166987.731847:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355b800, rc 0) 00000100:00100000:2.0:1762166987.731929:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7bb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+28:63267:x1847765450772352:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 3578us (3712us total) trans 8589935337 rc 301/301 00000100:00100000:2.0:1762166987.731943:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30960 00000100:00100000:2.0:1762166987.733048:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166987.733156:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450772736 00000100:00100000:0.0:1762166987.733165:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450772736 00000100:00100000:0.0:1762166987.733216:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 12014 00000100:00100000:0.0:1762166987.733227:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7caf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+28:63267:x1847765450772736:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166987.733522:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7caf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+29:63267:x1847765450772736:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 252us (434us total) trans 8589935338 rc 0/0 00000100:00100000:0.0:1762166987.733533:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 12014 00000100:00100000:2.0:1762166987.734742:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166987.734802:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450772992 00000100:00100000:0.0:1762166987.734811:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450772992 00000100:00100000:0.0:1762166987.734875:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 12015 00000100:00100000:0.0:1762166987.734887:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7cad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+29:63267:x1847765450772992:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166987.735106:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7cad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+30:63267:x1847765450772992:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 222us (369us total) trans 8589935339 rc 0/0 00000100:00100000:0.0:1762166987.735113:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 12015 00000100:00100000:1.0:1762166987.742762:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166987.742798:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450773120 00000100:00100000:2.0:1762166987.742809:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450773120 00000100:00100000:2.0:1762166987.742867:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30961 00000100:00100000:2.0:1762166987.742880:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7def100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+30:63270:x1847765450773120:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166987.742905:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166987.742926:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355b800/0x2f180c4effbad5e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eac09 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166987.743006:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355a800/0x2f180c4effbad5ef lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166987.743021:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355a800/0x2f180c4effbad5ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166987.743033:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355a800/0x2f180c4effbad5ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:2.0:1762166987.743099:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1762166987.743104:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166987.743131:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355a800/0x2f180c4effbad5ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166987.743159:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355b800/0x2f180c4effbad5e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac09 expref: 32 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166987.743177:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355a800/0x2f180c4effbad5ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac09 expref: 31 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166987.743188:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945cd0738700) 00010000:00010000:2.0:1762166987.743195:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1762166987.743200:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355a800, rc 0) 00000100:00100000:2.0:1762166987.743283:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7def100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+31:63270:x1847765450773120:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 406us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166987.743294:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30961 00000100:00100000:0.0:1762166987.745152:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166987.745348:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450773248 00000100:00100000:0.0:1762166987.745355:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450773248 00000100:00100000:0.0:1762166987.745396:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30962 00000100:00100000:0.0:1762166987.745407:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc76ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+31:63270:x1847765450773248:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166987.745422:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166987.745440:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde800/0x2f180c4effbad5f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eac10 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166987.745534:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde000/0x2f180c4effbad5fd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.745545:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde000/0x2f180c4effbad5fd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.745555:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde000/0x2f180c4effbad5fd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.745573:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdea00/0x2f180c4effbad604 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.745579:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdea00/0x2f180c4effbad604 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.745586:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdea00/0x2f180c4effbad604 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.745625:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde000/0x2f180c4effbad5fd lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.745633:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde000/0x2f180c4effbad5fd lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.745640:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde000/0x2f180c4effbad5fd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.745647:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde000/0x2f180c4effbad5fd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.745653:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bde000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166987.745658:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde000/0x2f180c4effbad5fd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.745668:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde000/0x2f180c4effbad5fd lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.745679:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945cd0738700) 00010000:00010000:0.0:1762166987.745682:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166987.745701:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde000/0x2f180c4effbad5fd lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.745708:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde000/0x2f180c4effbad5fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.745720:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdea00/0x2f180c4effbad604 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.745726:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdea00/0x2f180c4effbad604 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.745732:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdea00/0x2f180c4effbad604 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.745737:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdea00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166987.745740:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdea00/0x2f180c4effbad604 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.745747:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdea00/0x2f180c4effbad604 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.745755:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9c8d69b4 (ffff945cc7df9500) 00010000:00010000:0.0:1762166987.745757:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166987.745761:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdea00/0x2f180c4effbad604 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.745767:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdea00/0x2f180c4effbad604 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.745800:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde800/0x2f180c4effbad5f6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac10 expref: 32 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166987.745811:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945cd0738700) 00010000:00010000:0.0:1762166987.745815:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166987.745819:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde800/0x2f180c4effbad5f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac10 expref: 32 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166987.745832:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bde800, rc 0) 00000100:00100000:0.0:1762166987.745887:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc76ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+31:63270:x1847765450773248:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 483us (743us total) trans 0 rc 301/301 00000100:00100000:0.0:1762166987.745895:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30962 00000100:00100000:3.0:1762166987.747333:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166987.747527:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450773504 00000100:00100000:0.0:1762166987.747535:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450773504 00000100:00100000:0.0:1762166987.747585:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30963 00000100:00100000:0.0:1762166987.747594:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7bbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+31:63270:x1847765450773504:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166987.747609:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166987.747612:0:6496:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1762166987.747636:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355a800/0x2f180c4effbad5ef lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac09 expref: 31 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166987.747655:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945cd0738700) 00010000:00010000:0.0:1762166987.747660:0:6496:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166987.747674:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde200/0x2f180c4effbad60b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eac17 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166987.747769:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdee00/0x2f180c4effbad612 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.747782:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdee00/0x2f180c4effbad612 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.747792:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdee00/0x2f180c4effbad612 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.747807:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf000/0x2f180c4effbad619 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.747815:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf000/0x2f180c4effbad619 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.747824:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf000/0x2f180c4effbad619 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.748234:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfa00/0x2f180c4effbad620 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.748244:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfa00/0x2f180c4effbad620 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.748251:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfa00/0x2f180c4effbad620 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:0.0:1762166987.748259:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x55:0x0]: returning size 0 00010000:00010000:0.0:1762166987.748284:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdee00/0x2f180c4effbad612 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.748290:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdee00/0x2f180c4effbad612 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.748297:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdee00/0x2f180c4effbad612 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.748303:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdee00/0x2f180c4effbad612 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.748310:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdee00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166987.748314:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdee00/0x2f180c4effbad612 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.748320:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdee00/0x2f180c4effbad612 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.748327:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945cd0738700) 00010000:00010000:0.0:1762166987.748330:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166987.748333:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdee00/0x2f180c4effbad612 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.748338:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdee00/0x2f180c4effbad612 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00000004:00010000:0.0:1762166987.748348:0:6496:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000628e0ab9 reply state 0000000021f6c024 transno 8589935340 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf000/0x2f180c4effbad619 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.748358:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf000/0x2f180c4effbad619 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.748364:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9c8d69b4 (ffff945cc7df9d00) 00010000:00010000:0.0:1762166987.748367:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762166987.748369:0:6496:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1762166987.748389:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde200/0x2f180c4effbad60b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac17 expref: 33 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166987.748402:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfa00/0x2f180c4effbad620 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac17 expref: 32 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166987.748408:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff945cc7df9e00) 00010000:00010000:0.0:1762166987.748411:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166987.748413:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdfa00, rc 0) 00000100:00100000:0.0:1762166987.748464:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7bbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+33:63270:x1847765450773504:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 872us (1136us total) trans 8589935340 rc 0/0 00000100:00100000:0.0:1762166987.748472:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30963 00000100:00100000:2.0:1762166987.749848:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166987.749891:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450773760 00000100:00100000:0.0:1762166987.749897:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450773760 00000100:00100000:0.0:1762166987.749931:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30964 00000100:00100000:0.0:1762166987.749938:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7caca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+33:63270:x1847765450773760:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166987.749952:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166987.749962:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf600/0x2f180c4effbad62e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eac1e expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166987.750021:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad635 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.750031:0:6496:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfa00/0x2f180c4effbad620 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac17 expref: 34 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166987.750052:0:6496:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad635 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x55:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.750082:0:6496:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfa00/0x2f180c4effbad620 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac17 expref: 34 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166987.750094:0:6496:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfa00/0x2f180c4effbad620 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac17 expref: 34 pid: 6496 timeout: 706 lvb_type: 0 00000100:00100000:0.0:1762166987.750107:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc76ace00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1847765449808640:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166987.750184:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402f000 going to sleep for 11 seconds 00000100:00100000:0.0:1762166987.751160:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc76ace00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1847765449808640:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166987.751181:0:6496:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad635 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x55:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000100:00100000:2.0:1762166987.751208:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166987.751283:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450773888 00000100:00100000:1.0:1762166987.751289:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450773888 00010000:00010000:1.0:1762166987.751312:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfa00/0x2f180c4effbad620 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac17 expref: 35 pid: 6496 timeout: 706 lvb_type: 0 00000100:00100000:1.0:1762166987.751344:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9861 00000100:00100000:1.0:1762166987.751352:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7cad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+35:2418:x1847765450773888:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166987.751365:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166987.751371:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfa00/0x2f180c4effbad620 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac17 expref: 35 pid: 6496 timeout: 706 lvb_type: 0 00010000:00010000:1.0:1762166987.751382:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfa00/0x2f180c4effbad620 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac17 expref: 35 pid: 6496 timeout: 706 lvb_type: 0 00010000:00010000:1.0:1762166987.751399:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfa00/0x2f180c4effbad620 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac17 expref: 35 pid: 6496 timeout: 706 lvb_type: 0 00010000:00010000:1.0:1762166987.751416:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff945cc7df9e00) 00010000:00010000:1.0:1762166987.751421:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad635 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x55:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166987.751428:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad635 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x55:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166987.751435:0:6479:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad635 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x55:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166987.751457:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166987.751530:0:6496:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad635 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x55:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.751539:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad635 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x55:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:0.0:1762166987.751551:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x55:0x0]: returning size 0 00000004:00080000:0.0:1762166987.751721:0:6496:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x74:0x0], index 0: 0 00010000:00010000:0.0:1762166987.751816:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad635 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x55:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.751824:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad635 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x55:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.751831:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad635 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x55:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.751837:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdfe00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166987.751841:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad635 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x55:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.751848:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad635 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x55:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.751858:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff945cc7df9e00) 00010000:00010000:0.0:1762166987.751862:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166987.751865:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad635 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x55:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.751874:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad635 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x55:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.751926:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf600/0x2f180c4effbad62e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac1e expref: 35 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166987.751936:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945cd0738700) 00010000:00010000:0.0:1762166987.751986:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1762166987.751994:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf600/0x2f180c4effbad62e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac1e expref: 35 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166987.752007:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdf600, rc 0) 00000100:00100000:1.0:1762166987.752019:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7cad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+34:2418:x1847765450773888:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 665us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166987.752029:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9861 00000100:00100000:0.0:1762166987.752047:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7caca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+33:63270:x1847765450773760:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2107us (2204us total) trans 8589935341 rc 301/301 00000100:00100000:0.0:1762166987.752056:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30964 00000100:00100000:2.0:1762166987.753047:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166987.753095:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450774144 00000100:00100000:0.0:1762166987.753102:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450774144 00000100:00100000:0.0:1762166987.753134:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 12016 00000100:00100000:0.0:1762166987.753139:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff2ff450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+33:63270:x1847765450774144:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166987.753280:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff2ff450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+34:63270:x1847765450774144:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 140us (239us total) trans 8589935342 rc 0/0 00000100:00100000:0.0:1762166987.753286:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 12016 00000100:00100000:2.0:1762166987.754027:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166987.754078:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450774400 00000100:00100000:1.0:1762166987.754085:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450774400 00000100:00100000:1.0:1762166987.754125:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 12017 00000100:00100000:1.0:1762166987.754136:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7cace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+34:63270:x1847765450774400:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:1.0:1762166987.754260:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7cace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+35:63270:x1847765450774400:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 126us (234us total) trans 8589935343 rc 0/0 00000100:00100000:1.0:1762166987.754268:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 12017 00000100:00100000:2.0:1762166987.760887:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166987.760954:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450774528 00000100:00100000:0.0:1762166987.760964:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450774528 00000100:00100000:0.0:1762166987.761026:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30965 00000100:00100000:0.0:1762166987.761037:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7cac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+35:63271:x1847765450774528:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166987.761062:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166987.761080:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf600/0x2f180c4effbad643 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eac25 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166987.761140:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad64a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.761151:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad64a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.761158:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad64a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:0.0:1762166987.761194:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1762166987.761198:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166987.761216:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad64a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.761240:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf600/0x2f180c4effbad643 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac25 expref: 37 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166987.761256:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad64a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac25 expref: 36 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166987.761265:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945cd0738700) 00010000:00010000:0.0:1762166987.761267:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1762166987.761270:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdfe00, rc 0) 00000100:00100000:0.0:1762166987.761327:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7cac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+36:63271:x1847765450774528:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 292us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166987.761335:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30965 00000100:00100000:2.0:1762166987.762565:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166987.762613:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450774656 00000100:00100000:1.0:1762166987.762620:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450774656 00000100:00100000:1.0:1762166987.762656:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30966 00000100:00100000:1.0:1762166987.762665:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7cae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+36:63271:x1847765450774656:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166987.762676:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166987.762701:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa9400/0x2f180c4effbad651 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eac2c expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166987.762738:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa8000/0x2f180c4effbad658 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166987.762745:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa8000/0x2f180c4effbad658 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166987.762751:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa8000/0x2f180c4effbad658 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166987.762760:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa9000/0x2f180c4effbad65f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166987.762764:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa9000/0x2f180c4effbad65f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166987.762767:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa9000/0x2f180c4effbad65f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166987.762797:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa8000/0x2f180c4effbad658 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166987.762801:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa8000/0x2f180c4effbad658 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166987.762805:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa8000/0x2f180c4effbad658 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166987.762809:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa8000/0x2f180c4effbad658 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166987.762813:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa8000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166987.762815:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa8000/0x2f180c4effbad658 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166987.762820:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa8000/0x2f180c4effbad658 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166987.762825:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945cd0738700) 00010000:00010000:1.0:1762166987.762826:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166987.762829:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa8000/0x2f180c4effbad658 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166987.762832:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa8000/0x2f180c4effbad658 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166987.762839:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa9000/0x2f180c4effbad65f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166987.762842:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa9000/0x2f180c4effbad65f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166987.762845:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa9000/0x2f180c4effbad65f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166987.762849:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa9000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166987.762850:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa9000/0x2f180c4effbad65f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166987.762856:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa9000/0x2f180c4effbad65f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166987.762860:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc72e1b9b (ffff945bc812eb00) 00010000:00010000:1.0:1762166987.762861:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166987.762863:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa9000/0x2f180c4effbad65f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166987.762865:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa9000/0x2f180c4effbad65f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166987.762881:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa9400/0x2f180c4effbad651 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac2c expref: 37 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166987.762887:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945cd0738700) 00010000:00010000:1.0:1762166987.762888:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166987.762890:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa9400/0x2f180c4effbad651 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac2c expref: 37 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166987.762895:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa9400, rc 0) 00000100:00100000:1.0:1762166987.762923:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7cae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+36:63271:x1847765450774656:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 261us (367us total) trans 0 rc 301/301 00000100:00100000:1.0:1762166987.762928:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30966 00000100:00100000:2.0:1762166987.764206:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166987.764242:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450774912 00000100:00100000:1.0:1762166987.764247:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450774912 00000100:00100000:1.0:1762166987.764275:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30967 00000100:00100000:1.0:1762166987.764283:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7caf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+36:63271:x1847765450774912:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166987.764293:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166987.764296:0:6496:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1762166987.764309:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad64a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac25 expref: 36 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166987.764320:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945cd0738700) 00010000:00010000:1.0:1762166987.764322:0:6496:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166987.764329:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa8800/0x2f180c4effbad666 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eac33 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166987.764374:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa9a00/0x2f180c4effbad66d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166987.764381:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa9a00/0x2f180c4effbad66d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166987.764386:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa9a00/0x2f180c4effbad66d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166987.764393:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa9e00/0x2f180c4effbad674 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166987.764396:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa9e00/0x2f180c4effbad674 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166987.764400:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa9e00/0x2f180c4effbad674 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166987.764862:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa8200/0x2f180c4effbad67b lrc: 3/1,0 mode: --/PR res: [0x200000405:0x56:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166987.764868:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa8200/0x2f180c4effbad67b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166987.764872:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa8200/0x2f180c4effbad67b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:1.0:1762166987.764879:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x56:0x0]: returning size 0 00010000:00010000:1.0:1762166987.764896:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa9a00/0x2f180c4effbad66d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166987.764900:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa9a00/0x2f180c4effbad66d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166987.764903:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa9a00/0x2f180c4effbad66d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166987.764907:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa9a00/0x2f180c4effbad66d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166987.764910:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa9a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166987.764912:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa9a00/0x2f180c4effbad66d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166987.764915:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa9a00/0x2f180c4effbad66d lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166987.764919:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945cd0738700) 00010000:00010000:1.0:1762166987.764921:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166987.764923:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa9a00/0x2f180c4effbad66d lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166987.764928:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa9a00/0x2f180c4effbad66d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00000004:00010000:1.0:1762166987.764938:0:6496:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000068820a5d reply state 000000002385cf0f transno 8589935344 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa9e00/0x2f180c4effbad674 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166987.764947:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa9e00/0x2f180c4effbad674 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166987.764957:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc72e1b9b (ffff945bc812ec00) 00010000:00010000:1.0:1762166987.764960:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1762166987.764962:0:6496:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1762166987.764982:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa8800/0x2f180c4effbad666 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac33 expref: 38 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166987.764993:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa8200/0x2f180c4effbad67b lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac33 expref: 37 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166987.764998:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x56:0x0].0x0 (ffff945bc812ee00) 00010000:00010000:1.0:1762166987.764999:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166987.765001:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa8200, rc 0) 00000100:00100000:1.0:1762166987.765036:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7caf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+38:63271:x1847765450774912:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 753us (830us total) trans 8589935344 rc 0/0 00000100:00100000:1.0:1762166987.765042:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30967 00000100:00100000:2.0:1762166987.766466:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166987.766533:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450775168 00000100:00100000:1.0:1762166987.766540:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450775168 00000100:00100000:1.0:1762166987.766580:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30968 00000100:00100000:1.0:1762166987.766591:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7cad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+38:63271:x1847765450775168:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:1.0:1762166987.766606:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166987.766620:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc6eeaa00/0x2f180c4effbad689 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eac3a expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166987.766701:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945d02174400/0x2f180c4effbad690 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x56:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166987.766713:0:6496:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa8200/0x2f180c4effbad67b lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac33 expref: 39 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166987.766727:0:6496:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945d02174400/0x2f180c4effbad690 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x56:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166987.766758:0:6496:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa8200/0x2f180c4effbad67b lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac33 expref: 39 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166987.766772:0:6496:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa8200/0x2f180c4effbad67b lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac33 expref: 39 pid: 6496 timeout: 706 lvb_type: 0 00000100:00100000:1.0:1762166987.766786:0:6496:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7ded180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1847765449808768:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166987.766863:0:6496:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccaf2c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1762166987.767638:0:6496:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7ded180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6496:1847765449808768:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166987.767653:0:6496:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945d02174400/0x2f180c4effbad690 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x56:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000100:00100000:2.0:1762166987.768050:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166987.768091:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450775296 00000100:00100000:1.0:1762166987.768096:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450775296 00010000:00010000:1.0:1762166987.768113:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa8200/0x2f180c4effbad67b lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac33 expref: 40 pid: 6496 timeout: 706 lvb_type: 0 00000100:00100000:1.0:1762166987.768135:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9862 00000100:00100000:1.0:1762166987.768141:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7caf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+40:2419:x1847765450775296:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166987.768149:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166987.768154:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa8200/0x2f180c4effbad67b lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac33 expref: 40 pid: 6496 timeout: 706 lvb_type: 0 00010000:00010000:1.0:1762166987.768163:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa8200/0x2f180c4effbad67b lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac33 expref: 40 pid: 6496 timeout: 706 lvb_type: 0 00010000:00010000:1.0:1762166987.768176:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa8200/0x2f180c4effbad67b lrc: 0/0,0 mode: --/PR res: [0x200000405:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac33 expref: 40 pid: 6496 timeout: 706 lvb_type: 0 00010000:00010000:1.0:1762166987.768186:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x56:0x0].0x0 (ffff945bc812ee00) 00010000:00010000:1.0:1762166987.768188:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945d02174400/0x2f180c4effbad690 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x56:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166987.768194:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945d02174400/0x2f180c4effbad690 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x56:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166987.768197:0:6479:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d02174400/0x2f180c4effbad690 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x56:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 00010000:00010000:1.0:1762166987.768213:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166987.768229:0:6496:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945d02174400/0x2f180c4effbad690 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x56:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.768237:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d02174400/0x2f180c4effbad690 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x56:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:0.0:1762166987.768247:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x56:0x0]: returning size 0 00000100:00100000:1.0:1762166987.768249:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7caf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+39:2419:x1847765450775296:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 106us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166987.768260:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9862 00000004:00080000:0.0:1762166987.768379:0:6496:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x76:0x0], index 1: 0 00010000:00010000:0.0:1762166987.768458:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945d02174400/0x2f180c4effbad690 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x56:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.768464:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945d02174400/0x2f180c4effbad690 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x56:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.768468:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945d02174400/0x2f180c4effbad690 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x56:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.768471:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945d02174400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166987.768474:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d02174400/0x2f180c4effbad690 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x56:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.768508:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d02174400/0x2f180c4effbad690 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x56:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.768518:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x56:0x0].0x0 (ffff945bc812ee00) 00010000:00010000:0.0:1762166987.768521:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166987.768523:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945d02174400/0x2f180c4effbad690 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x56:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.768527:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d02174400/0x2f180c4effbad690 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x56:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.768572:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc6eeaa00/0x2f180c4effbad689 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac3a expref: 39 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166987.768582:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945cd0738700) 00010000:00010000:0.0:1762166987.768584:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1762166987.768588:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc6eeaa00/0x2f180c4effbad689 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac3a expref: 39 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166987.768597:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc6eeaa00, rc 0) 00000100:00100000:0.0:1762166987.768627:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7cad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+38:63271:x1847765450775168:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2039us (2163us total) trans 8589935345 rc 301/301 00000100:00100000:0.0:1762166987.768633:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30968 00000100:00100000:2.0:1762166987.769615:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166987.769654:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450775552 00000100:00100000:1.0:1762166987.769660:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450775552 00000100:00100000:1.0:1762166987.769698:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 12018 00000100:00100000:1.0:1762166987.769708:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7caea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+38:63271:x1847765450775552:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:1.0:1762166987.769851:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7caea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+39:63271:x1847765450775552:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 146us (240us total) trans 8589935346 rc 0/0 00000100:00100000:1.0:1762166987.769856:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 12018 00000100:00100000:2.0:1762166987.770667:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166987.770727:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450775808 00000100:00100000:1.0:1762166987.770733:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450775808 00000100:00100000:1.0:1762166987.770763:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 12019 00000100:00100000:1.0:1762166987.770772:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7caf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+39:63271:x1847765450775808:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:1.0:1762166987.770882:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7caf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+40:63271:x1847765450775808:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 111us (215us total) trans 8589935347 rc 0/0 00000100:00100000:1.0:1762166987.770890:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 12019 00000100:00100000:2.0:1762166987.776866:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166987.776933:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450775936 00000100:00100000:0.0:1762166987.776944:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450775936 00000100:00100000:0.0:1762166987.776999:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30969 00000100:00100000:0.0:1762166987.777011:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7cadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+40:63272:x1847765450775936:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166987.777033:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166987.777051:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf600/0x2f180c4effbad69e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eac41 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166987.777132:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde200/0x2f180c4effbad6a5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.777146:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde200/0x2f180c4effbad6a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.777157:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde200/0x2f180c4effbad6a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:0.0:1762166987.777201:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1762166987.777205:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166987.777223:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde200/0x2f180c4effbad6a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.777244:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf600/0x2f180c4effbad69e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac41 expref: 42 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166987.777260:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde200/0x2f180c4effbad6a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac41 expref: 41 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166987.777269:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945cd0738700) 00010000:00010000:0.0:1762166987.777272:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1762166987.777276:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bde200, rc 0) 00000100:00100000:0.0:1762166987.777331:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7cadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+41:63272:x1847765450775936:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 323us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166987.777339:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30969 00000100:00100000:2.0:1762166987.778642:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166987.778711:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450776192 00000100:00100000:0.0:1762166987.778721:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450776192 00000100:00100000:0.0:1762166987.778762:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30970 00000100:00100000:0.0:1762166987.778770:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5805500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+41:63272:x1847765450776192:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166987.778790:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166987.778809:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdee00/0x2f180c4effbad6ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eac48 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166987.778874:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde800/0x2f180c4effbad6b3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.778884:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde800/0x2f180c4effbad6b3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.778892:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde800/0x2f180c4effbad6b3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.778899:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdea00/0x2f180c4effbad6ba lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.778904:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdea00/0x2f180c4effbad6ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.778907:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdea00/0x2f180c4effbad6ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.779052:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde000/0x2f180c4effbad6c1 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x54:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.779062:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde000/0x2f180c4effbad6c1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.779069:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde000/0x2f180c4effbad6c1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:0.0:1762166987.779079:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x54:0x0]: returning size 0 00010000:00010000:0.0:1762166987.779167:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde800/0x2f180c4effbad6b3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.779175:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde800/0x2f180c4effbad6b3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.779180:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde800/0x2f180c4effbad6b3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.779187:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde800/0x2f180c4effbad6b3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.779193:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bde800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166987.779198:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde800/0x2f180c4effbad6b3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.779209:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde800/0x2f180c4effbad6b3 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.779221:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945cd0738700) 00010000:00010000:0.0:1762166987.779224:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166987.779229:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde800/0x2f180c4effbad6b3 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.779235:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde800/0x2f180c4effbad6b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.779248:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdea00/0x2f180c4effbad6ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.779252:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdea00/0x2f180c4effbad6ba lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.779256:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdea00/0x2f180c4effbad6ba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.779259:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdea00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166987.779260:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdea00/0x2f180c4effbad6ba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.779263:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdea00/0x2f180c4effbad6ba lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.779267:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x64c18fe5 (ffff945bc812e800) 00010000:00010000:0.0:1762166987.779269:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166987.779270:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdea00/0x2f180c4effbad6ba lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.779273:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdea00/0x2f180c4effbad6ba lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.779303:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdee00/0x2f180c4effbad6ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac48 expref: 44 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166987.779315:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde000/0x2f180c4effbad6c1 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac48 expref: 43 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166987.779323:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x54:0x0].0x0 (ffff945cc7df9e00) 00010000:00010000:0.0:1762166987.779325:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166987.779328:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bde000, rc 0) 00000100:00100000:0.0:1762166987.779387:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5805500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+43:63272:x1847765450776192:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 617us (753us total) trans 8589935348 rc 0/0 00000100:00100000:0.0:1762166987.779395:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30970 00000100:00100000:2.0:1762166987.781077:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166987.781129:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450776448 00000100:00100000:0.0:1762166987.781137:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450776448 00000100:00100000:0.0:1762166987.781185:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30971 00000100:00100000:0.0:1762166987.781195:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5807b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+43:63272:x1847765450776448:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166987.781215:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166987.781230:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf400/0x2f180c4effbad6cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eac4f expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166987.781285:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde400/0x2f180c4effbad6d6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.781295:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde400/0x2f180c4effbad6d6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.781304:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde400/0x2f180c4effbad6d6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.781329:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfc00/0x2f180c4effbad6dd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.781337:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfc00/0x2f180c4effbad6dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.781348:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfc00/0x2f180c4effbad6dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.781443:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde600/0x2f180c4effbad6e4 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.781459:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde600/0x2f180c4effbad6e4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.781470:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde600/0x2f180c4effbad6e4 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:0.0:1762166987.781504:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x55:0x0]: returning size 0 00010000:00010000:0.0:1762166987.781577:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde400/0x2f180c4effbad6d6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.781585:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde400/0x2f180c4effbad6d6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.781592:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde400/0x2f180c4effbad6d6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.781600:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde400/0x2f180c4effbad6d6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.781605:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bde400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166987.781609:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde400/0x2f180c4effbad6d6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.781620:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde400/0x2f180c4effbad6d6 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.781630:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945cd0738700) 00010000:00010000:0.0:1762166987.781633:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166987.781636:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde400/0x2f180c4effbad6d6 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.781643:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde400/0x2f180c4effbad6d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.781656:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfc00/0x2f180c4effbad6dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.781661:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfc00/0x2f180c4effbad6dd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.781667:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfc00/0x2f180c4effbad6dd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.781672:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdfc00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166987.781674:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfc00/0x2f180c4effbad6dd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.781680:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfc00/0x2f180c4effbad6dd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.781702:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9c8d69b4 (ffff945cc7df9d00) 00010000:00010000:0.0:1762166987.781705:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166987.781708:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfc00/0x2f180c4effbad6dd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.781714:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfc00/0x2f180c4effbad6dd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.781748:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf400/0x2f180c4effbad6cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac4f expref: 46 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166987.781760:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde600/0x2f180c4effbad6e4 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac4f expref: 45 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166987.781767:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff945cc7df9500) 00010000:00010000:0.0:1762166987.781769:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166987.781771:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bde600, rc 0) 00000100:00100000:0.0:1762166987.781822:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5807b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+45:63272:x1847765450776448:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 629us (755us total) trans 8589935349 rc 0/0 00000100:00100000:0.0:1762166987.781830:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30971 00000100:00100000:2.0:1762166987.783257:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166987.783316:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450776576 00000100:00100000:3.0:1762166987.783329:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450776576 00000100:00080000:0.0:1762166987.783389:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1762166987.783402:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19514 00000100:00100000:3.0:1762166987.783412:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc70b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+42:2418:x1847765450776576:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166987.783426:0:9168:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166987.783440:0:9168:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62600/0x2f180c4effbad6f2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eac56 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166987.783459:0:9168:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x75:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1762166987.783473:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166987.783500:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166987.783508:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62600/0x2f180c4effbad6f2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac56 expref: 43 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166987.783521:0:9168:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62600/0x2f180c4effbad6f2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac56 expref: 43 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166987.783530:0:9168:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4b62600, rc 0) 00000100:00100000:3.0:1762166987.783582:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc70b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+43:2418:x1847765450776576:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 173us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166987.783587:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19514 00000100:00100000:2.0:1762166987.784774:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166987.784807:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450776704 00000100:00100000:3.0:1762166987.784813:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450776704 00000100:00100000:3.0:1762166987.784850:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19515 00000100:00100000:3.0:1762166987.784857:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc70b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+23:2419:x1847765450776704:12345-192.168.204.38@tcp:101:lfs.0 00000100:00080000:0.0:1762166987.784862:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1762166987.784865:0:9168:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166987.784876:0:9168:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4b63e00/0x2f180c4effbad6f9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x74:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eac5d expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166987.784889:0:9168:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x74:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1762166987.784896:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166987.784897:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166987.784901:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4b63e00/0x2f180c4effbad6f9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac5d expref: 24 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166987.784909:0:9168:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff945bc4b63e00/0x2f180c4effbad6f9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac5d expref: 24 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166987.784915:0:9168:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4b63e00, rc 0) 00000100:00100000:3.0:1762166987.784962:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc70b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765450776704:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 105us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166987.784968:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19515 00000100:00100000:2.0:1762166987.786003:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166987.786055:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450776960 00000100:00100000:0.0:1762166987.786061:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450776960 00000100:00100000:0.0:1762166987.786114:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30972 00000100:00100000:0.0:1762166987.786124:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1ddf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+45:63272:x1847765450776960:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166987.786146:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166987.786164:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf800/0x2f180c4effbad700 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x54:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eac64 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166987.786268:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad707 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x54:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.786283:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad707 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x54:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.786294:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad707 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x54:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:0.0:1762166987.786307:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x54:0x0]: returning size 0 00010000:00010000:0.0:1762166987.786425:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf800/0x2f180c4effbad700 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x54:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac64 expref: 48 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166987.786448:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad707 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x54:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac64 expref: 47 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166987.786457:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x54:0x0].0x0 (ffff945cc7df9e00) 00010000:00010000:0.0:1762166987.786460:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166987.786464:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdfe00, rc 0) 00000100:00100000:0.0:1762166987.786550:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1ddf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+47:63272:x1847765450776960:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 427us (550us total) trans 8589935350 rc 0/0 00000100:00100000:0.0:1762166987.786558:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30972 00000100:00100000:2.0:1762166987.839822:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166987.839898:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450777088 00000100:00100000:3.0:1762166987.839917:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450777088 00000100:00100000:3.0:1762166987.839990:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19516 00000100:00100000:3.0:1762166987.840004:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5765c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+43:2419:x1847765450777088:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:3.0:1762166987.840075:0:9168:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc4b63400/0x2f180c4effbad715 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166987.840098:0:9168:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62600/0x2f180c4effbad6f2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac56 expref: 43 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166987.840111:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166987.840114:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166987.840118:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4b63400/0x2f180c4effbad715 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166987.840161:0:9168:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62600/0x2f180c4effbad6f2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac56 expref: 43 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166987.840176:0:9168:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62600/0x2f180c4effbad6f2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac56 expref: 43 pid: 9168 timeout: 706 lvb_type: 1 00000100:00100000:3.0:1762166987.840194:0:9168:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7bba680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9168:1847765449808896:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166987.840315:0:9168:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc4033840 going to sleep for 11 seconds 00000100:00100000:3.0:1762166987.841258:0:9168:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7bba680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9168:1847765449808896:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166987.841277:0:9168:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc4b63400/0x2f180c4effbad715 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166987.841424:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166987.841514:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450777216 00000100:00100000:1.0:1762166987.841521:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450777216 00010000:00010000:1.0:1762166987.841557:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62600/0x2f180c4effbad6f2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac56 expref: 44 pid: 9168 timeout: 706 lvb_type: 1 00000100:00100000:1.0:1762166987.841589:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9863 00000100:00100000:1.0:1762166987.841599:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+44:2418:x1847765450777216:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166987.841613:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166987.841638:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62600/0x2f180c4effbad6f2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac56 expref: 44 pid: 9168 timeout: 706 lvb_type: 1 00010000:00010000:1.0:1762166987.841651:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62600/0x2f180c4effbad6f2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac56 expref: 44 pid: 9168 timeout: 706 lvb_type: 1 00010000:00010000:1.0:1762166987.841676:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62600/0x2f180c4effbad6f2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac56 expref: 44 pid: 9168 timeout: 706 lvb_type: 1 00010000:00010000:1.0:1762166987.841701:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166987.841704:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166987.841709:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4b63400/0x2f180c4effbad715 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166987.841720:0:6479:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4b63400/0x2f180c4effbad715 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166987.841753:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166987.841790:0:9168:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc4b63400/0x2f180c4effbad715 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166987.841802:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+43:2418:x1847765450777216:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 202us (376us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166987.841804:0:9168:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4b63400/0x2f180c4effbad715 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166987.841819:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9863 00010000:00010000:3.0:1762166987.841832:0:9168:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc4b63400/0x2f180c4effbad715 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166987.841849:0:9168:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4b63400/0x2f180c4effbad715 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166987.841858:0:9168:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc4b63400/0x2f180c4effbad715 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166987.841865:0:9168:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4b63400 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166987.841870:0:9168:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4b63400/0x2f180c4effbad715 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166987.841879:0:9168:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4b63400/0x2f180c4effbad715 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166987.841892:0:9168:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc4b63400/0x2f180c4effbad715 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166987.841900:0:9168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4b63400/0x2f180c4effbad715 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166987.841996:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5765c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+42:2419:x1847765450777088:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 1995us (2193us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166987.842005:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19516 00000100:00100000:2.0:1762166987.842718:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166987.842739:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450777344 00000100:00100000:3.0:1762166987.842744:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450777344 00000100:00100000:3.0:1762166987.842770:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19517 00000100:00100000:3.0:1762166987.842775:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bccb7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+24:2417:x1847765450777344:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:3.0:1762166987.842802:0:9168:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc4b63000/0x2f180c4effbad71c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x74:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166987.842813:0:9168:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4b63e00/0x2f180c4effbad6f9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x74:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac5d expref: 24 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166987.842818:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166987.842819:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166987.842821:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4b63000/0x2f180c4effbad71c lrc: 4/0,1 mode: --/PW res: [0x280000401:0x74:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166987.842839:0:9168:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff945bc4b63e00/0x2f180c4effbad6f9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x74:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac5d expref: 24 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166987.842847:0:9168:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff945bc4b63e00/0x2f180c4effbad6f9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x74:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac5d expref: 24 pid: 9168 timeout: 706 lvb_type: 1 00000100:00100000:3.0:1762166987.842857:0:9168:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7bba680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9168:1847765449809024:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166987.842900:0:9168:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc4033840 going to sleep for 11 seconds 00000100:00100000:3.0:1762166987.843501:0:9168:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7bba680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9168:1847765449809024:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166987.843517:0:9168:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff945bc4b63000/0x2f180c4effbad71c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x74:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166987.843632:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166987.843667:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450777472 00000100:00100000:1.0:1762166987.843673:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450777472 00010000:00010000:1.0:1762166987.843701:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4b63e00/0x2f180c4effbad6f9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x74:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac5d expref: 25 pid: 9168 timeout: 706 lvb_type: 1 00000100:00100000:1.0:1762166987.843728:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9864 00000100:00100000:1.0:1762166987.843736:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bcb387480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+25:2419:x1847765450777472:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166987.843746:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166987.843761:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff945bc4b63e00/0x2f180c4effbad6f9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x74:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac5d expref: 25 pid: 9168 timeout: 706 lvb_type: 1 00010000:00010000:1.0:1762166987.843772:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff945bc4b63e00/0x2f180c4effbad6f9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x74:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac5d expref: 25 pid: 9168 timeout: 706 lvb_type: 1 00010000:00010000:1.0:1762166987.843789:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4b63e00/0x2f180c4effbad6f9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x74:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac5d expref: 25 pid: 9168 timeout: 706 lvb_type: 1 00010000:00010000:1.0:1762166987.843799:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166987.843801:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1762166987.843804:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff945bc4b63000/0x2f180c4effbad71c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166987.843819:0:6479:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4b63000/0x2f180c4effbad71c lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x74:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166987.843840:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166987.843854:0:9168:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff945bc4b63000/0x2f180c4effbad71c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166987.843862:0:9168:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff945bc4b63000/0x2f180c4effbad71c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166987.843871:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bcb387480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+24:2419:x1847765450777472:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 134us (237us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166987.843874:0:9168:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff945bc4b63000/0x2f180c4effbad71c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166987.843883:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9864 00010000:00010000:3.0:1762166987.843884:0:9168:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff945bc4b63000/0x2f180c4effbad71c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166987.843891:0:9168:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff945bc4b63000/0x2f180c4effbad71c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166987.843895:0:9168:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4b63000 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166987.843898:0:9168:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4b63000/0x2f180c4effbad71c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166987.843903:0:9168:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff945bc4b63000/0x2f180c4effbad71c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166987.843910:0:9168:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff945bc4b63000/0x2f180c4effbad71c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166987.843915:0:9168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff945bc4b63000/0x2f180c4effbad71c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166987.843955:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bccb7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+23:2417:x1847765450777344:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 1180us (1239us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166987.843961:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19517 00000100:00100000:2.0:1762166987.844638:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166987.844695:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450777728 00000100:00100000:0.0:1762166987.844701:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450777728 00000100:00100000:0.0:1762166987.844740:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30973 00000100:00100000:0.0:1762166987.844750:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+47:63272:x1847765450777728:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:0.0:1762166987.844802:0:6496:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166987.844820:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde000/0x2f180c4effbad6c1 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac48 expref: 47 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166987.844831:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x54:0x0].0x0 (ffff945cc7df9e00) 00010000:00010000:0.0:1762166987.844834:0:6496:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166987.844876:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf800/0x2f180c4effbad723 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x54:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.844885:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf800/0x2f180c4effbad723 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x54:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.844891:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf800/0x2f180c4effbad723 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x54:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00010000:0.0:1762166987.845003:0:6496:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000d2b1b213 reply state 00000000806b0005 transno 8589935351 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf800/0x2f180c4effbad723 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x54:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.845015:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf800/0x2f180c4effbad723 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x54:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.845020:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x54:0x0].0x0 (ffff945cc7df9e00) 00010000:00010000:0.0:1762166987.845023:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762166987.845026:0:6496:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166987.845090:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+48:63272:x1847765450777728:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 343us (454us total) trans 8589935351 rc 0/0 00000100:00100000:0.0:1762166987.845095:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30973 00000100:00100000:2.0:1762166987.845790:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166987.845832:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450777856 00000100:00100000:0.0:1762166987.845838:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450777856 00000100:00100000:0.0:1762166987.845875:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30974 00000100:00100000:0.0:1762166987.845884:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc7c70c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+48:63272:x1847765450777856:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166987.845900:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166987.845913:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf400/0x2f180c4effbad72a lrc: 2/0,0 mode: --/CR res: [0x200000405:0x54:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eac6b expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166987.845950:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf400/0x2f180c4effbad72a lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x54:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac6b expref: 49 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166987.845962:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf400/0x2f180c4effbad72a lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x54:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac6b expref: 49 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166987.845987:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x54:0x0].0x0 (ffff945cc7df9e00) 00010000:00010000:0.0:1762166987.845990:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166987.845993:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdf400, rc 0) 00000100:00100000:0.0:1762166987.846026:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc7c70c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+49:63272:x1847765450777856:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 144us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166987.846031:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30974 00000100:00100000:2.0:1762166987.846979:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166987.847023:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450777984 00000100:00100000:3.0:1762166987.847029:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450777984 00000100:00100000:3.0:1762166987.847075:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19518 00000100:00100000:3.0:1762166987.847086:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+42:63272:x1847765450777984:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166987.847098:0:9168:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166987.847114:0:9168:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4b63a00/0x2f180c4effbad731 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eac72 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166987.847135:0:9168:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x75:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1762166987.847148:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166987.847151:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166987.847159:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4b63a00/0x2f180c4effbad731 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac72 expref: 43 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166987.847172:0:9168:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4b63a00/0x2f180c4effbad731 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac72 expref: 43 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166987.847182:0:9168:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4b63a00, rc 0) 00000100:00100000:3.0:1762166987.847223:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+43:63272:x1847765450777984:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 140us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166987.847227:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19518 00000100:00100000:2.0:1762166987.848440:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166987.848520:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450778112 00000100:00100000:3.0:1762166987.848535:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450778112 00000100:00100000:3.0:1762166987.848572:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19519 00000100:00100000:3.0:1762166987.848579:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+43:2418:x1847765450778112:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:3.0:1762166987.848757:0:9168:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166987.848762:0:9168:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb mtime from disk: 0 -> 1762166987 00002000:00010000:3.0:1762166987.848765:0:9168:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb atime from disk: 0 -> 1762166987 00002000:00010000:3.0:1762166987.848768:0:9168:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb ctime from disk: 0 -> 1762166988 00002000:00010000:3.0:1762166987.848771:0:9168:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166987.848816:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+44:2418:x1847765450778112:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 236us (377us total) trans 17179876796 rc 0/0 00000100:00100000:3.0:1762166987.848824:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19519 00000100:00100000:3.0:1762166987.849778:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166987.849850:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450778368 00000100:00100000:1.0:1762166987.849855:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450778368 00000100:00100000:1.0:1762166987.849898:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 12020 00000100:00100000:1.0:1762166987.849908:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7bba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+49:63272:x1847765450778368:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:1.0:1762166987.849978:0:19593:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000405:0x54:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad707 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x54:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac64 expref: 49 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166987.850019:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945d02174e00/0x2f180c4effbad738 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x54:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166987.850035:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf400/0x2f180c4effbad72a lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x54:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac6b expref: 49 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166987.850044:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945d02174e00/0x2f180c4effbad738 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x54:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166987.850086:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf400/0x2f180c4effbad72a lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x54:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac6b expref: 49 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166987.850101:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf400/0x2f180c4effbad72a lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x54:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac6b expref: 49 pid: 6496 timeout: 706 lvb_type: 0 00000100:00100000:1.0:1762166987.850133:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7ded180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765449809152:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166987.850203:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccaf2ccc0 going to sleep for 11 seconds 00000001:00080000:0.0:1762166987.850378:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876796 is committed 00000001:00080000:0.0:1762166987.850387:0:25941:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179876795 is committed 00000100:00100000:1.0:1762166987.850989:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7ded180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765449809152:192.168.204.38@tcp:104: 00010000:00010000:1.0:1762166987.851012:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945d02174e00/0x2f180c4effbad738 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x54:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:3.0:1762166987.851530:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166987.851615:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450778496 00000100:00100000:1.0:1762166987.851622:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450778496 00010000:00010000:1.0:1762166987.851648:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf400/0x2f180c4effbad72a lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x54:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac6b expref: 50 pid: 6496 timeout: 706 lvb_type: 0 00000100:00100000:1.0:1762166987.851699:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9865 00000100:00100000:1.0:1762166987.851709:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7bbb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+50:2419:x1847765450778496:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166987.851725:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166987.851732:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf400/0x2f180c4effbad72a lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x54:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac6b expref: 50 pid: 6496 timeout: 706 lvb_type: 0 00010000:00010000:1.0:1762166987.851743:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf400/0x2f180c4effbad72a lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x54:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac6b expref: 50 pid: 6496 timeout: 706 lvb_type: 0 00010000:00010000:1.0:1762166987.851760:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf400/0x2f180c4effbad72a lrc: 0/0,0 mode: --/CR res: [0x200000405:0x54:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac6b expref: 50 pid: 6496 timeout: 706 lvb_type: 0 00010000:00010000:1.0:1762166987.851777:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x54:0x0].0x0 (ffff945cc7df9e00) 00010000:00010000:1.0:1762166987.851783:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945d02174e00/0x2f180c4effbad738 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x54:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166987.851796:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945d02174e00/0x2f180c4effbad738 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x54:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166987.851804:0:6479:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d02174e00/0x2f180c4effbad738 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x54:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166987.851831:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166987.851850:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945d02174e00/0x2f180c4effbad738 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x54:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166987.851858:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d02174e00/0x2f180c4effbad738 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x54:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166987.851873:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfc00/0x2f180c4effbad73f lrc: 3/0,1 mode: --/EX res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00000100:00100000:1.0:1762166987.851878:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7bbb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+49:2419:x1847765450778496:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 169us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166987.851897:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9865 00010000:00010000:0.0:1762166987.851897:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde600/0x2f180c4effbad6e4 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac4f expref: 49 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166987.851905:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfc00/0x2f180c4effbad73f lrc: 4/0,1 mode: --/EX res: [0x200000405:0x55:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166987.851929:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde600/0x2f180c4effbad6e4 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac4f expref: 48 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166987.851936:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde600/0x2f180c4effbad6e4 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac4f expref: 48 pid: 6496 timeout: 706 lvb_type: 0 00000100:00100000:0.0:1762166987.851950:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc76af100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765449809280:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166987.852002:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1762166987.852765:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc76af100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765449809280:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166987.852783:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfc00/0x2f180c4effbad73f lrc: 3/0,1 mode: --/EX res: [0x200000405:0x55:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:2.0:1762166987.852974:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166987.853111:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450778624 00000100:00100000:1.0:1762166987.853125:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450778624 00010000:00010000:1.0:1762166987.853170:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde600/0x2f180c4effbad6e4 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac4f expref: 49 pid: 6496 timeout: 706 lvb_type: 0 00000100:00100000:1.0:1762166987.853230:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9866 00000100:00100000:1.0:1762166987.853241:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+49:2419:x1847765450778624:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166987.853256:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166987.853263:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde600/0x2f180c4effbad6e4 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac4f expref: 49 pid: 6496 timeout: 706 lvb_type: 0 00010000:00010000:1.0:1762166987.853276:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde600/0x2f180c4effbad6e4 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac4f expref: 49 pid: 6496 timeout: 706 lvb_type: 0 00010000:00010000:1.0:1762166987.853301:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde600/0x2f180c4effbad6e4 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac4f expref: 49 pid: 6496 timeout: 706 lvb_type: 0 00010000:00010000:1.0:1762166987.853319:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff945cc7df9500) 00010000:00010000:1.0:1762166987.853325:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfc00/0x2f180c4effbad73f lrc: 3/0,1 mode: --/EX res: [0x200000405:0x55:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166987.853334:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfc00/0x2f180c4effbad73f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x55:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166987.853341:0:6479:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfc00/0x2f180c4effbad73f lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x55:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166987.853372:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166987.853412:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfc00/0x2f180c4effbad73f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x55:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166987.853423:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfc00/0x2f180c4effbad73f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x55:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:1.0:1762166987.853432:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+48:2419:x1847765450778624:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 192us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166987.853441:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9866 00000100:00100000:0.0:1762166987.853899:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc76af100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:19593:1847765449809408:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166987.853944:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166987.853982:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccee8d000 going to sleep for 11 seconds 00000100:00100000:2.0:1762166987.854019:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449809408 00000100:00100000:2.0:1762166987.854027:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449809408 00000100:00100000:2.0:1762166987.854078:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1509 00000100:00100000:2.0:1762166987.854089:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc76adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:19593:x1847765449809408:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762166987.854219:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc76adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:19593:x1847765449809408:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 133us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166987.854228:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1509 00000100:00100000:0.0:1762166987.854270:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc76af100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:19593:1847765449809408:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166987.854327:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc76af100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:19593:1847765449809536:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166987.854357:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166987.854383:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc3ea6c00 going to sleep for 11 seconds 00000100:00100000:2.0:1762166987.854425:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449809536 00000100:00100000:2.0:1762166987.854432:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449809536 00000100:00100000:2.0:1762166987.854500:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1510 00000100:00100000:2.0:1762166987.854512:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc76ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:19593:x1847765449809536:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762166987.854597:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc76ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:19593:x1847765449809536:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 89us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166987.854605:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1510 00000100:00100000:0.0:1762166987.854627:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc76af100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:19593:1847765449809536:0@lo:1000:mdt_rdpg00_003.0 00000001:00080000:0.0:1762166987.854717:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935352 00000100:00100000:0.0:1762166987.854757:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc76af100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:19593:1847765449809664:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:0.0:1762166987.854800:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166987.854818:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc350f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166987.854840:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449809664 00000100:00100000:2.0:1762166987.854845:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449809664 00000100:00100000:2.0:1762166987.854871:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1511 00000100:00100000:2.0:1762166987.854878:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc76aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:19593:x1847765449809664:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762166987.854981:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc76aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:19593:x1847765449809664:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 104us (179us total) trans 17179876797 rc 0/0 00000100:00100000:2.0:1762166987.854990:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1511 00000100:00100000:0.0:1762166987.855004:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc76af100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:19593:1847765449809664:0@lo:1000:mdt_rdpg00_003.0 00000001:00080000:0.0:1762166987.855047:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935353 00010000:00010000:0.0:1762166987.855068:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfc00/0x2f180c4effbad73f lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x55:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166987.855076:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfc00/0x2f180c4effbad73f lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x55:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166987.855080:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfc00/0x2f180c4effbad73f lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x55:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166987.855084:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdfc00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166987.855088:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfc00/0x2f180c4effbad73f lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x55:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166987.855092:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfc00/0x2f180c4effbad73f lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x55:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166987.855100:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff945cc7df9500) 00010000:00010000:0.0:1762166987.855102:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166987.855105:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfc00/0x2f180c4effbad73f lrc: 2/0,0 mode: --/EX res: [0x200000405:0x55:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166987.855108:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfc00/0x2f180c4effbad73f lrc: 0/0,0 mode: --/EX res: [0x200000405:0x55:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166987.855122:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945d02174e00/0x2f180c4effbad738 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x54:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166987.855126:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945d02174e00/0x2f180c4effbad738 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x54:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166987.855129:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945d02174e00/0x2f180c4effbad738 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x54:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166987.855132:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945d02174e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166987.855134:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d02174e00/0x2f180c4effbad738 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x54:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166987.855137:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d02174e00/0x2f180c4effbad738 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x54:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166987.855141:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x54:0x0].0x0 (ffff945cc7df9e00) 00010000:00010000:0.0:1762166987.855142:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1762166987.855144:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945d02174e00/0x2f180c4effbad738 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x54:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166987.855147:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d02174e00/0x2f180c4effbad738 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x54:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166987.855154:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x54:0x0].0x0 (ffff945cc7df9e00) 00010000:00010000:0.0:1762166987.855156:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166987.855161:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad707 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x54:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac64 expref: 50 pid: 6496 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166987.855243:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7bba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+49:63272:x1847765450778368:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 5336us (5470us total) trans 8589935354 rc 0/0 00000100:00100000:0.0:1762166987.855251:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 12020 00000020:00080000:0.0:1762166987.855255:0:19593:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1762166987.856229:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166987.856267:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450778752 00000100:00100000:0.0:1762166987.856273:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450778752 00000100:00100000:0.0:1762166987.856311:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30975 00000100:00100000:0.0:1762166987.856320:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+49:63272:x1847765450778752:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166987.856335:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166987.856349:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde000/0x2f180c4effbad746 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x54:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eac79 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166987.856395:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde000/0x2f180c4effbad746 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x54:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac79 expref: 50 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166987.856408:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde000/0x2f180c4effbad746 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x54:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac79 expref: 50 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166987.856423:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x54:0x0].0x0 (ffff945cc7df9e00) 00010000:00010000:0.0:1762166987.856426:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166987.856429:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bde000, rc 0) 00000100:00100000:0.0:1762166987.856464:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+50:63272:x1847765450778752:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 145us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166987.856470:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30975 00000100:00100000:3.0:1762166987.857828:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166987.857878:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450779008 00000100:00100000:0.0:1762166987.857884:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450779008 00000100:00100000:0.0:1762166987.857910:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 12021 00000100:00100000:0.0:1762166987.857915:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff2fec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+50:63272:x1847765450779008:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166987.858050:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff2fec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+51:63272:x1847765450779008:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 134us (229us total) trans 8589935355 rc 0/0 00000100:00100000:0.0:1762166987.858054:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 12021 00000100:00100000:2.0:1762166987.859432:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166987.859502:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450779264 00000100:00100000:0.0:1762166987.859508:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450779264 00000100:00100000:0.0:1762166987.859553:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 12022 00000100:00100000:0.0:1762166987.859562:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+51:63272:x1847765450779264:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:0.0:1762166987.859706:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+52:63272:x1847765450779264:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 138us (269us total) trans 8589935356 rc 0/0 00000100:00100000:0.0:1762166987.859718:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 12022 00000100:00100000:2.0:1762166987.861057:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166987.861294:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450779392 00000100:00100000:0.0:1762166987.861300:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450779392 00000100:00100000:0.0:1762166987.861339:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30976 00000100:00100000:0.0:1762166987.861347:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+52:63272:x1847765450779392:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166987.861363:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166987.861379:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde400/0x2f180c4effbad74d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eac80 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166987.861442:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdee00/0x2f180c4effbad754 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.861455:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdee00/0x2f180c4effbad754 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.861465:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdee00/0x2f180c4effbad754 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.861496:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdea00/0x2f180c4effbad75b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.861504:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdea00/0x2f180c4effbad75b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.861511:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdea00/0x2f180c4effbad75b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.861579:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde800/0x2f180c4effbad762 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.861587:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde800/0x2f180c4effbad762 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.861595:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde800/0x2f180c4effbad762 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:0.0:1762166987.861629:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x55:0x0]: returning size 0 00000004:00200000:0.0:1762166987.861633:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166987.861647:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde800/0x2f180c4effbad762 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.861656:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde800/0x2f180c4effbad762 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.861664:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdee00/0x2f180c4effbad754 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.861670:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdee00/0x2f180c4effbad754 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.861676:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdee00/0x2f180c4effbad754 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.861693:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdee00/0x2f180c4effbad754 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.861699:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdee00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166987.861703:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdee00/0x2f180c4effbad754 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.861710:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdee00/0x2f180c4effbad754 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.861721:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945cd0738700) 00010000:00010000:0.0:1762166987.861724:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166987.861728:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdee00/0x2f180c4effbad754 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.861734:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdee00/0x2f180c4effbad754 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.861745:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdea00/0x2f180c4effbad75b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.861751:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdea00/0x2f180c4effbad75b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.861756:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdea00/0x2f180c4effbad75b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.861761:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdea00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166987.861764:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdea00/0x2f180c4effbad75b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.861770:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdea00/0x2f180c4effbad75b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.861777:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9c8d69b4 (ffff945cc7df9d00) 00010000:00010000:0.0:1762166987.861779:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166987.861782:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdea00/0x2f180c4effbad75b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.861788:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdea00/0x2f180c4effbad75b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.861811:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde400/0x2f180c4effbad74d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac80 expref: 54 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166987.861824:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde800/0x2f180c4effbad762 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac80 expref: 53 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166987.861837:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff945cd1ddd300) 00010000:00010000:0.0:1762166987.861840:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166987.861843:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bde800, rc 0) 00000100:00100000:0.0:1762166987.861886:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+53:63272:x1847765450779392:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 539us (831us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166987.861893:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30976 00000100:00100000:3.0:1762166987.863005:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166987.863049:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450779648 00000100:00100000:0.0:1762166987.863055:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450779648 00000100:00100000:0.0:1762166987.863090:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30977 00000100:00100000:0.0:1762166987.863098:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7bb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+53:63272:x1847765450779648:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:0.0:1762166987.863129:0:6496:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1762166987.863141:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde800/0x2f180c4effbad762 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac80 expref: 53 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166987.863151:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff945cd1ddd300) 00010000:00010000:0.0:1762166987.863159:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde200/0x2f180c4effbad6a5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac41 expref: 52 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166987.863165:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945cd0738700) 00010000:00010000:0.0:1762166987.863167:0:6496:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166987.863175:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad769 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.863181:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad769 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.863187:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad769 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.863195:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfc00/0x2f180c4effbad770 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.863201:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfc00/0x2f180c4effbad770 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.863207:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfc00/0x2f180c4effbad770 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.863258:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf600/0x2f180c4effbad777 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.863264:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf600/0x2f180c4effbad777 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x55:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.863268:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf600/0x2f180c4effbad777 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x55:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.863398:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfa00/0x2f180c4effbad77e lrc: 3/0,1 mode: --/PW res: [0x200000405:0x55:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.863403:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfa00/0x2f180c4effbad77e lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x55:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.863407:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfa00/0x2f180c4effbad77e lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x55:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.863411:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfa00/0x2f180c4effbad77e lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x55:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.863415:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfa00/0x2f180c4effbad77e lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x55:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.863418:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfa00/0x2f180c4effbad77e lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x55:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.863434:0:6496:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1762166987.863443:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf600/0x2f180c4effbad777 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x55:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.863446:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf600/0x2f180c4effbad777 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x55:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.863450:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf600/0x2f180c4effbad777 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x55:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.863453:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdf600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166987.863455:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf600/0x2f180c4effbad777 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x55:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.863459:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf600/0x2f180c4effbad777 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x55:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.863465:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff945cd1ddd800) 00010000:00010000:3.0:1762166987.863466:0:10256:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1762166987.863468:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1762166987.863472:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf600/0x2f180c4effbad777 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x55:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166987.863474:0:10256:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfa00/0x2f180c4effbad77e lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x55:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.863494:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf600/0x2f180c4effbad777 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x55:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166987.863513:0:10256:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdfa00 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166987.863518:0:10256:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfa00/0x2f180c4effbad77e lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x55:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166987.863525:0:10256:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfa00/0x2f180c4effbad77e lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x55:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166987.863538:0:10256:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x55:0x0].0x0 (ffff945cd1ddd800) 00010000:00010000:3.0:1762166987.863541:0:10256:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1762166987.863544:0:10256:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfa00/0x2f180c4effbad77e lrc: 1/0,0 mode: --/PW res: [0x200000405:0x55:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166987.863550:0:10256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfa00/0x2f180c4effbad77e lrc: 0/0,0 mode: --/PW res: [0x200000405:0x55:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.863568:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad769 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166987.863570:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1762166987.863574:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166987.863576:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad769 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:3.0:1762166987.863578:0:10256:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166987.863583:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad769 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.863590:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad769 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.863593:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdfe00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166987.863595:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad769 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.863598:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad769 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.863602:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945cd0738700) 00010000:00010000:0.0:1762166987.863604:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166987.863605:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad769 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.863608:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad769 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00000004:00010000:0.0:1762166987.863613:0:6496:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000001fa2e2ad reply state 0000000086f80d98 transno 8589935357 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfc00/0x2f180c4effbad770 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.863619:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfc00/0x2f180c4effbad770 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.863623:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9c8d69b4 (ffff945cc7df9d00) 00010000:00010000:0.0:1762166987.863624:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762166987.863626:0:6496:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166987.863659:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7bb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+53:63272:x1847765450779648:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 562us (657us total) trans 8589935357 rc 0/0 00000100:00100000:0.0:1762166987.863663:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30977 00000100:00100000:2.0:1762166987.870312:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166987.870367:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450779776 00000100:00100000:0.0:1762166987.870382:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450779776 00000100:00100000:0.0:1762166987.870438:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30978 00000100:00100000:0.0:1762166987.870449:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf783f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+53:63273:x1847765450779776:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166987.870473:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166987.870520:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde400/0x2f180c4effbad785 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eac87 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166987.870578:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdea00/0x2f180c4effbad78c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.870588:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdea00/0x2f180c4effbad78c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.870599:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdea00/0x2f180c4effbad78c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:0.0:1762166987.870641:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1762166987.870645:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166987.870663:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdea00/0x2f180c4effbad78c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.870700:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde400/0x2f180c4effbad785 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac87 expref: 55 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166987.870717:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdea00/0x2f180c4effbad78c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac87 expref: 54 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166987.870726:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945cd0738700) 00010000:00010000:0.0:1762166987.870729:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1762166987.870732:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdea00, rc 0) 00000100:00100000:0.0:1762166987.870787:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf783f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+54:63273:x1847765450779776:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 340us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166987.870795:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30978 00000100:00100000:2.0:1762166987.872071:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166987.872149:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450780032 00000100:00100000:0.0:1762166987.872158:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450780032 00000100:00100000:0.0:1762166987.872202:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30979 00000100:00100000:0.0:1762166987.872226:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc576b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+54:63273:x1847765450780032:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166987.872246:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166987.872259:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad793 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eac8e expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166987.872309:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf600/0x2f180c4effbad79a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.872320:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf600/0x2f180c4effbad79a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.872329:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf600/0x2f180c4effbad79a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.872339:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde200/0x2f180c4effbad7a1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.872347:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde200/0x2f180c4effbad7a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.872353:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde200/0x2f180c4effbad7a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.872455:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde800/0x2f180c4effbad7a8 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x54:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.872463:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde800/0x2f180c4effbad7a8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.872475:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde800/0x2f180c4effbad7a8 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:0.0:1762166987.872509:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x54:0x0]: returning size 0 00010000:00010000:0.0:1762166987.872587:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf600/0x2f180c4effbad79a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.872594:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf600/0x2f180c4effbad79a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.872599:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf600/0x2f180c4effbad79a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.872605:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf600/0x2f180c4effbad79a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.872610:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdf600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166987.872613:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf600/0x2f180c4effbad79a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.872619:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf600/0x2f180c4effbad79a lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.872628:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945cd0738700) 00010000:00010000:0.0:1762166987.872631:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166987.872634:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf600/0x2f180c4effbad79a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.872639:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf600/0x2f180c4effbad79a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.872650:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde200/0x2f180c4effbad7a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.872659:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde200/0x2f180c4effbad7a1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.872663:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde200/0x2f180c4effbad7a1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.872667:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bde200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166987.872670:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde200/0x2f180c4effbad7a1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.872674:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde200/0x2f180c4effbad7a1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.872679:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x64c18fe5 (ffff945bc812e800) 00010000:00010000:0.0:1762166987.872681:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166987.872698:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde200/0x2f180c4effbad7a1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.872704:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde200/0x2f180c4effbad7a1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.872733:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad793 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac8e expref: 57 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166987.872744:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde800/0x2f180c4effbad7a8 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac8e expref: 56 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166987.872751:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x54:0x0].0x0 (ffff945cc7df9e00) 00010000:00010000:0.0:1762166987.872753:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166987.872755:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bde800, rc 0) 00000100:00100000:0.0:1762166987.872808:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc576b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+56:63273:x1847765450780032:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 595us (745us total) trans 8589935358 rc 0/0 00000100:00100000:0.0:1762166987.872814:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30979 00000100:00100000:3.0:1762166987.874224:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166987.874289:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450780288 00000100:00100000:0.0:1762166987.874300:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450780288 00000100:00100000:0.0:1762166987.874372:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30980 00000100:00100000:0.0:1762166987.874383:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7bbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+56:63273:x1847765450780288:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166987.874410:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166987.874431:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdee00/0x2f180c4effbad7b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eac95 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166987.874535:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf200/0x2f180c4effbad7bd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.874550:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf200/0x2f180c4effbad7bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.874561:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf200/0x2f180c4effbad7bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.874570:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdec00/0x2f180c4effbad7c4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.874577:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdec00/0x2f180c4effbad7c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.874583:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdec00/0x2f180c4effbad7c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.874722:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfa00/0x2f180c4effbad7cb lrc: 3/1,0 mode: --/PR res: [0x200000405:0x56:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.874730:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfa00/0x2f180c4effbad7cb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.874738:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfa00/0x2f180c4effbad7cb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:0.0:1762166987.874748:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x56:0x0]: returning size 0 00010000:00010000:0.0:1762166987.874826:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf200/0x2f180c4effbad7bd lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.874834:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf200/0x2f180c4effbad7bd lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.874840:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf200/0x2f180c4effbad7bd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.874846:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf200/0x2f180c4effbad7bd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.874852:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdf200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166987.874856:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf200/0x2f180c4effbad7bd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.874863:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf200/0x2f180c4effbad7bd lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.874874:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945cd0738700) 00010000:00010000:0.0:1762166987.874877:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166987.874881:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf200/0x2f180c4effbad7bd lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.874886:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf200/0x2f180c4effbad7bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.874900:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdec00/0x2f180c4effbad7c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.874910:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdec00/0x2f180c4effbad7c4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.874916:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdec00/0x2f180c4effbad7c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.874920:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdec00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166987.874923:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdec00/0x2f180c4effbad7c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.874929:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdec00/0x2f180c4effbad7c4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.874935:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc72e1b9b (ffff945bc812ec00) 00010000:00010000:0.0:1762166987.874938:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166987.874941:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdec00/0x2f180c4effbad7c4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.874946:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdec00/0x2f180c4effbad7c4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.874979:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdee00/0x2f180c4effbad7b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac95 expref: 59 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166987.874992:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfa00/0x2f180c4effbad7cb lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac95 expref: 58 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166987.874999:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x56:0x0].0x0 (ffff945cd1ddd300) 00010000:00010000:0.0:1762166987.875001:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166987.875004:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdfa00, rc 0) 00000100:00100000:0.0:1762166987.875065:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7bbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+58:63273:x1847765450780288:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 683us (848us total) trans 8589935359 rc 0/0 00000100:00100000:0.0:1762166987.875073:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30980 00000100:00100000:2.0:1762166987.876427:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166987.876516:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450780416 00000100:00100000:3.0:1762166987.876524:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450780416 00000100:00100000:3.0:1762166987.876571:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19520 00000100:00100000:3.0:1762166987.876581:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc576b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+17:2416:x1847765450780416:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166987.876597:0:9168:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166987.876615:0:9168:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4b63000/0x2f180c4effbad7d9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x76:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eac9c expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166987.876640:0:9168:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x76:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1762166987.876657:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166987.876660:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166987.876669:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4b63000/0x2f180c4effbad7d9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac9c expref: 18 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166987.876700:0:9168:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4b63000/0x2f180c4effbad7d9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac9c expref: 18 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166987.876712:0:9168:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4b63000, rc 0) 00000100:00100000:3.0:1762166987.876759:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc576b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+18:2416:x1847765450780416:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 181us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166987.876767:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19520 00000100:00100000:2.0:1762166987.878106:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166987.878155:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450780672 00000100:00100000:0.0:1762166987.878162:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450780672 00000100:00100000:0.0:1762166987.878205:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30981 00000100:00100000:0.0:1762166987.878215:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5769500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+58:63273:x1847765450780672:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166987.878232:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166987.878244:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde400/0x2f180c4effbad7e0 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x54:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eaca3 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166987.878321:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde600/0x2f180c4effbad7e7 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x54:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.878330:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde600/0x2f180c4effbad7e7 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x54:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.878338:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde600/0x2f180c4effbad7e7 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x54:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:0.0:1762166987.878347:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x54:0x0]: returning size 0 00010000:00010000:0.0:1762166987.878448:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde400/0x2f180c4effbad7e0 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x54:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaca3 expref: 61 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166987.878461:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde600/0x2f180c4effbad7e7 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x54:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaca3 expref: 60 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166987.878466:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x54:0x0].0x0 (ffff945cc7df9e00) 00010000:00010000:0.0:1762166987.878468:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1762166987.878470:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bde600, rc 0) 00000100:00100000:0.0:1762166987.878532:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5769500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+60:63273:x1847765450780672:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 320us (428us total) trans 8589935360 rc 0/0 00000100:00100000:0.0:1762166987.878541:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30981 00000100:00100000:1.0:1762166987.929259:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166987.929330:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450780800 00000100:00100000:3.0:1762166987.929343:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450780800 00000100:00100000:3.0:1762166987.929417:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19521 00000100:00100000:3.0:1762166987.929428:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7ded180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+18:2417:x1847765450780800:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:3.0:1762166987.929527:0:9168:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc4b63400/0x2f180c4effbad7f5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166987.929553:0:9168:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4b63a00/0x2f180c4effbad731 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac72 expref: 18 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166987.929562:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166987.929565:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166987.929568:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4b63400/0x2f180c4effbad7f5 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166987.929611:0:9168:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4b63a00/0x2f180c4effbad731 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac72 expref: 18 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166987.929623:0:9168:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc4b63a00/0x2f180c4effbad731 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac72 expref: 18 pid: 9168 timeout: 707 lvb_type: 0 00000100:00100000:3.0:1762166987.929637:0:9168:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7bba680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9168:1847765449809792:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166987.929751:0:9168:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc4033840 going to sleep for 11 seconds 00000100:00100000:3.0:1762166987.930644:0:9168:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7bba680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9168:1847765449809792:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166987.930663:0:9168:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc4b63400/0x2f180c4effbad7f5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166987.930853:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166987.930909:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450780928 00000100:00100000:0.0:1762166987.930914:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450780928 00010000:00010000:0.0:1762166987.930937:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4b63a00/0x2f180c4effbad731 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac72 expref: 19 pid: 9168 timeout: 707 lvb_type: 0 00000100:00100000:0.0:1762166987.930962:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9867 00000100:00100000:0.0:1762166987.930967:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf9d1f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+19:2419:x1847765450780928:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166987.930976:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166987.930996:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc4b63a00/0x2f180c4effbad731 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac72 expref: 19 pid: 9168 timeout: 707 lvb_type: 0 00010000:00010000:0.0:1762166987.931006:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc4b63a00/0x2f180c4effbad731 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac72 expref: 19 pid: 9168 timeout: 707 lvb_type: 0 00010000:00010000:0.0:1762166987.931023:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4b63a00/0x2f180c4effbad731 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac72 expref: 19 pid: 9168 timeout: 707 lvb_type: 0 00010000:00010000:0.0:1762166987.931036:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166987.931037:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166987.931040:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4b63400/0x2f180c4effbad7f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166987.931047:0:6479:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4b63400/0x2f180c4effbad7f5 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166987.931065:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166987.931098:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf9d1f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450780928:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 131us (246us total) trans 0 rc 0/0 00010000:00010000:3.0:1762166987.931103:0:9168:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc4b63400/0x2f180c4effbad7f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166987.931104:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9867 00010000:00010000:3.0:1762166987.931116:0:9168:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4b63400/0x2f180c4effbad7f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166987.931143:0:9168:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc4b63400/0x2f180c4effbad7f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166987.931152:0:9168:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4b63400/0x2f180c4effbad7f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166987.931160:0:9168:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc4b63400/0x2f180c4effbad7f5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166987.931168:0:9168:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4b63400 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166987.931174:0:9168:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4b63400/0x2f180c4effbad7f5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166987.931185:0:9168:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4b63400/0x2f180c4effbad7f5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166987.931199:0:9168:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc4b63400/0x2f180c4effbad7f5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166987.931207:0:9168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4b63400/0x2f180c4effbad7f5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166987.931310:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7ded180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+17:2417:x1847765450780800:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 1883us (2065us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166987.931318:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19521 00000100:00100000:1.0:1762166987.932102:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166987.932133:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450781056 00000100:00100000:3.0:1762166987.932138:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450781056 00000100:00100000:3.0:1762166987.932163:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19522 00000100:00100000:3.0:1762166987.932170:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7deed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+17:2416:x1847765450781056:12345-192.168.204.38@tcp:1:lfs.0 00010000:00010000:3.0:1762166987.932194:0:9168:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62000/0x2f180c4effbad7fc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x76:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166987.932204:0:9168:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4b63000/0x2f180c4effbad7d9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x76:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac9c expref: 17 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166987.932209:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166987.932210:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166987.932212:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62000/0x2f180c4effbad7fc lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x76:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166987.932229:0:9168:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4b63000/0x2f180c4effbad7d9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x76:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac9c expref: 17 pid: 9168 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1762166987.932237:0:9168:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc4b63000/0x2f180c4effbad7d9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x76:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac9c expref: 17 pid: 9168 timeout: 707 lvb_type: 1 00000100:00100000:3.0:1762166987.932246:0:9168:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7bba680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9168:1847765449809920:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166987.932284:0:9168:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc4033840 going to sleep for 11 seconds 00000100:00100000:3.0:1762166987.932987:0:9168:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7bba680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9168:1847765449809920:192.168.204.38@tcp:104: 00010000:00010000:3.0:1762166987.933067:0:9168:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62000/0x2f180c4effbad7fc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x76:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166987.933110:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166987.933171:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450781184 00000100:00100000:0.0:1762166987.933176:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450781184 00010000:00010000:0.0:1762166987.933196:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4b63000/0x2f180c4effbad7d9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x76:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac9c expref: 18 pid: 9168 timeout: 707 lvb_type: 1 00000100:00100000:0.0:1762166987.933229:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9868 00000100:00100000:0.0:1762166987.933236:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7dee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+18:2418:x1847765450781184:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166987.933243:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166987.933255:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc4b63000/0x2f180c4effbad7d9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x76:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac9c expref: 18 pid: 9168 timeout: 707 lvb_type: 1 00010000:00010000:0.0:1762166987.933263:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc4b63000/0x2f180c4effbad7d9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x76:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac9c expref: 18 pid: 9168 timeout: 707 lvb_type: 1 00010000:00010000:0.0:1762166987.933277:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4b63000/0x2f180c4effbad7d9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x76:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac9c expref: 18 pid: 9168 timeout: 707 lvb_type: 1 00010000:00010000:0.0:1762166987.933285:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166987.933286:0:6479:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166987.933289:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62000/0x2f180c4effbad7fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166987.933295:0:6479:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62000/0x2f180c4effbad7fc lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x76:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166987.933314:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166987.933332:0:9168:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62000/0x2f180c4effbad7fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166987.933341:0:9168:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62000/0x2f180c4effbad7fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166987.933347:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7dee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+17:2418:x1847765450781184:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 109us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166987.933354:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9868 00010000:00010000:3.0:1762166987.933358:0:9168:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62000/0x2f180c4effbad7fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166987.933364:0:9168:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62000/0x2f180c4effbad7fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166987.933370:0:9168:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62000/0x2f180c4effbad7fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166987.933374:0:9168:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4b62000 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:3.0:1762166987.933376:0:9168:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62000/0x2f180c4effbad7fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166987.933381:0:9168:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62000/0x2f180c4effbad7fc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166987.933391:0:9168:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62000/0x2f180c4effbad7fc lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166987.933397:0:9168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62000/0x2f180c4effbad7fc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1762166987.933522:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7deed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+16:2416:x1847765450781056:12345-192.168.204.38@tcp:1:lfs.0 Request processed in 1351us (1419us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166987.933531:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19522 00000100:00100000:1.0:1762166987.934309:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166987.934358:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450781440 00000100:00100000:0.0:1762166987.934362:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450781440 00000100:00100000:0.0:1762166987.934403:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30982 00000100:00100000:0.0:1762166987.934410:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7def800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+60:63273:x1847765450781440:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:0.0:1762166987.934466:0:6496:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166987.934494:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde800/0x2f180c4effbad7a8 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac8e expref: 60 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166987.934506:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x54:0x0].0x0 (ffff945cc7df9e00) 00010000:00010000:0.0:1762166987.934509:0:6496:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166987.934561:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde400/0x2f180c4effbad803 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x54:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.934573:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde400/0x2f180c4effbad803 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x54:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.934581:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde400/0x2f180c4effbad803 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x54:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00010000:0.0:1762166987.934713:0:6496:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000006a82f11 reply state 00000000a1a4f66d transno 8589935361 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde400/0x2f180c4effbad803 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x54:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.934723:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde400/0x2f180c4effbad803 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x54:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.934730:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x54:0x0].0x0 (ffff945cc7df9e00) 00010000:00010000:0.0:1762166987.934732:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762166987.934734:0:6496:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166987.934801:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7def800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+61:63273:x1847765450781440:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 390us (492us total) trans 8589935361 rc 0/0 00000100:00100000:0.0:1762166987.934808:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30982 00000100:00100000:2.0:1762166987.935569:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166987.935603:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450781568 00000100:00100000:3.0:1762166987.935608:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450781568 00000100:00100000:3.0:1762166987.935641:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19523 00000100:00100000:3.0:1762166987.935649:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5769c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+16:63273:x1847765450781568:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166987.935662:0:9168:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166987.935677:0:9168:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62800/0x2f180c4effbad80a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eacaa expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1762166987.935707:0:9168:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x75:0x0] initial LVB size: 0, mtime: 0x690888cb, atime: 0x690888cb, ctime: 0x690888cc, blocks: 0x0 00010000:00010000:3.0:1762166987.935721:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166987.935724:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1762166987.935732:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62800/0x2f180c4effbad80a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eacaa expref: 17 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166987.935746:0:9168:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62800/0x2f180c4effbad80a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eacaa expref: 17 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166987.935762:0:9168:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4b62800, rc 0) 00000100:00100000:3.0:1762166987.935795:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5769c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+17:63273:x1847765450781568:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 147us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166987.935803:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19523 00000100:00100000:2.0:1762166987.936465:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166987.936519:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450781696 00000100:00100000:3.0:1762166987.936523:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450781696 00000100:00100000:3.0:1762166987.936547:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19524 00000100:00100000:3.0:1762166987.936551:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5768a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+17:2417:x1847765450781696:12345-192.168.204.38@tcp:2:lfs.0 00002000:00010000:3.0:1762166987.936655:0:9168:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166987.936659:0:9168:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb mtime from disk: 1762166987 -> 1762166987 00002000:00010000:3.0:1762166987.936662:0:9168:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb atime from disk: 1762166987 -> 1762166987 00002000:00010000:3.0:1762166987.936664:0:9168:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb ctime from disk: 1762166988 -> 1762166988 00002000:00010000:3.0:1762166987.936666:0:9168:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1762166987.936704:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5768a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1e11365-ba0b-405b-99c9-a704373217f2+18:2417:x1847765450781696:12345-192.168.204.38@tcp:2:lfs.0 Request processed in 151us (238us total) trans 17179876798 rc 0/0 00000100:00100000:3.0:1762166987.936712:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19524 00000100:00100000:1.0:1762166987.937578:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166987.937628:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450781952 00000100:00100000:0.0:1762166987.937634:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450781952 00000100:00100000:0.0:1762166987.937670:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 12023 00000100:00100000:0.0:1762166987.937677:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7dec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+61:63273:x1847765450781952:12345-192.168.204.38@tcp:35:lfs.0 00000004:00010000:0.0:1762166987.937747:0:19593:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000405:0x54:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde600/0x2f180c4effbad7e7 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x54:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaca3 expref: 61 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166987.937773:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdee00/0x2f180c4effbad811 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x54:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166987.937781:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde000/0x2f180c4effbad746 lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x54:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac79 expref: 61 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166987.937786:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdee00/0x2f180c4effbad811 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x54:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166987.937811:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde000/0x2f180c4effbad746 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x54:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac79 expref: 61 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166987.937820:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde000/0x2f180c4effbad746 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x54:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac79 expref: 61 pid: 6496 timeout: 707 lvb_type: 0 00000100:00100000:0.0:1762166987.937832:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc76ad880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765449810048:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166987.937892:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc402fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1762166987.938634:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc76ad880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765449810048:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166987.938651:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdee00/0x2f180c4effbad811 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x54:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:1.0:1762166987.938859:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166987.938893:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450782080 00000100:00100000:0.0:1762166987.938898:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450782080 00010000:00010000:0.0:1762166987.938914:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde000/0x2f180c4effbad746 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x54:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac79 expref: 62 pid: 6496 timeout: 707 lvb_type: 0 00000100:00100000:0.0:1762166987.938937:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9869 00000100:00100000:0.0:1762166987.938942:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7def480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+62:2419:x1847765450782080:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166987.938951:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166987.938956:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde000/0x2f180c4effbad746 lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x54:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac79 expref: 62 pid: 6496 timeout: 707 lvb_type: 0 00010000:00010000:0.0:1762166987.938965:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde000/0x2f180c4effbad746 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x54:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac79 expref: 62 pid: 6496 timeout: 707 lvb_type: 0 00010000:00010000:0.0:1762166987.938977:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde000/0x2f180c4effbad746 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x54:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac79 expref: 62 pid: 6496 timeout: 707 lvb_type: 0 00010000:00010000:0.0:1762166987.938989:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x54:0x0].0x0 (ffff945cc7df9e00) 00010000:00010000:0.0:1762166987.938992:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdee00/0x2f180c4effbad811 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x54:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166987.938998:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdee00/0x2f180c4effbad811 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x54:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166987.939005:0:6479:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdee00/0x2f180c4effbad811 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x54:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166987.939021:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166987.939045:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdee00/0x2f180c4effbad811 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x54:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:0.0:1762166987.939048:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7def480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+61:2419:x1847765450782080:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 104us (190us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166987.939060:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdee00/0x2f180c4effbad811 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x54:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:0.0:1762166987.939076:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9869 00010000:00010000:1.0:1762166987.939084:0:19593:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945d02174400/0x2f180c4effbad818 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x56:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166987.939097:0:19593:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfa00/0x2f180c4effbad7cb lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac95 expref: 60 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166987.939110:0:19593:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945d02174400/0x2f180c4effbad818 lrc: 4/0,1 mode: --/EX res: [0x200000405:0x56:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166987.939140:0:19593:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfa00/0x2f180c4effbad7cb lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac95 expref: 60 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166987.939152:0:19593:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfa00/0x2f180c4effbad7cb lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac95 expref: 60 pid: 6496 timeout: 707 lvb_type: 0 00000100:00100000:1.0:1762166987.939162:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7ded500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765449810176:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166987.939207:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccaf2ccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1762166987.939893:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7ded500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000_UUID:19593:1847765449810176:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166987.939908:0:19593:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945d02174400/0x2f180c4effbad818 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x56:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:2.0:1762166987.940077:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166987.940118:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450782208 00000100:00100000:0.0:1762166987.940123:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450782208 00010000:00010000:0.0:1762166987.940144:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfa00/0x2f180c4effbad7cb lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac95 expref: 61 pid: 6496 timeout: 707 lvb_type: 0 00000100:00100000:0.0:1762166987.940173:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9870 00000100:00100000:0.0:1762166987.940182:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc576b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+61:2418:x1847765450782208:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166987.940193:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166987.940198:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfa00/0x2f180c4effbad7cb lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac95 expref: 61 pid: 6496 timeout: 707 lvb_type: 0 00010000:00010000:0.0:1762166987.940209:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfa00/0x2f180c4effbad7cb lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac95 expref: 61 pid: 6496 timeout: 707 lvb_type: 0 00010000:00010000:0.0:1762166987.940225:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfa00/0x2f180c4effbad7cb lrc: 0/0,0 mode: --/PR res: [0x200000405:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac95 expref: 61 pid: 6496 timeout: 707 lvb_type: 0 00010000:00010000:0.0:1762166987.940243:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x56:0x0].0x0 (ffff945cd1ddd300) 00010000:00010000:0.0:1762166987.940247:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945d02174400/0x2f180c4effbad818 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x56:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166987.940254:0:6479:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945d02174400/0x2f180c4effbad818 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x56:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166987.940260:0:6479:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945d02174400/0x2f180c4effbad818 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x56:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19593 initiator: MDT0 00010000:00010000:0.0:1762166987.940281:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166987.940307:0:19593:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945d02174400/0x2f180c4effbad818 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x56:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:0.0:1762166987.940314:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc576b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+60:2418:x1847765450782208:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 132us (236us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166987.940316:0:19593:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d02174400/0x2f180c4effbad818 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x56:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19593 initiator: MDT0 00000100:00100000:0.0:1762166987.940327:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9870 00000100:00100000:1.0:1762166987.940710:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7deca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:19593:1847765449810304:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166987.940743:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166987.940763:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccaf2c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166987.940781:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449810304 00000100:00100000:2.0:1762166987.940785:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449810304 00000100:00100000:2.0:1762166987.940813:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1512 00000100:00100000:2.0:1762166987.940818:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7ded880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:19593:x1847765449810304:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762166987.940881:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7ded880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:19593:x1847765449810304:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 63us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166987.940886:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1512 00000100:00100000:1.0:1762166987.940917:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7deca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:19593:1847765449810304:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166987.940962:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7deca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:19593:1847765449810432:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166987.940985:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166987.941006:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccaf2c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166987.941015:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449810432 00000100:00100000:2.0:1762166987.941020:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449810432 00000100:00100000:2.0:1762166987.941038:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1513 00000100:00100000:2.0:1762166987.941042:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7dece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:19593:x1847765449810432:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762166987.941097:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7dece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:19593:x1847765449810432:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 54us (110us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166987.941104:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1513 00000100:00100000:1.0:1762166987.941120:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7deca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:19593:1847765449810432:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166987.941144:0:19593:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7deca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:19593:1847765449810560:0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:1.0:1762166987.941160:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166987.941174:0:19593:0:(client.c:2680:ptlrpc_set_wait()) set ffff945ccaf2c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1762166987.941192:0:6499:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449810560 00000100:00100000:2.0:1762166987.941196:0:6499:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449810560 00000100:00100000:2.0:1762166987.941214:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1514 00000100:00100000:2.0:1762166987.941218:0:6499:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7dec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:19593:x1847765449810560:12345-0@lo:1000:mdt_rdpg00_003.0 00000100:00100000:2.0:1762166987.941258:0:6499:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7dec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:19593:x1847765449810560:12345-0@lo:1000:mdt_rdpg00_003.0 Request processed in 40us (97us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166987.941262:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1514 00000100:00100000:1.0:1762166987.941282:0:19593:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7deca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-mdtlov_UUID:19593:1847765449810560:0@lo:1000:mdt_rdpg00_003.0 00000001:00080000:1.0:1762166987.941306:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935362 00000001:00080000:1.0:1762166987.941336:0:19593:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589935363 00010000:00010000:1.0:1762166987.941345:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945d02174400/0x2f180c4effbad818 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x56:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166987.941351:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945d02174400/0x2f180c4effbad818 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x56:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166987.941355:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945d02174400/0x2f180c4effbad818 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x56:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166987.941359:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945d02174400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166987.941362:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d02174400/0x2f180c4effbad818 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x56:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166987.941367:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945d02174400/0x2f180c4effbad818 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x56:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166987.941374:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x56:0x0].0x0 (ffff945cd1ddd300) 00010000:00010000:1.0:1762166987.941376:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1762166987.941379:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945d02174400/0x2f180c4effbad818 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x56:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166987.941383:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d02174400/0x2f180c4effbad818 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x56:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166987.941396:0:19593:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdee00/0x2f180c4effbad811 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x54:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166987.941399:0:19593:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdee00/0x2f180c4effbad811 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x54:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166987.941404:0:19593:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdee00/0x2f180c4effbad811 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x54:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166987.941407:0:19593:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdee00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166987.941409:0:19593:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdee00/0x2f180c4effbad811 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x54:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166987.941411:0:19593:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdee00/0x2f180c4effbad811 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x54:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166987.941415:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x54:0x0].0x0 (ffff945cc7df9e00) 00010000:00010000:1.0:1762166987.941416:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1762166987.941418:0:19593:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdee00/0x2f180c4effbad811 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x54:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166987.941420:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdee00/0x2f180c4effbad811 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x54:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19593 initiator: MDT0 00010000:00010000:1.0:1762166987.941428:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x54:0x0].0x0 (ffff945cc7df9e00) 00010000:00010000:1.0:1762166987.941429:0:19593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1762166987.941433:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde600/0x2f180c4effbad7e7 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x54:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eaca3 expref: 62 pid: 6496 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166987.941510:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7dec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+61:63273:x1847765450781952:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 3833us (3936us total) trans 8589935364 rc 0/0 00000100:00100000:1.0:1762166987.941516:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 12023 00000020:00080000:1.0:1762166987.941519:0:19593:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1762166987.942234:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166987.942267:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450782336 00000100:00100000:0.0:1762166987.942271:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450782336 00000100:00100000:0.0:1762166987.942300:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30983 00000100:00100000:0.0:1762166987.942305:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5769f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+61:63273:x1847765450782336:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166987.942319:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166987.942329:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdec00/0x2f180c4effbad81f lrc: 2/0,0 mode: --/CR res: [0x200000405:0x54:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eacb1 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166987.942361:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdec00/0x2f180c4effbad81f lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x54:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eacb1 expref: 62 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166987.942369:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdec00/0x2f180c4effbad81f lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x54:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eacb1 expref: 62 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166987.942384:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x54:0x0].0x0 (ffff945cc7df9e00) 00010000:00010000:0.0:1762166987.942386:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166987.942388:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdec00, rc 0) 00000100:00100000:0.0:1762166987.942414:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5769f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+62:63273:x1847765450782336:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 108us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166987.942420:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30983 00000100:00100000:3.0:1762166987.942978:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166987.943017:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450782336 00000100:00100000:0.0:1762166987.943023:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450782336 00000004:00100000:0.0:1762166987.943046:0:6496:0:(mdt_mds.c:166:ldlm_enqueue_hpreq_check()) @@@ lock 00000000ab04ac6f cookie 0xa56c5e86028eacb1 req@ffff945bc7bba680 x1847765450782336/t0(0) o101->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:18/0 lens 376/0 e 0 to 0 dl 1762166998 ref 1 fl New:/602/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000004:00010000:0.0:1762166987.943060:0:6496:0:(mdt_mds.c:170:ldlm_enqueue_hpreq_check()) ### hpreq resend ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdec00/0x2f180c4effbad81f lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x54:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eacb1 expref: 62 pid: 6496 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166987.943088:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 676 00000100:00100000:0.0:1762166987.943095:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7bba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+62:63273:x1847765450782336:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166987.943103:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166987.943109:0:6496:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue()) @@@ found existing lock cookie 0x2f180c4effbad81f req@ffff945bc7bba680 x1847765450782336/t0(0) o101->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:18/0 lens 376/0 e 0 to 0 dl 1762166998 ref 1 fl Interpret:H/602/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1762166987.943130:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdec00/0x2f180c4effbad81f lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x54:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eacb1 expref: 62 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166987.943144:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x54:0x0].0x0 (ffff945cc7df9e00) 00010000:00010000:0.0:1762166987.943147:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1762166987.943150:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdec00, rc 0) 00000100:00100000:0.0:1762166987.943181:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7bba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+62:63273:x1847765450782336:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 87us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166987.943189:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 676 00000100:00100000:2.0:1762166987.944303:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166987.944345:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450782720 00000100:00100000:1.0:1762166987.944351:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450782720 00000100:00100000:1.0:1762166987.944389:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 12024 00000100:00100000:1.0:1762166987.944399:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc5768700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+62:63273:x1847765450782720:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:1.0:1762166987.944592:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc5768700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+63:63273:x1847765450782720:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 194us (290us total) trans 8589935365 rc 0/0 00000100:00100000:1.0:1762166987.944600:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 12024 00000100:00100000:2.0:1762166987.945291:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166987.945324:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450782976 00000100:00100000:1.0:1762166987.945329:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450782976 00000100:00100000:1.0:1762166987.945353:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 12025 00000100:00100000:1.0:1762166987.945358:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc576bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+63:63273:x1847765450782976:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:1.0:1762166987.945442:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc576bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+64:63273:x1847765450782976:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 83us (152us total) trans 8589935366 rc 0/0 00000100:00100000:1.0:1762166987.945448:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 12025 00000100:00100000:3.0:1762166987.946326:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166987.946387:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450783104 00000100:00100000:0.0:1762166987.946393:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450783104 00000100:00100000:0.0:1762166987.946434:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30984 00000100:00100000:0.0:1762166987.946444:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7bbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+64:63273:x1847765450783104:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166987.946460:0:6496:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166987.946500:0:6496:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde800/0x2f180c4effbad826 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eacb8 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166987.946562:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf200/0x2f180c4effbad82d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.946575:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf200/0x2f180c4effbad82d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.946588:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf200/0x2f180c4effbad82d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.946599:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad834 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.946606:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad834 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.946612:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad834 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.946678:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde200/0x2f180c4effbad83b lrc: 3/1,0 mode: --/PR res: [0x200000405:0x56:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.946698:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde200/0x2f180c4effbad83b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.946706:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde200/0x2f180c4effbad83b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00000004:00200000:0.0:1762166987.946736:0:6496:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x56:0x0]: returning size 0 00000004:00200000:0.0:1762166987.946739:0:6496:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166987.946752:0:6496:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde200/0x2f180c4effbad83b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.946760:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde200/0x2f180c4effbad83b lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.946767:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf200/0x2f180c4effbad82d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.946772:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf200/0x2f180c4effbad82d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.946776:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf200/0x2f180c4effbad82d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.946780:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf200/0x2f180c4effbad82d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.946783:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdf200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166987.946786:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf200/0x2f180c4effbad82d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.946791:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf200/0x2f180c4effbad82d lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.946798:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945cd0738700) 00010000:00010000:0.0:1762166987.946800:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166987.946803:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf200/0x2f180c4effbad82d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.946808:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf200/0x2f180c4effbad82d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.946817:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad834 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.946820:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad834 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.946824:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad834 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.946827:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdfe00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166987.946829:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad834 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.946832:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad834 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.946835:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc72e1b9b (ffff945bc812ec00) 00010000:00010000:0.0:1762166987.946836:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166987.946838:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad834 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.946840:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad834 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.946857:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde800/0x2f180c4effbad826 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eacb8 expref: 66 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166987.946865:0:6496:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde200/0x2f180c4effbad83b lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eacb8 expref: 65 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166987.946873:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x56:0x0].0x0 (ffff945cd1ddd400) 00010000:00010000:0.0:1762166987.946875:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166987.946877:0:6496:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bde200, rc 0) 00000100:00100000:0.0:1762166987.946911:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7bbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+65:63273:x1847765450783104:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 470us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166987.946915:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30984 00000100:00100000:2.0:1762166987.947960:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166987.947992:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450783360 00000100:00100000:0.0:1762166987.947998:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450783360 00000100:00100000:0.0:1762166987.948025:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30985 00000100:00100000:0.0:1762166987.948031:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc576a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+65:63273:x1847765450783360:12345-192.168.204.38@tcp:36:lfs.0 00010000:00010000:0.0:1762166987.948066:0:6496:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1762166987.948083:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde200/0x2f180c4effbad83b lrc: 0/0,0 mode: --/PR res: [0x200000405:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eacb8 expref: 65 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166987.948098:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x56:0x0].0x0 (ffff945cd1ddd400) 00010000:00010000:0.0:1762166987.948113:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdea00/0x2f180c4effbad78c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eac87 expref: 64 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166987.948121:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945cd0738700) 00010000:00010000:0.0:1762166987.948125:0:6496:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166987.948138:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf600/0x2f180c4effbad842 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.948147:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf600/0x2f180c4effbad842 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.948154:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf600/0x2f180c4effbad842 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.948163:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf400/0x2f180c4effbad849 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.948169:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf400/0x2f180c4effbad849 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.948174:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf400/0x2f180c4effbad849 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.948226:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc6eeaa00/0x2f180c4effbad850 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x56:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.948233:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc6eeaa00/0x2f180c4effbad850 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x56:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.948239:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc6eeaa00/0x2f180c4effbad850 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x56:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.948448:0:6496:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc42ff400/0x2f180c4effbad857 lrc: 3/0,1 mode: --/PW res: [0x200000405:0x56:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.948456:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc42ff400/0x2f180c4effbad857 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x56:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.948463:0:6496:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc42ff400/0x2f180c4effbad857 lrc: 3/0,1 mode: PW/PW res: [0x200000405:0x56:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.948469:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc42ff400/0x2f180c4effbad857 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x56:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.948521:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc42ff400/0x2f180c4effbad857 lrc: 4/0,1 mode: PW/PW res: [0x200000405:0x56:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.948528:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc42ff400/0x2f180c4effbad857 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x56:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.948547:0:6496:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1762166987.948561:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc6eeaa00/0x2f180c4effbad850 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x56:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166987.948568:0:10257:0:(ldlm_lockd.c:2826:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1762166987.948568:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc6eeaa00/0x2f180c4effbad850 lrc: 2/0,0 mode: EX/EX res: [0x200000405:0x56:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166987.948576:0:10257:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc42ff400/0x2f180c4effbad857 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x56:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.948578:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc6eeaa00/0x2f180c4effbad850 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x56:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.948594:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc6eeaa00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166987.948595:0:10257:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc42ff400 already unused, calling callback (ffffffffc0cd9320) 00010000:00010000:0.0:1762166987.948599:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc6eeaa00/0x2f180c4effbad850 lrc: 3/0,0 mode: EX/EX res: [0x200000405:0x56:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166987.948601:0:10257:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc42ff400/0x2f180c4effbad857 lrc: 2/0,0 mode: PW/PW res: [0x200000405:0x56:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.948611:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc6eeaa00/0x2f180c4effbad850 lrc: 4/0,0 mode: EX/EX res: [0x200000405:0x56:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166987.948618:0:10257:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc42ff400/0x2f180c4effbad857 lrc: 3/0,0 mode: PW/PW res: [0x200000405:0x56:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.948621:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x56:0x0].0x0 (ffff945cd1ddd700) 00010000:00010000:0.0:1762166987.948628:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1762166987.948632:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc6eeaa00/0x2f180c4effbad850 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x56:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166987.948637:0:10257:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x56:0x0].0x0 (ffff945cd1ddd700) 00010000:00010000:0.0:1762166987.948638:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc6eeaa00/0x2f180c4effbad850 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x56:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166987.948643:0:10257:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1762166987.948648:0:10257:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc42ff400/0x2f180c4effbad857 lrc: 1/0,0 mode: --/PW res: [0x200000405:0x56:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166987.948652:0:10257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc42ff400/0x2f180c4effbad857 lrc: 0/0,0 mode: --/PW res: [0x200000405:0x56:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166987.948665:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166987.948667:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1762166987.948669:0:10257:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1762166987.948750:0:6496:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf600/0x2f180c4effbad842 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.948755:0:6496:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf600/0x2f180c4effbad842 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.948759:0:6496:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf600/0x2f180c4effbad842 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.948765:0:6496:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf600/0x2f180c4effbad842 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.948768:0:6496:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdf600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166987.948769:0:6496:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf600/0x2f180c4effbad842 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.948773:0:6496:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf600/0x2f180c4effbad842 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.948777:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945cd0738700) 00010000:00010000:0.0:1762166987.948779:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166987.948780:0:6496:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf600/0x2f180c4effbad842 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.948783:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf600/0x2f180c4effbad842 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00000004:00010000:0.0:1762166987.948788:0:6496:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000002755666c reply state 0000000010417ce0 transno 8589935367 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf400/0x2f180c4effbad849 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.948795:0:6496:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf400/0x2f180c4effbad849 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166987.948799:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc72e1b9b (ffff945bc812ec00) 00010000:00010000:0.0:1762166987.948801:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1762166987.948802:0:6496:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1762166987.948852:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc576a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e1e11365-ba0b-405b-99c9-a704373217f2+65:63273:x1847765450783360:12345-192.168.204.38@tcp:36:lfs.0 Request processed in 819us (894us total) trans 8589935367 rc 0/0 00000100:00100000:0.0:1762166987.948859:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30985 00000100:00100000:2.0:1762166988.001004:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166988.001065:0:32222:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450783488 00000100:00100000:3.0:1762166988.001079:0:32222:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450783488 00000100:00100000:3.0:1762166988.001154:0:32222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 134 00000100:00100000:3.0:1762166988.001166:0:32222:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc34e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc359222-7391-43f5-989b-bf5867ae8fd6+9:63284:x1847765450783488:12345-192.168.204.38@tcp:101:mount.lustre.0 00010000:00010000:3.0:1762166988.001187:0:32222:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166988.001209:0:32222:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff945bc4b62000/0x2f180c4effbad85e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eacbf expref: -99 pid: 32222 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166988.001242:0:32222:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945bc4b62000/0x2f180c4effbad85e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eacbf expref: 10 pid: 32222 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166988.001251:0:32222:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff945bc4b62000/0x2f180c4effbad85e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eacbf expref: 10 pid: 32222 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166988.001258:0:32222:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4b62000, rc 0) 00000100:00100000:3.0:1762166988.001318:0:32222:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc34e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc359222-7391-43f5-989b-bf5867ae8fd6+10:63284:x1847765450783488:12345-192.168.204.38@tcp:101:mount.lustre.0 Request processed in 155us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166988.001330:0:32222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 134 00000100:00100000:3.0:1762166988.002289:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166988.002392:0:32222:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450783616 00000100:00100000:0.0:1762166988.002409:0:32222:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450783616 00000100:00100000:0.0:1762166988.002516:0:32222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 135 00000100:00100000:0.0:1762166988.002530:0:32222:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc34eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc359222-7391-43f5-989b-bf5867ae8fd6+10:63284:x1847765450783616:12345-192.168.204.38@tcp:501:mount.lustre.0 00000100:00100000:0.0:1762166988.002717:0:32222:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc34eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc359222-7391-43f5-989b-bf5867ae8fd6+10:63284:x1847765450783616:12345-192.168.204.38@tcp:501:mount.lustre.0 Request processed in 191us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166988.002727:0:32222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 135 00000100:00100000:2.0:1762166988.003601:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166988.003659:0:32222:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450783744 00000100:00100000:0.0:1762166988.003664:0:32222:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450783744 00000100:00100000:0.0:1762166988.003704:0:32222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 136 00000100:00100000:0.0:1762166988.003724:0:32222:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cc34ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc359222-7391-43f5-989b-bf5867ae8fd6+10:63284:x1847765450783744:12345-192.168.204.38@tcp:503:mount.lustre.0 00000100:00100000:0.0:1762166988.003819:0:32222:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cc34ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc359222-7391-43f5-989b-bf5867ae8fd6+10:63284:x1847765450783744:12345-192.168.204.38@tcp:503:mount.lustre.0 Request processed in 99us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166988.003825:0:32222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 136 00000100:00100000:2.0:1762166988.004962:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166988.005048:0:32222:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450783872 00000100:00100000:0.0:1762166988.005055:0:32222:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450783872 00000100:00100000:0.0:1762166988.005091:0:32222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 137 00000100:00100000:0.0:1762166988.005100:0:32222:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc35b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc359222-7391-43f5-989b-bf5867ae8fd6+10:63288:x1847765450783872:12345-192.168.204.38@tcp:502:llog_process_th.0 00000100:00100000:0.0:1762166988.005250:0:32222:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc35b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc359222-7391-43f5-989b-bf5867ae8fd6+10:63288:x1847765450783872:12345-192.168.204.38@tcp:502:llog_process_th.0 Request processed in 150us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166988.005256:0:32222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 137 00000100:00100000:3.0:1762166988.013027:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166988.013131:0:32222:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450784000 00000100:00100000:0.0:1762166988.013144:0:32222:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450784000 00000100:00100000:0.0:1762166988.013215:0:32222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 138 00000100:00100000:0.0:1762166988.013225:0:32222:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc35b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc359222-7391-43f5-989b-bf5867ae8fd6+10:63288:x1847765450784000:12345-192.168.204.38@tcp:502:llog_process_th.0 00000100:00100000:0.0:1762166988.013404:0:32222:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc35b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc359222-7391-43f5-989b-bf5867ae8fd6+10:63288:x1847765450784000:12345-192.168.204.38@tcp:502:llog_process_th.0 Request processed in 179us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166988.013414:0:32222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 138 00000100:00100000:2.0:1762166988.014259:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166988.014314:0:32222:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450784128 00000100:00100000:0.0:1762166988.014319:0:32222:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450784128 00000100:00100000:0.0:1762166988.014347:0:32222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 139 00000100:00100000:0.0:1762166988.014357:0:32222:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc35b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc359222-7391-43f5-989b-bf5867ae8fd6+10:63288:x1847765450784128:12345-192.168.204.38@tcp:502:llog_process_th.0 00000100:00100000:0.0:1762166988.014431:0:32222:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc35b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc359222-7391-43f5-989b-bf5867ae8fd6+10:63288:x1847765450784128:12345-192.168.204.38@tcp:502:llog_process_th.0 Request processed in 75us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166988.014439:0:32222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 139 00000100:00100000:2.0:1762166988.016911:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166988.016968:0:32222:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450784256 00000100:00100000:0.0:1762166988.016974:0:32222:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450784256 00000100:00100000:0.0:1762166988.017007:0:32222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 140 00000100:00100000:0.0:1762166988.017016:0:32222:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc35b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc359222-7391-43f5-989b-bf5867ae8fd6+10:63284:x1847765450784256:12345-192.168.204.38@tcp:101:mount.lustre.0 00010000:00010000:0.0:1762166988.017041:0:32222:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166988.017065:0:32222:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff945bc42ff400/0x2f180c4effbad865 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eacf0 expref: -99 pid: 32222 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166988.017091:0:32222:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945bc42ff400/0x2f180c4effbad865 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eacf0 expref: 11 pid: 32222 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166988.017099:0:32222:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff945bc42ff400/0x2f180c4effbad865 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eacf0 expref: 11 pid: 32222 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166988.017106:0:32222:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc42ff400, rc 0) 00000100:00100000:0.0:1762166988.017143:0:32222:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc35b0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc359222-7391-43f5-989b-bf5867ae8fd6+11:63284:x1847765450784256:12345-192.168.204.38@tcp:101:mount.lustre.0 Request processed in 128us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166988.017154:0:32222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 140 00000100:00100000:3.0:1762166988.018194:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166988.018238:0:32222:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450784384 00000100:00100000:0.0:1762166988.018242:0:32222:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450784384 00000100:00100000:0.0:1762166988.018266:0:32222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 141 00000100:00100000:0.0:1762166988.018272:0:32222:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc35b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc359222-7391-43f5-989b-bf5867ae8fd6+11:63284:x1847765450784384:12345-192.168.204.38@tcp:256:mount.lustre.0 20000000:01000000:0.0:1762166988.018290:0:32222:0:(mgs_nids.c:896:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1762166988.018315:0:32222:0:(mgs_nids.c:304:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1762166988.018318:0:32222:0:(mgs_nids.c:315:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:0.0:1762166988.018861:0:32222:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc35b0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc359222-7391-43f5-989b-bf5867ae8fd6+11:63284:x1847765450784384:12345-192.168.204.38@tcp:256:mount.lustre.0 Request processed in 587us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166988.018869:0:32222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 141 00000100:00100000:2.0:1762166988.020073:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166988.020110:0:32222:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450784512 00000100:00100000:0.0:1762166988.020115:0:32222:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450784512 00000100:00100000:0.0:1762166988.020145:0:32222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 142 00000100:00100000:0.0:1762166988.020153:0:32222:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc35b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc359222-7391-43f5-989b-bf5867ae8fd6+11:63284:x1847765450784512:12345-192.168.204.38@tcp:101:mount.lustre.0 00010000:00010000:0.0:1762166988.020164:0:32222:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166988.020181:0:32222:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff945bc6eeaa00/0x2f180c4effbad86c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eacf7 expref: -99 pid: 32222 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166988.020201:0:32222:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945bc6eeaa00/0x2f180c4effbad86c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eacf7 expref: 12 pid: 32222 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166988.020209:0:32222:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff945bc6eeaa00/0x2f180c4effbad86c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eacf7 expref: 12 pid: 32222 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166988.020214:0:32222:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc6eeaa00, rc 0) 00000100:00100000:0.0:1762166988.020239:0:32222:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc35b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc359222-7391-43f5-989b-bf5867ae8fd6+12:63284:x1847765450784512:12345-192.168.204.38@tcp:101:mount.lustre.0 Request processed in 88us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166988.020244:0:32222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 142 00000100:00100000:3.0:1762166988.020844:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166988.020876:0:32222:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450784640 00000100:00100000:0.0:1762166988.020879:0:32222:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450784640 00000100:00100000:0.0:1762166988.020899:0:32222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 143 00000100:00100000:0.0:1762166988.020903:0:32222:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc35b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc359222-7391-43f5-989b-bf5867ae8fd6+12:63284:x1847765450784640:12345-192.168.204.38@tcp:501:mount.lustre.0 00000100:00100000:0.0:1762166988.021014:0:32222:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc35b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc359222-7391-43f5-989b-bf5867ae8fd6+12:63284:x1847765450784640:12345-192.168.204.38@tcp:501:mount.lustre.0 Request processed in 108us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166988.021021:0:32222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 143 00000100:00100000:2.0:1762166988.022244:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166988.022281:0:32222:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450784768 00000100:00100000:0.0:1762166988.022285:0:32222:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450784768 00000100:00100000:0.0:1762166988.022307:0:32222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 144 00000100:00100000:0.0:1762166988.022312:0:32222:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc35b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc359222-7391-43f5-989b-bf5867ae8fd6+12:63284:x1847765450784768:12345-192.168.204.38@tcp:503:mount.lustre.0 00000100:00100000:0.0:1762166988.022417:0:32222:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc35b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc359222-7391-43f5-989b-bf5867ae8fd6+12:63284:x1847765450784768:12345-192.168.204.38@tcp:503:mount.lustre.0 Request processed in 100us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166988.022424:0:32222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 144 00000100:00100000:2.0:1762166988.023338:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166988.023385:0:32222:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450784896 00000100:00100000:0.0:1762166988.023390:0:32222:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450784896 00000100:00100000:0.0:1762166988.023417:0:32222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 145 00000100:00100000:0.0:1762166988.023425:0:32222:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc69a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc359222-7391-43f5-989b-bf5867ae8fd6+12:63292:x1847765450784896:12345-192.168.204.38@tcp:502:llog_process_th.0 00000100:00100000:0.0:1762166988.023528:0:32222:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc69a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc359222-7391-43f5-989b-bf5867ae8fd6+12:63292:x1847765450784896:12345-192.168.204.38@tcp:502:llog_process_th.0 Request processed in 104us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166988.023537:0:32222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 145 00000100:00100000:3.0:1762166988.024221:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166988.024255:0:32222:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450785024 00000100:00100000:0.0:1762166988.024259:0:32222:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450785024 00000100:00100000:0.0:1762166988.024280:0:32222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 146 00000100:00100000:0.0:1762166988.024284:0:32222:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc69a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc359222-7391-43f5-989b-bf5867ae8fd6+12:63292:x1847765450785024:12345-192.168.204.38@tcp:502:llog_process_th.0 00000100:00100000:0.0:1762166988.024336:0:32222:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc69a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc359222-7391-43f5-989b-bf5867ae8fd6+12:63292:x1847765450785024:12345-192.168.204.38@tcp:502:llog_process_th.0 Request processed in 51us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166988.024341:0:32222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 146 00000100:00100000:2.0:1762166988.025292:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166988.025355:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450785152 00000100:00100000:0.0:1762166988.025360:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450785152 00000100:00100000:0.0:1762166988.025386:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30986 00000100:00100000:3.0:1762166988.025392:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166988.025396:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2415:x1847765450785152:12345-192.168.204.38@tcp:38:mount.lustre.0 00000100:00100000:2.0:1762166988.025417:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450785280 00010000:00080000:0.0:1762166988.025418:0:6496:0:(ldlm_lib.c:1428:target_handle_connect()) lustre-MDT0000: connection from 1dd12c0b-744c-4d89-8dac-079bf92f5ace@192.168.204.38@tcp t0 exp 0000000000000000 cur 607 last 0 00000100:00100000:2.0:1762166988.025423:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450785280 00000100:00080000:3.0:1762166988.025462:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000080:0.0:1762166988.025498:0:6496:0:(genops.c:1402:class_connect()) connect: client 1dd12c0b-744c-4d89-8dac-079bf92f5ace, cookie 0x2f180c4effbad873 00000100:00100000:2.0:1762166988.025503:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 677 00000100:00100000:2.0:1762166988.025514:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+538:2418:x1847765450785280:12345-192.168.204.38@tcp:400:kworker.0 00000004:00100000:0.0:1762166988.025527:0:6496:0:(mdt_handler.c:7249:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:2.0:1762166988.025568:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e1e11365-ba0b-405b-99c9-a704373217f2+538:2418:x1847765450785280:12345-192.168.204.38@tcp:400:kworker.0 Request processed in 57us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166988.025577:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 677 00000020:01000000:0.0:1762166988.025603:0:6496:0:(lprocfs_status_server.c:658:lprocfs_exp_setup()) using hash ffff945cf3cb6100 00000100:00100000:3.0:1762166988.025614:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00080000:0.0:1762166988.025651:0:6496:0:(import.c:65:import_set_state_nolock()) ffff945bc6077000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1762166988.025693:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450785536 00000100:00100000:2.0:1762166988.025697:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450785536 00000100:00100000:0.0:1762166988.025710:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1dd12c0b-744c-4d89-8dac-079bf92f5ace+6:2415:x1847765450785152:12345-192.168.204.38@tcp:38:mount.lustre.0 Request processed in 313us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166988.025720:0:30829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30987 00000100:00100000:0.0:1762166988.025730:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30986 00000100:00100000:2.0:1762166988.025732:0:30829:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7bb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2415:x1847765450785536:12345-192.168.204.38@tcp:38:mount.lustre.0 00010000:00080000:2.0:1762166988.025752:0:30829:0:(ldlm_lib.c:1428:target_handle_connect()) lustre-MDT0001: connection from 1dd12c0b-744c-4d89-8dac-079bf92f5ace@192.168.204.38@tcp t0 exp 0000000000000000 cur 607 last 0 00000020:00000080:2.0:1762166988.025783:0:30829:0:(genops.c:1402:class_connect()) connect: client 1dd12c0b-744c-4d89-8dac-079bf92f5ace, cookie 0x2f180c4effbad87a 00000004:00100000:2.0:1762166988.025798:0:30829:0:(mdt_handler.c:7249:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000020:01000000:2.0:1762166988.025841:0:30829:0:(lprocfs_status_server.c:658:lprocfs_exp_setup()) using hash ffff945cf1f8fc00 00000100:00080000:2.0:1762166988.025860:0:30829:0:(import.c:65:import_set_state_nolock()) ffff945cc6242000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1762166988.025887:0:30829:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7bb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1dd12c0b-744c-4d89-8dac-079bf92f5ace+6:2415:x1847765450785536:12345-192.168.204.38@tcp:38:mount.lustre.0 Request processed in 160us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166988.025893:0:30829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30987 00000100:00100000:1.0:1762166988.026614:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166988.026642:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166988.026663:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450785792 00000100:00100000:1.0:1762166988.026666:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166988.026669:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450785792 00000100:00100000:0.0:1762166988.026699:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450785664 00000100:00100000:0.0:1762166988.026706:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450785664 00000100:00100000:2.0:1762166988.026718:0:30829:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450785408 00000100:00100000:2.0:1762166988.026724:0:30829:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450785408 00000100:00100000:3.0:1762166988.026747:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30988 00000100:00100000:3.0:1762166988.026757:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7deca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1dd12c0b-744c-4d89-8dac-079bf92f5ace+7:63284:x1847765450785792:12345-192.168.204.38@tcp:41:mount.lustre.0 00000100:00100000:0.0:1762166988.026760:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30989 00000100:00100000:1.0:1762166988.026772:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30990 00000100:00100000:0.0:1762166988.026776:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7dee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1dd12c0b-744c-4d89-8dac-079bf92f5ace+6:0:x1847765450785664:12345-192.168.204.38@tcp:41:mount.lustre.0 00000004:00000024:3.0:1762166988.026787:0:6494:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1445838848 avail 1299599360 00000100:00080000:2.0:1762166988.026787:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1762166988.026790:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7dedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1dd12c0b-744c-4d89-8dac-079bf92f5ace+7:0:x1847765450785408:12345-192.168.204.38@tcp:41:mount.lustre.0 00000100:00080000:2.0:1762166988.026791:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:0.0:1762166988.026797:0:6496:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1445212160 avail 1298972672 00000004:00000024:1.0:1762166988.026812:0:12357:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 4243456 pending 0 free 1445838848 avail 1299599360 00000100:00100000:0.0:1762166988.026849:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7dee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1dd12c0b-744c-4d89-8dac-079bf92f5ace+6:0:x1847765450785664:12345-192.168.204.38@tcp:41:mount.lustre.0 Request processed in 78us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166988.026851:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7deca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1dd12c0b-744c-4d89-8dac-079bf92f5ace+7:63284:x1847765450785792:12345-192.168.204.38@tcp:41:mount.lustre.0 Request processed in 95us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166988.026858:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7dedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1dd12c0b-744c-4d89-8dac-079bf92f5ace+7:0:x1847765450785408:12345-192.168.204.38@tcp:41:mount.lustre.0 Request processed in 73us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166988.026867:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30988 00000100:00100000:0.0:1762166988.026876:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30989 00000100:00100000:1.0:1762166988.026888:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30990 00000100:00100000:3.0:1762166988.027599:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166988.027640:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450785920 00000100:00100000:1.0:1762166988.027644:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450785920 00000100:00100000:1.0:1762166988.027669:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30991 00000100:00100000:1.0:1762166988.027674:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7bbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1dd12c0b-744c-4d89-8dac-079bf92f5ace+6:63284:x1847765450785920:12345-192.168.204.38@tcp:40:mount.lustre.0 00000100:00100000:1.0:1762166988.027728:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7bbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1dd12c0b-744c-4d89-8dac-079bf92f5ace+6:63284:x1847765450785920:12345-192.168.204.38@tcp:40:mount.lustre.0 Request processed in 53us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166988.027734:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30991 00000100:00100000:2.0:1762166988.028450:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166988.028605:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166988.028634:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166988.028645:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450786048 00000100:00100000:1.0:1762166988.028649:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450786048 00000100:00100000:3.0:1762166988.028665:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450786176 00000100:00100000:3.0:1762166988.028671:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450786176 00000100:00100000:1.0:1762166988.028674:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19525 00000100:00100000:1.0:1762166988.028691:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2415:x1847765450786048:12345-192.168.204.38@tcp:8:mount.lustre.0 00000100:00100000:0.0:1762166988.028710:0:7438:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450786304 00010000:00080000:1.0:1762166988.028711:0:8382:0:(ldlm_lib.c:1428:target_handle_connect()) lustre-OST0000: connection from 1dd12c0b-744c-4d89-8dac-079bf92f5ace@192.168.204.38@tcp t0 exp 0000000000000000 cur 607 last 0 00000100:00100000:0.0:1762166988.028717:0:7438:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450786304 00000100:00100000:3.0:1762166988.028719:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19526 00000100:00100000:3.0:1762166988.028728:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2415:x1847765450786176:12345-192.168.204.38@tcp:8:mount.lustre.0 00010000:00080000:3.0:1762166988.028749:0:9168:0:(ldlm_lib.c:1428:target_handle_connect()) lustre-OST0001: connection from 1dd12c0b-744c-4d89-8dac-079bf92f5ace@192.168.204.38@tcp t0 exp 0000000000000000 cur 607 last 0 00000020:00000080:1.0:1762166988.028750:0:8382:0:(genops.c:1402:class_connect()) connect: client 1dd12c0b-744c-4d89-8dac-079bf92f5ace, cookie 0x2f180c4effbad881 00002000:00100000:1.0:1762166988.028763:0:8382:0:(ofd_obd.c:124:ofd_parse_connect_data()) lustre-OST0000: cli 1dd12c0b-744c-4d89-8dac-079bf92f5ace/ffff945cc4d77000 ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 2103b32 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00100000:0.0:1762166988.028768:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 17 00000100:00100000:0.0:1762166988.028780:0:7438:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf1cd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0002:1dd12c0b-744c-4d89-8dac-079bf92f5ace+6:63284:x1847765450786304:12345-192.168.204.38@tcp:900:mount.lustre.0 00002000:00100000:1.0:1762166988.028782:0:8382:0:(ofd_obd.c:222:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000020:00000080:3.0:1762166988.028789:0:9168:0:(genops.c:1402:class_connect()) connect: client 1dd12c0b-744c-4d89-8dac-079bf92f5ace, cookie 0x2f180c4effbad888 00002000:00100000:3.0:1762166988.028829:0:9168:0:(ofd_obd.c:124:ofd_parse_connect_data()) lustre-OST0001: cli 1dd12c0b-744c-4d89-8dac-079bf92f5ace/ffff945bc5876000 ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 2103b32 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00100000:0.0:1762166988.028836:0:7438:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0002:1dd12c0b-744c-4d89-8dac-079bf92f5ace+6:63284:x1847765450786304:12345-192.168.204.38@tcp:900:mount.lustre.0 Request processed in 59us (201us total) trans 0 rc 0/0 00000020:01000000:1.0:1762166988.028847:0:8382:0:(lprocfs_status_server.c:658:lprocfs_exp_setup()) using hash ffff945bc49ab600 00002000:00100000:3.0:1762166988.028849:0:9168:0:(ofd_obd.c:222:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:0.0:1762166988.028849:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 17 00002000:00080000:1.0:1762166988.028856:0:8382:0:(ofd_obd.c:365:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1762166988.028881:0:8382:0:(import.c:65:import_set_state_nolock()) ffff945cc4d70000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1762166988.028913:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1dd12c0b-744c-4d89-8dac-079bf92f5ace+6:2415:x1847765450786048:12345-192.168.204.38@tcp:8:mount.lustre.0 Request processed in 231us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166988.028919:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19525 00000020:01000000:3.0:1762166988.029241:0:9168:0:(lprocfs_status_server.c:658:lprocfs_exp_setup()) using hash ffff945cc9241100 00002000:00080000:3.0:1762166988.029249:0:9168:0:(ofd_obd.c:365:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1762166988.029263:0:9168:0:(import.c:65:import_set_state_nolock()) ffff945bc5877000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1762166988.029294:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf1cd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1dd12c0b-744c-4d89-8dac-079bf92f5ace+6:2415:x1847765450786176:12345-192.168.204.38@tcp:8:mount.lustre.0 Request processed in 566us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166988.029299:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19526 00000100:00100000:2.0:1762166988.029566:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166988.029628:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450786432 00000100:00100000:1.0:1762166988.029632:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450786432 00000100:00100000:1.0:1762166988.029659:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 12026 00000100:00100000:1.0:1762166988.029666:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff2fe850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1dd12c0b-744c-4d89-8dac-079bf92f5ace+6:63284:x1847765450786432:12345-192.168.204.38@tcp:33:mount.lustre.0 00000004:00200000:1.0:1762166988.029741:0:19593:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1762166988.029783:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff2fe850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1dd12c0b-744c-4d89-8dac-079bf92f5ace+6:63284:x1847765450786432:12345-192.168.204.38@tcp:33:mount.lustre.0 Request processed in 119us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166988.029788:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 12026 00000001:00100000:3.0:1762166988.030000:0:24624:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1dd12c0b-744c-4d89-8dac-079bf92f5ace 00000001:00080000:3.0:1762166988.030009:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843498 is committed 00000001:00080000:3.0:1762166988.030014:0:24624:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474843497 is committed 00000100:00100000:2.0:1762166988.123713:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166988.123876:0:32222:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450786560 00000100:00100000:0.0:1762166988.123888:0:32222:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450786560 00000100:00100000:0.0:1762166988.123942:0:32222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 147 00000100:00100000:0.0:1762166988.123953:0:32222:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc69a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc359222-7391-43f5-989b-bf5867ae8fd6+12:63319:x1847765450786560:12345-192.168.204.38@tcp:101:mount.lustre.0 00010000:00010000:0.0:1762166988.123970:0:32222:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166988.123987:0:32222:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff945bc4bdf600/0x2f180c4effbad88f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ead28 expref: -99 pid: 32222 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166988.124011:0:32222:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945bc4bdf600/0x2f180c4effbad88f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ead28 expref: 13 pid: 32222 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166988.124017:0:32222:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff945bc4bdf600/0x2f180c4effbad88f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ead28 expref: 13 pid: 32222 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166988.124023:0:32222:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdf600, rc 0) 00000100:00100000:0.0:1762166988.124074:0:32222:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc69a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc359222-7391-43f5-989b-bf5867ae8fd6+13:63319:x1847765450786560:12345-192.168.204.38@tcp:101:mount.lustre.0 Request processed in 125us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166988.124080:0:32222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 147 00000100:00100000:2.0:1762166988.124938:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166988.125004:0:32222:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450786688 00000100:00100000:0.0:1762166988.125013:0:32222:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450786688 00000100:00100000:0.0:1762166988.125052:0:32222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 148 00000100:00100000:0.0:1762166988.125059:0:32222:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc69aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc359222-7391-43f5-989b-bf5867ae8fd6+13:63319:x1847765450786688:12345-192.168.204.38@tcp:501:mount.lustre.0 00000100:00100000:0.0:1762166988.125192:0:32222:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc69aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc359222-7391-43f5-989b-bf5867ae8fd6+13:63319:x1847765450786688:12345-192.168.204.38@tcp:501:mount.lustre.0 Request processed in 134us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166988.125198:0:32222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 148 00000100:00100000:2.0:1762166988.125901:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166988.125942:0:32222:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450786816 00000100:00100000:0.0:1762166988.125947:0:32222:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450786816 00000100:00100000:0.0:1762166988.125970:0:32222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 149 00000100:00100000:0.0:1762166988.125974:0:32222:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc69ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc359222-7391-43f5-989b-bf5867ae8fd6+13:63319:x1847765450786816:12345-192.168.204.38@tcp:503:mount.lustre.0 00000100:00100000:0.0:1762166988.126051:0:32222:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc69ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc359222-7391-43f5-989b-bf5867ae8fd6+13:63319:x1847765450786816:12345-192.168.204.38@tcp:503:mount.lustre.0 Request processed in 76us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166988.126056:0:32222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 149 00000100:00100000:2.0:1762166988.126885:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166988.126927:0:32222:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450786944 00000100:00100000:0.0:1762166988.126932:0:32222:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450786944 00000100:00100000:0.0:1762166988.126960:0:32222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 150 00000100:00100000:0.0:1762166988.126970:0:32222:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc69a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc359222-7391-43f5-989b-bf5867ae8fd6+13:63322:x1847765450786944:12345-192.168.204.38@tcp:502:llog_process_th.0 00000100:00100000:0.0:1762166988.127030:0:32222:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc69a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc359222-7391-43f5-989b-bf5867ae8fd6+13:63322:x1847765450786944:12345-192.168.204.38@tcp:502:llog_process_th.0 Request processed in 63us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166988.127036:0:32222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 150 00000100:00100000:2.0:1762166988.135885:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166988.135973:0:32222:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450787072 00000100:00100000:0.0:1762166988.135988:0:32222:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450787072 00000100:00100000:0.0:1762166988.136053:0:32222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 151 00000100:00100000:0.0:1762166988.136066:0:32222:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc69aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc359222-7391-43f5-989b-bf5867ae8fd6+13:63322:x1847765450787072:12345-192.168.204.38@tcp:502:llog_process_th.0 00000100:00100000:0.0:1762166988.136232:0:32222:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc69aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc359222-7391-43f5-989b-bf5867ae8fd6+13:63322:x1847765450787072:12345-192.168.204.38@tcp:502:llog_process_th.0 Request processed in 169us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166988.136240:0:32222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 151 00000100:00100000:2.0:1762166988.137015:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166988.137058:0:32222:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450787200 00000100:00100000:0.0:1762166988.137063:0:32222:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450787200 00000100:00100000:0.0:1762166988.137092:0:32222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 152 00000100:00100000:0.0:1762166988.137101:0:32222:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc69ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc359222-7391-43f5-989b-bf5867ae8fd6+13:63322:x1847765450787200:12345-192.168.204.38@tcp:502:llog_process_th.0 00000100:00100000:0.0:1762166988.137169:0:32222:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc69ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc359222-7391-43f5-989b-bf5867ae8fd6+13:63322:x1847765450787200:12345-192.168.204.38@tcp:502:llog_process_th.0 Request processed in 69us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166988.137175:0:32222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 152 00000100:00100000:2.0:1762166988.138094:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166988.138145:0:32222:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450787328 00000100:00100000:0.0:1762166988.138150:0:32222:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450787328 00000100:00100000:0.0:1762166988.138184:0:32222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 153 00000100:00100000:0.0:1762166988.138191:0:32222:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc69a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc359222-7391-43f5-989b-bf5867ae8fd6+13:63319:x1847765450787328:12345-192.168.204.38@tcp:101:mount.lustre.0 00010000:00010000:0.0:1762166988.138203:0:32222:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166988.138224:0:32222:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff945bc4bdea00/0x2f180c4effbad896 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ead59 expref: -99 pid: 32222 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166988.138254:0:32222:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945bc4bdea00/0x2f180c4effbad896 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ead59 expref: 14 pid: 32222 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166988.138266:0:32222:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff945bc4bdea00/0x2f180c4effbad896 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ead59 expref: 14 pid: 32222 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166988.138275:0:32222:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdea00, rc 0) 00000100:00100000:0.0:1762166988.138323:0:32222:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc69a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cc359222-7391-43f5-989b-bf5867ae8fd6+14:63319:x1847765450787328:12345-192.168.204.38@tcp:101:mount.lustre.0 Request processed in 132us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166988.138330:0:32222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 153 00000100:00100000:2.0:1762166988.139835:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166988.139884:0:32221:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450787456 00000100:00100000:1.0:1762166988.139891:0:32221:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450787456 00000100:00100000:1.0:1762166988.139930:0:32221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 154 00000100:00100000:1.0:1762166988.139939:0:32221:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc954d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc359222-7391-43f5-989b-bf5867ae8fd6+14:63319:x1847765450787456:12345-192.168.204.38@tcp:256:mount.lustre.0 20000000:01000000:1.0:1762166988.139961:0:32221:0:(mgs_nids.c:896:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1762166988.139986:0:32221:0:(mgs_nids.c:304:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1762166988.139990:0:32221:0:(mgs_nids.c:315:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:2.0:1762166988.140628:0:32221:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc954d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc359222-7391-43f5-989b-bf5867ae8fd6+14:63319:x1847765450787456:12345-192.168.204.38@tcp:256:mount.lustre.0 Request processed in 690us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166988.140638:0:32221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 154 00000100:00100000:2.0:1762166988.142036:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166988.142088:0:32221:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450787584 00000100:00100000:1.0:1762166988.142094:0:32221:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450787584 00000100:00100000:1.0:1762166988.142120:0:32221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 155 00000100:00100000:1.0:1762166988.142125:0:32221:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc954e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc359222-7391-43f5-989b-bf5867ae8fd6+14:63319:x1847765450787584:12345-192.168.204.38@tcp:101:mount.lustre.0 00010000:00010000:1.0:1762166988.142137:0:32221:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166988.142151:0:32221:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff945d02174e00/0x2f180c4effbad89d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ead60 expref: -99 pid: 32221 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166988.142172:0:32221:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff945d02174e00/0x2f180c4effbad89d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ead60 expref: 15 pid: 32221 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166988.142179:0:32221:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff945d02174e00/0x2f180c4effbad89d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ead60 expref: 15 pid: 32221 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166988.142186:0:32221:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945d02174e00, rc 0) 00000100:00100000:1.0:1762166988.142215:0:32221:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc954e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc359222-7391-43f5-989b-bf5867ae8fd6+15:63319:x1847765450787584:12345-192.168.204.38@tcp:101:mount.lustre.0 Request processed in 90us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166988.142220:0:32221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 155 00000100:00100000:3.0:1762166988.142847:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166988.142881:0:32221:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450787712 00000100:00100000:1.0:1762166988.142884:0:32221:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450787712 00000100:00100000:1.0:1762166988.142905:0:32221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 156 00000100:00100000:1.0:1762166988.142909:0:32221:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc954ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc359222-7391-43f5-989b-bf5867ae8fd6+15:63319:x1847765450787712:12345-192.168.204.38@tcp:501:mount.lustre.0 00000100:00100000:1.0:1762166988.143017:0:32221:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc954ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc359222-7391-43f5-989b-bf5867ae8fd6+15:63319:x1847765450787712:12345-192.168.204.38@tcp:501:mount.lustre.0 Request processed in 107us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166988.143022:0:32221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 156 00000100:00100000:2.0:1762166988.143936:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166988.143980:0:32221:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450787840 00000100:00100000:1.0:1762166988.143985:0:32221:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450787840 00000100:00100000:1.0:1762166988.144013:0:32221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 157 00000100:00100000:1.0:1762166988.144020:0:32221:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc954e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc359222-7391-43f5-989b-bf5867ae8fd6+15:63319:x1847765450787840:12345-192.168.204.38@tcp:503:mount.lustre.0 00000100:00100000:1.0:1762166988.144116:0:32221:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc954e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc359222-7391-43f5-989b-bf5867ae8fd6+15:63319:x1847765450787840:12345-192.168.204.38@tcp:503:mount.lustre.0 Request processed in 96us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166988.144123:0:32221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 157 00000100:00100000:2.0:1762166988.145583:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166988.145639:0:32221:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450787968 00000100:00100000:1.0:1762166988.145645:0:32221:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450787968 00000100:00100000:1.0:1762166988.145691:0:32221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 158 00000100:00100000:1.0:1762166988.145699:0:32221:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc954f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc359222-7391-43f5-989b-bf5867ae8fd6+15:63327:x1847765450787968:12345-192.168.204.38@tcp:502:llog_process_th.0 00000100:00100000:1.0:1762166988.145805:0:32221:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc954f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc359222-7391-43f5-989b-bf5867ae8fd6+15:63327:x1847765450787968:12345-192.168.204.38@tcp:502:llog_process_th.0 Request processed in 107us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166988.145814:0:32221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 158 00000100:00100000:3.0:1762166988.146720:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166988.146780:0:32221:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450788096 00000100:00100000:1.0:1762166988.146785:0:32221:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450788096 00000100:00100000:1.0:1762166988.146818:0:32221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 159 00000100:00100000:1.0:1762166988.146826:0:32221:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc79a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc359222-7391-43f5-989b-bf5867ae8fd6+15:63327:x1847765450788096:12345-192.168.204.38@tcp:502:llog_process_th.0 00000100:00100000:1.0:1762166988.146899:0:32221:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc79a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cc359222-7391-43f5-989b-bf5867ae8fd6+15:63327:x1847765450788096:12345-192.168.204.38@tcp:502:llog_process_th.0 Request processed in 75us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166988.146904:0:32221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 159 00000100:00100000:2.0:1762166988.148194:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166988.148228:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166988.148258:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450788224 00000100:00100000:1.0:1762166988.148264:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450788224 00000100:00100000:0.0:1762166988.148282:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450788480 00000100:00100000:0.0:1762166988.148287:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450788480 00000100:00100000:1.0:1762166988.148307:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30992 00000100:00100000:1.0:1762166988.148314:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4530380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2415:x1847765450788224:12345-192.168.204.38@tcp:38:mount.lustre.0 00000100:00100000:0.0:1762166988.148326:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30993 00000100:00100000:0.0:1762166988.148334:0:6496:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4533480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2415:x1847765450788480:12345-192.168.204.38@tcp:38:mount.lustre.0 00010000:00080000:1.0:1762166988.148354:0:12357:0:(ldlm_lib.c:1428:target_handle_connect()) lustre-MDT0000: connection from fa222f93-414e-47af-b74d-7427e42503ec@192.168.204.38@tcp t0 exp 0000000000000000 cur 607 last 0 00010000:00080000:0.0:1762166988.148358:0:6496:0:(ldlm_lib.c:1428:target_handle_connect()) lustre-MDT0001: connection from fa222f93-414e-47af-b74d-7427e42503ec@192.168.204.38@tcp t0 exp 0000000000000000 cur 607 last 0 00000020:00000080:1.0:1762166988.148433:0:12357:0:(genops.c:1402:class_connect()) connect: client fa222f93-414e-47af-b74d-7427e42503ec, cookie 0x2f180c4effbad8a4 00000020:00000080:0.0:1762166988.148433:0:6496:0:(genops.c:1402:class_connect()) connect: client fa222f93-414e-47af-b74d-7427e42503ec, cookie 0x2f180c4effbad8ab 00000004:00100000:1.0:1762166988.148459:0:12357:0:(mdt_handler.c:7249:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000004:00100000:0.0:1762166988.148460:0:6496:0:(mdt_handler.c:7249:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000020:01000000:1.0:1762166988.148572:0:12357:0:(lprocfs_status_server.c:658:lprocfs_exp_setup()) using hash ffff945cf3cb6100 00000020:01000000:0.0:1762166988.148572:0:6496:0:(lprocfs_status_server.c:658:lprocfs_exp_setup()) using hash ffff945cf1f8fc00 00000100:00080000:1.0:1762166988.148622:0:12357:0:(import.c:65:import_set_state_nolock()) ffff945cc6256000 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1762166988.148622:0:6496:0:(import.c:65:import_set_state_nolock()) ffff945cc625b000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1762166988.148691:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4530380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fa222f93-414e-47af-b74d-7427e42503ec+6:2415:x1847765450788224:12345-192.168.204.38@tcp:38:mount.lustre.0 Request processed in 366us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166988.148704:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30992 00000100:00100000:0.0:1762166988.148707:0:6496:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4533480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa222f93-414e-47af-b74d-7427e42503ec+6:2415:x1847765450788480:12345-192.168.204.38@tcp:38:mount.lustre.0 Request processed in 363us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166988.148715:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30993 00000100:00100000:2.0:1762166988.149976:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166988.150004:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166988.150030:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450788608 00000100:00100000:2.0:1762166988.150033:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166988.150037:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450788608 00000100:00100000:1.0:1762166988.150057:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450788352 00000100:00100000:1.0:1762166988.150063:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450788352 00000100:00080000:2.0:1762166988.150073:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1762166988.150079:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1762166988.150090:0:6496:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450788736 00000100:00100000:0.0:1762166988.150096:0:6496:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450788736 00000100:00100000:1.0:1762166988.150113:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30994 00000100:00100000:2.0:1762166988.150122:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30995 00000100:00100000:1.0:1762166988.150128:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4533b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fa222f93-414e-47af-b74d-7427e42503ec+6:0:x1847765450788608:12345-192.168.204.38@tcp:41:mount.lustre.0 00000100:00100000:2.0:1762166988.150138:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4530700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa222f93-414e-47af-b74d-7427e42503ec+7:0:x1847765450788352:12345-192.168.204.38@tcp:41:mount.lustre.0 00000100:00100000:3.0:1762166988.150151:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30996 00000004:00000024:1.0:1762166988.150156:0:12357:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 6438912 pending 0 free 1445212160 avail 1298972672 00000004:00000024:2.0:1762166988.150157:0:6495:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 6389760 pending 0 free 1445838848 avail 1299599360 00000100:00100000:3.0:1762166988.150194:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc4531f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa222f93-414e-47af-b74d-7427e42503ec+7:63319:x1847765450788736:12345-192.168.204.38@tcp:41:mount.lustre.0 00000100:00100000:2.0:1762166988.150212:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4530700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa222f93-414e-47af-b74d-7427e42503ec+7:0:x1847765450788352:12345-192.168.204.38@tcp:41:mount.lustre.0 Request processed in 78us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166988.150221:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30995 00000100:00100000:1.0:1762166988.150221:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4533b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fa222f93-414e-47af-b74d-7427e42503ec+6:0:x1847765450788608:12345-192.168.204.38@tcp:41:mount.lustre.0 Request processed in 96us (246us total) trans 0 rc 0/0 00000004:00000024:3.0:1762166988.150235:0:7432:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 6389760 pending 0 free 1445838848 avail 1299599360 00000100:00100000:1.0:1762166988.150235:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30994 00000100:00100000:3.0:1762166988.150346:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc4531f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa222f93-414e-47af-b74d-7427e42503ec+6:63319:x1847765450788736:12345-192.168.204.38@tcp:41:mount.lustre.0 Request processed in 179us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166988.150354:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30996 00000100:00100000:2.0:1762166988.151072:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166988.151113:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450788864 00000100:00100000:3.0:1762166988.151122:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450788864 00000100:00100000:3.0:1762166988.151167:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30997 00000100:00100000:3.0:1762166988.151176:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa222f93-414e-47af-b74d-7427e42503ec+6:63319:x1847765450788864:12345-192.168.204.38@tcp:40:mount.lustre.0 00000100:00100000:3.0:1762166988.151229:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa222f93-414e-47af-b74d-7427e42503ec+6:63319:x1847765450788864:12345-192.168.204.38@tcp:40:mount.lustre.0 Request processed in 54us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166988.151237:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30997 00000100:00100000:2.0:1762166988.152162:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166988.152189:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166988.152236:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450788992 00000100:00100000:1.0:1762166988.152242:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450788992 00000100:00100000:3.0:1762166988.152255:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450789120 00000100:00100000:2.0:1762166988.152257:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166988.152266:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450789120 00000100:00100000:1.0:1762166988.152285:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19527 00000100:00100000:1.0:1762166988.152293:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2415:x1847765450788992:12345-192.168.204.38@tcp:8:mount.lustre.0 00000100:00100000:2.0:1762166988.152318:0:7438:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450789248 00010000:00080000:1.0:1762166988.152322:0:8382:0:(ldlm_lib.c:1428:target_handle_connect()) lustre-OST0000: connection from fa222f93-414e-47af-b74d-7427e42503ec@192.168.204.38@tcp t0 exp 0000000000000000 cur 607 last 0 00000100:00100000:2.0:1762166988.152324:0:7438:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450789248 00000100:00100000:3.0:1762166988.152355:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19528 00000100:00100000:3.0:1762166988.152363:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2415:x1847765450789120:12345-192.168.204.38@tcp:8:mount.lustre.0 00000020:00000080:1.0:1762166988.152370:0:8382:0:(genops.c:1402:class_connect()) connect: client fa222f93-414e-47af-b74d-7427e42503ec, cookie 0x2f180c4effbad8b2 00000100:00100000:2.0:1762166988.152385:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 18 00002000:00100000:1.0:1762166988.152385:0:8382:0:(ofd_obd.c:124:ofd_parse_connect_data()) lustre-OST0000: cli fa222f93-414e-47af-b74d-7427e42503ec/ffff945cc6254000 ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 2103b32 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00010000:00080000:3.0:1762166988.152393:0:9168:0:(ldlm_lib.c:1428:target_handle_connect()) lustre-OST0001: connection from fa222f93-414e-47af-b74d-7427e42503ec@192.168.204.38@tcp t0 exp 0000000000000000 cur 607 last 0 00000100:00100000:2.0:1762166988.152405:0:7438:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0002:fa222f93-414e-47af-b74d-7427e42503ec+6:63319:x1847765450789248:12345-192.168.204.38@tcp:900:mount.lustre.0 00002000:00100000:1.0:1762166988.152406:0:8382:0:(ofd_obd.c:222:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000020:00000080:3.0:1762166988.152430:0:9168:0:(genops.c:1402:class_connect()) connect: client fa222f93-414e-47af-b74d-7427e42503ec, cookie 0x2f180c4effbad8b9 00002000:00100000:3.0:1762166988.152441:0:9168:0:(ofd_obd.c:124:ofd_parse_connect_data()) lustre-OST0001: cli fa222f93-414e-47af-b74d-7427e42503ec/ffff945bc5676000 ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 2103b32 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1762166988.152452:0:9168:0:(ofd_obd.c:222:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:2.0:1762166988.152528:0:7438:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0002:fa222f93-414e-47af-b74d-7427e42503ec+6:63319:x1847765450789248:12345-192.168.204.38@tcp:900:mount.lustre.0 Request processed in 124us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166988.152539:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 18 00000020:01000000:3.0:1762166988.152573:0:9168:0:(lprocfs_status_server.c:658:lprocfs_exp_setup()) using hash ffff945cc9241100 00000020:01000000:1.0:1762166988.152576:0:8382:0:(lprocfs_status_server.c:658:lprocfs_exp_setup()) using hash ffff945bc49ab600 00002000:00080000:3.0:1762166988.152584:0:9168:0:(ofd_obd.c:365:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00002000:00080000:1.0:1762166988.152590:0:8382:0:(ofd_obd.c:365:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1762166988.152623:0:8382:0:(import.c:65:import_set_state_nolock()) ffff945cc6255000 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1762166988.152649:0:9168:0:(import.c:65:import_set_state_nolock()) ffff945cf78a3000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1762166988.152668:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fa222f93-414e-47af-b74d-7427e42503ec+6:2415:x1847765450788992:12345-192.168.204.38@tcp:8:mount.lustre.0 Request processed in 371us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166988.152691:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19527 00000100:00100000:3.0:1762166988.152723:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fa222f93-414e-47af-b74d-7427e42503ec+6:2415:x1847765450789120:12345-192.168.204.38@tcp:8:mount.lustre.0 Request processed in 351us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166988.152735:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19528 00000100:00100000:2.0:1762166988.153434:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166988.153501:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450789376 00000100:00100000:1.0:1762166988.153506:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450789376 00000100:00100000:1.0:1762166988.153538:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 12027 00000100:00100000:1.0:1762166988.153546:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf3db7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:fa222f93-414e-47af-b74d-7427e42503ec+6:63319:x1847765450789376:12345-192.168.204.38@tcp:33:mount.lustre.0 00000004:00200000:1.0:1762166988.153617:0:19593:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1762166988.153671:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf3db7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:fa222f93-414e-47af-b74d-7427e42503ec+6:63319:x1847765450789376:12345-192.168.204.38@tcp:33:mount.lustre.0 Request processed in 126us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166988.153690:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 12027 00000100:00100000:0.0:1762166988.213151:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166988.213378:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450789504 00000100:00100000:3.0:1762166988.213392:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450789504 00000100:00100000:3.0:1762166988.213516:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30998 00000100:00100000:3.0:1762166988.213530:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc76ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa222f93-414e-47af-b74d-7427e42503ec+6:63345:x1847765450789504:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166988.213557:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166988.213582:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b62e00/0x2f180c4effbad8c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ead91 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166988.213661:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b63400/0x2f180c4effbad8c7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.213691:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b63400/0x2f180c4effbad8c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.213705:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b63400/0x2f180c4effbad8c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:3.0:1762166988.213771:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1762166988.213776:0:7432:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166988.213798:0:7432:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b63400/0x2f180c4effbad8c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.213827:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b62e00/0x2f180c4effbad8c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ead91 expref: 8 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166988.213850:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b63400/0x2f180c4effbad8c7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ead91 expref: 7 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166988.213860:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945cd0738700) 00010000:00010000:3.0:1762166988.213864:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1762166988.213869:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4b63400, rc 0) 00000100:00100000:3.0:1762166988.213950:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc76ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa222f93-414e-47af-b74d-7427e42503ec+7:63345:x1847765450789504:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 423us (814us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166988.213959:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30998 00000100:00100000:0.0:1762166988.215382:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166988.215422:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450789760 00000100:00100000:3.0:1762166988.215430:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450789760 00000100:00100000:3.0:1762166988.215503:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 30999 00000100:00100000:3.0:1762166988.215512:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc76aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa222f93-414e-47af-b74d-7427e42503ec+7:63345:x1847765450789760:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166988.215530:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166988.215546:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b62c00/0x2f180c4effbad8ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ead98 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166988.215628:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b63000/0x2f180c4effbad8d5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.215640:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b63000/0x2f180c4effbad8d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.215651:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b63000/0x2f180c4effbad8d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.215661:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b63a00/0x2f180c4effbad8dc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.215668:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b63a00/0x2f180c4effbad8dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.215674:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b63a00/0x2f180c4effbad8dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.215780:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b63000/0x2f180c4effbad8d5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.215788:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b63000/0x2f180c4effbad8d5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.215794:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b63000/0x2f180c4effbad8d5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.215801:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b63000/0x2f180c4effbad8d5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.215807:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4b63000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166988.215812:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b63000/0x2f180c4effbad8d5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.215819:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b63000/0x2f180c4effbad8d5 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.215831:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945cd0738700) 00010000:00010000:3.0:1762166988.215834:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166988.215839:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b63000/0x2f180c4effbad8d5 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.215845:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b63000/0x2f180c4effbad8d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.215858:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b63a00/0x2f180c4effbad8dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.215864:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b63a00/0x2f180c4effbad8dc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.215869:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b63a00/0x2f180c4effbad8dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.215874:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4b63a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166988.215877:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b63a00/0x2f180c4effbad8dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.215882:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b63a00/0x2f180c4effbad8dc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.215888:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x64c18fe5 (ffff945bc812e800) 00010000:00010000:3.0:1762166988.215890:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166988.215893:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b63a00/0x2f180c4effbad8dc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.215899:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b63a00/0x2f180c4effbad8dc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.215926:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b62c00/0x2f180c4effbad8ce lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ead98 expref: 8 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166988.215935:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945cd0738700) 00010000:00010000:3.0:1762166988.215938:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1762166988.215942:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b62c00/0x2f180c4effbad8ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ead98 expref: 8 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166988.215951:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4b62c00, rc 0) 00000100:00100000:3.0:1762166988.216004:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc76aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa222f93-414e-47af-b74d-7427e42503ec+7:63345:x1847765450789760:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 494us (630us total) trans 0 rc 301/301 00000100:00100000:3.0:1762166988.216012:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 30999 00000100:00100000:2.0:1762166988.217257:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166988.217333:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450789888 00000100:00100000:3.0:1762166988.217342:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450789888 00000100:00100000:3.0:1762166988.217387:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 31000 00000100:00100000:3.0:1762166988.217396:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc59d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa222f93-414e-47af-b74d-7427e42503ec+7:63345:x1847765450789888:12345-192.168.204.38@tcp:34:lfs.0 00010000:00010000:3.0:1762166988.217455:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b63e00/0x2f180c4effbad8e3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.217467:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b63e00/0x2f180c4effbad8e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.217501:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b63e00/0x2f180c4effbad8e3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.217514:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b62600/0x2f180c4effbad8ea lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.217521:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b62600/0x2f180c4effbad8ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.217527:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b62600/0x2f180c4effbad8ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.217604:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc0030800/0x2f180c4effbad8f1 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x54:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.217617:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cc0030800/0x2f180c4effbad8f1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.217624:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc0030800/0x2f180c4effbad8f1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:3.0:1762166988.217699:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x54:0x0]: returning size 0 00000004:00200000:3.0:1762166988.217705:0:7432:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166988.217720:0:7432:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945cc0030800/0x2f180c4effbad8f1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.217734:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b63e00/0x2f180c4effbad8e3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.217740:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b63e00/0x2f180c4effbad8e3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.217746:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b63e00/0x2f180c4effbad8e3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.217751:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b63e00/0x2f180c4effbad8e3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.217757:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4b63e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166988.217760:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b63e00/0x2f180c4effbad8e3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.217767:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b63e00/0x2f180c4effbad8e3 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.217791:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945cd0738700) 00010000:00010000:3.0:1762166988.217793:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166988.217797:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b63e00/0x2f180c4effbad8e3 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.217804:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b63e00/0x2f180c4effbad8e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.217820:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b62600/0x2f180c4effbad8ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.217825:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b62600/0x2f180c4effbad8ea lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.217830:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b62600/0x2f180c4effbad8ea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.217836:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4b62600 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166988.217838:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b62600/0x2f180c4effbad8ea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.217843:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b62600/0x2f180c4effbad8ea lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.217850:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x64c18fe5 (ffff945bc812e800) 00010000:00010000:3.0:1762166988.217852:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166988.217855:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b62600/0x2f180c4effbad8ea lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.217860:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b62600/0x2f180c4effbad8ea lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.217870:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc0030800/0x2f180c4effbad8f1 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.217877:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cc0030800/0x2f180c4effbad8f1 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.217883:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cc0030800/0x2f180c4effbad8f1 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.217889:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cc0030800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166988.217891:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc0030800/0x2f180c4effbad8f1 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.217898:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cc0030800/0x2f180c4effbad8f1 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.217904:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x54:0x0].0x0 (ffff945cc7df9e00) 00010000:00010000:3.0:1762166988.217907:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166988.217910:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cc0030800/0x2f180c4effbad8f1 lrc: 2/0,0 mode: --/PR res: [0x200000405:0x54:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.217916:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc0030800/0x2f180c4effbad8f1 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x54:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00000100:00100000:3.0:1762166988.217992:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc59d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa222f93-414e-47af-b74d-7427e42503ec+7:63345:x1847765450789888:12345-192.168.204.38@tcp:34:lfs.0 Request processed in 597us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166988.218001:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 31000 00000100:00100000:0.0:1762166988.234843:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166988.234892:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450790016 00000100:00100000:3.0:1762166988.234906:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450790016 00000100:00100000:3.0:1762166988.234981:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 31001 00000100:00100000:3.0:1762166988.234993:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc76ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+65:63348:x1847765450790016:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166988.235029:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166988.235055:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc0030800/0x2f180c4effbad8f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028ead9f expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166988.235146:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b62600/0x2f180c4effbad8ff lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.235163:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b62600/0x2f180c4effbad8ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.235176:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b62600/0x2f180c4effbad8ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:3.0:1762166988.235230:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1762166988.235235:0:7432:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1762166988.235259:0:7432:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b62600/0x2f180c4effbad8ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.235287:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc0030800/0x2f180c4effbad8f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ead9f expref: 67 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166988.235311:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b62600/0x2f180c4effbad8ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028ead9f expref: 66 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166988.235321:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945cd0738700) 00010000:00010000:3.0:1762166988.235324:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1762166988.235329:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4b62600, rc 0) 00000100:00100000:3.0:1762166988.235414:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc76ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+66:63348:x1847765450790016:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 422us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166988.235423:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 31001 00000100:00100000:0.0:1762166988.237089:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166988.237207:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450790272 00000100:00100000:3.0:1762166988.237218:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450790272 00000100:00100000:3.0:1762166988.237276:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 31002 00000100:00100000:3.0:1762166988.237287:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc76ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+66:63348:x1847765450790272:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166988.237311:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166988.237333:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b63e00/0x2f180c4effbad906 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eada6 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166988.237405:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b62c00/0x2f180c4effbad90d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.237420:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b62c00/0x2f180c4effbad90d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.237430:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b62c00/0x2f180c4effbad90d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.237440:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b63a00/0x2f180c4effbad914 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.237446:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b63a00/0x2f180c4effbad914 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.237452:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b63a00/0x2f180c4effbad914 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.237556:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b62c00/0x2f180c4effbad90d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.237563:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b62c00/0x2f180c4effbad90d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.237569:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b62c00/0x2f180c4effbad90d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.237576:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b62c00/0x2f180c4effbad90d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.237581:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4b62c00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166988.237586:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b62c00/0x2f180c4effbad90d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.237593:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b62c00/0x2f180c4effbad90d lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.237608:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945cd0738700) 00010000:00010000:3.0:1762166988.237611:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166988.237615:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b62c00/0x2f180c4effbad90d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.237620:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b62c00/0x2f180c4effbad90d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.237633:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b63a00/0x2f180c4effbad914 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.237638:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b63a00/0x2f180c4effbad914 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.237643:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b63a00/0x2f180c4effbad914 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.237648:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4b63a00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166988.237650:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b63a00/0x2f180c4effbad914 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.237655:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b63a00/0x2f180c4effbad914 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.237661:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x64c18fe5 (ffff945bc812e800) 00010000:00010000:3.0:1762166988.237664:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166988.237667:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b63a00/0x2f180c4effbad914 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.237672:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b63a00/0x2f180c4effbad914 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.237708:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b63e00/0x2f180c4effbad906 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eada6 expref: 67 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166988.237717:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945cd0738700) 00010000:00010000:3.0:1762166988.237720:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1762166988.237723:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b63e00/0x2f180c4effbad906 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eada6 expref: 67 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166988.237731:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4b63e00, rc 0) 00000100:00100000:3.0:1762166988.237800:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc76ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+66:63348:x1847765450790272:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 510us (719us total) trans 0 rc 301/301 00000100:00100000:3.0:1762166988.237808:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 31002 00000100:00100000:2.0:1762166988.239383:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166988.239439:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450790528 00000100:00100000:3.0:1762166988.239447:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450790528 00000100:00100000:3.0:1762166988.239524:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 31003 00000100:00100000:3.0:1762166988.239535:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc59d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+66:63348:x1847765450790528:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:3.0:1762166988.239553:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166988.239570:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b63000/0x2f180c4effbad91b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eadad expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166988.239665:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b62e00/0x2f180c4effbad922 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.239690:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b62e00/0x2f180c4effbad922 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.239702:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b62e00/0x2f180c4effbad922 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.239715:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac200/0x2f180c4effbad929 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.239727:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac200/0x2f180c4effbad929 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.239734:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac200/0x2f180c4effbad929 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.239860:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cada00/0x2f180c4effbad930 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x54:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.239870:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cada00/0x2f180c4effbad930 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.239876:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cada00/0x2f180c4effbad930 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:3.0:1762166988.239886:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x54:0x0]: returning size 0 00010000:00010000:3.0:1762166988.239990:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b62e00/0x2f180c4effbad922 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.239997:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b62e00/0x2f180c4effbad922 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.240002:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b62e00/0x2f180c4effbad922 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.240009:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b62e00/0x2f180c4effbad922 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.240015:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4b62e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166988.240019:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b62e00/0x2f180c4effbad922 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.240031:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b62e00/0x2f180c4effbad922 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.240048:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945cd0738700) 00010000:00010000:3.0:1762166988.240052:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166988.240057:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b62e00/0x2f180c4effbad922 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.240063:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b62e00/0x2f180c4effbad922 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.240077:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac200/0x2f180c4effbad929 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.240083:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac200/0x2f180c4effbad929 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.240089:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac200/0x2f180c4effbad929 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.240094:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945cf3cac200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:3.0:1762166988.240096:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac200/0x2f180c4effbad929 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.240100:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac200/0x2f180c4effbad929 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.240106:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x64c18fe5 (ffff945bc812e800) 00010000:00010000:3.0:1762166988.240107:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1762166988.240110:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac200/0x2f180c4effbad929 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.240116:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cac200/0x2f180c4effbad929 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.240153:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b63000/0x2f180c4effbad91b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eadad expref: 69 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166988.240168:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cada00/0x2f180c4effbad930 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eadad expref: 68 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166988.240176:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x54:0x0].0x0 (ffff945cc7df9e00) 00010000:00010000:3.0:1762166988.240178:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1762166988.240181:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cf3cada00, rc 0) 00000100:00100000:3.0:1762166988.240247:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc59d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+68:63348:x1847765450790528:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 713us (872us total) trans 8589935368 rc 0/0 00000100:00100000:3.0:1762166988.240255:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 31003 00000100:00100000:0.0:1762166988.241688:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166988.241772:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450790784 00000100:00100000:1.0:1762166988.241782:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450790784 00000100:00100000:1.0:1762166988.241832:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 12028 00000100:00100000:1.0:1762166988.241844:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc76ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+68:63348:x1847765450790784:12345-192.168.204.38@tcp:35:lfs.0 00000100:00100000:1.0:1762166988.242047:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc76ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+69:63348:x1847765450790784:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 205us (375us total) trans 8589935369 rc 0/0 00000100:00100000:1.0:1762166988.242053:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 12028 00000100:00100000:0.0:1762166988.597865:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166988.597917:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166988.598009:0:12357:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450790912 00000100:00100000:2.0:1762166988.598019:0:12357:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450790912 00000100:00100000:1.0:1762166988.598319:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450791040 00000100:00100000:1.0:1762166988.598325:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450791040 00000100:00100000:2.0:1762166988.598329:0:12357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 31004 00000100:00100000:2.0:1762166988.598344:0:12357:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc76afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1dd12c0b-744c-4d89-8dac-079bf92f5ace+6:63363:x1847765450790912:12345-192.168.204.38@tcp:101:stat.0 00010000:00010000:2.0:1762166988.598362:0:12357:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1762166988.598366:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 31005 00000100:00100000:1.0:1762166988.598378:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc76ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa222f93-414e-47af-b74d-7427e42503ec+7:63367:x1847765450791040:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:2.0:1762166988.598384:0:12357:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355b400/0x2f180c4effbad93e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eadb4 expref: -99 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166988.598388:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166988.598401:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945d02174400/0x2f180c4effbad945 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eadbb expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166988.598450:0:12357:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355ac00/0x2f180c4effbad94c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166988.598452:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa8200/0x2f180c4effbad953 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166988.598473:0:12357:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355ac00/0x2f180c4effbad94c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166988.598505:0:12357:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355ac00/0x2f180c4effbad94c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:1.0:1762166988.598507:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa8200/0x2f180c4effbad953 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166988.598522:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa8200/0x2f180c4effbad953 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166988.598534:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa8800/0x2f180c4effbad95a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166988.598541:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa8800/0x2f180c4effbad95a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166988.598548:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa8800/0x2f180c4effbad95a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:2.0:1762166988.598553:0:12357:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1762166988.598558:0:12357:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1762166988.598576:0:12357:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355ac00/0x2f180c4effbad94c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12357 initiator: MDT0 00010000:00010000:2.0:1762166988.598603:0:12357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355b400/0x2f180c4effbad93e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eadb4 expref: 8 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166988.598622:0:12357:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355ac00/0x2f180c4effbad94c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eadb4 expref: 7 pid: 12357 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166988.598622:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa9a00/0x2f180c4effbad961 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x54:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166988.598644:0:12357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945cd0738700) 00010000:00010000:1.0:1762166988.598644:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa9a00/0x2f180c4effbad961 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166988.598650:0:12357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1762166988.598655:0:12357:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355ac00, rc 0) 00010000:00010000:1.0:1762166988.598659:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa9a00/0x2f180c4effbad961 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:1.0:1762166988.598703:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x54:0x0]: returning size 0 00000004:00200000:1.0:1762166988.598707:0:7432:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1762166988.598720:0:7432:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa9a00/0x2f180c4effbad961 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000100:00100000:2.0:1762166988.598725:0:12357:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc76afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1dd12c0b-744c-4d89-8dac-079bf92f5ace+7:63363:x1847765450790912:12345-192.168.204.38@tcp:101:stat.0 Request processed in 383us (866us total) trans 0 rc 0/0 00010000:00010000:1.0:1762166988.598736:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa9a00/0x2f180c4effbad961 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00000100:00100000:2.0:1762166988.598738:0:12357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 31004 00010000:00010000:1.0:1762166988.598750:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa8200/0x2f180c4effbad953 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166988.598758:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa8200/0x2f180c4effbad953 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166988.598765:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa8200/0x2f180c4effbad953 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166988.598772:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa8200/0x2f180c4effbad953 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166988.598779:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa8200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166988.598784:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa8200/0x2f180c4effbad953 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166988.598793:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa8200/0x2f180c4effbad953 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166988.598805:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945cd0738700) 00010000:00010000:1.0:1762166988.598808:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166988.598812:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa8200/0x2f180c4effbad953 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166988.598818:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa8200/0x2f180c4effbad953 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166988.598830:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa8800/0x2f180c4effbad95a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166988.598841:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa8800/0x2f180c4effbad95a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166988.598847:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa8800/0x2f180c4effbad95a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166988.598852:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa8800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:1.0:1762166988.598855:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa8800/0x2f180c4effbad95a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166988.598860:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa8800/0x2f180c4effbad95a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166988.598867:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x64c18fe5 (ffff945bc812e800) 00010000:00010000:1.0:1762166988.598871:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1762166988.598874:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa8800/0x2f180c4effbad95a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166988.598881:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa8800/0x2f180c4effbad95a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166988.599225:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945d02174400/0x2f180c4effbad945 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eadbb expref: 9 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166988.599238:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa9a00/0x2f180c4effbad961 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eadbb expref: 8 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166988.599245:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x54:0x0].0x0 (ffff945cc7df9e00) 00010000:00010000:1.0:1762166988.599247:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1762166988.599250:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa9a00, rc 0) 00000100:00100000:1.0:1762166988.599284:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc76ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa222f93-414e-47af-b74d-7427e42503ec+8:63367:x1847765450791040:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 909us (1366us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166988.599291:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 31005 00000100:00100000:0.0:1762166988.600974:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166988.601097:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450791296 00000100:00100000:3.0:1762166988.601105:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450791296 00000100:00100000:3.0:1762166988.601144:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 31006 00000100:00100000:3.0:1762166988.601153:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc76af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+69:63372:x1847765450791296:12345-192.168.204.38@tcp:101:cat.0 00010000:00010000:3.0:1762166988.601169:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166988.601183:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b62e00/0x2f180c4effbad968 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eadc2 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166988.601261:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b63e00/0x2f180c4effbad96f lrc: 3/1,0 mode: --/CR res: [0x200000405:0x54:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.601336:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b63e00/0x2f180c4effbad96f lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x54:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.601345:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b63e00/0x2f180c4effbad96f lrc: 3/1,0 mode: CR/CR res: [0x200000405:0x54:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:3.0:1762166988.601353:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x54:0x0]: returning size 0 00010000:00010000:3.0:1762166988.601452:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b62e00/0x2f180c4effbad968 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eadc2 expref: 72 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166988.601465:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b63e00/0x2f180c4effbad96f lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x54:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eadc2 expref: 71 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166988.601470:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x54:0x0].0x0 (ffff945cc7df9e00) 00010000:00010000:3.0:1762166988.601472:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1762166988.601474:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4b63e00, rc 0) 00000100:00100000:3.0:1762166988.601547:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc76af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+71:63372:x1847765450791296:12345-192.168.204.38@tcp:101:cat.0 Request processed in 395us (575us total) trans 8589935370 rc 0/0 00000100:00100000:3.0:1762166988.601552:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 31006 00000100:00100000:3.0:1762166988.602244:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166988.602355:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166988.602367:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450791424 00000100:00100000:0.0:1762166988.602372:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450791424 00000100:00100000:0.0:1762166988.602418:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 31007 00000100:00100000:0.0:1762166988.602428:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7bba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1dd12c0b-744c-4d89-8dac-079bf92f5ace+7:63363:x1847765450791424:12345-192.168.204.38@tcp:101:stat.0 00000100:00100000:2.0:1762166988.602437:0:7438:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450791552 00010000:00010000:0.0:1762166988.602438:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1762166988.602445:0:7438:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450791552 00010000:00010000:0.0:1762166988.602451:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde600/0x2f180c4effbad97d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eadc9 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166988.602516:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19 00010000:00010000:0.0:1762166988.602525:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf200/0x2f180c4effbad984 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00000100:00100000:2.0:1762166988.602526:0:7438:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0002:fa222f93-414e-47af-b74d-7427e42503ec+6:63367:x1847765450791552:12345-192.168.204.38@tcp:900:lfs.0 00010000:00010000:0.0:1762166988.602541:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf200/0x2f180c4effbad984 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166988.602550:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf200/0x2f180c4effbad984 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166988.602562:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad98b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166988.602570:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad98b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00000100:00100000:2.0:1762166988.602573:0:7438:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0002:fa222f93-414e-47af-b74d-7427e42503ec+6:63367:x1847765450791552:12345-192.168.204.38@tcp:900:lfs.0 Request processed in 49us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166988.602585:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19 00010000:00010000:0.0:1762166988.602587:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad98b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166988.602658:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde800/0x2f180c4effbad992 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x54:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166988.602666:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde800/0x2f180c4effbad992 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166988.602686:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde800/0x2f180c4effbad992 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:0.0:1762166988.602726:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x54:0x0]: returning size 0 00000004:00200000:0.0:1762166988.602730:0:7432:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1762166988.602744:0:7432:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde800/0x2f180c4effbad992 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166988.602753:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde800/0x2f180c4effbad992 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166988.602768:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf200/0x2f180c4effbad984 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166988.602775:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf200/0x2f180c4effbad984 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166988.602781:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf200/0x2f180c4effbad984 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166988.602787:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf200/0x2f180c4effbad984 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166988.602793:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdf200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166988.602796:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf200/0x2f180c4effbad984 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166988.602802:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf200/0x2f180c4effbad984 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166988.602811:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945cd0738700) 00010000:00010000:0.0:1762166988.602821:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166988.602824:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf200/0x2f180c4effbad984 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166988.602830:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf200/0x2f180c4effbad984 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166988.602839:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad98b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166988.602845:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad98b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166988.602850:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad98b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166988.602856:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdfe00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166988.602859:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad98b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166988.602865:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad98b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166988.602873:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x64c18fe5 (ffff945bc812e800) 00010000:00010000:0.0:1762166988.602876:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166988.602879:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad98b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166988.602884:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad98b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166988.602909:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde600/0x2f180c4effbad97d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eadc9 expref: 9 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166988.602924:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde800/0x2f180c4effbad992 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eadc9 expref: 8 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166988.602931:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x54:0x0].0x0 (ffff945cc7df9e00) 00010000:00010000:0.0:1762166988.602933:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1762166988.602936:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bde800, rc 0) 00000100:00100000:0.0:1762166988.602980:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7bba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1dd12c0b-744c-4d89-8dac-079bf92f5ace+8:63363:x1847765450791424:12345-192.168.204.38@tcp:101:stat.0 Request processed in 554us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166988.602987:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 31007 00000100:00100000:3.0:1762166988.603969:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166988.604001:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450791808 00000100:00100000:0.0:1762166988.604007:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450791808 00000100:00100000:0.0:1762166988.604053:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 31008 00000100:00100000:0.0:1762166988.604061:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7bb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa222f93-414e-47af-b74d-7427e42503ec+8:63367:x1847765450791808:12345-192.168.204.38@tcp:101:lfs.0 00010000:00010000:0.0:1762166988.604071:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166988.604080:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde200/0x2f180c4effbad999 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eadd0 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166988.604141:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdee00/0x2f180c4effbad9a0 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x54:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166988.604150:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdee00/0x2f180c4effbad9a0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166988.604158:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdee00/0x2f180c4effbad9a0 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:0.0:1762166988.604166:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x54:0x0]: returning size 0 00000100:00100000:0.0:1762166988.604281:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166988.604327:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166988.604350:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450791936 00000100:00100000:1.0:1762166988.604356:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450791936 00000100:00100000:0.0:1762166988.604363:0:7438:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450792064 00000100:00100000:0.0:1762166988.604369:0:7438:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450792064 00002000:00100000:1.0:1762166988.604391:0:14623:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x75:0x0] (0->4095) req@ffff945bc76af480 x1847765450791936/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:19/0 lens 488/0 e 0 to 0 dl 1762166999 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166988.604402:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc76af480 with x1847765450791936 ext(0->4095) 00000100:00100000:0.0:1762166988.604403:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 20 00002000:00010000:1.0:1762166988.604410:0:14623:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc76af480 00000100:00100000:0.0:1762166988.604432:0:7438:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc76ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0002:1dd12c0b-744c-4d89-8dac-079bf92f5ace+6:63363:x1847765450792064:12345-192.168.204.38@tcp:900:stat.0 00000100:00100000:1.0:1762166988.604437:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2839 00000100:00100000:1.0:1762166988.604449:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc76af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450791936:12345-192.168.204.38@tcp:3:cat.0 00000100:00100000:0.0:1762166988.604505:0:7438:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc76ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0002:1dd12c0b-744c-4d89-8dac-079bf92f5ace+6:63363:x1847765450792064:12345-192.168.204.38@tcp:900:stat.0 Request processed in 49us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166988.604514:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 20 00000100:00100000:1.0:1762166988.604619:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc76af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450791936:12345-192.168.204.38@tcp:3:cat.0 Request processed in 171us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166988.604627:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2839 00002000:00100000:1.0:1762166988.604635:0:14623:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x75:0x0] (0->4095) req@ffff945bc76af480 x1847765450791936/t0(0) o3->e1e11365-ba0b-405b-99c9-a704373217f2@192.168.204.38@tcp:19/0 lens 488/440 e 0 to 0 dl 1762166999 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1762166988.604643:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc76af480 with x1847765450791936 ext(0->4095) 00002000:00010000:1.0:1762166988.604647:0:14623:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc76af480 00000100:00100000:3.0:1762166988.605007:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166988.605063:0:6505:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450792192 00000100:00100000:0.0:1762166988.605068:0:6505:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450792192 00000100:00100000:0.0:1762166988.605110:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 21 00000100:00100000:0.0:1762166988.605119:0:6505:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7bb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:1dd12c0b-744c-4d89-8dac-079bf92f5ace+6:63373:x1847765450792192:12345-192.168.204.38@tcp:900:cat.0 00000100:00100000:0.0:1762166988.605169:0:6505:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7bb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:1dd12c0b-744c-4d89-8dac-079bf92f5ace+6:63373:x1847765450792192:12345-192.168.204.38@tcp:900:cat.0 Request processed in 50us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166988.605178:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 21 00000001:00080000:3.0:1762166988.605765:0:32215:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935371 is committed 00000001:00080000:3.0:1762166988.605797:0:32215:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935370 is committed 00000001:00100000:3.0:1762166988.605805:0:32215:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of fa222f93-414e-47af-b74d-7427e42503ec 00000001:00100000:3.0:1762166988.605881:0:32215:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1dd12c0b-744c-4d89-8dac-079bf92f5ace 00000020:00080000:3.0:1762166988.605918:0:32215:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff945bc402f240 refcount 2 committed 0 result 0 batchid 4294969064 00000020:00080000:3.0:1762166988.605924:0:32215:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945bc5f03300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff945cf1dce6c0 00000020:00080000:3.0:1762166988.605927:0:32215:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff945bc5f03f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff945bccec4800 00010000:00010000:2.0:1762166988.605956:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa8e00/0x2f180c4effbad5be lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166988.605966:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa8e00/0x2f180c4effbad5be lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166988.605974:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa8e00/0x2f180c4effbad5be lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166988.605980:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa8e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166988.605989:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa8e00/0x2f180c4effbad5be lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166988.605996:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa8e00/0x2f180c4effbad5be lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00000020:00080000:0.0:1762166988.606006:0:32243:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294969064 committed batchid 4294969063 00010000:00010000:2.0:1762166988.606013:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x64c18fe5 (ffff945bc812e800) 00010000:00010000:2.0:1762166988.606017:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166988.606021:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa8e00/0x2f180c4effbad5be lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166988.606027:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa8e00/0x2f180c4effbad5be lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166988.606052:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf000/0x2f180c4effbad619 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166988.606060:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf000/0x2f180c4effbad619 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166988.606066:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf000/0x2f180c4effbad619 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166988.606071:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdf000 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166988.606075:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf000/0x2f180c4effbad619 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00000020:00080000:0.0:1762166988.606081:0:32243:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969063 00010000:00010000:2.0:1762166988.606082:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf000/0x2f180c4effbad619 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166988.606093:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9c8d69b4 (ffff945cc7df9d00) 00010000:00010000:2.0:1762166988.606097:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166988.606100:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf000/0x2f180c4effbad619 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166988.606106:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf000/0x2f180c4effbad619 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166988.606133:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa9e00/0x2f180c4effbad674 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166988.606141:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde200/0x2f180c4effbad999 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eadd0 expref: 9 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166988.606142:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa9e00/0x2f180c4effbad674 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166988.606158:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa9e00/0x2f180c4effbad674 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166988.606164:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4aa9e00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166988.606168:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa9e00/0x2f180c4effbad674 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166988.606170:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdee00/0x2f180c4effbad9a0 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eadd0 expref: 8 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166988.606178:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa9e00/0x2f180c4effbad674 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:0.0:1762166988.606187:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x54:0x0].0x0 (ffff945cc7df9e00) 00010000:00010000:2.0:1762166988.606191:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc72e1b9b (ffff945bc812ec00) 00010000:00010000:0.0:1762166988.606192:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166988.606198:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166988.606198:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdee00, rc 0) 00010000:00010000:2.0:1762166988.606203:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa9e00/0x2f180c4effbad674 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166988.606210:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa9e00/0x2f180c4effbad674 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166988.606224:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf800/0x2f180c4effbad723 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x54:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166988.606230:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf800/0x2f180c4effbad723 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x54:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166988.606236:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf800/0x2f180c4effbad723 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x54:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00000100:00100000:0.0:1762166988.606242:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7bb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa222f93-414e-47af-b74d-7427e42503ec+8:63367:x1847765450791808:12345-192.168.204.38@tcp:101:lfs.0 Request processed in 2179us (2274us total) trans 8589935371 rc 0/0 00010000:00010000:2.0:1762166988.606244:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdf800 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166988.606250:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf800/0x2f180c4effbad723 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x54:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00000100:00100000:0.0:1762166988.606257:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 31008 00010000:00010000:2.0:1762166988.606261:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf800/0x2f180c4effbad723 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x54:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166988.606271:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x54:0x0].0x0 (ffff945cc7df9e00) 00010000:00010000:2.0:1762166988.606273:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166988.606276:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf800/0x2f180c4effbad723 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x54:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166988.606282:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf800/0x2f180c4effbad723 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x54:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166988.606292:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfc00/0x2f180c4effbad770 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166988.606298:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfc00/0x2f180c4effbad770 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166988.606304:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfc00/0x2f180c4effbad770 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166988.606310:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdfc00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166988.606312:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfc00/0x2f180c4effbad770 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166988.606318:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfc00/0x2f180c4effbad770 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166988.606324:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9c8d69b4 (ffff945cc7df9d00) 00010000:00010000:2.0:1762166988.606326:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166988.606329:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfc00/0x2f180c4effbad770 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166988.606333:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfc00/0x2f180c4effbad770 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x9c8d69b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166988.606347:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde400/0x2f180c4effbad803 lrc: 3/0,1 mode: TXN/TXN res: [0x200000405:0x54:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166988.606353:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde400/0x2f180c4effbad803 lrc: 2/0,0 mode: TXN/TXN res: [0x200000405:0x54:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166988.606359:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde400/0x2f180c4effbad803 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x54:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166988.606364:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bde400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166988.606367:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde400/0x2f180c4effbad803 lrc: 3/0,0 mode: TXN/TXN res: [0x200000405:0x54:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166988.606373:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde400/0x2f180c4effbad803 lrc: 4/0,0 mode: TXN/TXN res: [0x200000405:0x54:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166988.606379:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x54:0x0].0x0 (ffff945cc7df9e00) 00010000:00010000:2.0:1762166988.606382:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166988.606384:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde400/0x2f180c4effbad803 lrc: 2/0,0 mode: --/TXN res: [0x200000405:0x54:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166988.606390:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde400/0x2f180c4effbad803 lrc: 0/0,0 mode: --/TXN res: [0x200000405:0x54:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166988.606399:0:3619:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf400/0x2f180c4effbad849 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166988.606406:0:3619:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf400/0x2f180c4effbad849 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166988.606411:0:3619:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf400/0x2f180c4effbad849 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166988.606416:0:3619:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdf400 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:2.0:1762166988.606420:0:3619:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf400/0x2f180c4effbad849 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166988.606426:0:3619:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf400/0x2f180c4effbad849 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166988.606434:0:3619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc72e1b9b (ffff945bc812ec00) 00010000:00010000:2.0:1762166988.606436:0:3619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1762166988.606439:0:3619:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf400/0x2f180c4effbad849 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00010000:00010000:2.0:1762166988.606444:0:3619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf400/0x2f180c4effbad849 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc72e1b9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 00000100:00100000:3.0:1762166988.607133:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166988.607585:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166988.607627:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450792448 00000100:00100000:2.0:1762166988.607635:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450792448 00000100:00100000:2.0:1762166988.607687:0:6495:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450792704 00000100:00100000:2.0:1762166988.607691:0:6495:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450792704 00000100:00100000:2.0:1762166988.607725:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 31009 00000100:00100000:2.0:1762166988.607734:0:6495:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7bb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1dd12c0b-744c-4d89-8dac-079bf92f5ace+7:63373:x1847765450792448:12345-192.168.204.38@tcp:101:cat.0 00010000:00010000:2.0:1762166988.607750:0:6495:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166988.607765:0:6495:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355b400/0x2f180c4effbad9ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eadd7 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166988.607855:0:6495:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355aa00/0x2f180c4effbad9b5 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x54:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166988.607867:0:6495:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355aa00/0x2f180c4effbad9b5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 00010000:00010000:2.0:1762166988.607876:0:6495:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355aa00/0x2f180c4effbad9b5 lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 00000004:00200000:2.0:1762166988.607889:0:6495:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x54:0x0]: returning size 0 00000100:00100000:0.0:1762166988.607975:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 31010 00010000:00010000:2.0:1762166988.607981:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355b400/0x2f180c4effbad9ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eadd7 expref: 10 pid: 6495 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166988.607988:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7bb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+29:63371:x1847765450792704:12345-192.168.204.38@tcp:101:multiop.0 00010000:00010000:2.0:1762166988.608001:0:6495:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355aa00/0x2f180c4effbad9b5 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eadd7 expref: 9 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166988.608009:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x54:0x0].0x0 (ffff945cc7df9e00) 00010000:00010000:0.0:1762166988.608009:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1762166988.608015:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1762166988.608018:0:6495:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945cc355aa00, rc 0) 00010000:00010000:0.0:1762166988.608020:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde600/0x2f180c4effbad9c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eadde expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166988.608058:0:6495:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7bb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1dd12c0b-744c-4d89-8dac-079bf92f5ace+9:63373:x1847765450792448:12345-192.168.204.38@tcp:101:cat.0 Request processed in 324us (927us total) trans 8589935372 rc 0/0 00000100:00100000:2.0:1762166988.608065:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 31009 00010000:00010000:0.0:1762166988.608069:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad9ca lrc: 3/0,1 mode: --/CW res: [0x200000405:0x54:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166988.608082:0:7432:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cada00/0x2f180c4effbad930 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eadad expref: 30 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166988.608093:0:7432:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa9a00/0x2f180c4effbad961 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eadbb expref: 7 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166988.608101:0:7432:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde800/0x2f180c4effbad992 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eadc9 expref: 8 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166988.608108:0:7432:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdee00/0x2f180c4effbad9a0 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eadd0 expref: 7 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166988.608116:0:7432:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355aa00/0x2f180c4effbad9b5 lrc: 2/0,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eadd7 expref: 8 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166988.608123:0:7432:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad9ca lrc: 8/0,1 mode: --/CW res: [0x200000405:0x54:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166988.608155:0:7432:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355aa00/0x2f180c4effbad9b5 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eadd7 expref: 8 pid: 6495 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166988.608168:0:7432:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355aa00/0x2f180c4effbad9b5 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eadd7 expref: 8 pid: 6495 timeout: 707 lvb_type: 0 00000100:00100000:0.0:1762166988.608181:0:7432:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc76aca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7432:1847765449810688:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166988.608267:0:7432:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdee00/0x2f180c4effbad9a0 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eadd0 expref: 7 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166988.608278:0:7432:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdee00/0x2f180c4effbad9a0 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eadd0 expref: 7 pid: 7432 timeout: 707 lvb_type: 0 00000100:00100000:0.0:1762166988.608293:0:7432:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc76ac380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7432:1847765449810816:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166988.608341:0:7432:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde800/0x2f180c4effbad992 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eadc9 expref: 8 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166988.608350:0:7432:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde800/0x2f180c4effbad992 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eadc9 expref: 8 pid: 7432 timeout: 707 lvb_type: 0 00000100:00100000:0.0:1762166988.608360:0:7432:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7432:1847765449810944:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166988.608401:0:7432:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa9a00/0x2f180c4effbad961 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eadbb expref: 7 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166988.608412:0:7432:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa9a00/0x2f180c4effbad961 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eadbb expref: 7 pid: 7432 timeout: 707 lvb_type: 0 00000100:00100000:0.0:1762166988.608423:0:7432:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945cf783df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7432:1847765449811072:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166988.608472:0:7432:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cada00/0x2f180c4effbad930 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eadad expref: 30 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166988.608501:0:7432:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cada00/0x2f180c4effbad930 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eadad expref: 30 pid: 7432 timeout: 707 lvb_type: 0 00000100:00100000:0.0:1762166988.608512:0:7432:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc8122300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7432:1847765449811200:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166988.608543:0:7432:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cee01a840 going to sleep for 11 seconds 00000100:00100000:2.0:1762166988.609298:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166988.609357:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166988.609389:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450792832 00000100:00100000:1.0:1762166988.609398:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450792832 00010000:00010000:1.0:1762166988.609426:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdee00/0x2f180c4effbad9a0 lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eadd0 expref: 8 pid: 7432 timeout: 707 lvb_type: 0 00000100:00100000:3.0:1762166988.609449:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450793088 00000100:00100000:3.0:1762166988.609467:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450793088 00000100:00100000:1.0:1762166988.609474:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9871 00000100:00100000:1.0:1762166988.609527:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc59d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fa222f93-414e-47af-b74d-7427e42503ec+9:2418:x1847765450792832:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166988.609539:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166988.609548:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdee00/0x2f180c4effbad9a0 lrc: 5/0,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eadd0 expref: 9 pid: 7432 timeout: 707 lvb_type: 0 00010000:00010000:1.0:1762166988.609559:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdee00/0x2f180c4effbad9a0 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eadd0 expref: 9 pid: 7432 timeout: 707 lvb_type: 0 00000100:00100000:3.0:1762166988.609580:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 12029 00010000:00010000:1.0:1762166988.609580:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x54:0x0].0x0 (ffff945cc7df9e00) 00010000:00010000:1.0:1762166988.609592:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad9ca lrc: 3/0,1 mode: --/CW res: [0x200000405:0x54:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00000100:00100000:3.0:1762166988.609602:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc495ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:fa222f93-414e-47af-b74d-7427e42503ec+9:63367:x1847765450793088:12345-192.168.204.38@tcp:35:lfs.0 00010000:00010000:1.0:1762166988.609607:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad9ca lrc: 3/0,1 mode: --/CW res: [0x200000405:0x54:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166988.609615:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1762166988.609654:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc59d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fa222f93-414e-47af-b74d-7427e42503ec+9:2418:x1847765450792832:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 129us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166988.609664:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9871 00000100:00100000:3.0:1762166988.609992:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc495ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:fa222f93-414e-47af-b74d-7427e42503ec+9:63367:x1847765450793088:12345-192.168.204.38@tcp:35:lfs.0 Request processed in 394us (632us total) trans 8589935373 rc 0/0 00000100:00100000:3.0:1762166988.610004:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 12029 00000100:00100000:0.0:1762166988.611729:0:7432:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc76aca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7432:1847765449810688:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166988.611741:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:0.0:1762166988.611753:0:7432:0:(ldlm_lockd.c:740:ldlm_handle_ast_error()) ### client (nid 192.168.204.38@tcp) returned -22 from blocking AST (req@00000000adc4d622 x1847765449810816) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdee00/0x2f180c4effbad9a0 lrc: 1/0,0 mode: --/PR res: [0x200000405:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eadd0 expref: 8 pid: 7432 timeout: 707 lvb_type: 0 00010000:00010000:0.0:1762166988.611773:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdee00/0x2f180c4effbad9a0 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eadd0 expref: 8 pid: 7432 timeout: 707 lvb_type: 0 00000100:00100000:0.0:1762166988.611789:0:7432:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc76ac380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7432:1847765449810816:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166988.611792:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166988.611811:0:7432:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7432:1847765449810944:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166988.611826:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166988.611829:0:7432:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945cf783df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7432:1847765449811072:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166988.611846:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450793344 00000100:00100000:0.0:1762166988.611846:0:7432:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc8122300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7432:1847765449811200:192.168.204.38@tcp:104: 00000100:00100000:1.0:1762166988.611855:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450793344 00000100:00100000:3.0:1762166988.611860:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:1.0:1762166988.611885:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa9a00/0x2f180c4effbad961 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eadbb expref: 8 pid: 7432 timeout: 707 lvb_type: 0 00010000:00010000:0.0:1762166988.611886:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x54:0x0].0x0 (ffff945cc7df9e00) 00010000:00010000:0.0:1762166988.611895:0:7432:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad9ca lrc: 3/0,1 mode: --/CW res: [0x200000405:0x54:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166988.611905:0:7432:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad9ca lrc: 3/0,1 mode: --/CW res: [0x200000405:0x54:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00000100:00100000:3.0:1762166988.611915:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00010000:00010000:0.0:1762166988.611919:0:7432:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad9ca lrc: 3/0,1 mode: --/CW res: [0x200000405:0x54:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000100:00100000:1.0:1762166988.611921:0:7421:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450793216 00000100:00100000:1.0:1762166988.611927:0:7421:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450793216 00010000:00010000:1.0:1762166988.611945:0:7421:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355aa00/0x2f180c4effbad9b5 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eadd7 expref: 9 pid: 6495 timeout: 707 lvb_type: 0 00000100:00100000:3.0:1762166988.611948:0:8398:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450793472 00000100:00100000:3.0:1762166988.611955:0:8398:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450793472 00000100:00100000:0.0:1762166988.611958:0:6479:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450793600 00000100:00100000:0.0:1762166988.611963:0:6479:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450793600 00000100:00100000:1.0:1762166988.611977:0:7421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9872 00010000:00010000:3.0:1762166988.611978:0:8398:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cada00/0x2f180c4effbad930 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eadad expref: 31 pid: 7432 timeout: 707 lvb_type: 0 00010000:00010000:0.0:1762166988.611983:0:6479:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde800/0x2f180c4effbad992 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eadc9 expref: 10 pid: 7432 timeout: 707 lvb_type: 0 00000100:00100000:1.0:1762166988.611994:0:7421:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7bb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fa222f93-414e-47af-b74d-7427e42503ec+8:2418:x1847765450793344:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1762166988.612010:0:7421:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1762166988.612011:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9873 00010000:00010000:1.0:1762166988.612022:0:7421:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa9a00/0x2f180c4effbad961 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eadbb expref: 8 pid: 7432 timeout: 707 lvb_type: 0 00000100:00100000:3.0:1762166988.612024:0:8398:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7bbb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1dd12c0b-744c-4d89-8dac-079bf92f5ace+10:2418:x1847765450793216:12345-192.168.204.38@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1762166988.612031:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9874 00010000:00010000:1.0:1762166988.612044:0:7421:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa9a00/0x2f180c4effbad961 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eadbb expref: 8 pid: 7432 timeout: 707 lvb_type: 0 00000100:00100000:0.0:1762166988.612047:0:6479:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cf9d1d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+31:2418:x1847765450793472:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1762166988.612051:0:8398:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1762166988.612065:0:8398:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355aa00/0x2f180c4effbad9b5 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eadd7 expref: 10 pid: 6495 timeout: 707 lvb_type: 0 00010000:00010000:0.0:1762166988.612065:0:6479:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1762166988.612077:0:7421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa9a00/0x2f180c4effbad961 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eadbb expref: 8 pid: 7432 timeout: 707 lvb_type: 0 00010000:00010000:0.0:1762166988.612078:0:6479:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cada00/0x2f180c4effbad930 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eadad expref: 31 pid: 7432 timeout: 707 lvb_type: 0 00010000:00010000:3.0:1762166988.612085:0:8398:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355aa00/0x2f180c4effbad9b5 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eadd7 expref: 10 pid: 6495 timeout: 707 lvb_type: 0 00010000:00010000:0.0:1762166988.612109:0:6479:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cada00/0x2f180c4effbad930 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eadad expref: 31 pid: 7432 timeout: 707 lvb_type: 0 00010000:00010000:1.0:1762166988.612127:0:7421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x54:0x0].0x0 (ffff945cc7df9e00) 00010000:00010000:3.0:1762166988.612138:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cc355aa00/0x2f180c4effbad9b5 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eadd7 expref: 10 pid: 6495 timeout: 707 lvb_type: 0 00010000:00010000:1.0:1762166988.612140:0:7421:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad9ca lrc: 3/0,1 mode: --/CW res: [0x200000405:0x54:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000100:00100000:2.0:1762166988.612144:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9875 00010000:00010000:1.0:1762166988.612159:0:7421:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad9ca lrc: 3/0,1 mode: --/CW res: [0x200000405:0x54:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166988.612167:0:7421:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166988.612173:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1dd12c0b-744c-4d89-8dac-079bf92f5ace+10:2418:x1847765450793600:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1762166988.612180:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945cf3cada00/0x2f180c4effbad930 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eadad expref: 31 pid: 7432 timeout: 707 lvb_type: 0 00010000:00010000:2.0:1762166988.612196:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1762166988.612198:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x54:0x0].0x0 (ffff945cc7df9e00) 00010000:00010000:0.0:1762166988.612205:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad9ca lrc: 3/0,1 mode: --/CW res: [0x200000405:0x54:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166988.612210:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde800/0x2f180c4effbad992 lrc: 4/0,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eadc9 expref: 10 pid: 7432 timeout: 707 lvb_type: 0 00000100:00100000:1.0:1762166988.612218:0:7421:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7bb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fa222f93-414e-47af-b74d-7427e42503ec+7:2418:x1847765450793344:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 224us (473us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166988.612241:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad9ca lrc: 3/0,1 mode: --/CW res: [0x200000405:0x54:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000100:00100000:1.0:1762166988.612250:0:7421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9872 00010000:00010000:0.0:1762166988.612259:0:6479:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1762166988.612261:0:8398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x54:0x0].0x0 (ffff945cc7df9e00) 00010000:00010000:3.0:1762166988.612268:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad9ca lrc: 3/0,1 mode: --/CW res: [0x200000405:0x54:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.612276:0:8398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad9ca lrc: 3/0,1 mode: --/CW res: [0x200000405:0x54:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:3.0:1762166988.612283:0:8398:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166988.612286:0:6479:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cf9d1d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1e11365-ba0b-405b-99c9-a704373217f2+30:2418:x1847765450793472:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 242us (460us total) trans 0 rc 0/0 00010000:00010000:2.0:1762166988.612298:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde800/0x2f180c4effbad992 lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eadc9 expref: 9 pid: 7432 timeout: 707 lvb_type: 0 00000100:00100000:0.0:1762166988.612303:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9874 00000100:00100000:3.0:1762166988.612321:0:8398:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7bbb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1dd12c0b-744c-4d89-8dac-079bf92f5ace+9:2418:x1847765450793216:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 291us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1762166988.612333:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9873 00010000:00010000:2.0:1762166988.612349:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde800/0x2f180c4effbad992 lrc: 0/0,0 mode: --/PR res: [0x200000405:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eadc9 expref: 8 pid: 7432 timeout: 707 lvb_type: 0 00010000:00010000:2.0:1762166988.612379:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x54:0x0].0x0 (ffff945cc7df9e00) 00000100:00100000:1.0:1762166988.612382:0:6494:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450793728 00010000:00010000:2.0:1762166988.612385:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad9ca lrc: 3/0,1 mode: --/CW res: [0x200000405:0x54:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000100:00100000:1.0:1762166988.612389:0:6494:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450793728 00010000:00010000:2.0:1762166988.612402:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad9ca lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x54:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166988.612411:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad9ca lrc: 4/0,1 mode: CW/CW res: [0x200000405:0x54:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7432 initiator: MDT0 00000100:00100000:1.0:1762166988.612424:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 31011 00000100:00100000:1.0:1762166988.612433:0:6494:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1dd12c0b-744c-4d89-8dac-079bf92f5ace+8:63373:x1847765450793728:12345-192.168.204.38@tcp:101:cat.0 00010000:00010000:2.0:1762166988.612446:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1762166988.612447:0:6494:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166988.612463:0:6494:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa8000/0x2f180c4effbad9d1 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x54:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eade5 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1762166988.612552:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1dd12c0b-744c-4d89-8dac-079bf92f5ace+9:2418:x1847765450793600:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 391us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166988.612563:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9875 00010000:00010000:1.0:1762166988.612570:0:6494:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa8000/0x2f180c4effbad9d1 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x54:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eade5 expref: 9 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166988.612588:0:7432:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad9ca lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x54:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166988.612592:0:6494:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa8000/0x2f180c4effbad9d1 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x54:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eade5 expref: 8 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166988.612604:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad9ca lrc: 3/0,1 mode: CW/CW res: [0x200000405:0x54:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:1.0:1762166988.612617:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x54:0x0].0x0 (ffff945cc7df9e00) 00010000:00010000:1.0:1762166988.612622:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000004:00200000:0.0:1762166988.612623:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x54:0x0]: returning size 0 00010000:00010000:1.0:1762166988.612625:0:6494:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa8000, rc 0) 00000100:00100000:1.0:1762166988.612684:0:6494:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1dd12c0b-744c-4d89-8dac-079bf92f5ace+8:63373:x1847765450793728:12345-192.168.204.38@tcp:101:cat.0 Request processed in 253us (774us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166988.612692:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 31011 00010000:00010000:0.0:1762166988.612756:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde600/0x2f180c4effbad9c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eadde expref: 31 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166988.612770:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdfe00/0x2f180c4effbad9ca lrc: 3/0,0 mode: CW/CW res: [0x200000405:0x54:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eadde expref: 30 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166988.612778:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x54:0x0].0x0 (ffff945cc7df9e00) 00010000:00010000:0.0:1762166988.612782:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1762166988.612785:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdfe00, rc 0) 00000100:00100000:0.0:1762166988.612816:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7bb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+30:63371:x1847765450792704:12345-192.168.204.38@tcp:101:multiop.0 Request processed in 4831us (5230us total) trans 8589935374 rc 0/0 00000100:00100000:0.0:1762166988.612826:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 31010 00000100:00100000:1.0:1762166988.617148:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166988.617226:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450793856 00000100:00100000:3.0:1762166988.617234:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450793856 00000100:00080000:2.0:1762166988.617282:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1762166988.617295:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 19529 00000100:00100000:3.0:1762166988.617306:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7dec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1dd12c0b-744c-4d89-8dac-079bf92f5ace+6:63373:x1847765450793856:12345-192.168.204.38@tcp:101:cat.0 00010000:00010000:3.0:1762166988.617322:0:9168:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1762166988.617337:0:9168:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62e00/0x2f180c4effbad9df lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eadec expref: -99 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166988.617370:0:9168:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62800/0x2f180c4effbad80a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eacaa expref: 17 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166988.617379:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166988.617381:0:9168:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1762166988.617385:0:9168:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62e00/0x2f180c4effbad9df lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eadec expref: 7 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166988.617415:0:9168:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62800/0x2f180c4effbad80a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eacaa expref: 17 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1762166988.617427:0:9168:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62800/0x2f180c4effbad80a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eacaa expref: 17 pid: 9168 timeout: 707 lvb_type: 0 00000100:00100000:3.0:1762166988.617442:0:9168:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc406df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9168:1847765449811328:192.168.204.38@tcp:104: 00000100:00100000:3.0:1762166988.617554:0:9168:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cc6b56f00 going to sleep for 11 seconds 00000100:00100000:1.0:1762166988.619956:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166988.619974:0:9168:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc406df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9168:1847765449811328:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166988.620003:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450793984 00000100:00100000:0.0:1762166988.620014:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450793984 00010000:00010000:2.0:1762166988.620019:0:9168:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62e00/0x2f180c4effbad9df lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eadec expref: 7 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1762166988.620044:0:9168:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4b62e00, rc 0) 00010000:00010000:0.0:1762166988.620049:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62800/0x2f180c4effbad80a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eacaa expref: 18 pid: 9168 timeout: 707 lvb_type: 0 00000100:00100000:0.0:1762166988.620097:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9876 00000100:00100000:0.0:1762166988.620110:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7dec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+18:2419:x1847765450793984:12345-192.168.204.38@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1762166988.620119:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7dec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1dd12c0b-744c-4d89-8dac-079bf92f5ace+7:63373:x1847765450793856:12345-192.168.204.38@tcp:101:cat.0 Request processed in 2813us (2980us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166988.620124:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1762166988.620131:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 19529 00010000:00010000:0.0:1762166988.620155:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62800/0x2f180c4effbad80a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eacaa expref: 18 pid: 9168 timeout: 707 lvb_type: 0 00010000:00010000:0.0:1762166988.620175:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62800/0x2f180c4effbad80a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eacaa expref: 18 pid: 9168 timeout: 707 lvb_type: 0 00010000:00010000:0.0:1762166988.620198:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62800/0x2f180c4effbad80a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eacaa expref: 18 pid: 9168 timeout: 707 lvb_type: 0 00010000:00010000:0.0:1762166988.620212:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166988.620214:0:6481:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1762166988.620222:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62e00/0x2f180c4effbad9df lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eadec expref: 6 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166988.620232:0:6481:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62e00/0x2f180c4effbad9df lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eadec expref: 6 pid: 9168 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166988.620268:0:6481:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff945bc4b62e00/0x2f180c4effbad9df lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eadec expref: 6 pid: 9168 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1762166988.620282:0:6481:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc8122300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6481:1847765449811456:192.168.204.38@tcp:105: 00000100:00100000:0.0:1762166988.620355:0:6481:0:(client.c:2680:ptlrpc_set_wait()) set ffff945cee01a240 going to sleep for 11 seconds 00000100:00100000:0.0:1762166988.622238:0:6481:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc8122300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6481:1847765449811456:192.168.204.38@tcp:105: 00010000:00010000:0.0:1762166988.622256:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1762166988.622335:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7dec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+17:2419:x1847765450793984:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 2229us (2382us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166988.622347:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9876 00000100:00100000:1.0:1762166988.622611:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166988.622654:0:14623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450794112 00000100:00100000:0.0:1762166988.622660:0:14623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450794112 00002000:00100000:0.0:1762166988.622703:0:14623:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x75:0x0] (0->4095) req@ffff945bc7defb80 x1847765450794112/t0(0) o3->1dd12c0b-744c-4d89-8dac-079bf92f5ace@192.168.204.38@tcp:19/0 lens 488/0 e 0 to 0 dl 1762166999 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166988.622713:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc7defb80 with x1847765450794112 ext(0->4095) 00002000:00010000:0.0:1762166988.622718:0:14623:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc7defb80 00000100:00100000:0.0:1762166988.622750:0:14623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 2840 00000100:00100000:0.0:1762166988.622761:0:14623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7defb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1dd12c0b-744c-4d89-8dac-079bf92f5ace+7:2417:x1847765450794112:12345-192.168.204.38@tcp:3:cat.0 00000100:00100000:0.0:1762166988.622881:0:14623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7defb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1dd12c0b-744c-4d89-8dac-079bf92f5ace+7:2417:x1847765450794112:12345-192.168.204.38@tcp:3:cat.0 Request processed in 124us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1762166988.622889:0:14623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 2840 00002000:00100000:0.0:1762166988.622895:0:14623:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x75:0x0] (0->4095) req@ffff945bc7defb80 x1847765450794112/t0(0) o3->1dd12c0b-744c-4d89-8dac-079bf92f5ace@192.168.204.38@tcp:19/0 lens 488/440 e 0 to 0 dl 1762166999 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1762166988.622902:0:14623:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff945bc7defb80 with x1847765450794112 ext(0->4095) 00002000:00010000:0.0:1762166988.622904:0:14623:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff945bc7defb80 00000100:00100000:2.0:1762166988.624361:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166988.624387:0:6497:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450794368 00000100:00100000:3.0:1762166988.624395:0:6497:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450794368 00000100:00100000:3.0:1762166988.624446:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 12030 00000100:00100000:3.0:1762166988.624456:0:6497:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc495b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1dd12c0b-744c-4d89-8dac-079bf92f5ace+8:63373:x1847765450794368:12345-192.168.204.38@tcp:35:cat.0 00000100:00100000:3.0:1762166988.624851:0:6497:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc495b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1dd12c0b-744c-4d89-8dac-079bf92f5ace+9:63373:x1847765450794368:12345-192.168.204.38@tcp:35:cat.0 Request processed in 396us (493us total) trans 8589935375 rc 0/0 00000100:00100000:3.0:1762166988.624860:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 12030 00000100:00100000:3.0:1762166988.624907:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166988.625043:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450794624 00000100:00100000:0.0:1762166988.625048:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450794624 00000100:00100000:0.0:1762166988.625087:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 31012 00000100:00100000:0.0:1762166988.625096:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1dd12c0b-744c-4d89-8dac-079bf92f5ace+9:63377:x1847765450794624:12345-192.168.204.38@tcp:101:multiop.0 00010000:00010000:0.0:1762166988.625107:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166988.625125:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde600/0x2f180c4effbad9e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eadf3 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166988.625181:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdee00/0x2f180c4effbad9ed lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166988.625195:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdee00/0x2f180c4effbad9ed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166988.625205:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdee00/0x2f180c4effbad9ed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166988.625221:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde200/0x2f180c4effbad9f4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166988.625228:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde200/0x2f180c4effbad9f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166988.625235:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde200/0x2f180c4effbad9f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166988.625324:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf200/0x2f180c4effbad9fb lrc: 3/1,0 mode: --/PR res: [0x200000405:0x54:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166988.625334:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf200/0x2f180c4effbad9fb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166988.625342:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf200/0x2f180c4effbad9fb lrc: 3/1,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000004:00200000:0.0:1762166988.625352:0:7432:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000405:0x54:0x0]: returning size 0 00010000:00010000:0.0:1762166988.625415:0:7432:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdee00/0x2f180c4effbad9ed lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166988.625424:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdee00/0x2f180c4effbad9ed lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166988.625430:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdee00/0x2f180c4effbad9ed lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166988.625438:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdee00/0x2f180c4effbad9ed lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166988.625444:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bdee00 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166988.625448:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdee00/0x2f180c4effbad9ed lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166988.625456:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdee00/0x2f180c4effbad9ed lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166988.625469:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff945cd0738700) 00010000:00010000:0.0:1762166988.625473:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166988.625535:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdee00/0x2f180c4effbad9ed lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166988.625547:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdee00/0x2f180c4effbad9ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166988.625557:0:7432:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde200/0x2f180c4effbad9f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166988.625563:0:7432:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde200/0x2f180c4effbad9f4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166988.625568:0:7432:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde200/0x2f180c4effbad9f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166988.625574:0:7432:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff945bc4bde200 already unused, calling callback (ffffffffc18e2310) 00010000:00010000:0.0:1762166988.625578:0:7432:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde200/0x2f180c4effbad9f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166988.625584:0:7432:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde200/0x2f180c4effbad9f4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166988.625591:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x64c18fe5 (ffff945cd1ddd700) 00010000:00010000:0.0:1762166988.625594:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1762166988.625603:0:7432:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde200/0x2f180c4effbad9f4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166988.625609:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde200/0x2f180c4effbad9f4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x64c18fe5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166988.625645:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde600/0x2f180c4effbad9e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eadf3 expref: 12 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166988.625657:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf200/0x2f180c4effbad9fb lrc: 3/0,0 mode: PR/PR res: [0x200000405:0x54:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eadf3 expref: 11 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166988.625683:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x54:0x0].0x0 (ffff945cc7df9e00) 00010000:00010000:0.0:1762166988.625686:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1762166988.625689:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bdf200, rc 0) 00000100:00100000:0.0:1762166988.625731:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1dd12c0b-744c-4d89-8dac-079bf92f5ace+11:63377:x1847765450794624:12345-192.168.204.38@tcp:101:multiop.0 Request processed in 637us (823us total) trans 8589935376 rc 0/0 00000100:00100000:0.0:1762166988.625739:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 31012 00010000:00010000:0.0:1762166988.626583:0:6482:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1762166988.677819:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166988.677881:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450794880 00000100:00100000:0.0:1762166988.677891:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450794880 00000100:00100000:0.0:1762166988.677940:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 31013 00000100:00100000:0.0:1762166988.677947:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7deea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1dd12c0b-744c-4d89-8dac-079bf92f5ace+11:63377:x1847765450794880:12345-192.168.204.38@tcp:101:multiop.0 00010000:00010000:0.0:1762166988.677972:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1762166988.677975:0:7432:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:0.0:1762166988.678001:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdf200/0x2f180c4effbad9fb lrc: 0/0,0 mode: --/PR res: [0x200000405:0x54:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eadf3 expref: 11 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166988.678019:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa8000/0x2f180c4effbad9d1 lrc: 0/0,0 mode: --/CR res: [0x200000405:0x54:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eade5 expref: 10 pid: 6494 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166988.678028:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x54:0x0].0x0 (ffff945cc7df9e00) 00010000:00010000:0.0:1762166988.678032:0:7432:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166988.678048:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde600/0x2f180c4effbada09 lrc: 2/0,0 mode: --/EX res: [0x200000405:0x54:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eadfa expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166988.678094:0:7432:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde200/0x2f180c4effbada10 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x54:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166988.678109:0:7432:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdec00/0x2f180c4effbad81f lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x54:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eacb1 expref: 29 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166988.678115:0:7432:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b63e00/0x2f180c4effbad96f lrc: 2/0,0 mode: CR/CR res: [0x200000405:0x54:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eadc2 expref: 29 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166988.678122:0:7432:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde200/0x2f180c4effbada10 lrc: 5/0,1 mode: --/EX res: [0x200000405:0x54:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7432 initiator: MDT0 00010000:00010000:0.0:1762166988.678149:0:7432:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b63e00/0x2f180c4effbad96f lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x54:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eadc2 expref: 29 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166988.678161:0:7432:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b63e00/0x2f180c4effbad96f lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x54:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eadc2 expref: 29 pid: 7432 timeout: 707 lvb_type: 0 00000100:00100000:0.0:1762166988.678187:0:7432:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc8122300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7432:1847765449811584:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166988.678274:0:7432:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdec00/0x2f180c4effbad81f lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x54:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eacb1 expref: 29 pid: 6496 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166988.678281:0:7432:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdec00/0x2f180c4effbad81f lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x54:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eacb1 expref: 29 pid: 6496 timeout: 707 lvb_type: 0 00000100:00100000:0.0:1762166988.678289:0:7432:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc8123100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7432:1847765449811712:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166988.678307:0:7432:0:(client.c:2680:ptlrpc_set_wait()) set ffff945bc3731000 going to sleep for 11 seconds 00000100:00100000:2.0:1762166988.679451:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:0.0:1762166988.679460:0:7432:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc8122300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7432:1847765449811584:192.168.204.38@tcp:104: 00000100:00100000:0.0:1762166988.679505:0:7432:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc8123100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7432:1847765449811712:192.168.204.38@tcp:104: 00010000:00010000:0.0:1762166988.679533:0:7432:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde200/0x2f180c4effbada10 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x54:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000100:00100000:1.0:1762166988.679550:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166988.679561:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450795136 00000100:00100000:3.0:1762166988.679568:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450795136 00000100:00100000:2.0:1762166988.679583:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450795264 00000100:00100000:2.0:1762166988.679589:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450795264 00010000:00010000:2.0:1762166988.679611:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdec00/0x2f180c4effbad81f lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x54:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eacb1 expref: 31 pid: 6496 timeout: 707 lvb_type: 0 00000100:00100000:3.0:1762166988.679621:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 12031 00000100:00100000:3.0:1762166988.679632:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc495b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+31:44353:x1847765450795136:12345-192.168.204.38@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1762166988.679650:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9877 00000100:00100000:2.0:1762166988.679660:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7dee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+31:2418:x1847765450795264:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166988.679682:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166988.679688:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdec00/0x2f180c4effbad81f lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x54:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eacb1 expref: 31 pid: 6496 timeout: 707 lvb_type: 0 00010000:00010000:2.0:1762166988.679698:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdec00/0x2f180c4effbad81f lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x54:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eacb1 expref: 31 pid: 6496 timeout: 707 lvb_type: 0 00010000:00010000:2.0:1762166988.679712:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bdec00/0x2f180c4effbad81f lrc: 0/0,0 mode: --/CR res: [0x200000405:0x54:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eacb1 expref: 31 pid: 6496 timeout: 707 lvb_type: 0 00010000:00010000:2.0:1762166988.679724:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x54:0x0].0x0 (ffff945cc7df9e00) 00010000:00010000:2.0:1762166988.679728:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde200/0x2f180c4effbada10 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x54:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166988.679735:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde200/0x2f180c4effbada10 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x54:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166988.679741:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1762166988.679774:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7dee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+31:2418:x1847765450795264:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 116us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1762166988.679781:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9877 00000100:00100000:3.0:1762166988.679843:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc495b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e1e11365-ba0b-405b-99c9-a704373217f2+30:44353:x1847765450795136:12345-192.168.204.38@tcp:35:ldlm_bl.0 Request processed in 212us (392us total) trans 8589935377 rc 0/0 00000100:00100000:3.0:1762166988.679854:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 12031 00000100:00100000:1.0:1762166988.680592:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:2.0:1762166988.680625:0:6481:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450795392 00000100:00100000:2.0:1762166988.680631:0:6481:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450795392 00010000:00010000:2.0:1762166988.680649:0:6481:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b63e00/0x2f180c4effbad96f lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x54:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eadc2 expref: 30 pid: 7432 timeout: 707 lvb_type: 0 00000100:00100000:2.0:1762166988.680690:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 9878 00000100:00100000:2.0:1762166988.680698:0:6481:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc7def480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+30:2419:x1847765450795392:12345-192.168.204.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1762166988.680708:0:6481:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1762166988.680713:0:6481:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b63e00/0x2f180c4effbad96f lrc: 4/0,0 mode: CR/CR res: [0x200000405:0x54:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eadc2 expref: 30 pid: 7432 timeout: 707 lvb_type: 0 00010000:00010000:2.0:1762166988.680729:0:6481:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b63e00/0x2f180c4effbad96f lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x54:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eadc2 expref: 30 pid: 7432 timeout: 707 lvb_type: 0 00010000:00010000:2.0:1762166988.680743:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4b63e00/0x2f180c4effbad96f lrc: 0/0,0 mode: --/CR res: [0x200000405:0x54:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eadc2 expref: 30 pid: 7432 timeout: 707 lvb_type: 0 00010000:00010000:2.0:1762166988.680754:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x54:0x0].0x0 (ffff945cc7df9e00) 00010000:00010000:2.0:1762166988.680758:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde200/0x2f180c4effbada10 lrc: 3/0,1 mode: --/EX res: [0x200000405:0x54:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166988.680766:0:6481:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde200/0x2f180c4effbada10 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x54:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166988.680773:0:6481:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde200/0x2f180c4effbada10 lrc: 4/0,1 mode: EX/EX res: [0x200000405:0x54:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7432 initiator: MDT0 00010000:00010000:2.0:1762166988.680797:0:6481:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1762166988.680821:0:7432:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde200/0x2f180c4effbada10 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x54:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000100:00100000:2.0:1762166988.680830:0:6481:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7def480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1e11365-ba0b-405b-99c9-a704373217f2+29:2419:x1847765450795392:12345-192.168.204.38@tcp:103:ldlm_bl.0 Request processed in 131us (236us total) trans 0 rc 0/0 00010000:00010000:0.0:1762166988.680837:0:7432:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde200/0x2f180c4effbada10 lrc: 3/0,1 mode: EX/EX res: [0x200000405:0x54:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7432 initiator: MDT0 00000100:00100000:2.0:1762166988.680841:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 9878 00000004:02000000:0.0:1762166988.680906:0:7432:0:(lod_object.c:7768:lod_primary_pick()) *** cfs_fail_loc=1a03, val=0*** 00000004:00080000:0.0:1762166988.683162:0:7432:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x75:0x0], index 0: 0 00000004:00080000:0.0:1762166988.683170:0:7432:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x76:0x0], index 0: 0 00000004:00080000:0.0:1762166988.683175:0:7432:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x77:0x0], index 1: 0 00000004:00080000:0.0:1762166988.683179:0:7432:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x78:0x0], index 1: 0 00000004:00080000:0.0:1762166988.683183:0:7432:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x77:0x0], index 0: 0 00000040:00080000:0.0:1762166988.683265:0:7432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].32, 88 off10672 00000004:00080000:0.0:1762166988.683273:0:7432:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 607831795098ns, next at 521692814678ns, rc = 0 00000040:00080000:0.0:1762166988.683307:0:7432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].31, 88 off10560 00000004:00080000:0.0:1762166988.683314:0:7432:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 607831835470ns, next at 521692798423ns, rc = 0 00000040:00080000:0.0:1762166988.683338:0:7432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].32, 88 off10648 00000004:00080000:0.0:1762166988.683343:0:7432:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 607831865635ns, next at 521692798423ns, rc = 0 00000004:00080000:1.0:1762166988.683350:0:32233:0:(osp_sync.c:925:osp_sync_new_err_job()) lustre-OST0001-osc-MDT0000 repeating 2 operation object 0x2c0000401:71 00000040:00080000:0.0:1762166988.683356:0:7432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].33, 88 off10760 00000004:00080000:0.0:1762166988.683361:0:7432:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 607831883332ns, next at 521692814678ns, rc = 0 00000040:00080000:0.0:1762166988.683374:0:7432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].34, 88 off10848 00000004:00080000:0.0:1762166988.683379:0:7432:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 607831900778ns, next at 521692814678ns, rc = 0 00000040:00080000:0.0:1762166988.683389:0:7432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].33, 88 off10736 00000004:00080000:0.0:1762166988.683394:0:7432:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 607831915740ns, next at 521692798423ns, rc = 0 00000040:00080000:0.0:1762166988.683409:0:7432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].34, 88 off10824 00000004:00080000:1.0:1762166988.683411:0:32233:0:(osp_sync.c:925:osp_sync_new_err_job()) lustre-OST0001-osc-MDT0000 repeating 2 operation object 0x2c0000401:71 00000004:00080000:0.0:1762166988.683415:0:7432:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 607831936472ns, next at 521692798423ns, rc = 0 00000100:00100000:2.0:1762166988.683436:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7def100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765449811968:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762166988.683438:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7ded500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765449811840:0@lo:2:osp-syn-1-0.0 00000040:00080000:0.0:1762166988.683440:0:7432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].35, 88 off10936 00000004:00080000:0.0:1762166988.683451:0:7432:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 607831972768ns, next at 521692814678ns, rc = 0 00000100:00100000:3.0:1762166988.683532:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166988.683574:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166988.683617:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449811840 00000100:00100000:3.0:1762166988.683624:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449811840 00000100:00100000:0.0:1762166988.683629:0:8382:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449811968 00000100:00100000:0.0:1762166988.683635:0:8382:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449811968 00000100:00100000:0.0:1762166988.683687:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19530 00000100:00100000:3.0:1762166988.683696:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19531 00000100:00100000:0.0:1762166988.683699:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc8123100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3634:x1847765449811968:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762166988.683709:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3633:x1847765449811840:12345-0@lo:2:osp-syn-1-0.0 00000100:00080000:1.0:1762166988.683762:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1762166988.683847:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc8123100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3634:x1847765449811968:12345-0@lo:2:osp-syn-1-0.0 Request processed in 150us (271us total) trans 0 rc -22/-22 00000100:00100000:3.0:1762166988.683859:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3633:x1847765449811840:12345-0@lo:2:osp-syn-1-0.0 Request processed in 151us (325us total) trans 0 rc -22/-22 00000100:00100000:0.0:1762166988.683859:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19530 00000100:00100000:3.0:1762166988.683870:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19531 00000004:00080000:1.0:1762166988.683875:0:3634:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc7def100, transno 0 00000004:00080000:1.0:1762166988.683883:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc7def100/1, rc -22, transno 0 00000100:00100000:1.0:1762166988.683900:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7def100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765449811968:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1762166988.683909:0:3633:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff945bc7ded500, transno 0 00000004:00080000:3.0:1762166988.683915:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc7ded500/1, rc -22, transno 0 00000100:00100000:3.0:1762166988.683922:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7ded500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765449811840:0@lo:2:osp-syn-1-0.0 00000001:00080000:3.0:1762166988.684582:0:32215:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935378 is committed 00000004:00080000:3.0:1762166988.684587:0:32215:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 29 committed 00000004:00080000:3.0:1762166988.684596:0:32215:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 28 committed 00000004:00080000:3.0:1762166988.684601:0:32215:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 27 committed 00000004:00080000:3.0:1762166988.684603:0:32215:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 28 committed 00000004:00080000:3.0:1762166988.684605:0:32215:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 27 committed 00000004:00080000:3.0:1762166988.684606:0:32215:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 26 committed 00000004:00080000:3.0:1762166988.684608:0:32215:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 25 committed 00000004:00080000:3.0:1762166988.684610:0:32215:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 26 committed 00000001:00080000:3.0:1762166988.684615:0:32215:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935377 is committed 00000001:00080000:3.0:1762166988.684623:0:32215:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589935373 is committed 00000020:00080000:3.0:1762166988.684628:0:32215:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 4294969064 batchid updated 00000020:00080000:3.0:1762166988.684645:0:32243:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969064 00000020:00080000:3.0:1762166988.684653:0:32243:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969064 00000100:00100000:3.0:1762166988.684659:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1762166988.684680:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7def100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765449812096:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762166988.684708:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166988.684730:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1762166988.684740:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc7ded500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765449812224:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1762166988.684753:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde200/0x2f180c4effbada10 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x54:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eadfa expref: 8 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1762166988.684768:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x54:0x0].0x0 (ffff945cc7df9e00) 00000100:00100000:3.0:1762166988.684770:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc576b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765449812352:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1762166988.684773:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000100:00100000:1.0:1762166988.684779:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1762166988.684796:0:7432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde600/0x2f180c4effbada09 lrc: 0/0,0 mode: --/EX res: [0x200000405:0x54:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eadfa expref: 8 pid: 7432 timeout: 0 lvb_type: 3 00000100:00100000:3.0:1762166988.684800:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449812096 00000100:00100000:3.0:1762166988.684804:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449812096 00010000:00010000:0.0:1762166988.684820:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4bde200/0x2f180c4effbada10 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x54:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eadfa expref: 7 pid: 7432 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1762166988.684827:0:3634:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc5768700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765449812480:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762166988.684828:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449812224 00000100:00100000:3.0:1762166988.684831:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449812224 00000100:00100000:3.0:1762166988.684850:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19532 00000100:00100000:3.0:1762166988.684859:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc406ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3636:x1847765449812096:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762166988.684860:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166988.684861:0:8382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19533 00000100:00100000:0.0:1762166988.684878:0:8382:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc576bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3635:x1847765449812224:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1762166988.684911:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x54:0x0].0x0 (ffff945cc7df9e00) 00010000:00010000:1.0:1762166988.684914:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1762166988.684917:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4bde200, rc 0) 00002000:00010000:3.0:1762166988.684922:0:9168:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1762166988.684925:0:9168:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb mtime from disk: 1762166987 -> 1762166987 00002000:00010000:3.0:1762166988.684928:0:9168:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb atime from disk: 1762166987 -> 1762166987 00002000:00010000:3.0:1762166988.684929:0:9168:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb ctime from disk: 1762166988 -> 1762166988 00002000:00010000:3.0:1762166988.684931:0:9168:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1762166988.684949:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc7deea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1dd12c0b-744c-4d89-8dac-079bf92f5ace+7:63377:x1847765450794880:12345-192.168.204.38@tcp:101:multiop.0 Request processed in 7001us (7136us total) trans 8589935378 rc 0/0 00000100:00100000:1.0:1762166988.684956:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 31013 00000100:00100000:3.0:1762166988.684965:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc406ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+11:3636:x1847765449812096:12345-0@lo:2:osp-syn-1-0.0 Request processed in 108us (255us total) trans 17179876799 rc 0/0 00000100:00100000:3.0:1762166988.684971:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19532 00000100:00100000:3.0:1762166988.684983:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449812480 00000100:00100000:3.0:1762166988.684986:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449812480 00000100:00100000:0.0:1762166988.684995:0:8382:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc576bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+11:3635:x1847765449812224:12345-0@lo:2:osp-syn-1-0.0 Request processed in 121us (218us total) trans 17179876800 rc 0/0 00000100:00100000:0.0:1762166988.685005:0:8382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19533 00000100:00100000:3.0:1762166988.685011:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19534 00000004:00080000:1.0:1762166988.685013:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc7ded500/2, rc 0, transno 17179876800 00000100:00100000:3.0:1762166988.685021:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+10:3634:x1847765449812480:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762166988.685021:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7ded500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765449812224:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762166988.685101:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+11:3634:x1847765449812480:12345-0@lo:2:osp-syn-1-0.0 Request processed in 81us (242us total) trans 17179876801 rc 0/0 00000100:00100000:3.0:1762166988.685107:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19534 00000100:00100000:1.0:1762166988.685118:0:3635:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc8122300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765449812608:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762166988.685130:0:3636:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc8123480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765449812736:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762166988.685159:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166988.685186:0:9168:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449812608 00000100:00100000:3.0:1762166988.685191:0:9168:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449812608 00000100:00100000:1.0:1762166988.685224:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1762166988.685231:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19535 00000100:00100000:3.0:1762166988.685240:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3635:x1847765449812608:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762166988.685244:0:35248:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449812736 00000100:00100000:0.0:1762166988.685250:0:35248:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449812736 00000004:00080000:1.0:1762166988.685259:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc7def100/2, rc 0, transno 17179876799 00000100:00100000:1.0:1762166988.685267:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc7def100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765449812096:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1762166988.685287:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19536 00000100:00100000:1.0:1762166988.685294:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166988.685299:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3636:x1847765449812736:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762166988.685318:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc8120e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765449812864:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762166988.685343:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1762166988.685363:0:3633:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1762166988.685370:0:3633:0:(client.c:1893:ptlrpc_send_new_req()) Sending RPC req@ffff945bc8121500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765449812992:0@lo:2:osp-syn-0-0.0 00000100:00080000:2.0:1762166988.685398:0:6490:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1762166988.685404:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1762166988.685417:0:35248:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+8:3636:x1847765449812736:12345-0@lo:2:osp-syn-0-0.0 Request processed in 120us (192us total) trans 21474843500 rc 0/0 00000100:00100000:0.0:1762166988.685426:0:35248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19536 00000100:00100000:1.0:1762166988.685442:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449812352 00000004:00080000:2.0:1762166988.685443:0:3636:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc8123480/2, rc 0, transno 21474843500 00000100:00100000:0.0:1762166988.685446:0:35248:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449812864 00000100:00100000:1.0:1762166988.685448:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449812352 00000100:00100000:2.0:1762166988.685452:0:3636:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc8123480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3636:1847765449812736:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762166988.685452:0:35248:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449812864 00000100:00100000:3.0:1762166988.685461:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3635:x1847765449812608:12345-0@lo:2:osp-syn-0-0.0 Request processed in 222us (301us total) trans 21474843499 rc 0/0 00000100:00100000:3.0:1762166988.685470:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19535 00000100:00100000:1.0:1762166988.685510:0:28874:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765449812992 00000100:00100000:1.0:1762166988.685515:0:28874:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765449812992 00000100:00100000:0.0:1762166988.685523:0:35248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19537 00000100:00100000:0.0:1762166988.685533:0:35248:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+11:3633:x1847765449812352:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1762166988.685534:0:9168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19538 00000100:00100000:3.0:1762166988.685548:0:9168:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3633:x1847765449812864:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1762166988.685555:0:28874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19539 00000100:00100000:1.0:1762166988.685565:0:28874:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc2d5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+8:3633:x1847765449812992:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1762166988.685628:0:35248:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3633:x1847765449812352:12345-0@lo:2:osp-syn-1-0.0 Request processed in 97us (334us total) trans 17179876802 rc 0/0 00000100:00100000:0.0:1762166988.685636:0:35248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19537 00000004:00080000:0.0:1762166988.685695:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc576b480/2, rc 0, transno 17179876802 00000100:00100000:1.0:1762166988.685697:0:28874:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+10:3633:x1847765449812992:12345-0@lo:2:osp-syn-0-0.0 Request processed in 133us (293us total) trans 21474843502 rc 0/0 00000100:00100000:0.0:1762166988.685703:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc576b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765449812352:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762166988.685710:0:28874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19539 00000004:00080000:0.0:1762166988.685720:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc8121500/2, rc 0, transno 21474843502 00000100:00100000:0.0:1762166988.685726:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc8121500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765449812992:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1762166988.685741:0:3633:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc8120e00/2, rc 0, transno 21474843501 00000100:00100000:0.0:1762166988.685745:0:3633:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc8120e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3633:1847765449812864:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1762166988.685751:0:3634:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc5768700/2, rc 0, transno 17179876801 00000004:00080000:1.0:1762166988.685757:0:3635:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff945bc8122300/2, rc 0, transno 21474843499 00000100:00100000:2.0:1762166988.685760:0:3634:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc5768700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3634:1847765449812480:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1762166988.685765:0:3635:0:(client.c:2379:ptlrpc_check_set()) Completed RPC req@ffff945bc8122300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3635:1847765449812608:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1762166988.685816:0:9168:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc2d5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3633:x1847765449812864:12345-0@lo:2:osp-syn-0-0.0 Request processed in 269us (470us total) trans 21474843501 rc 0/0 00000100:00100000:3.0:1762166988.685824:0:9168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19538 00000100:00100000:1.0:1762166988.688322:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:3.0:1762166988.688402:0:19593:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450795648 00000100:00100000:3.0:1762166988.688418:0:19593:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450795648 00000100:00100000:3.0:1762166988.688526:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 12032 00000100:00100000:3.0:1762166988.688551:0:19593:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945cff2fe050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1dd12c0b-744c-4d89-8dac-079bf92f5ace+7:63377:x1847765450795648:12345-192.168.204.38@tcp:35:multiop.0 00000100:00100000:3.0:1762166988.688825:0:19593:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945cff2fe050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:1dd12c0b-744c-4d89-8dac-079bf92f5ace+8:63377:x1847765450795648:12345-192.168.204.38@tcp:35:multiop.0 Request processed in 280us (506us total) trans 8589935379 rc 0/0 00000100:00100000:3.0:1762166988.688832:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 12032 00000100:00100000:0.0:1762166988.737877:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.38@tcp (source: 12345-192.168.204.38@tcp) 00000100:00100000:1.0:1762166988.737959:0:7432:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1847765450795776 00000100:00100000:1.0:1762166988.737971:0:7432:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1847765450795776 00000100:00100000:1.0:1762166988.738051:0:7432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.38@tcp, seq: 31014 00000100:00100000:1.0:1762166988.738063:0:7432:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff945bc8121c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+27:63371:x1847765450795776:12345-192.168.204.38@tcp:101:multiop.0 00010000:00010000:1.0:1762166988.738094:0:7432:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1762166988.738115:0:7432:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa8800/0x2f180c4effbada17 lrc: 2/0,0 mode: --/CR res: [0x200000405:0x54:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa56c5e86028eae01 expref: -99 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166988.738175:0:7432:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa8800/0x2f180c4effbada17 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x54:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eae01 expref: 28 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166988.738191:0:7432:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff945bc4aa8800/0x2f180c4effbada17 lrc: 3/0,0 mode: CR/CR res: [0x200000405:0x54:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.38@tcp remote: 0xa56c5e86028eae01 expref: 28 pid: 7432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1762166988.738209:0:7432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000405:0x54:0x0].0x0 (ffff945cc7df9e00) 00010000:00010000:1.0:1762166988.738213:0:7432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1762166988.738216:0:7432:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff945bc4aa8800, rc 0) 00000100:00100000:1.0:1762166988.738280:0:7432:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff945bc8121c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1e11365-ba0b-405b-99c9-a704373217f2+28:63371:x1847765450795776:12345-192.168.204.38@tcp:101:multiop.0 Request processed in 219us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1762166988.738288:0:7432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.38@tcp, seq: 31014 00000001:02000400:0.0:1762166989.314467:0:36085:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-flr test_200a: @@@@@@ FAIL: failed writing to 6115840:671584 00000001:02000400:3.0:1762166989.371539:0:36108:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-flr test_200a: @@@@@@ FAIL: failed writing to 1952000:1031936 00010000:00010000:2.0:1762166989.650700:0:7420:0:(ldlm_lockd.c:2829:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 72879 lines, 72879 kept, 0 dropped, 0 bad.